ECR 2012 Book of Abstracts - B - Scientific Sessions

European Society of Radiology (ESR)

doi:10.1007/s13244-012-0158-z

ECR 2012 Book of Abstracts - B - Scientific Sessions

Insights into imaging · 2012 · vol. 3(Suppl 1) , pp. 135–363 · doi:10.1007/s13244-012-0158-z · PMID:22696128 · PMC3481065

Other OA: gold CC-BY-4.0

📄 Open PDF Full text JSON View on PubMed View at publisher

⚙ AI-generated summary by qwen3.7-flash+body, 2026-10-12 ⓘ

This document is a table of contents for the European Congress of Radiology 2012 abstracts and does not contain research data on endometriosis or adenomyosis.

One-sentence paraphrase of the abstract; not a substitute for reading it. No clinical advice. How this works

⚙ AI-generated deep summary by qwen3.7-flash, 2026-10-12 · read from full text ⓘ

This document is a compilation of abstracts from the European Congress of Radiology 2012, featuring multiple independent studies on neuroimaging. The included research investigates topics such as diffusion restriction in acute stroke, vascular compression in hemifacial spasm, carotid plaque morphology, and intracranial pressure dynamics in arteriovenous malformations. Each abstract presents specific methodological approaches and findings related to cerebrovascular or neurological conditions without addressing gynecological pathology. The paper does not explicitly discuss endometriosis or adenomyosis; it was included in the corpus via a keyword match in the upstream search index.

Read from the paper's body, not the abstract. Not a substitute for reading the paper. No clinical advice. How this works

Full text 2,006,943 characters · extracted from oa-pdf · click to expand

6(XURSHDQ&RQJUHVVRI 5DGLRORJ\ 6HVVLRQQXPEHUVDUHSUHÀ[HGE\66 3UHVHQWDWLRQQXPEHUVDUHSUHÀ[HGE\ WKHOHWWHU% 6HVVLRQVDQGDEVWUDFWVDUHOLVWHGE\ GD\V 3UHVHQWDWLRQVIRUZKLFKWKHDXWKRUV KDYHVXEPLWWHGDGGLWLRQDOPDWHULDODQG LPDJHVWR(326DUHPDUNHGZLWK WKH LFRQ 7KXUVGD\ )ULGD\ 6DWXUGD\ 6XQGD\ 0RQGD\ % 6FLHQWLÀF6HVVLRQV DOI 10.1007/s13244-012-0158-z Insights Imaging (2012) 3 (Suppl 1):S135 S3633– 6FLHQWLILF6HVVLRQ 6 &$' ( ) *+% (XURSHDQ&RQJUHVVRI 5DGLRORJ\ 6FLHQWLILF6HVVLRQ $ 6&'()*+% 7KXUVGD\0DUFK (XURSHDQ&RQJUHVVRI 5DGLRORJ\ 6FLHQWLILF6HVVLRQ 6 &$' ( ) *+% (XURSHDQ&RQJUHVVRI 5DGLRORJ\ % 5HPLVVLRQRIGLIIXVLRQOHVLRQVLQDFXWHVWURNH05LPDJLQJD IROORZXSVWXG\ZLWKFRQVHFXWLYHSDWLHQWV ')ORHU\&*LQWKRHU5:XQQ) $)HOOQHU/LQ]$7GDQLHOÁRHU\#DNKOLQ]DW 3XUSRVH7KHPLVPDWFKFRQFHSWLQVWURNH05LVEDVHGRQWKHDVVXPSWLRQWKDW GLIIXVLRQZHLJKWHG LPDJLQJ LQGLFDWHV LQIDUFW FRUH UHSUHVHQWLQJLUUHYHUVLEO\ GDP DJHGWLVVXH+RZHYHUWKLVWKHVLVKDVQRW\HWEHHQSURYHQLQDODUJHSDWLHQWFRKRUW ZLWKDGHTXDWH05IROORZXS7KXVWKHDLPRIWKLVVWXG\ZDVWRDQDO\VHWHPSRUDO HYROXWLRQRIUHVWULFWHGGLIIXVLRQDWIROORZXS05ZLWKLQKRXUV 0HWKRGV DQG 0DWHULDOV FRQVHFXWLYH VWURNH SDWLHQWV ZLWKLQ PRQWKV GHPRQVWUDWLQJUHVWULFWHGGLIIXVLRQDWLQLWLDO05H[DPLQDWLRQZHUHHYDOXDWHG([WHQ VLRQRIGLIIXVLRQUHVWULFWLRQZDVMXGJHGERWKRQLQLWLDO05DVZHOODVRQIROORZXS DIWHUKRXUV&KDQJHVLQOHVLRQH[WHQVLRQZHUHDVVHVVHGE\WZRUDGLRORJLVWV LQGHSHQGHQWO\DVZHOODVRYHUDOOLPDJHTXDOLW\WLHUVFDOH 5HVXOWV([WHQVLRQRIOHVLRQVZLWKUHVWULFWHGGLIIXVLRQDWIROORZXS05ZDVLGHQWL FDOWRWKHLQLWLDOVFDQLQDQGLQFUHDVHGLQ7KH OHVLRQVZHUHGHFUHDVHGPHDQLQJSDUWLDOLQYROXWLRQRIWKHOHVLRQLQ DQGFRPSOHWHO\UHVROYHGLQ0HDQUDWLQJRILPDJHTXDOLW\ZDV IRULQLWLDO05,DQGIRUIROORZXS7KDWPHDQVLQWKHLQLWLDOOHVLRQZLWK UHVWULFWHGGLIIXVLRQSURYHGWREHWKHLQIDUFWLRQFRUHLQGHHGZKHUHDVLQSDUWLDO UHVROXWLRQZDVVHHQ2QO\LQRIDOOSDWLHQWVWKHLQLWLDOOHVLRQGLGQRWUHVXOWLQ FRPSOHWHLQIDUFWLRQ &RQFOXVLRQ2XUÀQGLQJVSURYHWKHH[LVWLQJDVVXPSWLRQWKDWGLIIXVLRQUHVWULFWLRQ UHSUHVHQWVLQIDUFWFRUHZKLFKPD\UHPDLQXQFKDQJHGRULQFUHDVHLQYROXPHRYHU WLPH LQGLFDWLQJ DQ DFFXUDF\ RI DOPRVW 3DUWLDO RU FRPSOHWH UHVROXWLRQ RI GLIIXVLRQUHVWULFWLRQLVH[WUHPHO\UDUH % $UWHULDOK\SHUWHQVLRQLVDVVRFLDWHGZLWKURVWUDOYHQWURODWHUDOPHGXOOD QHXURYDVFXODUFRPSUHVVLRQ 0+DUWHO 0:yMFLN05XG]LĸVND$6]F]XGOLN(.OXF]HZVND =DEU]H3/.UDNyZ3/.DWRZLFH3/KDUWHO#YR[HOSO 3XUSRVH9HQWURODWHUDOPHGXOOD9/0LVWKHYDVRPRWRUFHQWUHFRPSULVLQJQHX URQVZKLFKFRQWUROEORRGSUHVVXUHWKURXJKHIIHUHQWSDUDV\PSDWKHWLFFRQQHFWLRQV 3UHYLRXVVWXGLHVVXJJHVWWKDWK\SHUWHQVLRQLQKHPLIDFLDOVSDVP+)6SDWLHQWVLV FDXVHGE\9/0YDVFXODUFRPSUHVVLRQ 0HWKRGVDQG0DWHULDOV+)6SDWLHQWVDQGFRQWUROVPDWFKHGDFFRUGLQJWR DJHDQGVH[ZHUHVFDQQHGZLWK05,+\SHUWHQVLRQZDVFRQÀUPHGDFFRUGLQJWR :+2FULWHULD7KHFRPSUHVVLRQZDVJUDGHGIURPWRODFNRIYHVVHOFRQWDFW ZLWKEUDLQVWHPYHVVHOFRQWDFWZLWKQRVWHPFRPSUHVVLRQYHVVHOFRQWDFWZLWK PRGHUDWHVWHPFRPSUHVVLRQYHVVHOFRQWDFWZLWKPDUNHGEUDLQVWHPFRPSUHV VLRQDQGLWVGHIRUPDWLRQGLVSODFHPHQW6WDWLVWLFDODQDO\VLVZDVFDUULHGRXWXVLQJ &KLVTXDUHGWHVW 5HVXOWV9/0YDVFXODUFRPSUHVVLRQZDVVLJQLÀFDQWO\PRUHIUHTXHQWDPRQJSDU WLFLSDQWVZLWKYVZLWKRXWK\SHUWHQVLRQLQ+)6YVѯò S DVZHOODVLQFRQWUROJURXSYVѯò S 7KHRFFXUUHQFHRI 9/0FRPSUHVVLRQZDVQRWUHODWHGWRWKHERG\VLGH0DUNHGFRPSUHVVLRQJUDGHG DVDQGFRUUHODWHGZLWKDUWHULDOK\SHUWHQVLRQLQ+)6SDWLHQWV &RQFOXVLRQ+\SHUWHQVLRQLQERWKJURXSVZLWKDQGZLWKRXW+)6LVSUHVHQWVLJQLÀ FDQWO\RIWHQLQSDWLHQWVZLWK9/0FRPSUHVVLRQRQWKHULJKWRUWKHOHIWVLGHZLWKRXW ODWHUDOL]DWLRQ+\SHUWHQVLRQLVSUHVHQWPRUHRIWHQZLWKQGDQGUGJUDGH9/0 YDVFXODUFRPSUHVVLRQFRPSDULQJWRJUDGHDQG7KHVWXG\FRQÀUPHGFRUUHOD WLRQEHWZHHQRFFXUUHQFHRIK\SHUWHQVLRQDQG9/0YDVFXODUFRPSUHVVLRQQRWRQO\ LQ+)6EXWDOVRLQSDWLHQWVUHIHUUHGIRU05,GXHWRRWKHUGLVHDVHV7KHFHQWUDO PHFKDQLVPRIK\SHUWHQVLRQVKRXOGEHIXUWKHUHYDOXDWHG % &DURWLGDWKHURVFOHURWLFSODTXHPRUSKRORJ\DQGLVFKDHPLFYDVFXODU EUDLQGLVHDVHRQ05, 4-$YDQGHQ%RXZKXLMVHQ0:9HUQRRLM*3 .UHVWLQ:-1LHVVHQ 0$,NUDP$+RIPDQ-&0:LWWHPDQ$YDQGHU/XJW5RWWHUGDP1/ TYDQGHQERXZKXLMVHQ#HUDVPXVPFQO 3XUSRVH9XOQHUDEOHSODTXHFRPSRQHQWVLQFDURWLGDUWHULHVFDQEHGHWHFWHGQRQ LQYDVLYHO\ZLWKPDJQHWLFUHVRQDQFHLPDJLQJ05,,QDV\PSWRPDWLFSHUVRQVWKH UHODWLRQ EHWZHHQ FDURWLG SODTXH FRPSRVLWLRQ DQG YDVFXODU EUDLQGLVHDVH LV QRW ZHOOVWXGLHG:HVWXGLHGWKHDVVRFLDWLRQEHWZHHQFDURWLGDWKHURVFOHURWLFSODTXH FKDUDFWHULVWLFVDQGLVFKDHPLFEUDLQGLVHDVHRQ05, 0HWKRGVDQG0DWHULDOV)URPWKHSRSXODWLRQEDVHG5RWWHUGDP6WXG\SDUWLFL SDQWVZLWKFDURWLGZDOOWKLFNHQLQJRQXOWUDVRXQG!PPXQGHUZHQWERWKFDURWLG 05, DQG EUDLQ 05, 0D[LPXP FDURWLG ZDOO WKLFNHQLQJ GHJUHH RI VWHQRVLV DQG 5RRP% 1HXUR 66D 1HXURYDVFXODU05, 0RGHUDWRUV **XDUQLHUL1DSOHV,7 =0HUKHPLF6DUDMHYR%$ % 1RQLQYDVLYH&95DVVHVVPHQWXVLQJ$6/DQG%2/' $3RUWHOR,6RXVD3 9LOHOD3 )LJXHLUHGR/LVERQ37IHUURYLOHOD#VDSRSW 3XUSRVH:HDLPHGWRGHYHORSDUHSURGXFLEOHSURWRFROIRUQRQLQYDVLYHDVVHVV PHQWRIFHUHEURYDVFXODUUHDFWLYLW\&95FRPELQLQJDEUHDWKKROG%+FKDOOHQJH ZLWK&%)PHDVXUHPHQWVXVLQJ $6/LQFRPSDULVRQZLWKDPDWFKLQJ%2/'SURWRFRO 0HWKRGVDQG0DWHULDOV $JURXSRIKHDOWK\VXEMHFWVZDVVWXGLHGRYHUVHVVLRQV RQD705,%2/'LPDJHVZHUHREWDLQHGXVLQJ*((3,VHTXHQFHDQG $6/LPDJHV ZHUHREWDLQHGXVLQJ47,363,&25(VHTXHQFHIURPFRQWLJXRXVVOLFHV7KH%+ SURWRFROFRQVLVWHGRQ%2/'$6/F\FOHVRIV%+DOWHUQDWHGZLWKQRUPDO EUHDWKLQJ7KHGDWDZHUHDQDO\VHGXVLQJ)6/LQFOXGLQJVWDQGDUGSUHSURFHVVLQJ VWHSVDQGJHQHUDOOLQHDUPRGHOVWDWLVWLFDODQDO\VLV%RWK%2/'DQG&%)PDSVRI &95ZHUHREWDLQHGIRUHDFKVXEMHFWDQGVHVVLRQVKRZLQJVLJQLÀFDQWUHVSRQVHV WR%+HVSHFLDOO\LQJUH\PDWWHU&95PHDVXUHPHQWVZHUHREWDLQHGDVSHUFHQW VLJQDOFKDQJHVDYHUDJHGDFURVVWKHDFWLYDWLRQPDSVDVVRFLDWHGZLWKWKH%2/' DQG&%)UHVSRQVHV,QWUDDQGLQWHUVXEMHFWYDULDELOLW\ZDVPHDVXUHGLQWHUPVRI WKHUHVSHFWLYHFRHIÀFLHQWVRIYDULDWLRQ&9 5HVXOWV7KHPHDQSHUFHQWVLJQDOFKDQJHDYHUDJHGDFURVVWKH&95PDSVZDV DQG IRU %2/' VHVVLRQV DQG DQG IRU%2/'$6/VHVVLRQVDQGDQGDQGIRU&%)VHVVLRQVDQG 7KHLQWUDDQGLQWHUVXEMHFWYDULDELOLW\ZDV&9LQWUD DQG&9LQWHU IRU %2/' &9LQWUD DQG &9LQWHU IRU %2/'$6/ DQG &9LQWUD DQG &9LQWHU IRU&%) &RQFOXVLRQ1RQLQYDVLYH&95DVVHVVHGE\I05,E\PHDVXULQJWKH%2/'DQG &%)UHVSRQVHVWREUHDWKKROG%+FKDOOHQJHVLVDUHSURGXFLEOHPHWKRG % $FXWHRQVHWPLJUDLQRXVDXUDPLPLFNLQJDFXWHVWURNH05SHUIXVLRQ LPDJLQJIHDWXUHV ')ORHU\ 059RVNR) $)HOOQHU) *UXEHU&*LQWKRHU *5DQVPD\U08GHU:*%UDGOH\&)HOOQHU/LQ]$7(UODQJHQ'( 6DQ'LHJR&$865HJHQVEXUJ'(GDQLHOÁRHU\#DNKOLQ]DW 3XUSRVH,QDYHU\OLPLWHGQXPEHURIFDVHVDFXWHPLJUDLQRXVDXUDPD\SUHVHQW FOLQLFDOO\DVDFXWHEUDLQLQIDUFWLRQ6LQFHWKHVHSDWLHQWVLQFUHDVLQJO\XQGHUJRVWURNH 05WKHDLPRIWKLVVWXG\ZDVWRHYDOXDWHSDWWHUQVRI05SHUIXVLRQDEQRUPDOLWLHV LQDFXWHPLJUDLQRXVDXUD 0HWKRGVDQG0DWHULDOV,QDUHWURVSHFWLYHDQDO\VLV05VWXGLHVSHUIRUPHG IRU WKH VXVSLFLRQ RI DFXWH EUDLQ LQIDUFWLRQ ZHUH DQDO\VHG IRU SDWLHQWV VXIIHULQJ IURPDFXWHPLJUDLQRXVDXUDDQGQRWIURPVWURNHFOLQLFDOO\DQGLPDJLQJEDVHG $OOSDWLHQWVZHUHH[DPLQHGFOLQLFDOO\E\WZRQHXURORJLVWVDQGXQGHUZHQWDVWURNH 05 SURWRFRO LQFOXGLQJ SHUIXVLRQZHLJKWHG LPDJLQJ 7ZR UDGLRORJLVWV UHYLHZHG SHUIXVLRQPDSVYLVXDOO\DQGTXDQWLWDWLYHIRUSUHVHQFHYDVFXODUWHUULWRU\DQGJUDGH RISHUIXVLRQDEQRUPDOLW\ 5HVXOWV$PRQJ05VWXGLHVSDWLHQWVZHUHIRXQGZKRUHFHLYHG DFXWHPLJUDLQRXVDXUDDVWKHÀQDOGLDJQRVLVDIWHUFRPSOHWHFOLQLFDODQGLPDJLQJ ZRUNXS+\SRSHUIXVLRQZDVIRXQGLQRISDWLHQWVZLWKGHOD\HGU077 DQG773DQGGHFUHDVHGU&%9DQGU&%) QRWFRQÀQHGWRDVLQJOHYDVFXODUWHUULWRU\ %LODWHUDOK\SRSHUIXVLRQZDVVHHQLQFDVHVLQFDVHVK\SRSHUIXVLRQZLWK DSRVWHULRUSUHGRPLQDQFHZDVIRXQG773DQGU077ZHUHWKHEHVWPDSVWRGHSLFW SHUIXVLRQFKDQJHVDWYLVXDODVVHVVPHQWEXWDOVRU&%)PDSVGHPRQVWUDWHGVLJ QLÀFDQWK\SRSHUIXVLRQDWTXDQWLWDWLYHDQDO\VLV,QDOOSDWLHQWVFOLQLFDODQGLPDJLQJ IROORZXSZDVQHJDWLYHIRUVWURNH &RQFOXVLRQ$FXWHPLJUDLQRXVDXUDLVDUDUHEXWLPSRUWDQWGLIIHUHQWLDOGLDJQRVLV DPRQJSDWLHQWVUHIHUUHGIRU05XQGHUWKHVXVSLFLRQRIDFXWHEUDLQLQIDUFWLRQ&KDU DFWHULVWLFSHUIXVLRQDEQRUPDOLWLHVFDQEHVHHQLQWKHPDMRULW\RIFDVHV 6FLHQWLILF6HVVLRQ $ 6&'()*+% 7KXUVGD\ (XURSHDQ&RQJUHVVRI 5DGLRORJ\ % 3UHVHUYHGUHJXODWLRQRILQWUDFUDQLDOSUHVVXUHLQSDWLHQWVZLWK FHUHEUDODUWHULRYHQRXVPDOIRUPDWLRQV ) *0HLQHO -)LVFKHU1:RHKUOH,.RHUWH'6WHIÀQJHU53 /DXEHQGHU 0) 5HLVHU1$OSHULQ%(UWO:DJQHU0XQLFK'(0LDPL)/86 IHOL[PHLQHO#PHGXQLPXHQFKHQGH 3XUSRVH&HUHEUDODUWHULRYHQRXVPDOIRUPDWLRQVF$90VPD\OHDGWRDVLJQLÀFDQW PDVVHIIHFW7 RLGHQWLI\SDWLHQWVDWULVNZHQRQLQYDVLYHO\HYDOXDWHGLQWUDFUDQLDO SUHVVXUH,&3LQSDWLHQWVZLWKF$90VDQGFRUUHODWHGLWZLWKQLGXVYROXPH 0HWKRGVDQG0DWHULDOVFRQVHFXWLYHF$90SDWLHQWVDQGFRQWUROVPDWFKHG IRUDJHDQGJHQGHUZHUHLQYHVWLJDWHGZLWKD7 HVOD05,VFDQQHU1LGXVYROXPH ZDVTXDQWLÀHGE\05DQJLRJUDSK\7 RWDODUWHULDOFHUHEUDOEORRGÁRZW&%)YH QRXVRXWÁRZDQGDTXHGXFWDODQGFUDQLRVSLQDO&6)VWURNHYROXPHVZHUHREWDLQHG XVLQJYHORFLW\HQFRGHGFLQHSKDVHFRQWUDVW05,,&3ZDVGHULYHGIURPV\VWROLF LQWUDFUDQLDOYROXPHFKDQJH,&9&DQGSXOVHSUHVVXUHJUDGLHQW 5HVXOWVW&%)ZDVIRXQGWREHVLJQLÀFDQWO\KLJKHULQF$90SDWLHQWVPHGLDQQLGXV YROXPHFPUDQJHFPDVFRPSDUHGWRFRQWUROVPHGLDQYV P/PLQS7KHPDMRUSURSRUWLRQRILQFUHDVHGYHQRXVRXWÁRZZDVIRXQG LQWKHLSVLODWHUDOLQWHUQDOMXJXODUYHLQ,-9YVP/PLQS ZKLOHWKHUH ZDVQRVLJQLÀFDQWLQFUHDVHLQVHFRQGDU\YHQRXVRXWÁRZHSLGXUDOYHUWHEUDODQG GHHSFHUYLFDOYHLQVYVP/PLQS 7KHUHZDVQRVLJQLÀFDQWGLIIHUHQFH LQPHGLDQ,&3EHWZHHQF$90SDWLHQWVDQGKHDOWK\VXEMHFWVYVPP+J S DQG,&3GLGQRWFRUUHODWHZLWKQLGXVYROXPHLQF$90SDWLHQWV6SHDUPDQ V UKR :HGLGQRWREVHUYHVLJQLÀFDQWGLIIHUHQFHVEHWZHHQSDWLHQWVDQGFRQWUROV UHJDUGLQJ,&9&FUDQLRVSLQDORUDTXHGXFWDOVWURNHYROXPH &RQFOXVLRQ,&3LVNHSWZLWKLQQRUPDOOLPLWVHYHQLQSDWLHQWVZLWKODUJHF$90V QLGXVYROXPHXSWRFP(OHYDWHGYHQRXVRXWÁRZLVPRVWO\IRXQGLQWKH LSVLODWHUDOMXJXODUYHLQV % ,QWUDFUDQLDOSUHVVXUHDFURVVWKHOLIHVSDQDVWXG\ZLWKSKDVH FRQWUDVWLPDJLQJ ,.RHUWH $3RPVFKDU53 /DXEHQGHU'6WHIÀQJHU) +HLQHQ05HLVHU 1$OSHULQ%(UWO:DJQHU0XQLFK'(0LDPL)/86 3XUSRVH,QWUDFUDQLDOSUHVVXUH,&3LVDQLPSRUWDQWFOLQLFDOSDUDPHWHUIRUGLDJ QRVWLFDQGWKHUDSHXWLFGHFLVLRQPDNLQJDQGIROORZXSIRUH[DPSOHLQK\GURFHSKD OXV WUDXPDWLF EUDLQ LQMXU\ QRUPDO SUHVVXUH K\GURFHSKDOXV 13+ RU LGLRSDWKLF LQWUDFUDQLDOK\SHUWHQVLRQ,,++RZHYHUQRUPDWLYHGDWDDFURVVWKHOLIHVSDQDUH QRW DYDLODEOH XQWLO SUHVHQW :H DLPHG WR QRQLQYDVLYHO\ DVVHVVWKH LQWUDFUDQLDO SUHVVXUHLQKHDOWK\VXEMHFWVDFURVVWKHOLIHVSDQXVLQJ05, 0HWKRGVDQG0DWHULDOV$IWHULQIRUPHGFRQVHQWKHDOWK\VXEMHFWVPDOHV IHPDOHVDJHWR\HDUVZHUHLQYHVWLJDWHGRQD705,&LQHSKDVHFRQWUDVW VHTXHQFHVZHUHSHUIRUPHGWRTXDQWLI\DUWHULDOLQÁRZYHQRXVRXWÁRZDQGFUDQLRV SLQDO&6)ÁRZWRGHULYHDQ05HVWLPDWHRILQWUDFUDQLDOFRPSOLDQFHIURPWKHUDWLR RIWKHPD[LPDOYROXPHDQGSUHVVXUHFKDQJHVWKDWRFFXUGXULQJWKHFDUGLDFF\FOH ,QWUDFUDQLDOSUHVVXUH05,&3ZDVHVWLPDWHGEDVHGRQWKHLQYHUVHUHODWLRQVKLS EHWZHHQFRPSOLDQFHDQGSUHVVXUH'DWDZHUHDQDO\VHGXVLQJOLQHDUUHJUHVVLRQ 5HVXOWV$QLQFUHDVHRIDJHE\RQH\HDUSUHGLFWHGDGHFOLQHE\XQLWVRI VTXDUHURRWHG05,&3SKROGLQJJHQGHUFRQVWDQW:RPHQVKRZHGD PP+JFRQÀGHQFHLQWHUYDOS KLJKHU05,&3ZKHQ FRPSDUHGWRPHQKROGLQJDJHFRQVWDQW &RQFOXVLRQ 1RQLQYDVLYHO\ PHDVXUHG 05,&3 GHFUHDVHV ZLWK DJH ZLWK D JHQGHUGHSHQGHQFH7KHVHDJHDQGJHQGHUUHODWHGFKDQJHVQHHGWREHWDNHQ LQWRFRQVLGHUDWLRQZKHQSDWLHQWVZLWKVXVSHFWHGSDWKRORJ\DUHHYDOXDWHG SUHVHQFHRILQWUDSODTXHKDHPRUUKDJHOLSLGFRUHDQGFDOFLÀFDWLRQZHUHDVVHVVHGLQ ERWKFDURWLGDUWHULHV $VVRFLDWLRQVEHWZHHQSODTXHFKDUDFWHULVWLFVDQGZKLWHPDWWHU OHVLRQV:0/VODFXQDUDQGFRUWLFDOLQIDUFWVZHUHLQYHVWLJDWHGSHUSDUWLFLSDQWDQG DGGLWLRQDOO\SHUFDURWLGDUWHU\ $QDO\VLVZHUHDGMXVWHGIRUFDUGLRYDVFXODUULVNIDFWRUV 5HVXOWV&DURWLGVWHQRVLV25SHUVWHQRVLVLQFUHDVHFRQÀGHQFH LQWHUYDOPD[LPXPFDURWLGZDOOWKLFNQHVVSHUPPLQFUHDVH LQ WKH SUHVHQFH RI LQWUDSODTXH KDHPRUUKDJH ZHUH DOO IRXQG WR EH VLJQLÀFDQWO\DVVRFLDWHGZLWKWKHSUHVHQFHRIFRUWLFDOLQIDUFWVERWKLQWKHSDUWLFLSDQW EDVHGDQDO\VLVDQGLQWKHFDURWLGDUWHU\EDVHGDQDO\VLV7KHUHZHUHQRDVVRFLDWLRQV EHWZHHQDQ\SODTXHFKDUDFWHULVWLFVDQGSUHVHQFHRIODFXQDULQIDUFWV,QWKHVXEMHFW EDVHGDQDO\VLVPD[LPXPSODTXHWKLFNQHVVSUHVHQFHRILQWUDSODTXHKDHPRUUKDJH DQGFDOFLÀFDWLRQZHUHDVVRFLDWHGZLWK:0/YROXPH,QWKHDUWHU\EDVHGDQDO\VLV RQO\WKHDVVRFLDWLRQIRUFDOFLÀFDWLRQVUHPDLQHG &RQFOXVLRQ 3UHVHQFH RI FDURWLG LQWUDSODTXH KDHPRUUKDJH DQG PHDVXUHV RI FDURWLG SODTXH VL]H DUH LQGHSHQGHQWO\ DVVRFLDWHG ZLWK FRUWLFDOLQIDUFWV EXW QRW ZLWKODFXQDULQIDUFWV3ODTXHFDOFLÀFDWLRQEXWQRWYXOQHUDEOHSODTXHFRPSRQHQWV LVUHODWHGWR:0/YROXPH % 3URJUHVVLRQRIWKHPXOWLSOHK\SRLQWHQVHYHVVHOVLJQRQWKH VXVFHSWLELOLW\ZHLJKWHGLPDJHVDIWHUUHFDQDOLVDWLRQLQSDWLHQWVZLWK K\SHUDFXWHLVFKDHPLFVWURNH < :.LP6%DLN-< -DQJ6$KQ<DQJVDQ.5YLPJV#KDQPDLOQHW 3XUSRVH 7KH PXOWLSOH K\SRLQWHQVH YHVVHO VLJQ 0+96 RQ WKH 6:, KDV EHHQ UHSRUWHGWRLGHQWLI\WKHLVFKDHPLFWHUULWRU\LQSWVZLWKK\SHUDFXWHLVFKDHPLFVWURNH :HHYDOXDWHGWKHSURJUHVVLRQRIWKLV0+96RQWKHLPPHGLDWH6:,DIWHUUHFDQDOLVD WLRQDQGLWVFOLQLFDOLPSOLFDWLRQV 0HWKRGVDQG0DWHULDOVK\SHUDFXWHLVFKDHPLFVWURNHSWVZKRZHUHWUHDWHG ZLWKLQWUDDUWHULDORULQWUDYHQRXVWKURPERO\VLVZLWKLQKRXUVRI6[RQVHWDQGZKR XQGHUZHQW LPPHGLDWH 05, DIWHU UHFDQDOLVDWLRQ ZHUH HQUROOHG LQ WKLV VWXG\ 7KH UHFDQDOLVDWLRQVWDWXVZDVHYDOXDWHGLQFHUHEUDOLQIDUFWLRQ7,&,VFRUHEHIRUHDQG DIWHU WKURPERO\VLV7KH 6:,V ZHUH HYDOXDWHG IRU WKH SUHVHQFH RI 0+96 LQ WKH LVFKDHPLFWHUULWRU\7KHYHLQVLQWKHLVFKDHPLFWHUULWRU\ZHUHFODVVLÀHGLQWRJUDGHV 5HVXOWV7KHLQLWLDO7,&,JUDGHVZHUHLQFDVHVDQGELQFDVHV$IWHUWKURP ERO\VLVWKH7,&,JUDGHVZHUHLQDOOFDVHV7KH6:,VVKRZHGWKH0+96RYHUWKH DIIHFWHGVLGHLQDOOSWVEHIRUHUHFDQDOLVDWLRQ$IWHUUHFDQDOLVDWLRQDOOSWV GLGQRWVKRZWKH0+96RQ6:,7KHREVHUYHGYHLQVLQWKHDIIHFWHGDUHDZHUH HTXDOLQSWVOHVVLQSWVDQGHTXDODQGOHVVWRJHWKHULQRQHSW &RQFOXVLRQ7KH0+96RQ6:,FDQEHLQGLFDWLYHRIDFXWHWKURPERHPEROLFRF FOXVLRQ DQG LWV FKDQJH LPPHGLDWHO\ DIWHU UHFDQDOLVDWLRQ FDQ EHXVHG WR SUHGLFW WKHVWDWXVRIWKHÀQDOLQIDUFWLRQ$IWHUUHFDQDOLVDWLRQWKHDSSHDUDQFHRIWKHHTXDO FRUWLFDOYHVVHOVLJQUHWXUQWRQRUPDORQ6:,ZDVDVVRFLDWHGZLWKDIDYRXUDEOH FOLQLFDORXWFRPHDQGHVFDSHGLQIDUFWLRQLQRXUVPDOOVHULHVVWXG\ % 8WLOLW\RIVXVFHSWLELOLW\ZHLJKWHGLPDJLQJIRUGHWHFWLRQRIFDURWLG FDYHUQRXVÀVWXODDFDVHFRQWUROVWXG\ +-.DPEOH5-%DVWL&-.HVDYDGDV%-7KRPDV7KLUXYDQDQWKSXUDP,1 3XUSRVH 7 R GHWHUPLQH WKH XWLOLW\ DQG DFFXUDF\ RI VXVFHSWLELOLW\ZHLJKWHG 05, 6:,IRUWKHGHWHFWLRQRIFDURWLGFDYHUQRXVÀVWXOD 0HWKRGVDQG0DWHULDOV:HUHWURVSHFWLYHO\LGHQWLÀHGSDWLHQWVJURXSRI'6$ SURYHGFDURWLGFDYHUQRXVÀVWXOD&&)>FDVHJURXS@SDWLHQWVJURXS'6$ QHJDWLYH IRU &&) >FRQWURO JURXS@ DQG SDWLHQWV RI FDYHUQRXV VLQXV WKURPERVLV ZLWKSURPLQHQW629JURXS)RUDOOSDWLHQWV6:,VHTXHQFHZDVDYDLODEOH8VLQJ XQLIRUPUHJLRQRILQWHUHVW52,VLJQDOLQWHQVLW\ZLWKLQVXSHULRURSKWKDOPLFYHLQ 629DQGVXSHULRUVDJLWWDOVLQXV666ZHUHPHDVXUHGLQPDJQLWXGHLPDJH629 666VLJQDOLQWHQVLW\UDWLRZDVFDOFXODWHGLQHDFKSDWLHQWPHDQYDOXHVRIWKHWKUHH JURXSVZHUHFRPSDUHGIRUDFFXUDF\ 5HVXOWV629666VLJQDOLQWHQVLW\UDWLRVLQJURXSLQJURXSDQGLQ JURXSZHUHLQFOXGHG0HDQVWDQGDUGGHYLDWLRQRI629666UDWLRVIRUJURXS JURXSJURXSLQGLUHFWW\SHDQGGLUHFWW\SHZHUH DQGUHVSHFWLYHO\0DQQ:KLWQH\WDLOHG WHVWEHWZHHQJURXSDQGDQGJURXSDQGZDVVWDWLVWLFDOO\VLJQLÀFDQWZLWK 33VLJQLÀFDQW $OOFDVHVDQGFRQWUROVZHUHUHOLDEO\GLVWLQJXLVKHG ZLWK629666VLJQDOLQWHQVLW\UDWLRRIDVFXWRII7KLVLQFUHDVHGVLJQDOLQWHQVLW\ UDWLRZDVEHFDXVHRIDUWHULDOLVHGÁRZLQ629VHFRQGDU\WR&&) &RQFOXVLRQ6:,LVIHDVLEOHDVZHOODVDFFXUDWHIRUGHWHFWLRQRIERWKGLUHFWDQG LQGLUHFWFDURWLGFDYHUQRXVÀVWXODDQGQRQLQYDVLYHIROORZXSRIWUHDWHGSDWLHQWV 6FLHQWLILF6HVVLRQ 6 &$' ( ) *+% (XURSHDQ&RQJUHVVRI 5DGLRORJ\ % 0XOWL]RQHWXPRXUPRGHOH[SRVHGE\PXOWLSDUDPHWULFG\QDPLF FRQWUDVWHQKDQFHGDQGGLIIXVLRQZHLJKWHG05LPDJLQJ .+RO]DSIHO&*DQWHU06HWWOHV6/RUHQ]HQ$-%HHU(-5XPPHQ\ 60HW]0XQLFK'(KRO]DSIHO#URHPHGWXPGH 3XUSRVH7 RFRUUHODWHNLQHWLFSDUDPHWHUVGHULYHGIURPG\QDPLFFRQWUDVWHQKDQFHG 05LPDJLQJ'&(05,ZLWKDSSDUHQWGLIIXVLRQFRHIÀFLHQW$'&YDOXHVGHWHUPLQHG E\GLIIXVLRQZHLJKWHG05LPDJLQJ':,LQDVSDWLDOO\UHVROYHGPXOWLSDUDPHWULF LPDJLQJDSSURDFKIRUSKHQRW\SLQJRIWXPRXUELRORJ\LQOLYLQJRUJDQLVPV 0HWKRGV DQG 0DWHULDOV ,Q FKHPRQDLYH SDWLHQWV ZLWK KLVWRORJLFDOO\ SURYHQ DGHQRFDUFLQRPDVRIWKHOXQJRUWKHJDVWURLQWHVWLQDOWUDFWOHVLRQVZHUHLPDJHG ':, '&(05, 7UDQVIHU FRQVWDQW .WUDQV UDWH FRQVWDQW NHS DQG IUDFWLRQDO H[WUDYDVFXODU H[WUDFHOOXODU VSDFH YH ZHUH FDOFXODWHG IRU HDFK SL[HO 7LVVXH ' VRIWZDUH 6LHPHQV DQG FRUUHODWHG ZLWK$'& YDOXHV :KROH WXPRXU UHJLRQV RI LQWHUHVW52,VZHUHFRPSDUHGXVLQJWKH6SHDUPDQҋVUDQNFRUUHODWLRQFRHIÀFLHQW $GGLWLRQDOO\SDUDPHWHUVZHUHFRUUHODWHGRQDSL[HOE\SL[HOEDVLVDQGWRUHÁHFW VSDWLDOKHWHURJHQHLW\DOOWXPRXUVHFWLRQVZHUHGLYLGHGLQWRSL[HOULQJVSHULSKHU\ WRFHQWUH 5HVXOWV)RUZKROHWXPRXU52,VQRVLJQLÀFDQWFRUUHODWLRQEHWZHHQ$'&YDOXHV DQG NLQHWLF SDUDPHWHUV FRXOG EH GHPRQVWUDWHG +RZHYHU SL[HOZLVH DQDO\VLV RI $'&DQGNLQHWLFSDUDPHWHUVUHYHDOHGDGLVWLQFWSDWWHUQLQVSDWLDOGLVWULEXWLRQRI WKHSDUDPHWHUVUHVWULFWHG$'&KLJKHVW.WUDQVDQGYHYDOXHVLQWKHWXPRXUULP YHU\KLJK$'&YDOXHVDQGEUHDNGRZQLQSHUIXVLRQLQWKHFHQWUHLQFUHDVLQJ$'& YDOXHVFRQVWDQW.WUDQVDQGLQFUHDVLQJNHSLQDWUDQVLWLRQDO]RQHZKHQDSSURDFK LQJIURPSHULSKHUDOO\WRFHQWUDOO\ &RQFOXVLRQ1RQLQYDVLYHPXOWLSDUDPHWULFDVVHVVPHQWRIWKHVSDWLDOKHWHURJHQHLW\ RIWXPRXUELRORJ\LVIHDVLEOHXVLQJ'&(05,DQG':,&RPELQLQJERWKIXQFWLRQDO LPDJLQJPHWKRGVLGHQWLÀHVWXPRXUUHJLRQVZLWKGLIIHUHQWELRORJLFDOFKDUDFWHULVWLFV H[SRVLQJDPXOWL]RQHWXPRXUPRGHO % 3HUIXVLRQ&7VXEFODVVLÀHV)'*3(7PHWDEROLFUHVSRQGHUVLQ RHVRSKDJRJDVWULFDGHQRFDUFLQRPD 7 6$KHDUQ53HWW\*%DLQ$'HQLVRQ$:HOVFK9&XQQLQJKDP /6FKZHLJHU) *LOEHUW$EHUGHHQ8.IMJLOEHUW#DEGQDFXN 3XUSRVH ,GHQWLI\LQJ SUHGLFWLYH ELRPDUNHUV WR RSWLPLVH WUHDWPHQW VHOHFWLRQ LQ RHVRSKDJRJDVWULF DGHQRFDUFLQRPD 2*& DQG WR DYRLG LQHIIHFWLYHWUHDWPHQW LV LPSRUWDQW$URXQG RI RHVRSKDJHDO FDQFHU SDWLHQWV WKDW KDYHD PHWDEROLF UHVSRQVH05WRFKHPRWKHUDS\ZLWK)'*3(7DWGD\VJRRQWRUHVSRQGWRWKH IXOOFRXUVHRIWUHDWPHQW $VSDUWRIDODUJHUVWXG\ZHLQYHVWLJDWHGWKHSUHGLFWLYHDF FXUDF\RIFRPELQLQJSHUIXVLRQ&73&7ZLWK)'*3(7IRUFKHPRWKHUDS\UHVSRQVH 0HWKRGVDQG0DWHULDOV/RFDOO\DGYDQFHGPHWDVWDWLF2*&SDWLHQWVZHUHUHFUXLWHG LQWRWKH3&7DUPRIWKHVWXG\Q ,PDJLQJZDVSHUIRUPHGRQGD\VDQG DIWHUFKHPRWKHUDS\)'*3(7DQG3&73DWLHQWVZHUHFODVVLÀHG05LIVWDQGDUG XSWDNHYDOXHV689GHFUHDVHZDV!3&7ZDVSHUIRUPHGZLWKIUDPHV .9S P$V PO RI 2PQLSDTXH ZDV LQIXVHG DW IUDPH ,PDJHV ZHUHDQDO\VHGRIÁLQHXVLQJLQKRXVHVRIWZDUH3HUIXVLRQDQGEORRGYROXPHZHUH FDOFXODWHGXVLQJWKHPD[LPXPVORSHPRGHO3&7SDWLHQWVKDYHEHHQDQDO\VHG 5DGLRORJLFDOUHVSRQVH55ZDVDVVHVVHGE\5(&,67YDVVHVVPHQWVZHUH EDVHGRQDVVHVVPHQWRIWKHSULPDU\WXPRXU 5HVXOWVSDWLHQWVZHUHFODVVLÀHGDVPHWDEROLFUHVSRQGHUVZHUHDOVR UDGLRORJLFUHVSRQGHUV7XPRXUSHUIXVLRQZDVVLJQLÀFDQWO\LQFUHDVHGS LQ )'*3(705VPHDQLQFUHDVHWKDWGRJRRQWRKDYHD55DVFRPSDUHGWR WKRVHWKDWGRQRWKDYHD55PHDQLQFUHDVH &RQFOXVLRQ3&7SRWHQWLDOO\VXEFODVVLÀHV)'*3(7PHWDEROLFUHVSRQGHUVLQWR SDWLHQWVWKDWZLOODQGZLOOQRWJRRQWRWRKDYHDUDGLRORJLFDOUHVSRQVH3&7PD\KDYH FOLQLFDOXWLOLW\LQFRPELQDWLRQZLWK)'*3(7DVDSUHGLFWLYHELRPDUNHUWRRSWLPLVH WUHDWPHQWVHOHFWLRQLQ2*& % ,QWUDYR[HOLQFRKHUHQWPRWLRQ,9,0DQDO\VLVRIEUHDVWFDUFLQRPDVD SLORWVWXG\ $0&KRZ9$L3 6< &KHXQJ.0&KDQ6.<X**/R+DSS\9DOOH\+. DSULOFPN#JPDLOFRP 3XUSRVH 7 R FKDUDFWHULVH FKDQJHV LQ GLIIXVLRQ DQG SHUIXVLRQ HIIHFWV LQEUHDVW FDUFLQRPDVXVLQJLQWUDYR[HOLQFRKHUHQWPRWLRQ,9,0DQDO\VLV 0HWKRGVDQG0DWHULDOVIHPDOHSDWLHQWVZLWKELRSV\SURYHQEUHDVWFDUFLQRPDV ZHUHSURVSHFWLYHO\HYDOXDWHG$OO05,H[DPLQDWLRQVZHUHSHUIRUPHGRQD705, VFDQQHU0$*1(7207ULR6LHPHQVXVLQJDGHGLFDWHGFKDQQHOSKDVHGDUUD\ FRLO$ VLQJOHVKRW HFKRSODQDU LPDJLQJ ':, SURWRFRO ZDV SHUIRUPHG WR REWDLQ 5RRP& 2QFRORJLF,PDJLQJ 66 7XPRXUELRORJ\UHVSRQVHDQGSURJQRVLV 0RGHUDWRUV *%URZQ6XWWRQ8. 13RZHU:DWHUIRUG,( % 'LIIXVLRQZHLJKWHGLPDJLQJDQLPSHUIHFWELRPDUNHUIRUWKH PDOLJQDQF\RIEUHDVWWXPRXUV +%LFNHO.3LQNHU'RPHQLJ:%RJQHU6*UXEHU0:HEHU7+HOELFK 9LHQQD$7KXEHUWELFNHO#PHGXQLZLHQDFDW 3XUSRVH7 RHYDOXDWHGLIIHUHQFHVLQDSSDUHQWGLIIXVLRQFRHIÀFLHQW$'&YDOXHVRI GLIIHUHQWW\SHVDQGJUDGHVRIPDOLJQDQWEUHDVWWXPRXUVDQGWKHLQÁXHQFHRIWKHVH GLIIHUHQFHVRQWKHGLDJQRVWLFDFFXUDF\RIGLIIXVLRQZHLJKWHG':,05,DW7 0HWKRGVDQG0DWHULDOVSDWLHQWVZLWKSUHGHWHFWHGIRFDOEUHDVWOHVLRQV ZHUHLQFOXGHG$OOVFDQVZHUHSHUIRUPHGRQD705LPDJHUEHIRUHWKHDSSOLFD WLRQRIDQ\WKHUDS\ $7ZHLJKWHGVHTXHQFHDGLIIXVLRQZHLJKWHGVLQJOHVKRWHFKR SODQDU LPDJLQJ GLIIXVLRQZHLJKWHG VHTXHQFH ZLWK EYDOXHV VHFP DQG DG\QDPLFFRQWUDVWHQKDQFHG'&(7VHTXHQFHZHUHDSSOLHG/HVLRQVZHUH LGHQWLÀHG RQ WKH '&(VHTXHQFH DQG$'& ZDV PHDVXUHG LQ WKH FRUUHVSRQGLQJ $'&PDSV XVLQJ GLPHQVLRQDO UHJLRQV RI LQWHUHVW$Q$'&WKUHVKROG RI ðPPòVZDVXVHGWRGLIIHUHQWLDWHEHQLJQIURPPDOLJQDQWOHVLRQV$OOOHVLRQV ZHUHELRSVLHGDQGKLVWRSDWKRORJLFDOO\FODVVLÀHGXVLQJWKH710V\VWHP 5HVXOWV:KLOH$'&YDOXHVZHUHVLJQLÀFDQWO\ORZHULQDOOVXEW\SHVRIPDOLJQDQW WXPRXUVWKDQLQEHQLJQOHVLRQV$'&YDOXHVRIQRQLQYDVLYHOHVLRQVZHUHVLJQLÀ FDQWO\KLJKHUWKDQWKRVHRILQYDVLYHRQHV7XPRXUJUDGHVLQYHUVHO\FRUUHODWHGZLWK $'&YDOXHVEXWWKHGLIIHUHQFHZDVRQO\VLJQLÀFDQWEHWZHHQJUDGH,DQGJUDGH,,, OHVLRQV:KLOHWKHRYHUDOOVHQVLWLYLW\DQGVSHFLÀFLW\RI':,ZHUH JRRGDQDO\VLVRIWKHGLIIHUHQWWXPRXUVXEW\SHVUHYHDOHGDVHQVLWLYLW\RIRQO\ IRUQRQLQYDVLYHWXPRXUVZKLOHIRULQYDVLYHWXPRXUVLQYDVLYHGXFWDODQG LQYDVLYHOREXODUFRXOGEHREWDLQHG &RQFOXVLRQ1RQLQYDVLYHEUHDVWWXPRXUVPD\SUHVHQWVLJQLÀFDQWO\KLJKHU$'& YDOXHVWKDQLQYDVLYHRQHV7KLVPD\OHDGWRPDQ\IDOVHQHJDWLYHUHVXOWVZKLFK KDVWREHFRQVLGHUHGZKHQXVLQJ':,DVDGLDJQRVWLFWRRO % $QHZGLIIXVLRQZHLJKWHG05LPDJLQJDSSURDFKIRUHYDOXDWLQJ UHVSRQVHWRVRUDIHQLEWUHDWPHQWLQDGYDQFHGKHSDWRFHOOXODUFDUFLQRPD 0/HZLQ /)DUWRX[$9LJQDXG/$UULYH< 0HQX25RVPRUGXF 9LOOHMXLI)53DULV)56DLQW'HQLV)5PDLWHOHZLQ#SEUDSKSIU 3XUSRVH7 RSURVSHFWLYHO\HYDOXDWHWKHDSSDUHQWGLIIXVLRQFRHIÀFLHQW$'&WKH SXUHGLIIXVLRQFRHIÀFLHQW'DQGWKHSHUIXVLRQIUDFWLRQILQDGYDQFHGKHSDWRFHO OXODUFDUFLQRPD+&&SDWLHQWVUHFHLYLQJVRUDIHQLE 0HWKRGVDQG0DWHULDOV'LIIXVLRQZHLJKWHGLPDJLQJ':,ZDVSHUIRUPHGLQ SDWLHQWVXVLQJEYDOXHVRIDQGVPP7ZRWXPRXUVZHUHDQDO\VHG LQHDFKSDWLHQWDWEDVHOLQHZHHNVDQGPRQWKVWUHDWPHQW$'&'DQGIZHUH FDOFXODWHGE\VWDWLVWLFDOUHJUHVVLRQ 5HVXOWV 7KH PHDQV RI OHVLRQ VL]H$'& DQG ' YDOXHV GLG QRW FKDQJH XQGHU WUHDWPHQWUHVSHFWLYHO\PP[PPVDQG [PPV+RZHYHUDWZHHNVDQGPRQWKVLQVHYHQUHVSRQGHUSDWLHQWV I YDOXHV VLJQLÀFDQWO\ LQFUHDVHG 3 DQG 3 UH VSHFWLYHO\ZKHUHDVLQÀYHQRQUHVSRQGHUSDWLHQWVIYDOXHVGHFUHDVHG 3 DQG3 UHVSHFWLYHO\)XUWKHUPRUHIYDOXHVZHUHLQYHUVHO\ FRUUHODWHG ZLWK њ)3 OHYHOV 3 DQG UHVSRQGHU SDWLHQWV VKRZHG D KLJKHU RYHUDOO VXUYLYDO 26 WKDQ QRQUHVSRQGHU SDWLHQWV YV PRQWKV7KHUHODWLYHYDULDWLRQRIIRYHUEDVHOLQHDWPRQWKWUHDWPHQWZDVKLJKO\ FRUUHODWHGZLWK263 DQGV\PSWRPDWLFWLPHWRSURJUHVVLRQ3 &RQFOXVLRQ,QFRQWUDVWWR$'&DQG'WKHSHUIXVLRQIUDFWLRQILVVLJQLÀFDQWO\DI IHFWHGE\VRUDIHQLEDQGFRXOGEHDSRWHQWLDOPDUNHURIHDUO\UHVSRQVHWRWUHDWPHQW 6FLHQWLILF6HVVLRQ $ 6&'()*+% 7KXUVGD\ (XURSHDQ&RQJUHVVRI 5DGLRORJ\ [PPVHFZDVVLJQLÀFDQWO\SORZHUWKDQWKDWRIUHVSRQGHU JURXS [ PPVHF7KH EHVW FXWRII$'& YDOXH LQ GLVWLQJXLVKLQJ UHVSRQGHUVIURPQRQUHVSRQGHUVZDV[PPVRQWKHEDVLVRISRVW&57 $'&\LHOGHGDJRRGVSHFLÀFLW\FRPELQLQJTXDOLWDWLYHDQDO\VLVRI':,WR PRUSKRORJLFDOÀQGLQJVZHFRXOGOHDGWRPRUHDFFXUDWHUHVXOWV &RQFOXVLRQ':05,UHSUHVHQWVDSRZHUIXODQGHIIHFWLYHWRROWRPRQLWRUWKHUD SHXWLFUHVSRQVHLQ/$5&EHLQJDEOHWRGHWHFWFHOOXODUFKDQJHVLQWUHDWHGWXPRXUV % $VVHVVPHQWRIWXPRUKHWHURJHQHLW\&7WH[WXUHDVDELRPDUNHURI RYHUDOOVXUYLYDOLQSULPDU\FRORUHFWDOFDQFHU ) .+1J %*DQHVKDQ5.R]DUVNL.0LOHV9*RK1RUWKZRRG8. %ULJKWRQ8.+HUWIRUGVKLUH8./RQGRQ8. 3XUSRVH 7 R GHWHUPLQH LI &7 WH[WXUH LV UHODWHG WR RYHUDOO VXUYLYDO LQ SULPDU\ FRORUHFWDOFDQFHU 0HWKRGVDQG0DWHULDOV)ROORZLQJ,5%DSSURYDOSDWLHQWVPDOHVIHPDOHV PHDQ\HDUVXQGHUZHQWVWDJLQJFRQWUDVWHQKDQFHG&7N9P$V URWDWLRQWLPHPPVOLFHFROOLPDWLRQP/PJPOLRGLQDWHGFRQWUDVWDWP/V VHFRQGGHOD\7KHHQWLUHFRORUHFWDOWXPRXUWH[WXUHIHDWXUHVZHUHDVVHVVHG XVLQJ SURSULHWDU\ LPDJH WH[WXUH DQDO\VLV VRIWZDUH 7 H[5$' GHULYLQJ HQWURS\ (XQLIRUPLW\8NXUWRVLV.VNHZQHVV6DQGVWDQGDUGGHYLDWLRQ6'IURP WKH&7LPDJHVZLWKRXWÀOWUDWLRQDQGZLWKÀOWHUYDOXHVFRUUHVSRQGLQJWRÀQH PHGLXPDQGFRDUVHWH[WXUHV3DWLHQWVZHUHIROORZHGXSWLOOGHDWK RUFHQVRUHGDW\HDUVLIDOLYH52&DQG.DSODQ0HLHUDQDO\VLVZDVSHUIRUPHG WRGHWHUPLQHWKHUHODWLRQVKLSLIDQ\EHWZHHQ&7WH[WXUHDQG\URYHUDOOVXUYLYDO 5HVXOWV'DWDZHUHDYDLODEOHIURPSDWLHQWV7KHUHZHUHVWDJH,VWDJH,, VWDJH,,,DQGVWDJH,9FDQFHUV)LQHWH[WXUH.DSODQ0HLHUVXUYLYDOSORWVIRU (8.6DQG6'ZHUHVLJQLÀFDQWO\GLIIHUHQWS S S S DQGS UHVSHFWLYHO\IRUWKUHVKROGVRI (!8 . !6DQG 6'UHVSHFWLYHO\&R[UHJUHVVLRQDQDO\VLVVKRZHGWKHVH SDUDPHWHUVZHUHLQGHSHQGHQWSUHGLFWRUVRIRYHUDOOVXUYLYDOZLWKVWDJH &RQFOXVLRQ/RZHUHQWURS\NXUWRVLVDQG6'DQGKLJKHUXQLIRUPLW\DQGVNHZQHVV DWÀQHWH[WXUHVDUHSUHGLFWRUVRISRRUHU\HDURYHUDOOVXUYLYDOLQFRORUHFWDOFDQFHU % (YDOXDWLRQRIUDGLRORJLFDOSURJQRVWLFIDFWRUVRIKHSDWLFPHWDVWDVHV LQSDWLHQWVZLWKSDQFUHDWLFQHXURHQGRFULQHQHRSODVPV &,KP$%DXU,*6WHIIHQ(%7LVFKHU03DYHO7 'HQHFNH %HUOLQ'(DOH[DQGHUEDXU#FKDULWHGH 3XUSRVH3DQFUHDWLFQHXURHQGRFULQHQHRSODVPVS1(1DUHUDUHWXPRXUVDQG RIWHQGLDJQRVHGDWDQDGYDQFHGVWDJHRIGLVHDVH7KHOLYHULVWKHPRVWIUHTXHQWVLWH RIPHWDVWDVHVDQGSURJUHVVLRQRIKHSDWLFPHWDVWDVHVRIWHQGHWHUPLQHVSURJQRVLV 7KLVVWXG\DLPHGWRHYDOXDWHWKHFKDUDFWHULVWLFVRIOLYHUPHWDVWDVHVRIS1(1LQ PXOWLSKDVLFFRQWUDVWHQKDQFHG&7RU05,GHWHUPLQLQJULVNIDFWRUVIRUSURJUHVVLRQ 0HWKRGVDQG0DWHULDOV:HUHWURVSHFWLYHO\DQDO\VHGWKH&7DQG05,DSSHDU DQFHRIOLYHUPHWDVWDVHVLQSDWLHQWVZLWKKLVWRORJLFDOO\SURYHQZHOOGLIIHUHQWLDWHG *S1(1IRUFRQWUDVWHQKDQFHPHQWQHFURVLVYDVFXODULQÀOWUDWLRQDVZHOODV WKHQXPEHURIPHWDVWDVHVDQGWXPRXUEXUGHQ3URJUHVVLRQRIOLYHUPHWDVWDVHV ZDVMXGJHGDFFRUGLQJWRWKH5(&,67FULWHULD 5HVXOWV 'XULQJ VXUYHLOODQFH SDWLHQWV UHFHLYHG ELRWKHUDS\ RFWUHRWLGH /$5 DQGSDWLHQWVREWDLQHGQRDQWLWXPRUDOWKHUDS\0HGLDQWLPHWRSURJUHVVLRQRI SDWLHQWVZLWKELRWKHUDS\DQGSDWLHQWVZLWKRXWWKHUDS\ZDVDQGPRQWKV UHVSHFWLYHO\+5&,S 7KHRQO\VLJQLÀFDQWUDGLRORJLFDO IDFWRUVKRZQWRKDYHDOHVVIDYRXUDEOHLQGHSHQGHQWSURJQRVWLFVLJQLÀFDQFHLVWKH K\SRYDVFXODULVDWLRQGHÀQHGDVK\SRHQKDQFHPHQWGXULQJWKHHDUO\DUWHULDODQGSRU WDOYHQRXVSKDVHVRIKHSDWLFPHWDVWDVHV+5&,S 7KLV VLJQLÀFDQWO\SUHGLFWHGHDUO\SURJUHVVLRQLQWKHVXEJURXSZLWKRXWRFWUHRWLGHWKHUDS\ \HDU SURJUHVVLRQ UDWH ZLWK K\SHUYDVFXODULVDWLRQ K\SRYDVFXODULVDWLRQ S ZKLOHELRWKHUDS\PDVNHGWKLVSUHGLFWRUDOOSDWLHQWVS &RQFOXVLRQ3DWLHQWVWUHDWHGZLWKRFWUHRWLGH/$5KDGDVLJQLÀFDQWO\ORQJHUWLPH WRWXPRXUSURJUHVVLRQ+\SRYDVFXODULVHGPHWDVWDVHVPLJKWEHDQHDV\DFFHVVLEOH ULVNIDFWRUIRUWXPRXUSURJUHVVLRQDQGWKHUHIRUHLPSRUWDQWWRWDNHLQWRDFFRXQWZKHQ GHFLGLQJRQWKHUDSHXWLFDSSURDFK LPDJHV D[LDOO\ ZLWK EYDOXHV VPP$ FLUFXODU52,ZDVGHÀQHGLQWKH':LPDJHVRYHUWKHEUHDVWFDUFLQRPDVDQGQRUPDO ÀEURJODQGXODU WLVVXH IRU ,9,0 PHDVXUHPHQWV 7UXH GLIIXVLRQ FRHIÀFLHQW 'WUXH SVHXGRGLIIXVLRQ FRHIÀFLHQW 'SVHXGR DQG SHUIXVLRQ IUDFWLRQ 3IUDFWLRQ ZHUH HVWLPDWHGE\ÀWWLQJWKH':VLJQDOGHFD\LQWKH52,WRWKH,9,0ELFRPSDUWPHQWDO PRGHO6,6, 3IUDFWLRQ[H[SE'WUXH3IUDFWLRQ[H[SE'SVHXGR 5HVXOWV'WUXHRIEUHDVWFDUFLQRPDV[PPVZDVVLJQLÀFDQWO\ ORZHUSWZRWDLOHG:LOFR[RQPDWFKHGSDLUVWHVWWKDQWKDWRIÀEURJODQGX ODUWLVVXH[PPV0RUHRYHUVLJQLÀFDQWGLIIHUHQFHS LQ3IUDFWLRQZDVREVHUYHGLQEUHDVWFDUFLQRPDVDQGÀEURJODQGXODU WLVVXHZKLOHVLPLODU'SVHXGRLQEUHDVWFDUFLQRPDV[ PPVDQGÀEURJODQGXODUWLVVXH[PPVZHUHREVHUYHG &RQFOXVLRQ,9,0DQDO\VLVUHYHDOHGGHFUHDVHG'WUXHDQG3IUDFWLRQLQEUHDVWFDU FLQRPDVVKRZLQJWKDWDOWHUDWLRQVLQERWKFHOOXODULW\DQGSHUIXVLRQHIIHFWVFRQWULEXWH WRWKHFKDQJHVLQDSSDUHQWGLIIXVLRQXVLQJ':,,9,0DQDO\VLVPD\EHYDOXDEOHIRU FKDUDFWHULVLQJEUHDVWFDUFLQRPDVDQGPRQLWRULQJLWVSURJUHVVLRQQRQLQYDVLYHO\ % (DUO\DVVHVVPHQWRIWXPRXUUHVSRQVHWRVRUDIHQLELQXYHDO PHODQRPDZLWKOLYHUPHWDVWDVHVXVLQJVHPLTXDQWLWDWLYH'&(05, ) 1HQVD -6WDWWDXV%1RND\%7KLHULQJ+*/LSLQVNL 0)RUVWLQJ06FKHXOHQ-.DONPDQQ(VVHQ'( 'RUWPXQG'(IHOL[QHQVD#JPDLOFRP 3XUSRVH (YDOXDWLRQ RI VHPLTXDQWLWDWLYH G\QDPLF FRQWUDVWHQKDQFHG 05, '&(05,WRDVVHVVWKHUDS\UHVSRQVHLQSDWLHQWVZLWKOLYHUPHWDVWDVHVRIXYHDO PHODQRPD80WUHDWHGZLWK6RUDIHQLE 0HWKRGV DQG 0DWHULDOV 7KLV VWXG\ ZDV DSSURYHG E\ RXU ORFDO LQVWLWXWLRQDO UHYLHZERDUG6HYHQWHHQSDWLHQWVZLWKOLYHUPHWDVWDVHVRI80ZHUHWUHDWHGZLWK 6RUDIHQLEDQGH[DPLQHGE\'&(05,7 $YDQWR6LHPHQVDWEDVHOLQHDQGIRU IROORZXSVFDQVHYHU\ZHHNV7KHOHVLRQZLWKWKHORQJHVWGLDPHWHUZDVVHOHFWHG DVWDUJHW0HDVXUHPHQWVZHUHSHUIRUPHGSDUDFRURQDOO\IRUVHFXVLQJD7 )ODVKVHTXHQFHPPVOLFHWKLFNQHVVWHPSRUDOUHVROXWLRQVHFDQG*DGREXWURO PPRONJÁRZPOVHF $XWRPDWHGUHVSLUDWRU\PRWLRQFRUUHFWLRQZDVDSSOLHG WRWKHLPDJHVHULHVWKHUHDIWHUWKHWDUJHWOHVLRQZDVPDQXDOO\GHOLQHDWHGE\DUHJLRQ RILQWHUHVW&RQWUDVWHQKDQFHPHQWWLPHFXUYHVZHUHÀWWHGXVLQJVPRRWKLQJVSOLQH LQWHUSRODWLRQDQGVHPLTXDQWLWDWLYHSDUDPHWHUVZHUHFDOFXODWHGPD[LPXPVORSH GXULQJLQLWLDOFRQWUDVWDJHQWXSWDNHL6ORSHPD[DQGLQLWLDODUHDXQGHUWKHFXUYH WRL$8&DQGVHFRQGVL$8&DIWHUWKHRQVHWWLPH7KHUDS\UHVSRQVH ZDVDVVHVVHGDFFRUGLQJWRUHVSRQVHHYDOXDWLRQFULWHULDLQVROLGWXPRUV5(&,67 ZLWKDPHDQWLPHWRSURJUHVVLRQRIGD\V 5HVXOWV$IWHU ZHHNV L6ORSHPD[ L$8& DQG L$8& VKRZHG D VWDWLVWLFDOO\ VLJQLÀFDQWPHDQGHFUHDVHRIDQG UHVSHFWLYHO\HDFKSEHIRUHVXEVHTXHQWO\HQWHULQJVWHDG\VWDWH $GHFUHDVHLQ'&(05,SDUDPHWHUVZDVQRWDVVRFLDWHGZLWKWKHUDS\UHVSRQVH RUWLPHWRSURJUHVVLRQ &RQFOXVLRQ 5HVSLUDWRU\ PRWLRQ FRUUHFWHG VHPLTXDQWLWDWLYH '&(05, VKRZV DUDSLGDQGVLJQLÀFDQWGHFUHDVHLQOLYHUPHWDVWDVHVRI80XQGHUWUHDWPHQWZLWK VRUDIHQLEEXWDFRUUHODWLRQWRFOLQLFDORXWFRPHFRXOGQRWEHREVHUYHG % &RPELQHGTXDOLWDWLYHDQGTXDQWLWDWLYHDQDO\VLVRI':,LQHDUO\ DVVHVVPHQWRISRRUUHVSRQGHUVDIWHUFKHPRUDGLDWLRQWKHUDS\ SUHOLPLQDU\UHVXOWVLQORFDOO\DGYDQFHGUHFWDOFDQFHU /0RQJX]]L',SSROLWR&&DSUDUR&7 DOHL)UDQ]HVL6*DOLPEHUWL66LURQL 0RQ]D,7OHWL]LDPRQJX]]L#JPDLOFRP 3XUSRVH7 RHYDOXDWHWKHSRWHQWLDOUROHRI':,%6DQG $'&PDSLQLGHQWLI\LQJSRRU UHVSRQGHUVWRQHRDGMXYDQWFKHPRUDGLDWLRQWUHDWPHQW&57IRU/$5& 0HWKRGVDQG0DWHULDOVSDWLHQWVPHDQDJHZLWKELRSV\SURYHQGLDJQRVLV RIUHFWDOFDQFHUZHUHSURVSHFWLYHO\HQUROOHGLQRXUVWXG\05H[DPLQDWLRQVZHUH SHUIRUPHGSULRUWRWKHUDS\77RU1VWDJHDQGDIWHU&57ZHHNVDIWHUWKH FRPSOHWLRQRIWUHDWPHQWRQD7 HVOD$FKLHYD3KLOLSVVFDQQHUZLWKDSHOYLF SKDVHG DUUD\ PXOWLFRLO PXOWLSODQDU 7 DQG 776( DQG ':,%6 VHTXHQFHV E IDFWRUDQGPPVHFZHUHDFTXLUHG)RUTXDQWLWDWLYHDQDO\VLVPHDQ$'& YDOXHVRIWKHWXPRXUUHJLRQVZHUHPHDVXUHGE\UDGLRORJLVWVE\PDQXDOO\GUDZLQJ 52,FRYHULQJHQWLUHWXPRXUUHJLRQVRQ $'&PDSV0HDQSUHDQGSRVW&57$'& YDOXHVZHUHFRPSDUHGEHWZHHQUHVSRQGHUVDQGQRQUHVSRQGHUVEHLQJWKHKLV WRSDWKRORJLFUHVSRQVHDFFRUGLQJWR0DQGDUGҋVFULWHULDDVWKHUHIHUHQFHVWDQGDUG 5HVXOWV $IWHUVXUJLFDOUHVHFWLRQLPDJLQJÀQGLQJVZHUHFRPSDUHGZLWKSDWKRORJLFDO UHVXOWV7ZHQW\VHYHQSDWLHQWVVKRZHGFRPSOHWH75*RUVXEWRWDOUHJUHV VLRQ75*DQGZHUHFRQVLGHUHGDVUHVSRQGHUVZKLOHZHUHFODVVLÀHG DVSRRUUHVSRQGHUV75*7KHPHDQSRVW&57 $'&YDOXHRISRRUUHVSRQGHUV 6FLHQWLILF6HVVLRQ 6 &$' ( ) *+% (XURSHDQ&RQJUHVVRI 5DGLRORJ\ % 6LQJOHVRXUFHGXDOHQHUJ\&7LPSURYLQJGLIIHUHQWLDWLRQEHWZHHQ DWHOHFWDVLVDQGWXPRXULQFHQWUDOOXQJFDQFHUFOLQLFDOSUDFWLFHRID QRYHOWHFKQLTXH < &KHQ/7 DQJ;7 /L/3 4L< //L;< =KDQJ< &XL< 66XQ ;3 =KDQJ%HLMLQJ&1WDQJOHL#EMFDQFHURUJ 3XUSRVH7 RHYDOXDWHWKHSHUIRUPDQFHRIVLQJOHVRXUFHGXDOHQHUJ\&7IRUGLI IHUHQWLDWLRQEHWZHHQDWHOHFWDVLVDQGWXPRXULQFHQWUDOOXQJFDQFHU 0HWKRGV DQG 0DWHULDOV 7KH VWXG\ FRPSULVHV FRQVHFXWLYH SDWLHQWV ZLWK FRQÀUPHGFHQWUDOOXQJFDQFHUDVVRFLDWHGZLWKDWHOHFWDVLVRQVLQJOHVRXUFHGXDO HQHUJ\&7 7KHRSWLPLVHGPRQRFKURYPDWLFLPDJHVZHUHREWDLQHGE\VHOHFWLQJ WKHEHVW&15DQGWKHLRGLQHEDVHGPDWHULDOGHFRPSRVHGLPDJHVZHUHREWDLQHG ZLWKLRGLQHFRQFHQWUDWLRQPHDVXUHG,PDJHVZHUHDVVHVVHGE\WZRUDGLRORJLVWV ZRUNLQJ LQ FRQVHQVXV IRU WKH GLVSOD\PHQW RI WXPRXUDWHOHFWDVLVLQWHUIDFH 7KH LRGLQHFRQFHQWUDWLRQVEHWZHHQWXPRXUDQGDWHOHFWDVLVZDVFRPSDUHGE\SDLUHG WWHVWZLWK6366 5HVXOWV7KHRSWLPDOHQHUJ\OHYHOZDVLQWKHUDQJHRINH9PHGLDQNH9 IRUGLVSOD\LQJWXPRXUDWHOHFWDVLVLQWHUIDFHDWVGHOD\HGVFDQQLQJSKDVHDQGLQ WKHUDQJHRINH9PHGLDQNH9DWVGHOD\HGVFDQQLQJSKDVH7XPRXU DWHOHFWDVLVLQWHUIDFHFRXOGEHGHÀQHGLQDQGSDWLHQWVXVLQJ FRPELQDWLRQRIWKHRSWLPLVHGPRQRFKURYPDWLFLPDJHVZLWKLRGLQHEDVHGPDWH ULDOGHFRPSRVHGLPDJHVDWVDQGVGHOD\HGSKDVHUHVSHFWLYHO\PRUHWKDQ DQGXVLQJWKHRSWLPLVHGPRQRFKURYPDWLFLPDJHVDORQHZLWK S DQGS UHVSHFWLYHO\7KHLRGLQHFRQFHQWUDWLRQVRIDWHOHFWDVLVZDV PXFKKLJKHUWKDQWXPRXUSDQGWKHLRGLQHEDVHGPDWHULDOGHFRPSRVHG LPDJHVHQDEOHGGLIIHUHQWLDWLRQEHWZHHQDWHOHFWDVLVDQGWXPRXULQPRUHSDWLHQWV &RQFOXVLRQ 7KH VLQJOH VRXUFH GXDO HQHUJ\ &7 FRXOG LPSURYH GLIIHUHQWLDWLRQ EHWZHHQDWHOHFWDVLVDQGWXPRXULQFHQWUDOOXQJFDQFHUZLWKWKHRSWLPLVHG&15 WHFKQLTXHDQGPDWHULDOGHFRPSRVLWLRQWHFKQLTXH7KLVPRGDOLW\PDQLIHVWHGDVD SRWHQWLDOO\XVHIXOUDGLRORJLFWRROIRUURXWLQHFOLQLFDOGLDJQRVLV % 3UHGLFWLYHIHDWXUHVRI)'*3(7&7DQG&7LQGLDJQRVLQJQRGDO PHWDVWDVLVRI7QRQVPDOOFHOOOXQJFDQFHUVPDQLIHVWLQJDVSDUW VROLGQRGXOHV +.LP&03DUN60/HH-&3DHQJ-0*RR+-/HH6HRXO.5 NKMVQXK#JPDLOFRP 3XUSRVH7 RUHWURVSHFWLYHO\LQYHVWLJDWHWKHSUHGLFWLYHIDFWRUVRI)'*3(7&7DQG &7IRU/1PHWDVWDVLVLQ716&/&VPDQLIHVWLQJDVSDUWVROLGQRGXOHV361V 0HWKRGVDQG0DWHULDOV7KHLQVWLWXWLRQDOUHYLHZERDUGDSSURYHGWKLVVWXG\DQG ZDLYHG LQIRUPHG FRQVHQW )URP -DQXDU\ WR 0D\ SDWLHQWV ZLWK SDWKRORJLFDOO\ SURYHQ 7 16&/&V PDQLIHVWLQJ DV 361V ZLWK /1 VWDJLQJ ZHUH LQFOXGHGLQWKLVVWXG\689PD[DQG&7IHDWXUHVRISULPDU\WXPRXUVZHUHHYDOX DWHGWRLQYHVWLJDWHSUHGLFWLYHIDFWRUVIRU/1PHWDVWDVLV,QDGGLWLRQRSWLPDOFXWRII YDOXHVIRUHDFKSUHGLFWRUZHUHGHWHUPLQHGDQGWKHGLDJQRVWLFSHUIRUPDQFHRIWKH SUHGLFWLRQPRGHOXVLQJWKHSUHGLFWRUVZDVHYDOXDWHGXVLQJDUHFHLYHURSHUDWLQJ FKDUDFWHULVWLF52&DQDO\VLV 5HVXOWV/1PHWDVWDVHVZHUHIRXQGLQRISDWLHQWV1R/1PHWDV WDVLVZDVSUHVHQWLQSDWLHQWVZLWKVROLGSURSRUWLRQ7KHUHZHUHVLJQLÀFDQW GLIIHUHQFHVLQ689PD[VROLGSURSRUWLRQDQGOHVLRQORFDWLRQRIWKHSULPDU\WXPRXU EHWZHHQSDWLHQWVZLWKDQGZLWKRXW/1PHWDVWDVLV30XOWLYDULDWHDQDO\VLV UHYHDOHG WKDW KLJKHU 689PD[ >RGGV UDWLR 25 3 @ODUJHU VROLG SURSRUWLRQ>253 @DQGFHQWUDOORFDWLRQ>253 @ZHUH LQGHSHQGHQWSUHGLFWRUVIRU/1PHWDVWDVLV7KHRSWLPDOFXWRIIYDOXHVRI689PD[ DQGVROLGSURSRUWLRQZHUHDQGUHVSHFWLYHO\7KHDUHDXQGHUWKH52& FXUYHRIWKHSUHGLFWLYHPRGHOXVLQJDOOWKUHHYDULDEOHVZDV &RQFOXVLRQ+LJKHU689PD[ODUJHUVROLGSURSRUWLRQDQGFHQWUDOORFDWLRQRIWKH SULPDU\ WXPRXU DUH VLJQLÀFDQW LQGHSHQGHQW SUHGLFWRUV IRU /1 PHWDVWDVLV LQ 7 16&/&V PDQLIHVWLQJ DV 361V ZKLFK FDQ HQDEOH D YHU\ DFFXUDWH SUHRSHUDWLYH SUHGLFWLRQRI/1VWDWXVLQWKHVHFDQFHUV % 3UHYDOHQFHFOLQLFDOVLJQLÀFDQFHDQGGLDJQRVWLFYDOXHRIH[WUDSOHXUDO DQGFDUGLRSKUHQLFO\PSKQRGHV &0DQWLQL%)HUDJDOOL1&LYLWDUHDOH53ROYHURVL$7 DUWDUR$&RWURQHR &KLHWL,7 3XUSRVH7 RHYDOXDWHWKHSUHYDOHQFHFOLQLFDOPHDQLQJDQGGLDJQRVWLFYDOXHRI H[WUDSOHXUDODQGFDUGLRSKUHQLFQRGHVRFFDVLRQDOO\REVHUYHGRQ&7VFDQVRIWKH FKHVW7 RGHÀQHD&7GLPHQVLRQDOFXWRIIYDOXHIRUH[WUDSOHXUDODQGFDUGLRSKUHQLF % &7EDVHGUHVSRQVHDVVHVVPHQWRIDGYDQFHGJDVWURLQWHVWLQDO VWURPDOWXPRXULVGXDOHQHUJ\&7DPRUHSUHGLFWLYHLPDJLQJ ELRPDUNHURIUHVSRQVHWKDQ5(&,67RU&KRLFULWHULD" 00H\HU3 $SIDOWUHU7 +HQ]OHU'-'LQWHU3 +RKHQEHUJHU626FK|QEHUJ &)LQN0DQQKHLP'(PUPH\HUPDWKLDV#JPDLOFRP 3XUSRVH'XDOHQHUJ\&7'(&7DOORZVWKHDVVHVVPHQWRILRGLQHGLVWULEXWLRQLQ WXPRXUV7KLVPD\EHFRQVLGHUHGDVDVXUURJDWHPDUNHUIRUSHUIXVLRQDQGWXPRXU YDVFXODULW\7KLVVWXG\HYDOXDWHGZKHWKHU'(&7DOORZVDEHWWHUSUHGLFWLRQRIVXUYLYDO WKDQHVWDEOLVKHGUHVSRQVHFULWHULD5(&,67DQG&KRLFULWHULD 0HWKRGVDQG0DWHULDOV6HYHQWHHQSDWLHQWVZLWKDGYDQFHG*,67WUHDWHGZLWK W\URVLQNLQDVHLQKLELWRUVZHUHDVVHVVHGE\FRQWUDVWHQKDQFHG'(&7DIWHUDQG PRQWKVIROORZXS5HVSRQVHZDVUDWHGDFFRUGLQJWR5(&,67 &KRLFULWHULDDQG '(&7DQDO\VLVRILRGLQHUHODWHGDWWHQXDWLRQ3URJUHVVLYHGLVHDVHZDVGHÀQHGDV DLQFUHDVHRIWXPRXUVL]H5(&,67DQGWXPRXUGHQVLW\&KRLRUHLWKHUDQ LQFUHDVHJUHDWHUWKDQRIWXPRXUVL]HRULRGLQHUHODWHGDWWHQXDWLRQRQ'(&7 3URJUHVVLRQIUHH VXUYLYDO 3)6 DQG RYHUDOO VXUYLYDO 26 ZHUHFDOFXODWHG E\ .DSODQ0HLHUDQDO\VLV 5HVXOWV,QGHSHQGHQWIURPWKHXVHGUHVSRQVHFULWHULDSDWLHQWVZLWKSDUWLDOUHVSRQVH RUVWDEOHGLVHDVHKDGDVLJQLÀFDQWO\ORQJHUPHGLDQ3)6WKDQSDWLHQWVZLWKSURJUHV VLYHGLVHDVHPHGLDQPRQWKVYVPRQWKVS2QO\'(&7DW PRQWKVDOORZHGDYDOLGGLVFULPLQDWLRQRISDWLHQWVZLWKJRRGRUSRRU26PHGLDQ YVPRQWKVS &RQFOXVLRQ7KLV VWXG\ LQGLFDWHV WKDW '(&7 LV D SURPLVLQJ SUHGLFWLYH LPDJLQJ ELRPDUNHURIUHVSRQVHLIFRPSDUHGWRHVWDEOLVKHGUHVSRQVHFULWHULDDVLWDOORZHG WKHEHVWSUHGLFWLRQRIVXUYLYDO 5RRP' &KHVW 66 1HRSODVPVVWDJLQJULVNDQGVXUJHU\ 0RGHUDWRUV 6/H\7RURQWR21&$ .0DODJDUL$WKHQV*5 % 7KHSUHVXUJLFDO7VWDJLQJRIQRQVPDOOFHOOOXQJFDQFHUHIÀFDF\ FRPSDULVRQRI06&7YHUVXV705LPDJLQJ 7 :7 DQJ:1:X2+2X\DQJ+< +XDQJ///LX/0/L:< :DQJ ;;;X%HLMLQJ&1QLFN\ #KRWPDLOFRP 3XUSRVH 7 R FRPSDUH SURVSHFWLYHO\ WKH GLDJQRVWLF HIÀFDFLHV RI 0'&7 DQG 705,IRUGHWHUPLQLQJ7VWDJLQJLQ16&/& 0HWKRGVDQG0DWHULDOV,QVWLWXWLRQDOUHYLHZERDUGDSSURYDODQGLQIRUPHGFRQ VHQWZHUHREWDLQHGSDWLHQWVZLWK16&/&SURYHGE\SDWKRORJ\ZHUHHQUROOHG LQ WKH VWXG\7 RWDOO\ SDWLHQWV XQGHUZHQW QRQHQKDQFHG 05, HQKDQFHG 05, DQGHQKDQFHG0'&7 7VWDJLQJZHUHSUHOLPLQDULO\HYDOXDWHGDFFRUGLQJWRWKHVH LPDJLQJPDQLIHVWDWLRQVDQGFRUUHODWHGZLWKWKDWRISDWKRORJ\XVLQJWKH.DSSDWHVW 'LDJQRVWLFHIÀFDFLHVIRU7VWDJLQJRI16&/&RQQRQHQKDQFHG05,HQKDQFHG05, DQGHQKDQFHG&7LPDJLQJZHUHFRPSDUHGXVLQJWKH0F1HPDUWHVWUHVSHFWLYHO\ 5HVXOWV'LDJQRVWLFHIÀFDF\IRU7VWDJLQJRI16&/&ZDVRQQRQHQKDQFHG 05,RQHQKDQFHG05,DQGWKDWRQHQKDQFHG&7ZDVUHVSHFWLYHO\ 7KHUH ZDV QR VLJQLÀFDQW GLIIHUHQFH DPRQJ WKHVH GLIIHUHQW SURWRFROV RQ WKH GLDJQRVWLF HIÀFDF\ IRU7 VWDJLQJ RI 16&/& 3 ! $OWKRXJKWKHUH ZHUH QR VLJQLÀFDQW GLIIHUHQFHV IRU WKH 16&/& ZLWK7a VWDJLQJ GLDJQRVWLF HIÀFDF\ RI HQKDQFHG&7ZDVVOLJKWO\VXSHULRUWRWKDWRIQRQHQKDQFHG05,DQGHQKDQFHG 05,IRUWKH16&/&ZLWK7aVWDJLQJGLDJQRVWLFHIÀFDF\RIHQKDQFHG05,ZDV VOLJKWO\VXSHULRUWRWKDWRIHQKDQFHG&7DQGQRQHQKDQFHG05, &RQFOXVLRQ &RPSDUHG WR 0'&7 QRQHQKDQFHG 05, DQG HQKDQFHG 05, SUR YLGHGVOLJKWO\VXSHULRUGLDJQRVWLFHIÀFDF\IRUWKHSUHVXUJLFDO7VWDJLQJRI16&/& HVSHFLDOO\ IRU WKH 7a WXPRXU )RU SDWLHQWV ZKR FDQQRW VWDQG ZLWK HQKDQFHG 0'&7VFDQ705,ZRXOGEHDVXEVWLWXWHGH[DPLQDWLRQIRUWKHSUHVXUJLFDO7 VWDJLQJRI16&/& 6FLHQWLILF6HVVLRQ $ 6&'()*+% 7KXUVGD\ (XURSHDQ&RQJUHVVRI 5DGLRORJ\ 5HVXOWV 7KH VWXG\ SRSXODWLRQ LQFOXGHG VXEMHFWV 7KH PHDQ GXUDWLRQR I IROORZXSZDV\HDUV'DWDUHJDUGLQJWKHSUHVHQFHRISOHXUDOSODTXHVZHUH DYDLODEOHLQVXEMHFWVDPRQJWKHFDVHVRIOXQJFDQFHULGHQWLÀHG$GMXVWHG 25HVWLPDWLQJWKHULVNRIOXQJFDQFHUDVVRFLDWHGZLWKSOHXUDOSODTXHVZDV FRQÀGHQFHLQWHUYDOWR &RQFOXVLRQ$PRQJ D SRSXODWLRQ RI IRUPHUO\ DVEHVWRVH[SRVHG ZRUNHUV WKH SUHVHQFHRISOHXUDOSODTXHVGRHVQRWOHDGWRDQH[FHVVULVNRIOXQJFDQFHU % ,QFLGHQWDOÀQGLQJVLQDVWXG\VFUHHQLQJDVEHVWRVH[SRVHGZRUNHUV IRUOXQJFDQFHUDQGPHVRWKHOLRPDXVLQJORZGRVHFRPSXWHG WRPRJUDSK\/'&7ZKDW\RXFDQÀQGZKHQ\RXDUHQRWORRNLQJ (7 DUXOOL +5REHUWV0GH3HUURW%26XOOLYDQ*'RQJ163DXO '3DWVLRV.LQJVWRQ21&$7 RURQWR21&$HDW#TXHHQVXFD 3XUSRVH7KHSXUSRVHRIRXUVWXG\LVWRDVVHVVWKHIUHTXHQF\RILQFLGHQWDOÀQG LQJV,)VDQGWKHLUSRWHQWLDOLPSDFWLQDQDVEHVWRVH[SRVHGSRSXODWLRQVFUHHQHG IRUOXQJFDQFHUDQGPHVRWKHOLRPDXVLQJ/'&7 0HWKRGVDQG0DWHULDOV SDWLHQWVPHQVFUHHQHGEHWZHHQ0DUFK DQGXVLQJ/'&7 ,)VZHUHFRQVLGHUHGDQ\ÀQGLQJVQRWUHODWHGWRWKH SULPDU\SXUSRVHRIWKHVFUHHQLQJVWXG\LQGHWHFWLQJSXOPRQDU\DQGSOHXUDOIRFDO DQGGLIIXVHDEQRUPDOLWLHVVHFRQGDU\WRDVEHVWRVH[SRVXUHFDWHJRULVHGDQDWRPL FDOO\1HFHVVLW\IRUIROORZXSZDVGHFLGHGEDVHGRQWKHÀQGLQJVE\WKHUHDGLQJ UDGLRORJLVW7KHFRVWVRIWKHDVVRFLDWHGIROORZXSZHUHFDOFXODWHGEDVHGRQWKH 6FKHGXOHRI%HQHÀWVSXEOLVKHGE\WKH0LQLVWU\RI+HDOWKDQG/RQJ7 HUP&DUHRI WKHSURYLQFHRI2QWDULR&$ 5HVXOWV7KHDYHUDJHDJHZDV\HDUVSDUWLFLSDQWVZHUHFXUUHQWVPRN HUVIRUPHUVPRNHUVDQGQRQVPRNHUV7KHDYHUDJHQXPEHURISDFN \HDUVLQWKHVPRNLQJSRSXODWLRQZDVDQGDVEHVWRVH[SRVXUHZDVLQWKH HQWLUHVFUHHQHGSRSXODWLRQ&OLQLFDOO\VLJQLÀFDQW,)VUHTXLULQJIROORZXSZHUHIRXQG LQRIRIEDVHOLQHVFUHHQLQJVWXGLHV7KHPRVWFRPPRQLQFLGHQWDO ÀQGLQJV ZHUH FDUGLDF KHSDWLF KLDWDO KHUQLDV ELOLDU\ UHQDOVSOHQLFDQGWKRVHUHODWHGWRWKHWK\URLG7KHWRWDOFRVWRI LQYHVWLJDWLQJ,)VZDVHVWLPDWHGDWDSSUR[LPDWHO\&$1ZKHUHDVWKHWRWDO FRVWRIWKHEDVHOLQHVFUHHQLQJVWXGLHVLVHVWLPDWHGDW&$1 &RQFOXVLRQ,)VLQVFUHHQLQJVWXGLHVDUHERWKFOLQLFDOO\DQGÀQDQFLDOO\VLJQLÀFDQW 7KHLU LPSDFW VKRXOG EH FRQVLGHUHG ZKHQ GHWHUPLQLQJ WKH LPSOHPHQWDWLRQ DQG YDOLGDWLRQRIQHZVFUHHQLQJWHVWV % /XQJFDQFHUVFUHHQLQJE\PRUSKRORJLFDO05,LQFRPSDULVRQWR ORZGRVH&7 -7UHPSHU03XGHUEDFK%6WLHOWMHV0(LFKLQJHU+3 6FKOHPPHU 6'HORUPH+HLGHOEHUJ'(MWUHPSHU#GNI]GH 3XUSRVH/XQJFDQFHUVFUHHQLQJZLWK&7DSSOLHVLRQLVLQJUDGLDWLRQ7KLVLVSURE OHPDWLFLQORQJWHUPIROORZXSZLWKDFFXPXODWLQJGRVHV7KHDLPRIWKLVVWXG\ZDV WRH[DPLQHWKHSRWHQWLDORIPDJQHWLFUHVRQDQFHLPDJLQJ05,IRUWKHGHWHFWLRQ RIVXVSHFWHGOXQJOHVLRQVLQFRPSDULVRQWRORZGRVH&7 0HWKRGVDQG0DWHULDOVSDUWLFLSDQWVRIWKH+HLGHOEHUJOXQJFDQFHUVFUHHQLQJ WULDO/86,VKRZLQJDVXVSLFLRXVOXQJOHVLRQLQ&7EHFDXVHRIVL]H!PP RUVLJQLÀFDQWJURZWKGD\VGRXEOLQJWLPHWKDWUHTXLUHVLPPHGLDWHZRUNXS LQYDVLYHSURFHGXUHVRUVKRUWWHUPIROORZXSUHFHLYHGDQRQFRQWUDVWOXQJ05, +$67(9,%(7UX)LVSLQFRURQDODQGWUDQVYHUVDORULHQWDWLRQ7KHVWXG\WLPH ZDVDSSUR[PLQXWHV7KH05GDWDZHUHFKHFNHGIRUVXVSLFLRXVOHVLRQV7KH UHVXOWVZHUHFRPSDUHGWR&7 5HVXOWVRIWKHVXVSLFLRXVOHVLRQVFRXOGEHLGHQWLÀHGE\05,FRPSDUDEOH WR&7 OXQJOHVLRQVFRXOGQRWEHHQLGHQWLÀHGLQ05,RIWKHPEHLQJVPDOOHU WKDQ PP OHVLRQV KDG SUREDEO\ DOUHDG\ UHVROYHG E\ WKH WLPHWKH 05, ZDV SHUIRUPHGIHVPDOOLQÀOWUDWHVRUDWHOHFWDVHV,Q)LVKHUҋVH[DFWWHVWLQGHSHQG HQFHFDQEHUHMHFWHGS SURYLQJ05,EHLQJDVDFFXUDWHDV&7LQGHWHFWLQJ UHOHYDQWOXQJOHVLRQV &RQFOXVLRQ7KHVHUHVXOWVVKRZWKDWVXVSLFLRXVOXQJOHVLRQVRQORZGRVH&7DUH GHSLFWHGLQDOVRRQPRUSKRORJLFDO05,RIWKHOXQJ QRGHV7 RHYDOXDWHWKHIUHTXHQF\RIWKHVHQRGHVLQGLIIHUHQWGLVHDVHVSDUWLFXODUO\ LQSULPDU\RUVHFRQGDU\PDOLJQDQWSOHXUDOGLVHDVHV 0HWKRGVDQG0DWHULDOV:HLQFOXGHGFRQVHFXWLYHSDWLHQWVZKRXQGHUZHQW 0'&7 RI WKH FKHVW IRU GLIIHUHQW FOLQLFDO SXUSRVHV QRQQHRSODVWLF SDWLHQWV ZLWK H[WUDWKRUDFLF QHRSODVP ZLWK LQWUDWKRUDFLF QHRSODVP DQG ZLWK SOHXUDO PHWDVWDVLV DQG SDWLHQWV ZLWK KLVWRORJLFDOO\ SURYHQPDOLJQDQW SOHXUDO PHVRWKHOLRPD030)RUHDFKJURXSRISDWLHQWVZHDQDO\VHGWKHSUHVHQFHRI H[WUDSOHXUDODQGFDUGLRSKUHQLFQRGHVWKHLUQXPEHUVLQJOHRUPXOWLSOHDQGWKHLU VL]HPPEHWZHHQDQGPPDQG!PP 5HVXOWV 7KH SUHYDOHQFH RI H[WUDSOHXUDO QRGHV LQGHSHQGHQWO\ IURP WKHLUV L ] H UHVXOWHG OHVV WKDQ LQ DOO JURXSV RI SDWLHQWV H[FHSW IRU SDWLHQWV ZLWK 030 7KHSUHYDOHQFHRIFDUGLRSKUHQLFQRGHV!PPZDV LQSDWLHQWVZLWK030LQSDWLHQWVZLWKSOHXUDOPHWDVWDVLVDQGOHVVWKDQ LQDOORWKHUJURXSVRISDWLHQWV1RVLJQLÀFDQWGLIIHUHQFHVLQWKHSUHYDOHQFHRI FDUGLRSKUHQLFQRGHVPPLQDOOJURXSVRISDWLHQWVS!ZHUHIRXQG &RQFOXVLRQ7KHSUHVHQFHRIH[WUDSOHXUDOQRGHVRIDQ\VL]HDQGFDUGLRSKUHQLF QRGHVJUHDWHUWKDQPPKDYHDVLJQLÀFDQWGLDJQRVWLFYDOXHLQPDOLJQDQWSOHXUDO GLVHDVHHLWKHUSULPDU\RUVHFRQGDU\ZKLOHWKH\DUHH[WUHPHO\UDUHLQRWKHUGLV HDVHVQHRSODVWLFRUQRW % 'LIIXVLRQZHLJKWHGLPDJLQJDGGGLDJQRVWLFYDOXHWR05,LQ GLIIHUHQWLDWLQJWKRUDFRPHGLDVWLQLFOHVLRQVFRPSDULVRQZLWK3(7&7 ) %XHPL) 7 RQGR*6WUDQJLR$6WHFFR$&DUULHUR1RYDUD,7 IUDQEXHPL#YLUJLOLRLW 3XUSRVH7KHDLPRIWKLVVWXG\ZDVWRDVVHVVWKHGLDJQRVWLFDFFXUDF\RIGLIIXVLRQ ZHLJKWHG05,VHTXHQFHVYHUVXV3(7&7LQWKHGHWHFWLRQDQGFKDUDFWHULVDWLRQRI WKRUDFRPHGLDVWLQDO GLVWULFW OHVLRQV XVLQJ WKH KLVWRSDWKRORJLFDO ÀQGLQJV DV JROG VWDQGDUG 0HWKRGVDQG0DWHULDOVSDWLHQWVZLWKWKRUDFLFPHGLDVWLQDOOHVLRQVXQGHUZHQW 3(7&7 DQG 05, VWDQGDUG DQG GLIIXVLRQZHLJKWHG VHTXHQFHV ZHUHSHUIRUPHG DQG$'& PDSV ZHUH JHQHUDWHG7 R RSWLPLVH WKH FRPSDULVRQ EHWZHHQ 3(7&7 DQG 05, LQ GLVFULPLQDWLQJ EHQLJQ IURP PDOLJQDQW OHVLRQV DQ$'& FXWRII YDOXH ZDVVWDWHG[PPV&RQVLGHULQJWKHÀQGLQJVRIKLVWRSDWKRORJLFDOOHVLRQV DV´JROGVWDQGDUGµUHIHUHQFHYDOXHVRIVHQVLWLYLW\VSHFLÀFLW\GLDJQRVWLFDFFXUDF\ SRVLWLYHSUHGLFWLYHYDOXH339DQGQHJDWLYHSUHGLFWLYHYDOXH139RI05,DQG &73(7ZHUHFDOFXODWHG 5HVXOWV7KHREWDLQHGYDOXHVVKRZHGGLIIXVLRQZHLJKWHG05,KDYLQJDVHQVLWLY LW\FRPSDUDEOHWR&73(7YVDQGJUHDWHUVSHFLÀFLW\YV 2YHUDOOWKHGLDJQRVWLFDFFXUDF\RIGLIIXVLRQZHLJKWHG05,UHWXUQHGDYDOXHRI FRPSDUHGWRRI3(7&7 7KH339REWDLQHGZLWKGLIIXVLRQZHLJKWHGVHTXHQFHV ZDVVLPLODUWRWKHRQHREWDLQHGZLWK3(7&7YVZLWKGLIIXVLRQZHLJKWHG 139VHTXHQFHVEHLQJPRUHDFFXUDWHWKDQ3(7&7YV1RVWDWLVWLFDOO\ UHOHYDQWGLIIHUHQFHVDPRQJWKHVHQVLWLYLW\DQGVSHFLÀFLW\YDOXHVRIWKHWZRPHWKRGV ZHUHIRXQGDIWHUDFRPSDULVRQZLWKWKH0F1HPDUҋVWHVW &RQFOXVLRQ&DOFXODWLRQRIWKH$'&ZLWKGLIIXVLRQZHLJKWHG05,KDVSURYHGWR EH H[WUHPHO\ VHQVLWLYH LQ WKH WKRUDFRPHGLDVWLQDO PDVVHV GLVFULPLQDWLRQ DQG LW PD\EHDQLPSRUWDQWWHFKQLFDOIHDWXUHWRFRPSOHWHEDVLF05,VHTXHQFHVZLWKRU ZLWKRXWFRQWUDVWPHGLD % 'RSOHXUDOSODTXHVFDUU\DQH[FHVVRIULVNRIOXQJFDQFHULQ DVEHVWRVH[SRVHGZRUNHUV" 5%DUERW &/H0DUTXDQG-&3DLURQ&3DULV3 %URFKDUG) /DXUHQW 9LOOHQDYHGҋ2UQRQ)5&ODPDUW)5&UHWHLO)59DQGRHXYUHOHV1DQF\)5 %RUGHDX[)53HVVDF)5UHPLEDUERW#IUHHIU 3XUSRVH 0RVW VWXGLHV HYDOXDWLQJ UHODWLRQVKLSV EHWZHHQ SOHXUDO SODTXHVDQG OXQJFDQFHUKDYHEHHQEDVHGRQFKHVWUDGLRJUDSKVDQGGXHWRWKHORZVHQVLWLYLW\ DQG VSHFLÀFLW\ RI FKHVW UDGLRJUDSK WR LGHQWLI\ SOHXUDO SODTXHV WKHLU UHVXOWV DUH VWLOOFRQWURYHUVLDO7KHDLPRIWKLVVWXG\ZDVWRHYDOXDWHZKHWKHUWKHSUHVHQFHRI SOHXUDOSODTXHVGHWHFWHGXVLQJORZGRVHFKHVW&7OHDGVWRDQDGGLWLRQDOULVNRI OXQJFDQFHUWRWKDWSURYLGHGE\DVEHVWRVH[SRVXUHZLWKRXWSUHVHQFHRISODTXHV 0HWKRGV DQG 0DWHULDOV$ ODUJH VFUHHQLQJ SURJUDPPH IRU IRUPHUO\ DVEHVWRV H[SRVHGZRUNHUVZDVRUJDQLVHGLQ)UDQFHIURPWRLQFOXGLQJH[SRVXUH DVVHVVPHQWPHDVXUHGE\DFXPXODWLYHH[SRVXUHLQGH[DQGGHWHFWLRQRISOHXUDO DQGOXQJDEQRUPDOLWLHVE\ORZGRVHFRPSXWHGWRPRJUDSK\5HDGLQJZDVSHUIRUPHG EOLQGO\LQGHSHQGHQWO\E\UHDGHUV&DVHVRILQFLGHQWOXQJFDQFHULQWKLVSRSXOD WLRQZHUHFRXQWHGXSWR-DQXDU\5HODWLRQVKLSEHWZHHQSUHVHQFHRISOHXUDO SODTXHVDQGRFFXUUHQFHRIOXQJFDQFHUZDVDVVHVVHGE\DGMXVWHGRGGVUDWLRV25 IRUDJHVH[VPRNLQJVWDWXVDQGDVEHVWRVH[SRVXUH 6FLHQWLILF6HVVLRQ 6 &$' ( ) *+% (XURSHDQ&RQJUHVVRI 5DGLRORJ\ 5RRP' ,QWHUYHQWLRQDO5DGLRORJ\ 66 *HQLWRXULQDU\JDVWURLQWHVWLQDODQGELOLDU\ LQWHUYHQWLRQV 0RGHUDWRUV 0*LYHQ'XEOLQ,( 7-DUJLHOOR/XEOLQ3/ % 8WHULQHDUWHU\HPEROLVDWLRQSUHLQWHUYHQWLRQDOSUHGLFWLRQRIWKH EHVWWXEHDQJOHREOLTXLW\IRUYLVXDOLVDWLRQRIWKHXWHULQHDUWHU\RULJLQ XVLQJ'UHFRQVWUXFWHGFRQWUDVWHQKDQFHG05DQJLRJUDSK\ 1111DJXLE1($1RXU(OGLQ%6FKHOO7 *UXEHU5RXK7/HKQHUW 7 -9RJO)UDQNIXUWD0DLQ'(QDJ\QQQ#\DKRRFRP 3XUSRVH7 RWHVWWKHDFFXUDF\RI'UHFRQVWUXFWHGFRQWUDVWHQKDQFHG05DQJL RJUDSK\'&(05$LQSUHGLFWLQJWKHEHVWWXEHDQJOHREOLTXLW\WRYLVXDOLVHWKH XWHULQHDUWHU\RULJLQ8$2EHIRUHXWHULQHDUWHU\HPEROLVDWLRQ8$( 0HWKRGVDQG0DWHULDOV7KHSURVSHFWLYHVWXG\LQFOXGHGIHPDOHVPHDQDJH \HDUVWRZKRP8$(ZDVSHUIRUPHG&(05$ZDVSHUIRUPHGEHIRUH8$( DQG'LPDJHVZHUHUHFRQVWUXFWHGXVLQJ,QVSDFHDSSOLFDWLRQ7KH'ÀJXUHZDV URWDWHGLQDOOGLUHFWLRQVWRGHWHUPLQHWKHEHVWDQJOHIRUYLVXDOLVLQJWKH8$2E\WZR UDGLRORJLVWVLQFRQVHQVXV7KHVXJJHVWHGDQJOHZDVSURYLGHGWRWKHLQWHUYHQWLRQLVW IRURSWLRQDOXVDJH $IWHU8$(WKHDFWXDODQJOHXVHGIRUYLVXDOLVDWLRQZDVUHFRUGHG DQGFRPSDUHGZLWKWKHVXJJHVWHGDQJOH&RUUHODWLRQEHWZHHQWKHVXJJHVWHGDQJOH DQGDFWXDODQJOHZDVWHVWHGXVLQJ6SHDUPDQҋVFRUUHODWLRQWHVW 5HVXOWV)RUYLVXDOLVLQJWKHOHIW8$WKHVXJJHVWHGDQJOHLQWKHVLGHWRVLGHGLUHF WLRQVKRZHGDPHDQRIULJKWWKHDFWXDODQJOHZDVULJKW ,QWKHFHSKDORFDXGDOGLUHFWLRQWKHVXJJHVWHGDQJOHZDVFDXGDOWKH DFWXDODQJOHZDVFDXGDO$VWDWLVWLFDOO\VLJQLÀFDQWVWURQJSRVLWLYHFRU UHODWLRQZDVGHWHFWHGEHWZHHQWKHVXJJHVWHGDQGDFWXDODQJOHVLQWKHVLGHWRVLGH UKR SDQGFHSKDORFDXGDOGLUHFWLRQVUKR S)RUWKH ULJKW8$WKHVXJJHVWHGDQJOHLQWKHVLGHWRVLGHGLUHFWLRQZDVOHIWWKH DFWXDODQJOHZDVOHIW,QWKHFHSKDORFDXGDOGLUHFWLRQWKHVXJJHVWHGDQ JOHZDVFDXGDOWKHDFWXDODQJOHZDVFDXGDO $VWDWLVWLFDOO\ VLJQLÀFDQWVWURQJSRVLWLYHFRUUHODWLRQZDVGHWHFWHGLQWKHVLGHWRVLGHUKR SDQGFHSKDORFDXGDOGLUHFWLRQVUKR S &RQFOXVLRQ3UHLQWHUYHQWLRQDO'&(05$FDQDFFXUDWHO\SUHGLFWWKHEHVWWXEH DQJOHREOLTXLW\IRUYLVXDOLVDWLRQRIWKHXWHULQHDUWHU\RULJLQEHIRUH8$( % $GYDQWDJHVRIWKHEUDFKLDODSSURDFKLQXWHULQHDUWHULHVHPEROLVDWLRQ 3 51HFKLIRU%'RUREDW%XFKDUHVW52RIÀFH#GUQHFKLIRUUR 3XUSRVH'HVFULSWLRQRIDGYDQWDJHVRIWKHEUDFKLDODSSURDFKLQXWHULQHDUWHULHV HPEROLVDWLRQ 0HWKRGVDQG0DWHULDOVFRQVHFXWLYHFDVHVRIXWHULQHÀEURLGVHPEROLVDWLRQ XVLQJEUDFKLDODSSURDFK6RPHSDUDPHWHUVWKDWSHUPLWWKHHVWLPDWLRQRIWKLVWHFK QLTXHҋVUHVXOWVWKHFRPSOLFDWLRQVDQGWKHSRVWSURFHGXUHTXDOLW\RIOLIHZHUHIROORZHG 5HVXOWV7KHFDWKHWHULVDWLRQRIELODWHUDOXWHULQHDUWHULHVZDVSRVVLEOHLQRI FDVHV7KHPHDQWLPHRIWKHLQWHUYHQWLRQZDVPLQ6'PLQ5DGLRVFRS\ WLPHUDQJHGEHWZHHQPLQXWHVDQGPLQXWHVZLWKDPHDQWLPHRIPLQXWHV 6'PLQXWHV7KHFRPSOLFDWLRQVDWWKHSXQFWXUHVLWHZHUHEUDFKLDODUWHU\ VSDVPLQRIFDVHVORFDOKDHPDWRPDLQRIFDVHVEUDFKLDODUWHU\WKURP ERVLVLQRIFDVHVDQGFDVHRIWHJXPHQWDGKHUHQFHWRWKHGHHSHUOD\HUV 5HDGPLVVLRQIRUFRPSOLFDWLRQVZDVQHFHVVDU\LQFDVHV7KHSRVWHPEROLVDWLRQ SDLQZDVSHUFHSWHGOHVVLQWHQVHPHDQRQDVFDOHRIWKHSDWLHQWV DSSUHFLDWHGWKHDEVHQFHRIDQ\FRQVWUDLQWWRUHVWDVDQLPSRUWDQWDGYDQWDJH &RQFOXVLRQ7KHEUDFKLDODSSURDFKLVDVXFFHVVIXOWHFKQLTXHVXSHULRUWRIHPXUDO DSSURDFK WKDW SHUPLWV D VLJQLÀFDQW UHGXFWLRQ LQ UDGLRVFRS\ WLPH DQG UDGLDWLRQ GRVH&RPSOLFDWLRQVDWWKHSXQFWXUHVLWHDUHYHU\UDUHVLQGLUHFWUHODWLRQZLWKRS HUDWRUҋVH[SHULHQFH7KHSDWLHQWҋVFRPIRUWGXULQJÀUVWKRXUVDIWHULQWHUYHQWLRQLV VLJQLÀFDQWO\LQFUHDVHG7KHSRVWHPEROLVDWLRQSDLQLVOHVVLQWHQVH0LFURFDWKHWHUV ZHUHQRWQHFHVVDU\DVGLDJQRVWLFFDWKHWHUVZHUHXVHGLQDOOWKHLQWHUYHQWLRQVWKXV OHDGLQJWRFRVWUHGXFWLRQV % /XQJYROXPHLQSDWLHQWVZLWKSHFWXVH[FDYDWXPTXDQWLI\LQJWKH SXOPRQDU\LQYROYHPHQW" -9DOOHMRV &&DSXQD\3 &DUUDVFRVD00DUWLQH])HUUR-&DUUDVFRVD 9LFHQWH/RSH]$5%XHQRV$LUHV$5MDYVV#\DKRRFRPDU 3XUSRVH7 RTXDQWLI\WKHOXQJYROXPHRISHFWXVH[FDYDWXP3(SDWLHQWVXVLQJ FKHVW PXOWLVOLFH FRPSXWHG WRPRJUDSK\ 0'&7 DQG WR FRPSDUH WKHVH ZLWK D FRQWUROJURXS 0HWKRGV DQG 0DWHULDOV7KLUW\VL[ SDWLHQWV PHDQ DJH \HDUROG ZLWK 3( DQG FRQWUROV XQGHUZHQW ORZ GRVH FKHVW 0'&7 7KH YROXPH RI OXQJ SDUHQ FK\PDLQHDFKH[DPLQDWLRQZDVGHWHUPLQHGE\SHUIRUPLQJDWKUHHGLPHQVLRQDO UHFRQVWUXFWLRQ:HGHWHUPLQHGYDOXHVIRUWKHYROXPHRIWKHULJKWOXQJOHIWOXQJ DQGWKHSXOPRQDU\YROXPHLQGH[39,ULJKWOHIW6HYHULW\LQGLFHVRIWKHGHIRUPLW\ XVLQJWKHVWDQGDUG+DOOHULQGH[+,FKHVWZDOODV\PPHWU\LQGH[&:$,FDUGLDF FRPSUHVVLRQ LQGH[ &&, FDUGLDF DV\PPHWU\ LQGH[ &$, DQG VWHUQDO WLOW DQJOH ZHUHDOVRFDOFXODWHGIURP&7VFDQV6WDWLVWLFDOGLIIHUHQFHVRIPHDVXUHPHQWVZHUH FDOFXODWHGXVLQJWKH6WXGHQWWDQG.UXVNDOO:DOOLVWHVWV 5HVXOWV:HIRXQGHYLGHQFHS RIDORZHU39,LQ3(SDWLHQWVLQ FRPSDULVRQZLWKFRQWUROSDWLHQWV7KH39,ZDVGLUHFWO\FRUUHODWHGZLWK WKH+,U S DQGZLWKWKH&&,U S &RQFOXVLRQ7KLVSUHOLPLQDU\VWXG\VKRZHGGLIIHUHQFHVLQOXQJYROXPHVEHWZHHQ 3( SDWLHQWV DQG FRQWURO JURXS 7KHUHIRUH 39, FRUUHODWHG ZLWK VHYHULW\ LQGLFHV 7KHVHÀQGLQJVVXJJHVWWKDWOXQJYROXPHTXDQWLÀFDWLRQPD\EHDVHYHULW\LQGH[ RISXOPRQDU\LQYROYHPHQW % 3UHGLFWLRQRISRVWRSHUDWLYHSXOPRQDU\IXQFWLRQE\VLQJOHEUHDWK GXDOHQHUJ\[HQRQ&7 DSUHOLPLQDU\UHSRUW +<DQDJLWD::DWDQDEH< 6KLPL]X7 2NDGD+2KQR+2VDGD1+RQGD 01DND\DPD.DZDJRH6DLWDPD-3K\DQDJLW#VDLWDPDPHGDFMS 3XUSRVH&KURQLFREVWUXFWLYHSXOPRQDU\GLVHDVH&23'LVFRPPRQDQGOXQJ FDQFHULVVWLOORQHRIWKHOHDGLQJFDXVHVRIGHDWKZRUOGZLGH6RLWLVLPSRUWDQWWR DVFHUWDLQRSHUDELOLW\RISDWLHQWVKDYLQJERWK&23'DQGOXQJFDQFHU7KHSXUSRVH ZDVWRDVVHVVWKHDELOLW\RI[HQRQGXDOHQHUJ\&7WRSUHGLFWSRVWRSHUDWLYHSXO PRQDU\IXQFWLRQ 0HWKRGVDQG0DWHULDOV(LJKWSDWLHQWVZLWKOXQJFDQFHUSODQQHGIRUUHVHFWLRQZHUH HQUROOHGLQWKLVVWXG\,QVWLWXWLRQDOUHYLHZERDUGDSSURYHGWKLVVWXG\DQGZULWWHQ LQIRUPHGFRQVHQWZDVREWDLQHGIURPDOOSDWLHQWV7KH\ZHUHVFDQQHGZLWKDGXDO VRXUFH&7VFDQQHULQGXDOHQHUJ\PRGHN96QN9GXULQJDEUHDWKKROG DIWHUVLQJOHYLWDOFDSDFLW\EUHDWKRIDPL[WXUHRI[HQRQDQGR[\JHQLQWKHUDWLRRI [HQRQ;HQRQLPDJHV;HLPDJHVZHUHFDOFXODWHGE\WKUHHPDWHULDO GHFRPSRVLWLRQ7KHVXPRIWKHSL[HOYDOXHVRIWKH;HLPDJHVZLWKLQWKHSDUWRI WKHOXQJWREHUHPDLQHGDIWHUUHVHFWLRQ$DQGWKDWRIWKHZKROHOXQJ%ZHUH HQXPHUDWHG:HPXOWLSOLHG $%DQGSUHRSHUDWLYHIRUFHGH[SLUDWRU\YROXPHLQRQH VHFRQG)(9RUIRUFHGYLWDOFDSDFLW\)9&WRSUHGLFWSRVWRSHUDWLYH)(9RU)9& 3UHGLFWHG)(9DQG)9&ZHUHFRPSDUHGZLWKPHDVXUHGSRVWRSHUDWLYH)(9DQG )9&DQGUHJUHVVLRQZDVWHVWHGE\WVWDWLVWLFV 5HVXOWV7KHSUHGLFWHGYDOXHVRI)(9DQG)9&IURP;HLPDJHVFRUUHODWHGWRWKH SRVWRSHUDWLYHPHDVXUHPHQWV5 DQGWKHUHJUHVVLRQZDVVLJQLÀFDQW IRU)9&S &RQFOXVLRQ3UHGLFWHGSRVWRSHUDWLYH)(9DQG)9&ZLWKWKH;HLPDJHVFRUUHODWHG WRWKHSRVWRSHUDWLYH)(9DQG)9& 6FLHQWLILF6HVVLRQ $ 6&'()*+% 7KXUVGD\ (XURSHDQ&RQJUHVVRI 5DGLRORJ\ 5HVXOWV ,Q DOO ÀYH SDWLHQWV ÀVWXOD ZDV LPPHGLDWHO\ FORVHG DQG WKHUH ZHUH QR FRPSOLFDWLRQVFRQVLGHULQJRXUSURFHGXUH,QRQHSDWLHQWORFDOFDQFHUUHFXUUHQFH RFFXUUHGPRQWKVDIWHUWKHLQWHUYHQWLRQDQGLQWKHSDWLHQWZLWKGLYHUWLFXORVLV PRQWKVODWHUWKHQHZHSLVRGHRIGLYHUWLFXOLWLVFDXVHGDEVFHVVIRUPDWLRQ &RQFOXVLRQ 3HUFXWDQHRXV FORVXUH RI ORZRXWSXW HQWHURFXWDQHRXV ÀVWXODV ZLWK F\DQRDFULODWHJOXHXQGHUÁXRURVFRS\JXLGDQFHLVDVLPSOHDQGHIIHFWLYHPHWKRG WKDWUHSUHVHQWVDJRRGDOWHUQDWLYHWRVXUJLFDOWKHUDS\$GYDQWDJHRIWKLVPHWKRGLV WKDWWKHJOXLQJRIWKHÀVWXODFRXOGEHHDVLO\GHWHFWHGXQGHUÁXRURVFRS\VLQFHOLSLRGRO PDNHVWKHJOXHYLVLEOH6KRUWWHUPUHVXOWVRIWKLVQRYHOWHFKQLTXHDUHH[FHOOHQWEXW IXUWKHUHYDOXDWLRQRIORQJWHUPUHVXOWVLVUHTXLUHG % )OXRURVFRSLFDOO\JXLGHGGLODWDWLRQVRIRHVRSKDJHDOVWULFWXUHVGXHWR HSLGHUPRO\VLVEXOORVDG\VWURSKLFDORQJWHUPUHVXOWVIURPDVLQJOH FHQWUHVWXG\ 6&6SLOLRSRXORV5,QFKLQJROR0.URNLGLV3 *NRXW]LRV$0F*DUWK ,$KPHG1.DUXQDQLWK\56DOWHU7 6DEKDUZDO/RQGRQ8. 3XUSRVH7 RLQYHVWLJDWHWKHLPPHGLDWHDQGORQJWHUPUHVXOWVIROORZLQJWKHÁXRUR VFRSLFDOO\JXLGHGRHVRSKDJHDOEDOORRQGLODWDWLRQVIRUWKHPDQDJHPHQWRIG\VSKDJLD LQDVHULHVRISDWLHQWVVXIIHULQJIURPHSLGHUPRO\VLVEXOORVDG\VWURSKLFD'(% 0HWKRGVDQG0DWHULDOV7KHPHGLFDOUHFRUGVRIDOOSDWLHQWVWUHDWHGZLWKÁXRUR VFRSLFDOO\JXLGHGEDOORRQGLODWDWLRQRIRHVRSKDJHDOVWULFWXUHVDQG'(%EHWZHHQ DQG ZHUH LQFOXGHG LQ WKH VWXG\ DQG UHWURVSHFWLYHO\ DQDO\VHG 7KH LQGLFDWLRQIRUWKHWUHDWPHQWZDVG\VSKDJLDDWWULEXWHGWRDWOHDVWRQHUDGLRORJLFDOO\ YHULÀHGRHVRSKDJHDOVWULFWXUH7KHVWXG\ҋVSULPDU\HQGSRLQWVLQFOXGHGSURFHGXUDO WHFKQLFDO VXFFHVV FOLQLFDO LPSURYHPHQW DVVHVVHG E\ D WR G\VSKDJLD VFRUH DQGPDMRUFRPSOLFDWLRQVUDWH6HFRQGDU\HQGSRLQWVLQFOXGHGSDWLHQWVXUYLYDODQG UHLQWHUYHQWLRQUDWHV 5HVXOWV,QWRWDOFRQVHFXWLYH'(%SDWLHQWVPHDQDJHUDQJH \HDUVVXIIHULQJIURPG\VSKDJLDGXHWRRHVRSKDJHDOVWULFWXUHVZHUHWUHDWHGZLWK ÁXRURVFRSLFDOO\JXLGHGEDOORRQGLODWDWLRQV,QWRWDOSURFHGXUHVDQGGLODWD WLRQVLQOHVLRQVZHUHSHUIRUPHG7KHEDOORRQGLDPHWHUVUDQJHGIURPWRPP 0HDQWLPHIROORZXSZDVUDQJHPRQWKV7 HFKQLFDOVXFFHVV UDWHZDVSURFHGXUHV7KHUHZHUHQRPDMRUFRPSOLFDWLRQV0HDQ UHLQWHUYHQWLRQIUHHLQWHUYDOUDWHZDVPRQWKVZKLOHSRVWSURFHGXUDOG\VSKDJLD VFRUH ZDV VLJQLÀFDQWO\ ORZHU FRPSDUHG WR EDVHOLQH &, YV &,UHVSHFWLYHO\S &RQFOXVLRQ )OXRURVFRSLFDOO\ JXLGHG EDOORRQ GLODWDWLRQ IRU WKH PDQDJHPHQWRI G\VSKDJLDFDXVHGE\RHVRSKDJHDOVWULFWXUHVRZLQJWR'(%LVVDIHDQGHIIHFWLYH 7KHVSHFLÀFPHWKRGGHPRQVWUDWHGDVLJQLÀFDQWFOLQLFDOLPSURYHPHQWRIG\VSKDJLD DQG ORQJWHUP VDWLVIDFWRU\ UHLQWHUYHQWLRQ UDWHV ZKLOH QR PDMRU FRPSOLFDWLRQV ZHUHQRWHG % (IIHFWLYHQHVVRISHUFXWDQHRXVELOLDU\VWRQHUHPRYDODVSULPDU\ WUHDWPHQWFRPSDUHGZLWKHQGRVFRSLFUHWURJUDGHWHFKQLTXHLQFDVHV RI,+%'VWRQHVPPELOHGXFWVWRQHVKLVWRU\RI*,E\SDVVVXUJHU\ 6&KRL< +DQ6/HH+<X-HRQMXVL.5PDXP]RD#JPDLOFRP 3XUSRVH7 RHYDOXDWHWKHHIIHFWLYHQHVVRISHUFXWDQHRXVELOLDU\VWRQHUHPRYDODV SULPDU\WUHDWPHQWFRPSDUHGZLWKHQGRVFRSLFUHWURJUDGHWHFKQLTXHLQFDVHVRI ,+%'VWRQHVPPELOHGXFWVWRQHVKLVWRU\RI*,E\SDVVVXUJHU\ 0HWKRGVDQG0DWHULDOV)URP0DUFKWR0D\DWRWDORIFRQVHFXWLYH SDWLHQWVZLWKELOLDU\VWRQHVXQGHUZHQWSHUFXWDQHRXVELOLDU\VWRQHUHPRYDODVSUL PDU\WUHDWPHQWJURXS,Q RUVHFRQGDU\WUHDWPHQWDIWHUHQGRVFRSLFUHWURJUDGH WHFKQLTXHVKDGIDLOHGJURXS,,Q ,QWZRJURXSVWKHRQHVZKRVDWLVÀHGWKH LQFOXVLRQFULWHULDZHUHJURXS,ҋ0) 0HDQDJH\HDUVDQGJURXS ,,ҋ0) 0HDQDJH\HDUVUHVSHFWLYHO\7KHLQFOXVLRQFULWHULDZHUHDV IROORZVSDWLHQWVZKRLKDG,+%'VWRQHVLLKDGPPELOHGXFWVWRQHVLLLKDG KLVWRU\RISUHYLRXV*,E\SDVVVXUJHU\HJVXEWRWDOJDVWUHFWRP\ZLWK%LOORWK,,RS WRWDOJDVWUHFWRP\S\ORUXVSUHVHUYLQJSDQFUHDWLFRGXRGHQHFWRP\333'5HQ< FKROHGRFKRMHMXQRVWRP\:HDQDO\VHGVXFFHVVUDWHVDQGOHQJWKRISRVWSURFHGXUDO KRVSLWDOVWD\RIWKHWZRJURXSV 5HVXOWV 7KHUH ZDV QR VLJQLÀFDQW GLIIHUHQFH LQ VXFFHVV UDWH EHWZHHQ WKHW Z R JURXSVLQJURXS,ҋDQGLQJURXS,,ҋ3 $QGWKH OHQJWKRISRVWSURFHGXUDOKRVSLWDOVWD\ZDVVLJQLÀFDQWO\LQFUHDVHGLQJURXS,,ҋPHDQ GD\VJURXS,ҋPHDQGD\V3 $P\ODVHDQGOLSDVHOHYHOEHWZHHQSUH DQGSRVWSURFHGXUHZDVQRWVLJQLÀFDQWO\GLIIHUHQW3 DQGUHVSHFWLYHO\ 7KHUHZDVQRSURFHGXUDOFRPSOLFDWLRQ &RQFOXVLRQ7KHUHIRUHLQFDVHVRIDERYHPHQWLRQHGSDWLHQWVSULPDU\SHUFXWDQH RXVELOLDU\VWRQHUHPRYDOFDQEHPRUHHIÀFLHQW % $UWHULDOHPEROLVDWLRQIRUFHUYLFDOOHLRP\RPDVKRXOGZHWUHDWLWDV DGHQRP\RVLV" -.RK0.LP0/HH'-XQJ63DUN0/HH-:RQ'/HH./HH 6HRXO.5TKVR #\XKVDF 3XUSRVH7KHDLPRIWKLVVWXG\LVWRFRPSDUHWKHHIIHFWLYHQHVVRIXWHULQHDUWHU\ HPEROLVDWLRQ8$(LQWUHDWLQJV\PSWRPDWLFÀEURLGVLQWKHXWHULQHFHUYL[WRWKDWLQ WKHXWHULQHERG\RUIXQGXV 0HWKRGV DQG 0DWHULDOV )URP WKH GDWD IRU SDWLHQWV ZKR XQGHUZHQW 8$( EHWZHHQDQGZHUHWURVSHFWLYHO\DQDO\VHGWKHGDWDIRUSDWLHQWVZLWK ÀEURLGVORFDWHGLQWKHXWHULQHFHUYL[6HYHQRIWKHSDWLHQWVSUHVHQWHGDWRWDORI ÀEURLGVLQWKHXWHULQHERG\RUIXQGXVDVZHOODVLQWKHXWHULQHFHUYL[7KHHIIHFWV RI8$(DQGYDVFXODULWLHVRQDQJLRJUDSKLFÀQGLQJVZHUHFRPSDUHGEHWZHHQÀEURLGV LQWKHFHUYL[DQGÀEURLGVLQWKHXWHULQHERG\RUIXQGXV1HFURVLVRIÀEURLGVZDV DVVHVVHGE\05,PRQWKVDIWHU8$(6WDWLVWLFDODQDO\VLVZDVSHUIRUPHGXVLQJ WKH0DQQ:KLWQH\WHVWDQG)LVKHUҋVH[DFWWHVW 5HVXOWV&RPSOHWHQHFURVLVRIOHLRP\RPDVLQWKHXWHULQHFHUYL[ZDVVHHQLQRQO\ SDWLHQWVRIWKHZKLOHDOOÀEURLGVLQWKHXWHULQHERG\RUIXQGXVZHUHFRPSOHWHO\ LQIDUFWHG S 3DUWLDO QHFURVLV ZDV VHHQ LQ DQG QR QHFURVLV LQ 2QH SDWLHQWXQGHUZHQWK\VWHURVFRSLFUHVHFWLRQIRUUHPRYDORILQFRPSOHWHO\LQIDUFWHG ÀEURLG3RRUYDVFXODULWLHVZHUHQRWHGLQRISDWLHQWVZLWKFHUYLFDOÀEURLGV EXWLQQRQHRIWKHSDWLHQWVZLWKÀEURLGVLQWKHXWHULQHERG\RUIXQGXVS &RQFOXVLRQ3RRUYDVFXODULWLHVZHUHIUHTXHQWÀQGLQJLQFHUYLFDOOHLR\RPDVDQG RXWFRPHVRI8$(IRUFHUYLFDOOHLRP\RPDVZHUHGLVDSSRLQWLQJDQGLQGLFDWHFDXWLRQ LQVHOHFWLQJDQGFRXQVHOOLQJSDWLHQWVIRUWKLVWUHDWPHQW % 7UDQVFDWKHWHUSHOYLFDUWHULDOHPEROLVDWLRQIRUFRQWURORIREVWHWULF KDHPRUUKDJH 0)HUUHU3XFKRO &/DQFLHJR((VWHEDQ-&LDPSL0(GR 6(*RQ]OH]6(*RQ]OH]$O]LUD(67 ROHGR(6OROHVIHUUHU#RQRFRP 3XUSRVH([FHVVLYHEORRGORVVLVFRQVLGHUHGWREHJUHDWHUWKDQPOLQYDJLQDO GHOLYHU\RUPODIWHUFDHVDUHDQVHFWLRQ7KHSXUSRVHRIWKLVZRUNLVWRSUHVHQW RXUH[SHULHQFHLQHPHUJHQF\VHOHFWLYHDUWHULDOHPEROLVDWLRQLQWZRKRVSLWDOV 0HWKRGVDQG0DWHULDOV:HSUHVHQWZRPHQZKRXQGHUZHQWLQWUDFWDEOHRE VWHWULFEOHHGLQJ0HDQSDWLHQWDJHZDV\HDUV,QERWKKRVSLWDOVWKHUHZDVD WUDLQHGWHDPRQFDOOIRULQWHUYHQWLRQDOSURFHGXUHV,QGLFDWLRQIRUVHOHFWLYHDUWHULDO HPEROLVDWLRQZDVPDGHE\J\QDHFRORJLVWVDQGDQDHVWKHWLVWV1RQVHOHFWLYHSHOYLF DUWHULRJUDSK\ZDVSHUIRUPHGYLDWUDQVIHPRUDODSSURDFKWRGHPRQVWUDWHWKHDQDWRP\ DQG SRLQWV RI EOHHGLQJ :H SHUIRUPHG LQWUDDUWHULDO HPEROLVDWLRQ XVLQJ JHODWLQH VSRQJHSDUWLFOHVRUFRLOVGHSHQGLQJRQEOHHGLQJVRXUFH 5HVXOWVZHUHSULPDU\KDHPRUUKDJHVDQGZHUHVHFRQGDU\&DXVHV ZHUHDIWHUYDJLQDOGHOLYHULHVSODFHQWDDFFUHWDFHUYLFDOWHDUDQGXWHULQH DWRQ\DIWHUFDHVDUHDQVHFWLRQDUWHULDOWHDUVXWHULQHDWRQ\DQGSVHXGRDQ HXU\VPDIWHUDERUWLRQSVHGRDQHXU\VPDIWHUHFWRSLFFHUYLFDOSUHJQDQF\7KH WZRVHFRQGDU\KDHPRUUKDJHVZHUHGXHWRSVHXGRDQHXU\VPV&DWKHWHULVDWLRQRI ERWKXWHULQHDUWHULHVZDVSHUIRUPHGLQSDWLHQWV(PEROLVDWLRQPDWHULDO ZHHPSOR\HGJHODWLQHVSRQJHXVLQJ39$SDUWLFOHVDQGSDWLHQWZLWKFRLOV :HKDGQRWFRPSOLFDWLRQVUHODWHGWRSURFHGXUH7KHUHVXOWZDVVDWLVIDFWRU\LQ SDWLHQWVZLWKFRPSOHWHFHVVDWLRQRIEOHHGLQJEXWWZRFDVHVSUHVHQWHGVRPHKRXUV ODWHUHPEROLVDWLRQDQHSLVRGHRIUHEOHHGLQJWKDWXQGHUZHQWHPHUJHQWK\VWHUHFWRP\ &RQFOXVLRQ,QWUDDUWHULDOHPEROLVDWLRQLVDQDOWHUQDWLYHWRVXUJLFDOPHDVXUHVRIIHUV JRRGUHVXOWVLVVDIHDQGSUHVHUYHVIHUWLOLW\RIZRPHQ % $QRYHOWHFKQLTXHRISHUFXWDQHRXVFORVXUHRIHQWHURFXWDQHRXVÀVWXOD %6HNRYVNL/&DPEM6DSXQDU6SOLW+5EXGLPLU#\DKRRFRP 3XUSRVH3DWLHQWVZLWKDSRVWRSHUDWLYHHQWHURFXWDQHRXVÀVWXODKDYHVLJQLÀFDQWO\ UHGXFHGTXDOLW\RIOLIH5HFHQWO\VHYHUDOPLQLPDOO\LQYDVLYHPHWKRGVZHUHGHYHORSHG DVDQDOWHUQDWLYHWRVXUJLFDOWKHUDS\IRUWKLVFRQGLWLRQ:HSUHVHQWRXUWHFKQLTXH RISHUFXWDQHRXVFORVXUHRIHQWHURFXWDQHRXVÀVWXODXQGHUÁXRURVFRS\JXLGDQFH 0HWKRGVDQG0DWHULDOV)LYHSDWLHQWVZKRKDYHGHYHORSHGORZRXWSXWHQWHUR FXWDQHRXVÀVWXODVLQFH0DUFKZHUHLQFOXGHGLQWKLVVWXG\(QWHURFXWDQHRXV ÀVWXOD RFFXUUHG DV D SRVWRSHUDWLYH FRPSOLFDWLRQ RI FRORUHFWDO FDUFLQRPD LQ IRXU SDWLHQWVDQGLQRQHSDWLHQWÀVWXODZDVDSRVWVXUJHU\FRPSOLFDWLRQRIDSHUIRUDWHG GLYHUWLFXOLWLV1EXW\OF\DQRDFULOLFJOXHPL[HGZLWKOLSLRGRODVDQHPEROLVDWLRQPDWH ULDOZDVGHSOR\HGLQDÀVWXODWKURXJK)K\GURSKLOLFFDWKHWHUXQGHUÁXRURVFRS\ JXLGDQFH3URFHGXUHWDNHVOHVVWKDQPLQXWHVDQGUHTXLUHVDSSUR[LPDWHO\ VHFRQGVRIÁXRURVFRS\ 6FLHQWLILF6HVVLRQ 6 &$' ( ) *+% (XURSHDQ&RQJUHVVRI 5DGLRORJ\ WUHDWHGZLWKSHUFXWDQHRXVWUDQVKHSDWLFSODFHPHQWRISDUWLDOO\H37)(H[SDQGHG SRO\WHWUDÁXRURHWK\OHQHFRYHUHGVWHQWVLQD<FRQÀJXUDWLRQ 5HVXOWV%LODWHUDOQ @DQGUDSLGO\UHVROYLQJFKRODQJLWLV>Q @RFFXUUHGLQ IRXUSDWLHQWV%LOLUXELQOHYHOGHFUHDVHGVLJQLÀFDQWO\IROORZLQJVWHQWSODFH PHQWS0HGLDQSDWLHQWVXUYLYDODQGVWHQWSDWHQF\WLPHVZHUHGD\V FRQÀGHQFHLQWHUYDO>&,@GD\VDQGGD\V&,GD\V UHVSHFWLYHO\6HYHQSDWLHQWVSUHVHQWHGZLWKVWHQWRFFOXVLRQGXHWRVOXGJH LQFUXVWDWLRQ Q DQG WXPRXU RYHUJURZWK Q DQG UHTXLUHG UHSHDWHG 37%' 7XPRXULQJURZWKDFXWHFKROHF\VWLWLVRUVWHQWPLJUDWLRQZDVQRWREVHUYHGLQDQ\ RIWKHVHSDWLHQWV &RQFOXVLRQ7KHSUHOLPLQDU\UHVXOWVRISHUFXWDQHRXVSDOOLDWLYHWUHDWPHQWRIPD OLJQDQWKLODUELOLDU\REVWUXFWLRQZLWK<FRQÀJXUHGFRYHUHGVWHQWVVXJJHVWWKDWWKH\ DUHVDIHDQGFOLQLFDOO\HIIHFWLYH 5RRP( 0XVFXORVNHOHWDO 66 2VWHRSRURVLVDQGERQHPDUURZ 0RGHUDWRUV -($GDPV0DQFKHVWHU8. 09O\FKRX/DULVVD*5 % ,PSDFWRIH[HUFLVHRQERQHPLQHUDOGHQVLW\ ,$EEDV+(OJKDZDEL:<RXQDQ$6DERXU0*REULDO&DLUR(* LPDQDEEDV#\DKRRFRP 3XUSRVH7 RDVVHVVWKHLPSDFWRIFDORULFUHVWULFWLRQGLHWYHUVXVFDORULFUHVWULFWLRQ GLHWLQDGGLWLRQWRDHURELFH[HUFLVHVRQERQHPLQHUDOGHQVLW\LQREHVHZRPHQ 0HWKRGVDQG0DWHULDOV)RUW\REHVHZRPHQZHUHFODVVLÀHGUDQGRPO\LQWRWZR JURXSVRIHTXDOLQQXPEHU7KHÀUVWJURXSUHFHLYHGFDORULFUHVWULFWLRQGLHWZKLOH WKH VHFRQG UHFHLYHG FDORULF UHVWULFWLRQ GLHW LQ DGGLWLRQ WR D SURJUDP RI DHURELF H[HUFLVHVRYHUPRQWKV7KHYDULDEOHVPHDVXUHGLQFOXGHGERG\PDVVLQGH[IDW ZHLJKWOHDQPDVVEDVDOPHWDEROLFUDWHDQGERQHPLQHUDOGHQVLW\ 5HVXOWV &RPSDULVRQ EHWZHHQ ERWK JURXSV VKRZHG VLJQLÀFDQWO\ KLJKHU SRVW WUHDWPHQWOHDQPDVVEDVDOPHWDEROLFUDWHDQGERQHPLQHUDOGHQVLW\LQZHLJKW EHDULQJERQHVOXPEDUVSLQHDQGKLSLQWKHVHFRQGJURXSFRPSDUHGWRWKHÀUVW RQH2QWKHRWKHUKDQGWKHERQHPLQHUDOGHQVLW\RIWKHUDGLXVVKRZHGVLJQLÀFDQW GHFUHDVH EHWZHHQ WKH SUH DQG SRVWWUHDWPHQW UHVXOWV LQ ERWK JURXSV ZLWK QR VLJQLÀFDQWGLIIHUHQFHVEHWZHHQWKHWZRJURXSV &RQFOXVLRQ6LJQLÀFDQWLQFUHDVHLQWKHERQHPLQHUDOGHQVLW\RIWKHZHLJKWEHDULQJ ERQHV ZDV QRWHG LQ REHVH ZRPHQ XQGHUJRLQJ FDORULF UHVWULFWLRQ LQ DGGLWLRQ WR DHURELFH[HUFLVHVWKDQLQWKRVHQRWXQGHUJRLQJH[HUFLVHV $HURELFH[HUFLVHVVKRXOG EHDGGHGWRZHLJKWORVVSURJUDPVIRUREHVHZRPHQWRUHGXFHWKHDGYHUVHHIIHFWV RIFDORULFUHVWULFWLRQGLHWRQERQHPLQHUDOGHQVLW\ % 4XDQWLWDWLYHXOWUDVRXQGDWWKHSKDODQJHVLQDFRKRUWRIWZLQVRI GLIIHUHQWDJHV **XJOLHOPL ) 'H7 HUOL]]L$&DULQL/6LQLEDOGL50LQJDUHOOL) %UDQFDWL )RJJLD,7&DUSL,75RPH,7JJXJOLHOPL#XQLIJLW 3XUSRVH3UHOLPLQDU\VWXG\RIERQHWLVVXHTXDOLW\E\TXDQWLWDWLYHXOWUDVRXQG486 DWWKHSKDODQJHVLQWZLQFKLOGUHQDQGDGXOWV 0HWKRGVDQG0DWHULDOVWZLQFRXSOHVRIKHDOWK\FKLOGUHQXQGHU\HDUVRI DJH1 DQGRIDGXOWV1 LQWKHDJHUDQJH\HDUVZHUHUHFUXLWHGIRU 486PHDVXUHPHQWDWWKHSKDODQJHV$QWKURSRPHWULFGDWDVH[DJHKHLJKWDQG ZHLJKWZHUHUHFRUGHGWRJHWKHUZLWKDPSOLWXGHGHSHQGHQWVSHHGRIVRXQG$' 6R6DQGERQHWUDQVPLVVLRQWLPH%77 5HVXOWV0HDQDJHLQFKLOGUHQJURXSZDV\UVKHLJKWFPZHLJKW NJ0HDQDJHLQDGXOWJURXSZDV\UVKHLJKWFPZHLJKW NJ,QFKLOGUHQ $'6R6DQG%77ZHUHSRVLWLYHO\FRUUHODWHGZLWKDJHU U KHLJKWU U DQGZHLJKWU U LQDGXOWV $'6R6ZDV QHJDWLYHO\UHODWHGWRDJHU $'6R6DQG%77ZHUHSRVLWLYHO\UHODWHGWRKHLJKW U U &RUUHODWLRQFRHIÀFLHQWVIRU $'6R6DQG8%3,EHWZHHQFRXSOHGRI WZLQVDUHVLJQLÀFDQWO\KLJKHUIRUFKLOGUHQU IRU $'6R6DQGU IRU%77 WKDQIRUDGXOWVU IRU $'6R6DQGU IRU%777KHDEVROXWHYDOXHRIWKH GLIIHUHQFHVEHWZHHQWZLQVIRU $'6R6DQG%77LVVLJQLÀFDQWO\KLJKHULQDGXOWWZLQV % 7KHFRPSDULVRQRIYLVXDOLVDWLRQDPRQJEDOORRQRFFOXGHGUHWURJUDGH WUDQVYHQRXVYHQRJUDSK\XVLQJLRGLQHFRQWUDVWDQGFDUERQGLR[LGH JDVDQGWKHVXEVHTXHQWREOLWHUDWLRQE\IRDPVFOHURVDQWVIRUJDVWULF YDULFHVXQGHU'6$ -.RL]XPL7 +DVKLPRWR.0\RMLQ&,WRX7 +DUD7 6HNLJXFKL7 ,FKLNDZD 7 .DJDZD1:DWDQDEH,VHKDUD-3MNRL]XPL#LVLFFXWRNDLDFMS 3XUSRVH 3UHYLRXVO\ ZH DSSOLHG FDUERQ GLR[LGH JDV '6$ IRU EDOORRQRFFOXGHG UHWURJUDGH WUDQVYHQRXV YHQRJUDSK\ %579 SULRU WR REOLWHUDWLRQ%572 XVLQJ IRDPVFOHURVDQWVDQGFODULÀHG&2GHPRQVWUDWHGJDVWULFYDULFHV*9PRUHFOHDUO\ WKDQLRGLQHFRQWUDVW+RZHYHUWKHSK\VLRORJLFDOSURSHUWLHVRI&2DQGIRDPDUH GLIIHUHQW7KXVZHFRPSDUHGWKHYLVXDOLVDWLRQRIWKHPXQGHU'6$ 0HWKRGVDQG0DWHULDOV)RUÀIWHHQSDWLHQWVZLWK*9%579XVLQJLRGLQHFRQWUDVW ZDV SHUIRUPHG ÀUVW DQG WKHQ &2 VHFRQG 7KHVH %579 ZHUH UHSHDWHG DIWHU FKDQJLQJ SDWLHQWҋV KDELWXV WKH FDWKHWHU SRVLWLRQV RU GRZQJUDGLQJV :KHQ *9 ZHUHRSDFLÀHGRQ&2%579IRDPVFOHURVDQWVZHUHLQMHFWHG(DFKYLVXDOLVDWLRQ JUDGHRI*9JUDGH*9RQO\*9!FROODWHUDOV*9FROODWHUDOVFROODWHUDOV RQO\ZDVGHWHUPLQHGE\WZRREVHUYHUV&DUP&7ZDVSHUIRUPHGWRFRQÀUPWKH UHDFKRIDLULQWR*9 5HVXOWV7KLUW\IRXUSDLUVRI%579ZHUHSHUIRUPHGIRUÀIWHHQSDWLHQWV7KHJUDGHV RQ&2%579ZHUHVLJQLÀFDQWO\SVPDOOHUWKDQWKHJUDGHVRQ LRGLQH%5792QWKHRWKHUKDQGVWKHJUDGHVRQIRDP%572 DUHVLPLODUWRWKHODVWJUDGHVRQ&2%579ZKLOHVLJQLÀFDQWO\S GLIIHUHQWIURPWKHODVWJUDGHVRQLRGLQH%579,QDOOSDWLHQWV*9ZHUH RSDFLÀHG E\ IRDP RQ &DUP &7 DQG FRPSOHWH WKURPERVLV RI *9 ZDVREWDLQHG ZLWKRXWDQ\FRPSOLFDWLRQ &RQFOXVLRQ&2%579YLVXDOLVHG*9EHWWHUWKDQLRGLQH%579DQGSURYLGHGD JRRGVLPXODWLRQRI%572XVLQJIRDPVFOHURVDQWVOHDGLQJVXFFHVVIXOWKURPERVLV RI*9 % 5HWULHYDEOHFRYHUHGVWHQWLQWKHWUHDWPHQWRIEHQLJQELOLDU\ VWULFWXUHVLQWHUPHGLDWHWHUPRXWFRPHV &.LP'*ZRQ*< .R.%6XQJ+.<RRQ-6KLQ-.LP+< 6RQJ 6HRXO.5FKHUU\NLP #GUHDPZL]FRP 3XUSRVH7 RLQYHVWLJDWHWKHLQWHUPHGLDWHWHUPRXWFRPHVRIDUHWULHYDEOHFRYHUHG VWHQWLQWKHWUHDWPHQWRIEHQLJQELOLDU\VWULFWXUHV 0HWKRGV DQG 0DWHULDOV )URP$SULO WR )HEUXDU\ SDWLHQWV ZLWK EHQLJQELOLDU\VWULFWXUHVZHUHHQUROOHGLQWKLVVWXG\6HYHQWHHQSDWLHQWVKDGQRW SUHYLRXVO\XQGHUJRQHLQWHUYHQWLRQDOWUHDWPHQW6L[WHHQSDWLHQWVKDGUHFXUUHQWRU UHIUDFWRU\VWULFWXUHVGHVSLWHSURORQJHGFDWKHWHULQWHUSRVLWLRQDIWHUEDOORRQGLODWLRQ SURFHGXUHV7KHUHWULHYDEOHVWHQWZDVIXOO\37)(SRO\WHWUDÁXRURHWK\OHQHFRYHUHG VHOIH[SDQGDEOHQLWLQROVWHQW7 HFKQLFDOVXFFHVVFOLQLFDOVXFFHVVGUDLQDJHFDWK HWHUUHPRYDODIWHUSHUFXWDQHRXVWUHDWPHQWXVLQJDUHWULHYDEOHVWHQWDQGSULPDU\ SDWHQF\UDWHZHUHHYDOXDWHG 5HVXOWV $WRWDORIUHWULHYDEOHFRYHUHGVWHQWVZHUHSODFHGGXHWRVWHQWPLJUDWLRQ Q RUSHUVLVWHQWVWULFWXUHQ DIWHUVHVVLRQVRIVWHQWUHPRYDO SURFHGXUHV7KHVWHQWVZHUHVXFFHVVIXOO\SODFHGDQGUHPRYHGLQDOOFDVHV7KH PHDQVWHQWLQGZHOOLQJSHULRGZDVPRQWKVUDQJHPRQWKV&OLQLFDOVXFFHVV ZDV DFKLHYHG LQ SDWLHQWV 'XULQJ WKH PHDQ IROORZXS RI PRQWKV UDQJHPRQWKVWKUHHRISDWLHQWVKDGUHFXUUHQFHRIFOLQLFDOO\VLJQLÀFDQW VWULFWXUHV7KHSULPDU\SDWHQF\UDWHVDWDQG\HDUVZHUHDQG UHVSHFWLYHO\ &RQFOXVLRQ,QWHUPHGLDWHWHUPRXWFRPHVLQGLFDWHWKDWSHUFXWDQHRXVWUHDWPHQWRI EHQLJQELOLDU\VWULFWXUHVXVLQJDUHWULHYDEOHFRYHUHGVWHQWDSSHDUVWREHIHDVLEOH DQGFOLQLFDOO\HIIHFWLYHPHWKRG % 3HUFXWDQHRXV<FRQÀJXUHGFRYHUHGVWHQWSODFHPHQWIRUPDOLJQDQW KLODUELOLDU\REVWUXFWLRQDSURVSHFWLYHSLORWVWXG\ 16HR'*ZRQ*< .R.%6XQJ+.<RRQ-6KLQ-.LP+< 6RQJ 6HRXO.5VOGPVGO#KDQPDLOQHW 3XUSRVH7 RLQYHVWLJDWHWKHWHFKQLFDODQGFOLQLFDOVDIHW\DQGHIÀFDF\RISHUFXWDQH RXV<FRQÀJXUHGFRYHUHGVWHQWSODFHPHQWLQSDWLHQWVZLWKPDOLJQDQWKLODUELOLDU\ REVWUXFWLRQ 0HWKRGVDQG0DWHULDOV7KLVLVDSURVSHFWLYHSLORWVWXG\WKDWHQUROOHGFRQ VHFXWLYH SDWLHQWV ZLWK PDOLJQDQW KLODU ELOLDU\ REVWUXFWLRQV IURP 2FWREHU WR 'HFHPEHU7KLVVWXG\ZDVDSSURYHGE\WKH,QVWLWXWLRQDO5HYLHZ%RDUGRIRXU ,QVWLWXWLRQDQGLQIRUPHGFRQVHQWZDVREWDLQHGIURPHDFKSDWLHQW $OOSDWLHQWVZHUH 6FLHQWLILF6HVVLRQ $ 6&'()*+% 7KXUVGD\ (XURSHDQ&RQJUHVVRI 5DGLRORJ\ % 6FDOLQJUHODWLRQVEHWZHHQWUDEHFXODUERQHPDVVDQG' PLFURVWUXFWXUHLQWZRORFDWLRQVRIWKHKXPDQIHPXU 7 %DXP -6%DXHU,6LGRUHQNR50RQHWWL) (FNVWHLQ00DWVXXUD (0/RFKPXHOOHU3 .=\VVHW&5DHWK0XQLFK'(*DUFKLQJ'( 6DO]EXUJ$79LHQQD$7WKEDXP#JP[GH 3XUSRVH 7 R LQYHVWLJDWH SRVVLEOH VLWHGLIIHUHQFHV RI ERQH PDVVPLFURVWUXFWXUH VFDOLQJUHODWLRQVWKDWPD\EHUHODWHGWRGLIIHUHQWORDGLQJFRQGLWLRQVDFFRUGLQJWR :ROIIҋVODZRIERQHUHPRGHOOLQJ 0HWKRGV DQG 0DWHULDOV &\OLQGULFDO ERQH VSHFLPHQV ZLWK D GLDPHWHU RI PP ZHUHKDUYHVWHGIURPKXPDQIHPRUD(LJKW\HLJKWVSHFLPHQVZHUHWDNHQIURPWKH IHPRUDOQHFNDQGVSHFLPHQVIURPWKHJUHDWHUWURFKDQWHU'PLFUR&7LP DJHVZLWKLVRWURSLFVSDWLDOUHVROXWLRQRIPLFURPHWUHZHUHREWDLQHG%RQHPDVV %979RIHDFKVSHFLPHQZDVFDOFXODWHG7 RGHWHUPLQHWKHORFDOVWUXFWXUHRIWKH WUDEHFXODUQHWZRUNDVZHOODVLWVDOLJQPHQWZLWKWKHGLUHFWLRQRIWKHH[WHUQDOIRUFH DFWLQJRQWKHERQHLVRWURSLFDOSKDDQGDQLVRWURSLFVFDOLQJLQGLFHVDOSKD]ZHUH FRPSXWHG7KHQWKHPRPHQWVRIWKHGLVWULEXWLRQPHDQ>@YDULDQFHYDURIWKH LVRWURSLFDQGDQLVRWURSLFVFDOLQJLQGLFHVZHUHFDOFXODWHG6FDOLQJH[SRQHQWVZHUH GHWHUPLQHGDVWKHVORSHRIDOLQHDUÀWLQWKHGRXEOHORJDULWKPLFUHSUHVHQWDWLRQRIWKH FRUUHODWLRQVRI%979DJDLQVWWKHPRPHQWVRIWKHGLVWULEXWLRQRIWKHVFDOLQJLQGLFHV 5HVXOWV $OOFRUUHODWLRQVREH\HGYHU\DFFXUDWHO\SRZHUODZVZLWKVFDOLQJH[SRQHQWV RIDQG>DOSKD@DQGYDUDOSKDDQG>DOSKD]@ DQGDQGYDUDOSKD]QHFNDQGWURFKDQWHUUHVSHFWLYHO\7KXVERQH PDVVPLFURVWUXFWXUHVFDOLQJUHODWLRQVRIWKHERQHSUREHVWDNHQIURPWZRGLIIHUHQW VLWHVRIWKHIHPXUVKRZHGVXUSULVLQJO\VPDOOYDULDWLRQV &RQFOXVLRQ,QWKHIHPXUWUDEHFXODUERQHPDVVPLFURVWUXFWXUHVFDOLQJUHODWLRQV PD\KDYHDUDWKHUXQLYHUVDOFKDUDFWHUDQGGRQRWGHSHQGVRPXFKRQWKHW\SHRI H[WHUQDOPHFKDQLFDOIRUFHV % 4XDQWLWDWLYHDQDO\VLVRISHUIXVLRQSDUDPHWHUVLQRVWHRSRURWLF SDWLHQWVZLWKDFXWHYHUWHEUDOIUDFWXUHXVLQJG\QDPLFFRQWUDVW HQKDQFHG05, *3 6FKPLGW $%LIIDU2'LHWULFK66RXUEURQ0'Ҋ$QDVWDVL .1LNRODRX0) 5HLVHU$%DXU0HOQ\N0XQLFK'(/HHGV8. JHUZLQVFKPLGW#PHGXQLPXHQFKHQGH 3XUSRVH7 RHYDOXDWHWKHSRWHQWLDORITXDQWLWDWLYHG\QDPLFFRQWUDVWHQKDQFHG05, '&(05,LQYHUWHEUDOERQHPDUURZY%0RISDWLHQWVZLWKRVWHRSRURVLVDQGDFXWH YHUWHEUDOFRPSUHVVLRQIUDFWXUHV 0HWKRGVDQG0DWHULDOVSDWLHQWVZLWKDFXWHIUDFWXUHVIHPDOHVPDOHV PHGLDQDJHUDQJHDQGVXEMHFWVZLWKRXWNQRZQKLVWRU\RIRVWHRSRURVLV IHPDOHV PDOHV PHGLDQ ZHUH H[DPLQHG XVLQJ WZRGLPHQVLRQDO '&(05,52,'DWDLQIUDFWXUHGQ DQGQRUPDODSSHDULQJYHUWHEUDHQ ZHUHDQDO\VHGZLWKDWZRFRPSDUWPHQWWUDFHUNLQHWLFPRGHOSURYLGLQJHVWLPDWHV RIDWOHDVWLQGHSHQGHQWSDUDPHWHUVSODVPDÁRZ3)SODVPDYROXPH39DQG H[WUDFWLRQÁRZ()3DUDPHWHUVZHUHFRUUHODWHGZLWKGXDO[UD\DEVRUSWLRPHWU\ ';$Q DQGTXDQWLWDWLYHFRPSXWHGWRPRJUDSK\4&7GHQVLWRPHWU\Q 5HVXOWV0HDQ3)ZDVVLJQLÀFDQWO\KLJKHULQIUDFWXUHVWKDQLQQRUPDODSSHDULQJ YHUWHEUDHYVP/P/PLQS6LPLODUO\PHDQ39DQG() GLIIHUHGVLJQLÀFDQWO\YVP/P/DQGYVP/P/ PLQ 0HDQ 3) ZDV VLJQLÀFDQWO\ GHFUHDVHG LQ QRUPDO DSSHDULQJ Y%0 RI RVWH RSRURWLFSDWLHQWVFRPSDUHGWRWKHFRQWUROJURXSYVP/P/PLQ S 0HDQ YDOXHV RI 3) DQG 39 ZHUH VLJQLÀFDQWO\ GHFUHDVHG LQ OXPEDU FRPSDUHG WR WKRUDFLF YHUWHEUDH S 39 VKRZHG D VLJQLÀFDQW FRUUHODWLRQ ZLWK4&7S &RQFOXVLRQ'&(05,LVXVHIXOWRGLIIHUHQWLDWHQRUPDODSSHDULQJY%0LQRVWH RSRURWLF SDWLHQWV IURP KHDOWK\ VXEMHFWV DV ZHOO DV DFXWH FRPSUHVVLRQ IUDFWXUH )XUWKHUPRUHLWPD\VHUYHDVDWRROWRJUDGHRVWHRSRURVLV % 5ROHRIGLIIXVLRQZHLJKWHGZKROHERG\05,ZLWKEDFNJURXQGERG\ VLJQDOVXSSUHVVLRQ':,%6IRUGLVHDVHGHWHFWLRQLQSDWLHQWVZLWK PXOWLSOHP\HORPDSUHOLPLQDU\UHVXOWV 3 $%RQDIÀQL',SSROLWR,0DFFKL) 5RVVLQL$'L/HOLR66LURQL0RQ]D,7 SDERQDIÀQL#JPDLOFRP 3XUSRVH 7 R DVVHVV WKH RYHUDOO GLDJQRVWLF FDSDELOLW\ RI ZKROH ERG\ 05,Z L W K ':,%6WHFKQLTXHFRPELQHGZLWKVWDQGDUG7DQG67,57VHTXHQFHVIRUGHWHF WLRQRIERQHPDUURZOHVLRQVLQSDWLHQWVZLWKPXOWLSOHP\HORPD00 0HWKRGVDQG0DWHULDOVSDWLHQWVZLWK00XQGHUZHQW7$FKLHYD3KLOLSV :%05, VWXG\ IURP VNXOO YHUWH[ WR IHHW XVLQJ D EXLOWLQERG\ FRLO DQG VWHSSLQJ WKDQLQFKLOGUHQ$'6R6GLIIFKLOGUHQDGXOWVWWHVW %77GLIIFKLOGUHQDGXOWVWWHVW$EVROXWHGLIIHUHQFH EHWZHHQWZLQVLQFUHDVHVVLJQLÀFDQWO\ZLWKDJHU SIRU$'6R6 DQGU SIRU%77 &RQFOXVLRQ'LIIHUHQWLDWLRQLQERQHWLVVXHTXDOLW\LQWZLQVLVLQFUHDVLQJZLWKDJH DPRQJ WZLQV FRXSOHV DQG WKLV SUREDEO\ UHÁHFWV GLIIHUHQWLDWLRQLQ OLIHVW\OH OLIH KDELWVDQGGLHW % %DULDWULFVXUJHU\DQGUDGLRORJLVWVEHVLGHVFRPSOLFDWLRQVDQ LPSRUWDQWUROHLQWKHHYDOXDWLRQRIWUHDWPHQWHIÀFDF\DQGHIIHFWV ''LDQR ) 3RQWL&6DVVL**DU]LOOR**XJOLHOPL(6DOL]]RQL *%DWWLVWD$%D]]RFFKL%RORJQD,76DQ*LRYDQQL5RWRQGR)RJJLD,7 GDQLGG#OLEHURLW 3XUSRVH%DULDWULFVXUJHU\LVWKHPRVWHIIHFWLYHZD\RIFRQWUROOLQJVHYHUHREHVLW\ DQGLWVPHGLFDOFRPRUELGLWLHV2XUDLPZDVWRLQYHVWLJDWHWKHLPSDFWRIEDULDWULF WUHDWPHQW RQ ERG\ FRPSRVLWLRQ %& DQG ERQH PHWDEROLVP RYHU D SHULRG RI PRQWKVIROORZLQJWKHVXUJLFDOLQWHUYHQWLRQDQGWRGHWHUPLQHWKHUROHRIGXDOHQHUJ\ [UD\DEVRUSWLRPHWU\';$LQWKHPDQDJHPHQWRIREHVLW\ 0HWKRGVDQG0DWHULDOV:HSURVSHFWLYHO\HQUROOHGIHPDOHSDWLHQWV \HDUROG.JPGLUHFWHGWREDULDWULFVXUJHU\5RX[HQ<JDVWULFE\SDVV RQYHUWLFDOEDQGHGJDVWURSODVW\$OOSDWLHQWVXQGHUZHQWZKROHERG\DQGOXPEDU VSLQH';$VFDQVEHIRUHWUHDWPHQWDQGDIWHUDQGPRQWKV%&SDUDPHWHUV ZHUHDVVHVVHGIDWPDVV)0QRQERQHOHDQPDVV/0ERQHPLQHUDOFRQWHQWDQG GHQVLW\%0'RQZKROHERG\DQGUHJLRQDOEDVLV7KXVGLIIHUHQWLDOUDWHVRIPDVV DQG%0'FKDQJHVZHUHFDOFXODWHGWRGHÀQHWKHWUHQGLQWKHRYHUDOOZHLJKWORVV 5HVXOWV %RG\ PDVV LQGH[ GHFUHDVHG LQ WKH ÀUVW PRQWKV DQG JUHZ VWHDG\ EHWZHHQDQGPRQWKVS$GHFUHDVHRI)0/0UDWLRZDVREVHUYHG LQERWKWRWDODQGDQGURLGUHJLRQDWPRQWKV)0/0ZKLOHVOLJKWO\LQFUHDVHG EHWZHHQDQGPRQWKV)0/06LPLODUWUHQGZDVREVHUYHGIRUFHQWUDODQG SHULSKHUDOIDWGLVWULEXWLRQUDWLRу DQGу UHVSHFWLYHO\ S$UHGXFWLRQRIWRWDODQGOXPEDU%0'ZDVREVHUYHGDWPRQWKVHYHQ VWURQJHU DW PRQWKV FRPSDUHG WR SUHWUHDWPHQW YDOXHV у DQG у UHVSHFWLYHO\S &RQFOXVLRQ %& DQG ERQH PHWDEROLVP DUH VLJQLÀFDQWO\ PRGLÀHG DIWHU EDULDWULF VXUJHU\';$LVIXQGDPHQWDOLQWKHLQYHVWLJDWLRQRISDWLHQWVVXEPLWWHGWRVXUJLFDO WUHDWPHQWIRUPRUELGREHVLW\DQGLQWKHLUFOLQLFDOPDQDJHPHQW % )DWIUDFWLRQDQG7 YDOXHVRIYHUWHEUDOERQHPDUURZXWLOLVLQJDQHZ IDWVHSDUDWLRQ05WHFKQLTXHLQSHULPHQRSDXVDOZRPHQFRPSDULVRQ ZLWKERQHPLQHUDOGHQVLWRPHWU\ ) %(UJHQ *<LOGLULP$&HOLN$(<LOGL]-.DUDND\D8$\GLQJR] $QNDUD75,VWDQEXO75DHOFLQGU#JPDLOFRP 3XUSRVH7 RXVHIDWIUDFWLRQDQG7 YDOXHVWRLQYHVWLJDWHERQHPLQHUDOLVDWLRQOHYHO XVLQJDQHZ05WHFKQLTXHFDOOHG´LWHUDWLYHGHFRPSRVLWLRQRIZDWHUDQGIDWZLWKHFKR DV\PPHWU\DQGOHDVWVTXDUHVHVWLPDWLRQTXDQWLÀFDWLRQµLQSHULPHQRSDXVDOZRPHQ 0HWKRGVDQG0DWHULDOV%HWZHHQ2FWREHUDQG'HFHPEHUPHDQDJH \HDUVPD[PLQFRQVHFXWLYHSDWLHQWVZKRDJUHHGWRXQGHUJR05, DQG ZKR KDG D VSLQDO GXDO HQHUJ\ [UD\ DEVRUSWLRPHWU\ '(;$ H[DPLQDWLRQ FRQVWLWXWHG WKH VWXG\ SRSXODWLRQ ' IDVW JUDGLHQW UHFDOOHG HFKR )*5( SXOVH VHTXHQFHZLWKVL[DV\PPHWULFHFKRHVZDVXVHG)DWIUDFWLRQDQG7 YDOXHVZHUH PHDVXUHGIURP//YHUWHEUDHE\SODFLQJ52,V'HSHQGLQJRQWVFRUHVGHULYHG IURP%0'YHUWHEUDHZHUHFODVVLÀHGLQWRJURXSVQRUPDORVWHRSDHQLD RVWHRSRURVLV2QHZD\$129$RU:HOFK$129$ZDVSHUIRUPHGWRFRPSDUHWKH GLIIHUHQFHVDPRQJJURXSV7KHDELOLW\RIIDWIUDFWLRQIRUWKHSUHGLFWLRQRIRVWHRSRUR VLVRVWHRSDHQLDZDVHYDOXDWHGE\52&DQDO\VLV 5HVXOWV)RUIDWIUDFWLRQWKHPHDQYDOXHVZHUHIRXQGWREHGLIIHUHQWLQWKUHHJURXSV 3*URXSYHUWHEUDHZHUHGLIIHUHQWIURPJURXSVDQG37KH DUHDXQGHU52&FXUYHIRUIDWIUDFWLRQZDV&,7KHRSWLPDO FXWRIISRLQWZDVREWDLQHGDV)RUWKLVVHQVLWLYLW\DQGVSHFLÀFLW\RIIDWIUDF WLRQZHUHDQGUHVSHFWLYHO\)RU7 WKHUHZDVQRVWDWLVWLFDOO\VLJQLÀFDQW GLIIHUHQFHEHWZHHQWKHJURXSV3 &RQFOXVLRQ,WLVSRVVLEOHWRHVWLPDWHWKHOHYHORIERQHPLQHUDOLVDWLRQE\TXDQWLÀ FDWLRQRIWKHIDWIUDFWLRQZLWKWKHQHZ05WHFKQLTXHZLWKDQDFFHSWDEOHVHQVLWLYLW\ DQGVSHFLÀFLW\OHYHOV 6FLHQWLILF6HVVLRQ 6 &$' ( ) *+% (XURSHDQ&RQJUHVVRI 5DGLRORJ\ 5HVXOWV,QDOOSDWLHQWV2&'OHVLRQVZHUHFOHDUO\YLVLEOHRQWKH$8&PDSVDQG VKRZHG VWURQJO\ HOHYDWHG SHUIXVLRQ DQG SHUPHDELOLW\ 0HDQ YDOXHV 6' ZHUH 3) PO POPLQ 39 36 PO POPLQ DQG 9(( 7KHIROORZXSVFDQVLQGLFDWHGDGHFUHDVHRIWKHPHGLDQ39 IURPWR &RQFOXVLRQ2XUVWXG\VKRZVWKHIHDVLELOLW\RI'&(05,WR,GHWHFW2&'OHVLRQV ,,TXDQWLI\SHUIXVLRQDQGSHUPHDELOLW\XVLQJDFRPSDUWPHQWPRGHODQG,,,UHYHDO FKDQJHVRI39LQGLIIHUHQWGLVHDVHVWDJHV7KLVTXDQWLWDWLYHDSSURDFKSURYLGHV DGGLWLRQDO LQIRUPDWLRQ RQ WKH SDWKRSK\VLRORJ\ RI WKH FRQGLWLRQ PLJKW LQÁXHQFH GLVHDVHPDQDJHPHQWDQGFRXOGRIIHUDQRQLQYDVLYHPHDQVRIWKHUDS\PRQLWRULQJ 5RRP( *,7UDFW 66D &URKQҋVGLVHDVHDQGLQWHVWLQDOLQÁDPPDWLRQ 0RGHUDWRUV $*XSWD/RQGRQ8. 65RPDQR1DSOHV,7 % 05SHUIXVLRQRIQRUPDOVPDOOERZHO -+<DFRXE&=LQL;)DQ$<RXVXI'7 5XELQ$2WR&KLFDJR,/86 ]LQLFKLDUD#JPDLOFRP 3XUSRVH7 RGHWHUPLQHWKHIHDVLELOLW\RITXDQWLWDWLYHDQDO\VLVRIVPDOOERZHOSHU IXVLRQXVLQJG\QDPLFFRQWUDVWHQKDQFHG05,'&(05,DQGFRPSDUHSHUIXVLRQ SDWWHUQVRIMHMXQXPDQGLOHXP 0HWKRGVDQG0DWHULDOV6L[QRUPDOVXEMHFWVZHUHSURVSHFWLYHO\HQUROOHGWRXQ GHUJR05HQWHURJUDSK\5HJLRQVRILQWHUHVWZHUHGUDZQRYHUWKHMHMXQXPLOHXP DQG WHUPLQDO LOHXP 7, WR FDOFXODWH WKH YROXPH WUDQVIHU FRQVWDQW .WUDQV DQG H[WUDYDVFXODUH[WUDFHOOXODUVSDFH9H7KHGLIIHUHQFHEHWZHHQWKHVPDOOERZHO UHJLRQVZDVDVVHVVHGXVLQJSDLUHGWWHVW 5HVXOWV7KHMHMXQXPGHPRQVWUDWHVHDUOLHUDQGPRUHLQWHQVHHQKDQFHPHQWFRP SDUHGWRWKHLOHXPDQG7,7KHPHDQ.WUDQVPLQDWWKHMHMXQXPLOHXPDQG7, UHVSHFWLYHO\ZHUHDQG7KHPHDQ9HDWWKH MHMXQXPLOHXPDQG7,UHVSHFWLYHO\ZHUHDQG7KH .WUDQVZDVVLJQLÀFDQWO\KLJKHULQWKHMHMXQXPFRPSDUHGWRWKHLOHXP3 DQG7,37KH9HZDVVLJQLÀFDQWO\KLJKHULQWKHMHMXQXPFRPSDUHGWRWKH LOHXP3DQG7,37KHUHZDVQRVLJQLÀFDQWGLIIHUHQFHEHWZHHQ WKHLOHXPDQG7,LQ.WUDQVDQG9H3 DQGUHVSHFWLYHO\ &RQFOXVLRQ '&(05, LV D IHDVLEOH PHWKRG IRU TXDQWLWDWLYH DQDO\VLV RI VPDOO ERZHOSHUIXVLRQ7KHMHMXQXPGHPRQVWUDWHVHDUOLHUDQGPRUHLQWHQVHHQKDQFHPHQW FRPSDUHGWRWKHLOHXP%HWWHUXQGHUVWDQGLQJRIVPDOOERZHOSHUIXVLRQLVLPSRUWDQW IRUDFFXUDWHLGHQWLÀFDWLRQRIGLVHDVHGVHJPHQWV % 'DUNOXPHQERZHO05LQSDWLHQWVZLWK&URKQҋVGLVHDVHWZRVWHS ZKROHLQWHVWLQDOSUHSDUDWLRQZLWKSROLHWLOHQJOLFRO ,6DQVRQL&/3LFFROR) 3LWRFFR5'HO9HVFRYR0&LFDOD %%HRPRQWH=REHO5RPH,7 3XUSRVH7KH GDUN OXPHQ WHFKQLTXH 05( DQG 05& LV DQ H[FHOOHQW PRGDOLW\ IRUVPDOOERZHODVVHVVPHQWLQSDWLHQWVZLWK,%'EXWLWFDQFDXVHGLVFRPIRUWIRU SDWLHQWV:HSURSRVHDQDOWHUQDWLYHPHWKRGWRGLVWHQGDQGHYDOXDWHERWKVPDOO DQG ODUJH ERZHO E\ DSSO\LQJ WKH GDUN OXPHQ WHFKQLTXH WLPH SROLHWLOHQJOLFROH 3(*DGPLQLVWUDWLRQV 0HWKRGVDQG0DWHULDOVSDWLHQWVZLWKNQRZQ&'ZHUHDVNHGWRGULQNWZLFH /RI3(*VROXWLRQKRXUVDQGGXULQJPLQXWHVEHIRUH05H[DPLQDWLRQ $ELSKDVLFOXPHQ057VFDQQHUH[DPLQDWLRQZDVSHUIRUPHGRQD[LDODQG FRURQDOSODQHVZHREWDLQHG7ZDQG7UXH),63VHTXHQFHVDQG7ZIDWVDWVH TXHQFHVEHIRUHDQGDIWHULYG\QDPLFDGPLQLVWUDWLRQRIJDGROLQLXP6FDQQHU7LPH ZDVaPLQUDQJHPLQ*UDGLQJRIERZHOGLVWHQVLRQFOHDQVLQJDQGSDULHWDO LQÁDPPDWLRQDFWLYHLQDFWLYHQRQHZDVHYDOXDWHGXVLQJFRQYHQWLRQDOFRORQRVFRS\ &&DQGSRVWELRSV\KLVWRSDWKRORJLFDOUHVXOWVDVJROGVWDQGDUGLQDOOSDWLHQWV 5HVXOWV:LWKUHVSHFWWR&&DFKLHYHGLQSWVLQVLFNVHJPHQWV05 VKRZHGDFRPSOHWHFRUUHODWLRQRIWKHSUHVHQFHDQGORFDOLVDWLRQRIÁRJRVLVDQG JRRGFRUUHODWLRQRIÁRJRVLVJUDGLQJ3391932QO\RIFRORQLF VHJPHQWVZHUHKLQGHUHGE\IDHFHVPDNLQJDQDGHTXDWHLQWUDOXPLQDOGLDJQRVLV LPSUDFWLFDEOH WDEOHWHFKQLTXH7KHSURWRFROFRQVLVWHGRIFRURQDODQGVDJLWWDOVKRUWWDXLQYHUVLRQ UHFRYHU\67,57776(DQGD[LDO':,%6VHTXHQFHVLQRUGHUWRFKDUDFWHULVH ERQHLQYROYHPHQWLQWHUPVRISDWWHUQVL]HDQGGLVWULEXWLRQ':,%6LPDJHVZHUH FRPSDUHGZLWK7DQG67,5LPDJHVLQÀYHGLVWULFWVVNXOOVSLQHVWHUQXPDQGULEV SHOYLVXSSHUDQGORZHUOLPEVLQSDWLHQWVZLWKIRFDOGLIIXVHRUFRPELQHG GLVHDVH $OOSDWLHQWVZHUHFOLQLFDOO\VWDJHGDFFRUGLQJWR'XULHDQG6DORPRQ6\VWHP 5HVXOWV,QIRFDODQGFRPELQHGGLVHDVHIRFDOERQHOHVLRQVZHUHGHWHFWHG ZHUH FRUUHFWO\ LGHQWLÀHG ZLWK 77 VHTXHQFHV DQG ZLWK ':,%6DORQH,QSDWLHQWVZLWKGLIIXVHGLVHDVH':,%6DOZD\VVKRZHGKRPRJHQH RXVLQFUHDVHGVLJQDOLQWHQVLW\ZLWKLQWKHERQHVLQYROYHGZLWKJUHDWHUVHQVLWLYLW\LQ GHPRQVWUDWLQJZLGHVSUHDGLQYROYHPHQWRIERQHPDUURZWKDQ77VHTXHQFHV GXHWRWKHLULQKRPRJHQHRXVDOWHUDWLRQRILQWHQVLW\VLJQDOSDWLHQWVZHUHFRUUHFWO\ VWDJHGDVGLIIXVHGLVHDVHZLWK':,%6ZKLOH7DQG7VHTXHQFHVVKRZHGIRFDO RUFRPELQHGGLVHDVH &RQFOXVLRQ :%05, ZLWK ':,%6 VHTXHQFHV LQ SDWLHQWV ZLWK 00 DSSHDUV WR EHWHFKQLFDOO\IHDVLEOHDQGDSURPLVLQJQRQLQYDVLYHWRROIRUHDUO\GHWHFWLRQDQG FKDUDFWHULVDWLRQRIERQHPDUURZOHVLRQVSDUWLFXODUO\LQZLGHVSUHDGIRUP % 'LDJQRVWLFYDOXHRIZKROHERG\ORZGRVHFRPSXWHGWRPRJUDSK\ :%/'&7LQWKHVWDJLQJRISDWLHQWVZLWKPXOWLSOHP\HORPD 9%HVRVWUL ',SSROLWR0&ULYHOODUR(03RJOLDQL$'L/HOLR66LURQL 0LODQ,70RQ]D,7YDOHULDEHVRVWUL#JPDLOFRP 3XUSRVH 7 R DVVHVV WKH UROH RI ZKROH ERG\ ORZGRVH FRPSXWHG WRPRJUDSK\ :%/'&7 LQ WKH GLDJQRVLV DQG VWDJLQJ RI SDWLHQWV ZLWK VXVSLFLRQ RI PXOWLSOH P\HORPD00 0HWKRGVDQG0DWHULDOV$WRWDORISDWLHQWVZLWKHDUO\PXOWLSOHP\HORPDXQ GHUZHQWXQHQKDQFHGZKROHERG\ORZGRVH&7SURWRFROVWXG\SHUIRUPHGRQVOLFH VFDQQHU3KLOLSV%ULOOLDQFH3WXEHYROWDJH.9WXEHFXUUHQWWLPHSURGXFW P$VFROOLPDWLRQ[$OOWKHSDWLHQWVZHUHFOLQLFDOO\VWDJHGDFFRUGLQJWR 'XULHDQG6DOPRQ6\VWHP'LDJQRVLVRIRVWHRO\WLFOHVLRQVZDVSHUIRUPHGRQWKH EDVLV RI D[LDO DQG PXOWLSODQDU UHIRUPDWWHG LPDJHV ZKHUHDV WKHDVVHVVPHQW RI VSLQDOPLVDOLJQPHQWDQGIUDFWXUHZDVGRQHXVLQJPXOWLSODQDUUHIRUPDWWHGLPDJHV 5HVXOWV ,Q DOO SDWLHQWV LPDJH UHVROXWLRQ ZDV GLDJQRVWLF HQDEOLQJ FRUUHFW FODVVLÀFDWLRQRIPXOWLSOHP\HORPDSDWLHQWV:%/'&7VKRZHGDWRWDORISDWKR ORJLFERQHÀQGLQJVLQSDWLHQWV&7VFDQQLQJUHVXOWHGLQFRPSOHWHHYDOXDWLRQRI WKHERQHOHVLRQVLQWKHVHDUHDVRIWKHVNHOHWRQVNXOOKXPHUXVIHPXU ULEVVFDSXODHSHOYLVFODYLFOHVWHUQXPFHUYLFDO GRUVDOOXPEDUDQGVDFUDOUDFKLV,QSDWLHQWVWKH&7GHWHFWLRQ RIERQHLQYROYHPHQWZDVWKHRQO\FULWHULRQIRUWKHWUHDWPHQW)XUWKHUPRUHLQ SDWLHQWV:%/'&7VFDQQLQJGHPRQVWUDWHGSXOPRQDU\RUSOHXUDOOHVLRQVFDVHV GXHWRLQIHFWLYHVRXUFHDQGFDVHVGXHWRPXOWLSOHP\HORPDORFDOLVDWLRQVDQG FDVHRIUHQDOQHRSODVLDDVDUHODWHGSDWKRORJ\7KHRYHUDOOGRVHGHOLYHUHGWRHDFK SDWLHQWZDVP6Y &RQFOXVLRQ :KROH ERG\ ORZGRVH &7 LQYHVWLJDWLRQDO SURWRFRO LV D UHOLDEOH LPDJLQJEDVHGPHWKRGIRUWKHGLUHFWPDQDJHPHQWRISDWLHQWVZLWKPXOWLSOHP\ HORPD:%/'&7KDVDVXSHULRUUHSURGXFLELOLW\DQGLWLVIDVWHUWKDQFRQYHQWLRQDO UDGLRJUDSK\EHLQJIXUWKHUPRUHDEOHWRGHPRQVWUDWHH[WUDRVVHRXVÀQGLQJV % 4XDQWLWDWLYHDVVHVVPHQWRISHUIXVLRQDQGSHUPHDELOLW\LQ RVWHRFKURQGULWLVGLVVHFDQVOHVLRQVIHDVLELOLW\DQGLQLWLDOUHVXOWV $3 $UQROGL0,QJULVFK68W]VFKQHLGHU0) 5HLVHU6:HFNEDFK 0XQLFK'(DQGUHDVDUQROGL#PHGXQLPXHQFKHQGH 3XUSRVH:KLOHWKHH[DFWSDWKRSK\VLRORJ\RIRVWHRFKRQGULWLVGLVVHFDQV2&' KDVQRW\HWEHHQFOHDUO\XQGHUVWRRGGHWHUPLQDWLRQRIWKHEHVWPDQDJHPHQWRIWKH FRQGLWLRQVWLOOUHPDLQVFRQWLQXRXVO\GLVFXVVHG>2/RXJKOLQ@>.RFKHU@ 3XUSRVHRIWKLVVWXG\ZDVWRHYDOXDWHWKHIHDVLELOLW\RI,GHWHFWLRQ,,TXDQWLWDWLYH DVVHVVPHQW,,,PRQLWRULQJRISHUIXVLRQDQGSHUPHDELOLW\LQ2&'OHVLRQVE\' '&(05, 0HWKRGVDQG0DWHULDOVPHDQDJH\SDWLHQWVZLWK2&'RIWKHPHGLDOIHPX UDOFRQG\OHWKHPHGLDOWDODUGRPHQ XQGHUZHQW'&(05,DW70DJQHWRP 9HULR6LHPHQV0HGLFDO6ROXWLRQV*HUPDQ\XVLQJDYLHZVKDULQJ'*(VHTXHQFH 7(75 PVÁLSDQJOH VSDWLDOUHVROXWLRQ [[PPóPDWUL[ VL]H WHPSRUDOUHVROXWLRQ VDIWHUEROXVLQMHFWLRQRIPPRONJ *G'73$SDWLHQWVREWDLQHGIROORZXSVFDQDIWHUDQDYHUDJHRIPRQWKV7KH $,)ZDVPHDVXUHGLQWKHSRSOLWHDODUWHU\NQHHLQWKHDQWHULRUWLELDODUWHU\DQNOH 52,VLQ2&'OHVLRQVZHUHGUDZQRQ$8&PDSVKDHPRG\QDPLFSDUDPHWHUVLQ WKHVHUHJLRQVZHUHGHWHUPLQHGXVLQJDFRPSDUWPHQWH[FKDQJHPRGHO\LHOGLQJ HVWLPDWHVRISODVPDÁRZ3)SODVPDYROXPH39SHUPHDELOLW\VXUIDFHSURGXFW 36DQGLQWHUVWLWLDOYROXPH9((>6RXUEURQ@ 6FLHQWLILF6HVVLRQ $ 6&'()*+% 7KXUVGD\ (XURSHDQ&RQJUHVVRI 5DGLRORJ\ ZDOORHGHPDDPHVHQWHULFRHGHPDERQ7ZLPDJHV*GHQKDQFHPHQWRQ 7ZHLJWKHGLPDJHVF7ZRTXDQWLWDWLYHSDUDPHWHUVZHUHDVVHVVHGSUHVHQFH DQGQXPEHURIO\PSKQRGHVGZDOOWKLFNHQLQJPPPP !PPH7KHVHSDUDPHWHUVSURGXFHGDEDVLFDFWLYLW\VFRUHUDQJLQJEHWZHHQ DQGVXJJHVWLQJLQDFWLYLW\ORZDFWLYLW\DFWLYLW\KLJKDFWLYLW\ 7KLVVFRUHZDVFRUUHODWHGZLWK&'(,6%$DQG&'$,,WZDVIXUWKHUPXOWLSOLHGIRU DIDFWRURUDFFRUGLQJWRWKHOHQJWKRIWKHDIIHFWHGVHJPHQWOHQJWK!FP RU!FPREWDLQLQJDOHQJWKDFWLYLW\VFRUH%WKHQIRUDIDFWRUWRLQWKH SUHVHQFHRIÀVWXODVDEVFHVVHVRUSHULDQDOGLVHDVHLQUHODWLRQWRWKHLUH[WHQWDQG VHYHULW\SURYLGLQJDFRPSOLFDWLRQDFWLYLW\VFRUH&$ÀQDOLQWHJUDWHG05,VFRUH 'UDQJHG 5HVXOWV6LJQLÀFDQWFRUUHODWLRQEHWZHHQEDVLFVFRUHDQG&'$,U &'(,6 U DQG%$U SZDVREWDLQHG+LJKFRUUHODWLRQU ZDV REWDLQHG EHWZHHQ FRPSOLFDWLRQDFWLYLW\ VFRUH DQG % JRRG FRUUHODWLRQ EHWZHHQ OHQJWKDFWLYLW\VFRUHDQG&'(,6U &RQFOXVLRQ7KHEDVLF05,DFWLYLW\LQGH[FRUUHODWHGZLWKFOLQLFDODQGHQGRVFRSLF DFWLYLW\,QWHJUDWHGVFRUHV%&'FRUUHODWHGZLWK%$RUHQGRVFRS\ % 05DFWLYLW\DVVHVVPHQWLQ&URKQҋVGLVHDVHRIWKHWHUPLQDOLOHXP IUHHEUHDWKLQJGLIIXVLRQZHLJKWHGLPDJLQJ':,DQGG\QDPLF PRWLOLW\HYDOXDWLRQDVDSRVVLEOHDOWHUQDWLYHWR05ZLWKLQWUDYHQRXV FRQWUDVWDJHQW ,6DQVRQL&/3LFFROR) 3LWRFFR5'HO9HVFRYR0&LFDOD %%HRPRQWH=REHO5RPH,7 3XUSRVH &RQWUDVWHGHQKDQFHG G\QDPLF 05HQWHURJUDSK\ '&(05( LV DQ DFFHSWHGPHWKRGWRDVVHVV&URKQҋVGLVHDVH&'DFWLYLW\LWQHHGVIRUJDGROLQLXP FRQWUDVWPDWHULDOV5HFHQWO\GLIIXVLRQZHLJKWHG05LPDJLQJ':,DQGLWVUHODWHG $'&PDSKDYHEHHQXVHGLQPXOWLSOHFOLQLFDOFRQGLWLRQLQFOXGLQJERZHOVWXG\DQG &URKQҋVGLVHDVHDFWLYLW\2XUDLPLVWRLQYHVWLJDWHWKHYDOXHRIIUHHEUHDWKLQJ':, 05LPDJLQJLQWKHDVVHVVPHQWRIVPDOOERZHO&'DFWLYLW\ 0HWKRGVDQG0DWHULDOVSDWLHQWVZLWKWHUPLQDOLOHXP&'XQGHUZHQW05H[ DPLQDWLRQDIWHUERZHORUDOGLVWHQVLRQZLWKSRO\HWK\OHQJO\FROVROXWLRQ:HEDVHG 05DVVHVVPHQWRIGLVHDVHDFWLYLW\RQPRUSKRORJ\DQGPRWLOLW\RIVPDOOERZHODQG SHULYLVFHUDOVWUXFWXUHVWUXH),63 FLQHWUXH),63 +$67(7:VHTXHQFHVSDULHWDO VLJQDOLQWHQVLW\LQ':,DQGG\QDPLFDVVHVVPHQWRISDULHWDOFRQWUDVWHQKDQFHPHQW )/$6+7:VHTXHQFH3DWLHQWVZHUHGLYLGHGLQWRWKUHHFDWHJRULHVQHJDWLYH LQDFWLYHDFWLYHGLVHDVHEDVLQJRQHQGRVFRSLFELRSV\DVWKHVWDQGDUGUHIHUHQFH FDVHVZKROHRIFOLQLFDOÀQGLQJVDQG05VHTXHQFHVFDVHV 5HVXOWV2Q':,,QÁDPPDWRU\ERZHOWUDFWVVKRZHGKLJKHUVLJQDOFRPSDUHGWR QRUPDOVHJPHQWVDFFXUDF\VHQVLWLYLW\VSHFLÀFLW\339 139 $'&YDOXHLQDFWLYHGLVHDVHZDVORZHUWKDQLQLQDFWLYHGLVHDVH QHJDWLYH[[PPVLQDFWLYH[[PPVDFWLYH [[PPV,QDOOSDWLHQWVDFRPSOHWH05H[DPLQDWLRQDOORZHG WRSHUIRUPDGHWDLOHGDQGSDQRUDPLFHYDOXDWLRQRIVPDOOERZHO &RQFOXVLRQ&LQH05PRGHDGGVVXLWDEOHIXQFWLRQDOLQIRUPDWLRQDERXWPRWLOLW\ RIDIIHFWHGORRSVDQGFRQGLWLRQRISUR[LPDOORRSV)UHHEUHDWKLQJ':,LVXVHIXOLQ YLVXDODVVHVVPHQWRI&'DFWLYLW\$'&YDOXHVPD\IDFLOLWDWHTXDQWLWDWLYHDQDO\VLV RIGLVHDVHDFWLYLW\GHFUHDVLQJLQLQÁDPHGERZHOVHJPHQWVEHFDXVHRIUHVWULFWHG GLIIXVLRQ % 1RQLQYDVLYHDVVHVVPHQWRIERZHOZDOOÀEURVLVLQ&URKQҋVGLVHDVH UROHRIWKHTXDOLWDWLYHHODVWRJUDSKLFLPDJLQJ,(DQGFRUUHODWLRQ ZLWKEDVHOLQH86FRORXU'RSSOHU&'86DQGFRQWUDVWHQKDQFHG XOWUDVRXQG&(86SDWWHUQV 90LJDOHGGX*9LUJLOLR$6FDQX0'RUH$3RUFX00DU]R'6LULJX '6FDQX6DVVDUL,7PLJDOHGGX#VPLUJRUJ 3XUSRVH7 RFRUUHODWHWKHXOWUDVRQRJUDSKLFVFRUHVIRUPRUSKRORJLF86YDVFXODU &'86DQGSHUIXVLRQ&(86SDWWHUQVZLWKDQHZTXDOLWDWLYHHODVWRJUDSKLFHYDOX DWLRQ(,IRUGHÀQLQJÀEURVWHQRWLFYHUVXVLQÁDPPDWRU\ERZHOZDOOLQYROYHPHQW 0HWKRGVDQG0DWHULDOV&'SDWLHQWVIHPDOHVPDOHVZHUHLQFOXGHGLQ WKHVWXG\SDWLHQWVKDGLQÁDPPDWRU\VWULFWXULQJDQGSHQHWUDWLQJGLVHDVH LOHDOFRORQLFDQGLOHRFRORQLF:HSHUIRUPHGWUDQVDEGRPLQDOXOWUD VRXQGH[DPLQDWLRQVLQFOXGLQJEDVHOLQH86&'86&(86DIWHUHQGRYDVFXODU FRQWUDVWDGPLQLVWUDWLRQ6RQR9XHZLWK6LHPHQV$FXVRQ6HTXRLD+0] OLQHDUSUREHDQG6LHPHQV$FXVRQ60+]OLQHDUSUREH7KHODVWRQH ZDVXVHGIRUTXDOLWDWLYHHODVWRJUDSKLFHYDOXDWLRQWKURXJKDUHFHQW(,VRIWZDUH WKHTXDQWLÀFDWLRQRIFRQWUDVWHQKDQFHGVRQRJUDSKLFSHUIXVLRQZDVREWDLQHGXV LQJ4RQWUDVWVRIWZDUH%UDFFR7KHIROORZLQJSDUDPHWHUV3($.WLPHWRSHDN 773UHJLRQDOEORRGYROXPH5%9ZHUHFRQVLGHUHG86&'86DQG&(86 &RQFOXVLRQ7KHFRPELQDWLRQRI05(DQG05&DOORZVDFRPSOHWHDVVHVVPHQW RILQÁDPPDWLRQLQVPDOODQGODUJHERZHOLQSDWLHQWVZLWK&'UHTXLULQJPLQLPDO HIIRUWWRSDWLHQW6RZKROHERZHODVVHVVPHQWZLWK´VWHSVµGLVWHQVLRQLVIHDVLEOH VDWLVI\LQJGRHVQRWUHTXLUHDQ\SDUWLFXODUSUHSDUDWLRQRUUHWURJUDGHPDQXDOFRORQ GLVWHQVLRQDQGLWODFNVRILRQLVLQJUDGLDWLRQ % 'LIIXVLRQZHLJKWHG05LPDJLQJRIDFXWHDSSHQGLFLWLVLQSDHGLDWULF SDWLHQWVFRPSDULVRQZLWKFRQYHQWLRQDO05,DQGVXUJLFDOÀQGLQJV 8%D\UDNWXWDQ0.DQWDUFL(U]XUXP75DNNDQUDG#KRWPDLOFRP 3XUSRVH7KH DLP RI WKLV VWXG\ LV WR GHWHUPLQH WKH YDOXH RI GLIIXVLRQZHLJKWHG PDJQHWLFUHVRQDQFHLPDJLQJIRUWKHGLDJQRVLVRIDFXWHDSSHQGLFLWLVLQSDHGLDWULF SDWLHQWV 0HWKRGVDQG0DWHULDOV)RUW\ÀYHFRQVHFXWLYHSDWLHQWVZLWKDFOLQLFDOGLDJQRVLV RIDFXWHDSSHQGLFLWLVXQGHUZHQWDEGRPLQDO05,ZHUHRSHUDWHGRQIRUDFXWH DSSHQGLFLWLV )LUVW WKH ':, DORQH ZDV UHYLHZHG IROORZHG E\ FRQYHQWLRQDO 05, DORQHDQGWKHQFRQYHQWLRQDO05,DQG':,ZHUHUHYLHZHGE\WZRREVHUYHUV7KH VXUJLFDOÀQGLQJVZHUHFRPSDUHGZLWKWKH05,UHVXOWV6HQVLWLYLW\VSHFLÀFLW\DQG DFFXUDF\ ZHUH FDOFXODWHG IRU ':, FRQYHQWLRQDO 05, DQG FRPELQHG ':, DQG FRQYHQWLRQDO05,IRUWKHGHSLFWLRQRIDFXWHDSSHQGLFLWLV 5HVXOWV$FRPELQDWLRQRI':,DQGFRQYHQWLRQDO05,ZDVWKHPRVWVHQVLWLYHDQG WKHPRVWDFFXUDWHZLWKFRUUHVSRQGLQJVHQVLWLYLW\DQGDFFXUDF\IRUREVHUYHUVDQG VHQVLWLYLW\RIDQGUHVSHFWLYHO\DFFXUDF\RIUHVSHFWLYHO\ 8VLQJ':,DORQHWKHVHQVLWLYLW\ZDVIRXQGWREHDQGDQGDFFXUDF\RI DQGIRUREVHUYHUVDQGUHVSHFWLYHO\8VLQJFRQYHQWLRQDO05,DORQH VHQVLWLYLW\RIIRUERWKDQGDFFXUDF\RIDQGZDVIRXQGUHVSHFWLYHO\ IRU WKH WZR REVHUYHUV7KH DFFXUDF\ RI WKH GHSLFWLRQ RI DFXWH DSSHQGLFLWLV ZDV VXSHULRUXVLQJWKHFRPELQDWLRQRI':,DQGFRQYHQWLRQDO05,IRUERWKREVHUYHUV DFFXUDF\RIDQGUHVSHFWLYHO\ &RQFOXVLRQ7KHXVHRIFRPELQDWLRQRI':,DQGFRQYHQWLRQDO05,LVDYDOXDEOH WHFKQLTXHLQWKHGLDJQRVLVRIDFXWHDSSHQGLFLWLVHVSHFLDOO\LQFKLOGUHQDIWHUVXE RSWLPDORUQRQGLDJQRVWLFVRQRJUDSK\ % 05,GHULYHGVPDOOERZHOPRWLOLW\DVDPDUNHURIGLVHDVHDFWLYLW\LQ &URKQҋVGLVHDVHXVLQJDKLVWRSDWKRORJLFDOVWDQGDUGRIUHIHUHQFH $0HQ\V'$WNLQVRQ63XQZDQL,3URFWRU01RYHOOL05RGULJXH]-XVWR '+DZNHV6+DOOLJDQ67 D\ORU/RQGRQ8.DOH[PHQ\V#XFODFXN 3XUSRVH7 RLQYHVWLJDWHWKHUHODWLRQVKLSEHWZHHQVRIWZDUHGHULYHGVPDOOERZHO PRWLOLW\LQGH[DQGKLVWRSDWKRORJLFDOJUDGLQJRI&URKQҋVGLVHDVHDFWLYLW\ 0HWKRGVDQG0DWHULDOV $VRIWZDUHVROXWLRQGHVLJQHGWRTXDQWLI\ERZHOZDOOPRWLRQ ZDVDSSOLHGWRFRURQDOEUHDWKKROGFLQH),63VHTXHQFHVHFRQGEUHDWKKROG75 PV7(PVVOLFHWKLFNQHVVPPVOLFHVHFWKURXJKWKHWHUPLQDOLOHXP 7,LQ&URKQҋVGLVHDVHSDWLHQWVIHPDOHVPHDQDJHXQGHUJRLQJVWDQGDUG 05HQWHURJUDSK\7KHSUHYLRXVO\YDOLGDWHGVRIWZDUHXVHVQRQULJLGUHJLVWUDWLRQWR WUDFNLQWHQVLW\FKDQJHVRYHUWLPHXVLQJDPDQXDOO\SODFHGOLQHDUUHJLRQRILQWHU HVWZLWKLQWKHERZHOSURYLGLQJDXWRPDWHGHVWLPDWLRQRIERZHOZDOOGLVSODFHPHQW H[SUHVVHGDVWKHVWDQGDUGGHYLDWLRQRIMDFRELDQGHWHUPLQDQWPRWLOLW\LQGH[$OO SDWLHQWV XQGHUZHQW VXEVHTXHQW FRORQRVFRS\ DQG 7, ELRSV\ ZLWKLQD PHDQ RI GD\V+LVWRSDWKRORJLFDOJUDGLQJRI7,DFWLYLW\ZDVXQGHUWDNHQE\WZRH[SHULHQFHG SDWKRORJLVWVZKRGHULYHGDHQGRVFRSLFDFXWHLQÁDPPDWRU\VFRUHH$,6EDVHGRQ WKHSUHVHQFHRIXOFHUDWLRQQHXWURSKLOVLQWKHODPLQDSURSULDFU\SWLWLVFU\SWDEVFHVV IRUPDWLRQ LQÁDPPDWRU\ H[XGDWHV DQG JUDQXORPDV SUHVHQW DEVFHQW 7KH 05,PRWLOLW\LQGH[ZDVFRUUHODWHGZLWKWKHH$,6XVLQJ.HQGDOOҋVUDQNFRUUHODWLRQ 5HVXOWV7KHPHDQPRWLOLW\LQGH[DQGSDWKRORJ\VFRUHZDVUDQJH DQGUDQJHUHVSHFWLYHO\7KHUHZDVDVWDWLVWLFDOO\VLJQLÀFDQWQHJDWLYHFRU UHODWLRQEHWZHHQWKHPRWLOLW\LQGH[DQGDFWLYLW\VFRUH.HQGDOOWDXS &RQFOXVLRQ4XDQWLÀHGVPDOOERZHOPRWLOLW\LVQHJDWLYHO\FRUUHODWHGZLWKKLVWRSDWKR ORJLFDO PDUNHUV RI GLVHDVH DFWLYLW\ VXJJHVWLQJ LW PD\ EH XVHG DV D TXDQWLWDWLYH PDUNHURILQÁDPPDWLRQ % 3URSRVDORIDTXDOLWDWLYH05,DFWLYLW\LQGH[IRU&URKQҋVGLVHDVH ) 0DFFLRQL9%XRQRFRUH,6WDOWDUL$3LQR*%HOOD9'H0DUFR00DULQL 5RPH,7IUDQFHVFDPDFFLRQL#XQLURPDLW 3XUSRVH7 RSURSRVHD05,DFWLYLW\LQGH[IRU&URKQҋVGLVHDVH&' 0HWKRGVDQG0DWHULDOVSDWLHQWVZLWK&'XQGHUZHQWLOHRFRORQRVFRS\JROG VWDQGDUGDQG05(QWHURJUDSK\(QGRVFRSLF&'(,6ELRORJLFDO%$DQGFOLQL FDODFWLYLW\&'$,ZHUHDVVHVVHGDQGVFRUHGDEVHQWORZGHÀQLWHO\SUHVHQW PDUNHG DFWLYLW\ 7KUHH DFWLYLW\ 05, SDUDPHWHUV ZHUH TXDOLWDWLYHO\ VFRUHG 6FLHQWLILF6HVVLRQ 6 &$' ( ) *+% (XURSHDQ&RQJUHVVRI 5DGLRORJ\ % /RZGRVH&7LQLQLWLDOHYDOXDWLRQRI&URKQҋVGLVHDVHLQWKH HPHUJHQF\VHWWLQJ"7RZDUGUHSODFLQJWKH3)$ 6%2ҋ1HLOO) 2ҋ1HLOO$0F*DUULJOH) 6KDQDKDQ000DKHU&RUN,( VLREKDQ[[#JPDLOFRP 3XUSRVH&URKQҋVGLVHDVH&'SDWLHQWVDUH´DWULVNµIRUH[SRVXUHWRVLJQLÀFDQW FXPXODWLYHHIIHFWLYHGRVHVRIUDGLDWLRQIURPGLDJQRVWLFLPDJLQJVWXGLHV7KHSXUSRVH RIWKLVVWXG\LVWRFRPSDUHWKHGLDJQRVWLF\LHOGRIORZGRVH&7/'&7ZLWKLWHUDWLYH UHFRQVWUXFWLRQWRWKDWRIFRQYHQWLRQDOSODLQÀOPRIDEGRPHQ3)$ 0HWKRGVDQG0DWHULDOV)ROORZLQJHWKLFDODSSURYDOSDWLHQWVZLWK&'UHIHUUHG IRUFOLQLFDOO\LQGLFDWHG&7DEGRPHQSHOYLV&7$3ZHUHSURVSHFWLYHO\UHFUXLWHGWR XQGHUJRDGGLWLRQDO/'&7DWWLPHRI&7$3 2IWKHVHSDWLHQWVKDGDFRQWHPSR UDQHRXV3)$ZLWKLQKUVRI&7PDOHIHPDOHPHDQDJH\HDUVUDQJH PHDQ%0,NJPUDQJH7KHHIIHFWLYHGRVH('LQP6YIRU HDFK/'&7ZDVFDOFXODWHGUDGLRORJLVWVLQFRQVHQVXVUHYLHZHGWKH/'&7LPDJHV DQGWKH3)$VPRQWKVODWHUZLWKDYDOLGDWHG&URKQҋVVSHFLÀFFRGLQJV\VWHP 5HVXOWV 7KH PHDQ (' IRU /'&7 ZDV P6Y UDQJH P6Y SDPHDQGRVHUHGXFWLRQRIIURPFRQYHQWLRQDO&7 ZLWKRXWORVV RI GLDJQRVWLF XWLOLW\ 7KH PHDQ (' IRU %0, .JP ZDV P6Y DQG IRU %0,!.JPZDVP6Y7KHDSSUR[LPDWHPHDQ('RID3)$LVP6Y 7KHUHZDVDJUHHPHQWEHWZHHQ3)$DQG/'&7LQSDWLHQWVRQO\QRDEQRUPDO ÀQGLQJV)LQGLQJVRQ/'&7PLVVHGRQ3)$LQFOXGHGDEVFHVVHVQ REVWUXFWLRQ Q FROLWLVQ DQGHQWHULWLVQ /'&7GHWHFWHGPRUHFOLQLFDOO\VLJQLÀFDQW LQFLGHQWDOÀQGLQJV &RQFOXVLRQ /'&7 ZLWK LWHUDWLYH UHFRQVWUXFWLRQ \LHOGHG IDU VXSHULRU GLDJQRVWLF LQIRUPDWLRQWKDQ3)$DWDQ('WKDWDSSUR[LPDWHVWR3)$V/'&7PD\UHSUH VHQWDIHDVLEOHUHSODFHPHQWIRULQLWLDO3)$LPSDUWLQJYHU\OLWWOHDGGLWLRQDOUDGLDWLRQ H[SRVXUH 5RRP) *HQLWRXULQDU\ 66 3URVWDWH05LPDJLQJ 0RGHUDWRUV --)WWHUHU1LMPHJHQ1/ -5LFKHQEHUJ%ULJKWRQ8. % )XQFWLRQDOSURVWDWH05,HYDOXDWLRQRIDVFRULQJV\VWHP 65RHKOHQ&$UVRY'%ORQGLQ-.ODVHQ5/DQ]PDQ*$QWRFK3 $OEHUV 04XHQWLQ'VVHOGRUI'(PLFKDHOTXHQWLQ#PHGXQLGXHVVHOGRUIGH 3XUSRVH )XQFWLRQDO SURVWDWH 05, LV SHUIRUPHG LQ YDU\LQJ FRPELQDWLRQV RI7 ZHLJKWHG LPDJHV ZLWK GLIIXVLRQZHLJKWHG LPDJLQJ ':, G\QDPLFFRQWUDVWHQ KDQFHG05,'&(05,DQGVSHFWURVFRSLFLPDJLQJ056,5HFHQWO\D(XURSHDQ FRQVHQVXVPHHWLQJSURSRVHGWKHXVHRIDVLPSOHSRLQWVFDOHIRUHVWLPDWLQJWKH SUREDELOLW\RIDOHVLRQWREHPDOLJQDQW7KLVUHFRPPHQGDWLRQKDVQRWEHHQYDOLGDWHG VRIDUZKLFKLVWKHDLPRIWKHSUHVHQWVWXG\ 0HWKRGVDQG0DWHULDOV7KHDSSHDUDQFHRISUHGHÀQHGOHVLRQVLQWKUHHGLI IHUHQW05VHTXHQFHV7ZHLJKWHGLPDJHV':,DQG'&(05,LQIXQFWLRQDO SURVWDWH 05, H[DPLQDWLRQV KDYH EHHQ UHWURVSHFWLYHO\ VFRUHG E\ WKUHH EOLQGHG UDGLRORJLVWVXVLQJWKHSRLQWVFDOHIRUHDFK05VHTXHQFH $IWHUVFRULQJ7':,DQG 7':,'&(05,HYHU\OHVLRQZDVJUDGHGEDVHGRQLWVSUREDELOLW\IRUPDOLJQDQF\ ,QWHUREVHUYHUUHOLDELOLW\ZDVHYDOXDWHGXVLQJ.DSSDVWDWLVWLFVN 5HVXOWV :LWK UHVSHFW WR 7ZHLJKWHG LPDJHV ':, DQG '&(05, N ZHUH DQGUHVSHFWLYHO\&RPELQHGVFRULQJRI7ZHLJKWHGLPDJHVDQG':, GHPRQVWUDWHGFRUUHFWWXPRXUGLDJQRVLVWUXHSRVLWLYHLQGHSHQGLQJRQ UHDGHURIFDVHVN 7KHDFFXUDF\ZDVIXUWKHULPSURYHGWRDIWHU VFRULQJDOOWKUHH05VHTXHQFHVLQFOXGLQJ'&(05,N &RQFOXVLRQ7KHXVHRIDVLPSOHSRLQWVFRULQJV\VWHPIRU7ZHLJKWHGLPDJHV ':,DQG'&(05,LVIHDVLEOHLQIXQFWLRQDOSURVWDWH05,DQGFRPHVDORQJZLWKD KLJKLQWHUREVHUYHUUHOLDELOLW\ VFRUHVWRDVVHVVOD\HUYDVFXODULVDWLRQLQWUDSDULHWDORUWUDQVSDULHWDO HQKDQFHPHQWFKDUDFWHULVWLFVUHVSHFWLYHO\ZHUHXVHG:HGHÀQHGDQHZ VFRUHRIÀEURVLVFRPSDULQJDEGRPLQDODQGERZHOZDOOVWLIIQHVV&RUUHODWLRQ EHWZHHQ(,VFRUHDQG86&'86&(86VFRUHVZHUHHYDOXDWHGZLWKWKHQRQ SDUDPHWULF6SHDUPDQUDQNWHVW 5HVXOWV(ODVWRJUDSKLFVFRUHZDVVLJQLÀFDQWO\FRUUHODWHGZLWK86VFRUHS DQGTXDOLWDWLYH&(86VFRUHS6LJQLÀFDQWFRUUHODWLRQQHLWKHUZLWK&' 86QRUZLWK3($.773DQG5%9ZHUHREWDLQHGZLWK4RQWUDVW &RQFOXVLRQ7KHLQWURGXFWLRQRIGHGLFDWHG86VRIWZDUHIRUHODVWRJUDSKLFDVVHVV PHQWRIÀEURVLVFDQLPSURYHWKH86GLDJQRVLVLQWKHDVVHVVPHQWRIÀEURWLFYHUVXV LQÁDPPDWRU\LQYROYHPHQWLQ&' % 0DJQHWLFUHVRQDQFHLPDJLQJLVFRUUHODWHGZLWKIDHFDOFDOSURWHFWLQ OHYHOLQWKHHYDOXDWLRQRIVPDOOERZHODQGFRORQLF&URKQҋVGLVHDVH -0DNDQ\DQJD'3HQGVH($WNLQV06WHZDUG6%ORRP60F&DUWQH\ 63XQZDQL6+DOOLJDQ67 D\ORU/RQGRQ8.FPDNDQ\DQJD#\DKRRFRP 3XUSRVH7KHUDSHXWLFVWUDWHJ\LQ&URKQҋVGLVHDVHUHTXLUHVNQRZOHGJHRIWKHRYHUDOO GLVHDVHEXUGHQ$QHZ05,VFRUHRIDFWLYLW\ZDVWHVWHGDJDLQVWYDOLGDWHGFOLQLFDO UHIHUHQFHVWDQGDUGVUHÁHFWLQJJOREDODFWLYLW\+DUYH\%UDGVKDZLQGH[+%,DQG IDHFDOFDOSURWHFWLQ 0HWKRGVDQG0DWHULDOVSDWLHQWVPDOHVPHGLDQDJHUDQJHZLWK NQRZQRUVXVSHFWHG&URKQҋVGLVHDVHXQGHUZHQWVWDQGDUG705HQWHURJUDSK\ D[LDODQGFRURQDO+$67(7UXH)LVSDQGSRVWJDGROLQLXPFRURQDO9,%(FRPSOHWHG D+%,TXHVWLRQQDLUHDQGSURYLGHGDVWRROVDPSOHIRUIDHFDOFDOSURWHFWLQ7ZRREVHUY HUVTXDOLWDWLYHO\JUDGHGERZHOZDOOWKLFNQHVVPXUDO7VLJQDOPHVHQWHULFRHGHPD 7HQKDQFHPHQWKDXVWUDOORVVFRORQIURPQRUPDOWRPRVWDEQRUPDOIRU MHMXQXPSUR[LPDOLOHXPWHUPLQDOLOHXPDQGFRORQGLYLGHGLQWRVHJPHQWV7KH OHQJWKRIGLVHDVHLQHDFKVHJPHQWZDVPHDVXUHGDQGWKHLQGLYLGXDOVHJPHQWDO VFRUHPXOWLSOLHGDVIROORZVFP[FP[DQGFP[$VFRUHRI ZDVDGGHGIRUHDFKRIWKHIROORZLQJLISUHVHQWO\PSKDGHQRSDWK\FRPEVLJQ DEVFHVVHVDQGÀVWXODH.HQGDOO VUDQNFRUUHODWLRQZDVXVHGWRHYDOXDWHWKHUHOD WLRQVKLSEHWZHHQ05,VFRUHIDHFDOFDOSURWHFWLQDQG+%, 5HVXOWV7KHPHDQ05,DFWLYLW\VFRUHZDVUDQJH$SRVLWLYHFRUUHODWLRQ ZDVIRXQGEHWZHHQWKH05,VFRUHDQGFDOSURWHFWLQ.HQGDOOҋVWDXE &,WRS 1RFRUUHODWLRQZDVIRXQGEHWZHHQ05,DQG+%,.HQGDOOҋV WDXE S &RQFOXVLRQ*OREDO&URKQҋVGLVHDVHDFWLYLW\PHDVXUHGXVLQJDVLPSOHFOLQLFDO05, VFRUHLVFRUUHODWHGZLWKWKHIDHFDOFDOSURWHFWLQOHYHO05,LVXVHIXOIRUWKHJOREDO DVVHVVPHQWRIGLVHDVHDFWLYLW\LQ&URKQҋVGLVHDVH % 7KHGLDJQRVWLFYDOXHRIVPDOOERZHOZDOOYDVFXODULW\DIWHUVXOSKXU KH[DÁXRULGHÀOOHGPLFUREXEEOHLQMHFWLRQLQWKHGLIIHUHQWLDWLRQRI LQÁDPPDWRU\DQGÀEURWLFVWHQRVHVLQSDWLHQWVZLWK&URKQҋVGLVHDVH (4XDLD/'H3DROL%&DELEER) 'HJUDVVL0&RYD7ULHVWH,7 TXDLD#XQLWVLW 3XUSRVH7 RDVVHVVWKHYDOXHRIVPDOOERZHOZDOOYDVFXODULW\DIWHUPLFUREXEEOH FRQWUDVW DJHQW LQMHFWLRQ WR GLIIHUHQWLDWH LQÁDPPDWRU\ IURP ÀEURWLF VWHQRVHV LQ SDWLHQWVZLWK&URKQҋVGLVHDVH 0HWKRGVDQG0DWHULDOV)LIWHHQSDWLHQWVPDOHVDQGIHPDOHVPHDQDJH6' \HDUVZLWKDELRSV\SURYHQGLDJQRVLVRI&URKQ VGLVHDVH&URKQ VGLVHDVH DFWLYLW\LQGH[&'$,!Q SDWLHQWVRUQ LQYROYLQJDWOHDVWRQH LOHDOORRSZDOOWKLFNQHVVPHDVXUHGE\XQHQKDQFHG86!PPZHUHLQFOXGHG ,QHDFKSDWLHQWWKHWHUPLQDOORRSZDVVFDQQHGE\FRQWUDVWHQKDQFHGXOWUDVRXQG &(86DIWHUVXOSKXUKH[DÁXRULGHÀOOHGPLFUREXEEOHLQMHFWLRQDQGGLJLWDOFLQHFOLSV VHFRQGVZHUHVWRUHGLQ',&20IRUPDW7KHYDVFXODULW\RIWKHWHUPLQDOORRS ZDVTXDQWLÀHGLQJUH\VFDOHOHYHOVE\DPDQXDOO\GUDZQ52,HQFRPSDVV LQJWKHWKLFNHQHGERZHOZDOODQGLWZDVFRUUHODWHGZLWK&'$,7KHSHUFHQWDJHRI HQKDQFHPHQWFRPSDUHGWREDVHOLQHWKHWLPHWRSHDNHQKDQFHPHQWDQGWKHDUHD XQGHUFXUYHZHUHFDOFXODWHG 5HVXOWV$OO SDWLHQWV UHYHDOHG GLIIXVH WUDQVSDULHWDO FRQWUDVW HQKDQFHPHQW DIWHU PLFUREXEEOH LQMHFWLRQ H[FHSW IRU SDWLHQWV ZLWK ÀEURWLF VWHQRVLV ZKR UHYHDOHG FRQWUDVWHQKDQFHPHQWOLPLWHGWRWKHVXEPXFRVD,QÁDPPDWRU\YVÀEURWLFVWHQRVHV GLGQRWGLIIHULQWKHSHUFHQWDJHRIHQKDQFHPHQWYV DQGLQWKHWLPHWRSHDNHQKDQFHPHQWYVVHFV3!ZKLOH GLIIHUHQFHLQWKHDUHDXQGHUWKHHQKDQFHPHQWFXUYHZDVIRXQGYV 3ZLWKDVLJQLÀFDQWFRUUHODWLRQZLWKWKH&'$,VFRUHѩ 3 &RQFOXVLRQ7KHTXDQWLWDWLYHDQDO\VLVRIERZHOZDOOK\SHUYDVFXODULW\RQ&(86PD\ GLIIHUHQWLDWHLQÁDPPDWRU\IURPÀEURWLFVWHQRVHVLQSDWLHQWVZLWK&URKQҋVGLVHDVH 6FLHQWLILF6HVVLRQ $ 6&'()*+% 7KXUVGD\ (XURSHDQ&RQJUHVVRI 5DGLRORJ\ 0HWKRGVDQG0DWHULDOV3&DLQWKH3=DQGLQWKH7=ZHUHHYDOXDWHGLQ SDWLHQWVE\HQGRUHFWDOSURVWDWH05,DW7 LQFOXGLQJ7ZHLJKWHGDQGGLIIXVLRQ ZHLJKWHG05,EHIRUH53 05,WXPRXUYROXPHZDVFRPSDUHGWRSDWKRORJLFDOÀQG LQJVRIGLJLWLVHGVOLGHVRIZKROHPRXQW53 &RUUHODWLRQEHWZHHQ$'&YDOXHVDQG *6ZDVSHUIRUPHGLQWKH3=DQGWKH7=IRUWXPRXUVZLWKQRKLJK*OHDVRQJUDGH JURXSYHUVXVWXPRXUVZLWKJURXSJURXSDQGPRUHWKDQ RIKLJK*OHDVRQJUDGHVJURXS79ZHUHFRPSDUHGE\WKH%ODQG$OWPDQWHVW 5HVXOWV$'&YDOXHVZHUHQRWVLJQLÀFDQWO\GLIIHUHQWEHWZHHQJURXSVDQGDQG EHWZHHQJURXSVDQG:KHQJURXSVYHUVXVJURXSVZHUHFRPSDUHG $'&YDOXHVZHUHVLJQLÀFDQWO\ORZHULQJURXSYVLQWKH3= DQGYVS'LVWLQFWLRQEHWZHHQWKHVHWZRJURXSVZDV DFKLHYHGZLWKDVHQVLWLYLW\RIDQGDQGDVSHFLÀFLW\RIDQGUH VSHFWLYHO\&RPSDULVRQRISDWKRORJLFDOZLWK7:05,DQG':05,WXPRXUYROXPH VKRZHGDPHDQGLIIHUHQFHRIUDQJHDQGRIUDQJH UHVSHFWLYHO\:KHQERWKVHTXHQFHVSUHGLFWHGD79FFFRQFRUGDQFHZLWKWKH SDWKRORJLFDOYROXPHZDVREVHUYHGLQFDVHV &RQFOXVLRQ7XPRXUVZLWKPRUHWKDQRIKLJK*OHDVRQJUDGHVFDQEHSUH GLFWHGE\PHDVXUHPHQWRIWKH$'&YDOXH&RQFRUGDQFHEHWZHHQ79RQ05,DQG SDWKRORJLFDOYROXPHZDVKLJKIRUWXPRXUVFF % 0XOWLSDUDPHWULF05LPDJLQJIRUGHWHFWLRQDQGORFDOLVDWLRQRI WUDQVLWLRQ]RQHSURVWDWHFDQFHU &0$+RHNV7 +DPEURFN'<DNDU&+XOVEHUJHQYDQGH.DD$-:LWMHV --)XWWHUHU-2%DUHQWV]1LMPHJHQ1/&+RHNV#UDGXPFQQO 3XUSRVH 7 R UHWURVSHFWLYHO\ GHWHUPLQH GHWHFWLRQ DQG ORFDOLVDWLRQ DFFXUDF\ IRU *OHDVRQJUDGH**DQG**WUDQVLWLRQ]RQH7=FDQFHURI7ZHLJKWHG 7:,05LPDJLQJ05,YHUVXVPXOWLSDUDPHWULF05LPDJLQJ0305,XVLQJ UDGLFDOSURVWDWHFWRP\VSHFLPHQV53DVJROGVWDQGDUG 0HWKRGVDQG0DWHULDOV,QFOXVLRQFULWHULDZHUH7=FDQFHU!FPXSRQ53 DQG7HQGRUHFWDO0305,7:,GLIIXVLRQZHLJKWHG05,DSSDUHQWGLIIXVLRQ FRHIÀFLHQWPDSV$'&DQGG\QDPLFFRQWUDVWHQKDQFHG05,'&(05,)URP 53 SDWLHQWVZLWK7=FDQFHUVZHUHLQFOXGHG7ZHQW\WZRSDWLHQWVZLWKRXW 7=ZLWKSHULSKHUDO]RQH3=FDQFHUZHUHUDQGRPO\VHOHFWHGDVFRQWUROJURXS )RXU UDGLRORJLVWV UDQGRPO\ VFRUHG 7:, 7:,$'& 7:,'&(05,DQG 7:,$'&'&(05,ZLWKDWZRZHHNLQWHUYDO7=FDQFHUVXVSLFLRQZDVUDWHG RQDSRLQWVFDOHLQ7=UHJLRQVRILQWHUHVW52,$VFRUHZDVDSRVLWLYH GHWHFWLRQ DFFXUDF\ UHVXOW /RFDOLVDWLRQ DFFXUDF\ ZDV DQDO\VHG XVLQJ 52,52& ZLWKJHQHUDOLVHGHVWLPDWLRQHTXDWLRQV 5HVXOWV6LJQLÀFDQWO\PRUH**YHUVXV**7=FDQFHUV ZHUHGHWHFWHGS2QO\IRU**7=FDQFHUVGHWHFWLRQDFFXUDF\ZDV VLJQLÀFDQWO\LPSURYHGE\0305,FRPSDUHGWR7:,YHUVXVS 8VLQJ0305,ORFDOLVDWLRQDFFXUDF\ZDVLPSURYHGIRU**7=FDQFHUVRQO\ $8&IRU0305,YHUVXVIRU7:,S &RQFOXVLRQ'HWHFWLRQUDWHVRI**7=FDQFHUVDUHVLJQLÀFDQWO\KLJKHUWKDQ WKRVHRI**7=FDQFHUV0305,FRPSDUHGWR7:,LPSURYHVGHWHFWLRQDF FXUDF\IRU**7=FDQFHUVRQO\0305,VOLJKWO\LPSURYHV7=FDQFHUORFDOLVDWLRQ DFFXUDF\FRPSDUHGWR7:, % 5HWURVSHFWLYHFRUUHODWLRQEHWZHHQSDWKRORJLFDOVSHFLPHQVDQG PXOWLSDUDPHWULF05,IRUGHWHFWLRQRISURVWDWHFDQFHU ) 5XVVR ($UPDQGR60D]]HWWL,%HUWRWWR(%ROOLWR) 3RUSLJOLD '5HJJH&DQGLROR,72UEDVVDQR,7ÀOLSSRUXVVR#LUFFLW 3XUSRVH7 RXQGHUVWDQGFDXVHVRIIDLOXUHWRLGHQWLI\FDQFHUOHVLRQV 0HWKRGV DQG 0DWHULDOV SDWLHQWV ZLWK ELRSWLF GLDJQRVLV RI SURVWDWH FDQFHU 3&DXQGHUZHQW05,H[DPLQDWLRQDW7 7':,DQG'&(05,LPDJHVZHUH DQDO\VHGIRUWKHLGHQWLÀFDWLRQRI3&D2QWKHEDVLVRISDWKRORJLFH[DPLQDWLRQDIWHU VXUJHU\05,ÀQGLQJVZHUHUHDQDO\VHGE\DQH[SHUWUDGLRORJLVWWRHYDOXDWH05, IHDWXUHVRI3&DPLVVHGDWWKHÀUVWDQDO\VLV 5HVXOWV3DWKRORJLFDQDO\VLVIRXQG3&DKDGDSDWKRORJLFDOYROXPH!PO %HIRUH SURVWDWHFWRP\ 05, GHWHFWHG OHVLRQV ! PO VHQV VHQVPHDQ $'&LQWKHSHULSKHUDO]RQH3=DQGVHQVPHDQ $'&LQWKHWUDQVLWLRQDO]RQH7=3DWKRORJ\EDVHG05,UHDQDO\VLVDOORZHG WRUHFRJQLVH3&DLQ3=DQGLQ7=7KHPLVVHGOHVLRQVLQ3= KDGVPDOOHUYROXPHVYVPO$PRQJPLVVHGOHVLRQVRQO\ RQHORFDOLVHGLQ3=KDGDQ$'&!KDGDQG$'&YDOXHVDQGDQ $'&RI$PLOGK\SRLQWHQVHOHVLRQLQWHUSUHWHGDVSURVWDWLWLVKDGDW\SH7, FXUYHDQGDQ$'&RIOHVLRQVRI3=DQG7=ZHUHK\SRYDVFXODULVHG$'& % 3URVWDWHFDQFHUVFUHHQLQJWKHUROHRISUHELRSV\05,RIWKHSURVWDWH LQUXOLQJRXWSURVWDWHFDQFHU 7 )UDQLHO +$9DUJDV< 0D]DKHUL6%RHKPHU++ULFDN2$NLQ '%H\HUVGRUII%HUOLQ'(1HZ<RUN1<86WRELDVIUDQLHO#FKDULWHGH 3XUSRVH7 RHYDOXDWHWKHUROHRISURVWDWHPDJQHWLFUHVRQDQFHLPDJLQJ05,LQ SDWLHQWVZLWKVXVSHFWHGSURVWDWHFDQFHU 0HWKRGVDQG0DWHULDOV(WKLFVERDUGDSSURYDOZDVUHFHLYHGIRUWKLVUHWURVSHFWLYH DQDO\VLVRISURVSHFWLYHO\DFTXLUHGGDWD1LQHW\PHQPHGLDQDJH\HDUVPHGLDQ 36$QJPOXQGHUZHQWFRPELQHGHQGRUHFWDOERG\SKDVHGDUUD\FRLO7 HVOD 05,EHIRUHWKHLUÀUVWV\VWHPDWLFFRUHELRSV\ZLWKWUDQVUHFWDOXOWUDVRXQG7586 JXLGDQFH05LPDJHVZHUHDQDO\VHGLQGHSHQGHQWO\E\WKUHHUDGLRORJLVWV7KHUD GLRORJLVWVGLYLGHGWKHSURVWDWHLQWRUHJLRQVFRUUHVSRQGLQJWRWKHELRSV\VFKHPH DQGHYDOXDWHGHDFKUHJLRQIRUWKHSUHVHQFHRIFDQFHULQDVWDQGDUGLVHGPDQQHU XVLQJDSRLQWVFDOH$WVWDWLVWLFDODQDO\VLVVFRUHVZHUHGLFKRWRPLVHGDVEHQLJQ YVPDOLJQDQW5HVXOWVZHUHDQDO\VHGE\VH[WDQW5HFHLYHURSHUDWLQJ FKDUDFWHULVWLF52&DQDO\VLVZDVGRQHDQGGHVFULSWLYHVWDWLVWLFVZHUHFDOFXODWHG 5HVXOWV6\VWHPDWLF7586JXLGHGFRUHELRSV\IRXQGFDQFHULQSDWLHQWV ORZJUDGHFDQFHU*OHDVRQVFRUH KLJKJUDGHFDQFHU*OHDVRQVFRUH DQGFRUHVORZJUDGHFDQFHUKLJKJUDGHFDQFHU $UHDV XQGHU52&FXUYHVZHUHIRUWKHWKUHHUHDGHUVE\VH[WDQWVIRURYHUDOO SURVWDWHFDQFHUGHWHFWLRQDQGIRUGHWHFWLRQRIKLJKJUDGHFDQFHU'H VFULSWLYHVWDWLVWLFVIRUGHWHFWLRQRIDOOFDQFHUVKLJKJUDGHFDQFHUVE\VH[WDQWZHUH DV IROORZV QHJDWLYH SUHGLFWLYH YDOXH VSHFLÀFLW\ VHQVLWLYLW\DQGSRVLWLYH SUHGLFWLYHYDOXH &RQFOXVLRQ,QSDWLHQWVZLWKVXVSHFWHGSURVWDWHFDQFHUQHJDWLYH05,ÀQGLQJV UXOHRXWKLJKJUDGHSURVWDWHFDQFHURQVXEVHTXHQW7586JXLGHGFRUHELRSV\ ZLWKDKLJKSUREDELOLW\+RZHYHUVHQVLWLYLW\LVORZDQGSDWLHQWVVKRXOGXQGHUJR FORVHIROORZXS % 3URVWDWHFDQFHUUROHRISUHWUHDWPHQWPXOWLSDUDPHWULF05,LQ SUHGLFWLQJELRFKHPLFDOUHFXUUHQFHIROORZLQJUDGLFDOSURVWDWHFWRP\ -3DUN&.LP%3DUN+/HH6-HRQ66HR+&KRL6HRXO.5 MXQJMDHVPFSDUN#VDPVXQJFRP 3XUSRVH7 RUHWURVSHFWLYHO\GHWHUPLQHZKHWKHUSUHWUHDWPHQWPXOWLSDUDPHWULF05, ÀQGLQJVFDQSUHGLFWELRFKHPLFDOUHFXUUHQFH%&5LQSDWLHQWVZKRXQGHUJRUDGLFDO SURVWDWHFWRP\53IRUSURVWDWHFDQFHU 0HWKRGVDQG0DWHULDOVSDWLHQWVPHGLDQDJH\HDUVDJHUDQJH \HDUVZLWKELRSV\SURYHQSURVWDWHFDQFHUZKRUHFHLYHG53XQGHUZHQWSUHWUHDW PHQWPXOWLSDUDPHWULF05,DW7 LQFOXGLQJ7ZHLJKWHG7:,GLIIXVLRQZHLJKWHG ':,DQGG\QDPLFFRQWUDVWHQKDQFHGLPDJLQJ'&(,05,YDULDEOHVGHULYHGIURP UHWURVSHFWLYHFRQVHQVXVDVVHVVPHQWVE\WZRUHDGHUVLQFOXGHGDSSDUHQWWXPRXU SUHVHQFHDW7:,':,7:,'&(,DQG7:,':,'&(,H[WUDFDSVXODU H[WHQVLRQVHPLQDOYHVLFOHLQYDVLRQDQGWXPRXUVL]HDW':,RU'&(,&OLQLFDOYDUL DEOHVLQFOXGHGSUHWUHDWPHQWSURVWDWHVSHFLÀFDQWLJHQ36$FOLQLFDO7VWDJHDQG *OHDVRQVFRUH8QLYDULDWHDQGPXOWLYDULDWH&R[UHJUHVVLRQDQDO\VHVLQYHVWLJDWHG WKHUHODWLRQVKLSEHWZHHQFOLQLFDODQGLPDJLQJYDULDEOHVDQG%&5 5HVXOWV$IWHUDPHGLDQIROORZXSRIPRQWKV%&5GHYHORSHGLQSDWLHQWV 8QLYDULDWHDQDO\VLVUHYHDOHGWKDW05,DQGFOLQLFDOYDULDEOHVZHUHDOOVLJQLÀ FDQWO\UHODWHGWR%&530XOWLYDULDWHDQDO\VLVUHYHDOHGWKDWSUHWUHDWPHQW 36$>KD]DUGUDWLR+53 @DQG*OHDVRQVFRUH+53 ZHUHWKHRQO\VLJQLÀFDQWLQGHSHQGHQWSUHGLFWRUVIRU%&5$SSDUHQWWXPRXUSUHV HQFHDW7:,':,'&(,ZDVDQLQGHSHQGHQWSUHGLFWRURIERUGHUOLQHVLJQLÀFDQFH IRU%&5RQPXOWLYDULDWHDQDO\VLV+53 &RQFOXVLRQ $SSDUHQWWXPRXUSUHVHQFHDWFRPELQHG7:,':,DQG'&(,DSSHDUV WREHDQLQGHSHQGHQWSUHGLFWRURIERUGHUOLQHVLJQLÀFDQFHIRU%&5IROORZLQJ53 DQGSUHWUHDWPHQW36$DQG*OHDVRQVFRUHDUHVLJQLÀFDQWLQGHSHQGHQWSUHGLFWRUV IRUWKLVHQGSRLQW % $VVHVVPHQWRIDJJUHVVLYHQHVVDQGWXPRXUYROXPHRISURVWDWH FDQFHUFRUUHODWLRQRI$'&ZLWKKLVWRORJLFJUDGHDQGSDWKRORJLFDO WXPRXUYROXPH *.KRXU\'(LVV) %HXYRQ1%'HORQJFKDPSV) &RUQXG3DULV)5 NKRXU\JDE#JPDLOFRP 3XUSRVH7 RFRUUHODWHDSSDUHQWGLIIXVLRQFRHIÀFLHQW$'&YDOXHVWXPRXUYROXPH 79ZLWK*OHDVRQVFRUH*6DQGSDWKRORJLFDOYROXPHRISURVWDWHFDQFHU3&D RQZKROHPRXQWUDGLFDOSURVWDWHFWRP\53VSHFLPHQV 6FLHQWLILF6HVVLRQ 6 &$' ( ) *+% (XURSHDQ&RQJUHVVRI 5DGLRORJ\ % )HDVLELOLW\DQGUHOLDELOLW\RI05JXLGHGELRSV\RIWKHSURVWDWHJODQG FRPSDULVRQWRKLVWRSDWKRORJLFDORXWFRPH $0DOLFK$.RWW$8OULFK-)HJHU5&KHODUX 1RUGKDXVHQ'(FKHODUXBUREHUW#\DKRRFRP 3XUSRVH$ UHOHYDQW QXPEHU RI SDWLHQWV VXIIHULQJ IURP SURVWDWH FDQFHU UHPDLQ XQGHWHFWHGDIWHUXOWUDVRXQGJXLGHGELRSV\3URVWDWH05,DQG05JXLGHGELRSV\ PLJKWRYHUFRPHWKLVGLDJQRVWLFJDS 0HWKRGVDQG0DWHULDOV$VDUHVXOWRIDGLDJQRVWLFSURVWDWH05,3KLOLSV,QWHUD $FKLHYD7SHUIRUPHGDWSDWLHQWVZKRXQGHUZHQWXOWUDVRXQGEDVHGELRSV\RI WKHSURVWDWHJODQGZLWKDQHJDWLYHUHVXOWOHVLRQVZHUHGHWHFWHGWREHVXVSLFLRXV GXHWRSDWKRORJLFDOFRQWUDVWXSWDNH!LQLWLDOXSWDNHG\QDPLFVHULHVV VHULHVDQGVXVSLFLRXVGLIIXVLRQFRHIÀFLHQW7KHVHOHVLRQVZHUHELRSVLHG05JXLGHG XVLQJ&$'FDOFXODWLRQIRUDFFHVV'\QD&$'IRUSURVWDWH,QYLYR3KLOLSV1/DQGUH ODWHGKDUGZDUH'\QD75,0,QWHUYHQWLRQZDVSHUIRUPHGZLWKD*ELRSV\QHHGOH 5HVXOWVKLVWRORJLFDOO\YHULÀHGOHVLRQVZHUHSURYHQWREHPDOLJQDQWSUHPD OLJQDQW,QVDPSOHVQRSURVWDWLFWLVVXHZDVIRXQG$PRQJ WKHYHULÀHGLQYDVLYHPDOLJQDQWOHVLRQVZHUHVXPPDULVHGDVKLJKJUDGH LQWHUPHGLDWHDQGORZJUDGHPDOLJQDQWOHVLRQVZHUHKLVWRORJLFDOO\FRQÀUPHG DV7DVDDQGDVE0HDQ*OHDVRQVFRUHZDVOHVLRQVZHUHYHULÀHG DVKLJKULVN$6$3OHVLRQVZHUHRIRWKHUEHQLJQKLVWRORJ\$PRQJWKHEHQLJQ HQWLWLHVSURVWDWLWLVZDVFRPPRQO\REVHUYHGLQFDVHVK\SHUSODVLDLQIXUWKHU FDVHVDQGDWURSKLFJODQGXODUWLVVXHLQFDVHV2QO\PDOLJQDQWOHVLRQV ZHUHORFDWHGLQWKHSHULSKHUDO]RQHLQWKHFHQWUDO]RQHH[FOXVLYHO\ &RQFOXVLRQ05JXLGHGSURVWDWHELRSV\LVDSUHFLVHWHFKQRORJ\ZLWKDKLJKGHWHF WLRQUDWHRISURVWDWHFDQFHUWREHUHFRPPHQGHGDVWKHPHWKRGRIFKRLFHDIWHUD QHJDWLYHVRQRJUDSKLFDOELRSV\ZLWKVXVSLFLRXVGLDJQRVWLFSURVWDWH05, % 05,DQGXOWUDVRXQGJXLGHGSURVWDWHELRSV\XVLQJUHDOWLPHVRIW LPDJHIXVLRQ.RHOLVDSLORWVWXG\ (5XG(%DFR'.ORW]$6YLQGODQG+%(JJHVER2VOR12 SHUXG#PHGLVLQXLRQR 3XUSRVH7UDQVUHFWDOXOWUDVRXQG7586JXLGHGELRSVLHVDUHWKHJROGVWDQGDUG ZKHQGLDJQRVLQJSURVWDWHFDQFHU+RZHYHUH[DFWELRSV\ORFDWLRQVFDQQRWEHYHUL ÀHGDQGWKHUHLVDKLJKUDWHRIIDOVHQHJDWLYHELRSVLHV0DJQHWLFUHVRQDQFHLPDJLQJ 05,FDQLGHQWLI\WXPRXUVEXWLWLVVWLOOQRWSRVVLEOHWRGRFXPHQWELRSV\SRVLWLRQV XVLQJ7586 $QHZ'JXLGHG7586ELRSV\PHWKRG.RHOLVFDQGRFXPHQWH[DFW ELRSV\ORFDWLRQVDQGZLWKUHDOWLPHVRIWLPDJH05,IXVLRQWDUJHWHGELRSVLHVFDQ EHSHUIRUPHG7KHDLPRIWKHVWXG\ZDVWRHYDOXDWH.RHOLV'XOWUDVRXQGDQG 05,IXVLRQJXLGHGELRSV\WHFKQLTXH 0HWKRGVDQG0DWHULDOV1LQHW\SDWLHQWV\UVPHDQ\UVPHDQ36$QJ POXQGHUZHQW05,SULRUWRSURVWDWHELRSVLHV6XEJURXSVSULPDU\ELRSV\SWVVW WKUHELRSVLHVSWVDQGELRFKHPLFDOUHFXUUHQFH%&5DIWHUUDGLRWKHUDS\SWV 05,7$YDQWR6LHPHQV(UODQJHQDQGERG\DUUD\FRLO6HTXHQFHVD['7 DQG':,3RVWLPDJLQJSURFHVVLQJ1RUGLF,&(7XPRXUVZHUHKLJKOLJKWHGRQD[LDO 7LPDJHVDQGFODVVLÀHGDVKLJKPRGHUDWHRUORZGHJUHHRIVXVSLFLRQ%LRSVLHV ' $FFXYL[90HGLVRQ.RUHDQDYLJDWLRQV\VWHP.RHOLV*UHQREOH)UDQFH 5HVXOWVQRGXOHVZHUHELRSVLHG3RVLWLYHELRSVLHVDFFRUGLQJWRGHJUHHRIVXV SLFLRQKLJKPHGLXPDQGORZ5DQGRPELRSVLHV ZHUHDQGSRVLWLYHLQ%LRSV\SRVLWLYHVXEJURXSVSULPDU\ELRSV\SRVLWLYH VWWKUHELRSV\%&5DIWHUUDGLRWKHUDS\ &RQFOXVLRQ7KH.RHOLVPHWKRGLVIHDVLEOHDQGDOORZVDFFXUDWHWDUJHWHGELRSVLHV +HQFHIDOVHQHJDWLYHELRSVLHVDQGWKHXVHRIUDQGRPELRSVLHVFDQEHUHGXFHG DQGUHVSHFWLYHO\$3=OHVLRQZDVPLVVHGIRULWVOLQHDUVKDSH$'& 7=OHVLRQVZLWKORZ $'&VPHDQZHUHLQWHUSUHWHGDVVWURPDODGHQRPDV &RQFOXVLRQ:HIRXQGPDQ\FDXVHVRIGLDJQRVWLFIDLOXUHK\SRYDVFXODULVHGOHVLRQV LQ3=DQG7=WKLQOHVLRQVLQ3=JODQGLQKRPRJHQHLW\HVSHFLDOO\LQ7=OHVLRQV VL]HLQWHUPHGLDWH$'&YDOXHV05,UHDQDO\VLVLGHQWLÀHVLQ$'&YDOXHVWKHPRVW DFFXUDWHPHWKRGWRLGHQWLI\SURVWDWHFDQFHU % ,VLWSRVVLEOHWRPRGHOWKHULVNRIPDOLJQDQF\RIIRFDODEQRUPDOLWLHV IRXQGDWSURVWDWHPXOWLSDUDPHWULF05," 25RXYLHUH03DSLOODUG1*LURXLQ5%RXWLHU05DELOORXG %5LFKH) 0HJH/HFKHYDOOLHU0&RORPEHO$*HOHW/\RQ)5 ROLYLHUURXYLHUH#FKXO\RQIU 3XUSRVH7 RHYDOXDWHZKHWKHUIRFDODEQRUPDOLWLHV)$VGHSLFWHGE\SURVWDWH05, FRXOGEHFKDUDFWHULVHGXVLQJVLPSOHVHPLRORJLFDOIHDWXUHV 0HWKRGV DQG 0DWHULDOV SDWLHQWV ZKR XQGHUZHQW 7ZHLJKWHG GLIIXVLRQ ZHLJKWHG DQG G\QDPLF FRQWUDVWHQKDQFHG 05, DW 7 EHIRUH SURVWDWH ELRSV\ ZHUHSURVSHFWLYHO\LQFOXGHG)$VYLVLEOHDW05,ZHUHFKDUDFWHULVHGE\H[SHULHQFHG XURUDGLRORJLVWV XVLQJ WKHLU VKDSH WKH GHJUHH RI VLJQDO DEQRUPDOLW\ QRUPDO WR PDUNHGO\ DEQRUPDO RQ LQGLYLGXDO 05 VHTXHQFHV DQG D VXEMHFWLYH VFRUH 66 SUREDEO\ EHQLJQ WR 66 SUREDEO\ PDOLJQDQW )$V ZHUH WKHQELRSVLHG XQGHU86JXLGDQFH 5HVXOWV)$VZHUHSRVLWLYHDWELRSV\7KHVXEMHFWLYHVFRUHVLJQLÀFDQWO\ SUHGLFWHGELRSV\UHVXOWVS $VFRPSDUHGWR66)$VWKHRGGVUDWLRV25 RIPDOLJQDQF\RI66DQG66)$VZHUHDQG 7KHVKDSHRI)$VZDVQRWDVLJQLÀFDQWSUHGLFWRURIELRSV\UHVXOWVLQWKHSHULSKHUDO ]RQH 3= LWV SUHGLFWLYH YDOXH ZDV QRW WHVWHG LQ WKH WUDQVLWLRQ ]RQH GXH WR WKH VPDOOQXPEHURIFDVHV,QFRQWUDVWDVLPSOHFRPELQDWLRQRI05VLJQDODEQRUPDOL WLHVLQWR´ORZULVNµ´LQWHUPHGLDWHµDQG´KLJKULVNµJURXSVVLJQLÀFDQWO\SUHGLFWHG ELRSV\UHVXOWVS$VFRPSDUHGWRORZULVN)$VWKH25RIPDOLJQDQF\ RILQWHUPHGLDWHDQGKLJKULVN)$VZHUHDQGLQWKH RYHUDOOSRSXODWLRQDQGDQGLQ3= &RQFOXVLRQ$VLPSOHFRPELQDWLRQRIVLJQDODEQRUPDOLWLHVRILQGLYLGXDO05VH TXHQFHVFDQVLJQLÀFDQWO\VWUDWLI\WKHULVNRIPDOLJQDQF\RI)$VDQGJLYHVLPLODU UHVXOWVWRDVXEMHFWLYHVFRUHDVVLJQHGE\H[SHUWXURUDGLRORJLVWV7KLVKROGVSURPLVH RIDPRUHVWDQGDUGLVHGLQWHUSUHWDWLRQRI05,E\UHDGHUVZLWKYDU\LQJH[SHULHQFH % $FFXUDF\RIXOWUDKLJKEYDOXHVEWRGLIIHUHQWLDWHEHQLJQIURP PDOLJQDQWSURVWDWLFQRGXOHVRQHQGRUHFWDOGLIIXVLRQZHLJKWHGLPDJLQJ 40RQ]DQL$6FKXOO1%'HORQJVFKDPSV) %HXYRQ3 /HJPDQQ) &RUQXG 3DULV)5TPRQ]DQL#\DKRRFRP 3XUSRVH7 RDVVHVVWKHDFFXUDF\RIHQGRUHFWDOGLIIXVLRQZHLJKWHG05,HU':, 05, DW 7 HVOD ZLWK XOWUDKLJK E YDOXHV WR GLIIHUHQWLDWH EHQLJQ IURP PDOLJQDQW SURVWDWLFQRGXOHV 0HWKRGVDQG0DWHULDOVFRQVHFXWLYHSDWLHQWVZLWKQRSUHYLRXVELRSV\DQRUPDO GLJLWDOUHFWDOH[DPLQDWLRQDQGD36$OHYHORIQJPOZHUHUHIHUUHGXQGHUZHQW HU05,7ZHLJKWHGDQG':,05,EYDOXHDSSDUHQWGLIIXVLRQFRHIÀFLHQW$'& PDSSLQJDQGELPDJHVZDVSHUIRUPHGEHIRUHVH[WDQWDQG758605,LPDJH IXVLRQJXLGHG ELRSVLHV 2Q E':, VLJQDO LQWHQVLW\ 6, ZDV SURVSHFWLYHO\ PHDVXUHGRQK\SHULQWHQVHQRGXOHVRULJLQDWLQJLQWKHSHULSKHUDODQGWUDQVLWLRQ]RQH 3=DQG7=DQGRQWKHUHPDLQLQJVXUIDFHRQWKHVDPHVOLFH6,RIWKHFRUUHVSRQGLQJ DUHDVRQ$'&DQGELPDJHVZDVPHDVXUHG1RGXOHSURVWDWH6,UDWLRVZHUH FDOFXODWHGIRUEDQGEDQGEUDWLREUDWLRZDVWKHQFDOFXODWHG $UHDVXQGHUWKHFXUYHV$8&RI$'&PDSSLQJDQGEUDWLREUDWLRZHUH FRPSDUHGWRELRSV\UHVXOWV 5HVXOWV05,H[DPLQDWLRQVKRZHGQRGXOHVLQSDWLHQWVLQWKH3=DQG LQ WKH 7= 7ZHQW\QLQH QRGXOHV ZHUH PDOLJQDQW EUDWLR EUDWLR YDOXH ZDV VLJQLÀFDQWO\ KLJKHU LQ PDOLJQDQW QRGXOHV WKDQ LQ EHQLJQ QRGXOHVS $8&YDOXHRIWKHEUDWLREUDWLRZDVQRWVLJQLÀFDQWO\ KLJKHUWKDQWKDWRI$'&YVS 6HQVLWLYLW\DQGVSHFLÀFLW\ZHUH YVDQGYVUHVSHFWLYHO\ &RQFOXVLRQ EUDWLREUDWLR 6, YDOXH KHOSV WR GLIIHUHQWLDWH EHQLJQ IURP PDOLJQDQWSURVWDWLFQRGXOHVLQERWK3=DQG7=$OWKRXJKSHUIRUPDQFHZDVEHWWHU WKDQWKDWRI$'&PDSSLQJWKHGLIIHUHQFHRQO\DSSURDFKHGVLJQLÀFDQFH 6FLHQWLILF6HVVLRQ $ 6&'()*+% 7KXUVGD\ (XURSHDQ&RQJUHVVRI 5DGLRORJ\ % $FFXUDF\RI7PDJQHWLFUHVRQDQFHLPDJLQJZLWKDKLJKUHOD[LYLW\ FRQWUDVWDJHQWLQDVVHVVLQJWUHDWPHQWUHVSRQVHLQSDWLHQWV XQGHUJRLQJQHRDGMXYDQWFKHPRWKHUDS\ 07 HOHVFD) 3HGLFRQL0/XFLDQL) 9DVVHOOL9&DVDOL(0LJOLR&&DWDODQR 5RPH,7PDULDQQDWHOHVFD#\DKRRLW 3XUSRVH7 RDVVHVVWKHDFFXUDF\RIPDJQHWLFUHVRQDQFHLPDJLQJDW7705, LQHYDOXDWLQJUHVLGXDOGLVHDVHDIWHUQHRDGMXYDQWFKHPRWKHUDS\1$&LQSDWLHQWV ZLWKDGYDQFHGEUHDVWFDQFHU 0HWKRGV DQG 0DWHULDOV %HWZHHQ 0DUFK DQG -XO\ ZRPHQ ZLWK DGYDQFHGEUHDVWFDQFHUVXQGHUZHQWG\QDPLF705,EHIRUHDQGDIWHU1$&7KH 05,SURWRFROFRPSULVHGSUHFRQWUDVW)6(7Z,'($/VHTXHQFHDQG9,%5$17' 7ZVHTXHQFHDFTXLUHGEHIRUHDQGDIWHUDGPLQLVWUDWLRQRIJDGREHQDWHGLPHJOX PLQH0XOWL+DQFHDWPPRONJERG\ZHLJKW$GHGLFDWHGELODWHUDOEUHDVWFRLO ZDVXVHG)RUHDFKSDWLHQWWXPRXUVL]HZDVGHWHUPLQHGEHIRUHDQGDIWHU1$&,I ELODWHUDOPXOWLIRFDORUPXOWLFHQWULFGLVHDVHZDVSUHVHQWRQO\WKHPDMRUOHVLRQZDV FRQVLGHUHG7KH05,HYDOXDWLRQRIWUHDWPHQWUHVSRQVHZDVFODVVLÀHGEDVHGRQ 5(&,67FULWHULD5HVLGXDOWXPRXUVL]HVREWDLQHGXVLQJ05,ZHUHFRPSDUHGZLWK SDWKRORJLFDOÀQGLQJV 5HVXOWV $WRWDOQXPEHURIOHVLRQVZHUHHYDOXDWHG7KHVHQVLWLYLW\VSHFLÀFLW\DQG DFFXUDF\RI05,LQGHWHFWLQJUHVLGXDOGLVHDVHZDVDQGUHVSHF WLYHO\DUHDXQGHU52&FXUYH05,RYHUHVWLPDWHGWKHSUHVHQFHRIUHVLGXDO WXPRXULQFDVHV7KHPHDQRIWKHODUJHVWGLDPHWHUVPHDVXUHGDWEDVHOLQH05, SRVWWUHDWPHQW05,DQGKLVWRORJ\ZHUHDQGPPUHVSHFWLYHO\7KH WXPRXUVL]HGLIIHUHQFHEHWZHHQ05,DQGKLVWRORJ\ZDVQRWVWDWLVWLFDOO\VLJQLÀFDQW 3YDOXH :HIRXQGDVWDWLVWLFDOO\VLJQLÀFDQWFRUUHODWLRQEHWZHHQ05,DQG SDWKRORJ\PHDVXUHPHQWV6SHDUPDQU 3YDOXH &RQFOXVLRQ7KHSUHVHQFHDQGVL]HRIUHVLGXDOGLVHDVHLQEUHDVWSDWLHQWVWUHDWHG ZLWK1$&FRXOGEHDFFXUDWHO\HYDOXDWHGXVLQJ705,DQGKLJKUHOD[LYLW\FRQWUDVW DJHQW % 05PDPPRJUDSK\DW7LQFOLQLFDOSUDFWLFHSURVSHFWLYHVLQJOH FHQWUHH[SHULHQFH 3 $7 %DOW]HU:$.DLVHU+3 %XUPHLVWHU0'LHW]HO -HQD'(SDVFDOEDOW]HU#PHGXQLMHQDGH 3XUSRVH+LJKHUPDJQHWLFÀHOGVWUHQJWKOHDGVWRKLJKHUVLJQDOWRQRLVHUDWLRZKLFK PD\EHLQYHVWHGLQKLJKHUVSDWLDORUWHPSRUDOUHVROXWLRQIRUEUHDVWLPDJLQJ:KLOH VWURQJHUFKHPLFDOVKLIWEHWZHHQIDWDQGZDWHUPD\EHXVHIXOLQIDWVDWXUDWHG' JUDGLHQWHFKRLPDJLQJ%DQG%LQKRPRJHQHLWLHVPD\QHJDWLYHO\DIIHFWLPDJLQJ :HUHSRUWRQRXUSURVSHFWLYHH[SHULHQFHXVLQJ705PDPPRJUDSK\050LQ FOLQLFDOSUDFWLFH 0HWKRGV DQG 0DWHULDOV &RQVHFXWLYH SDWLHQWV XQGHUZHQW 050 7 5DSLG FKDQHO EUHDVW FRLO DFFRUGLQJ WR (XURSHDQ UHFRPPHQGDWLRQV G\QDPLF 7Z IDWVDWXUDWHG'9,%(PPRONJ2PQLVFDQ7Z76(67,5DFTXLVLWLRQWLPH PLQ 5HIHUHQFH VWDQGDUG ZDV KLVWRSDWKRORJ\ RU IROORZXS ! PRQWKV 5HVXOWVIURPGRXEOHUHDGLQJE\WZRH[SHULHQFHGUDGLRORJLVWVLQFOLQLFDOSUDFWLFH ZHUHUHFRUGHGSURVSHFWLYHO\5HVXOWVSHUEUHDVWZHUHFRPSDUHGZLWKWKHUHIHUHQFH VWDQGDUG XVLQJ FRQWLQJHQF\ WDEOHV 6HQVLWLYLW\ VSHFLÀFLW\ SRVLWLYH DQG QHJDWLYH OLNHOLKRRGUDWLR/5/5ZHUHFDOFXODWHG 5HVXOWVEUHDVWVLQSDWLHQWVZHUHLQFOXGHG,QGLFDWLRQVIRU050ZHUHXQ FOHDUQ RUVXVSLFLRXVQ UHVXOWVLQFRQYHQWLRQDOLPDJLQJDIWHUFDUHQ FOLQLFDOÀQGLQJVQ IROORZXSRIEHQLJQOHVLRQVQ DQGFRQWUDODWHUDOÀQGLQJV Q 6HQVLWLYLW\VSHFLÀFLW\/5XQG/5RIXQGZHUH REVHUYHG 5HJXODUO\ LQKRPRJHQHRXV IDW VDWXUDWLRQ GXH WR % LQKRPRJHQHLWLHV ZDVREVHUYHGZKLFKGLGQRWKDYHDGHWULPHQWDOLQÁXHQFHRQGLDJQRVWLFDFFXUDF\ $OOIDOVHSRVLWLYHÀQGLQJVSUHVHQWHGDVQRQPDVVHQKDQFHPHQWV &RQFOXVLRQ050DWWHVODVKRZHGH[FHOOHQWGLDJQRVWLFDFFXUDF\6LPLODUWR050 DW7 QRQPDVVOLNHHQKDQFHPHQWVZHUHGLDJQRVWLFDOO\FKDOOHQJLQJ7W\SLFDO DUWHIDFWVGLGQRWKDYHDGHWULPHQWDOHIIHFWRQGLDJQRVWLFSHUIRUPDQFH % %DFNWRWKHIXWXUHQRQFRQWUDVWEUHDVW05,QF%05,XVLQJD FRPELQDWLRQRI7ZHLJKWHGGLIIXVLRQZHLJKWHGDQG67,5LPDJLQJ 507ULPEROL19HUDUGL/$&DUERQDUR) &DUWLD*'L/HR) 6DUGDQHOOL 6DQ'RQDWR0LODQHVH,7&RUXQQD,7 3XUSRVH2XUDLPZDVWRDVVHVVSHUEUHDVWVHQVLWLYLW\DQGVSHFLÀFLW\RIQF%05, 0HWKRGVDQG0DWHULDOV$FRQVHFXWLYHVHULHVRIZRPHQZKRXQGHUZHQWEUHDVW 05, DW RXU LQVWLWXWLRQ IURP 1RYHPEHU WR 'HFHPEHU ZDVLQFOXGHG LQ WKLV UHWURVSHFWLYH VWXG\ 7ZR EOLQGHG UHDGHUV ZLWK 5 DQG\HDU 5 RI 5RRP) %UHDVW 66 05,7 XQHQKDQFHGDQGPRUH 0RGHUDWRUV $/LQGD8GLQH,7 &/RR$PVWHUGDP1/ % 7KHLQÁXHQFHRIKRUPRQDOÁXFWXDWLRQVRQTXDQWLWDWLYHGLIIXVLRQ ZHLJKWHGPDJQHWLFUHVRQDQFHLPDJLQJ':05,RIWKHJODQGXODU EUHDVWWLVVXHLQKHDOWK\SUHPHQRSDXVDOSDUWLFLSDQWVDW7 1005$O5DVKLGL*:DLWHU7 $KHDUQ) -*LOEHUW7 :5HGSDWK $EHUGHHQ8.QDOUDVKLGL #DEHUGHHQDFXN 3XUSRVH7 RGHWHUPLQHZKHWKHUWKHF\FOLFDOFKDQJHVLQWKHKRUPRQDOOHYHOVDIIHFW TXDQWLWDWLYHYDOXHVRIDSSDUHQWGLIIXVLRQFRHIÀFLHQW$'&DQGWUDQVYHUVHUHOD[DWLRQ WLPH7IRUJODQGXODUWLVVXHVLQKHDOWK\SUHPHQRSDXVDOZRPHQ 0HWKRGVDQG0DWHULDOV7KHVWXG\ZDVSHUIRUPHGXVLQJD705,3KLOLSV6FDQQHU DQGDGHGLFDWHGELODWHUDOFKDQQHOSKDVHGDUUD\EUHDVWFRLO3DUWLFLSDQWVZHUH VFDQQHGIRXUWLPHVGXULQJWKHPHQVWUXDOF\FOH$'&PDSZDVJHQHUDWHGIURPD GLIIXVLRQZHLJKWHGLPDJLQJ':,SXOVHVHTXHQFHZLWKIRXUEYDOXHV DQG VPP7 PDS ZDV JHQHUDWHG IURP D PXOWLSOH VSLQ HFKR6( SXOVH VHTXHQFHZLWKIRXUHFKRWLPHV7(DQGPV5HJLRQVRILQWHUHVW 52,ZHUHSODFHGLQWKHJODQGXODUWLVVXHDWWKHHDFKRIWKHIRXUGLIIHUHQWSKDVHV RIWKHPHQVWUXDOF\FOHLQHDFKEUHDVW 5HVXOWV4XDQWLWDWLYHPHDVXUHPHQWVZHUHREWDLQHGLQKHDOWK\SDUWLFLSDQWV \HDUVROGZLWKUHJXODUPHQVWUXDOF\FOH7KHUHVXOWVRIWKH$'&ðPPV GXULQJVWQGUGDQGWKZHHNZHUHDQG UHVSHFWLYHO\DQG7YDOXHVPVZHUHDQGUH VSHFWLYHO\$129$WHVWVKRZVWKDWWKHUHZDVQRVWDWLVWLFDOO\VLJQLÀFDQWLQÁXHQFH RIPHQVWUXDOF\FOHRQPHDQ$'&RU7YDOXHV+RZHYHUWKHUHZDVDVLJQLÀFDQW DJHE\ZHHNRIF\FOHLQWHUDFWLRQ &RQFOXVLRQ 7KHUH ZDV QR VLJQLÀFDQW GLIIHUHQFH LQ PHDQ$'& DQG 7 YDOXHV DFURVV WKH ZHHNV RI WKH PHQVWUXDO F\FOH +RZHYHU DJH FDQ EH FRQVLGHUHG DV LQÁXHQFLQJIDFWRU % (IIHFWVRILQKRPRJHQHRXVUDGLRIUHTXHQF\SRZHUGHSRVLWLRQRQWKH DSSDUHQWGLIIXVLRQFRHIÀFLHQWRIWKHQRUPDOEUHDVWDW7 5*LURPHWWL00DLHURQ0%D]]RFFKL53DGRYDQL&=XLDQL8GLQH,7 UJLURPHWWL#VLUPRUJ 3XUSRVH7 RLQYHVWLJDWHZKHWKHUWKHDSSDUHQWGLIIXVLRQFRHIÀFLHQW$'&TXDQ WLÀFDWLRQLQWKHEUHDVWLVDIIHFWHGE\WKHLQKRPRJHQHLW\RIUDGLRIUHTXHQF\SRZHU GHSRVLWLRQ53'LQKHUHQWWR7V\VWHPV 0HWKRGVDQG0DWHULDOV:HHQUROOHGSDWLHQWVZLWKRXWHYLGHQFHRIEUHDVWOH VLRQVDWELODWHUDOEUHDVWPDJQHWLFUHVRQDQFHLPDJLQJSHUIRUPHGRQD7PDJ QHW%HIRUHFRQWUDVWDGPLQLVWUDWLRQWZRVHTXHQFHVZHUHFRQVHFXWLYHO\DFTXLUHG DDWUDQVPLWPDJQHWLFÀHOG%PDSSLQJVHTXHQFHJHQHUDWLQJD%PDSED GLIIXVLRQZHLJKWHGHFKRSODQDUVHTXHQFHJHQHUDWLQJE DQGVHFPP LPDJHVWRJHWKHUZLWKDQ$'&PDS,QHDFKSDWLHQWEUHDVWVZHUHGLYLGHGLQWRIRXU SHUVLGHV\PPHWULFDOUHJLRQV,,9RQWKHD[LDOVOLFHSDVVLQJWKURXJKWKHQLSSOHV LQRUGHUWRFDOFXODWHRQDSHUUHJLRQEDVLVDWKHSHUFHQWRI53'ÁLSDQJOHIURP %PDSEWKHDSSDUHQWGLIIXVLRQFRHIÀFLHQW$'&RIÀEURJODQGXODUWLVVXH),7 $QDO\VLVZDVSHUIRUPHGZLWKD.UXVNDO:DOOLVWHVWDQGWKHX0DQQ:KLWQH\WHVW 5HVXOWV53'ZDVVLJQLÀFDQWO\KLJKHULQOHIWEUHDVWUHJLRQVDVFRPSDUHGWRWKH ULJKWRQHVS/RZHVW53'ZDVIRXQGLQWKHULJKWLQWHUQDOUHJLRQU,,, 7KHVDPHWUHQGZDVREVHUYHGIRUWKH),7$'&YDOXHDOWKRXJK GLIIHUHQFHVZHUHQRWVWDWLVWLFDOO\VLJQLÀFDQWDYHUDJH $'&RI[PP VHFDWWKHUHJLRQU,,, &RQFOXVLRQ,QKRPRJHQHLW\LQ53'DW7DIIHFWHGWKHULJKWEUHDVW$OWKRXJK QRWVWDWLVWLFDOO\VLJQLÀFDQWUHODWHGGLIIHUHQFHEHWZHHQULJKWDQGOHIWEUHDVW),7$'& VXJJHVWVWKDW$'&TXDQWLÀFDWLRQLVSRWHQWLDOO\XQUHOLDEOHDW7XQOHVVV\VWHPV WRKRPRJHQLVH53'DUHXVHG 6FLHQWLILF6HVVLRQ 6 &$' ( ) *+% (XURSHDQ&RQJUHVVRI 5DGLRORJ\ FH050SDWKRORJLFDOÀQGLQJVDQGIROORZXSGDWDZHUHFRQVLGHUHGWKHUHIHUHQFH VWDQGDUG566HQVLWLYLW\VSHFLÀFLW\339DQG139RIXH050ZHUHDVVHVVHG$ &KLVTXDUHWHVWZDVXVHGWRDVVHVVDQ\VWDWLVWLFDOO\VLJQLÀFDQWGLIIHUHQFHVEHWZHHQ XH050DQGWKH56 5HVXOWVSDWLHQWVIXOÀOOHGRXUVHOHFWLRQFULWHULDZHUHDIIHFWHGE\GLIIHUHQW OHVLRQV PDOLJQDQFLHV ZHUH GLDJQRVHG$IWHU XH050 RI PDOLJQDQFLHV ZHUH QRW K\SRWKHWLFDOO\ DGGUHVVHG WR FH050 DQG ZHUH FRQVLGHUHGDV IDOVH QHJDWLYH6HQVLWLYLW\VSHFLÀFLW\339DQG139RIXH050ZHUHS SSUHVSHFWLYHO\ &RQFOXVLRQ&RPSDUHGWRWKH56XH050VHQVLWLYLW\DQG139ZHUHQRWVWDWLVWL FDOO\GLIIHUHQW,QSDWLHQWVZKRFDQQRWUHFHLYH*DGROLQLXPLQMHFWLRQXH050FRXOG EHDVDIHKLJKO\LQIRUPDWLYHWHFKQLTXH % $FRPSDULVRQEHWZHHQ)$67WHFKQLTXHDQGVWDQGDUGEUHDVW05,DUH ZHUHDG\IRU05VFUHHQLQJ" &&DERUQL&/RVLR3 3DQL]]D(9HQWXULQL) 'H&REHOOL$'HO0DVFKLR 0LODQ,7 3XUSRVH%UHDVW05,RIIHUVDGYDQWDJHVRYHUPDPPRJUDSK\LQVFUHHQLQJEUHDVW FDQFHUDPRQJ\RXQJZRPHQEXWVSHFLÀFLW\VKRXOGEHLPSURYHGWRUHGXFHH[SHQ VLYHIROORZXS'LIIXVLRQZHLJKWHGLPDJLQJ':,FDQLQFUHDVHSRVLWLYHSUHGLFWLYH YDOXHRIG\QDPLF05,:HFRPSDUHGWKHGLDJQRVWLFSHUIRUPDQFHRID)$67WHFK QLTXHLQFOXGLQJ':,ZLWKVWDQGDUGH[DPLQDWLRQLQWKLVVHWWLQJ 0HWKRGVDQG0DWHULDOV:HUHWURVSHFWLYHO\VHOHFWHGEUHDVW05,7':, G\QDPLFVWXG\VKRZLQJHQKDQFLQJOHVLRQV!PPZKLFKQDWXUHZDVDVVHVVHG F\WRKLVWRORJLFDOO\RUZLWKIROORZXS7ZRWUDLQHGUDGLRORJLVWVLQFRQVHQVXVUHYLHZHG HDFK H[DPLQDWLRQ FRQVLGHULQJ WKH LQIRUPDWLRQV GHULYHG IURP D VKRUW G\QDPLF VWXG\VWSRVWFRQWUDVWVXEWUDFWLRQRQO\SOXV':,)$6705,VHSDUDWHO\IURP VWDQGDUGH[DPLQDWLRQ7DQGSRVWFRQWUDVWVXEWUDFWLRQDQGFRPSDULQJWKHLU GLDJQRVWLFSHUIRUPDQFH 5HVXOWV)$6705,GHSLFWHGHQKDQFLQJOHVLRQVLGHQWLÀHGZLWK VWDQGDUG H[DP QR FDQFHU ZDV PLVVHG 4XDQWLWDWLYH ':, ZLWK DVVHVVPHQW RI $'&DSSDUHQWGLIIXVLRQFRHIÀFLHQWZDVSRVVLEOHLQVKRZLQJORZHU$'& YDOXHVLQPDOLJQDQWOHVLRQVWKDQEHQLJQYV3,Q VWDQGDUGH[DPLQDWLRQWKHNLQHWLFDQDO\VLVVKRZHGOLPLWHGYDOXHZLWKRQO\RI FDQFHUVH[KLELWLQJDW\SHFXUYHDQGPRVWDQLQGHWHUPLQDWHFXUYH$'& ZDVPRUHSUHGLFWLYHRIEHQLJQRUPDOLJQDQWQDWXUHXVLQJDFXWRIIRIPPV 52&DQDO\VLV)$6705,DFFXUDF\ZDVVXSHULRUWKDQVWDQGDUG05,YV ZLWKDVLJQLÀFDQWO\EHWWHUQHJDWLYHSUHGLFWLYHYDOXHYVDQGFRQWULEXWLRQ IRU%,5$'6OHVLRQV &RQFOXVLRQ,QRXUH[SHULHQFH)$6705,VKRZHGDEHWWHUDFFXUDF\WKDQVWDQG DUGH[DPLQDWLRQGXHWRWKHVXSHULRULW\RI$'&RYHUG\QDPLFFULWHULD7KHKLJKHU QHJDWLYHSUHGLFWLYHYDOXHDQGWKHVKRUWHUH[DPLQDWLRQWLPHFRXOGSRWHQWLDOO\H[WHQG WKHDSSOLFDWLRQRI05,LQDVFUHHQLQJFRQWH[W % 6XEJURXSDQDO\VLVRIWKHÀQDOUHVXOWVRIWKH$XVWULDQVFUHHQLQJWULDO IRUIDPLOLDOEUHDVWFDQFHU &&5LHGO1/XIW&%%HUQKDUW*+HLQ]3HHU.3LQNHU7++HOELFK 9LHQQD$7FKULVWRSKHUULHGO#PHGXQLZLHQDFDW 3XUSRVH7 RDVVHVVWKHYDOXHRIPDPPRJUDSK\XOWUDVRXQGDQG05,RIWKHEUHDVW LQWKHVXUYHLOODQFHRIYDULRXVVXEJURXSVRIZRPHQDWKLJKULVNIRUEUHDVWFDQFHU 0HWKRGVDQG0DWHULDOV,QDSURVSHFWLYHWULDOZRPHQDWKLJKULVNIRUEUHDVWFDQFHU ZHUHRIIHUHGDQQXDOVXUYHLOODQFHH[DPLQDWLRQVFRQVLVWLQJRIPDPPRJUDSK\XOWUD VRXQGDQG05,6HQVLWLYLW\VSHFLÀFLW\SRVLWLYHSUHGLFWLYHYDOXHQHJDWLYHSUHGLFWLYH YDOXHSRVLWLYHOLNHOLKRRGUDWLRDQGQHJDWLYHOLNHOLKRRGUDWLRRIWKHWKUHHVXUYHLOODQFH PRGDOLWLHVZHUHDVVHVVHGIRUYDULRXVVXEJURXSVRISDUWLFLSDQWVGLFKRWRPLVHGE\ PXWDWLRQVWDWXVDJHPHQRSDXVDOVWDWXVDQGSHUVRQDOKLVWRU\RIEUHDVWFDQFHU 5HVXOWV,QSDWLHQWVFRPSOHWHLPDJLQJURXQGVZHUHSHUIRUPHG$WRWDO QXPEHURIFDQFHUVZHUHGHWHFWHGZLWKVHQVLWLYLWLHVIRUPDPPRJUDSK\XOWUD VRXQGDQG05,RIDQGUHVSHFWLYHO\S2IFDQFHUV ZHUH'&,6)RUWKHVHPDPPRJUDSK\XOWUDVRXQGDQG05,GHPRQVWUDWHG VHQVLWLYLWLHVRIDQGUHVSHFWLYHO\S0DPPRJUDSK\XOWUD VRXQGDQG05,OHGWRDQGIDOVHSRVLWLYHÀQGLQJVZKLFKUHVXOWHGLQ VSHFLÀFLWLHVRIDQGUHVSHFWLYHO\S2IWKHVHZHUHDW\SL FDOGXFWDOK\SHUSODVLDV2IWKHVHSUHPDOLJQDQWOHVLRQVPDPPRJUDSK\XOWUDVRXQG DQG05,GHWHFWHGS&RPSUHKHQVLYHVXEJURXSDQDO\VHV UHYHDOHGDKLJKHUVSHFLÀFLW\RI05,LQWKHVXEJURXSRIPXWDWLRQFDUULHUVDQG SRVWPHQRSDXVDOZRPHQFRPSDUHGWRQRQPXWDWLRQFDUULHUVDQGSUH SHULPHQRSDXVDOZRPHQZLWK3 %05,H[SHULHQFHHYDOXDWHGQF%05,VWXGLHVSHUIRUPHGXVLQJJUDGLHQWHFKR7 ZHLJKWHG7ZHLJKWHG67,5DQGGLIIXVLRQZHLJKWHGLPDJLQJE DQG VPPDVVLJQLQJD%,5$'6VFRUHIRUHDFKEUHDVW5HDGHUVZHUHEOLQGHGWR FRQWUDVWHQKDQFHG&(%05,DQGÀQDOGLDJQRVLV%UHDVWVDVVLJQHG%,5$'6 ZHUHFRQVLGHUHGDVQHJDWLYHVDQGWKRVHDVVLJQHG%,5$'6DVSRVLWLYHV6HQ VLWLYLW\VSHFLÀFLW\DQGDFFXUDF\ZHUHHVWLPDWHG $FRPELQDWLRQRIPDPPRJUDSK\ XOWUDVRXQG&(%05,PPRONJRIJDGREHQDWHGLPHJOXPLQHDQGSDWKRORJ\ ZDVFRQVLGHUHGDVDVWDQGDUGRIUHIHUHQFH,QWHUREVHUYHUDJUHHPHQWZDVHVWLPDWHG XVLQJ&RKHQNDSSDVWDWLVWLFV 5HVXOWV$ WRWDO RI EUHDVWV LQ SDWLHQWV DJHG \HDUV UDQJH \HDUV ZHUH DQDO\VHG 3HUEUHDVW FDQFHU SUHYDOHQFH ZDV ,'& Q ,/& Q '&,6 Q FDQFHUV QRW RWKHUZLVH VSHFLÀHG Q 5 KDG VHQVLWLYLW\ RI VSHFLÀFLW\ RI DQG DFFXUDF\ RI 5KDGVHQVLWLYLW\RIVSHFLÀFLW\RIDQGDFFXUDF\ RI)RU5IDOVHQHJDWLYHVZHUHIRXU,'&RQH'&,6DQGRQH,/& RQHFDQFHUVQRWRWKHUZLVHVSHFLÀHG)RU5IDOVHQHJDWLYHVZHUHIRXU,'&RQH '&,6DQGRQH,/&RQHFDQFHUVQRWRWKHUZLVHVSHFLÀHG,QWHUREVHUYHUDJUHHPHQW ZDVDOPRVWSHUIHFWN &RQFOXVLRQ $FRPELQDWLRQRI7ZHLJKWHGGLIIXVLRQZHLJKWHGDQG67,5LPDJLQJ DOORZHGIRUDJRRGGLDJQRVWLFSHUIRUPDQFHZLWKKLJKVSHFLÀFLW\ % %UHDVW05,DW7 DSLORWVWXG\HVWLPDWLQJVHQVLWLYLW\DQGVSHFLÀFLW\ RIXQHQKDQFHG05,':,FRPELQHGZLWK7,'($/VHTXHQFHYV&( 05,LQWKHDVVHVVPHQWRIUHVSRQVHWRQHRDGMXYDQWFKHPRWKHUDS\ ) 3HGLFRQL07 HOHVFD0/XFLDQL) 9DVVHOOL9&DVDOL(0LJOLR&&DWDODQR 5RPH,7IHGHULFDSHGLFRQL#XQLURPD LW 3XUSRVH7 RLGHQWLI\VHQVLWLYLW\DQGVSHFLÀFLW\RIDFRQWUDVWDJHQWIUHHGLDJQRVWLF DSSURDFKFRPELQLQJRQO\':,ZLWK7,'($/LPDJHVXH05,DQGFRPSDUHWKH UHVXOWVZLWKFRQWUDVWHQKDQFHG05,&(050LQWKHDVVHVVPHQWRIUHVSRQVHWR QHRDGMXYDQWFKHPRWKHUDS\XVLQJD70DJQHW 0HWKRGVDQG0DWHULDOV&RQVHFXWLYHSDWLHQWVXQGHUJRLQJQHRDGMXYDQWFKHPR WKHUDS\IRUELRSV\SURYHGEUHDVWFDQFHU!FPXQGHUZHQW705SULRUWRFKHPR WKHUDS\HYHU\WZRF\FOHVDQGEHIRUHVXUJLFDOH[FLVLRQ05SURWRFROFRPSULVHG DQ)6(7,'($/DQG':,VHTXHQFHVDQG9LEUDQW'7ZHLJKWHGVHTXHQFH DFTXLUHGEHIRUHDQGDIWHUDGPLQLVWUDWLRQRIFRQWUDVWPHGLD7XPRXUUHVSRQVHZDV FODVVLÀHGXVLQJ5(&,67FULWHULDXVLQJWXPRXUVL]HDW05,7XPRXUUHVSRQVHDW 05, DIWHU FKHPRWKHUDS\ ZDV FRPSDUHG WR KLVWRORJLFDO VSHFLPHQ DIWHU VXUJHU\ 7ZREOLQGHGREVHUYHUVUDWHGXH05,DQGWKHQ&(05,IRUWKHHYDOXDWLRQRIWXPRXU UHVSRQVH/HVLRQVL]H$'&YDOXHVDQG)6(,'($/GHVFULSWRUVZHUHDVVHVVHG 5HVXOWVSDWLHQWVZHUHHQUROOHG6HQVLWLYLW\RIXH05,ZDVREVHUYHUDQG REVHUYHU6HQVLWLYLW\RI&(05,ZDVIRUERWKREVHUYHUV6SHFLÀFLW\ ZDVXH05,DQG&(05,IRUERWKREVHUYHUV7KHGLIIHUHQFHVEHWZHHQ ERWKPHWKRGVDQGREVHUYHUVZHUHQRWVWDWLVWLFDOO\VLJQLÀFDQW3/HVLRQVL]H PHDVXUHPHQWVGLGQRWGLIIHUVLJQLÀFDQWO\EHWZHHQDOOVHTXHQFHVDQDO\VHG7XPRXU $'&YDOXHVGHPRQVWUDWHGVLJQLÀFDQWGLIIHUHQFHVEHWZHHQUHVSRQGHUVDQGQRQ UHVSRQGHUVDIWHUWKHÀUVW,,F\FOHVRIWUHDWPHQW &RQFOXVLRQ&RPELQDWLRQRI':,DQG7,'($/DOORZWRREWDLQVLPLODUYDOXHRI VHQVLWLYLW\DQGVSHFLÀFLW\RI&(05,LQWKHHYDOXDWLRQRIWXPRXUUHVSRQVHWRQHR DGMXYDQWFKHPRWKHUDS\ $'&YDOXHVFRXOGEHXVHIXOIRUGLIIHUHQWLDWLQJUHVSRQGHUV IURPQRQUHVSRQGHUVHDUOLHUGXULQJWKHWUHDWPHQW % 7RFRQWUDVWRUQRWWRFRQWUDVW"$QHZDSSURDFKWRXQHQKDQFHG05 PDPPRJUDSK\ 0/RUHQ]RQ&=XLDQL$/LQGD6'H6WHIDQL00DLHURQ5*LURPHWWL 0%D]]RFFKL8GLQH,7PLFKHOHORUHQ]RQ#JPDLOFRP 3XUSRVH7 RDVVHVVVHQVLWLYLW\VSHFLÀFLW\SRVLWLYHDQGQHJDWLYHSUHGLFWLYHYDOXH 339139RIXQHQKDQFHG8(05PDPPRJUDSK\050 0HWKRGVDQG0DWHULDOVZHHQUROOHGDOOSDWLHQWVXQGHUJRLQJFRQWUDVWHQKDQFHG &( 050 LQ RXU LQVWLWXWLRQ EHWZHHQ )HEUXDU\ DQG 0D\ ZLWK KLVWRORJLFDO GLDJQRVLVRURQH\HDUIROORZXS3DWLHQWVXQGHUJRLQJQHRDGMXYDQWFKHPRWKHUDS\ ZHUHH[FOXGHG8VLQJD7VFDQQHU67,57:':DQG7:LPDJHVEHIRUHDQG DIWHU*DGROLQLXPLQMHFWLRQZHUHDFTXLUHG7ZRUHDGHUVLQFRQVHQVXVSURVSHFWLYHO\ DVVHVVHGXH050LH7:':DQG7:LPDJHVDFTXLUHGEHIRUH*DGROLQLXP LQMHFWLRQ ZLWKRXW WKH NQRZOHGJH RI FOLQLFDO PDPPRJUDSK\ XOWUDVRXQG DQG SDWKRORJLFDOGLDJQRVLV%DVHGRQPRUSKRORJLFDOIHDWXUHVDV\PPHWU\DUFKLWHFWXUDO GLVWRUWLRQRUPDVVIRUPDVVHVVKDSHPDUJLQVVLJQDOIHDWXUHVDQG$'&YDOXHV FXWRII PPVUHDGHUVUHSRUWHGZKHWKHUWKH\ZHUHFRQÀGHQWLQH[FOXG LQJDQXQGHUO\LQJPDOLJQDQF\RUQRWK\SRWKHWLFDOO\DGGUHVVLQJSDWLHQWVWRFRQWUDVW DJHQW LQMHFWLRQ RQO\ LQ WKH VHFRQG FDVH &OLQLFDO PDPPRJUDSK\ XOWUDVRXQG 6FLHQWLILF6HVVLRQ $ 6&'()*+% 7KXUVGD\ (XURSHDQ&RQJUHVVRI 5DGLRORJ\ % ,PDJLQJRIPXOWLSOHVFOHURVLVDW7 LQFUHDVHGGLDJQRVWLF\LHOGXVLQJ VXEWUDFWLRQLPDJLQJ 6/DQJQHU56HLSHO%0HQVHO62WWR$'UHVVHO1+RVWHQ0.LUVFK *UHLIVZDOG'(VRHQNHODQJQHU#XQLJUHLIVZDOGGH 3XUSRVH 7KH GHWHFWLRQ RI FRQWUDVWHQKDQFHG *G GHP\HOLQDWLQJ OHVLRQVL V LPSRUWDQW IRU WKH GLDJQRVLV DQG WUHDWPHQW RI PXOWLSOH VFOHURVLV 7KH DLP RI RXU VWXG\ZDVWRHYDOXDWHWKHDSSOLFDELOLW\RIVXEWUDFWLRQ05LPDJHVIRUWKHGHWHFWLRQ RIDFWLYH06OHVLRQDW7 HVODXVLQJDFKDQQHOKHDGFRLO 0HWKRGVDQG0DWHULDOV:HSURVSHFWLYHO\LQFOXGHGSDWLHQWVIHPDOHVPHDQ DJH\HDUVZLWKSURYHQPXOWLSOHVFOHURVLV05LPDJLQJZDVSHUIRUPHG DW7 HVODXVLQJDFKDQQHOKHDGFRLO$OOSDWLHQWVUHFHLYHGLQWUDYHQRXVFRQWUDVW PHGLD*DGRYLVW%D\HU6FKHULQJ3KDUPD%HUOLQZLWKDGRVHRIPPRO *GNJERG\ZHLJKW)ROORZXS05,ZDVSHUIRUPHGDIWHUPRQWKV,QDOOSDWLHQWV ZHDFTXLUHGD[LDO7ZDQG7ZÁGLPDJHVEHIRUHDQGPLQXWHVDIWHUDGPLQLV WUDWLRQRI*DGREXWURO3UHFRQWUDVWLPDJHVZHUHVXEWUDFWHGIURPWKHSRVWFRQWUDVW (QKDQFLQJOHVLRQVZHUHFRXQWHGRQSUHDQGSRVWFRQWUDVWLPDJHV/HVLRQFRXQW ZDVHYDOXDWHGE\WZRLQGHSHQGHQWQHXURUDGLRORJLVWV 5HVXOWV/HVLRQORDGRQ7ZLPDJHVZDV8VLQJXQVXEWUDFWHGSRVW FRQWUDVWLPDJHV*GOHVLRQVPHDQLQSDWLHQWVZHUHLGHQWLÀHG 2QVXEWUDFWLRQLPDJHV*GOHVLRQVLQSDWLHQWVZHUHGHWHFWHG,QRIWKHVH SDWLHQWV*GOHVLRQVZHUHQRWLGHQWLÀHGRQXQVXEWUDFWHGLPDJHV,QSDWLHQWV DGGLWLRQDO*GOHVLRQVZHUHGHWHFWHGDQGLQSDWLHQWVWKHVL]HRIWKHOHVLRQV LQFUHDVHG7KHUHZDVJRRGLQWHUUHDGHUDJUHHPHQWѣ &RQFOXVLRQ8VLQJDFKDQQHOKHDGFRLODQGFRQWUDVWHQKDQFHG'VXEWUDFWLRQ 05LPDJHVLPSURYHWKHGLDJQRVWLF\LHOGRI05,DW7 HVODIRUGHWHFWLRQRIDFWLYH 06OHVLRQ % 9DOXHRI',505VHTXHQFHVLQFRPSDULVRQWR)/$,5DQG'37ZKHQ LGHQWLI\LQJFRUWLFDODQGMX[WDFRUWLFDOOHVLRQVLQSDWLHQWVZLWKPXOWLSOH VFOHURVLV 09HUD&DUWDV96FKRQVWHGW*HOGUHV&$XJHU$FRVWD50LWMDQD3HQHOOD $5RYLUD&DxHOODV%DUFHORQD(6PDUWDYHUD #JPDLOFRP 3XUSRVH7KHGHWHFWLRQE\05RIFRUWLFDOMX[WDFRUWLFDOOHVLRQVLQSDWLHQWVZLWKWKH GLDJQRVWLF VXVSLFLRQ RI PXOWLSOH VFOHURVLV LV RI JUHDW UHOHYDQFH7KH SXUSRVH RI WKLVZRUNLVWRFRPSDUHWKHVHQVLELOLW\RI´GRXEOHLQYHUVLRQUHFXSHUDWLRQµVHTXHQFH ',5LQFRPSDULVRQWR´ÁXLGDWWHQXDWHGLQYHUVLRQUHFRYHU\µ)/$,5DQGSURWRQLF GHQVLW\VHTXHQFH'37LQLGHQWLI\LQJGHP\HOLQDWLQJFRUWLFRMX[WDFRUWLFDOOHVLRQV LQWKLVSDWLHQWV 0HWKRGV DQG 0DWHULDOV SDWLHQWV ZHUH LQFOXGHG ZRPHQ PLG GOH DJH ZLWK WKH GLDJQRVLV RI D VLQJOH QHXURORJLF V\QGURPH RU PXOWLSOH VFOHURVLV$OOWKHVWXGLHVZHUHPDGHLQD7HTXLSPHQWDQGLQFOXGHGVHTXHQFHV ',5)/$,5DQG'37REWDLQHGLQDQD[LDOVKRWZLWKFRQWLJXRXVLPDJHVPP ZLGWK2QHREVHUYHULGHQWLÀHGWKHFRUWLFDOMX[WDFRUWLFDOOHVLRQVLQHDFKVHTXHQFH LQGHSHQGHQWO\DQGDVDZKROH 5HVXOWV2IDWRWDORIOHVLRQVGHWHFWHGLQWKHWKUHHVHTXHQFHVDVDZKROH )/$,5LGHQWLÀHGE\LWVHOIRIWKHP'37DQG',57KHFRP SDULVRQEHWZHHQWKH',5VHTXHQFHDQGWKH)/$,5DQG'37VKRZVDJDLQLQWKH QXPEHURIGHWHFWHGOHVLRQVRIDZKHQFRPSDULQJ',5WR)/$,5DQGRID ZKHQFRPSDULQJ',5WR'37:KHQFRPSDULQJ)/$,5DQG'37DVDZKROHWR ',5VHTXHQFHE\LWVHOIWKHJDLQLVRIDS &RQFOXVLRQ7KH',5VHTXHQFHLVVLJQLÀFDQWO\PRUHVHQVLEOHLQGHWHFWLQJGHP\ HOLQDWLQJ FRUWLFRMX[WDFRUWLFDO OHVLRQV WKDQ )/$,5 DQG '37 1HYHUWKHOHVV WKH FRPELQDWLRQ RI WKH WKUHH VHTXHQFHV RIIHUV D KLJKHU VHQVLELOLW\LQ GHWHFWLQJ WKLV OHVLRQVZKLFKLVUHOHYDQWWRFRQÀUPWKHGLDJQRVLVRIPXOWLSOHVFOHURVLV % ,QIUDWHQWRULDOOHVLRQVLQPXOWLSOHVFOHURVLVLPSURYHGGHWHFWLRQZLWK 77,5005LPDJLQJDW7PDJQHW 2.LULWVL .7 VLWDV*1RXVVLRV*.LULWVLV7KHVVDORQLNL*5$WKHQV*5 NLUROJD#KRWPDLOFRP 3XUSRVH7 RSURVSHFWLYHO\FRPSDUHWKHGHSLFWLRQRILQIUDWHQWRULDOOHVLRQVXVLQJ ÁXLGDWWHQXDWHG LQYHUVLRQUHFRYHU\ )/$,5 DQG 77,50 PDJQHWLF UHVRQDQFH 05LPDJLQJLQSDWLHQWVZLWKPXOWLSOHVFOHURVLV 0HWKRGVDQG0DWHULDOV/RFDOHWKLFVUHYLHZERDUGDSSURYDODQGLQIRUPHGFRQ VHQWZHUHREWDLQHG&RQYHQWLRQDO)/$,5LQD[LDOSODQHDQG77,50LPDJHVLQ VDJLWWDOSODQHPPWKLFNZHUHDFTXLUHGLQSDWLHQWVZLWKPXOWLSOHVFOHURVLV ZRPHQPHQDQGDJHPDWFKHGKHDOWK\FRQWUROVXEMHFWVZRPHQ PHQ0HDQDJHZDV\HDUVUDQJH\HDUVLQSDWLHQWVDQG\HDUV &RQFOXVLRQ7KHXVHRI05,LPSURYHVWKHGHWHFWLRQRILQYDVLYHDQGSUHLQYDVLYH FDQFHUVDVZHOODVRIKLJKULVNOHVLRQV6SHFLÀFLWLHVIRU05,DUHKLJKHVWIRUPXWD WLRQFDUULHUVDQGSRVWPHQRSDXVDOZRPHQ % 7UHDWPHQWRILQYDVLYHEUHDVWFDQFHULQLWLDOFOLQLFDOH[SHULHQFH XVLQJKLJKLQWHQVLW\IRFXVHGXOWUDVRXQGWKHUDS\ZLWK7PDJQHWLF UHVRQDQFHJXLGDQFH $1DSROL) 3HGLFRQL0$Q]LGHL/'L0DUH*&DUWRFFL/%HUWDFFLQL) %RQL 91RFH&&DWDODQR5RPH,7DOHVVDQGURQDSROL#XQLURPD LW 3XUSRVH 7 R GHWHUPLQH WKH HIÀFDF\ RI QRQLQYDVLYH KLJKLQWHQVLW\ 05JXLGHG IRFXVHGXOWUDVRXQG05J)86WUHDWPHQWIRUELRSV\SURYHQLQYDVLYHGXFWDOEUHDVW FDQFHU,'&VWDJH701VFKHGXOHGWRVXUJLFDOUHVHFWLRQDQGVHQWLQHOO\PSK QRGHELRSV\ 0HWKRGVDQG0DWHULDOV8QGHUWKH,5%DSSURYDOSDWLHQWVZLWKXQLIRFDOELRSV\ SURYHQ,'&OHVVWKDQFPLQVL]HVFKHGXOHGDQGFRQVHQWHGWRVXUJLFDOOXPSHFWRP\ RUPDVWHFWRP\UHVHFWLRQDQGVHQWLQHOO\PSKQRGHELRSV\DQGLQZKLFKEUHDVW 05,FRQÀUPHGDQHQKDQFLQJOHVLRQLQDWUHDWDEOHORFDWLRQXQGHUZHQW05J)86 WUHDWPHQW XVLQJ WKH ([$EODWH V\VWHP ,Q6LJKWHF 7UHDWPHQWV ZHUH GRQH LQDVLQJOHVHVVLRQLQDQDPEXODWRU\VHWWLQJ(IIHFWLYHQHVVRIWKHWUHDWPHQWZDV HYDOXDWHGDWSDWKRORJ\DIWHUVXUJHU\ 5HVXOWV$OO OHVLRQV ZHUH WUHDWHG 1R HQKDQFHPHQW ZDV VHHQ DW EUHDVW05, DIWHUWUHDWPHQWLQDOOSDWLHQWV,QDOOFDVHVSDWKRORJ\GHPRQVWUDWHGWKHDEVHQFHRI UHVLGXDOFDQFHUDIWHUVXUJLFDOH[FLVLRQ:HIRXQGRQO\QHFURWLFWLVVXHZLWKDWOHDVW PPPDUJLQVRIQRUPDOEUHDVWWLVVXHDURXQGWKHQHFURVLV:HREWDLQHGH[FHOOHQW DJUHHPHQWEHWZHHQ05,SRVWWUHDWPHQWDQGSDWKRORJ\ &RQFOXVLRQ05J)86LVDSURPLVLQJQRQLQYDVLYHWUHDWPHQWPRGDOLW\IRUXQLIRFDO EUHDVWFDQFHU 5RRP*+ 1HXUR 66E :KLWHPDWWHUGLVHDVHV 0RGHUDWRUV &$XJHU$FRVWD%DUFHORQD(6 03:DWWMHV$PVWHUGDP1/ % &RPSDULVRQRI7DQG7VFDQQHUVIRUHYDOXDWLQJP\HOLQDWLRQLQ QHRQDWDOEUDLQV '7 RUWRUD93DQDUD66DOLFH3 $0DWWHL&%ULJDQWL$5&RWURQHR $7 DUWDUR0&DXOR&KLHWL,7GRPHQLFRWRUWRUD#KRWPDLOLW 3XUSRVH 05 LPDJLQJ LV SUHVHQWO\ WKH PRVW VHQVLWLYH PHWKRG IRU WKH LQYLYR HYDOXDWLRQRIZKLWHPDWWHUPDWXUDWLRQLQQHRQDWDOEUDLQV(YDOXDWLQJP\HOLQDWLRQ LV WHFKQLFDOO\ FRQGLWLRQHG E\ WKH VHTXHQFH DQG WKH VFDQQHU ÀHOG LQWHQVLW\ 7KH REMHFWLYHRIWKLVVWXG\ZDVWRUHWURVSHFWLYHO\FRPSDUHWKHOHYHORIP\HOLQDWLRQRI YDULRXVFHUHEUDOVWUXFWXUHVLQWZRJURXSVRIWHUPDQGSUHWHUPQHRQDWHVHYDOXDWHG ZLWKHLWKHUDRU7VFDQQHU 0HWKRGVDQG0DWHULDOV5RXWLQHEUDLQ05RIQHRQDWHVZDVUHWURVSHFWLYHO\ HYDOXDWHG SUHWHUP$IWHU LQIRUPHG FRQVHQW ZDV REWDLQHG IURP OHJDO JXDUG LDQVDOOQHRQDWHVZHUHVHGDWHGDQGXQGHUZHQW05H[DPVDWDJHVWDWLRQDODJH EHWZHHQDQGZHHNVHTXLYDOHQWFRUUHFWHGDJHIRUSUHWHUPV7VFDQQHU ZDVXVHGLQSUHWHUPDQG7LQSUHWHUPQHRQDWHV7ZREOLQGHG QHXURUDGLRORJLVWVLQGHSHQGHQWO\HYDOXDWHGP\HOLQDWLRQRQ76(7ZHLJKWHGD[LDO LPDJHVLQWKHEUDLQVWHPLQIHULRUFHUHEHOODUSHGXQFOHLQIHULRUFROOLFXOXVFHUHEHOODU YHUPLVJOREXVSDOOLGXVYHQWURSRVWHURODWHUDOWKDODPLFQXFOHXVLQWHUQDOFDSVXOH RSWLFUDGLDWLRQFRURQDUDGLDWDDQGSUHFHQWUDOJ\UXV6WDWLVWLFDOGLIIHUHQFHVZHUH HYDOXDWHGXVLQJD3HDUVRQҋV&KLVTXDUHGWHVWS 5HVXOWV0\HOLQDWLRQRIWKHFHUHEHOODUYHUPLVS JOREXVSDOOLGXVS LQWHUQDOFDSVXOHS DQGRSWLFUDGLDWLRQSZDVLGHQWLÀHGZLWKDKLJKHU IUHTXHQF\ZLWK7LQERWKWKHSUHWHUPDQGIXOOWHUPQHRQDWHV &RQFOXVLRQ76(7ZHLJKWHGVHTXHQFHVREWDLQHGZLWKD7FRPSDUHGZLWKD 7VFDQQHUSUHVHQWDKLJKHUVHQVLWLYLW\IRUP\HOLQDWHGEUDLQVWUXFWXUHLQQHRQDWHV 7KLVUHVXOWDQGWKHORVVRIFRQWUDVWLQ7ZHLJKWHGLPDJHVHQFRXUDJHWKHXVHRI 7ZHLJKWHGVHTXHQFHDW7WRHYDOXDWHWKHSURFHVVRIP\HOLQDWLRQLQQHZERUQV 6FLHQWLILF6HVVLRQ 6 &$' ( ) *+% (XURSHDQ&RQJUHVVRI 5DGLRORJ\ % 'LVUXSWHGZKLWHPDWWHUVWUXFWXUDOQHWZRUNVLQFOLQLFDOO\LVRODWHG V\QGURPHVVXJJHVWLYHRI06 < /LX16KX< 'XDQ< +H./L%HLMLQJ&1 3XUSRVH7 RLQYHVWLJDWHWKHWRSRORJLFDORUJDQLVDWLRQRIWKHZKLWHPDWWHUVWUXFWXUDO QHWZRUNVLQSDWLHQWVZLWKFOLQLFDOO\LVRODWHGV\QGURPH&,6DQGUHODSVLQJUHPPLWLQJ PXOWLSOHVFOHURVLV5506E\'7,WUDFWRJUDSK\DQGJUDSKWKHRUHWLFDODSSURDFKHV 0HWKRGVDQG0DWHULDOV7ZHQW\HLJKWSDWLHQWVZLWK&,6SDWLHQWVZLWK5506 DQGKHDOWK\FRQWUROV+&ZHUHLQFOXGHG$OOSDUWLFLSDQWVZHUHVFDQQHGZLWKD 705,VFDQQHU7DQG'7,LPDJHVZHUHDFTXLUHG:HFRQVWUXFWHGWKHZKLWH PDWWHUVWUXFWXUDOQHWZRUNIRUHDFKSDUWLFLSDQW%DVHGRQWKH)1ZHLJKWHGQHWZRUN IRUHDFKVXEMHFWZHFDOFXODWHGWKHQHWZRUNSURSHUWLHVLQFOXGLQJWKHVWUHQJWKJOREDO HIÀFLHQF\DQGORFDOHIÀFLHQF\DWWKHJOREDOOHYHODQGWKHUHJLRQDOHIÀFLHQF\DWWKH QRGDOOHYHO$PXOWLSOHOLQHDUUHJUHVVLRQDQDO\VLVZDVSHUIRUPHGRQHDFKQHWZRUN PHWULFEHWZHHQDQ\WZRJURXSV3FRUUHFWHGZDVUHJDUGHGDVVLJQLÀFDQW 5HVXOWV6PDOOZRUOGFKDUDFWHULVWLFVRIWKH:0VWUXFWXUDOQHWZRUNVZHUHLGHQWLÀHG LQERWKWKHFRQWUROVDQGWKHSDWLHQWV$PRQJWKHWKUHHJURXSVZHIRXQGWKH06 SDWLHQWVKDYHWKHORZHVWQHWZRUNHIÀFLHQF\&RPSDUHGZLWK+&WKH&,6SDWLHQWV H[KLELWHGVLJQLÀFDQWGHFUHDVHVLQWKHVWUHQJWKDQGJOREDOHIÀFLHQF\RIWKHLU:0 VWUXFWXUDO QHWZRUNV )RU DOO WKH QHWZRUN SURSHUWLHV WKH &,6 QHWZRUN H[KLELWHG LQWHUPHGLDWHGYDOXHV&RPSDUHGZLWK+&WKH&,6SDWLHQWVH[KLELWHGDUHGXFWLRQ LQWKHQRGDOHIÀFLHQF\LQELODWHUDOSUHFHQWUDOJ\UXVDQGOHIWSRVWFHQWUDOJ\UXVZKLOH WKH06SDWLHQWVKDYHZLGHVSUHDGHIÀFLHQF\UHGXFWLRQLQPDQ\EUDLQUHJLRQV &RQFOXVLRQ 'LVUXSWHG WRSRORJLFDO RUJDQLVDWLRQ LQ WKH ZKLWH PDWWHU QHWZRUNL V DOUHDG\IRXQGDWWKH&,67KHPRVWVLJQLÀFDQWUHJLRQDOFKDQJHVZHUHORFDWHGDW WKHSULPDU\VHQVRULPRWRUV\VWHPLQ&,6 % 5HYLVHG0F'RQDOGҋVFULWHULDIRUGLVVHPLQDWLRQLQVSDFHDFFXUDF\LQ GLDJQRVLVRIPXOWLSOHVFOHURVLVIURP1HXUREHKFHWҋVGLVHDVH 66HÀGEDNKW0%DEDLQH]KDG$%RUKDQL+DJKLJKL5-DOOL==DUH6KLUD],5 VHSLGHKVHÀGEDNKW#\DKRRFRP 3XUSRVH7 RUHWURVSHFWLYHO\GHWHUPLQHDFFXUDF\RIPRGLÀHG0F'RQDOGҋVFULWHULDIRU GLVVHPLQDWLRQLQVSDFHLQGLIIHUHQWLDWLQJPXOWLSOHVFOHURVLV06IURP1HXUREHKFHW GLVHDVH1%'LQDKLJKSUHYDOHQFHDUHDRIERWKGLVHDVHV 0HWKRGVDQG0DWHULDOV7ZRUDGLRORJLVWVUHWURVSHFWLYHO\UHYLHZHGEUDLQ05,V EHORQJLQJWRSDWLHQWVZLWK06DQGSDWLHQWVZLWK1%'EOLQGHGWRWKHFOLQLFDO GLDJQRVLV$FFXUDF\RI0F'RQDOGFULWHULDLQGLDJQRVLQJ06ZDVDVVHVVHGXVLQJ 3RVHUFULWHULDDVWKHJROGVWDQGDUG 5HVXOWV2XWRIDOO0F'RQDOGFULWHULDIRUGLVVHPLQDWLRQLQVSDFHRQO\LQIUDWHQWRULDO OHVLRQVZHUHQRWVLJQLÀFDQWO\PRUHSUHYDOHQWLQ06&RUSXVFDOORVDOOHVLRQVZHUH WKH PRVW VLJQLÀFDQW GLVFULPLQDWLQJ IDFWRU EHWZHHQ WKH WZR GLVHDVHV VL[ WLPHV PRUHSUHYDOHQWLQ066HQVLWLYLW\VSHFLÀFLW\DQGDFFXUDF\RI0F'RQDOGFULWHULD ZHUHDQGUHVSHFWLYHO\7KHWZRÀQGLQJVPRUHSUHYDOHQWLQ1%' SDWLHQWV ZHUH PHVRGLHQFHSKDOLF LQYROYHPHQW DQG H[WHQVLRQ RI WKH OHVLRQ IURP RQH DQDWRPLF VLWH WR WKH QHLJKERXULQJ VLWH ,QWHUREVHUYHU DJUHHPHQW ZDV QHDU SHUIHFWLQGLDJQRVLQJ06XVLQJPRGLÀHG0F'RQDOGVFULWHULDIRUGLVVHPLQDWLRQLQ VSDFHNDSSDRI &RQFOXVLRQ6SHFLÀFLW\RI0F'RQDOGҋVFULWHULDDVDVWDQGDORQHWHVWLQGLIIHUHQWLDW LQJ06IURP1%'LVVXERSWLPDOZLWKDSRVVLEOHKLJKUDWHRIIDOVHSRVLWLYHVWXGLHV 05,VVKRXOGEHLQWHUSUHWHGLQWKHSURSHUFOLQLFDOEDFNJURXQGWRDYRLGPLVODEHOOLQJ SDWLHQWVZLWKDOWHUQDWHGLDJQRVHVDV06 % (YDOXDWLRQRIPHWDEROLFSHUIXVLRQDQGPLFURVWUXFWXUDOFHUHEUDO DOWHUDWLRQVLQSDWLHQWVZLWKV\VWHPLFOXSXVHU\WKHPDWRVXVXVLQJ05 VSHFWURVFRS\SHUIXVLRQDQGGLIIXVLRQWHQVRULPDJLQJ 3 6]HZF]\N$=LPQ\-%ODGRZVND06]P\UND.DF]PDUHN06DVLDGHN :URFODZ3/DEHUQDF#ZSSO 3XUSRVH7KHDLPRIWKHVWXG\ZDVWRHYDOXDWHPHWDEROLFSHUIXVLRQDQGPLFURVWUXF WXUDOFHUHEUDODOWHUDWLRQVLQSDWLHQWVZLWKV\VWHPLFOXSXVHU\WKHPDWRVXV6/(DQG QRUPDODSSHDULQJEUDLQRQSODLQ05XVLQJDGYDQFHGWHFKQLTXHV05VSHFWURVFRS\ 056SHUIXVLRQZHLJKWHGDQGGLIIXVLRQWHQVRULPDJLQJ3:,DQG'7, 0HWKRGVDQG0DWHULDOV)RUW\WZR6/(SDWLHQWVPHDQDJH\UVZLWKQRUPDO DSSHDULQJEUDLQRQSODLQ05DQGDJHPDWFKHGFRQWUROVXEMHFWVXQGHUZHQWVLQJOH YR[HO056G\QDPLFVXVFHSWLELOLW\FRQWUDVWHQKDQFHG3:,DQG'7,LQGLUHFWLRQV RQ705XQLW0HWDEROLWHUDWLRV1$$&U&KR&UP,&UZHUHFDOFXODWHGIURP SRVWHULRUFLQJXODWHFRUWH[DQGOHIWSDULHWDOZKLWHPDWWHU9DOXHVRIFHUHEUDOEORRG YROXPH UHODWHG WR FHUHEHOOXP U&%9 ZHUH DVVHVVHG IURP UHJLRQV LQFOXGLQJ GLIIHUHQW FRUWLFDO ORFDWLRQV EDVDO JDQJOLD DQG IURQWRSDULHWDO ZKLWH PDWWHU )UDF UDQJH\HDUVLQFRQWUROVXEMHFWV2QO\LQIUDWHQWRULDOOHVLRQVZHUHGHWHFWHG DQGUHSRUWHG7KHQXPEHUVRIOHVLRQVZHUHFRPSDUHGEHWZHHQWHFKQLTXHV 5HVXOWV7 RWDOQXPEHURIOHVLRQVGLIIHUEHWZHHQ77,50DQG)/$,56HTXHQFHV 77,50LPDJHVGHSLFWHGPRUHLQIUDWHQWRULDOOHVLRQVOHVLRQVLQSDWLHQWV WKDQ)/$,5OHVLRQVLQSDWLHQWVLPDJHV>W6WXGHQWS @2QDYHUDJH 77,50 LPDJLQJ GHSLFWHG PRUH ,QIUDWHQWRULDO OHVLRQV SHU SDWLHQW WKDQ GLG )/$,5LPDJLQJ2QO\LQIUDWHQWRULDOOHVLRQVZHUHGHWHFWHGLQFRQWUROVXEMHFWV ZLWK77,50VHTXHQFH &RQFOXVLRQ 05 LPDJLQJ ZLWK77,50 HQDEOHV LQFUHDVHG LQIUDWHQWRULDO OHVLRQ GHWHFWLRQLQWKHPXOWLSOHVFOHURVLVEUDLQ % 9HLQGHQVLW\LQSDWLHQWVZLWKPXOWLSOHVFOHURVLVDW7 DSLORWVWXG\ 6*RHG$'DO%LDQFR**UDEQHU06FKHUQWKDQHU.9DVV67UDWWQLJ 9LHQQD$7VDELQHJRHG#PHGXQLZLHQDFDW 3XUSRVH ,QWUDOHVLRQDO YHLQV DQG SHULYHQRXV LQÁDPPDWLRQ DUH NQRZQ WR EHD SDWKRKLVWRORJLFDO KDOOPDUN RI PXOWLSOH VFOHURVLV 06 6XVFHSWLELOLW\ZHLJKWHG LPDJLQJ6:,DW7DOORZVWKHLPDJLQJRIYHLQVDVVPDOODVPPLQGLDPHWHU 7KHSXUSRVHRIRXUVWXG\ZDVWKHLGHQWLÀFDWLRQRILQWUDOHVLRQDOFKDUDFWHULVWLFVRI YHLQVLQ06SDWLHQWV 0HWKRGV DQG 0DWHULDOV SDWLHQWV PHDQ DJHG \HDUV ZLWK UHODSVLQJ UHPLWWLQJ065506Q DQGVHFRQGDU\SURJUHVVLYH066306Q ZLWKDQ H[SDQGHGGLVDELOLW\VWDWXVVFDOH('66ZHUHLQFOXGHG7KH05SURWRFRODW 7 FRPSULVHG D )/$,5)6(VHTXHQFH DQG D 6:,VHTXHQFH 757( PV YR[HOVL]H[[PP7KHH[DPLQDWLRQZDVSHUIRUPHGDWEDVHOLQHDQG \HDUDIWHU'DWDIURPSDWLHQWV5506Q 6306Q FRXOGÀQDOO\EHDQDO\VHG SODTXHVDQGLWVFRUUHVSRQGLQJQRUPDODSSHDULQJZKLWHPDWWHU1$:0ZHUH DVVHVVHGIRUOHVLRQYROXPHDQGYHLQYROXPHZLWKD'6RIWZDUH 5HVXOWV3DWLHQWVZLWKDUHODSVLQJUHPLWWLQJFRXUVHVKRZHGDPHDQLQWUDOHVLRQDO YHLQGHQVLW\ RI SDWLHQWV ZLWK VHFRQGDU\SURJUHVVLYH PXOWLSOH VFOHURVLV D PHDQ RI 7KLV LQGLFDWHV D WZRIROG KLJKHU YHLQGHQVLW\ LQ 5506SODTXHV 9HLQGHQVLW\ LQ 1$:0 FRQVWDQWO\ DFFRXQWHG IRU D PHDQ RI LQ SDWLHQWVZLWK5506DQG6306&RPSDUHGWRWKHFRUUHVSRQGLQJ1$:05506 SODTXHVVKRZDWKUHHIROGKLJKHUYHLQGHQVLW\DQG6306SODTXHVDWZRIROGKLJKHU YHLQGHQVLW\:HFRXOGIXUWKHUSUHFLVHO\GLVSOD\LQWUDOHVLRQDOVPDOOYHLQVSDUWLDOO\ VKRZLQJDVWUDLJKWOLQHGFRXUVH $GGLWLRQDOO\ZHFRXOGGHSLFWWKUHHQHZO\GHYHORSHG YHLQDVVRFLDWHG06SODTXHVZLWKLQ\HDU &RQFOXVLRQ3DWLHQWVZLWKDUHODSVLQJUHPLWWLQJFRXUVHRIPXOWLSOHVFOHURVLVUHSUH VHQWDKLJKHULQWUDOHVLRQDOYHLQGHQVLW\WKDQSDWLHQWVZLWKDVHFRQGDU\SURJUHVVLYH FRXUVHRIPXOWLSOHVFOHURVLV % 8OWUDKLJKÀHOG05,GHWHFWHGLURQDFFXPXODWLRQLQPXOWLSOHVFOHURVLV SODTXHVDSLORWVWXG\ 6*RHG$'DO%LDQFR**UDEQHU06FKHUQWKDQHU.9DVV+/DVVPDQQ 67UDWWQLJ9LHQQD$7VDELQHJRHG#PHGXQLZLHQDFDW 3XUSRVH)UHHLURQLVGLVFXVVHGWRFRQWULEXWHDVDQHXURWR[LFDJHQWWRQHXURLQ ÁDPPDWLRQDQGQHXURGHJHQHUDWLRQLQPXOWLSOHVFOHURVLV067KHSXUSRVHRIRXU VWXG\ZDVWRYLVXDOLVHDQGDQDO\VHIRFDOLURQDFFXPXODWLRQVZLWKLQ06SODTXHV DQGSHUIRUPDIROORZXSDIWHURQH\HDU 0HWKRGVDQG0DWHULDOVSDWLHQWVPHDQDJHG\HDUVZLWKUHODSVLQJUHPLWWLQJ 065506Q DQGVHFRQGDU\SURJUHVVLYH066306Q ZLWKDQ([SDQGHG 'LVDELOLW\6WDWXV6FDOH('66ZHUHH[DPLQHGRQD705VFDQQHU6LHPHQV +HDOWKFDUH(UODQJHQ*HUPDQ\DWEDVHOLQHDQG\HDUDIWHU7KHSURWRFROFRP SULVHGD)/$,5)6(VHTXHQFHDQGD6:,VHTXHQFH757(PVYR[HOVL]H [[PP4XDOLWDWLYHDQDO\VLVZDVSHUIRUPHGWRDVVHVVLURQDFFXPXODWLRQ LQ06SODTXHVZLWKLQ\HDU 5HVXOWV,QRXWRISDWLHQWVDWRWDORILURQORDGHG06SODTXHVZHUHGHWHFWHG ZLWKLQ\HDU,URQDFFXPXODWLRQVZHUHRQO\REVHUYHGLQSDWLHQWVZLWK5506 ,Q5506SDWLHQWVLURQFRQWDLQLQJOHVLRQVGRPLQDWHGOHVLRQVKRZHGLQFUHDVHG LURQORDGOHVLRQUHGXFHGLURQORDGDQGOHVLRQDFKDQJHGVKDSH,QOHVLRQV LQLWLDOO\LVRODWHGLURQGHSRVLWVDWWDLQHGFRQÁXHQFHDQGIXUWKHUOHVLRQVVKRZHGQR FKDQJHRILURQDFFXPXODWLRQ)XUWKHUPRUHWKHVL]HRI06SODTXHVZLWKLQFUHDVHG RUFRQÁXHQWLURQDFFXPXODWLRQZDVUHGXFHG &RQFOXVLRQ,QWKLVSLORWVWXG\LURQDFFXPXODWLRQVZHUHGHWHFWHGLQSDWLHQWVZLWK UHODSVLQJUHPLWWLQJ PXOWLSOH VFOHURVLV DQG VKRZHG G\QDPLFV LQ VKDSH DQG VL]H ZLWKLQ\HDU 6FLHQWLILF6HVVLRQ $ 6&'()*+% 7KXUVGD\ (XURSHDQ&RQJUHVVRI 5DGLRORJ\ QXPEHURIRUGHUVRIYLVXDOLVHGELOLDU\WUHHEUDQFKHVZHUHUHFRUGHG$KHOSIXOQHVV VFRULQJRIJDGR[HWLFDFLGHQKDQFHG7Z05&ZDVSHUIRUPHGLQFRQVHQVXV 5HVXOWV,PDJHTXDOLW\RI7Z05&DQG7Z05&3ZDVJUDGHGJRRGWRH[FHOOHQW LQDOOFDVHV7KHUHZHUHDGYDQWDJHVIRUERWK7Z05&IXQFWLRQDOLQIRUPDWLRQ OHVVDUWHIDFWGHJUDGDWLRQDQG7Z05&3KLJKHURUGHURIYLVXDOLVHGEUDQFKHV EHWWHUEUDQFKGHSLFWLRQ%RWKUHDGHUVVKRZHGSUHIHUHQFHIRU7Z05&3UHDGHU UHDGHUKRZHYHULQWKHPDMRULW\RIFDVHVFDVHV ERWKUHDGHUVDJUHHGWKDWJDGR[HWLFDFLGHQKDQFHG7Z05&ZDVKHOSIXO &RQFOXVLRQ*DGR[HWLFDFLGHQKDQFHG7Z05&LVFRPSOHPHQWDU\WREXWVKRXOG QRWUHSODFH7Z05&3 7Z05&LVDXVHIXODGMXQFWIRUPRUSKRORJLFHYDOXDWLRQ DQGSURYLGHVDGGLWLRQDOGLDJQRVWLFLQIRUPDWLRQ % %LOLDU\HQWHULFDQDVWRPRVHVXVHIXOQHVVRI*G(2%'73$HQKDQFHG 05FKRODQJLRJUDSK\ 3 %RUDVFKL) 'RQDWL66DOHPL5*LJRQL&%DUWROR]]L) )DODVFKL3LVD,7 SERUDVFKL#GRPHGXQLSLLW 3XUSRVH7 RDVVHVVWKHXVHIXOQHVVRI*G(2%'73$HQKDQFHG05FKRODQJLRJ UDSK\05&LQSDWLHQWVZLWKELOLDU\HQWHULFDQDVWRPRVHV 0HWKRGVDQG0DWHULDOV)RUW\IRXUSDWLHQWVZLWKSUHH[LVWLQJELOLDU\HQWHULFDQDV WRPRVHV DQG FOLQLFDOHFKRJUDSKLFDO VXVSHFW RI ELOLDU\ SDWKRORJ\ XQGHUZHQW 05 LPDJLQJDW7GHYLFH$IWHUDFTXLVLWLRQRI7Z7ZLPDJHVFRQYHQWLRQDO05& ZDVSHUIRUPHGWKURXJKWKLQVODE')5)6(DQGWKLFNVODE66)6(7ZVHTXHQFHV ,QHDFKSDWLHQWD'IDWVXSSUHVVHG/$9$VHTXHQFHZDVSHUIRUPHGEHIRUHDQG PLQXWHVDIWHULQWUDYHQRXVDGPLQLVWUDWLRQRIPO*G(2%'73$ 3ULPRYLVW%D\HU+HDOWK&DUHIROORZHGE\LQMHFWLRQRILVRWRQLFVDOLQHPO 7ZVHTXHQFHZDVDOVRREWDLQHGDIWHUPLQXWHVLQFDVHV9LVXDOLVD WLRQRIHDFKVHJPHQWRIWKHELOLDU\WUHHDQGDQDVWRPRWLFERZHOZDVJUDGHGE\WZR UDGLRORJLVWV LQ FRQIHUHQFH RQ D IRXUSRLQW VFDOH DEVHQW SRRU JRRG H[FHOOHQW$OOVHJPHQWVZHUHDVVHVVHGIRUWKHSUHVHQFHRIGXFWDOGLODWDWLRQVWULF WXUHELOHOHDNDJHLQWUDGXFWDOÀOOLQJGHIHFWVDQGRWKHUDEQRUPDOLWLHV05,ÀQGLQJV ZHUHFRPSDUHGWRVXUJLFDOÀQGLQJVZKHQVFKHGXOHGDQGRUDVL[PRQWKODVWLQJ FOLQLFDOUDGLRORJLFDOIROORZXS 5HVXOWV*G(2%'73$HQKDQFHG05&VLJQLÀFDQWO\RXWSHUIRUPHGFRQYHQWLRQDO 05&LQWKHYLVXDOLVDWLRQRIWKHH[WUDKHSDWLFELOLDU\V\VWHPDQGDQDVWRPRWLFUHJLRQ DQGLQWKHDVVHVVPHQWRIDQDVWRPRWLFVWULFWXUHVDQGSQHXPRELOLDS7KH JUDGLQJ RI YLVXDOLVDWLRQ DQG GHSLFWLRQ RI GLODWLRQ RI WKH VHFRQG DQG WKLUG RUGHU LQWUDKHSDWLF ELOH GXFWV ZDV VLJQLÀFDQWO\ VXSHULRU RQ 7Z 05& S 1R VLJQLÀFDQWGLIIHUHQFHZDVLGHQWLÀHGEHWZHHQWKHWZRWHFKQLTXHVLQWKHGHWHFWLRQ RIELOLDU\VWRQHV &RQFOXVLRQ&RQWUDVWHQKDQFHG05&XVLQJ*G(2%'73$FDQLPSURYHWKHGL DJQRVWLFSHUIRUPDQFHRIFRQYHQWLRQDO7Z05&LQWKHSRVWRSHUDWLYHDVVHVVPHQW RI ELOLDU\HQWHULF DQDVWRPRVHV VLQFH LW SURYLGHV ERWK DQDWRPLFDO DQG IXQFWLRQDO LQIRUPDWLRQRIWKHELOLDU\WUDFW % &KDUDFWHULVDWLRQDQGVWDJLQJRIKLODUFKRODQJLRFDUFLQRPD.ODWVNLQ 7XPRXUHYDOXDWLRQRIWKHKHSDWRF\WHVSHFLÀFFRQWUDVWDJHQW JDGR[HWDWHGLVRGLXP .,5LQJH +%HNWDV%3 5LQJH3 -2SKHUN $5HLFKHOW) :DFNHU-/RW]%&0H\HU+DQQRYHU'( *|WWLQJHQ'(ULQJHNULVWLQD#PKKDQQRYHUGH 3XUSRVH7 RDVVHVVWKHYDOXHRIJDGR[HWDWHGLVRGLXPIRUFKDUDFWHULVDWLRQDQG VWDJLQJRIKLODUFKRODQJLRFDUFLQRPDK&&& 0HWKRGVDQG0DWHULDOV7KLVSURVSHFWLYH+,3$$FRPSOLDQWVWXG\ZDV,5%DS SURYHGSDWLHQWVPDOHVIHPDOHV\ZLWKFOLQLFDOVXVSLFLRQRIFHQWUDO ELOHGXFWVWHQRVLV&%'6XQGHUZHQWSUHRSHUDWLYH05,,PDJHVZHUHDVVHVVHG IRUDHWLRORJ\RI&%'6$PRGLÀHG%LVPXWKFODVVLÀFDWLRQZDVDSSOLHGIRUWXPRXU H[WHQVLRQ7 RHVWLPDWHWKHYDOXHRIKHSDWRF\WHSKDVHLPDJHVRQO\7ZLPDJHV 7RQO\SRVWFRQWUDVWLPDJHV&0RUERWKLPDJHGDWDVHWVZHUHDVVHVVHGLQ WKUHH UHDGLQJ VHVVLRQV E\ UHDGHUV WZR ZHHNV LQWHUYDO$JUHHPHQW RI HDFK UHDGLQJVHVVLRQZLWKWKHLQWUDRSHUDWLYHÀQGLQJVLQWHUPVRI&%'6DHWLRORJ\DQG WXPRXUH[WHQVLRQZHLJKWHGNDSSDVWDWLVWLFZDVFDOFXODWHG 5HVXOWV &%'6 ZDV FDXVHG E\ K&&& Q JDOOEODGGHU FDUFLQRPD Q DQG SDQFUHDWLFFDUFLQRPDQ &KDUDFWHULVDWLRQRI&%'6DHWLRORJ\ZDVFRUUHFWE\ XVHRI7ZLPDJHVLQDQGE\XVHRI&0LPDJHVLQDQG E\FRPELQDWLRQRIERWKLQDQG$JUHHPHQWFRPSDULQJUHDG LQJVHVVLRQVDQGLQWUDRSHUDWLYHÀQGLQJVUHJDUGLQJWXPRXUH[WHQVLRQZDVIDLUXSWR PRGHUDWHѣ 7&0ERWKDVDUHVXOWRIFRPPRQXQGHUVWDJ LQJ,QWHUREVHUYHUDJUHHPHQWIRUWXPRXUH[WHQVLRQZDVIDLUѣUDQJH WLRQDODQLVRWURS\)$YDOXHVZHUHREWDLQHGIURPZKLWHPDWWHUWUDFWVLQFOXGLQJ SURMHFWLRQFRPPLVVXUDODQGDVVRFLDWLRQÀEUHV 5HVXOWV&RPSDUHGWRFRQWUROV6/(SDWLHQWVVKRZHGVLJQLÀFDQWO\SORZHU 1$$&UUDWLRVZLWKLQERWKHYDOXDWHGUHJLRQVORZHUU&%9YDOXHVRQO\ZLWKLQULJKW SDULHWDOFRUWH[DQGGHFUHDVHGYDOXHVRI)$LQPXOWLSOHZKLWHPDWWHUWUDFWVULJKW PLGGOH FHUHEHOODU SHGXQFOH JHQX RI FRUSXV FDOORVXP OHIW VXSHULRU DQG LQIHULRU ORQJLWXGLQDOIDVFLFOHVOHIWLQIHULRUIURQWRRFFLSLWDOIDVFLFOHDQGERWKFLQJXOD &RQFOXVLRQ7KHUHVXOWVRIDGYDQFHG05WHFKQLTXHVUHÁHFWQHXURQDOORVVZLWKLQ JUH\DQGZKLWHPDWWHUDQGGLVLQWHJULW\ZLWKLQPXOWLSOHZKLWHPDWWHUWUDFWVLQSDWLHQWV ZLWK6/(056DQG'7,VHHPWREHHVSHFLDOO\SURPLVLQJQRQLQYDVLYHQHXURLPDJ LQJELRPDUNHUVIRUDVVHVVLQJWKHVHYHULW\RIPLFURVWUXFWXUDOFKDQJHVLQSDWLHQWV ZLWK6/( % (DUO\DQGSURJUHVVLYHVLJQVRQ05,LQSDWLHQWVZLWKSURJUHVVLYH PXOWLIRFDOOHXNRHQFHSKDORSDWK\ 06DNDL.1DNDQLVKL< 7 RPLWD< <DPDVKLWD..XUL\DPD2VDND-3 [LDRKXPHL[X#JPDLOFRP 3XUSRVH7 RLOOXVWUDWHHDUO\DQGSURJUHVVLYHVLJQVRQ05LPDJHVLQSDWLHQWVZLWK SURJUHVVLYHPXOWLIRFDOOHXNRHQFHSKDORSDWK\30/ 0HWKRGVDQG0DWHULDOV05LPDJHVRIVHYHQSDWLHQWVZLWK30/ZHUHUHYLHZHG 7KHGLDJQRVLVRI30/ZDVHVWDEOLVKHGE\FOLQLFDOODERUDWRU\&6)3&5IRU-& YLUXVDQG05LPDJHVLQDOOSDWLHQWV2QHSDWLHQWZDVDOVRXQGHUZHQWEUDLQELRSV\ $OOSDWLHQWVXQGHUZHQWUHSHDWHG05H[DPLQDWLRQVRQRUWHVOD05XQLWVIRU WKHLQLWLDOGLDJQRVWLFZRUNXSDQGWUHDWPHQWFRQWURO 5HVXOWV ,Q DOO SDWLHQWV 05 LPDJHV VKRZHG ZRUVHQLQJ RI ÀQGLQJV 'XUDWLRQ RI IROORZXSVWXGLHVZDVWRPRQWKV1HZHUPDUJLQVLQVSUHDGLQJOHVLRQVVKRZHG KHWHURJHQHRXVPLOGK\SHULQWHQVHZLWKQXPHURXVGRWVRIVHYHUHK\SHULQWHQVHRQ 7ZHLJKWHGLPDJHV´0LON\ZD\DSSHDUDQFHµKHWHURJHQHRXVPLOGVOLJKWK\SRLQ WHQVLW\RQ7ZHLJKWHGLPDJHVDQGK\SHULQWHVHRQGLIIXVLRQZHLJKWHGLPDJHVZLWK PLOGGHFUHDVHGRULQFUHDVHGGLIIXVLRQ:LWKWKHSURJUHVVVLJQDOLQWHQVLW\RIWKHVH OHVLRQVJUDGXDOO\LQFUHDVHGRQ7ZHLJKWHGLPDJHVDQGLQYHUVHO\GHFUHDVHGRQ7 ZHLJKWHGLPDJHVZLWKLQFUHDVHRIGLIIXVLRQÀQDOO\QHDU&6)LQWHQVLW\ZLWKDWURSK\ 7KHVHÀQGLQJVVHHPHGWRFRUUHVSRQGWKHSDWKRORJLFDOÀQGLQJVRIQXPHURXVIRFL ZLWKP\HOLQDQGD[RQORVVWKDWPHUJHWRJHWKHUWREHODUJHGHP\HOLQDWLQJOHVLRQ DQGÀQDOO\WREHVHYHUHDWURSK\DQGFDYLW\ &RQFOXVLRQ ´0LON\ ZD\ DSSHDUDQFHµ RQ 7ZHLJKWHG LPDJHV DQG K\SHULQWHVH DUHDVRQGLIIXVLRQZHLJKWHGLPDJHVPD\EHHDUO\DQGSURJUHVVLYHVLJQVLQSDWLHQWV ZLWK30/ 5RRP,. $EGRPLQDO9LVFHUD 66E %LOLDU\WUDFW 0RGHUDWRUV 7'HQHFNH%HUOLQ'( **.DUPD]DQRYVN\0RVFRZ58 % *DGR[HWLFDFLGHQKDQFHG7ZHLJKWHG05FKRODQJLRJUDSK\LQ SULPDU\VFOHURVLQJFKRODQJLWLV $)U\GU\FKRZLF] $5-HG\QDN) .HOF]6.1DJOH6%5HHGHU 0DGLVRQ:,86/EHFN'(0DGLVRQ:,86DOH[IU\GU\FKRZLF]#XNVKGH 3XUSRVH 7 R GHWHUPLQH WKH YDOXH RI JDGR[HWLF DFLGHQKDQFHG GLPHQVLRQDO 7ZHLJKWHG05FKRODQJLRJUDSK\7Z05&LQFRPSDULVRQZLWKGLPHQVLRQDO 7ZHLJKWHG05FKRODQJLRSDQFUHDWLFRJUDSK\7Z05&3LQSDWLHQWVZLWKSULPDU\ VFOHURVLQJFKRODQJLWLV36& 0HWKRGVDQG0DWHULDOV:HUHWURVSHFWLYHO\HYDOXDWHG05H[DPVLQSDWLHQWV \HDUVNJNJPHQZRPHQ6FDQV ZHUHSHUIRUPHGDW7ZLWKDQHLJKWFKDQQHOSKDVHGDUUD\WRUVRFRLO'7Z 05&3ZDVSHUIRUPHGZLWKDVSDWLDOUHVROXWLRQRI[[PPLQWHUSRODWHG WR[[PPWKURXJK]HURÀOOLQJ7Z05&ZDVDFKLHYHGPLQDIWHU LQMHFWLRQRIPPRONJJDGR[HWLFZLWKDQDYLJDWRUJDWHG'VSRLOHGJUDGLHQWUH FDOOHGHFKR63*5VHTXHQFHZLWKLQWHUPLWWHQWVSHFWUDOO\VHOHFWLYHSDUWLDOLQYHUVLRQ UHFRYHU\IDWVXSSUHVVLRQ/$9$7KHVSDWLDOUHVROXWLRQRI[[PPZDV LQWHUSRODWHGWR[[PP,PDJHTXDOLW\ZDVHYDOXDWHGLQDEOLQGHGIDVKLRQ UHJDUGLQJLPDJHFRQWUDVWLPDJHTXDOLW\GHJUDGDWLRQGXHWRDUWHIDFWVDQGYLVXDOLVD WLRQTXDOLW\RIGXFWVE\WZRDEGRPLQDOUDGLRORJLVWV5HDGHUSUHIHUHQFHWRZDUGVDQG 6FLHQWLILF6HVVLRQ 6 &$' ( ) *+% (XURSHDQ&RQJUHVVRI 5DGLRORJ\ 7 05 FKRODQJLRJUDSK\ ZHUH UHWURVSHFWLYHO\ HYDOXDWHG &RQYHQWLRQDO 7 ZHLJKWHG05FKRODQJLRJUDSK\DQG*DGR[HWDWHHQKDQFHG05FKRODQJLRJUDSK\LQ GHOD\HGKHSDWRELOLDU\SKDVHLQFRURQDODQGD[LDOSODQHVZHUHVHSDUDWHO\DVVHVVHG DQG WKHQ FRPSDUHG WR(5&3 7KH SUHVHQFH RISHULSKHUDO DQG FHQWUDO VWHQRVLV GLODWDWLRQ DQG FRQWRXU LUUHJXODULWLHV IRU FKDUDFWHULVDWLRQ RI 36& ZDV HYDOXDWHG XVLQJDSRLQWVFRULQJV\VWHP 5HVXOWV7KHVWXG\FRKRUWFRQVLVWHGRISDWLHQWVIHPDOHVZLWKDPHDQDJH RI\HDUVUDQJH\HDUV0HDQWLPHEHWZHHQ(5&3DQG05LPDJLQJ ZDVGD\V,QSDWLHQWVZLWK36&IHDWXUHVGHOD\HGKHSDWRELOLDU\SKDVHVKRZHG DQ H[FHOOHQW FRUUHODWLRQ ZLWK (5&3 ѣ ѩ ZKHUHDV FRUUHODWLRQ RI 7ZHLJKWHG05ZDVRQO\PRGHUDWHѣ ѩ )XUWKHUPRUHGHOD\HG KHSDWRELOLDU\ SKDVH GHPRQVWUDWHG D VWDWLVWLFDOO\ VLJQLÀFDQW EHWWHU GHWHFWLRQ RI REVWUXFWLYHFHQWUDOVWHQRVLVLQFRPSDULVRQWRFRQYHQWLRQDO05&3S 7KH FRUUHVSRQGLQJ$8&VZHUHYHUVXVLQFRPSDULVRQZLWK(5&3 &RQFOXVLRQ'HOD\HGKHSDWRELOLDU\SKDVHRI*DGR[HWDWHHQKDQFHG05LQFUHDVHV DFFXUDF\ IRU HDUO\ GHSLFWLRQ RI 36& IHDWXUHV DQG SURYLGHV DGGLWLRQDO IXQFWLRQDO LQIRUPDWLRQRIELOHGXFWVZKLFKDOORZVDSSURSULDWHWUHDWPHQWRI36&DVVRFLDWHG FOLQLFDOO\VLJQLÀFDQWFHQWUDOVWHQRVLV % 5ROHRI*'(2%'73$HQKDQFHGPDJQHWLFUHVRQDQFH FKRODQJLRJUDSK\05&LQWKHHYDOXDWLRQRIELOLDU\VWULFWXUHVDIWHU RUWKRWRSLFOLYHUWUDQVSODQWDWLRQ2/7SUHOLPLQDU\UHVXOWV $3HFFKL0*LEHUWLQL0'H6DQWLV) 'L%HQHGHWWR3 7 RUULFHOOL0RGHQD,7 DQQDBSHFFKL#OLEHURLW 3XUSRVH7 RGHVFULEHWKHUROHRI*'(2%'73$HQKDQFHGPDJQHWLFUHVRQDQFH FKRODQJLRJUDSK\05&LQWKHHYDOXDWLRQRIELOLDU\VWULFWXUHVLQOLYHUWUDQVSODQWHG SDWLHQWV 0HWKRGV DQG 0DWHULDOV %HWZHHQ -XO\ DQG 6HSWHPEHU OLYHU WUDQVSODQWHGSDWLHQWVZLWKFOLQLFDOVXVSHFWHGELOLDU\VWULFWXUHVZHUHHYDOXDWHGZLWK *'(2%'73$HQKDQFHG 05&$[LDO DQG FRURQDO 7Z DQG 7Z VHTXHQFHV UDGLDO'66)6(FRURQDO'7Z)6(VHTXHQFHVZHUHDFTXLUHGLQSUHFRQWUDVWR JUDSKLFSKDVH7Z'*5(VHTXHQFHVZHUHSHUIRUPHGEHIRUHDQGDIWHULQMHFWLRQ RI*'(2%'73$PONJLQFOXGLQJG\QDPLFDQGGHOD\HGKHSDWRELOLDU\SKDVHV DFTXLUHGPLQXWHVDIWHU*'(2%'73$DGPLQLVWUDWLRQ'LDJQRVWLFFRQ ÀUPDWLRQZDVREWDLQHGZLWKKHSDWRELOLDU\VFLQWLJUDSK\+%6DQGSHUFXWDQHRXV WUDQVKHSDWLFFKRODQJLRJUDSK\37& 5HVXOWV,QDOOFDVHV*'(2%'73$HQKDQFHG05&GHSLFWHGELOLDU\VWULFWXUHV LQWUDKHSDWLFRQHELOLRHQWHULFDQDVWRPRWLFVWULFWXUH $W*'(2%'73$HQKDQFHG 05&ZKHQLQWUDKHSDWLFVWULFWXUHVZHUHDVVRFLDWHGZLWKDUHDVRIOLYHUSDUHQFK\PD ZLWKRXW*'(2%'73$H[FUHWLRQIRUGLPLQLVKHGKHSDWRELOLDU\IXQFWLRQFDXVHGE\ ELOLDU\REVWUXFWLRQVWULFWXUHVZHUHFRQVLGHUHGUHOHYDQW,QRQHFDVHGLODWDWLRQRI XSVWUHDP ELOLDU\ WUHH DQG ODFN RI *'(2%'73$ H[FUHWLRQ LQWR WKH ELOLRHQWHULF DQDVWRPRVHV ZDV DVVRFLDWHG ZLWK ELOLRHQWHULF DQDVWRPRWLF VWULFWXUH +%6 FRQ ÀUPHG DUHDV RI OLYHU SDUHQFK\PD ZLWK XQKRPRJHQHRXV DQG GHOD\HGXSWDNH RI UDGLRWUDFHUDVGHSLFWHGDW05&$OOLQWUDKHSDWLFVWULFWXUHVGHWHFWHGDW*'(2% '73$HQKDQFHG 05& ZHUH FRQÀUPHG DW 37& 7KUHH LQWUDKHSDWLF VWULFWXUHV DVVRFLDWHGZLWKSDUHQFK\PDODUHDVRIQR*'(2%'73$H[FUHWLRQZHUHWUHDWHG ZLWK37&ZLWKQRUPDOLVDWLRQRIELOLDU\WUHH2QHELOLRHQWHULFDQDVWRPRWLFVWULFWXUH UHFHLYHGQRFRQÀUPDWLRQDW+%6 &RQFOXVLRQ*'(2%'73$HQKDQFHG05&LVDXVHIXOWHFKQLTXHLQWKHHYDOXD WLRQRIELOLDU\VWULFWXUHVDIWHU2/7DVLWDOORZVWKHVHOHFWLRQRIVWULFWXUHVDVVRFLDWHG ZLWKDEQRUPDOSDUHQFK\PDOIXQFWLRQ % 8OWUDVRXQGVFRULQJV\VWHPIRUSUHRSHUDWLYHHYDOXDWLRQRI FKROHOLWKLDVLVKRZDFFXUDWHLWLVIRUSUHRSHUDWLYHSUHGLFWLRQRI GLIÀFXOWODSDURVFRSLFFKROHF\VWHFWRP\ 0$6LGGLTXL,$KPDG6$$5L]YL(8OODK$OLJDUK,1 GUD]IDUVLGGLTXL#JPDLOFRP 3XUSRVH/DSDURVFRSLFFKROHF\VWHFWRP\/&KDVEHFRPHWUHDWPHQWRIFKRLFH IRU FKROHOLWKLDVLV EXW WKHUH DUH VWLOO VRPH SDWLHQWV UHTXLULQJ FRQYHUVLRQ WR RSHQ FKROHF\VWHFWRP\ 2& PDLQO\ EHFDXVH RI WHFKQLFDO GLIÀFXOW\ 2XU DLP ZDV WR GHYHORSDVWDQGDUGLVHGXOWUDVRXQGEDVHGVFRULQJV\VWHPIRUSUHRSHUDWLYHSUHGLF WLRQRIGLIÀFXOW/& 0HWKRGVDQG0DWHULDOV8OWUDVRXQGÀQGLQJVRISDWLHQWVZKRXQGHUZHQW/& ZHUHUHWURVSHFWLYHO\UHYLHZHG)RXUSDUDPHWHUVWLPHWDNHQELOLDU\OHDNDJHLQMXU\ WRGXFWRUDUWHU\DQGFRQYHUVLRQWR2&ZHUHDQDO\VHGWRFODVVLI\/&DVHDV\RU GLIÀFXOW8OWUDVRXQGÀQGLQJVZHUHDQDO\VHGZLWKHPSKDVLVRQ*%ZDOOWKLFNQHVV SHULFKROHF\VWLFFROOHFWLRQGLVWHQGHG*%LPSDFWHGVWRQHVPXOWLSOHVWRQHV&%' GLDPHWHUDQGOLYHUVL]H $VFRUHRIWZRZDVDVVLJQHGIRUWKHSUHVHQFHRIHDFKÀQGLQJ ZLWKDWRWDOVFRUHRI$FXWRIIYDOXHRIZDVWDNHQWRSUHGLFWHDV\DQGGLIÀFXOW &RQFOXVLRQ %\ PHDQV RI FRPELQHG HYDOXDWLRQ RI 7Z VHTXHQFHV DQG SRVW FRQWUDVW LPDJHV DIWHU LQMHFWLRQ RI JDGR[HWDWH GLVRGLXP D PRUHUHOLDEOH FKDUDF WHULVDWLRQRI&%'6ZDVSRVVLEOH(YHQWKRXJK&%'6WHQGHGWREHXQGHUVWDJHG EHIRUHDVZHOODVDIWHUFRQWUDVWLQMHFWLRQDVVHVVPHQWRIH[DFWWXPRXUH[WHQVLRQ ZDVLPSURYHGE\FRQWUDVWDGPLQLVWUDWLRQ % 5HODWLRQVKLSEHWZHHQELOLDU\FRPSOLFDWLRQVDQGKHSDWLFDUWHULDO EXIIHUUHVSRQVHDIWHUOLYHUWUDQVSODQWDWLRQEDVHGRQXOWUDVRXQGGDWD $'RURV(+DUWPDQQ$1HPHWK9.R]PD$3 'HDN6.XGUQRYD -)D]DNDV/.RERUL%XGDSHVW+8GRUDWWLOD#\DKRRFRP 3XUSRVH %LOLDU\ VWULFWXUH DQG OHDNDJH DUH FRPPRQ FRPSOLFDWLRQV DIWHU OLYHU WUDQVSODQWDWLRQV/72QHRIWKHPDLQFDXVHLVDUWHULDOLVFKDHPLD7KHUHODWLRQVKLS EHWZHHQDUWHULDODQGSRUWDOYHLQÁRZKHSDWLFDUWHULDOEXIIHUUHVSRQVHFRQFHUQLQJ ODWHELOLDU\FRPSOLFDWLRQVDUHQRWIUHTXHQWO\DQDO\VHG 0HWKRGVDQG0DWHULDOVFRQVHFXWLYH/7 VLQWUDDQGSRVWRSHUDWLYHXOWUDVRXQG H[DPLQDWLRQV ZHUH UHWURVSHFWLYHO\ DQDO\VHG DQG FRPSDUHG ZLWK WKH RQH\HDU IROORZXSFOLQLFDOUHVXOWVIRFXVLQJRQELOLDU\VWULFWXUHVDQGOHDNDJH7KHXOWUDVRXQG GDWDZHUHFRPSRVHGRIWKHURXWLQHFRQWUROVDUWHULDOUHVLVWLYHLQGH[5,KHSDWLF YHLQYHORFLW\FXUYHVDQGSRUWDOYHLQYHORFLWLHV 5HVXOWV$OWRJHWKHUPLQRUV\PSWRPIUHHDQGPDMRUWUHDWPHQWUHTXLUHGDQG SHUIRUPHGELOLDU\FRPSOLFDWLRQVZHUHGLDJQRVHG,QFDVHVORZ5,VXJJHVWLQJ DUWHULDOVWHQRVLVZHUHQRWLFHGZKLOHWKHUHPDLQLQJFDVHVVKRZHGFRQVHTXHQWKLJK !FPVSRUWDOYHQRXVYHORFLWLHVDQG5,YDOXHV!2QWKHFRQWUDU\FDVHV ZHUHIRXQGZLWKWKHVDPHÁRZSDWWHUQVZLWKRXWDQ\VLJQVRIELOLDU\FRPSOLFDWLRQV &RQFOXVLRQ7KHKLJKSRUWDOYHORFLW\DQGKLJK5,PD\RQO\URXJKO\UHSUHVHQWWKH KHSDWLF DUWHULDO EXIIHU UHVSRQVH KRZHYHU WKHVH YDOXHV DUH PHDVXUHG URXWLQHO\ DIWHU/7 +DOIRIRXUSDWLHQWVVKRZHGWKLVÁRZFRPELQDWLRQEXWRQO\ GHYHORSHGELOLDU\FRPSOLFDWLRQVRIDQ\VHYHULW\7KHURXWLQHO\PHDVXUHGSDUDPHWHUV DUHQRWVXIÀFLHQWHQRXJKWRSUHGLFWODWHELOLDU\FRPSOLFDWLRQVDOWKRXJKPHGLFDO VXUJLFDORULQWHUYHQWLRQDOWUHDWPHQWRIH[FHVVLYHO\KLJKSRUWDOÁRZFRPELQHGZLWK KLJK5,DUWHULDOÁRZPD\EHEHQHÀFLDO7KHGHFLVLRQRISRWHQWLDOWUHDWPHQWVKRXOG EHPDGHLQGLYLGXDOO\ % 6WHDG\VWDWHIUHHSUHFHVVLRQVHTXHQFHVFDQDGGYDOXDEOHGLDJQRVWLF GHWDLOVWRFRQYHQWLRQDO05FKRODQJLRJUDSK\ $,R]]HOOL/2QFLQL0DFHUDWD,7DLR]]HOOL#VLUPRUJ 3XUSRVH$GGLQJ D VWHDG\VWDWH IUHH SUHFHVVLRQ VHTXHQFH 66)3 WR WKH FRQ YHQWLRQDO'7ZHLJKWHGPDJQHWLFUHVRQDQFHFKRODQJLRJUDSK\VHTXHQFH'& SURYLGHVDGGLWLRQDOGLDJQRVWLFGDWD 0HWKRGVDQG0DWHULDOV,QFRQVHFXWLYHSDWLHQWVWKDWXQGHUZHQW05FKRODQ JLRJUDSK\H[DPLQDWLRQDORQJ\HDUVIRUVXVSHFWHGELOLDU\REVWUXFWLRQRUELOLDU\ GLVHDVHVUHFHLYHGQRQEUHDWKKROGFRURQDOREOLTXH66)3VHTXHQFHVDIWHUWKH FRQYHQWLRQDO'&VHTXHQFH7KH66)3VHTXHQFHVLQDOOWKHH[DPLQDWLRQVZHUH UHWURVSHFWLYHO\H[DPLQHGE\RQHH[SHUWUHDGHUWRFRQÀUPWKH'&VHTXHQFHGLDJ QRVLVDQGVHDUFKIRUDGGLWLRQDOGHWDLOVWKDWFRXOGFRQWULEXWHWRWKHPDLQGLDJQRVLV 5HVXOWV,QDOOWKHFDVHVWKHEUHDWKLQJDUWHIDFWVZHUHQRWLQÁXHQFLQJWKH GLDJQRVWLFTXDOLW\RIWKHVHTXHQFHV,QFDVHVWKH'&GLDJQRVLV ZDVFRQÀUPHGE\66)3 LQWKHUHPDLQLQJFDVHV66)3LGHQWLÀHG WKHFRUUHFWGLDJQRVLVWKDWZDVQRWFOHDUZLWK'&DORQH,QFDVHV DGGHGVRPHGHWDLOVWKDWZHUHQRWYLVLEOHLQWKH'& &RQFOXVLRQ66)3LVDXVHIXOVHTXHQFHWKDWFDQDGGGHWDLOVWRWKHFRQYHQWLRQDO '&VHTXHQFHGXHWREHWWHUUHVROXWLRQKLJKH[WUDOXPLQDODQGELOLDU\ZDOOGHWDLOV ORZHUVHQVLWLYLW\WREUHDWKLQJDUWHIDFWVDQGGRHVQRWDGGVLJQLÀFDQWWLPHWRFRPSOHWH WKHH[DPLQDWLRQ % )XQFWLRQDOLPDJLQJXVLQJ*DGR[HWDWHGLVRGLXPHQKDQFHG705 FKRODQJLRJUDSK\YHUVXVFRQYHQWLRQDO705FKRODQJLRJUDSK\ FRPSDULVRQZLWK(5&3LQSDWLHQWVZLWKSULPDU\VFOHURWLFFKRODQJLWLV 51RO]$:LEPHU+(LQVSLHOHU8$VHQEDXP60DJQDOGL 03HFN5DGRVDYOMHYLF$%D6VDODPDK9LHQQD$7 ULFKDUGQRO]#PHGXQLZLHQDFDW 3XUSRVH 7 R HYDOXDWH WKH GLDJQRVWLF YDOXH RI *DGR[HWDWH GLVRGLXPHQKDQFHG 705FKRODQJLRJUDSK\GHOD\HGKHSDWRELOLDU\SKDVHYHUVXVFRQYHQWLRQDO 705FKRODQJLRJUDSK\LQFRPSDULVRQWR(5&3LQSDWLHQWVZLWKSULPDU\VFOHURWLF FKRODQJLWLV 0HWKRGVDQG0DWHULDOVSDWLHQWVZLWKSULPDU\VFOHURWLFFKRODQJLWLVFRQÀUPHG E\(5&3 FOLQLFDOSUHVHQWDWLRQDQGODERUDWRU\WHVWVDVVWDQGDUGRIUHIHUHQFHZKR XQGHUZHQW*DGR[HWDWH3ULPRYLVW%D\HU+HDOWK&DUH%HUOLQ*HUPDQ\HQKDQFHG 6FLHQWLILF6HVVLRQ $ 6&'()*+% 7KXUVGD\ (XURSHDQ&RQJUHVVRI 5DGLRORJ\ 5RRP/0 0ROHFXODU,PDJLQJ 66 $GYDQFHGWRSLFV 0RGHUDWRUV ,&DUULy%DUFHORQD(6 7'+HQQLQJ&RORJQH'( % ,QYLYRPROHFXODU05,RIWKHHVWURJHQUHFHSWRULQEUHDVWFDQFHU XVLQJDWDUJHWHGFRQWUDVWDJHQW $3DLV 50DUJDOLW,(%LWRQ$<RVHSRYLWFK+'HJDQL5HKRYRW,/ 7 HO+DVRPHU,/$GLSDLV#ZHL]PDQQDFLO 3XUSRVH'HYHORSLQJLQYLYRPROHFXODU05,IRUGHWHFWLQJHVWURJHQUHFHSWRU(5 H[SUHVVLRQLQDEUHDVWFDQFHUDQLPDOPRGHOXWLOLVLQJDQRYHO(5WDUJHWHGFRQWUDVW DJHQW 0HWKRGVDQG0DWHULDOV(5WDUJHWHGFRQWUDVWDJHQWEDVHGRQS\ULGLQLXPWHWUD DFHWDH*G ,,, FKHODWH 37$*G FRQMXJDWHG WR ћHVWUDGLRO (37$*G ZDV V\QWKHVLVHGDQGFKDUDFWHULVHGLQVROXWLRQDQGLQVWDEO\WUDQVIHFWHGZLWK(5(5 SRVLWLYHDQGZLOGW\SH0'$0%(5QHJDWLYHKXPDQEUHDVWFDQFHUFHOOVDV ZHOODVWXPRXUVLPSODQWHGRUWKRWRSLFDOO\LQWKHVDPHPRXVH,QYLYRSKDUPDFRNL QHWLFVDQG'&(05,VWXGLHVZHUHFRQGXFWHGRQ7VFDQQHU,PDJHSURFHVVLQJ LQFOXGHGPRGHOEDVHGDQGPRGHOIUHHDQDO\VHV 5HVXOWV7KHDIÀQLW\RI(37$*GWR(5ZDVIRXQGWREHLQWKHPLFURPRODUUDQJH 7KH7UHOD[LYLW\LQVROXWLRQZDVP0VDQGLQFUHDVHGWRP0V LQ(5SRVLWLYHEUHDVWFDQFHUFHOOV,QYLYR'&(05,XVLQJDORZGRVHRI(37$*G PPRONJGHPRQVWUDWHGKLJKHQKDQFHPHQWLQ(5SRVLWLYHEUHDVWFDQFHU WXPRXUVDVFRPSDUHGWRWKHHQKDQFHPHQWLQ(5QHJDWLYHWXPRXUVDQGLQQRUPDO PXVFOHWLVVXH,QFRQWUDVWERWKWXPRXUVVKRZHGVLPLODUHQKDQFHPHQWDQGKHQFH YDVFXODUSHUIXVLRQLQ'&(RIQRQWDUJHWHGGLIIXVLEOHFRQWUDVWDJHQW*G'73$DQG 37$*G)XUWKHUPRUHVSHFLÀFLQWHUDFWLRQRI(37$*GZLWK(5ZDVYDOLGDWHGE\ LQYLYRFRPSHWLWLRQ'&(05,H[SHULPHQWVZLWKWDPR[LIHQ &RQFOXVLRQ7KHUHVXOWVLQWKHEUHDVWFDQFHUDQLPDOPRGHOSURYLGHDSURRIRISULQ FLSOHRIWKHDELOLW\RI(37$*GWREHWDUJHWHGLQYLYRWR(5DQGLGHQWLI\(5SRVLWLYH WXPRXUV,QDGGLWLRQWKHVHUHVXOWVSURYLGHDEDVLVIRUWKHFOLQLFDOWUDQVODWLRQDVD PHDQVIRUGHWHFWLQJORFDOLVLQJDQGPRQLWRULQJ(5QRQLQYDVLYHO\ % 3(7LPDJLQJRIWKHUDS\LQGXFHGSURVWDWHFDQFHUFHOOGHDWKE\ WDUJHWLQJWKHLQWHUQDOHSLWRSHRISURVWDWHVSHFLÀFPHPEUDQHDQWLJHQ $5XJJLHUR-3 +ROODQG7 +XGROLQ-6/HZLV-*ULPP5RWWHUGDP1/ 1HZ<RUN1<86DUXJJLHUR#HUDVPXVPFQO 3XUSRVH:HUHSRUWWKHSUHSDUDWLRQDQGXVHRI=UGHVIHUULR[DPLQH%')2 ( D QRYHO =UODEHOHG PRQRFORQDO DQWLERG\ P$E FRQVWUXFWIRU WDUJHWHG LPPXQRSRVLWURQ HPLVVLRQ WRPRJUDSK\ RI SURVWDWHVSHFLÀF PHPEUDQH DQWLJHQ 360$DSURWRW\SLFDOFHOOVXUIDFHPDUNHUKLJKO\RYHUH[SUHVVHGLQSURVWDWHFDQFHU 3&:HSUHVHQWDQDSSURDFKWRPRQLWRU3&WKHUDS\XVLQJWKH=U')2(DV DPDUNHURIUHVSRQVH(UHFRJQLVHVDQLQWUDFHOOXODUHSLWRSHRI360$DQGWKXV FDQRQO\ELQGLWVFRJQDWHDQWLJHQLFHSLWRSHZKHQWKHFHOOPHPEUDQHLVGLVUXSWHG DVLQGHDGRUG\LQJFHOOV 0HWKRGV DQG 0DWHULDOV ( DV D PDUNHU RI G\LQJ FHOOV ZDV VWXGLHG E\ ÁRZ F\WRPHWU\DQGPLFURVFRS\RIFHOOVDIWHUDQWLDQGURJHQUDGLRDQGFKHPRWKHUDS\ WUHDWPHQW LQ /1&D3 DQG 3&360$ SRVLWLYH FHOOV 7KH LQ YLYR EHKDYLRXU RI =U')2( ZDV FKDUDFWHULVHG LQ PLFH EHDULQJ VXEFXWDQHRXV /1&D3 360$SRVLWLYHE\ELRGLVWULEXWLRQVWXGLHVLPPXQR3(7DQGRSWLFDOLPDJLQJ7KH SRWHQWLDORIDVVHVVLQJWXPRXUUHVSRQVHZDVHYDOXDWHGLQYLYRDIWHUUDGLRWKHUDS\ DQGFKHPRWKHUDS\WUHDWPHQW 5HVXOWV ,Q YLWUR VWXGLHV FRUUHODWHG ( ELQGLQJ ZLWK PDUNHUV RI QHFURVLV DSRSWRVLV ,Q YLYR ELRGLVWULEXWLRQ H[SHULPHQWV UHYHDOHG KLJK WDUJHWVSHFLILF XSWDNHRI=U')2(LQ/1&D3WXPRXUVDIWHUK,'J K ,'J K ,'J DQG K ,'J ([FHOOHQWLPDJHFRQWUDVWZDVREVHUYHGZLWKLPPXQR3(7 (XSWDNHZDVVWD WLVWLFDOO\LQFUHDVHGLQWUHDWHGYHUVXVFRQWUROWXPRXUDVPHDVXUHGE\LPPXQR3(7 DQGELRGLVWULEXWLRQVWXGLHV%ORFNLQJVWXGLHVDWKFRQÀUPHGELQGLQJVSHFLÀFLW\ &RQFOXVLRQ=U')2(GLVSOD\VKLJKWXPRXUWREDFNJURXQGWLVVXHFRQWUDVW LQ LPPXQR3(7 DQG FDQ EH XVHG DV D WRRO WR PRQLWRU WKH WXPRXU UHVSRQVH LQ 360$SRVLWLYH3& ODSDURVFRSLFFKROHF\VWHFWRP\6HQVLWLYLW\VSHFLÀFLW\DORQJZLWKSRVLWLYHSUHGLFWLYH YDOXHVIRUSUHGLFWLQJHDV\DQGGLIÀFXOWFDVHVZHUHFDOFXODWHG 5HVXOWVRXWRIFDVHVRIGLIÀFXOW/&DQGRXWRIFDVHVRIHDV\/& ZHUHFRUUHFWO\SUHGLFWHGRQWKHEDVLVRIWKLVVFRULQJV\VWHP$VFRUHRIKDGD VHQVLWLYLW\DQGVSHFLÀFLW\IRUFRUUHFWO\LGHQWLI\LQJGLIÀFXOW/&3UHGLF WLRQFDPHWUXHLQIRUHDV\DQGGLIÀFXOWFDVHV8OWUDVRXQGÀQGLQJVRI *%ZDOOWKLFNQHVVGLVWHQGHG*%LPSDFWHGVWRQHVDQGGLODWHG&%'ZHUHIRXQG VWDWLVWLFDOO\VLJQLÀFDQW &RQFOXVLRQ7KLVVFRULQJV\VWHPLVYHU\HIIHFWLYHLQSUHGLFWLQJFRQYHUVLRQULVNRI /&WR2&3DWLHQWVKDYLQJKLJKULVNPD\EHLQIRUPHGDQGVFKHGXOHGDSSURSULDWHO\ % +HSDWRELOLDU\H[FUHWLRQRIJDGR[HWDWHGLVRGLXP3ULPRYLVWLQ SDWLHQWVZLWKSULPDU\VFOHURVLQJFKRODQJLWLV36& .,5LQJH -+LQULFKV(00HUNOH) :DFNHU%&0H\HU+DQQRYHU'( 'XUKDP1&86ULQJHNULVWLQD#PKKDQQRYHUGH 3XUSRVH7 RHYDOXDWHKHSDWRELOLDU\H[FUHWLRQRI*G(2%'73$LQWRGLIIHUHQWVHJ PHQWVRIWKHKHSDWRELOLDU\V\VWHPLQSDWLHQWVZLWK36&DQGWRDVVHVVSRVVLEOH FRUUHODWLRQZLWKOLYHUIXQFWLRQWHVWV/)7 0HWKRGVDQG0DWHULDOV7KLVUHWURVSHFWLYHVWXG\ZDV,5%DSSURYHGSDWLHQWV IHPDOHVPDOHVPHDQDJH\HDUVZLWKFRQÀUPHGGLDJQRVLVRI36& ZKRXQGHUZHQWFRQWUDVWHQKDQFHGKHSDWLF05,DIWHULQMHFWLRQRIP/NJERG\ ZHLJKWZHUHLQFOXGHG'HOD\HGSKDVHLPDJHVDFTXLUHGEHWZHHQDQGPLQXWHV DIWHUFRQWUDVWLQMHFWLRQZHUHDVVHVVHGIRUWKHSUHVHQFHRIFRQWUDVWDJHQWLQWKH LQWUDKHSDWLFELOHGXFWV,%'FRPPRQELOHGXFW&%'JDOOEODGGHUDQGGXRGHQXP $.UXVNDO:DOOLVWHVWZDVSHUIRUPHGWRGHWHUPLQHZKHWKHUH[FUHWLRQZDVDIIHFWHG E\/)7 +HSDWRELOLDU\H[FUHWLRQZDVFRPSDUHGZLWKGDWDFROOHFWHGLQDSUHYLRXV VWXG\IURPSDWLHQWVZLWKRXWOLYHUGLVHDVHE\PHDQVRID0DQQ:KLWQH\8WHVW 5HVXOWVPLQXWHVDIWHUFRQWUDVWLQLWLDWLRQ*G(2%'73$FRXOGEHGHWHFWHGLQWKH ,%'LQ&%'LQJDOOEODGGHULQGXRGHQXPLQUHVSHFWLYHO\ &RQWUDVWH[FUHWLRQLQWRWKH,%'&%'DQGJDOOEODGGHUZDVVLJQLÀFDQWO\DIIHFWHG E\VHUXPELOLUXELQOHYHOVEXWQRWE\DONDOLQHSKRVSKDWDVHќJOXWDP\OWUDQVIHUDVH SDWLHQWVH[RUDJH &RQFOXVLRQ &RQWUDVW H[FUHWLRQ LQWR DOO KHSDWRELOLDU\ VHJPHQWV LV VLJQLÀFDQWO\ UHGXFHGLQSDWLHQWVZLWK36&FRPSDUHGWRSDWLHQWVZLWKRXWOLYHUGLVHDVHDQGLV IXUWKHUGHSHQGHQWRQVHUXPELOLUXELQOHYHO:LWKLQPLQXWHVSRVWFRQWUDVWLQLWLDWLRQ *G(2%'73$FDQEHH[SHFWHGLQWKH,%'DQG&%'LQRQO\DERXWRISDWLHQWV 'HOD\HGSKDVHLPDJLQJWKHUHIRUHQHHGVWREHFDUULHGRXWVLJQLÀFDQWO\ORQJHULQ 36&SDWLHQWVLQRUGHUWRDVVHVVIXQFWLRQDOLQIRUPDWLRQ % 6HFUHWLQVWLPXODWHGPDJQHWLFUHVRQDQFHFKRODQJLR SDQFUHDWLFRJUDSK\VDIHW\UHOLDELOLW\DQGDVVHVVPHQWRISDQFUHDWLF H[RFULQHIXQFWLRQ 3 0HVVQHU-3 .XHKQ7 ,WWHUPDQQ%0HQVHO.+HJHQVFKHLG+9RHO]NH -0D\HUOH1+RVWHQ53XOV*UHLIVZDOG'(SKLOVHEDPHV#\DKRRGH 3XUSRVH7 RLQYHVWLJDWHWKHVDIHW\UHOLDELOLW\RIVHFUHWLQVWLPXODWHGPDJQHWLFUHV RQDQFHFKRODQJLRSDQFUHDWLFRJUDSK\6605&3DQGDVVHVVPHQWRISDQFUHDWLF H[RFULQHIXQFWLRQ3()LQYROXQWHHUV 0HWKRGVDQG0DWHULDOV7KHVWXG\ZDV,5%DSSURYHGYROXQWHHUVPHQ PHDQDJH\HDUVXQGHUZHQWQDYLJDWRUWULJJHUHG7ZHLJKWHG'05&3V EHIRUHDQGDIWHUVHFUHWLQVWLPXODWLRQ8(NJ%:XVLQJD705V\VWHP$YDQWR 6LHPHQV7KHPHDQWLPHEHWZHHQLQWUDYHQRXVVHFUHWLQLQMHFWLRQDQGWKH6605&3 ZDVPLQ)RUKRXUVDIWHULQMHFWLRQRIVHFUHWLQDGYHUVHUHDFWLRQVZHUH HYDOXDWHG,PSURYHPHQWRIGXFWYLVXDOLVDWLRQDIWHUVHFUHWLQVWLPXODWLRQZDVREVHUYHG E\ WZR UHDGHUV UU VXEMHFWLYHO\ DQG TXDQWLWDWLYHO\ WKURXJKPHDVXUHPHQW RI GXFWVL]HGLDPHWHUV3()ZDVDVVHVVHGVXEMHFWLYHO\XVLQJ0DWRVFULWHULD VE\WZR UHDGHUVDQGTXDQWLÀHGZLWKFDOLEUDWHGYROXPHWULFPHDVXUHPHQWRIWRWDOH[FUHWHG YROXPH7(9DQGSDQFUHDWLFÁRZRXWSXW3)2 5HVXOWV0LQRUDGYHUVHUHDFWLRQVZHUHREVHUYHGLQRQO\FDVHVFRQVLVWLQJ RIÁXVKLQJDQGQRPDMRUUHDFWLRQVZHUHREVHUYHG6XEMHFWLYHO\GXFWYLVXDOLVD WLRQDIWHUVHFUHWLQVWLPXODWLRQZDVLPSURYHGLQUUXQFKDQJHGLQUU DQG ZRUVH LQ UU LQWHUUDWHUDJUHHPHQW NDSSD 'XFW GLDPHWHUVLQFUHDVHGVLJQLÀFDQWO\DIWHUVHFUHWLQVWLPXODWLRQKHDGPPERG\ PPWDLOPPS 3() HYDOXDWHGXVLQJ0DWRVFULWHULDҋVZDV UHVWULFWHGLQ0DWRVUU0DWRVUU0DWRVUUDQG 0DWRVUUNDSSD 7KHPHDQ7(9ZDVPODQGWKH PHDQ3)2ZDVPOPLQXWH$FFRUGLQJWRWKHWLPHQRUPDOYDOXHVRI7(9 3)2ZHUHUHJUHVVHGWRDORJDULWKPLFIXQFWLRQ57(9 53)2 &RQFOXVLRQ6605&3SURYLGHVDQLPSURYHPHQWLQPDLQSDQFUHDWLFGXFWYLVXDOL VDWLRQDQGDQRQLQYDVLYHTXDQWLÀFDWLRQRI3()ZLWKQHJOLJLEOHULVNRIVLGHHIIHFWV 6FLHQWLILF6HVVLRQ 6 &$' ( ) *+% (XURSHDQ&RQJUHVVRI 5DGLRORJ\ % &DQPROHFXODULPDJLQJRIEUHDVWWXPRXUVZLWKKLJKÀHOG PXWOLSDUDPHWULF05,REYLDWHXQQHFHVVDU\EUHDVWELRSVLHV" .3LQNHU'RPHQLJ+%LFNHO+0DJRPHWVFKQLJJ%%UXHFN6*UXEHU :%RJQHU06FKHUQWKDQHU'%HU]DF]\7 ++HOELFK9LHQQD$7 NDWMDSLQNHU#PHGXQLZLHQDFDW 3XUSRVH7 RHYDOXDWHLIPXOWLSDUDPHWULFDVVHVVPHQWRIEUHDVWOHVLRQVZLWKSURWRQ 05 VSHFWURVFRS\ '+056, GLIIXVLRQZHLJKWHG 05 LPDJLQJ ':, DQG FRQWUDVWHQKDQFHG&(05,REYLDWHVXQQHFHVVDU\EUHDVWELRSVLHV 0HWKRGVDQG0DWHULDOVSDWLHQWVZLWKEUHDVWOHVLRQVGHWHFWHGE\PDPPRJUD SK\RUXOWUDVRXQGDQGFODVVLÀHGDV%,5$'6ZHUHLQFOXGHGLQWKLV,5%DSSURYHG SURVSHFWLYHVWXG\$OOSDWLHQWVZHUHH[DPLQHGPXOWLSDUDPHWULF05,RIWKHEUHDVW DW7 05,SURWRFROLQFOXGHG'+056,EHIRUHDSSOLFDWLRQRIFRQWUDVWDJHQWWR DYRLGFRQWDPLQDWLRQRIVSHFWUDD':,D7ZHLJKWHGVHTXHQFHDQGDFRPELQHG FRQWUDVWHQKDQFHGKLJKWHPSRUDODQGVSDWLDOUHVROXWLRQ'7ZVHTXHQFHEHIRUH DQGDIWHUDSSOLFDWLRQRIDVWDQGDUGGRVH*G'27$05,ZDVDVVHVVHGIRUOHVLRQ PRUSKRORJ\DQG(+NLQHWLFVDFFRUGLQJWRWKH%,5$'6FODVVLÀFDWLRQUHVWULFWHGGLI IXVLYLW\DQGLQFUHDVHG&KROLQH&KROHYHOV$Q$'&WKUHVKROG[PPV DQGDVLJQDOWRQRLVHUDWLRRIWKH&KRUHVRQDQFHSHDN!ZHUHGHÀQHGDVD PDUNHURIPDOLJQDQF\ $SUHGHÀQHGHYDOXDWLRQDOJRULWKPZDVXVHGIRUDVVLJQPHQW RIDÀQDO%,5$'6FODVVLÀFDWLRQ$OOOHVLRQVZHUHKLVWRSDWKRORJLFDOO\YHULÀHG 5HVXOWV'+056,KDGDVHQVLWLYLW\RIDQGDVSHFLÀFLW\RI':,KDG DVHQVLWLYLW\RIDQGDVSHFLÀFLW\RI&(05,GHPRQVWUDWHGDVHQVLWLYLW\ RI DQG D VSHFLÀFLW\ RI 0XOWLSDUDPHWULF 05, LQFUHDVHGVHQVLWLYLW\ WR VSHFLÀFLW\WRDQGKDGDYHU\JRRGGLDJQRVWLFDFFXUDF\RI%UHDVW ELRSVLHVFRXOGKDYHEHHQREYLDWHGLQRIEHQLJQOHVLRQV &RQFOXVLRQ0XOWLSDUDPHWULF05,RIWKHEUHDVWDW7LPSURYHVGLIIHUHQWLDWLRQEH WZHHQEHQLJQDQGPDOLJQDQWEUHDVWOHVLRQVREYLDWLQJXQQHFHVVDU\EUHDVWELRSVLHV % (IIHFWRIF\FORSDPLQHRQ))'*XSWDNHRISDQFUHDWLFFDQFHU [HQRJUDIVLQQXGHPLFHHYDOXDWLRQE\FOLQLFDOO\LPSOHPHQWHGKLJK UHVROXWLRQ3(7&7 +.D\HG3 0H\HU%.UDHQ]OLQ1*UHW]&)LQN626FK|QEHUJ06DGLFN 0DQQKHLP'(KDQ\ND\HG#XPPGH 3XUSRVH :H TXDQWLWDWLYHO\ DQDO\VHG WKH HIIHFWV RI F\FORSDPLQH RQ WKH ) )'*XSWDNHRISDQFUHDWLFFDQFHU[HQRJUDIWV3&;XVLQJDFOLQLFDOO\LPSOHPHQWHG 3(7&7VFDQQHUZLWKKLJKUHVROXWLRQUHFRQVWUXFWLRQ 0HWKRGVDQG0DWHULDOV3&;IURPWZRSDQFUHDWLFFDQFHUFHOOOLQHVZHUHLQGXFHG VXEFXWDQHRXVO\LQWKHKLSDQGVKRXOGHURIQXGHPLFH3&;ZHUHWUHDWHGZLWKWKH DQWLKHGJHKRJVLJQDOOLQJDJHQWF\FORSDPLQHLQWUDSHULWRQHDOO\IRURQHZHHN0LFH ZHUHLQMHFWHGLQWUDYHQRXVO\ZLWK0%T))'*DQGVFDQQHGZLWKDGH WHFWRUP&7VFDQQHU6LHPHQV+HDOWKFDUH6HFWRU(UODQJHQ*HUPDQ\7 RDGDSW IRUWKHVPDOOVL]HRIPLFHZHFKDQJHGWKH]RRPWRLQVWHDGRIWKHVFDQWLPH SUREHGSRVLWLRQWRPLQXWHVLQVWHDGRIPLQXWHVDQGZHXVHGPP*DXVVLDQ )LOWHULQVWHDGRIPP7KHGDWDVHWZDVUHFRQVWUXFWHGDQGTXDQWLÀHGXVLQJWKH 7UXH;DQG7UXH'VRIWZDUHV 5HVXOWV 0LD3D&D FHOOV ZKLFK UHVSRQG WR F\FORSDPLQH VKRZHG GHFUHDVHG ))'*XSWDNH ZLWKRXW FKDQJHV LQ WXPRXU VL]H 7KH KLS WXPRXUV VKRZHG D UHGXFWLRQRIWKH689PD[E\WKH689DYJE\DQG68 9PLQE\S7KHVKRXOGHUWXPRXUVVKRZHGUHGXFWLRQRIWKH 689PD[E\689DYJE\DQG689PLQE\ S &DSDQ FHOOV ZKLFK GR QRW UHVSRQG WR F\FORSDPLQH GLG QRW VKRZ VLJQLÀFDQW689FKDQJHV &RQFOXVLRQ 7KH FOLQLFDOO\ LPSOHPHQWHG 3(7&7 VFDQQHU ZLWK KLJKUHVROXWLRQ UHFRQVWUXFWLRQ FDQ GHWHFW PLQLPDO FKDQJHV LQ UHVSRQVH WR ORZGRVH VKRUWWHUP WKHUDS\RISDQFUHDWLFFDQFHU[HQRJUDIWVHYHQZLWKRXWFKDQJHVLQWXPRXUVL]HDQG WKXVRIIHUVWKHSRWHQWLDOIRUWUDQVODWLRQDOUHVHDUFKLQDQWLWXPRXUWKHUDS\ % ,PSDFWRIQRUPDOWLVVXHXSWDNHXVLQJ*D'27$72&3(7&7LQ SDWLHQWVZLWKQHXURHQGRFULQHWXPRXUDIROORZXSVWXG\ 06WHIDQRYD &.UDWRFKZLO/6FKZDUW]8+DEHUNRUQ) /*LHVHO 6WLS0.+HLGHOEHUJ'(1HZ<RUN1<86IJLHVHO#GNI]GH 3XUSRVH,PDJLQJZLWKVRPDWRVWDWLQDQDORJXHVVXFKDV*D'27$3KH 7\U RFWUHRWLGH '27$72& EHFDPH D VWDQGDUG DSSURDFK IRU VWDJLQJ DQG UHVWDJLQJ WKH QHXURHQGRFULQH WXPRXUV 7KH DLP RI WKLV VWXG\ LVWR DVVHVV WKH LPSDFWRIWKHQRUPDOWLVVXHXSWDNHXVLQJ*D'27$72&3(7&7LQSDWLHQWVZLWK QHXURHQGRFULQHWXPRXUSULRUDQGDIWHUF\FOHVRISHSWLGHUHFHSWRUUDGLRQXFOLGH WKHUDS\3557ZLWK<'27$72&DQG/X'27$72& % 0ROHFXODULPDJLQJRIDSRSWRVLVLQWKHHDUO\FRXUVHDIWHUP\RFDUGLDO LQIDUFWLRQXVLQJK\EULGÁXRUHVFHQFHPROHFXODUWRPRJUDSK\[UD\ FRPSXWHGWRPRJUDSK\)07;&7WDUJHWLQJ$QQH[LQ9 0:LOGJUXEHU$$OH..RVDQNH(5XPPHQ\91W]LDFKULVWRV 0XQLFK'(PRULW]ZLOGJUXEHU#WXPGH 3XUSRVH7 RLQYHVWLJDWH$QQH[LQ9WDUJHWHGPROHFXODULPDJLQJRIFDUGLRP\RF\WH DSRSWRVLVLQWKHHDUO\FRXUVHDIWHUPXULQHP\RFDUGLDOLQIDUFWLRQ 0HWKRGVDQG0DWHULDOV0\RFDUGLDOLQIDUFWLRQ0,ZDVLQGXFHGLQ&%/-PLFH E\PLQXWHVOLJDWLRQRIWKHOHIWDQWHULRUGHVFHQGLQJDUWHU\/$'ZLWKVXEVHTXHQW UHSHUIXVLRQ 0LFH ZHUH LQMHFWHG ZLWK WKH$QQH[LQ 9 WDUJHWHG PROHFXODU LPDJLQJ SUREH$QQH[LQ9LYRKRXUVSULRUWRLPDJLQJ$GGLWLRQDOO\PLFHZHUHLQMHFWHG ZLWKDORQJFLUFXODWLQJLRGLQHEDVHGFRQWUDVWDJHQW([LWURQSULRUWRLPDJ LQJIRUEHWWHUYLVXDOLVDWLRQRIFDUGLDFDQDWRP\ZLWKVXEVHTXHQWIDFLOLWDWHGRUJDQ VHJPHQWDWLRQ+\EULG)07;&7ZDVSHUIRUPHGKRXUVKRXUVDQGGD\VDIWHU LQGXFWLRQRILVFKDHPLFLQMXU\0ROHFXODULPDJLQJVLJQDOIRU$QQH[LQ9LYRZDV YDOLGDWHGE\H[YLYRLPPXQRKLVWRFKHPLVWU\DQGÁRZF\WRPHWU\ 5HVXOWV 6XFFHVVIXO LPDJH DFTXLVLWLRQ RI ERWK )07 DQG &7 DQJLRJUDSK\ ZDV DFKLHYHG LQ DOO PLFH 0ROHFXODU LPDJLQJ VLJQDO IRU$QQH[LQ9LYR FRXOG EH ORFDOLVHGWRWKHDQWHULRUODWHUDOZDOORIWKHOHIWYHQWULFOHDWWKHVLWHRIP\RFDUGLDO LQIDUFWLRQ)07VLJQDOIRU$QQH[LQ9SHDNHGDWKRXUVDIWHUP\RFDUGLDOLQIDUFWLRQ ZLWKVXEVHTXHQWGHFUHDVHDWKRXUVDQGGD\VDIWHURQVHWRILVFKDHPLFLQMXU\ )07VLJQDOIRU$QQH[LQ9FRORFDOLVHGZLWKDSRSWRVLVVWDLQLQJ&DVSDVHXVLQJ LPPXQRKLVWRFKHPLVWU\DQGÁRZF\WRPHWU\+\EULGDFTXLVLWLRQRI[UD\FRPSXWHG WRPRJUDSK\DOORZVH[DFWORFDOLVDWLRQRIWKH)07VLJQDOWRWKHOHIWYHQWULFOHDQG IDFLOLWDWHVRUJDQVHJPHQWDWLRQDQGDWWHQXDWLRQFRUUHFWLRQ &RQFOXVLRQ+\EULG)07;&7WDUJHWLQJ$QQH[LQ9HQDEOHVDFFXUDWHLQYLYRDV VHVVPHQWRIDSRSWRVLVLQWKHHDUO\FRXUVHDIWHUP\RFDUGLDOLQIDUFWLRQLQDPXULQH LVFKDHPLDUHSHUIXVLRQPRGHO % )LUVWSDUDOOHOVSHFLÀFYLVXDOLVDWLRQRILQÁDPPDWRU\DFWLYLW\DQG FRQVHFXWLYHGHP\HOLQDWLRQLQH[SHULPHQWDOPXOWLSOHVFOHURVLV06 LQYLYRXVLQJGXDOFKDQQHORSWLFDOPROHFXODULPDJLQJ 0(LVHQEODHWWHU6$OEUHFKW/:DFKVPXWK:+HLQGHO7 9RJO7 .XKOPDQQ &%UHPHU0QVWHU'(HLVHQEODHWWHU#XQLPXHQVWHUGH 3XUSRVH$PHWKRGIRUFRQWLQXRXVVXUYHLOODQFHRIFHQWUDOQHUYRXVLQÁDPPDWRU\ SURFHVVHVDQGXQGHUO\LQJSDWKRSK\VLRORJ\ZDVGHVLUHGIRUH[DPLQDWLRQRIPXULQH PRGHOVRIGLVHDVH $FWLYDWHGPDFURSKDJHVKDYHEHHQVKRZQWRSOD\DFUXFLDOUROH LQLQLWLDOLVDWLRQDQGPDLQWHQDQFHRILQÁDPPDWLRQ3UHYLRXVZRUNSURYHGH[SUHV VLRQRIPDFURSKDJHUHODWHGSURWHLQ6$WREHFRUUHODWHGZLWKORFDOGLVHDVH DFWLYLW\ DQG RSWLFDO LPDJLQJ 2, RI 6$ KDV VXFFHVVIXOO\ EHHQ SHUIRUPHG 1HDULQIUDUHG ÁXRUHVFHQW ҋGLHWK\OWKLDWULFDUERF\DQLQHLRGLGH '%7 KDV EHHQ VKRZQWRVHOHFWLYHO\ELQGP\HOLQ 0HWKRGVDQG0DWHULDOV06HTXLYDOHQWOHVLRQVZHUHLQGXFHGLQ&%/PLFHE\ &XSUL]RQDSSOLFDWLRQRYHUGD\V+HDOWK\PLFHVHUYHGDVFRQWURO$QWL6$ RU,PPXQRJOREXOLQ*,J*FRQWUROIRUQRQVSHFLÀFODEHOGLVWULEXWLRQZHUHODEHOOHG ZLWK&\IRU2,7UDFHUGRVHVSHUDQLPDOZHUHJDQWL6$&\K DQGJ'%7 PLQSULRUWRÁXRUHVFHQFHPHGLDWHGWRPRJUDSK\ZLWKH[FLWDWLRQ HPLVVLRQRIQP&\DQGQP'%7)RUFRUUHODWLRQRILQYLYR 2,PDJQHWLFUHVRQDQFHWRPRJUDSK\05,IRUOHVLRQGHWHFWLRQDQGLPPXQRKLVWR FKHPLVWU\ZHUHSHUIRUPHG6WDWLVWLFDODQDO\VLVVWXGHQWWWHVW 5HVXOWV,Q&XSUL]RQWUHDWHGDQLPDOVLQMHFWLRQRIDQWL6$&\UHVXOWHGLQ WKUHHIROGKLJKHUWUDFHUDFFXPXODWLRQWKDQLQKHDOWK\DQLPDOVSPROYVSPRO S ZKHUHDVXQVSHFLÀF,J*&\DFFXPXODWHGWRDVLJQLÀFDQWO\ORZHUVFDOH SPROYVSPROS 0\HOLQDVVRFLDWHG'%7DFFXPXODWLRQGURSSHGIURP SPROKHDOWK\WRSPRO&XSUL]RQUHÁHFWLQJVLJQLÀFDQWGHP\HOLQDWLRQ)RU DOOPHDVXUHPHQWVD52,DQDO\VLVRIWKHFRUSXVFDOORVXPUHJLRQZDVSHUIRUPHG ZKHUHKLVWRORJ\DQG05,SURYHGOHVLRQORFDWLRQDQGVHYHULW\DVGHSLFWHGE\2, &RQFOXVLRQ$QWL6$&\LQFRPELQDWLRQZLWK'%7PD\VHUYHIRUVSHFLÀF YLVXDOLVDWLRQRIFHQWUDOQHUYRXVLQÁDPPDWLRQOLNH06DQGDOORZVIRUJUDGLQJDF FRUGLQJWRLPPXQHFHOODFWLYLW\DQGGHP\HOLQDWLRQ 6FLHQWLILF6HVVLRQ $ 6&'()*+% 7KXUVGD\ (XURSHDQ&RQJUHVVRI 5DGLRORJ\ &RQFOXVLRQ$'& PHDVXUHPHQWV FDQ KHOS WR GLVWLQJXLVK EHWZHHQ GLIIHUHQW WX PRXUW\SHVDQGFRXOGVHUYHDVDSURJQRVWLFPDUNHUIRUWKHXSWDNHRIPROHFXOHV LQWRWXPRXUV % &RPSDULVRQRIFRQVHFXWLYHEROXVWUDFNLQJDQGÁDVKUHSOHQLVKPHQW PHDVXUHPHQWVIRUWKHDVVHVVPHQWRIWLVVXHKDHPRG\QDPLFVXVLQJ FRQWUDVWHQKDQFHGXOWUDVRXQG&(86LQDQH[SHULPHQWDOVTXDPRXV FHOOFDUFLQRPDPRGHO 3 03DSURWWND0,QJULVFK3 =HQJHO&&&\UDQ.1LNRODRX0) 5HLVHU '$&OHYHUW0XQLFK'(SKLOLSSSDSURWWND#PHGXQLPXHQFKHQGH 3XUSRVH7 RHYDOXDWH´EROXVWUDFNLQJµ%7DQG´ÁDVKUHSOHQLVKPHQWµ)5IRUWKH DVVHVVPHQWRIWLVVXHKDHPRG\QDPLFVE\FRQWUDVWHQKDQFHGXOWUDVRXQG&(86LQ DQH[SHULPHQWDOVPDOODQLPDOVTXDPRXVFHOOFDUFLQRPDPRGHO6LQFHWKHXQGHUO\ LQJWLVVXHLVWKHVDPHVWURQJFRUUHODWLRQVEHWZHHQSDUDPHWHURXWFRPHVRIERWK WHFKQLTXHVDUHH[SHFWHG 0HWKRGVDQG0DWHULDOV+XPDQK\SRSKDU\Q[FDUFLQRPDFHOOVZHUHVXEFXWDQH RXVO\LQMHFWHGLQWRWKHOHIWÁDQNRIIHPDOHDWK\PLFQXGHUDWV$IWHUGD\VRI VXEFXWDQHRXVWXPRXUJURZWK%7DQG)5PHDVXUHPHQWVZHUHSHUIRUPHGLQHDFKUDW DIWHUEROXVLQMHFWLRQRI6RQR9XHYLDWKHODWHUDOWDLOYHLQXVLQJDKLJKHQGXOWUDVRXQG V\VWHPZLWKD0+]SUREH9LGHRVHTXHQFHVZHUHH[SRUWHGERWKPRGDOLWLHVZHUH DQDO\VHGZLWK9XH%R[%UDFFR6XLVVH%7\LHOGVWKHSDUDPHWHUVSHDNHQKDQFH PHQW3(DUHDXQGHUWKHFXUYH$8&ULVHWLPH57PHDQWUDQVLWWLPH077E ZDVKLQUDWH ZL5E DQG SHUIXVLRQLQGH[ 3,E )5 \LHOGV UHODWLYHEORRGYROXPH U%9077I3,IDQGZL5I 5HVXOWV +LJKO\ VLJQLÀFDQW FRUUHODWLRQV ZHUH REVHUYHG EHWZHHQ U%9 DQG 3( U S U%9 DQG$8& U S U%9 DQG P77E U S P77EDQGP77IU S 3,IDQG3(U S3, DQG$8&U S DQG3,DQGZL5IU S &RQFOXVLRQ:KHUHDVEROXVWUDFNLQJFDQEHXVHGLQDZLGHUDQJHRIPRGDOLWLHV LQFOXGLQJ &(86 &7 DQG 05 )5 DV D WHFKQLTXH IRU WKH DVVHVVPHQW RI WLVVXH KDHPRG\QDPLFVLVXQLTXHWR&(86$OWKRXJK%7DQG)5\LHOGGLIIHUHQWSDUDP HWHUVWKHXQGHUO\LQJWLVVXHKDHPRG\QDPLFVDUHHTXDO,QWKLVZRUNZHZHUHDEOH WRGHPRQVWUDWHVWURQJFRUUHODWLRQVEHWZHHQGLIIHUHQWSDUDPHWHUVRIERWKPRGDOL WLHVLQDVPDOODQLPDOWXPRXUPRGHOLQGLFDWLQJWKDWÁDVKUHSOHQLVKPHQWLVDYDOLG DOWHUQDWLYHWRWKHPRUHHVWDEOLVKHGEROXVWUDFNLQJWHFKQLTXH$OWKRXJKWKHODFNRI DEVROXWHTXDQWLWDWLYHSDUDPHWHUVKLQGHUVDGLUHFWFRPSDULVRQRIERWKPRGDOLWLHV )5DQG%7VKRXOGERWKEHVXLWDEOHIRUDUHODWLYHFRPSDULVRQHJEHWZHHQEDVHOLQH DQGIROORZXSH[DPLQDWLRQV 5RRP12 9DVFXODU 66 7KRUDFLFDQGDEGRPLQDODRUWD 0RGHUDWRUV $0LVKUD1HZ'HOKL,1 ,39XOHY%UDWLVODYD6. % 7ULSKDVLFPXOWLGHWHFWRU&7IRUWKHDVVHVVPHQWRILQWUDPXUDO KDHPDWRPDRIWKHDRUWDDQGWKHSXOPRQDU\DUWHU\ 06LPRQ) 'UXHVFKOHU$.RYDFV3 +XQROG.0D\-%DUNKDXVHQ) 9RJW /XHEHFN'(PDUWLQVLPRQ#XNVKGH 3XUSRVH 7KLV VWXG\ DLPHG WR HYDOXDWH WKH GLDJQRVWLF DFFXUDF\ RI D WULSKDVLF PXOWLGHWHFWRU&70'&7SURWRFROIRUWKHGHWHFWLRQRIDRUWLFGLVVHFWLRQVLQWUDPXUDO KDHPDWRPD,0+DQGYDVFXODUFRPSOLFDWLRQVLQSDWLHQWVZLWKVXVSLFLRQRIDFXWH DRUWLFV\QGURPH$$6 0HWKRGV DQG 0DWHULDO :LWKLQ PRQWKV SDWLHQWV XQGHUZHQW D WULSKDVLF ZLWKRXW FRQWUDVW DUWHULDO DQG YHQRXV SKDVH 0'&7 RI WKH HQWLUH DRUWD 2QH PLOOLPHWHUVOLFHVRIDOOGDWDVHWVZHUHDVVHVVHGE\WZRLQGHSHQGHQWUDGLRORJLVWV XVLQJPXOWLSODQDUUHIRUPDWLRQVRQDGHGLFDWHGZRUNVWDWLRQ7KHHYDOXDWLRQLQFOXGHG WKHGHWHFWLRQDQGFKDUDFWHULVDWLRQRI$$6DVZHOODVWKHDVVHVVPHQWRIFOLQLFDOO\ UHOHYDQWFRQFRPLWDQWYDVFXODUÀQGLQJV)ROORZXS0'&7VFDQVDVZHOODVLQWUD RSHUDWLYHÀQGLQJVVHUYHGDVWKHVWDQGDUGRIUHIHUHQFH 5HVXOWV0'&7FRQÀUPHGWKHGLDJQRVLVRIDQDFXWHDRUWLFV\QGURPHLQSDWLHQWV FODVVLÀHGDV7\SH$GLVVHFWLRQQ W\SH%GLVVHFWLRQQ DQGLQWUDPXUDO KDHPDWRPDQ 7KHFRQFRPLWDQWUHOHYDQWYDVFXODUÀQGLQJVLQFOXGHGGLVVHF WLRQRIVXSUDDRUWDOYHVVHOVQ GLVVHFWLRQRIDEGRPLQDOYLVFHUDODUWHULHVQ 0HWKRGVDQG0DWHULDOV6L[WHHQSDWLHQWVZLWKKLVWRORJLFDOFRQÀUPHGPHWDVWDWLF QHXURHQGRFULQHWXPRXUVZHUHHQUROOHGLQWKLVVWXG\,QHDFKSDWLHQW*D'27$ 72&3(7&7H[DPLQDWLRQVSULRUDQGDIWHUF\FOHVRI3557PHDQDGPLQLVWHUHG DFWLYLW\*%T</XZHUHHYDOXDWHG7KHPD[LPXPVWDQGDUGLVHG XSWDNHYDOXH689PD[RIWKHIROORZLQJQRUPDOWDUJHWWLVVXHVSLWXLWDU\JODQGWK\ URLGJODQGVSOHHQOLYHUEDFNJURXQGKHDGRIWKHSDQFUHDVNLGQH\VDQGVXSUDUHQDO JODQGVZHUHGHWHUPLQHGSULRUDQGDIWHUWKHUDS\ 5HVXOWV689PD[EHIRUHDQGDIWHU3557ZHUHGHWHUPLQHGDVSLWXLWDU\JODQG WK\URLGJODQGVSOHHQ OLYHU SDUHQFK\PD KHDG RI WKH SDQFUHDV NLGQH\VDQGVXSUDUHQDOJODQGV 7KHUHIRUHQRVWDWLVWLFDOVLJQLÀFDQWGLIIHUHQFHVZHUHIRXQG S!IRUDOORUJDQV &RQFOXVLRQ7KHXSWDNHRI*D'27$72&LQQRUPDOWLVVXHLVQRWVLJQLÀFDQWO\ DIIHFWHGE\3557 'HVSLWHWKHQRQLPSDFWRIQHXURHQGRFULQHVLGHHIIHFWVWKLVPLJKW DOVREHUHOHYDQWZLWKUHJDUGWRWXPRXUWRQRQWXPRXUUDWLRVIRUIROORZXSDVVHVV PHQWSDUWLFXODUO\OLYHUSDUHQFK\PDXSWDNHGHPRQVWUDWHGWREHUREXVW % 3UHFOLQLFDODVVHVVPHQWRIDQWLDQJLRJHQLFHIIHFWVRQPLFHZLWK PDPPDU\FDUFLQRPDXVLQJG\QDPLFFRQWUDVWHQKDQFHGPLFUR&7 ) (LVD5%UDXZHLOHU0+XSIHU7 1RZDN5'LWWULFK0:%HFNPDQQ :$.DOHQGHU(UODQJHQ'()DELDQ(LVD#LPSXQLHUODQJHQGH 3XUSRVH7 RHYDOXDWHWKHSRWHQWLDORILQYLYRG\QDPLFFRQWUDVWHQKDQFHG'&( PLFUR&7IRUWKHSUHFOLQLFDODVVHVVPHQWRIDQWLDQJLRJHQLFGUXJWKHUDS\UHVSRQVH RQPLFHZLWKPDPPDU\FDUFLQRPD 0HWKRGVDQG0DWHULDOV $PRQJIHPDOHPLFHZLWKLPSODQWHG0&)WXPRXUVLQ WKHIRXUWKLQJXLQDOPDPPDU\JODQGZHUHWUHDWHGZLWKDQDQWLDQJLRJHQLFGUXJDQG VHUYHGDVFRQWUROJURXS)RXUZHHNVDIWHUWXPRXULPSODQWDWLRQDOOPLFHXQGHUZHQW '&(PLFUR&7N9$7KHVFDQFRQVLVWHGRIJDQWU\URWDWLRQVZLWKD WRWDOVFDQWLPHRIV2YHUODSSLQJUHFRQVWUXFWLRQVZLWKDQLVRWURSLFYR[HO VL]HRIPZHUHSHUIRUPHGLQVLQWHUYDOV,QD'DQDO\VLVWKHUHODWLYHEORRG YROXPHU%9YDVFXODUSHUPHDELOLW\.DUHDXQGHUWKHWLPHFRQFHQWUDWLRQFXUYH $8&DQGWKHPRUSKRORJ\RIWKHWXPRXUVZHUHFRPSDUHGEHWZHHQWKHUDS\DQG FRQWUROJURXS$OOSDUDPHWHUVZHUHGHWHUPLQHGIRUDWRWDOSHULSKHUDODQGFHQWUDO WXPRXUYROXPHRILQWHUHVW92,0RUHRYHULPPXQRKLVWRFKHPLVWU\ZDVSHUIRUPHG WRFKDUDFWHULVHWKHWXPRXUYDVFXODULVDWLRQ 5HVXOWV 7KH PHDQ$8&V ZHUH VLJQLÀFDQWO\ ORZHU LQ WKHUDS\ ZLWK SYDOXHVR I DQGIRUWRWDOSHULSKHUDODQGFHQWUDOWXPRXU92,UHVSHFWLYHO\ . DQG U%9 VKRZHG VLJQLÀFDQW GLIIHUHQFHV IRU WKH SHULSKHUDO 92,S.SHU SU%9SHU EXW QRW IRU WKH WRWDO DQG FHQWUDO WXPRXU 92,V S.WRWDO S.FHQWUDO SU%9WRWDO SU%9FHQWUDO 0HDQWXPRXUYROXPHZDV VLJQLÀFDQWO\VPDOOHULQWKHUDS\SLQYLYR SH[YLYR +LVWRORJ\UHYHDOHG KLJKHUYDVFXODULVDWLRQLQWKHFRQWUROJURXSDQGVKRZHGFHQWUDOWXPRXUQHFURVLV &RQFOXVLRQ7KLV VWXG\ LQGLFDWHV WKH KLJK SRWHQWLDO RI '&( PLFUR&7 IRU HDUO\ LQYLYRDVVHVVPHQWRIDQWLDQJLRJHQLFGUXJWKHUDS\UHVSRQVHLQPLFH % &RPSDULVRQRI$'&PHDVXUHPHQWVDQG863,2XSWDNHLQWRGLIIHUHQW KXPDQ[HQRJUDIWWXPRXUPRGHOVDW705, 15DDEH7 (UQVW0+HLQH6&6DOPHQ0.DXO&+DEHUPDQQ*$GDP +,WWULFK+DPEXUJ'(QUDDEH#XNHXQLKDPEXUJGH 3XUSRVH7KHHYDOXDWLRQRIDSSDUHQWGLIIXVLRQFRHIÀFLHQWPHDVXUHPHQWV$'& DVDGLDJQRVWLFPDUNHUIRUWKHXSWDNHRI63,2LQGLIIHUHQWKXPDQ[HQRJUDIWWXPRXU PRGHOVLQPLFHDW705, 0HWKRGVDQG0DWHULDOV)LYHPLFHHDFKZLWKGLIIHUHQWKXPDQ[HQRJUDIWWXPRXUV 2+VPDOOFHOOOXQJFDQFHU/2;PDOLJQDQWPHODQRPD'8EUHDVWFDQFHU ZHUHPHDVXUHGRQD7VPDOODQLPDO05VFDQQHU&OLQ6FDQ%UXNHU*HUPDQ\ ZKHUHDVRQHVHUYHGDVFRQWUROQR863,2LQMHFWHG'LIIXVLRQZHLJKWHGLPDJLQJ ':,ZDVSHUIRUPHGSULRUWRWKHLQWUDYHQRXVLQMHFWLRQRIJ3(*\ODWHGVXSHU SDUDPDJQHWLFLURQR[LGHQDQRSDUWLFOHV863,2FRUHVL]HQP':,PHDVXUH PHQWVZHUHSHUIRUPHGXVLQJVL[GLIIHUHQWEIDFWRUVDQG VPP$'&PHDVXUHPHQWVZHUHSHUIRUPHGWKUHHWLPHVLQDKRPRJHQHRXVDUHD RIWKHWXPRXU0HDQ$'&YDOXHVRIWXPRXUW\SHVZHUHVWDWLVWLFDOO\FRPSDUHGWR HDFKRWKHUYLDDQDO\VLVRIYDULDQFH7ZHLJKWHGDQG7 UHOD[RPHWULFVHTXHQFHV ZHUHSHUIRUPHGWRHYDOXDWHWKHXSWDNHRI63,2LQWKHWXPRXUV 5HVXOWV$OOWKUHHWXPRXUW\SHVGLIIHUHGVLJQLÀFDQWO\SLQ$'&YDOXHVLQ [PPòVZLWKKLJKHVWYDOXHVLQWKH/2;WXPRXUIROORZHGE\ WKH'8WXPRXUDQGWKH2+WXPRXUPRGHO$Q LQKRPRJHQHRXVVLJQDODOWHUDWLRQGXHWR63,2XSWDNHRQ7ZHLJKWHGLPDJHVDQG UHOD[RPHWULFPHDVXUHPHQWVFRXOGRQO\EHGHWHFWHGLQWKH/2;WXPRXU 6FLHQWLILF6HVVLRQ 6 &$' ( ) *+% (XURSHDQ&RQJUHVVRI 5DGLRORJ\ % 6FUHHQLQJIRUDRUWLFURRWDQHXU\VPVLQSDWLHQWVZLWKVXVSHFWHGRU NQRZQ0DUIDQV\QGURPHLQWUDLQGLYLGXDOFRPSDULVRQRIHQKDQFHG DQGXQHQKDQFHG05DQJLRJUDSK\ZLWKHFKRFDUGLRJUDSK\ 3 %DQQDV0*URWK05\EF]\QVNL66KHLNK]DGHK < YRQ.RGROLWVFK-*UDVVQHU*/XQG*$GDP&+DEHUPDQQ +DPEXUJ'(SEDQQDV#XNHGH 3XUSRVH3DWLHQWVZLWK0DUIDQV\QGURPHKDYHWREHVFUHHQHGIRULQLWLDODVVHVVPHQW DQGIROORZXSRIDRUWLFURRWGLODWDWLRQ2XUSXUSRVHZDVWRHYDOXDWHLQWUDLQGLYLGX DOO\WKHSHUIRUPDQFHRIXQHQKDQFHG'66)305$ZLWKFRQWUDVWHQKDQFHG' &(05$PDJQHWLFUHVRQDQFHDQJLRJUDSK\IRUDRUWLFURRWGLDPHWHUPHDVXUHPHQWV DQGWRFRPSDUHWKHUHVXOWVZLWKURXWLQHO\SHUIRUPHGHFKRFDUGLRJUDSK\LQSDWLHQWV ZLWK0DUIDQV\QGURPH 0HWKRGVDQG0DWHULDOV $RUWLFURRWVZHUHH[DPLQHGSURVSHFWLYHO\LQFRQVHFX WLYHSDWLHQWVZLWKVXVSHFWHGRUNQRZQ0DUIDQV\QGURPHXVLQJD'66)305$ DQGD'&(05$DW7 HVOD7ZRUHDGHUVLQGHSHQGHQWO\PHDVXUHGDRUWLFURRW GLDPHWHUV DW WKH DQQXOXV VLQXVHV RI 9DOVDOYD DQG VLQXWXEXODU MXQFWLRQ LQ ERWK GDWDVHWVDQGFRPSDUHGUHVXOWVZLWKHFKRFDUGLRJUDSKLFGDWD,QWUDFODVVFRUUHODWLRQ FRHIÀFLHQW3HDUVRQҋVFRUUHODWLRQFRHIÀFLHQW%ODQG$OWPDQDQGWZRVLGHGWWHVW ZHUHXVHGWRDVVHVVDJUHHPHQWEHWZHHQREVHUYHUVDQGPHWKRGV 5HVXOWVRIWKHLQFOXGHGSDWLHQWVPHDQDJH\HDUVKDG 0DUIDQV\QGURPHWKHUHPDLQLQJZHUHKHDOWK\LQGLYLGXDOV%RWK66)3 05$DQG&(05$PHDVXUHPHQWVRIWKHVLQXVHVRI9DOVDOYDUHYHDOHGDVWURQJ FRUUHODWLRQZLWKHFKRFDUGLRJUDSK\U DQGU UHVSHFWLYHO\,QWUDFODVV FRUUHODWLRQZDVPDUNHGO\EHWWHUIRU66)305$U ZKHQFRPSDUHGWR&( 05$U ,PDJHTXDOLW\DVZHOODVLQWUDDQGLQWHUREVHUYHUDJUHHPHQWRI PHDVXUHPHQWVRIWKHVLQXVHVRI9DOVDOYDZDVVLJQLÀFDQWO\EHWWHUIRU66)305$ WKDQIRU&(05$ &RQFOXVLRQ'66)305$PHDVXUHPHQWVRIWKHDRUWLFURRWDUHVXSHULRUWR' &(05$PHDVXUHPHQWVDQGVKRXOGEHXVHGIRUHVWDEOLVKLQJWKHGLDJQRVLVRIDRUWLF LQYROYHPHQWLQ0DUIDQV\QGURPHDQGPRQLWRULQJWKHFRXUVHRIDRUWLFHQODUJHPHQW % )HDVLELOLW\RIWLPHUHVROYHG05DQJLRJUDSK\ZLWKLQWHUOHDYHG VWRFKDVWLFWUDMHFWRULHV7:,67IRUWKHGLDJQRVLVRIWKRUDFLFRXWOHW V\QGURPH 7 &/DXHQVWHLQ/8PXWOX$)LVFKHU&.ORHWHUV$4XLQVWHQ6.LQQHU (VVHQ'(WKRPDVODXHQVWHLQ#XQLGXHGH 3XUSRVH7KHWKRUDFLFRXWOHWV\QGURPH726LVGHÀQHGDVDSRVLWLRQDOFRPSUHV VLRQRIWKHYHUWHEUDODQGVXEFODYLDQDUWHU\726FDQEHGLDJQRVHGE\PDJQHWLF UHVRQDQFH DQJLRJUDSK\ 05$ LQ FRQMXQFWLRQ ZLWK SRVWXUDO PDQRHXYUHV 7KLV WHFKQLTXHUHTXLUHVKLJKDPRXQWVRIJDGROLQLXPDQGH[DFWWLPLQJRIFRQWUDVWGHOD\V $QHZWLPHUHVROYHG05$WHFKQLTXH7:,67FRPELQHVSDUDOOHOLPDJLQJZLWKD 'YLHZVKDULQJLPSOHPHQWDWLRQ+HQFH'GDWDVHWVFDQEHFROOHFWHGZLWKRQO\ OLWWOHLQWUDYHQRXVJDGROLQLXPEXWKLJKWHPSRUDOUHVROXWLRQ:HDLPHGWRDVVHVV ZKHWKHU726FDQEHGLDJQRVHGZLWK7:,6705$ 0HWKRGVDQG0DWHULDOVSDWLHQWVZLWKVXVSHFWHG726ZHUHVWXGLHG([DPLQD WLRQVZHUHSHUIRUPHGRQD7V\VWHP0$*1(720$YDQWR6LHPHQV$%RG\ 0DWUL[5)VXUIDFHFRLOZDVXVHGIRUVLJQDOUHFHSWLRQRIWKHXSSHUWKRUD[)ROORZLQJ WKHLYDGPLQLVWUDWLRQRIFFJDGREXWURO*DGRYLVW%D\HUDWDÁRZUDWHRIFFV FRQVHFXWLYHFRURQDO7ZHLJKWHG'GDWDVHWVZHUHDFTXLUHGXVLQJD7:,67 SURWRFRO 757(ÁLS PV PV PDWUL[ [ VOLFHV WHPSRUDO UHVROXWLRQV7KHDFTXLVLWLRQZDVSHUIRUPHGWZLFHZLWKWKHDUPVDORQJVLGH WKHERG\DQGDIWHUHOHYDWLRQ,PDJHVZHUHDQDO\VHGFRQFHUQLQJVWHQRWLFFKDQJHV RIWKHVXEFODYLDQDUWHULHV5HVXOWVRIVXEVHTXHQW%PRGHDQGFRORXUGXSOH[XOWUD VRQRJUDSK\ZHUHXVHGDVVWDQGDUGRIUHIHUHQFH 5HVXOWVSDWLHQWVGLGQRWUHYHDODVWHQRVLVRIWKHULJKWRUOHIWVXEFODYLDQDUWHU\,Q SDWLHQWVDFRPSUHVVLRQRIWKHVXEFODYLDQDUWHU\ZDVREVHUYHGDIWHUDUPHOHYDWLRQ XQLODWHUDOQ ELODWHUDOQ )LQGLQJVZHUHFRQÀUPHGE\WKHVWDQGDUGRIUHIHUHQFH &RQFOXVLRQ7:,6705$LVDIDVWDQGUREXVWWHFKQLTXHWRLGHQWLI\SDWLHQWVZLWK 726 SHULFDUGLDOHIIXVLRQKDHPDWRPDQ DQGLQWUDPXUDOKDHPDWRPDRIWKHSXOPRQDU\ DUWHULHVQ 7KH,0+RIWKHSXOPRQDU\DUWHULHVZHUHFRPELQHGZLWKDQ,0+ RIWKHDRUWDLQWKUHHDQGDGLVVHFWLRQRIDVFHQGLQJDRUWDLQFDVHV$OOLQWUDPXUDO KDHPDWRPDZHUHGHWHFWHGDWEHVWRQWKHQRQFRQWUDVWHQKDQFHGVFDQV &RQFOXVLRQ1RQHQKDQFHG&7VFDQVDUHDSUHUHTXLVLWHIRUWKHDFFXUDWHGHWHF WLRQRILQWUDPXUDOKDHPDWRPDLQSDWLHQWVZLWKVXVSLFLRQRIDFXWHDRUWLFV\QGURPH 2XU GLUHFWHG DQDO\VLV RI KLJKUHVROXWLRQ 0'&7 VFDQV VKRZHG WKDW LQWUDPXUDO KDHPDWRPDRIWKHSXOPRQDU\DUWHU\DUHPRUHIUHTXHQWWKDQH[SHFWHG % 0HDVXULQJDRUWLFDQGSXOPRQDU\WUXQNGLDPHWHUVLQHSLGHPLRORJLF UHVHDUFKGRZHQHHGJDGROLQLXPDQGRUWKRJRQDOVOLFHV" %0HQVHO-3 .KQ6/DQJQHU1+RVWHQ53XOV *UHLIVZDOG'(ELUJHUPHQVHO#XQLJUHLIVZDOGGH 3XUSRVH&DUGLRYDVFXODUPDJQHWLFUHVRQDQFHLPDJLQJKDVEHFRPHLQFUHDVLQJO\ SRSXODULQSRSXODWLRQEDVHGUHVHDUFK2XUVWXG\HYDOXDWHVWKHYDOLGLW\DQGUHOLDELOLW\ RIPHDVXULQJWKHGLDPHWHUVRIWKHDRUWDDQGSXOPRQDU\WUXQNIURPSODLQD[LDO9,%( YROXPHLQWHUSRODWHGEUHDWKKROGH[DPLQDWLRQLPDJHV 0HWKRGVDQG0DWHULDOV7KHVWXG\LQFOXGHGPDOHVXEMHFWVIURPWKHSRSXODWLRQ EDVHG6WXG\RI+HDOWKLQ3RPHUDQLD6+,3,QWKHVHVXEMHFWVWKHWKRUDFLFDQG DEGRPLQDODRUWDDQGSXOPRQDU\WUXQNZHUHLPDJHGDW7 HVODXVLQJDSODLQ9,%( VHTXHQFHDQGFRQWUDVWHQKDQFHGPDJQHWLFUHVRQDQFHDQJLRJUDSK\ &(05$ 'LDPHWHUVZHUHPHDVXUHGDWSUHGHÀQHGDQDWRPLFVLWHVIURPD[LDO9,%(LPDJHV DQGUHIRUPDWWHGRUWKRJRQDO&(05$LPDJHV7KHPHDVXUHPHQWVZHUHYDOLGDWHG XVLQJ 3HDUVRQ FRUUHODWLRQ DQG %ODQG$OWPDQ DQDO\VLV 5HOLDELOLW\ ZDV DVVHVVHG XVLQJWKH%ODQG$OWPDQPHWKRG 5HVXOWV&RPSDULVRQRIWKHGLDPHWHUVUHYHDOHGVWURQJFRUUHODWLRQIRUWKHDVFHQGLQJ DQGGHVFHQGLQJDRUWDZLWKU SDQGSUHVSHFWLYHO\ 0RGHUDWHFRUUHODWLRQZDVIRXQGIRUWKHDRUWLFDUFKDQGSXOPRQDU\WUXQNZLWKU SDQGU SUHVSHFWLYHO\7KHDEGRPLQDODRUWDVKRZHG VWURQJ FRUUHODWLRQ DV ZHOO ZLWK U S DQG U S I R U WKH LQIUDGLDSKUDJPDO DQG VXSUDUHQDO DRUWD DQG U S DQG U SIRUWKHLQIUDUHQDODRUWDDQGDRUWLFELIXUFDWLRQ0HDQELDVZDVOHVVWKDQ RUHTXDOWRFPOLPLWVRIDJUHHPHQWZHUHOHVVWKDQFP ,QWUDDQGLQWHUREVHUYHUDJUHHPHQWZDVH[FHOOHQW &RQFOXVLRQ$[LDOPHDVXUHPHQWRIWKHGLDPHWHUVRIWKHWKRUDFRDEGRPLQDODRUWD DQGSXOPRQDU\WUXQNXVLQJSODLQ9,%(LPDJHVLVKLJKO\YDOLGDQGUHOLDEOH % ,QWUDREVHUYHUDQGLQWHUREVHUYHUYDULDELOLW\RI&7EDVHGYROXPHWU\ DQGGLDPHWHUPHDVXUHPHQWVRIDEGRPLQDODRUWLFDQHXU\VPVDIWHU HQGRYDVFXODUDQHXU\VPUHSDLU :+6RPPHU0+DDFN) 0HLQHO0) 5HLVHU5:HLGHQKDJHQ 0XQLFK'(ZLHODQGVRPPHU#PHGXQLPXHQFKHQGH 3XUSRVH 7 R GHWHUPLQH WKH PRVW UHSURGXFLEOH DQG VXLWDEOH PHDVXUHPHQWV IRU FKDQJHV RI DEGRPLQDO DRUWLF DQHXU\VPV DIWHU HQGRYDVFXODU DQHXU\VP UHSDLU (9$5 0HWKRGVDQG0DWHULDOVFRQVHFXWLYHSDWLHQWVVXFFHVVIXOO\WUHDWHGE\(9$5 XQGHUZHQW URZ IROORZXS &7$ LQ PP FROOLPDWLRQ 0DQXDO GLDPHWHU DQG YROXPHWULFPHDVXUHPHQWVZHUHSHUIRUPHGWZLFHE\WZREOLQGHGDQGH[SHULHQFHG UHDGHUVZLWKDWOHDVWDZHHNLQWHUYDOEHWZHHQUHDGLQJV0D[LPXPD[LDODQGRU WKRJRQDODRUWLFGLDPHWHUVDVZHOODVYROXPHWU\RIWKHDEGRPLQDODRUWLFDQHXU\VP ZDVSHUIRUPHGXVLQJ2VLUL[VRIWZDUH,QWUDDQGLQWHUUHDGHUYDULDELOLWLHVZHUHGHWHU PLQHGE\FRQFRUGDQFHFRUUHODWLRQFRHIÀFLHQWV&&&0HDQWLPHIRUVHPLDXWRPDWHG YROXPHWU\RIWKHDRUWLFDQHXU\VPDQGIRUGLDPHWHUPHDVXUHPHQWVZDVUHFRUGHG 5HVXOWV,QWHUUHDGHUDJUHHPHQWZDVVLJQLÀFDQWO\KLJKHUIRUYROXPHWU\&&& &,WKDQIRUWKHD[LDOGLDPHWHU&&& &, DQG WKH RUWKRJRQDO GLDPHWHU PHDVXUHPHQW &&& &, S%RWKIRUUHDGHUVDQGLQWUDUHDGHUDJUHHPHQWZDVVLJQLÀFDQWO\KLJKHU IRU YROXPHWU\ &&& &, FRPSDUHG WR WKH RUWKRJRQDO GLDPHWHU&&& &,DQGWKHD[LDOGLDPHWHU&&& &,7KHPHDQWLPHIRUDRUWLFYROXPHWU\ZDVPLQZKLOH LWZDVPLQDQGPLQIRURUWKRJRQDODQGD[LDODRUWLFGLDPHWHUUH VSHFWLYHO\S &RQFOXVLRQ7KHUHOLDELOLW\RIDQHXU\VPDOYROXPHWU\XVLQJ&7$LVH[FHOOHQWIRUVH ULDOPHDVXUHPHQWVE\LQGLYLGXDOUHDGHUVDQGEHWZHHQGLIIHUHQWUHDGHUV$OWKRXJK LWLVWLPHFRQVXPLQJWKLVPHWKRGLVWKHPRVWVXLWDEOHWRGHWHFWVPDOOFKDQJHVLQ DQHXU\VPDOVL]H 6FLHQWLILF6HVVLRQ $ 6&'()*+% 7KXUVGD\ (XURSHDQ&RQJUHVVRI 5DGLRORJ\ LPSDFWRIHQKDQFHPHQWSDWWHUQVRQWKHHQGROHDNGHWHFWLRQUDWHDQGWRGHÀQHWKH RSWLPDOVFDQWLPLQJ 0HWKRGV DQG 0DWHULDOV 6HYHQW\RQH SDWLHQWV \HDUV DIWHU (9$5 RI WKH DEGRPLQDODRUWDZHUHUHWURVSHFWLYHO\LQFOXGHG$OOSDWLHQWVXQGHUZHQWG&7$ZLWK XQLGLUHFWLRQDOVFDQSKDVHVRQDVHFRQGJHQHUDWLRQGXDOVRXUFH&7N9 5HIP$V])29 PPWHPSRUDOUHVROXWLRQVHFPO>POVHF@FRQWUDVW > PJ LRGLQHPO@ EROXV WUDFNLQJ +8 IROORZHG E\ D YHQRXV SKDVH DQG D SUHOLPLQDU\ELSKDVLFV&7$(QKDQFHPHQWZDVDVVHVVHGIRUDOOVFDQSKDVHVE\ 52,PHDVXUHPHQWVLQDRUWDDQGGHWHFWDEOHHQGROHDNV,PDJHTXDOLW\ZDVUDWHG E\DSRLQWFRQÀGHQFHVFDOH 5HVXOWV,QG&7$WKHKLJKHVWPHDQDRUWLFHQKDQFHPHQWFRXOGEHDFKLHYHGVHF SRVWWKUHVKROGSWWKHKLJKHVWPHDQHQGROHDNHQKDQFHPHQWFRQVLGHUDEO\ODWHU DWVHFSW:LWKLQDWRWDORIHQGROHDNVZHUHQHZO\GHWHFWHGQRW YLVLEOHLQSUHOLPLQDU\V&7$'HWHFWLRQUDWHVGLIIHUHGVLJQLÀFDQWO\LQEHWZHHQWKH G&7$SKDVHVS7KHKLJKHVWGHWHFWLRQUDWHQ ZDVREWDLQHGVHFSW ZKHQWKHGLIIHUHQFHVEHWZHHQDRUWLFDQGHQGROHDNHQKDQFHPHQWDQGWKHUHIRUH WKHFRQWUDVWUHDFKHGLWVPD[LPXP7KHPHDQGRVHOHQJWKSURGXFWGLIIHUHGE\ G&7$P*\ FPV&7$P*\ FPS &RQFOXVLRQ '\QDPLF &7$ LQ WKH SRVW(9$5 IROORZXS UHYHDOHG WKDW WKH SHDN HQKDQFHPHQWRIHQGROHDNVDQGDRUWDDUHVLJQLÀFDQWO\GLIIHUHQWDQGQRWFRYHUHG VXIÀFLHQWO\E\FRQYHQWLRQDOELSKDVLFV&7$SURWRFROV7KHXVHRIG&7$LVDVVRFLDWHG ZLWKDVLJQLÀFDQWO\LQFUHDVHGGHWHFWLRQUDWHRIHQGROHDNV % 2QH\HDUDIWHUHQGRYDVFXODUDEGRPLQDODRUWLFDQHXU\VPUHSDLU (9$5RQHWKLUGRIWKHDQHXU\VPVDFVWLOOFRQVLVWVRIXQRUJDQLVHG WKURPEXVLQSDWLHQWVZLWKDQGZLWKRXWGHWHFWDEOHHQGROHDN 6$&RUQHOLVVHQ (-9RQNHQ-9DQ3UHKQ+-09HUKDJHQ ) /0ROO/:%DUWHOV$PHUVIRRUW1/8WUHFKW1/5RWWHUGDP1/ VDSFRUQHOLVVHQ#PHDQGHUPFQO 3XUSRVH7KHSXUSRVHRIWKLVVWXG\ZDVWRPRQLWRUWKURPEXVRUJDQLVDWLRQGXULQJ WKHÀUVW\HDUDIWHU(9$5ZLWK05, 0HWKRGV DQG 0DWHULDOV ,Q WKLV ,5%DSSURYHG SURVSHFWLYH VWXG\ SDWLHQWV XQGHUZHQW 05,H[DPV SUHRSHUDWLYHO\ ZHHNV SRVWRSHUDWLYHO\ P R Q W K V DQG\HDUDIWHU(9$53UHFRQWUDVW77DQGSRVWFRQWUDVW7ZLPDJHVZHUH DFTXLUHG$QH[SHULHQFHGUDGLRORJLVWVXEGLYLGHGWKHDQHXU\VPVDFLQWRUHJLRQVRI HQGROHDNXQRUJDQLVHGDQGRUJDQLVHGWKURPEXVEDVHGRQWKHVLJQDOLQWHQVLWLHVRQ WKHGLIIHUHQWO\ZHLJKWHGLPDJHVXVLQJFXVWRPZULWWHQVRIWZDUH 5HVXOWV 7KH PHDQ XQRUJDQLVHG WKURPEXV YROXPH SUHRSHUDWLYHO\ ZDV PO&,POSRVWRSHUDWLYHO\PO&,PODIWHUPRQWKV PO&,PODQGDIWHU\HDUPOPO7KHUHZDVDVLJQLÀFDQW LQFUHDVH LQ XQRUJDQLVHG WKURPEXV YROXPH SRVWRSHUDWLYHO\ FRPSDUHG ZLWK SUH RSHUDWLYHO\SDLUHGWWHVWSDIWHUZKLFKWKHXQRUJDQLVHGWKURPEXVYROXPH VLJQLÀFDQWO\GHFUHDVHGDIWHURQH\HDUSDLUHGWWHVWSSDWLHQWVKDGD W\SH,,HQGROHDNRQWKHSRVWRSHUDWLYH&7H[DP,QWKHVHSDWLHQWVDODUJHUSDUWRIWKH DQHXU\VPVDFFRQVLVWHGRIXQRUJDQLVHGWKURPEXVDIWHUPRQWKVWKDQLQSDWLHQWV ZLWKRXWDW\SH,,HQGROHDNPHDQRIDQHXU\VPVDFYROXPH&,YV PHDQRIDQHXU\VPVDFYROXPH&,LQGHSHQGHQWWWHVWS &RQFOXVLRQ0HDVXUHPHQWRIWKHGHJUHHRIWKURPEXVRUJDQLVDWLRQRIWKHLQWUD DQHXU\VPDOWKURPEXVDIWHU(9$5LVSRVVLEOHZLWK05, $IWHU(9$5WKHXQRUJDQLVHG WKURPEXVYROXPHGHFUHDVHVLQWLPHKRZHYHUERWKLQSDWLHQWVZLWKDQGZLWKRXW HQGROHDN RQH \HDU DIWHU (9$5 VWLOO RQHWKLUG RI WKH DQHXU\VP VDF FRQVLVWV RI XQRUJDQLVHGWKURPEXVRIXQNQRZQDHWLRORJ\ % 9DOLGDWLRQRIUDGLDOO\XQGHUVDPSOHGSRLQWHQFRGHG'ÁRZ05 3&9,35LQWKRUDFLFDRUWDDQGPDLQSXOPRQDU\DUWHU\ $)U\GU\FKRZLF] (1LHVSRG]DQ\6%5HHGHU2:LHEHQ .0-RKQVRQ&-)UDQFRLV0DGLVRQ:,86/EHFN'(0DGLVRQ:,86 DOH[IU\GU\FKRZLF]#XNVKGH 3XUSRVH7 RYDOLGDWHUDGLDOO\XQGHUVDPSOHGSRLQWYHORFLW\HQFRGHG'ÁRZ05 3&9,35 IRU TXDQWLÀFDWLRQ RI DRUWLF $$2 DQG PDLQ SXOPRQDU\DUWHU\ 03$ ÁRZV LQ FRPSDULVRQ WR FDUGLDF 05 YROXPHWU\ DQG ' SKDVH FRQWUDVW LPDJLQJ '3&05, 0HWKRGVDQG0DWHULDOVFDUGLRYDVFXODUKHDOWK\YROXQWHHUV\HDUV %0, ZHUH VFDQQHG DW 7 ZLWK HOHPHQWV RI D FKDQQHOFRLO/HIWDQGULJKWYHQWULFXODUYROXPHWU\XVLQJ&,1(E66)3LQFRQWLJX RXVVKRUWD[LVVOLFHVDQG'3&05,LQ$$2DQG03$VHUYHGDVUHIHUHQFHV$OO '3&05,H[DPVDQG3&9,35H[DPVZHUHSKDQWRPFRUUHFWHGDFFRUGLQJ WR&KHUQREHOVN\HWDO3&9,35ZDVSHUIRUPHGZLWKYHQF FPVUHFRQVWUXFWHG WRWLPHIUDPHV3&9,35GDWDZHUHDXWRPDWLFDOO\FRUUHFWHGIRUHGG\FXUUHQWV % 4XDQWLÀFDWLRQRIPLFURYDVFXODUYHVVHOZDOOFKDUDFWHULVWLFVRI DEGRPLQDODRUWLFDQHXU\VPVZLWK05,IHDVLELOLW\UHSURGXFLELOLW\DQG LQLWLDOH[SHULHQFH 9/1JX\HQ :+%DFNHV(0.RRL0&-:LVKDXSW ) $09+HOOHQWKDO0(+%RVERRP5-9DQGHU*HHVW*:+6FKXULQN 7 /HLQHU0DDVWULFKW1/(LQGKRYHQ1//HLGHQ1/8WUHFKW1/ YOQJX\HQ#PDDVWULFKWXQLYHUVLW\QO 3XUSRVH $SURPLQHQWFKDUDFWHULVWLFRIWKHDEGRPLQDODRUWLFDQHXU\VP$$$YHV VHOZDOOLVQHRYDVFXODULVDWLRQZKLFKKDVEHHQOLQNHGZLWK$$$SURJUHVVLRQDQG UXSWXUH7KHDLPRIWKHSUHVHQWVWXG\ZDVWRLQYHVWLJDWHWKHSRWHQWLDORIG\QDPLF FRQWUDVWHQKDQFHG05,'&(05,WRFKDUDFWHULVH $$$YHVVHOZDOOQHRYDVFXODWXUH E\TXDQWLÀFDWLRQRIWKHHQKDQFHPHQWG\QDPLFV 0HWKRGVDQG0DWHULDOVSDWLHQWVXQGHUZHQW'&(05,RIWKHDEGRPLQDODRUWD DW7 HVOD(QKDQFHPHQWG\QDPLFVZHUHTXDQWLÀHGE\FDOFXODWLQJWKHWUDQVIHU FRQVWDQW .WUDQV XVLQJ SKDUPDFRNLQHWLF PRGHOOLQJ DQG WKH DUHDXQGHUFXUYH $8&7 HQSDWLHQWVZHUHLPDJHGWZLFHRQGLIIHUHQWRFFDVLRQV,QWUDFODVVFRUUHODWLRQ FRHIÀFLHQWV,&&ZHUHGHWHUPLQHGWRLQYHVWLJDWHLQWHUVFDQLQWHUDQGLQWUDREVHUYHU YDULDELOLW\ $VVRFLDWLRQVEHWZHHQ.WUDQV $8&DQGPD[LPDOGLDPHWHUZHUHFRPSXWHG DVD3HDUVRQFRUUHODWLRQFRHIÀFLHQWU 5HVXOWV,QWRWDORIWKH05,H[DPLQDWLRQVFRXOGEHLQFOXGHGIRUSKDUPDFRNL QHWLFDQDO\VHV,QWHUVFDQLQWHUDQGLQWUDREVHUYHUYDULDELOLW\IRU.WUDQVDQG$8& PHDVXUHPHQWVZHUHH[FHOOHQW,&&!7KHPD[LPDOGLDPHWHUPHDQ6' PPZDVVLJQLÀFDQWO\FRUUHODWHGZLWK.WUDQVPLQU S EXWQRWZLWK$8&PHDVXUHPHQWV &RQFOXVLRQ4XDQWLWDWLYHDQDO\VLVRIHQKDQFHPHQWG\QDPLFVRIWKH$$$YHVVHO ZDOOZKLFKPD\UHÁHFWWKHH[WHQWRIQHRYDVFXODULVDWLRQLVIHDVLEOHDQGUHSURGXFLEOH 7KHUHLVDPRGHUDWHFRUUHODWLRQEHWZHHQWKHDRUWLFDQHXU\VPZDOOHQKDQFHPHQW .WUDQVDQG$$$PD[LPDOGLDPHWHU7KLVVWXG\ZDVIXQGHGE\WKH'XWFK+HDUW )RXQGDWLRQ% % 8VLQJHQJLQHHULQJPDWKHPDWLFDOPRGHOVDQG&7'LPDJLQJWR XQGHUVWDQGWKHKDHPRG\QDPLFDIWHUDRUWLFSURVWKHVLVLQVHUWLRQ /9)RU]HQLJR 3 %LRQGHWWL0'RPDQLQ&9HUJDUD%%DUEHULV0LODQ,7 5DQLFD,7SLELRQGH#WLQLW 3XUSRVH7KHPDLQJRDORIWKLVVWXG\LVWRGHPRQVWUDWHWKHSRVVLELOLW\RIPDWKHPDWL FDOPRGHOOLQJRIWKHEORRGÁRZLQFDUGLRYDVFXODUSDWKRORJLHVVXFKDV$$$ERWK EHIRUHDQGDIWHUHQGRYDVFXODUWUHDWPHQW(9$XVLQJG\QDPLF' 0HWKRGV DQG 0DWHULDOV 6LQFH WLOO ZH HQUROOHG ZKR XQGHUZHQW HQGRSURVWKHVLVLQVHUWLRQEHFDXVHRI$$$(DFKSDWLHQWZDVVWXGLHGEHIRUHDQG DIWHU LQWHUYHQWLRQ ZLWK 'RSSOHU 8OWUDVRXQG DQG 'RXEOH 6RXUFH (&*JDWHG 5RZV&7$QJLRJUDSK\&7',&20GDWDZHUHIRU'PRGHOJHRPHWU\H[WUDFWLRQ DQG 0HVK JHQHUDWLRQ DQG IRU PDWKHPDWLFDO PRGHOOLQJ RI DRUWLF KDHPRG\QDPLF EHIRUHDQGDIWHUSURVWKHVLVLQVHUWLRQ)URPWKHVHGDWDPDSVRISHDNZDOOVWUHVVRI ÁRZYHORFLW\SURÀOHVDQGRILQZDUGRXWZDUGZDOOGLVSODFHPHQWGXULQJRQHFDUGLDF F\FOHZHUHFDOFXODWHG 5HVXOWV3UHOLPLQDU\UHVXOWVVKRZWKDWLQWKHQDWLYH$$$WKHV\VWROLFRXWZDUGZDOO GLVSODFHPHQWLVFRUUHODWHGZLWKORZYHORFLW\KLJKSUHVVXUHDQGÁRZYHORFLW\SURÀOHV $IWHUHQGRSURVWKHVLVLQVHUWLRQWKHUHLVDQLQFUHDVHRILQWUDSURVWKHVLVÁRZYHORFLW\ ZLWKDGHFUHDVHRIODWHUDOSUHVVXUH'HIRUPDWLRQDQGSXOVDWLRQRIWKHPHWDOOLFVWHQW VWUXFWXUHKDSSHQHGDIWHUWKHÀUVW\HDURIIROORZXS7KHPLGVWHQWORFDWLRQRIWKH GHIRUPDWLRQZHOOFRUUHODWHGZLWKWKHORFDWLRQRIWKHPD[LPXPYHORFLW\FKDQJHGXU LQJFDUGLDFSXOVDWLRQ7KHULJLGSURVWKHVLVLQWHUUXSWVWKHSUHVVXUHZDYHRULJLQDWHG E\WKHFDUGLDFSXOVDWLRQZLWKJHQHUDWLRQRIEDFNZDUGFRPSRQHQWVZLWKSRVVLEOH ORQJWHUPQHJDWLYHHIIHFWVRQWKHFDUGLDFIXQFWLRQ &RQFOXVLRQ&RPSXWDWLRQDOEORRGÁRZG\QDPLFVXVLQJ'&7GDWDFRXOGSUHGLFW WKH ULVN RI DQHXULVPDO UXSWXUH /DWH GHIRUPDWLRQ RI (9$5 FDQ EH H[SODLQHG E\ FKDQJHVLQEORRGÁRZG\QDPLFV % '\QDPLFG&7$YHUVXVVWDWLFV&7$FRPSXWHGWRPRJUDSK\ DQJLRJUDSK\DIWHUDEGRPLQDODRUWLFHQGRYDVFXODUDQHXU\VPUHSDLU (9$5LQÁXHQFHRIHQKDQFHPHQWSDWWHUQVDQGRSWLPDOEROXVWLPLQJ RQHQGROHDNGHWHFWLRQ &$QGUHV&/XHFNH%)ROG\QD0*URWKRII61LW]VFKH $6FKPLGW'6FKHLQHUW0*XWEHUOHW//HKPNXKO /HLS]LJ'(FODXGLDDQGUHVPDLO#JRRJOHPDLOFRP 3XUSRVH7 RDVVHVVGLIIHUHQFHVRIDRUWLFDQGHQGROHDNHQKDQFHPHQWLQSDWLHQWV DIWHU (9$5 XVLQJ WKH UHFHQWO\ LQWURGXFHG G&7$ YHUVXV V&7$ WR HYDOXDWH WKH 6FLHQWLILF6HVVLRQ 6 &$' ( ) *+% (XURSHDQ&RQJUHVVRI 5DGLRORJ\ ZLWKUHQDOFHOOFDUFLQRPD5&&DQGNQRZQWXPRXUPLFURYDVFXODUGHQVLW\09' ZHUHDQDO\VHGZLWKDOOPRGHOVDQGUHVXOWVFRPSDUHG 5HVXOWV6LPXODWLRQ)RULQMHFWLRQWLPHVVKRUWHUWKDQWXPRXU077 %)06DJUHHV SHUIHFWO\ZLWK%)LQSXWIRULQMHFWLRQWLPHVQRWORQJHUWKDQWZLFHWKHWXPRXU077 %)06XQGHUHVWLPDWHV%)LQSXWE\QRWPRUHWKDQ%93/ZDVW\SLFDOO\ ORZHUWKDQ%9LQSXW $V%9LQSXW (DJUHHGZLWKLQZLWK%93/WKLV DSSHDUVWREHUDWKHUDGLIIHUHQFHLQ%9GHÀQLWLRQÀUVWSDVVGLVWULEXWLRQYVFDSLO ODU\YROXPH5&&VWXG\%)DQG%9IURPDOOPRGHOVFRUUHODWHGHTXDOO\ZHOOZLWK 09'UWRS $VSUHGLFWHGLQMHFWLRQWLPHV077 V DJUHHPHQW EHWZHHQ %) 06 DQG %) '& ZDV H[FHOOHQW VORSH U %93/ZDVORZHUWKDQ%9'&VORSHU ,IFRUUHFWHGZLWK( WKHGLIIHUHQFHUHGXFHGWR &RQFOXVLRQ6LPSOLÀHGPRGHOVFDQEHXVHIXODOWHUQDWLYHVLIUDGLDWLRQH[SRVXUHDQG RUWHPSRUDOVDPSOLQJQHHGWREHOLPLWHG6\VWHPDWLFGLIIHUHQFHVFDQEHFRUUHFWHG IRUDOORZLQJFRPSDULVRQZLWKRWKHUVWXGLHV % 5HGXFHGWLPH&7SHUIXVLRQDFTXLVLWLRQVDUHVXIÀFLHQWWRPHDVXUH WKHSHUPHDELOLW\VXUIDFHDUHDSURGXFWZLWKDGHFRQYROXWLRQPHWKRG 0$0D]]HL(6DQL6*XHUULQL1&LRIÀ6TXLWLHUL()RGHUDҋ &GH0DXUR) *0D]]HL/9ROWHUUDQL6LHQD,7)ORUHQFH,7 PPD]]HL#VLUPRUJ 3XUSRVH7KHDFTXLVLWLRQWLPHLQ&7SHUIXVLRQVWXGLHVVLJQLÀFDQWO\DIIHFWVSDWLHQWҋV GRVHH[SRVXUH,QRUGHUWRUHGXFHWKHUDGLDWLRQGRVHUHGXFHGWLPH&7SHUIXVLRQ DFTXLVLWLRQVDUHWHVWHGWRPHDVXUH36ZLWKDGHFRQYROXWLRQPHWKRG 0HWKRGVDQG0DWHULDOV36ZDVFDOFXODWHGZLWKUHSHDWHGPHDVXUHPHQWVQ ZKLOHWUXQFDWLQJWKHWLPHGHQVLW\FXUYHDWGLIIHUHQWWLPHYDOXHVLQ&7SHUIXVLRQ VWXGLHVFRQGXFWHGIRUOXQJFDQFHUQ +RGJNLQO\PSKRPDQ DQGUHQDOFHOO FDUFLQRPDQ XVLQJ&7SHUIXVLRQ'VRIWZDUH*(+HDOWKFDUH7KHPHGLDQ DFTXLVLWLRQWLPHRI&7SHUIXVLRQVWXGLHVZDVVHFUDQJHVHF7 RYHULI\WKH DFFXUDF\RIWKHGHFRQYROXWLRQDOJRULWKPDYDULDWLRQRIWKHWUXQFDWHG36ZLWKLQWKH HUURUPHDVXUHPHQWVZDVVHDUFKHGLHZLWKLQVWDQGDUGGHYLDWLRQVIURPWKHPHDQ QRPLQDOHUURUSURYLGHGE\WKHVRIWZDUH$VDVDQLW\FKHFNWKHWHVWZDVSHUIRUPHG IRUDOOWKHSDUDPHWHUVPHDVXUHGXVLQJ&73HUIXVLRQ'VRIWZDUH 5HVXOWV36ZDVFRQVLVWHQWZLWKLQLQaWRaVHFRQGVDQGZLWKLQLQ aWRaVHFRQGV36ZDVFRQVWDQWDIWHUWRVHF $FRQVLVWHQWUHVXOWODVWHG IRUDOOWKHREVHUYHGSDUDPHWHUV077 %9%)DVH[SHFWHGIURPWKHLUDQDO\WLFDO GHSHQGHQFH &RQFOXVLRQ 7KLUW\ÀYH VHFRQGV DUH HQRXJK WR REWDLQ D UHOLDEOH ,5) LPSXOVH UHVLGXDOIXQFWLRQ)RUDQDFFXUDWHPHDVXUHPHQWRIWKH36DVHFDFTXLVLWLRQ WLPHVKRXOGEHDQRSWLPDOFRPSURPLVHWRREWDLQUHOLDEOH36PHDVXUHPHQWVDQGD UHDVRQDEOHGRVHH[SRVXUH1RDGGLWLRQDOLQIRUPDWLRQFDQEHSURYLGHGZLWKORQJHU SHUIXVLRQDFTXLVLWLRQWLPHV % ,PSURYLQJLPDJHTXDOLW\RIYROXPHWULFKHOLFDOSHUIXVLRQ&7DWN9 XVLQJVSDWLRWHPSRUDOÀOWHULQJDVWUDWHJ\IRUGRVHUHGXFWLRQ $5DGKDNULVKQDQ,6LPFRFN-6WLUOLQJ$.KDQ5*O\QQH-RQHV9-*RK /RQGRQ8. 3XUSRVH7 RDVVHVVWKHFKDQJHLQLPDJHTXDOLW\RISHOYLFYROXPHWULFKHOLFDOSHU IXVLRQ&7WHFKQLTXHVZLWKWKHDSSOLFDWLRQRIDVSDWLRWHPSRUDOÀOWHU 0HWKRGV DQG 0DWHULDOV )ROORZLQJ HWKLFDO DSSURYDO DQG LQIRUPHG FRQVHQW SDWLHQWVPDOHVIHPDOHVZLWKSHOYLFFDQFHUVXQGHUZHQWDYROXPHWULFKHOLFDO SHUIXVLRQ&7VWXG\6RPDWRP'HÀQLWLRQ6LHPHQVXVLQJWKHIROORZLQJSDUDPHWHUV N9P$V'DGDSWLYHVSLUDOVF\FOHWLPHFP]D[LVP/ PJP/,RYHUVRO,9DWP/VHF)ROORZLQJPRWLRQFRUUHFWLRQLPDJHVZHUH UHFRQVWUXFWHGDWPPDQGPPVOLFHWKLFNQHVVZLWKDQGZLWKRXWDSSOLFDWLRQRID VSDWLRWHPSRUDOÀOWHU'QRLVHUHGXFWLRQ,PDJHQRLVHZDVDVVHVVHGE\SODFHPHQW RIDUHJLRQRILQWHUHVWZLWKLQPXVFOHDQGWXPRXUDWDQGPPVOLFHWKLFNQHVV UHVSHFWLYHO\7KHVWDQGDUGGHYLDWLRQRIWKH52,HTXLYDOHQWWRҊQRLVHҋZDVUHFRUGHG 7KHWXPRXUFRQWUDVWWRQRLVHUDWLR&15ZDVFDOFXODWHGE\GLYLGLQJWXPRXUHQ KDQFHPHQWE\QRLVH&15EHIRUHDQGDIWHUÀOWHUDSSOLFDWLRQZHUHFRPSDUHGXVLQJ SDLUHGWWHVWLQJZLWKVLJQLÀFDQFHDW 5HVXOWV0HDQQRLVHGHFUHDVHGIROORZLQJÀOWHUDSSOLFDWLRQIURPWRDW PPDQGWRDWPPIRUPXVFOHDQGIURPWRDWPPDQG WRDWPPIRUWXPRXU&RQWUDVWWRQRLVHUDWLRLQFUHDVHGIURPWR DWPPS DQGWRDWPPS &RQFOXVLRQ $SSOLFDWLRQRIDVSDWLRWHPSRUDOÀOWHUGHFUHDVHVQRLVHDQGVLJQLÀFDQWO\ LQFUHDVHVWKHFRQWUDVWWRQRLVHUDWLRDWPP7KLVKDVWKHHIIHFWRILQFUHDVLQJWKH &15DWPPWRDQHTXLYDOHQWPPVOLFHWKLFNQHVV DQG0D[ZHOOWHUPV&RQWUDVWHQKDQFHG05$XVLQJPPRONJJDGRIRVYHVHW WULVRGLXPZDVSHUIRUPHGWRIDFLOLWDWH'SODQHSODFHPHQWVLPXOWDQHRXVO\SURYLGLQJ FRQVWDQWO\KLJKVLJQDOWRQRLVHUDWLRWKURXJKRXWWKHH[DP%ODQG$OWPDQDQDO\VLV DYHUDJHGLIIHUHQFH6'DQGFRUUHODWLRQZHUHDSSOLHGIRUVWDWLVWLFDOWHVWLQJ 5HVXOWV%ODQG $OWPDQDQDO\VLVVKRZVDPDUNHGELDVEHWZHHQQRQFRUUHFWHG3& 9,35DQG&,1(E66)3$$2P/%$ZLQGRZWR03$P/ WR DQG EHWZHHQ QRQFRUUHFWHG 3&9,35 DQG SKDQWRPFRUUHFWHG '3&05,$$2WR03$P/WR3KDQWRP FRUUHFWLRQRI3&9,35GDWDLPSURYHGWKHELDVWRZDUGVERWK&,1(E66)3DQG' 3&05,7KHEHVWFRUUHODWLRQZDVUHDFKHGEHWZHHQSKDQWRPFRUUHFWHG3&9,35 DQG'3&05,5 &RQFOXVLRQ3&9,35ZLWKSRLQWYHORFLW\HQFRGLQJSHUPLWVWKHPHDVXUHPHQWRI EORRGÁRZLQWKHWKRUDFLFDRUWDDQGSXOPRQDU\DUWHU\VLPXOWDQHRXVO\WRPRUSKRORJLF DQGKDHPRG\QDPLFLQIRUPDWLRQ7KLVRQJRLQJHYDOXDWLRQLVOLPLWHGE\WKHYDULDELOLW\ RIWKHUHIHUHQFHPHWKRGVDQGRXWOLHUVLQÁXHQFLQJWKHUHVXOWVGLVSURSRUWLRQDOO\ 5RRP3 3K\VLFVLQ5DGLRORJ\ 66 )XQFWLRQDOLPDJLQJ 0RGHUDWRUV &/HLGHFNHU)RUFKKHLP'( 02QX%XFKDUHVW52 % 0HWDODUWHIDFWUHGXFWLRQLQGXDOVRXUFHFRPSXWHGWRPRJUDSK\XVLQJ PRQRHQHUJHWLFH[WUDSRODWLRQDV\VWHPDWLFDOO\RSWLPLVHGSURWRFRO ) *0HLQHO4=KDQJ) %DPEHUJ%%LVFKRII 0) 5HLVHU7 5&-RKQVRQ0XQLFK'(+DQJ]KRX&1 IHOL[PHLQHO#PHGXQLPXHQFKHQGH 3XUSRVH 0RQRHQHUJHWLF H[WUDSRODWLRQ LV D SURPLVLQJ VWUDWHJ\ WR UHGXFHPHWDO DUWHIDFWVLQGXDOVRXUFHFRPSXWHGWRPRJUDSK\'6&7:HSHUIRUPHGWKLVVWXG\ WR V\VWHPDWLFDOO\ RSWLPLVH LPDJH DFTXLVLWLRQ DQG UHFRQVWUXFWLRQ SDUDPHWHUV IRU WKLVDSSURDFK 0HWKRGVDQG0DWHULDOV$VWDQGDUGKLSSKDQWRPZDVORDGHGZLWKWLWDQLXPDQG FREDOWFKURPLXPPRGHOVRIKLSSURVWKHVHVDQGVFDQQHGRQD'6&7VFDQQHU6R PDWRP'HÀQLWLRQ)ODVK6LHPHQV)RUFKKHLP*HUPDQ\7XEHVSHFWUDWXEHFXUUHQW UDWLRFROOLPDWLRQSLWFKURWDWLRQWLPHDQGH[WUDSRODWHGHQHUJLHVZHUHRSWLPLVHG LQDVWHSZLVHSURFHVV$UWHIDFWVDQGLPDJHQRLVHZHUHTXDQWLÀHGE\PHDVXULQJ WKHVWDQGDUGGHYLDWLRQ6'RIWKH&7GHQVLW\LQDFLUFXODUUHJLRQRILQWHUHVWSODFHG DURXQGWKHSURVWKHVLVDQGFRQWUDODWHUDOO\UHVSHFWLYHO\ 5HVXOWV6QN9SSURYHGVXSHULRUWR6QN9SDQGN9SHV SHFLDOO\IRUWKLFNFREDOWFKURPLXPHOHPHQWV6'+8YV+87KHUHZDVD EHQHÀWIRULQFUHDVLQJWXEHFXUUHQWUDWLRIURPWREXWQRWEH\RQGLQIDYRXU RIWKH6QN9SVSHFWUXP6'+8YV+8IRUFREDOWFKURPLXP$UWHIDFWV ZHUHOHVVVHYHUHIRUDFROOLPDWLRQRI[DVFRPSDUHGWR[6'+8YV +8IRUFREDOWFKURPLXP$SLWFKRIDWDURWDWLRQWLPHRIZDVFKRVHQDV RSWLPDOZKHQFRPSDULQJGLIIHUHQWFRPELQDWLRQVZLWKFRPSDUDEOHVFDQQLQJWLPHV 7KHRSWLPDOH[WUDSRODWHGSKRWRQHQHUJLHVZHUHNH9IRUWLWDQLXPDQG NH9IRUFREDOWFKURPLXP &RQFOXVLRQ 6Q N9S ZLWK D WXEH FXUUHQW UDWLR RI D FROOLPDWLRQRI [ DQG H[WUDSRODWHG HQHUJLHV RI NH9 DUH RSWLPDO SDUDPHWHUV IRU D GHGLFDWHG'6&7SURWRFROWKDWHIIHFWLYHO\UHGXFHVPHWDODUWHIDFWVE\PRQRHQHUJHWLF H[WUDSRODWLRQ % 0RGHOGHSHQGHQWGLIIHUHQFHVLQWXPRXUSHUIXVLRQ&7 (.ORW] 0-XHUJHQV9*RK+$ONDGKL)RUFKKHLP'(/RQGRQ8. =XULFK&+ 3XUSRVH6LPSOLÀHGPRGHOVVXFKDVPD[LPXPVORSH06DQG3DWODN3/KDYH WKHUHSXWDWLRQWREHOHVVDFFXUDWHWKDQGHFRQYROXWLRQ'&DSSURDFKHV2XUJRDO ZDVWRTXDQWLI\WKHGLIIHUHQFHVDQGDVVHVVWKHLUUHOHYDQFHIRUFOLQLFDOVWXGLHV 0HWKRGVDQG0DWHULDOV:HJHQHUDWHGHQKDQFHPHQWFXUYHVIURPSDWLHQWDUWHULDO LQSXWIXQFWLRQVE\FRQYROXWLRQZLWKSDUDPHWULFLPSXOVHUHVLGXHIXQFWLRQVYDU\LQJ EORRGÁRZ%)EORRGYROXPH%9PHDQWUDQVLWWLPH077DQGH[WUDFWLRQIUDFWLRQ (RYHUWKHUDQJHW\SLFDOO\IRXQGIRUWXPRXUV6LPXODWHGFXUYHVZHUHDQDO\VHGZLWK 06DQG3/DQGWKHUHVXOWVFRPSDUHGWRWKHLQSXW'\QDPLFGDWDIURPSDWLHQWV 6FLHQWLILF6HVVLRQ $ 6&'()*+% 7KXUVGD\ (XURSHDQ&RQJUHVVRI 5DGLRORJ\ 5HVXOWV%DVHGRQLWVJHRPHWU\WKHP05KDVDQLQFUHDVHGVHQVLWLYLW\RINFSV 0%T LQ DQG NFSV0%T RII WKH )29 FHQWUH P&7 NFSV0%T7KH DYHUDJH VSDWLDOUHVROXWLRQYDOXHVRIWKHP05DQGWKHP&7DUHFRPSDUDEOHPPPP QHDU WKH )29 FHQWUH 7KHVH ÀQGLQJV ZHUH XQDIIHFWHG E\ SDUDOOHO0 5 , V F D Q V 7KHQRLVHHTXLYDOHQWFRXQWUDWHRIWKHP05SHDNVDWN%TPOZLWKNFSV P&7 NFSV#N%TPO7KHVFDWWHUIUDFWLRQZDVPHDVXUHGWREH P&7 7KHLPDJHFRQWUDVWLQFUHDVHVIURPWRZKHUHDVWKH EDFNJURXQGYDULDELOLW\GHFUHDVHVIURPWRZLWKLQFUHDVLQJGLDPHWHUVRI DFWLYHVSKHUHVVSKHUHEDFNJURXQG0HDVXUHPHQWRI%KRPRJHQHLW\SSP LQDFPVSKHUH%ÀHOGGLVWULEXWLRQDQG5)QRLVHVKRZHGQRVLJQLÀFDQWGLIIHU HQFHVWRWKHUHIHUHQFH05V\VWHP6LPXOWDQHRXV3(7DFTXLVLWLRQVKDGQRHIIHFW &RQFOXVLRQ3URSHULQWHJUDWLRQRI$3'3(7WHFKQRORJ\DQG705,GRHVQRW OLPLWWKHSHUIRUPDQFHRIHLWKHUFRPSRQHQWLQFRPSDULVRQWRVWDWHRIWKHDUWVWDQG DORQHLQVWUXPHQWDWLRQ % &RPSDULVRQRI63$&(DQG'76(05&3UHJDUGLQJLPDJHTXDOLW\ DQGGLDJQRVWLFFHUWDLQW\LQSDWLHQWVLQDURXWLQHFOLQLFDOVHWWLQJ 3 6XGKROW &8ULJR*%RQJDUW]-+RKPDQQ%DVOH&+/RQGRQ8. VXGKROWS#XKEVFK 3XUSRVH:HFRPSDUHG'63$&(VDPSOLQJSHUIHFWLRQZLWKDSSOLFDWLRQRSWLPLVHG FRQWUDVW05&3ZLWKFRQYHQWLRQDO'76(05&3LQDURXWLQHFOLQLFDOVHWWLQJ $LP ZDVWRHYDOXDWHZKHWKHURUQRWWKH'63$&(05&3DOORZVEHWWHULPDJHTXDOLW\ LQSDWLHQWVDQGLIWKLVWUDQVODWHVDOVRWRDKLJKHUOHYHORIFRQÀGHQFHUHJDUGLQJWKH GLDJQRVLVRIFKROHGRFKROLWKLDVLV 0HWKRGVDQG0DWHULDOV'76(DQG'63$&(VHTXHQFHVZHUHFRQVHFXWLYHO\ REWDLQHG IURP SDWLHQWV XQGHUJRLQJ 05&3 DW RXU LQVWLWXWLRQ )RU HYDOXDWLRQ WKHSDQFUHDWLFRELOLDU\WUHHZDVVXEGLYLGHGLQWRVHJPHQWVZKLFKZHUHVFRUHG VHSDUDWHO\IRUYLVLELOLW\DQGGLDJQRVWLFFHUWDLQW\RQDÀYHSRLQWVFDOHHDFKE\WKUHH H[SHULHQFHGUDGLRORJLVWV 5HVXOWV,QWRWDOVHJPHQWVZHUHUHYLHZHGLQERWKVHTXHQFHV7KHDYHUDJH LPDJH TXDOLW\ ZDV UDWHG JRRG LQ ERWK VHTXHQFHV EXW KLJKHU IRU 63$&(05&3 WKDQIRU'76(YHUVXVQ S ,QRIVHJPHQWVLP DJHTXDOLW\LQ'63$&(ZDVVXSHULRUWR'76(ZKLOHLPDJHTXDOLW\LQ'76( ZDVEHWWHULQRQO\VHJPHQWVVHJPHQWVZKHUHUDWHGDVHTXDO'LDJQRVWLF FHUWDLQW\ZDVHYDOXDWHGEHWWHUIRU'63$&(WKDQ'76(LQRIVHJPHQWV ZKLOH'76(KDGDKLJKHUGLDJQRVWLFFHUWDLQW\LQRQO\VHJPHQWVVHJPHQWV ZKHUHUDWHGDVHTXDO &RQFOXVLRQ'63$&(05&3DOORZVVXSHULRULPDJHTXDOLW\DQGRIIHUVDKLJKHU GLDJQRVWLFFHUWDLQW\FRPSDUHGWRFRQYHQWLRQDO'76(05&3 ,WVKRXOGEHXVHG DVWKH05&3VHTXHQFHRIFKRLFHLQDFOLQLFDOURXWLQHVHWWLQJ % 'HYHORSPHQWRIDWLVVXHHTXLYDOHQWSKDQWRPIRUVWDQGDUGLVDWLRQRI GLIIXVLRQZHLJKWHG05, *:ROI0/DQLDGR1$EROPDDOL7 3DXOXV'UHVGHQ'( 3XUSRVH:LGHVSUHDGDSSOLFDWLRQRIGLIIXVLRQZHLJKWHG05,':05,LQRQFRORJ\ LVFXUUHQWO\LPSDLUHGGXHWROLPLWHGVWDQGDUGLVDWLRQDFURVVLQVWUXPHQWV7KHUHIRUH ZHDLPHGWRGHYHORSDSKDQWRPZLWKWLVVXHHTXLYDOHQW05,SURSHUWLHV$'&5 5IRU':05,VWDQGDUGLVDWLRQ 0HWKRGVDQG0DWHULDOV7KHLQÁXHQFHVRILQGLYLGXDOSKDQWRPFRPSRQHQWVDJDURVH JHOFRQFHQWUDWLRQ VXFURVH*G'73$P063,2P0 DQG SUHVHUYDWLYH VRGLXP D]LGH RQ 05, SURSHUWLHV ZHUH V\VWHPDWLFDOO\ HYDOXDWHG %DVHG RQ D OLQHDU FRPELQDWLRQ PRGHO RI VLQJOH FRPSRQHQWV HIIHFWV WKHWLVVXHHTXLYDOHQWSKDQWRPZDVFRPSRVHGWRUHVHPEOHLQYLYR05,SURSHUWLHV RIYDULRXVQRUPDODQGQHRSODVWLFWLVVXHVDFFRUGLQJWROLWHUDWXUHYDOXHV$'&5 DQG 5 RI WLVVXHHTXLYDOHQWV ZHUH PHDVXUHG E\ GLIIXVLRQZHLJKWHG VSLQHFKR (3, EYDOXHV VPP PXOWLFRQWUDVW LQYHUVLRQUHFRYHU\ 76( 7, YDOXHV PV DQG PXOWLFRQWUDVW 6( 7(YDOXHV PV XVLQJ D 7VFDQQHU$YDQWR6LHPHQV,QWUDDQGLQWHUVHULHVYDULDELOLW\ZDVHYDOXDWHG DFURVVPXOWLSOHDFTXLVLWLRQVZLWKLQWKHVDPHDQGDOOLPDJLQJVHVVLRQVUHVSHFWLYHO\ 5HVXOWV,QGLYLGXDOFRPSRQHQWVVKRZLQYHUVHOLQHDUVFDOLQJZLWKFRQFHQWUDWLRQV IRU$'&DQGOLQHDUVFDOLQJIRU5DQG57KHWLVVXHHTXLYDOHQWSKDQWRP\LHOGHG VWDEOH05,SDUDPHWHUVRYHUDWOHDVWGD\VDWURRPWHPSHUDWXUHVWRUDJH([SHUL PHQWDODQGUHIHUHQFH $'&YDOXHVRIWLVVXHHTXLYDOHQWVZHUHVLJQLÀFDQWO\FRUUHODWHG U S +RZHYHU5DQG5ZHUHOHVVDGHTXDWHO\LPLWDWHGS! ,QWUDDQGLQWHUVHULHV$'&YDULDELOLW\ZDVDQGUHVSHFWLYHO\ &RQFOXVLRQ7KHWLVVXHHTXLYDOHQWSKDQWRPSHUPLWVUHSHDWHGTXDQWLÀFDWLRQVRI 05,SDUDPHWHUVLQFRPELQDWLRQZLWKHDV\SUHSDUDWLRQDQGORQJWLPHVWDELOLW\DV ZHOODVVLPSOHKDQGOLQJDQGSRVLWLRQLQJ,WPD\EHXVHIXOLQTXDOLW\DVVXUDQFHDQG V\VWHPVWDQGDUGLVDWLRQSURFHGXUHV':05,VKRZVH[FHOOHQWUHSHDWDELOLW\ZLWKLQ WKHVDPHVFDQQHU % )XQFWLRQDOLPDJLQJRQDQLQWHUYHQWLRQDO&DUPÁDWGHWHFWRU&7V\VWHP 5%UDXZHLOHU) (LVD0+XSIHU7 1RZDN'.ROGLW]:$.DOHQGHU (UODQJHQ'(5REHUW%UDXZHLOHU#LPSXQLHUODQJHQGH 3XUSRVH7 RLQYHVWLJDWHWKHSRWHQWLDORIG\QDPLF&DUP&7WRDVVHVVIXQFWLRQDO SDUDPHWHUVIURPDWLPHUHVROYHGVHTXHQFHRIYROXPHWULFLPDJHV 0HWKRGVDQG0DWHULDOV0HDVXUHPHQWVZHUHSHUIRUPHGRQDQH[SHULPHQWDOURERWLF &DUPÁDWGHWHFWRU&7V\VWHPDOORZLQJIRUDVFDQWLPHRIVDQGIRUYDOLGD WLRQSXUSRVHRQDFOLQLFDO&7VFDQQHU)RUKDOIVFDQUHFRQVWUXFWLRQVWKHUHVXOWLQJ WHPSRUDOVDPSOLQJZDVVIRUIXOOVFDQUHFRQVWUXFWLRQVV2QWKHFOLQLFDO&7 ZHSHUIRUPHGVFDQVDWDQGVWHPSRUDOVDPSOLQJ:HXVHGDSHUIXVLRQ SKDQWRPZKLFKSURYLGHVUHSURGXFLEOHFRQWUDVWFXUYHV7KUHHGLIIHUHQWZDWHUÁRZ UDWHVZHUHXWLOLVHGWRVLPXODWHGLIIHUHQWIXQFWLRQDOEHKDYLRXU6FDQVZHUHUHSHDWHG WKUHHWLPHVDQGSRVWSURFHVVHGXVLQJWKHPD[LPXPVORSHPHWKRGWRDVVHVVWKH IXQFWLRQDOSDUDPHWHUVEORRGYROXPH%9EORRGÁRZ%)PHDQWUDQVLWWLPH077 DQGWLPHWRSHDN773 5HVXOWV)RUHDFKVDPSOLQJUDWHDQGDOOIXQFWLRQDOSDUDPHWHUVUHSURGXFLELOLW\HUURUV GLGQRWH[FHHGIRUERWKFOLQLFDO&7DQG&DUP&7 )RUVWHPSRUDOVDPSOLQJ LQWHUYHQWLRQDO&DUP&7DQGFOLQLFDO&7ZHUHLQDJUHHPHQWZLWKGHYLDWLRQVEHORZ IRU%) %9DQG773DQGEHORZIRU077 )RUORZHUWHPSRUDOVDPSOLQJV RIVDQGVIXQFWLRQDOSDUDPHWHUVGHYLDWHGE\XSWRFRPSDUHGWRWKH VVDPSOLQJFDVH &RQFOXVLRQ7KHDVVHVVPHQWRIIXQFWLRQDOSDUDPHWHUVE\&DUP&7VKRZVSURPLV LQJUHVXOWVDQGPD\VDYHYDOXDEOHWLPHLQSDWLHQWWUHDWPHQWZKHQQRDGGLWLRQDO&7 RU05,VFDQLVUHTXLUHGEHIRUHRUGXULQJWKHUDSHXWLFLQWHUYHQWLRQ % 9LUWXDOQRQFRQWUDVWLQVHFRQGJHQHUDWLRQGXDOHQHUJ\FRPSXWHG WRPRJUDSK\UHOLDELOLW\RIDWWHQXDWLRQYDOXHV 07 RHSNHU 7 0RULW]0:HEHU%.UDXVV7 0DQJ *(XOOHU) :ROI&-+HUROG+5LQJO9LHQQD$7 )RUFKKHLP'(PLFKDHOWRHSNHU#PHGXQLZLHQDFDW 3XUSRVH7 RHYDOXDWHWKHUHOLDELOLW\RIDWWHQXDWLRQYDOXHVLQYLUWXDOQRQFRQWUDVW LPDJHV91&UHFRQVWUXFWHGIURPFRQWUDVWHQKDQFHGGXDOHQHUJ\VFDQVSHUIRUPHG RQDVHFRQGJHQHUDWLRQGXDOHQHUJ\&7 FRPSDUHGWRVLQJOHHQHUJ\QRQFRQWUDVW LPDJHV71& 0HWKRGVDQG0DWHULDOV7KHLQVWLWXWLRQDOUHYLHZERDUGDSSURYHGWKLVUHVHDUFK DQGZDLYHGLQIRUPHGFRQVHQW6L[WHHQSKDQWRPVFRQWDLQLQJDPL[WXUHRIFRQWUDVW DJHQW DQG ZDWHU DW GLIIHUHQW DWWHQXDWLRQV +8 ZHUH LQYHVWLJDWHG RQ D 'HÀQLWLRQ)ODVK&7VFDQQHUXVLQJDVLQJOHHQHUJ\VFDQDWN9DQGD'(&7 SURWRFRON961N9)RUFOLQLFDODVVHVVPHQWSDWLHQWVIHPDOHVZKR UHFHLYHGDGXDOSKDVH&7 FRQWDLQLQJDQXQHQKDQFHGVLQJOHHQHUJ\VFDQDWN9 DQGDFRQWUDVWHQKDQFHGPO,RPHURQPJPOPOVHF'(&7N9 61N9LQDQDUWHULDOQ RUDYHQRXVSKDVHZHUHUHWURVSHFWLYHO\DQDO\VHG 0HDQDWWHQXDWLRQZDVPHDVXUHGZLWKLQUHJLRQVRILQWHUHVWRIWKHSKDQWRPVDQG LQGLIIHUHQWWLVVXHW\SHVRIWKHSDWLHQWVZLWKLQWKHFRUUHVSRQGLQJ91&DQG71& LPDJHV3DLUHGWWHVWVDQG3HDUVRQFRUUHODWLRQZHUHXVHGIRUVWDWLVWLFDODQDO\VLV 5HVXOWV )RU DOO SKDQWRPV PHDQ DWWHQXDWLRQ LQ 91& ZDV +8 ,Q SDWLHQWVRYHUDOOUHJLRQVZHUHPHDVXUHGLQ71&DQG91&LPDJHVZLWKD PHDQGLIIHUHQFHEHWZHHQ71&DQG91&RI+8,QQ RI DOOFDVHVDEVROXWHGLIIHUHQFHVEHWZHHQ71&DQG91&ZHUHXQGHU+8DQGLQ Q GLIIHUHQFHVZHUHXQGHU+8 &RQFOXVLRQ6HFRQGJHQHUDWLRQGXDOHQHUJ\&7EDVHG91&LPDJHVSURYLGHDW WHQXDWLRQYDOXHVFORVHWRWKRVHRI71&7 RXVH91&DVDQDOWHUQDWLYHWR71&LQ GDLO\FOLQLFDOURXWLQHDVDIHW\PDUJLQRI+8VKRXOGEHDSSOLHG % &KDUDFWHULVDWLRQRIWKHELRJUDSKP05 6)UVW*'HOVR%:-DNRE\5/DGHEHFN&*DQWHU6*1HNROOD (-5XPPHQ\06FKZDLJHU6,=LHJOHU0XQLFK'(.QR[YLOOH7186 (UODQJHQ'(VHEDVWLDQIXHUVW#WXPGH 3XUSRVH7KHSK\VLFDOSHUIRUPDQFHRIWKHÀUVWIXOO\LQWHJUDWHGZKROHERG\05 3(7VFDQQHUWKHELRJUDSKP05P05ZDVVWXGLHGDQGFRPSDUHGWRFXUUHQW 05DQG3(7&7V\VWHPVWKH0DJQHWRP9HULR7DQGWKHELRJUDSKP&7P&7 UHVSHFWLYHO\6LPXOWDQHRXVRSHUDWLRQDQGLWVHIIHFWVZHUHDOVRFRQVLGHUHG 0HWKRGV DQG 0DWHULDOV 7KH NH\ FRPSRQHQWV RI WKH P05 DUH D 7 PDJQHW DQG$3'/62EORFNGHWHFWRUV0HDVXUHPHQWVZHUHSUHSDUHGDQGSHUIRUPHGDV GHVFULEHGLQWKH1(0$18SURWRFRO3(7DQGLQWKH$&5TXDOLW\FRQWURO PDQXDO05,3(7VHQVLWLYLW\DQGVSDWLDOUHVROXWLRQZHUHDVVHVVHGERWKZLWKDQG ZLWKRXWDQ05,9,%(VHTXHQFHUXQQLQJ 6FLHQWLILF6HVVLRQ 6 &$' ( ) *+% (XURSHDQ&RQJUHVVRI 5DGLRORJ\ % +\EULG3(705,LQWKHDVVHVVPHQWRIFDUGLDFYLDELOLW\DGGHGYDOXH FRPSDUHGWR3(7&7 25DWLE 51NRXORX0*9LQFHQWL$4XHUFLROL6+HLQ]HU''LGLHU 06WXEHU7 +6FKLQGOHU-3 9DOOHH*HQHYD&+/DXVDQQH&+ 5HQH1NRXORX#KFXJHFK 3XUSRVH :H HYDOXDWHG WKH SRWHQWLDO IRU K\EULG 3(705, GHYLFHV WR SURYLGH LQWHJUDWHG PHWDEROLF IXQFWLRQDO DQG DQDWRPLF FKDUDFWHULVDWLRQRI SDWLHQWV ZLWK VXVSHFWHGFRURQDU\DUWHU\GLVHDVH 0HWKRGVDQG0DWHULDOV7 HQSDWLHQWVZLWKVXVSHFWHGKLEHUQDWLQJP\RFDUGLXP DQGKHDOWK\YROXQWHHUVSHUIRUPHGDQLPDJLQJVWXG\XVLQJDK\EULG3(705, 3KLOLSV 9LDELOLW\ DVVHVVHG E\ ))'* ZDV SHUIRUPHG LQ GLVHDVHG SDWLHQWV DORQJZLWK05,DQDWRPLFDQGIXQFWLRQDOVWXG\DQGUHDVVHVVHGZLWKLQPLQXWHV E\FRQYHQWLRQDO3(7&7 1RQFRQWUDVWULJKWFRURQDU\DUWHU\5&$WDUJHWHGDQG ZKROHKHDUW'FRURQDU\DQJLR05,XVLQJ(&*JDWLQJDQGUHVSLUDWRU\QDYLJDWRU ZDVSHUIRUPHGLQKHDOWK\YROXQWHHUVZLWKUHFRQVWUXFWLRQSHUIRUPHGXVLQJ035DQG YROXPHUHQGHULQJ7KHH[WHQWRIPHWDEROLFGHIHFW0'XVLQJ3(705,DQG3(7&7 ZDVFRPSDUHGLQSDWLHQWVDQGFRURQDU\WHUULWRULHV/$'&;5&$$VVHVVDELOLW\ RIFRURQDU\OXPHQZDVMXGJHGDVJRRGVXERSWLPDORUQRQDVVHVVDEOHXVLQJD VHJPHQWVFRURQDU\PRGHO 5HVXOWV0HWDEROLFDVVHVVPHQWZDVVXFFHVVIXOLQDOOSDWLHQWVZLWK0'EHLQJ YVXVLQJ3(705,DQG3(7&7 UHVSHFWLYHO\3 QV7KH0'ZDV DQGYVDQGIRU/$'&;DQG5&$WHUULWRULHVUHVSHFWLYHO\ 3 QV&RURQDU\DQJLR05,ZDVVXFFHVVIXOLQDOOYROXQWHHUVZLWKFRURQDU\ VHJPHQWVYLVXDOLVHGRYHUDOO7KH5&$ZDVIXOO\YLVXDOLVHGLQYROXQWHHUVDQG WKHOHIWFRURQDU\DUWHULHVLQYROXQWHHUV$VVHVVDELOLW\LQYLVXDOLVHGVHJPHQWV ZDVJRRGVXERSWLPDODQGQRQDVVHVVDEOHLQDQGUHVSHFWLYHO\ &RQFOXVLRQ+\EULG3(705,GHYLFHVPD\HQDEOHPHWDEROLFHYDOXDWLRQFRPSD UDEOHWR3(7&7ZLWKDGGLWLRQDOYDOXHRZLQJWRDFFXUDWHIXQFWLRQDODQGDQDWRPLFDO LQIRUPDWLRQLQFOXGLQJFRURQDU\DVVHVVPHQW % ,VDQJLRJUDSKLFSHUIXVLRQVFRUHDVVHVVHGLQSDWLHQWVZLWKDFXWH P\RFDUGLDOLQIDUFWLRQFRUUHODWHGZLWKFDUGLDFPDJQHWLFUHVRQDQFH LQIDUFWVL]HDQG1WHUPLQDOSUREUDLQQDWULXUHWLFSHSWLGHLQPRQWK IROORZXS $$%U]R]RZVND&]DUQHN$8UEDQLN7 5DNRZVNL.UDNRZ3/ 3XUSRVH$LPRIWKHVWXG\ZDVWRDQDO\VHWKHFRUUHODWLRQEHWZHHQ$36DQG&05 LQIDUFWVL]HDQG/)IXQFWLRQSDUDPHWHUVLQPRQWKIROORZXS 0HWKRGVDQG0DWHULDOV,QDFRKRUWRISDWLHQWVZLWK67(0,WUHDWHGZLWK3&, $36ZDVFDOFXODWHGIRULQIDUFWUHODWHGDUWHU\EDVHGRQDQJLRJUDSKLFSDUDPHWHUVDQG ZDVGHÀQHGDVWKHVXPRIWKH7,0,ÁRZJUDGHSRLQWVDQGWKH7,0,P\RFDUGLDO SHUIXVLRQJUDGHSRLQWVEHIRUHDQGDIWHU3&,UDQJHRISRLQWVIURPWR)XOO SHUIXVLRQZDVGHÀQHGDV$36%DUHPHWDOVWHQWVZHUHXVHGGXULQJSULPDU\ 3&,,QSDWLHQWVZLWKPXOWLYHVVHOGLVHDVH3&,ZDVSHUIRUPHGLQWKHLQIDUFWUHODWHG DUWHU\&05SDUDPHWHUVDQG17SUR%13ZHUHDVVHVVHGDWPRQWKV 5HVXOWV0HGLDQ$36ZDVSRLQWV$36ZDVSUHVHQWLQRISDWLHQWV 7KHVLJQLÀFDQWFRUUHODWLRQZDVIRXQGEHWZHHQ$36DQG&05LQIDUFWVL]HU 3 &05OHIWYHQWULFXODU/9HMHFWLRQIUDFWLRQU 3 /9HQGGLDVWROLFYROXPHLQGH[U 3 /9HQGV\VWROLFYROXPHLQGH[ U 3 17SUR%13U 3 3DWLHQWVZLWK$36 KDGVLJQLÀFDQWO\ORZHULQIDUFWVL]H/9YROXPHVKLJKHU()DQGORZHU17SUR%13 &RQFOXVLRQ $36DVVHVVHGLQSDWLHQWVZLWK67(0,WUHDWHGZLWK3&,LVDJRRGSUH GLFWRURILQIDUFWVL]HDQGOHIWYHQWULFXODUIXQFWLRQLQPRQWKIROORZXS7KHUHZDVD VLJQLÀFDQWFRUUHODWLRQRI $36DQG&05SDUDPHWHUVDQG17SUR%13DIWHUPRQWKV % ,QYLYR05,FKDUDFWHULVDWLRQRIWKHP\RFDUGLXPZLWKDGLIIXVLRQ ZHLJKWHGVHTXHQFHLQ7 $$OEHULFK%D\DUUL 68ULEH-6DQFKH]*RQ]OH]56DQ]5HTXHQD 6&RVWD/0DUWL%RQPDWL9DOHQFLD(66DQWLDJRGH&KLOH&/0DGULG(6 DDOEHULFKYDO#TXLURQHV 3XUSRVH+HDUWPRWLRQOLPLWVWKHXVHRI05GLIIXVLRQZHLJKWHG05':VHTXHQFHV LQURXWLQHO\FDUGLDFH[DPLQDWLRQGXHWRWKHWLPHUHTXLUHGE\WKHSDLURIJUDGLHQW SXOVHV 2XU REMHFWLYH ZDV WR GHÀQH DQ 05 VHTXHQFH ZKLFK FRXOGEH XVHG WR TXDQWLWDWLYHO\DQDO\VHLQYLYRP\RFDUGLXPWLVVXHGLIIXVLRQLQKXPDQV 0HWKRGVDQG0DWHULDOV,QYLYRFDUGLDF05GLIIXVLRQLPDJHVZHUHDFTXLUHGLQ DSRSXODWLRQRIKHDOWK\YROXQWHHUVDJH\HDUVXVLQJD705V\VWHP $FKLHYD7;3KLOLSV+HDOWKFDUHDQGDVXUIDFHFRLOZLWKFKDQQHOV7KHSXOVH VHTXHQFHZDVDVSLQHFKRHFKRSODQDULPDJLQJ6((3,ZLWKD7(RIPVWKH % 7RZDUGVVWDQGDUGLVDWLRQRIGLIIXVLRQZHLJKWHG05,VWDWXVVXUYH\ DFURVVLQVWUXPHQWVXVLQJDWLVVXHHTXLYDOHQWSKDQWRP *:ROI ) 'H.H\]HU7 3DXOXV5+HUPDQV1$EROPDDOL'UHVGHQ'( /HXYHQ%( 3XUSRVH:LGHVSUHDGDSSOLFDWLRQRIRQFRORJLFGLIIXVLRQZHLJKWHG05,':05, LVFXUUHQWO\LPSDLUHGGXHWROLPLWHGVWDQGDUGLVDWLRQDFURVVLQVWUXPHQWVDQGLPDJLQJ SDUDPHWHUV:HWKHUHIRUHDLPHGWRSHUIRUPDVWDWXVVXUYH\RI':05,DWGLIIHUHQW VFDQQHUVXVLQJDWLVVXHHTXLYDOHQWSKDQWRP 0HWKRGVDQG0DWHULDOV7KHSKDQWRPZDVSUHSDUHGIURPDJDURVHJHOVXFURVH DQG*G'73$WRUHVHPEOHLQYLYR05,SURSHUWLHV$'&55RIYDULRXVQRUPDO DQGQHRSODVWLFWLVVXHVDFFRUGLQJWROLWHUDWXUHYDOXHV$'&RIWLVVXHHTXLYDOHQWV ZDV PHDVXUHG E\ GLIIXVLRQZHLJKWHG VSLQHFKR (3, EYDOXHV VPP 7( PV75 PVSDUDOOHOLPDJLQJIDFWRU3,) RQVHYHUDO VFDQQHUV7$YDQWR76RQDWDDQG77ULR6LHPHQV0HGLDQLQWUDDQG LQWHUVFDQQHUYDULDELOLW\ZDVHYDOXDWHGDFURVVPXOWLSOHLPDJHDFTXLVLWLRQVHVVLRQV ZLWKLQWKHVDPHDQGDOOVFDQQHUVUHVSHFWLYHO\ 5HVXOWV:LWKJURZLQJ7(ZHREVHUYHGDPDUNHGHDUO\$'&GHFUHDVHIRU6RQDWD GRZQWRUHODWLYHWR7( PLQLPDODQGPRGHUDWHODWHGHFUHDVHVIRU $YDQWRDQG 7ULRDQG $YDQWR $'&ZDVORZHUWKDQRQ7ULRу PVLQGHSHQG HQWRI7(ZKHUHDVLWZDVKLJKHUWKDQRQ6RQDWDу PVLQFUHDVLQJ ZLWK7(&RUUHVSRQGLQJO\LQWHUVFDQQHUYDULDELOLW\LQFUHDVHGZLWK7( $W RXURSWLPDOVHWWLQJV7( PLQLPDO75 PV3,) LQWUDVFDQQHUYDULDELOLWLHV ZHUH$YDQWR6RQDWDDQG7ULRZKLOHLQWHUVFDQQHUYDULDELOLW\ ZDV &RQFOXVLRQ$'& TXDQWLÀFDWLRQ DQG YDULDELOLW\ VWURQJO\ GHSHQG RQ LPDJLQJ SDUDPHWHUV,QJHQHUDO':05,UHYHDOVVXEVWDQWLDOYDULDELOLW\DFURVVVFDQQHUV ZKLFKODUJHO\FRPSOLFDWHVVHWXSRIPXOWLFHQWUHVWXGLHVDQGFRPSDULVRQRIUHVXOWV 1HYHUWKHOHVVDWRSWLPDOVHWWLQJV':05,SURYLGHVH[FHOOHQWUHSHDWDELOLW\DWWKH VDPHVFDQQHU+RZHYHUIXWXUHHIIRUWVDUHQHHGHGWREULQJVWDQGDUGLVDWLRQLQWR FOLQLFDOSUDFWLFH 5RRP4 &DUGLDF 66 $FXWHFRURQDU\V\QGURPHVYLDELOLW\ 0RGHUDWRUV *+DGMLGHNRY6RILD%* *$.URPEDFK*LHVVHQ'( % 6HQVLWLYLW\RIFDUGLDFPDJQHWLFUHVRQDQFHYDULHVZLWKFOLQLFDO SUHVHQWDWLRQRIELRSV\SURYHQDFXWHP\RFDUGLWLV *&DQQDYDOH0)UDQFRQH,,DPSLHUL%&RQWL$)UXVWDFL&&DWDODQR 5RPH,7 3XUSRVH5HFHQWO\7ZHLJKWHGLPDJLQJDOORZHGGHSLFWLRQRIP\RFDUGLDORHGHPD DVDVSHFLÀFPDUNHURIGLVHDVHLQDFXWHFOLQLFDOVHWWLQJ,WVVHQVLWLYLW\KRZHYHU YDULHVLQDFXWHDQGFKURQLFPDQLIHVWDWLRQV:HUHSRUWJUHDWVHQVLWLYLW\YDULDWLRQV RI05LQDFXWHP\RFDUGLWLVGHSHQGLQJRQFOLQLFDOSUHVHQWDWLRQ 0HWKRGV DQG 0DWHULDOV :H UHWURVSHFWLYHO\ HYDOXDWHG 05 VHQVLWLYLW\ LQ FRP SDULVRQZLWKFOLQLFDOSUHVHQWDWLRQLQSDWLHQWVZKRKDGLQWKHODVWWZR\HDUVDQ HQGRP\RFDUGLDOELRSV\GLDJQRVLVRIDFWLYHP\RFDUGLWLVDQGDFOLQLFDOKLVWRU\ PRQWKV$OO VXEMHFWV XQGHUZHQW DW WLPH RI GLDJQRVLV D FDUGLDF 05 &05 DQG LQYDVLYHFDUGLDFH[DPLQDWLRQ 5HVXOWV7KUHHW\SHVRIFOLQLFDOSDWWHUQVRIP\RFDUGLWLVZHUHUHFRJQLVHGLQIDUFW OLNHIHYHUFKHVWSDLQ67VHJPHQWGHÁHFWLRQDW(&*DQGVHUXP7URSRQLQ,HOHYD WLRQ&DUGLRP\RSDWK\OHIWYHQWULFXODUG\VIXQFWLRQLQDEVHQFHRI(&*VHURORJLF RUV\VWHPLFDEQRUPDOLWLHV$UUK\WKPLFVXGGHQRFFXUUHQFHRIVXSUDYHQWULFXODU DQGRUYHQWULFXODUDUUK\WKPLDVLQDEVHQFHRIV\VWHPLFHYLGHQFHRILQÁDPPDWLRQ 'HOD\HGHQKDQFHPHQWDW&05VXJJHVWLQJDP\RFDUGLWLVZDVGRFXPHQWHGLQ RISDWLHQWVQ RISDWWHUQQ RISDWWHUQDQGQ RI SDWWHUQ 7LVVXH RHGHPD ZDV REVHUYHG LQ Q RI SDWWHUQ Q LQ SDWWHUQ DQG Q LQ SDWWHUQ (DUO\ HQKDQFHPHQW ZDV SRVLWLYHLQRIWKHFDVHVZLWKSDWWHUQZLWKSDWWHUQDQG ZLWKSDWWHUQ &RQFOXVLRQ6HQVLWLYLW\RIFDUGLDF05LVKLJKIRULQIDUFWOLNHP\RFDUGLWLVORZIRU FDUGLRP\RSDWK\DQGYHU\ORZIRUDUUK\WKPLFSDWWHUQ$PRUHH[WHQVLYHYDVFXODU LQYROYHPHQWLQSDWWHUQFRPSDUHGZLWKIRFDOP\RF\WHDQGFRQGXFWLRQWLVVXHGDP DJHRISDWWHUQDQGDUHWKHPRVWOLNHO\H[SODQDWLRQ 6FLHQWLILF6HVVLRQ $ 6&'()*+% 7KXUVGD\ (XURSHDQ&RQJUHVVRI 5DGLRORJ\ % 0DJQHWLFUHVRQDQFH7PDSSLQJLQDFXWHP\RFDUGLDOLQIDUFWLRQ IURPFRUHWRSHULSKHU\ .8%DXQHU'7KHLVHQ7 6DQGQHU0) 5HLVHU%:LQWHUVSHUJHU 0XQLFK'(GDQLHOWKHLVHQ#PHGXQLPXHQFKHQGH 3XUSRVH 7 R HYDOXDWH 7 FKDUDFWHULVWLFV RI DFXWH P\RFDUGLDO LQIDUFWLRQ$0, DQGWRGHOLQHDWH$0,LQSUHDQGSRVWFRQWUDVWHQKDQFHGP\RFDUGLDO7PDSSLQJ 0HWKRGVDQG0DWHULDOVSDWLHQWVPHDQDJHIHPDOHVZLWK$0, G XQGHUZHQW FDUGLDF 05, DIWHU DFXWH SHUFXWDQHRXV FRURQDU\ LQWHUYHQWLRQ RQ D 7VFDQQHU0DJQHWRP $YDQWRZLWKHOHPHQWFRLO)RU7PDSSLQJSXUSRVHV DPRGLÀHG/RRN/RFNHULQYHUVLRQUHFRYHU\02//,VHTXHQFHZDVDSSOLHGSUHDQG PLQSRVWFRQWUDVWPPRONJ*DGREXWURODWWKUHHVKRUWD[LVVOLFHSRVLWLRQV 7HYDOXDWLRQZDVEDVHGRQPHDVXUHPHQWVZLWKGLIIHUHQW7,WLPHVFOXVWHUHGLQ JURXSVGXULQJ7UHOD[DWLRQ3UHDQGSRVWFRQWUDVW7PDSVZHUHFDOFXODWHGDQG $0,ZDVGHÀQHGKDYLQJDFXWRIIRI!VWDQGDUGGHYLDWLRQV6'DVFRPSDUHGWR 7YDOXHVRIQRUPDOP\RFDUGLXP0<252,EDVHGPHDVXUHPHQWVRI7YDOXHV RI$0, QRUPDO P\RFDUGLXP 0<2 DQG RI P\RFDUGLDOYDVFXODUREVWUXFWLRQ LI SUHVHQWLQWKH$0,FRUH092ZHUHSHUIRUPHG 5HVXOWV 7KH FRPSDULVRQ RI 7 YDOXHV RI$0, DQG 0<2 UHYHDOHG VLJQLÀFDQW GLIIHUHQFHV LQ SUHFRQWUDVW VFDQV PV YV PVS 7KHUHZDVQRVLJQLÀFDQWGLIIHUHQFHRI092PVFRPSDUHGWR$0,RU 0<23RVWFRQWUDVW7YDOXHVRI$0,0<2DQG092GURSSHGE\DQG UHVSHFWLYHO\7KHGLIIHUHQFHVRI7YDOXHVLQ$0,DQG0<2ZHUHVLJQLÀFDQW PVYVPVS7YDOXHVRI092ZHUHVLJQLÀFDQWO\KLJKHU FRPSDUHGWR$0,PVS KRZHYHUWKHUHZDVQRVLJQLÀFDQWGLIIHU HQFHEHWZHHQ092DQG0<2 &RQFOXVLRQ7 YDOXHV RI DFXWH P\RFDUGLDO LQIDUFWLRQ DUH VLJQLÀFDQWO\ GLIIHUHQW FRPSDUHGWRQRUPDOP\RFDUGLXPLQERWKSUHDQGSRVWFRQWUDVWLPDJLQJ % 5LJKWYHQWULFXODULQYROYHPHQWLQDFXWHOHIWYHQWULFXODUP\RFDUGLDO LQIDUFWLRQSURJQRVWLFLPSOLFDWLRQVRIFDUGLDF05,ÀQGLQJV 7 6FKORVVHU&-HQVHQ2%UXGHU.1DVVHQVWHLQ (VVHQ'(WKRPDVVFKORVVHU#XQLGXHGH 3XUSRVH7KHSXUSRVHRIWKLVVWXG\ZDVWRLQYHVWLJDWHWKHSUHYDOHQFHDQGSURJQRV WLFLPSRUWDQFHRIWKHFDUGLDF05,ÀQGLQJRIULJKWYHQWULFXODULQYROYHPHQWLQSDWLHQWV ZLWKDFXWH67VHJPHQWHOHYDWLRQP\RFDUGLDOLQIDUFWLRQ0, 0HWKRGVDQG0DWHULDOV)LIW\SDWLHQWVZLWKÀUVW67VHJPHQWHOHYDWLRQ0,XQGHUZHQW 7FDUGLDF05,LPPHGLDWHO\DIWHUVXFFHVVIXOSHUFXWDQHRXVFRURQDU\LQWHUYHQ WLRQ7KH05,SURWRFROLQFOXGHGLQYHUVLRQUHFRYHU\)/$6+GHOD\HGHQKDQFHPHQW VHTXHQFHV DIWHU FRQWUDVW DGPLQLVWUDWLRQ IRU WKH TXDQWLÀFDWLRQ RI P\RFDUGLDO GDPDJH7KHSUHYDOHQFHRIULJKWYHQWULFXODULQYROYHPHQWGHWHFWHGZLWK(&*DQG HFKRFDUGLRJUDSK\ZDVFRPSDUHGZLWKWKHSUHYDOHQFHGHWHFWHGZLWKFDUGLDF05, ZKLFKZDVWKHUHIHUHQFHVWDQGDUG3DWLHQWVXQGHUZHQWIROORZXSIRUPRQWKV 5HVXOWV 5LJKW YHQWULFXODU LQYROYHPHQW ZDV GLDJQRVHG ZLWK FDUGLDF 05, LQ SDWLHQWVRISDWLHQWVZLWKLQIHULRU67VHJPHQWHOHYDWLRQ0,DQG RISDWLHQWVZLWKDQWHULRU67VHJPHQWHOHYDWLRQ0,3DWLHQWVZLWKULJKW YHQWULFXODU LQYROYHPHQW LQ DQWHULRU 67VHJPHQW HOHYDWLRQ 0, KDG ODUJHU LQIDUFWV GHOD\HGHQKDQFHPHQWYVS ORZHUOHIW YHQWULFXODUHMHFWLRQIUDFWLRQYVSDQGORZHU ULJKWYHQWULFXODUHMHFWLRQIUDFWLRQYVSWKDQ WKRVH ZLWKRXW ULJKW YHQWULFXODU LQYROYHPHQW ,Q D PXOWLYDULDWHORJLVWLF UHJUHVVLRQ PRGHO ULJKW YHQWULFXODU LQYROYHPHQW ZDV D VWURQJ LQGHSHQGHQW SUHGLFWRU RGGV UDWLR&,RIPDMRUFDUGLDFDGYHUVHHYHQWV &RQFOXVLRQ5LJKWYHQWULFXODULQYROYHPHQWLQ67VHJPHQWHOHYDWLRQ0,LVGHWHFWHG PRUHIUHTXHQWO\ZLWKFDUGLDF05,WKDQZLWK(&*DQGHFKRFDUGLRJUDSK\DQGLVDQ LQGHSHQGHQWSURJQRVWLFLQGLFDWRU % 9DOXHRIFDUGLDFPDJQHWLFUHVRQDQFHLPDJLQJLQSDWLHQWVZLWKDFXWH FKHVWSDLQHOHYDWHGFDUGLDFHQ]\PHVDQGDQHJDWLYHFRURQDU\DQJLRJUDP 7 (PULFK.(PULFK1$EHJXQHZDUGHQH.2EHUKRO]HU7 0XHQ]HO &'XHEHU.) .UHLWQHU0DLQ]'(HPULFK#UDGLRORJLHNOLQLNXQLPDLQ]GH 3XUSRVH7 RDVVHVVWKHYDOXHRIFDUGLDF05,LQSDWLHQWVZLWKDFXWHFKHVWSDLQ HOHYDWHGFDUGLDFHQ]\PHVDQGDQHJDWLYHFRURQDU\DQJLRJUDPDQGDQDO\VHIDFWRUV RILQÁXHQFHRQWKHDFFXUDF\RIWKHGLDJQRVLV 0HWKRGVDQG0DWHULDOV,QDPRQWKSHULRGSDWLHQWVIURPWKHFKHVWSDLQ XQLWFRXOGEHLQFOXGHGLQWKLVVWXG\7KH05LPDJLQJSURWRFROZDVNHSWDVVLPSOHDV SRVVLEOHDQGFRQVLVWHGRIFLQHRHGHPDVHQVLWLYHDQGODWHJDGROLQLXPHQKDQFHPHQW LPDJLQJ&OLQLFDOIROORZXSDQGWKHV\QRSVLVRIDOOFOLQLFDOODERUDWRU\DQGLPDJLQJ 75V\QFKURQLVHGZLWKHYHU\RWKHU(&*SXOVH7KHVHOHFWHGEYDOXHVZHUHDQG VPP)DWZDVVXSSUHVVHGE\D63$,5FRQÀJXUDWLRQLQFRPELQDWLRQZLWK JUDGLHQWUHYHUVDOSXOVHV7KHDFTXLVLWLRQZDVSHUIRUPHGLQGLDVWROHDQGWKHGHOD\LQ WKH55SHULRGZDVFDOFXODWHGIURPDKLJKWHPSRUDOUHVROXWLRQVHTXHQFHSHUIRUPHG LPPHGLDWHO\EHIRUHWKHGLIIXVLRQDFTXLVLWLRQ6OLFHVZHUHDFTXLUHGLQEUHDWKKROGV RIV7KHVSDWLDOUHVROXWLRQZDVRI[[PPLQVKRUWD[LVVOLFHVDORQJWKH OHIWYHQWULFOH $IWHUFRUHJLVWHULQJWKHLPDJHVWRWKHORZHVWEYDOXHWKHP\RFDUGLXP ZDVVHJPHQWHGDQGWKH$'&FDOFXODWHGYR[HOE\YR[HO 5HVXOWV7KHPHDQ$'&YDOXHVREWDLQHGLQWKHP\RFDUGLXPRIWKHVXEMHFWVZHUH >PPV@,PDJHVSUHVHQWHGDJRRG615DQGDEVHQFHRIJHRPHWU\ GLVWRUWLRQDUWHIDFWV &RQFOXVLRQ7KH05':GHVFULEHGWHFKQLTXHFDQEHSHUIRUPHGHIÀFLHQWO\ZLWK DQDFFXUDWHV\QFKURQLVDWLRQRIWKHDFTXLVLWLRQWRWKH55F\FOHDQGPD\KHOSWR DQDO\VHP\RFDUGLDOVWUXFWXUHLQGLIIHUHQWGLVHDVHV % $FXWHFRURQDU\V\QGURPHZLWKQRUPDOFRURQDU\DUWHULHVDQGSRVLWLYH HQ]\PHVGLIIHUHQWLDOGLDJQRVLVZLWKFDUGLDF05, 0'DQWL66EDUEDWL*&DPDVWUD1$OVDGL) 0DUFRQL6:'HOOD6DOD 5RPH,7PDVVLPLOLDQRGDQWL#KRWPDLOFRP 3XUSRVH 7 R GHPRQVWUDWH WKH UROH RI FDUGLDF 05, LQ WKH GLIIHUHQWLDO GLDJQRVLV RIP\RFDUGLDOLQIDUFWLRQZLWKQRUPDOFRURQDU\DUWHULHVDQGRWKHUIRUPVRIKHDUW GLVHDVHZLWKLQIDUFWOLNHSUHVHQWDWLRQP\RFDUGLWLV7 DNRWVXERHWF6WXG\GHVLJQ SURVSHFWLYHVWXG\SHUIRUPHGLQDVLQJOHFHQWUHRQSDWLHQWVDGPLWWHGWRRXU87,& 0HWKRGVDQG0DWHULDOVFRQVHFXWLYHSDWLHQWVZLWKFKHVWSDLQHOHFWURFDUGLR JUDSKLFFKDQJHVVLPLODULQW\SHLQIDUFWHOHYDWHG7URSRQLQDQGFRURQDU\DQJLRJUDSK\ ZLWKHYLGHQFHRIQRUPDOFRURQDU\DUWHULHVZHUHSHUIRUPHGZLWKLQRQHZHHNRIRQVHW RIV\PSWRPVDFDUGLDFPDJQHWLFUHVRQDQFHZLWKFRQWUDVWDJHQW,17(5$7 3KLOLSV0HGLFDO6\VWHPV%HVW7KH1HWKHUODQGV 5HVXOWV 0DJQHWLF UHVRQDQFH LPDJLQJ VKRZHG LQ SDWLHQWV WKH SUHVHQFHRI VLJQLÀFDQW PRUSKRIXQFWLRQDO DOWHUDWLRQV LQ WHUPV RI GLDJQRVWLF LQ SDWLHQWV QR SDWKRORJLFDOFKDQJHVZHUHREVHUYHG,QSDWLHQWVZDVIRXQGODWHHQKDQFHPHQW LQ SDWLHQWV WKH ORFDOLVDWLRQ ZDV FRPSDWLEOH ZLWK P\RFDUGLDOLQIDUFWLRQ LQ SDWLHQWVZLWKP\RFDUGLWLV,QSDWLHQWVZKLFKZDVQRWSUHVHQWODWHHQKDQFHPHQW WKHUHZDVDVHYHUHFDUGLDFDNLQHVLDLQWKHDSLFDOVHJPHQWVDYHUDJHIUDPHZRUN FRPSDWLEOHZLWK7 DNRWVXERV\QGURPH &RQFOXVLRQ 7KH FDUGLDF 05, PD\ KDYH NH\ UROH LQ WKH GLIIHUHQWLDO GLDJQR VLV RI DFXWH FRURQDU\ V\QGURPHV ZLWK QRUPDO FRURQDU\ DUWHULHV DQG RU RWKHU FDUGLRP\RSDWKLHV % ,PSURYHGDJUHHPHQWEHWZHHQH[SHULHQFHGDQGLQH[SHULHQFHG REVHUYHUVXVLQJDVWDQGDUGLVHGHYDOXDWLRQSURWRFROIRUFDUGLDF YROXPHWU\DQGLQIDUFWVL]HPHDVXUHPHQW *./XQG.0OOHUOHLOH0*URWK'6ULQJ7 .OLQLN6+DODM*)ROZDUVNL 0.DXO*$GDP+DPEXUJ'(JOXQG#XNHGH 3XUSRVH 7 R VWXG\ WKH DJUHHPHQW EHWZHHQ H[SHULHQFHG DQG LQH[SHULHQFHG REVHUYHUVEHIRUHDQGDIWHUWUDLQLQJXVLQJDVWDQGDUGLVHGHYDOXDWLRQSURWRFROIRU FDUGLDFPDJQHWLFUHVRQDQFHLPDJLQJ&05PHDVXUHPHQWVRIOHIWYHQWULFXODU/9 YROXPHVPDVVDQGLQIDUFWVL]H 0HWKRGVDQG0DWHULDOV&05VWXGLHVIURPSDWLHQWVZLWKP\RFDUGLDOLQIDUF WLRQZHUHHYDOXDWHG)LUVW&05VWXGLHVZHUHDQDO\VHGE\H[SHULHQFHGDQG LQH[SHULHQFHGREVHUYHUVZLWKUHVSHFWWRHQGGLDVWROLFYROXPH('9HQGV\VWROLF YROXPH(69HMHFWLRQIUDFWLRQ()/9PDVVDQGLQIDUFWVL]H3ODQLPHWULFPHDV XUHPHQWVZHUHSHUIRUPHGRQVKRUWD[LVVOLFHV6LPSVRQVPHWKRGXVLQJDKHDUW DQDO\VLVWRRO+H$76XEVHTXHQWO\WKHLQH[SHULHQFHGREVHUYHUVZHUHWUDLQHGXVLQJ DVWDQGDUGLVHGHYDOXDWLRQSURWRFRO7KHUHDIWHUDOOREVHUYHUVDQDO\VHGDQRWKHU &05VWXGLHV$JUHHPHQWDQGYDULDQFHZDVFRPSDUHGEHIRUHDQGDIWHUWUDLQLQJ XVLQJ%ODQG$OWPDQDQDO\VLV 5HVXOWV %HIRUH WUDLQLQJ WKH UHODWLYH GLIIHUHQFH EHWZHHQ H[SHULHQFHG DQG LQH[ SHULHQFHGREVHUYHUVZDVIRU('9IRU(69 IRU() IRU/9PDVVDQGIRULQIDUFWVL]H$IWHUWUDLQLQJ DJUHHPHQWVLJQLÀFDQWO\LPSURYHGWRIRU('93IRU(69 3IRU()3DQGIRULQIDUFWVL]H3 6OLFHEDVHG DQDO\VLV VKRZHG WKDW LQFOXVLRQ RI WKH PRVW EDVDO DQG DSLFDO VOLFHV ZHUHPDLQO\UHVSRQVLEOHIRUWKHLQLWLDOORZDJUHHPHQW &RQFOXVLRQ7UDLQLQJDQGDGKHUHQFHWRWKHSURSRVHGHYDOXDWLRQSURWRFROVLJQLÀ FDQWO\LPSURYHGWKHDJUHHPHQWEHWZHHQH[SHULHQFHGDQGLQH[SHULHQFHGREVHUYHUV IRU/9YROXPHV()DQGLQIDUFWVL]H7KHSURSRVHGHYDOXDWLRQSURWRFROFDQEHXVHG DVDJXLGHOLQHIRUWHDFKLQJRIQRYHO&05H[DPLQHUV 6FLHQWLILF6HVVLRQ 6 &$' ( ) *+% (XURSHDQ&RQJUHVVRI 5DGLRORJ\ :[/[7KDQGP9DVWKHJROGVWDQGDUGZHUHSHUIRUPHGE\DQH[SHUL HQFHGUDGLRORJLVW 5HVXOWV7KHDXWRPDWHGYROXPHWU\D9FRXOGEHSHUIRUPHGLQDOO&7VFDQVZLWKLQ DSSUR[LPDWHO\ VHFRQGV 7KH DYHUDJH VSOHQLF YROXPH PHDVXUHG E\ D9 ZDV FPóFRPSDUHGWRFPóLQPDQXDOYROXPHVHJPHQWDWLRQP9DQG FPóLQHVWLPDWHGYROXPHGHWHUPLQDWLRQH97KHFRUUHODWLRQFRHIÀFLHQWRI D9DQGP9ZDVRIP9DQGH9DQGRID9DQGH97KHUHZDVDQ DOPRVW SHUIHFW FRUUHODWLRQ RI WKH FKDQJHV LQ VSOHQLF YROXPH PHDVXUHG ZLWK WKH QHZD9DQGP9P9DQGH9DQGD9DQGH9EHWZHHQWZRWLPH SRLQWV$OOYDOXHVDUHVLJQLÀFDQWS &RQFOXVLRQ2XUDXWRPDWHGGHWHFWLRQDQGYROXPHWULFVHJPHQWDWLRQVRIWZDUHUDS LGO\SURYLGHVREMHFWLYHDQGUHDGHULQGHSHQGHQWPHDVXUHPHQWRIWKHVSOHQLFYROXPH LQ&7VFDQV7KHDXWRPDWHGYROXPHWU\LVQRWDVWLPHFRQVXPLQJDVPDQXDOYRO XPHWU\6SOHQLFYROXPHFKDQJHVFDQSURYLGHHYLGHQFHRIWKHFRXUVHRIO\PSKRPD % $VVHVVPHQWRIDQHZ'YLVXDOLVDWLRQWHFKQLTXHLQ&7 FRORQRJUDSK\WKH)XQQHOYLHZFRPSDUHGWRVWDQGDUGLQWHUSUHWDWLRQ VWUDWHJLHVDQGRWKHUUHFHQW'UHQGHULQJWHFKQRORJLHV ) &KDQGHOLHU /6WHLQ7 &DEUHUD*UDQE\4&&$0RQWUHDO4&&$ 3XUSRVH7KHVWXG\REMHFWLYHLVWRDVVHVVWKHSHUIRUPDQFHRIDQHZ'UHQGHU LQJWHFKQLTXHDSSOLHGWR&7FRORQRJUDSK\&7&QDPHO\WKH)XQQHOYLHZ)9,W DLPVDWDGGUHVVLQJFXUUHQWUHYLHZLQJVKRUWFRPLQJVGXULQJXQLDQGELGLUHFWLRQDO VWDQGDUG UHYLHZV 869 %69 VXFK DV OLPLWHG FRORQLF VXUIDFH FRYHUDJH GH VSLWH ORQJ UHYLHZLQJWLPH >(XU5DGLRO@ DQG WKH KLJKHU GHJUHH RI GLVWRUWLRQV DQG UHGXFHG ´SRO\S GLVSOD\ WLPHµ RI QHZ UHQGHULQJ WHFKQLTXHV >(XU5DGLRO@ 0HWKRGVDQG0DWHULDOV:HGHVLJQHGDXQLTXH'YLUWXDOOHQVDUUDQJLQJUD\V WUDQVPLVVLRQEDVHGRQWKHEHVWUD\FDVWLQJVWUDWHJ\RSWLPLVLQJWKHUHVSHFWLYHÀHOG RIYLHZ,WDOORZVIRUGLVWRUWLRQOLPLWHGYLVXDOLVDWLRQRIDUHDVEHKLQGIROGVZLWKLQD WUDGLWLRQDOSHUVSHFWLYHUHQGHULQJHQGRVFRS\YDOLGDWHG&7&GDWDVHWVZLWKJRRG FRORQLF GLVWHQVLRQV ZHUH LQYROYHG LQ WKLV UHWURVSHFWLYH VWXG\WR FRPSDUH 869 %69DQG)9'PDQXDOÁ\WKURXJKZDVGHHPHGUHIHUHQFHVWDQGDUGE\PDQXDOO\ DVVHVVLQJWKHFRPSOHWHFRORQLFVXUIDFHYLVLEOH)XUWKHUPRUH)9ZLOOEHLQYROYHG LQ DQ DFDGHPLF SURWRFRO 0F*LOO 8QLYHUVLW\ 4XHEHF &DQDGD WRSURVSHFWLYHO\ LQYHVWLJDWHLWVFRQWULEXWLRQWR&7&UHYLHZV 5HVXOWV $VLQJOHÁ\WKURXJKZLWK)9UHQGHUHGRIWKHYLVLEOHFRORQLFPXFRVD FRPSDUHGWRDQGUHVSHFWLYHO\IRUWKH869DQG%'9,QDGGLWLRQLW VLJQLÀFDQWO\LQFUHDVHGWKHGLVSOD\WLPHFORVHUWRWKHGLVSOD\SHULSKHU\UHTXLUHGIRU TXDOLW\DVVHVVPHQWRISRWHQWLDOOHVLRQVZLWKRXWLQGXFLQJPDMRUGLVWRUWLRQ &RQFOXVLRQ)XQQHOYLHZIRU&7&SURYLGHVDWLPHHIÀFLHQWLQWHUSUHWDWLRQVWUDWHJ\ WRDVVHVVWKHHQWLUHFRORQLFPXFRVDZLWKDVLQJOHDXWRPDWLFÁ\WKURXJKLQFUHDVLQJ SRWHQWLDOOHVLRQFRQVSLFXLW\DQGGLVSOD\WLPH,WKDVWKHSRWHQWLDOWRVLJQLÀFDQWO\ UHGXFHUHYLHZLQJWLPHZKLOHPDLQWDLQLQJVHQVLWLYLW\DQGVSHFLÀFLW\ % &7FRURQDU\DQJLRJUDSK\ZLWKN9WXEHYROWDJHDQGDORZQRLVH UHFRQVWUXFWLRQÀOWHULQQRQREHVHSDWLHQWVHYDOXDWLRQRIUDGLDWLRQ GRVHDQGGLDJQRVWLFTXDOLW\RI'DQG'LPDJHUHFRQVWUXFWLRQV XVLQJRSHQVRXUFHVRIWZDUH2VLUL; /)DJJLRQL0%LDQFKL3 0DUUDFFLQL/'ҋ(UULFR(1HUL'&DUDPHOOD &%DUWROR]]L3LVD,7OIDJJLRQL#VLUPRUJ 3XUSRVH7 RHYDOXDWHWKHGLDJQRVWLFTXDOLW\RI'DQG'LPDJHUHFRQVWUXFWLRQV IURP&7FRURQDU\DQJLRJUDSK\&7&$VWXGLHVSHUIRUPHGXVLQJDWXEHYROWDJHRI N9DQGDORZQRLVHUHFRQVWUXFWLRQÀOWHU 0HWKRGV DQG 0DWHULDOV )LIW\ QRQREHVH SDWLHQWV ZLWK FRPSDUDEOH ERG\PDVV LQGH[%0,XQGHUZHQW&7&$XVLQJDURZ&7VFDQQHU2XWRIWKHPZHUH LPDJHGXVLQJDWXEHYROWDJHRIN9DQGDORZQRLVH6RIWUHFRQVWUXFWLRQÀOWHU ZKLOHLQWKHUHPDLQLQJSDWLHQWVDWXEHYROWDJHRIN9DQGDVWDQGDUGUHFRQ VWUXFWLRQNHUQHOZHUHVHOHFWHG0D[LPXPLQWHQVLW\SURMHFWLRQ0,3FXUYHGSODQDU UHIRUPDWLRQ&35DQGYROXPHUHQGHULQJ95YLHZVZHUHJHQHUDWHGXVLQJRSHQ VRXUFHVRIWZDUH2VLUL;ZZZRVLUL[YLHZHUFRPDQGWKHLUGLDJQRVWLFTXDOLW\ ZDVDVVHVVHGYLVXDOO\XVLQJDWKUHHSRLQWVFRUHSRRUJRRGH[FHOOHQW 5HVXOWV (IIHFWLYH GRVH ZDV VLJQLÀFDQWO\ ORZHU ZLWK WKH N9 WKDQ ZLWK WKH N9SURWRFROP6YYVP6YS,PDJHTXDOLW\RIDOO UHFRQVWUXFWLRQVZDVJRRGWRH[FHOOHQWERWKDWN9DQGN9ZLWKDVWDWLVWLFDO WUHQGWRZDUGVEHWWHUTXDOLW\RI&35YLHZVZLWKWKHN9ORZQRLVHÀOWHUSURWRFRO 0,3YVS 95YVS &35YVS UHVSHFWLYHO\ GDWDZHUHWKHEDVLVIRUHVWDEOLVKLQJDFRQVHQVXVEDVHGGLDJQRVLV7KLVGLDJQRVLV VHUYHGDVWKHVWDQGDUGRIUHIHUHQFH 5HVXOWV %HVLGHV WKH ÀYH PDLQ GLDJQRVHV LVFKDHPLF FDUGLRP\RSDWK\ GLODWLYH FDUGLRP\RSDWK\P\RFDUGLWLV7 DNR7 VXERFDUGLRP\RSDWK\DQGK\SHUWHQVLYHFDUGLR P\RSDWK\Q WKHUHZHUHPLVFHOODQHRXVFDUGLDFGLDJQRVHVHJK\SHUWURSKLF FDUGLRP\RSDWK\FDUGLDFDP\ORLGRVLVRUQRQFRPSDFWLRQFDUGLRP\RSDWK\Q &RPSDUHGZLWKWKHÀQDOVWDQGDUGRIUHIHUHQFHGLDJQRVLVF05,HQDEOHGHVWDEOLVKLQJ WKHÀQDOGLDJQRVLVLQSDWLHQWV2QO\LQSDWLHQWVF05,FRXOGQRW GHWHFWWKHÀQDOGLDJQRVLV)XUWKHUDQDO\VLVVKRZHGQRVLJQLÀFDQWFRUUHODWLRQEH WZHHQDJHVH[DQGWLPHWRF05,H[DPLQDWLRQDQGWKHFRUUHFWQHVVRIWKHGLDJQRVLV S!7KHRQO\LPSRUWDQWIDFWRUZDVWKHNLQGRIGLDJQRVLVLWVHOI &RQFOXVLRQ F05, KHOSV HVWDEOLVKLQJ WKH ÀQDO GLDJQRVLV LQ SDWLHQWV ZLWK DFXWH FKHVWSDLQHOHYDWHGFDUGLDFHQ]\PHVDQGDQHJDWLYHFRURQDU\DQJLRJUDPLQWKH YDVWPDMRULW\RIFDVHV$JHVH[DQGWLPHWRH[DPLQDWLRQKDGQRLQÁXHQFHRQWKH DFFXUDF\RIWKHGLDJQRVLV % 3DUWLWLRQFRHIÀFLHQWIRUJDGROLQLXPFKHODWHVLQWKHQRUPDO P\RFDUGLXPFRPSDULVRQRIJDGRSHQWHWDWHGLPHJOXPLQHDQG JDGREHQDWHGLPHJOXPLQH 1.DZHO 01DFLI) 6DQWLQL6/LX-%UHPHULFK$$UDL'%OXHPNH %HWKHVGD0'86%DVOH&+QDGLQHNDZHO#JP[GH 3XUSRVH7 RHYDOXDWHWKHLQÁXHQFHRIFRQWUDVWDJHQWVZLWKGLIIHUHQWUHOD[LYLW\RQ WKHSDUWLWLRQFRHIÀFLHQWѤDQGWLPLQJRIHTXLOLEUDWLRQXVLQJDPRGLÀHGORRNORFNHU LQYHUVLRQUHFRYHU\02//,VHTXHQFHLQFDUGLDF05, 0HWKRGV DQG 0DWHULDOV 02//, ZDV DFTXLUHG LQ KHDOWK\ VXEMHFWV 7 DW PLGYHQWULFXODUVKRUWD[LVSUHFRQWUDVWDQGDQGPLQDIWHULQWUDYH QRXVDGPLQLVWUDWLRQRIDEROXVRIHLWKHUPPRONJ*DGREHQDWHGLPHJOXPLQH *G%237$Q RU*DGRSHQWHWDWHGLPHJOXPLQH*G'73$Q XVLQJWKH IROORZLQJSDUDPHWHUV7(75PVÁLSDQJOHEDQGZLGWK+]3[ VOLFHWKLFNQHVVPP7WLPHVZHUHPHDVXUHGLQP\RFDUGLXPDQGEORRGSRRO Ѥ ZDV DSSUR[LPDWHG E\ 70\RFDUGLXP SUHFRQWUDVW 70\RFDUGLXP SRVW FRQWUDVW7%ORRGSRROSUHFRQWUDVW7%ORRGSRROSRVWFRQWUDVW9DOXHVIRU *G%237$DQG*G'73$ZHUHFRPSDUHGWWHVW,QWHUREVHUYHUDJUHHPHQWZDV HYDOXDWHGLQWUDFODVVFRUUHODWLRQFRHIÀFLHQW>,&&@ 5HVXOWV 2YHUDOO VFDQV SUHFRQWUDVW DQG DW WLPHSRLQWV SRVWFRQWUDVW DGPLQLVWUDWLRQLQVXEMHFWVZHUHHYDOXDWHG7WLPHVRIP\RFDUGLXPDQGEORRG SRROSDQGѤDQGUHVSHFWLYHO\SH[FOXG LQJPLQIRU*G%237$ZHUHVLJQLÀFDQWO\ORZHUIRU*G%237$WKDQ*G'73$ Ѥ*G'73$VKRZHGQRVLJQLÀFDQWYDULDWLRQEHWZHHQDQGPLQѤ*G%237$ YDOXHVZHUHVLJQLÀFDQWO\ORZHUDWPLQFRPSDUHGWRRWKHUWLPHVYV S,QWHUREVHUYHUDJUHHPHQWIRUѤYDOXHVZDVH[FHOOHQWZLWK*G%237$ ,&& DQGJRRGIRU*G'73$,&& &RQFOXVLRQѤ*G%237$YDOXHVDUHVLJQLÀFDQWO\ORZHUFRPSDUHGWRѤ*G'73$ DWWKHVDPHDGPLQLVWHUHGGRVH8VLQJ*G%237$WKHHTXLOLEULXPEHWZHHQP\R FDUGLXPDQGEORRGSRROLVQRWDFKLHYHGXQWLOPLQSRVWFRQWUDVW 5RRP= &RPSXWHU$SSOLFDWLRQV 66 ,PDJHSURFHVVLQJSDUW 0RGHUDWRUV 3%DGXUD*OLZLFH3/ (.RWWHU)UHLEXUJ'( % $XWRPDWHGGHWHFWLRQDQGYROXPHWULFVHJPHQWDWLRQRIWKHVSOHHQLQ &7VFDQVRISDWLHQWVZLWKPDOLJQDQWO\PSKRPD 0+DPPRQ5-DQND66HLIHUW0.UDPHU08GHU$&DYDOODUR (UODQJHQ'(PDWWKLDVKDPPRQ#XNHUODQJHQGH 3XUSRVH:HLQWURGXFHDQDXWRPDWHGGHWHFWLRQDQGYROXPHWULFVHJPHQWDWLRQRI WKHVSOHHQLQVSLUDO&7VFDQV&RUUHODWLRQDQDO\VLVRIDXWRPDWHGYROXPHWU\D9 HVWLPDWHG YROXPH GHWHUPLQDWLRQ H9 DQG PDQXDO YROXPH VHJPHQWDWLRQ P9 ZDVSHUIRUPHG 0HWKRGVDQG0DWHULDOV:HUHWURVSHFWLYHO\HYDOXDWHGWKH7+(6(860(',&2 &$'V\VWHP RQ VSLUDO &7 VFDQV RI FRQVHFXWLYH O\PSKRPD SDWLHQWV DW WKUHH FRQVHFXWLYHWLPHSRLQWV'HWHUPLQDWLRQRIWKHH9VSOHQLFYROXPHFPó FPó 6FLHQWLILF6HVVLRQ $ 6&'()*+% 7KXUVGD\ (XURSHDQ&RQJUHVVRI 5DGLRORJ\ % 'RHV-3(*ORVV\FRPSUHVVLRQGLVJXLVHFUDQLDOIUDFWXUHV" 0) 0F(QWHH,1LNRORYVNL5%RXUQH03LHWU]\N 0(YDQRII3 %UHQQDQ.7 D\6\GQH\$87XVFRQ$=86 PDUNPFHQWHH#V\GQH\HGXDX 3XUSRVH7KHFXUUHQWVWXG\DLPVWRHVWDEOLVKZKHWKHUGHWHFWLRQRIFUDQLDOYDXOW IUDFWXUHVLVDIIHFWHGE\-3(*ðDQGðORVV\FRPSUHVVLRQZKHQFRPSDUHG WR-3(*ORVVOHVVFRPSUHVVLRQ 0HWKRGVDQG0DWHULDOV&7LPDJHVZLWKWKUHHOHYHOVRI-3(*FRPSUHV VLRQORVVOHVV[ [ZHUHSUHVHQWHGWRVHQLRUUDGLRORJLVWV,PDJHV FRQWDLQHGDVLQJOHVNXOOIUDFWXUHZKLOHZHUHQRUPDO2EVHUYHUVZHUHDVNHGWR LGHQWLI\WKHSUHVHQFHRUDEVHQFHRIDIUDFWXUHDQGZKHUHDIUDFWXUHZDVSUHVHQW WRORFDWHDQGUDWHWKHLUFRQÀGHQFHLQLWVSUHVHQFH $-$)52&DQG52&PHWKRGRO RJ\ZDVHPSOR\HGDQGWKH'%0050&PHWKRGZDVXVHGWRH[SORUHGLIIHUHQFHV EHWZHHQWKHORVVOHVVDQGORVV\FRPSUHVVHGLPDJHV 5HVXOWV7KHPHDQ-$)52&)20DQG52& $8&VFRUHVZLWKORVVOHVV-3(* FRPSUHVVLRQZHUHFRPSDUHGWRIRU[ORVV\DQG ZLWK[ORVV\6LJQLÀFDQWGLIIHUHQFHVZHUHVHHQRQO\EHWZHHQ-3(*/RVV\ [DQG[S$QRYHUDOOWUHQGRIGHFUHDVHGSHUIRUPDQFHZLWK[ORVV\ FRPSUHVVLRQZDVVHHQZKLOH-3(*ORVVOHVVDQG-3(*/RVV\[ZHUH VHHQWRSHUIRUPHTXDOO\S$VLJQLÀFDQWWUHQGRILQFUHDVHGFRQÀGHQFHLQ WUXHDQGIDOVHSRVLWLYHVFRUHVZDVVHHQZLWK-3(*/RVV\[FRPSUHVVLRQ &RQFOXVLRQ7KLVZRUNGHPRQVWUDWHVWKDW-3(*[ORVV\FRPSUHVVLRQGH JUDGHVWKHGHWHFWLRQRIVNXOOIUDFWXUHVVLJQLÀFDQWO\ZKLOHLQFUHDVLQJWKHFRQÀGHQFH ZLWKZKLFKUHDGHUVUDWHIUDFWXUHV-3(*ORVV\FRPSUHVVLRQDW[GRHVQRW VLJQLÀFDQWO\FKDQJHSHUIRUPDQFHZKHQFRPSDUHGWR-3(*ORVVOHVVFRPSUHV VLRQIRUWKHGHWHFWLRQRIVNXOOIUDFWXUHVLQ&7 % ,QWUDRSHUDWRUYDULDELOLW\RIOLYHUVHJPHQWYROXPHWU\XVLQJYHVVHO EDVHGDQGSODQHEDVHGWHFKQLTXHV ,0DWHND/5XVNR=9DUDGL$.ULVWRQ$3HUHQ\L=%HUHQ\L93HWURYV]NL 2'HPMHQ$3DONR6]HJHG+8PDWHNDLORQD#\DKRRFRP 3XUSRVH7 RPHDVXUHWKHLQWUDRSHUDWRUYDULDELOLW\RIOLYHUVHJPHQWYROXPHWU\7ZR DSSURDFKHVZHUHFRPSDUHGLQSRLQWRIGLIÀFXOW\YDULDELOLW\DQGGXUDWLRQ 0HWKRGVDQG0DWHULDOVSDWLHQWVZLWKSULPDU\RUPHWDVWDWLFOLYHUWXPRXUZHUH VHOHFWHGIURPDSXEOLFGDWDVHWKWWSVOLYHURUJ2QHUDGLRORJLVWVHSDUDWHGWKH &RLQDXGVHJPHQWVRQSRUWDOYHQRXV&7VFDQVXVLQJDUHVHDUFKSURWRW\SH6WDUWLQJ IURPJROGVWDQGDUGOLYHUFRQWRXUWKHUDGLRORJLVWDSSOLHGWZRGLIIHUHQWWHFKQLTXHV,Q WKHYHVVHOEDVHGDSSURDFKSRUWDOYHLQ39ZDVVHJPHQWHGIURPPDQXDOO\GHÀQHG URRWSRLQW7KHQQRQ39VWUXFWXUHVZHUHUHPRYHGDQGWKHPDLQ39EUDQFKHV ZHUHODEHOOHGLQGLPHQVLRQDOYLHZPDQXDOO\)LQDOO\WKHYDVFXODUWHUULWRU\EH ORQJLQJWRHDFKODEHOOHG39EUDQFKZDVFRPSXWHG,QWKHSODQHEDVHGDSSURDFK GLPHQVLRQDOYLHZVZHUHXVHGWRGUDZWUDFHVDORQJWKHPDLQYHLQEUDQFKHVOHIW PLGGOHDQGULJKWKHSDWLFYHLQULJKW39DQGEUDQFKHVRIOHIW39IHHGLQJVHJPHQWV ,,DQG,,,8VLQJWKHVHWUDFHVVPRRWKVXUIDFHVZHUHFRPSXWHGZKLFKZHUHXVHG LQDKLHUDUFKLFDORUGHUWRVHSDUDWHWKHOLYHU $OOSDWLHQWVZHUHSURFHVVHGWLPHVZLWK ERWKPHWKRGVWKHVWDQGDUGGHYLDWLRQRIYROXPHIRUHDFKVHJPHQWZDVFRPSXWHG LQRIWKHWRWDOOLYHUDQGSURFHVVLQJWLPHZDVPHDVXUHG 5HVXOWV7KH DYHUDJH VWDQGDUG GHYLDWLRQ LQ VHJPHQW YROXPHWU\ ZDV DQG ZKLOHWKHSURFHVVLQJWLPHZDVDQGVHFRQGVIRUYHVVHODQGSODQH EDVHGDSSURDFKUHVSHFWLYHO\ &RQFOXVLRQ7KHLQWUDRSHUDWRUYDULDELOLW\RIVHJPHQWYROXPHWU\GLGQRWSURYHG WR EH VLJQLÀFDQWO\ GLIIHUHQW IRU WKH WHFKQLTXHV 9HVVHOEDVHG DSSURDFK WDNHV VLJQLÀFDQWO\ORQJHUGXHWRGLIÀFXOWLHVRIODEHOOLQJWKHULJKW39 % )DVWDXWRPDWLFFRPSXWDWLRQRISDWKSURSRVDOVIRU&7JXLGHG UDGLRIUHTXHQF\5)DEODWLRQRIPDOLJQDQWOLYHUWXPRXUVLQLWLDO FOLQLFDOH[SHULHQFH '6FKPLGW -%LHEHUVWHLQ&6FKXPDQQ&7UXPP6&ODVHQ &'&ODXVVHQ3 /3HUHLUD=XULFK&+%UHPHQ'(0XQLFK'( 7ELQJHQ'(+HLOEURQQ'(GLHWKDUGVFKPLGW#XV]FK 3XUSRVH7 RGHPRQVWUDWHIHDVLELOLW\DQGHIIHFWLYLW\RIDIDVWDXWRPDWLFSK\VLFLDQ LQGHSHQGHQWPHWKRGWKDWFRPSXWHVDOLVWRISDWKSURSRVDOVIRUFRPSXWHUWRPR JUDSKLF&7JXLGHGUDGLRIUHTXHQF\DEODWLRQ5)$RIPDOLJQDQWOLYHUWXPRXUV 0HWKRGVDQG0DWHULDOV&7GDWDVHWVRISDWLHQWVZLWKPDOLJQDQWOLYHUWXPRXUV WUHDWHGE\&7JXLGHGKHSDWLF5)$ZHUHUHWURVSHFWLYHO\HYDOXDWHG2SWLPDODFFHVV SDWKVZHUHGHWHUPLQHGIURPWKUHHH[SHULHQFHGLQWHUYHQWLRQDOUDGLRORJLVWVFRQVLGHU LQJIROORZLQJSDUDPHWHUVGLVWDQFHWXPRXUWRVNLQDWULVNVWUXFWXUHVOXQJHSLJDVWULF &RQFOXVLRQ&RPSDUHGZLWKDVWDQGDUGWXEHYROWDJHRIN9XVDJHRIN9 DQGDORZQRLVHÀOWHUOHDGVWRDVLJQLÀFDQWUHGXFWLRQRIUDGLDWLRQGRVHZLWKHTXLYDOHQW GLDJQRVWLFTXDOLW\RI0,3 95DQG&35UHFRQVWUXFWLRQVLQQRQREHVHSDWLHQWV % ,PDJHUHJLVWUDWLRQEH\RQG3(7&7DGYDQFHGUHJLVWUDWLRQRI[UD\ DQG05PDPPRJUDPVLVIHDVLEOHDQGSURYLGHVPRUSKRORJLFDODQG IXQFWLRQDOLQIRUPDWLRQDWDJODQFH 0'LHW]HO 7 +RSS195XLWHU:$.DLVHU3 $7 %DOW]HU-HQD'( .DUOVUXKH'( 3XUSRVH,PDJHUHJLVWUDWLRQRI[UD\DQG05,PDPPRJUDPV;0DQG00ZRXOG DOORZFRPELQLQJPRUSKRORJLFDOLQIRUPDWLRQRI;0HJPLFURFDOFLÀFDWLRQZLWKWRSR JUDSKLFDQGIXQFWLRQDOSDUDPHWHUVRI'00GLIIXVLRQSHUIXVLRQHWF@GHYHORSHGDVRIWZDUHDOORZLQJERWKWRSRJUDSKLF PDWFKLQJRIEUHDVWOHVLRQDVZHOODVIXVLRQRIWKHFRUUHVSRQGLQJIXQFWLRQDO05, GDWDDQG>@HYDOXDWHGRYHUDOOUDGLRORJLFDOTXDOLW\DQGDFFXUDF\RIWKLVDSSURDFK 0HWKRGVDQG0DWHULDOV3DWLHQWVZLWKYLVLEOHPDVVOHVLRQVERWKLQ;0DQG00 ZHUHHQUROOHG%DVHGRQWKH00D´YLUWXDO;0µZDVFDOFXODWHGXVLQJRXULQKRXVH GHYHORSHGVRIWZDUH%DVHGRQG\QDPLFHQKDQFHPHQWFKDUDFWHULVWLFVRIWKH00D FRORXUFRGHGRYHUOD\ZDVFDOFXODWHGWRFKDUDFWHULVHWXPRXUYDVFXODULVDWLRQ7KLV RYHUOD\ZDVUHJLVWHUHGZLWKWKH´YLUWXDO;0µ2YHUDOOLPDJHTXDOLW\DQGDFFXUDF\RI WKHUHJLVWUDWLRQDQGIXUWKHUWLVVXHSDUDPHWHUVZHUHDVVHVVHGE\WZRH[SHULHQFHG UHDGHUVLQFRQVHQVXV 5HVXOWV SDWLHQWV ZHUH HQUROOHG UDQJH \HDUV PHDQ \HDUV,Q DOO SDWLHQWVIXVLRQZDVSHUIRUPHGVXFFHVVIXOO\2YHUDOODFFXUDF\ZDVGHÀQHGDVGLV SODFHPHQWRIWKHFHQWUHVRIWKHOHVLRQEHWZHHQ;0DQG00GLYLGHGE\WKHOHVLRQ VL]H,WUHDFKHGPHDQ7KHFRORXUFRGHGRYHUOD\DOORZHGLGHQWLÀFDWLRQDQG FKDUDFWHULVDWLRQRIDOOFDVHVQ &RQFOXVLRQ&OLQLFDOIHDVLELOLW\RIDGYDQFHG[UD\DQG05PDPPRJUDPVUHJLVWUD WLRQFRXOGEHGHPRQVWUDWHG$VLWDOORZVFRPELQDWLRQRIWRSRJUDSKLFPRUSKRORJLF DQGIXQFWLRQDOGDWDLQWRRQHVLQJOHLPDJHLWLVDSURPLVLQJWRROWRIXUWKHUHQKDQFH GLDJQRVWLFDFFXUDF\DQGFOLQLFDOZRUNÁRZLQEUHDVWLPDJLQJ % 7UDEHFXODUGLUHFWLRQDQGGHIRUPDWLRQGLVWULEXWLRQLQOXQJWUDQVSODQW SDWLHQWVZLWKVHYHUHRVWHRSRURVLVULVN /)LVFKHU -3DWVFK$9DOHQWLQLWVFK&6FKXHOOHU:HLGHNDPP %=ZH\WLFN) .DLQEHUJHU*/DQJV9LHQQD$76DQ)UDQFLVFR&$86 OXNDVDÀVFKHU#PHGXQLZLHQDFDW 3XUSRVH1HZRQVHWRVWHRSRURVLVRUSURJUHVVLRQRIDSUHH[LVWLQJGLVHDVHZLWK ERQHIUDFWXUHVZLWKLQWKHÀUVW\HDUVDIWHUOXQJWUDQVSODQWDWLRQ/X7;LVDVHYHUH EXWSRRUO\XQGHUVWRRGSUREOHP+LJKUHVROXWLRQSHULSKHUDOTXDQWLWDWLYHFRPSXWHG WRPRJUDSK\+5S4&7RIIHUVQRYHORSWLRQVIRUWKHDVVHVVPHQWRIGLVHDVHSURJUHV VLRQ,WSURYLGHVYROXPHWULF%0'GHWDLOHGFRUWLFDOERQHJHRPHWU\DQGWUDEHFXODU PLFURDUFKLWHFWXUH:HSURSRVHDQGHYDOXDWHDQRYHORSWLFDOÁRZEDVHGUHJLVWUDWLRQ DSSURDFKWRFDSWXUHWUDEHFXODUUHRUJDQLVDWLRQDQGREVHUYHVLJQLÀFDQWGLIIHUHQFHV EHWZHHQ/X7;LQGLFDWLRQV 0HWKRGVDQG0DWHULDOVSDWLHQWVLQGLFDWLRQJURXSVDYDVFXODUGLVHDVHVE F\VWLFÀEURVLVFSDUHQFK\PDOGLVHDVHVZHUHVFDQQHGZLWK+5S4&7DWEDVHOLQH DQGPRQWKVDIWHU/X7;7 RFDSWXUHWUDEHFXODUUHRUJDQLVDWLRQWKHYROXPHVZHUH ULJLGO\ UHJLVWHUHG 6XEVHTXHQWO\ WUDEHFXODU GHIRUPDWLRQ ZDV PHDVXUHG XVLQJ RSWLFDOÁRZ:HREWDLQHGGHIRUPDWLRQÀHOGPDSVIRUHDFKFDVHDQGTXDQWLÀHGWKH LQFUHDVHRIWUDEHFXODUWKLFNQHVVWRJHWKHUZLWKWUDEHFXODUGLUHFWLRQ(QWURS\ZDV XVHGWRTXDQWLI\GLUHFWLRQDOGRPLQDQFH.XOOEDFN/HLEOHU./GLYHUJHQFHEHWZHHQ GLUHFWLRQDQGFKDQJHGLVWULEXWLRQWRTXDQWLI\WKHUHODWLRQVKLSRIWZRPHDVXUHPHQWV 5HVXOWV1RVLJQLÀFDQWGLIIHUHQFHVEHWZHHQ/X7;LQGLFDWLRQJURXSVZHUHREVHUYHG ZKHQ FRPSDULQJ GLUHFWLRQDO GRPLQDQFH DW D VLQJOH WLPH SRLQW +RZHYHU ZKHQ LQFOXGLQJUHRUJDQLVDWLRQLQIRUPDWLRQE\FRPELQLQJWUDEHFXODUGLUHFWLRQDQGWKLFN QHVVFKDQJHVLJQLÀFDQWGLIIHUHQFHVSIGUFRUUHFWHGZHUHIRXQGEHWZHHQ LQGLFDWLRQJURXSVDEDQGEFPHDQ./DEF &RQFOXVLRQ &RPSXWHUEDVHG DQDO\VLV RI ERQH PLFURDUFKLWHFWXUH GHWHFWHG VLJ QLÀFDQW GLIIHUHQFHV LQ RVWHRSRURVLV SURJUHVVLRQ DPRQJ GLIIHUHQW /X7; JURXSV ZKLOH PLFURDUFKLWHFWXUH DVVHVVPHQW DW D VLQJOH WLPH SRLQW GRHVQRW7UDEHFXODU UHRUJDQLVDWLRQ FDQ EH PHDVXUHG TXDQWLWDWLYHO\ LQ +5S4&7 GDWDDQG UHYHDOV GLVHDVHVSHFLÀFSDWWHUQV 6FLHQWLILF6HVVLRQ 6 &$' ( ) *+% (XURSHDQ&RQJUHVVRI 5DGLRORJ\ &RQFOXVLRQ$XWRPDWLFSURFHGXUHVIRUPHGLFDOLPDJHSURFHVVLQJDQGJHRPHWU\ UHFRQVWUXFWLRQDUHLPSRUWDQWLQDQDO\VLQJFOLQLFDOGDWD5REXVWVFKHPHVDUHSUR SRVHGUHGXFLQJWKHHIIHFWRIHUURUVLQVXEVHTXHQWDQDO\VLVDQGSRVWSURFHVVLQJ 5RRP& 2QFRORJLF,PDJLQJ 66 &RORUHFWDOFDQFHUDVVHVVLQJWXPRXUEHKDYLRXU 0RGHUDWRUV 5*+%HHWV7DQ0DDVWULFKW1/ 3$%RQDIÀQL0RQ]D,7 % 5HFWDOFDQFHUDVVHVVPHQWRIUHVSRQVHWRQHRDGMXYDQW FKHPRUDGLDWLRQE\G\QDPLFFRQWUDVWHQKDQFHG05LPDJLQJ .2EHUKRO]HU$/ROOHUW7 -XQJLQJHU$+HLQW]$.UHIW7+DQVHQ&'XHEHU 0DLQ]'(OROOHUW#UDGLRORJLHNOLQLNXQLPDLQ]GH 3XUSRVH 3UHWUHDWPHQW DVVHVVPHQW RI IXQFWLRQDO DQG PRUSKRORJLFDO WXPRXU FKDUDFWHULVWLFVZLWKPDJQHWLFUHVRQDQFHLPDJLQJ05,LQORFDOO\DGYDQFHGUHFWDO FDUFLQRPDDQGLGHQWLÀFDWLRQRIIDFWRUVZKLFKLQÁXHQFHUHVSRQVHWRQHRDGMXYDQW FKHPRUDGLDWLRQ 0HWKRGVDQG0DWHULDOV,QDSURVSHFWLYHVWXG\QLQHW\ÀYHSDWLHQWVZLWKDGYDQFHG PU7DQGPU7FDUFLQRPDVXQGHUZHQWG\QDPLFFRQWUDVWHQKDQFHG05,'&(05, EHIRUHDQGDIWHUQHRDGMXYDQWFKHPRUDGLDWLRQ*\4XDQWLWDWLYHSDUDPHWHUV ZHUHGHULYHGIURPDSKDUPDFRNLQHWLFWZRFRPSDUWPHQWPRGHOFRQWUDVWPHGLXP H[FKDQJHUDWHN>PLQ@UHODWHVWRPLFURFLUFXODWLRQDQGDPSOLWXGH$UHSUHVHQWV WKHLQWHUVWLWLDOVSDFH7XPRXUVZHUHDOVRFKDUDFWHULVHGZLWKUHJDUGWRPRUSKRORJ\ DVQRQPXFLQRXVRUPXFLQRXVDWSUHWUHDWPHQWKLJKUHVROXWLRQ05,5HVSRQVHWR WUHDWPHQWZDVGHÀQHGDVGRZQVKLIWLQWKH8,&&VWDJH 5HVXOWV ,Q QRQPXFLQRXV FDUFLQRPDV FRQWUDVW PHGLXP H[FKDQJH UDWH ZDV KLJKHU DW SUHWUHDWPHQW 05, FRPSDUHG ZLWK PXFLQRXV FDUFLQRPDV S(IIHFWRIFKHPRUDGLDWLRQRQG\QDPLF05SDUDPHWHUVZDVKLJKHULQ QRQPXFLQRXVFDUFLQRPDVWKDQLQZLWKLQWKHPXFLQRXVVXEW\SHS $GRZQ VKLIWLQWKH8,&&VWDJHZDVVHHQLQSDWLHQWVDFRPSOHWHUHVSRQVHLQ $KLJKHUUDWHRIUHVSRQVHWRWUHDWPHQWZDVOLQNHGZLWKDQRQPXFLQRXVPRUSKRO RJ\S/RJLVWLFUHJUHVVLRQUHYHDOHGDQDVVRFLDWLRQEHWZHHQPXFLQRXV WXPRXUPRUSKRORJ\DQGSRRUUHVSRQVHRGGVUDWLR>FRQÀGHQFHLQWHUYDO@ >@S DVZHOODVDQDVVRFLDWLRQEHWZHHQDKLJKSHUFHQWLOHRI WKHFRQWUDVWPHGLXPH[FKDQJHUDWHDQGDKLJKHUUHVSRQVHUDWHRGGVUDWLR >@S &RQFOXVLRQ)XQFWLRQDODQGPRUSKRORJLFDOSDUDPHWHUVRISUHWUHDWPHQW05,FDQ DVVHVVWXPRXUFKDUDFWHULVWLFVZKLFKDUHDVVRFLDWHGZLWKHIIHFWLYHQHVVRIFKHPR UDGLDWLRQEHIRUHWUHDWPHQWLVLQLWLDWHG % $FFXUDF\RIJDGRIRVYHVHWHQKDQFHG'7:05,IRUVHOHFWLRQRI \S7DIWHUFKHPRUDGLDWLRQIRUUHFWDOFDQFHU 00DDV'0-/DPEUHJWV8/DOML0-/DKD\H*/%HHWV 5*+%HHWV7 DQ0DDVWULFKW1/PRQLTXHPDDV#OLYHQO 3XUSRVH6HOHFWLRQRI\S7WXPRXUVDIWHU&57DOORZVIRUORFDOH[FLVLRQDIWHU&57 3XUSRVHRIWKLVVWXG\ZDVWRFRPSDUHGLDJQRVWLFSHUIRUPDQFHDWJDGRIRVYHVHW HQKDQFHG7:05,IRUVHOHFWLQJ\S7WXPRXUVZLWKWKDWRI7:05, 0HWKRGVDQG0DWHULDOVSDWLHQWVZLWKORFDOO\DGYDQFHGUHFWDOFDQFHUXQGHUZHQW '7:)6(05, SODQHV DQG D[LDO JDGRIRVYHVHWHQKDQFHG '7:*5( 05, EHIRUH DQG DIWHU ZHHNV DIWHU &57 7ZR DEGRPLQDO UDGLRORJLVWV H[SHUW DQGQRQH[SHUWSUHGLFWHG\7VWDJHDW7:05,DWFH7:05,DIWHUDZHHN LQWHUYDO$IWHUDQRWKHUZHHNLQWHUYDOWKH7:DQGFH7:LPDJHVZHUHVFRUHG VLPXOWDQHRXVO\:LWKFH7:UHDGLQJPXOWLSODQDUUHIRUPDWWLQJZDVXVHG3DWLHQW RUGHUZDVUDQGRPLVHGEHWZHHQHDFKUHDGLQJ/LNHOLKRRGRID\7ZDVVFRUHG XVLQJDFRQÀGHQFHOHYHOVFRUH GHÀQLWHO\RXWJURZLQJZDOOWR GHÀQLWHO\FRQÀQHG WRZDOO+LVWRORJ\ZDVJROGVWDQGDUG52&DQDO\VHVZHUHSHUIRUPHGWRFRPSDUH GLDJQRVWLFSHUIRUPDQFH 5HVXOWV)RUWKHH[SHUW $8&VZHUH7:FH7:DQGFH77: &RUUHVSRQGLQJVHQVLWLYLWLHVDQGVSHFLÀFLWLHVZHUHDQG7:DQG FH7:DQGDQG77:)RUWKHQRQH[SHUW$8&VZHUH7: FH7:DQGFH77:&RUUHVSRQGLQJVHQVLWLYLWLHVDQGVSHFLÀFLWLHV ZHUHDQG7:DQGFH7:DQGDQGIRUFH77: YHVVHOVERZHODQGDQJXODWLRQ7KHSODQQLQJVRIWZDUH0H9LVODE&7,SURWRW\SH )UDXQKRIHU0(9,6 %UHPHQ ZDV HYDOXDWHG ZLWK IRFXV RQ FOLQLFDOO\ XVDELOLW\ E\ PDUNV YHU\ JRRG JRRG VDWLVIDFWRU\ VXIÀFLHQW LQVXIÀFLHQW IDLOWRGHWHUPLQHWKHEHVWSURSRVDO7KHEHVWSURSRVDOVZHUHFRPSDUHGZLWK WKRVHRIWKUHHH[SHUWVE\DVFRUH EHWWHU WKHVDPHTXDOLW\ OHVVJRRG QRWXVHIXO)RUVWDWLVWLFDODQDO\VLVWKHEHVWSURSRVDORIWKHDXWRPDWLFPHWKRG ZDVFRUUHODWHGZLWKWKHH[SHUWSURSRVDOVQRQSDUDPHWULF6SHDUPDQCV-03,1 6$6,QVWLWXWH&DU\86$ 5HVXOWV$XWRPDWLF SDWK SURSRVDO FRPSXWDWLRQ ZDV VXFFHVVIXO LQ DOO FDVHV ,PDJHSURFHVVLQJWLPHZDVDSSUR[LPDWHO\VHFVHF7KHPHDQ PDUNRIWKHDXWRPDWLFSDWKSURSRVDOZDVGHPRQVWUDWLQJDFOLQLFDOXVDELOLW\ 7KH DXWRPDWLF PHWKRG FRUUHODWHG ZHOO ZLWK WKH WKUHH H[SHUW SURSRVDOV U U U &RQFOXVLRQ 7KH DXWRPDWLF SDWK SURSRVDO FRPSXWDWLRQ IRU &7JXLGHG 5)$ RI PDOLJQDQWOLYHUWXPRXUVLVIHDVLEOHDQGHIIHFWLYHZLWKDJRRGFRUUHODWLRQWRH[SHUW SURSRVDOVXVHGLQFOLQLFDOURXWLQHZRUN % (YDOXDWLRQRIKHSDWLFIDWW\LQÀOWUDWLRQZLWKGXDOHQHUJ\VSHFWUDO&7 3 /Y;/LQ-/L-*DR0.H=KHQJ]KRX&16KDQJKDL&1 %HLMLQJ&1/YSHLMLH#FRP 3XUSRVH7 RLQYHVWLJDWHWKHDFFXUDF\DQGVHQVLWLYLW\RIWKHGXDOHQHUJ\VSHFWUDO &7LQWKHDVVHVVPHQWDQGFODVVLÀFDWLRQRIIDWW\LQÀOWUDWLRQLQOLYHU 0HWKRGVDQG0DWHULDOV7KLVSURVSHFWLYHVWXG\ZDVLQVWLWXWLRQDOUHYLHZERDUGDS SURYHGDQGZULWWHQLQIRUPHGFRQVHQWZDVREWDLQHGIURPDOOSDWLHQWV7KHDXWKRUV H[DPLQHGSDWLHQWVPHQZRPHQZLWKGXDOHQHUJ\VSHFWUDO&7LPDJLQJ GXULQJWKHSODLQ&7VFDQ7KHUHZHUHKHSDWLFSDWLHQWVZLWKPLOGPRGHUDWH DQG VHYHUH IDWW\ LQÀOWUDWLRQ UHVSHFWLYHO\ DV WKH VWXG\ JURXS QRUPDO KHSDWLFSDWLHQWVDVWKHFRQWUROJURXS7KHGHJUHHRIIDWW\LQÀOWUDWLRQZDVFODVVLÀHG DFFRUGLQJWRWKHPHDVXUHGOLYHUWRVSOHHQDWWHQXDWLRQUDWLR)DWFRQFHQWUDWLRQVLQ WKHOLYHUZHUHGHULYHGIURPIDWEDVHGPDWHULDOGHFRPSRVLWLRQVSHFWUDO&7LPDJHV 7KHTXDQWLWDWLYHSDUDPHWHUEHWZHHQWKHFRQWURODQGVWXG\JURXSDQGDPRQJWKH WKUHHKHSDWLFIDWW\LQÀOWUDWLRQJURXSVZHUHFRPSDUHGUHVSHFWLYHO\WZRVDPSOHW WHVWWKHDQDO\VLVRIYDULDQFH 5HVXOWV)DWFRQFHQWUDWLRQVLQQRUPDOKHSDWLFSDWLHQWVPJP/GLI IHUHGVLJQLÀFDQWO\IURPWKRVHSDWLHQWVZLWKKHSDWLFIDWW\LQÀOWUDWLRQV 3ZLWKWKHVHQVLWLYLW\RIDQGVSHFLÀFLW\RI6LJQLÀFDQWGLIIHU HQFHVZHUHDOVRIRXQGDPRQJWKHSDWLHQWVZLWKPLOGPJP/PRG HUDWHPJP/DQGVHYHUHPJP/IDWW\LQÀOWUDWLRQV LQOLYHUUHVSHFWLYHO\3 &RQFOXVLRQ7KHIDWFRQFHQWUDWLRQVGHULYHGIURPWKHIDWEDVHGPDWHULDOGHFRP SRVLWLRQLQWKHGXDOHQHUJ\VSHFWUDO&7ZHUHVWDWLVWLFDOO\GLIIHUHQWDPRQJSDWLHQWV ZLWKGLIIHUHQWGHJUHHVRIIDWW\LQÀOWUDWLRQDQGPD\SURYLGHDTXDQWLWDWLYHPHWKRGWR DVVHVVDQGFODVVLI\WKHKHSDWLFIDWW\LQÀOWUDWLRQ % ,PSDFWRIUREXVWLPDJHSURFHVVLQJWRUHGXFHHUURULQFRPSXWDWLRQDO KDHPRG\QDPLFV $--RDR$0*DPEDUXWR$6HTXHLUD/LVERQ37DQDMRDR#LVWXWOSW 3XUSRVH&DUGLRYDVFXODUGLVHDVHVDUHDVVRFLDWHGZLWKDQXPEHURIIDFWRUVWKDW LQFOXGHELRFKHPLVWU\KDHPRG\QDPLFVDQGJHQHWLFSUHGLVSRVLWLRQ7KHVHIDFWRUV DUHVSHFLÀFWRHDFKLQGLYLGXDODQGLWLVLPSRUWDQWWRDFFXUDWHO\UHSUHVHQWSDWLHQW VSHFLÀFLQIRUPDWLRQLQRUGHUWRDVVHVVSDWLHQWVWDWHDWGLDJQRVLVDQGSURJQRVLV VWDJHV+HUHZHIRFXVRQWKHHIIHFWVRIXQFHUWDLQW\LQFOLQLFDOO\DFTXLUHGPHGLFDO LPDJLQJWRYDULDELOLW\LQWKHUHFRQVWUXFWHGYHVVHOJHRPHWU\DQGWKLVHUURUSURSDJD WLRQWRWKHFRPSXWHGKDHPRG\QDPLFV 0HWKRGVDQGV0DWHULDOV7KHHIIHFWVRIÀOWHULQJFRQWUDVWHQKDQFHPHQWDQGVHJ PHQWDWLRQRIPHGLFDOLPDJHVDUHH[DPLQHGZLWKUHODWLRQWRFKDQJHVLQWKHUHFRQ VWUXFWHGJHRPHWU\7KHLPDJHVXVHGLQFOXGH05,DQG&7GDWDVHWVODUJHO\IRFXVHG RQWKHFHUHEUDOYDVFXODWXUH'LIIHUHQWLPDJHSURFHVVLQJPHWKRGVDUHFKRVHQDQG WHVWHGDQGWKHPRVWVXLWDEOHFRPELQDWLRQRIDSSURDFKHVLVGLVFXVVHG1XPHULFDO VLPXODWLRQVRIWKHKDHPRG\QDPLFVDUHSHUIRUPHGDQGWKHLPSDFWRIYDULDELOLW\LQ WKHYHVVHOJHRPHWU\LVFRQVLGHUHGZLWKUHVSHFWWRÁRZSDUDPHWHUVFRPPRQO\DV VRFLDWHGZLWKGLVHDVHWUDQVSRUWDQGVWUHVVHVRQWKHYHVVHOZDOO7KHGLVFXVVLRQ LVWKHUHIRUHZLWKDFOLQLFDOUHOHYDQFH 5HVXOWV 5HVXOWV LQGLFDWH WKDW LPDJH SUHSURFHVVLQJ FDQ VXEVWDQWLDOO\ DOWHU WKH TXDOLW\ RI WKH LPDJH WR LPSURYH YHVVHO H[WUDFWLRQ7KLV UHPRYHV D FHUWDLQ OHYHO RIXQFHUWDLQW\LQWKHVHJPHQWDWLRQSURFHVV1HYHUWKHOHVVFDUHPXVWEHWDNHQWR FKRRVHDSSURSULDWHDQGUREXVWVFKHPHV5HVXOWVRIFRPSXWDWLRQDOKDHPRG\QDPLFV DUHSUHVHQWHGZLWKHUURUEDUV 6FLHQWLILF6HVVLRQ $ 6&'()*+% 7KXUVGD\ (XURSHDQ&RQJUHVVRI 5DGLRORJ\ &RQFOXVLRQ7KH IXQFWLRQDO ':05, SOD\V D FUXFLDO UROH LQ GHWHFWLQJ WKH FRP SOHWHUHVSRQVHLQ/$5&SDWLHQWVE\DGGLQJLQIRUPDWLRQDERXWFKDQJHVLQWXPRXU SDWKRSK\VLRORJ\XVHIXOIRUWKHDVVHVVPHQWRIYLDELOLW\RIWKHWXPRXUDIWHU&57 % /RQJWHUPRXWFRPHRI05,EDVHGLQGLYLGXDOLVHGWUHDWPHQWIRUUHFWDO FDQFHUDPXOWLFHQWUHVWXG\ 00DDV60(QJHOHQ0/DKD\H'/DPEUHJWV-:/HLMWHQV&/9DQ%HUOR +9HUNRRLMHQ*/%HHWV5*+%HHWV7 DQ0DDVWULFKW1/ 3XUSRVH$ GLIIHUHQWLDWHG WUHDWPHQW DFFRUGLQJ WR HDFK LQGLYLGXDO ULVN SURÀOH LQ UHFWDOFDQFHUSDWLHQWVZDVLQWURGXFHGRYHUWKHODVWGHFDGH7KHSXUSRVHRIWKLV VWXG\ZDVWRHYDOXDWHZKHWKHU05,EDVHGLQGLYLGXDOLVHGWUHDWPHQWFDQLPSURYH ORQJWHUPRXWFRPHRIUHFWDOFDQFHUSDWLHQWV 0HWKRGVDQG0DWHULDOV)URPXQWLOSDWLHQWVZHUHLQFOXGHGLQD PXOWLFHQWUHSURVSHFWLYHFRKRUWVWXG\ZLWKH[SHUWDQGQRQH[SHUWUHFWDO05,UHDG HUV $OOXQGHUZHQWSUHRSHUDWLYH05,XVLQJDO\PSKQRGHVSHFLÀFFRQWUDVWDJHQWWR SUHGLFW&507DQG1VWDJH%DVHGRQWKH05,SDWLHQWVZHUHVWUDWLÀHGLQGLIIHUHQW ULVNJURXSVIRUORFDOUHFXUUHQFHDHDUO\WXPRXUZLGH&50 1EQRQORFDOO\ DGYDQFHGWXPRXUDQGFORFDOO\DGYDQFHGWXPRXUFORVHLQYROYHG&501VWDWXV GLVWDOWXPRXUV*URXSDXQGHUZHQWVXUJHU\ESUHRSHUDWLYH[*\IROORZHGE\ LPPHGLDWHVXUJHU\DQGFDORQJFRXUVHRIFKHPRUDGLDWLRQZLWKVXUJHU\DIWHUD ZHHNLQWHUYDO.DSODQ0HLHUFXUYHVZHUHXVHGWRHVWLPDWHORQJWHUPRXWFRPH 5HVXOWV$IWHU D PHGLDQ IROORZXS RI PRQWKV WKH \HDU ORFDO UHFXUUHQFH GLVHDVHIUHHVXUYLYDODQGRYHUDOOVXUYLYDODUHDQGUHVSHFWLYHO\ &RQFOXVLRQ05,EDVHGLQGLYLGXDOLVHGWUHDWPHQWRIUHFWDOFDQFHUOHDGVWRH[FHO OHQW ORQJWHUP RXWFRPH VSHFLÀFDOO\ UHJDUGLQJ ORFDO FRQWURO ERWK LQ H[SHUW DQG QRQH[SHUW FHQWUHV7KH UHVXOWV FRPSDUH IDYRXUDEO\ WR RWKHU SXEOLVKHG UHSRUWV 7KHUHVXOWVFRQÀUPWKDW05,LVPDQGDWRU\LQWKHVWDJLQJRIUHFWDOFDQFHUDQGVKRZ WKDWJRRGORFDOFRQWUROLVDFKLHYHGZKLOHQRZGLVWDQWPHWDVWDVHVGHWHUPLQHRYHUDOO VXUYLYDO7KHUHIRUHUDGLRORJLVWVVKRXOGIRFXVRQHDUO\GHWHFWLRQRIPHWDVWDVHVZLWK WKHDLPWRLPSURYHRYHUDOOVXUYLYDO % 'LIIXVLRQZHLJKWHG05LPDJLQJIRUSUHGLFWLRQRIHDUO\UHVSRQVHRI ORFDOO\DGYDQFHGUHFWDOFDQFHUWRFKHPRUDGLDWLRQWKHUDS\ 5&LDQFL$)LOLSSRQH(3DFH9%LDQFR*(VSRVLWR$7 DUWDUR $5&RWURQHR&KLHWL,7UFLDQFL#UDGXQLFKLW 3XUSRVH7 RHYDOXDWH':,IRUDVVHVVPHQWRIHDUO\WUHDWPHQWUHVSRQVHRIORFDOO\ DGYDQFHGUHFWDOFDQFHU/$5&ZHHNVDIWHUFKHPRUDGLRWKHUDS\&57 0HWKRGVDQG0DWHULDOV7ZHQW\HLJKWSDWLHQWVZLWK/$5&XQGHUZHQW05,SULRU WRDQGZHHNVDIWHU&57 LQFOXGLQJ7ZHLJKWHGLPDJHVDQGHFKRSODQDU':, ZLWKEYDOXHVWRVHFPP$'&YDOXHVZHUHPHDVXUHG,PDJLQJZDV FRUUHODWHGWRSRVWVXUJLFDOKLVWRSDWKRORJLFWXPRXUUHJUHVVLRQJUDGHDFFRUGLQJWR 0DQGDUGҋVFODVVLÀFDWLRQ7ZRDQGZHHNSRVWWUHDWPHQW$'&FKDQJHVUHVSHFW WREDVHOLQHу$'&LQWKHJURXSZLWKFRPSOHWHUHVSRQVH&5ZHUHFRPSDUHG ZLWKWKRVHLQWKHQRQFRPSOHWHUHVSRQVHJURXSQRQ&50RUHRYHUDQGZHHN SRVWWUHDWPHQW$'&FKDQJHVZHUHFRPSDUHGHLWKHULQ&5RULQQRQ&5JURXS 5HVXOWV$WZHHNVWKHPHGLDQу$'&RI&5JURXSZDVVLJQLÀFDQWO\ KLJKHUFRPSDUHGWRWKDWRIQRQ&5JURXSS 6LPLODUO\DWZHHNV WKH PHGLDQ у$'& RI &5 JURXS ZDV VLJQLÀFDQWO\ KLJKHU WKDQ WKDW RI QRQ&5 JURXS S 7KH EHVW у$'& FXWRII WR GLIIHUHQWLDWH &5 IURPQRQ&5DWZHHNVZDVS ZKLFK\LHOGHGDVHQVLWLYLW\RID VSHFLÀFLW\RIDQGDQ $]YDOXHRIDWZHHNVLWZDVS ZLWK DVHQVLWLYLW\RIDVSHFLÀFLW\RIDQGDQ$]YDOXH:KHQFRPSDULQJ PHGLDQу$'&REWDLQHGDWDQGZHHNVDIWHU&57 QRVLJQLÀFDQWGLIIHUHQFHV ZHUHIRXQGHLWKHUIRU&5RUIRUQRQ&5JURXSS &RQFOXVLRQ7KHPHGLDQу$'&DWZHHNVDIWHU&57UHSUHVHQWVDQHDUO\DQG UHOLDEOHSUHGLFWRURISUHRSHUDWLYHWUHDWPHQWRXWFRPH % 9DVFXODUPDSSLQJXVLQJDQ05,EORRGSRROFRQWUDVWDJHQWUHYHDOV YDVFXODUDV\PPHWU\DQGFKHPRUDGLRWKHUDS\LQGXFHGYDVFXODU UHPRGHOOLQJLQWKHPHVRUHFWXPRIUHFWDOFDQFHUSDWLHQWV (.OX]D-3 .OHLMQHQ00DDV&-HXNHQV:%DFNHV*%HHWV 5%HHWV7 DQ0DDVWULFKW1/ 3XUSRVH,QUHFWDOFDQFHUSDWLHQWVWKHWXPRXUVXUURXQGLQJPHVRUHFWXPH[KLELWV WKHHQKDQFHGYDVFXODWXUHDQGGHVPRSODVWLFSDWWHUQ2XUDLPZDVWRGHWHUPLQHWKH YDVFXODUFKDQJHVLQWKHPHVRUHFWXPUHODWHGWRWKHWXPRXUJURZWKDQGWKHLQÁXHQFH RIQHRDGMXYDQWFKHPRUDGLRWKHUDS\RQWKHVWUXFWXUHRIPHVRUHFWDOYDVFXODWXUHXVLQJ 05,YDVFXODUPDSSLQJZLWKDEORRGSRROFRQWUDVWDJHQW ,QWHUREVHUYHU DJUHHPHQW NDSSD ZDV FH77: FH7: DQG 7: &RQFOXVLRQ7KHXVHRIJDGRIRVYHVHWHQKDQFHG7:05,LPSURYHGVHQVLWLYLW\LQ WKHQRQH[SHUWDQGVSHFLÀFLW\LQWKHH[SHUWUHDGHUIRUVHOHFWLQJ\S7WXPRXUVDIWHU &57 ,QWHUHVWLQJO\7:LPDJLQJDORQHVKRZHGHTXDOGLDJQRVWLFSHUIRUPDQFHDV 7:LPDJLQJDORQH,QWHUREVHUYHUDJUHHPHQWZDVKLJKHUZKHQ7:LPDJLQJZDV DGGHGWR7:LPDJLQJ*DGRIRVYHVHW05,PLJKWKHOSERWKH[SHUWDQGQRQH[SHUW UHDGHUVLQPRUHDFFXUDWHVHOHFWLRQRIWXPRXUVFRQÀQHGWRWKHUHFWDOZDOODIWHU&57 % 5HFWDOFDQFHUG\QDPLFFRQWUDVWHQKDQFHG05,FRUUHODWHVZLWK O\PSKQRGHVWDWXVGLVWDQWPHWDVWDVHVDQG(*)5H[SUHVVLRQ $/ROOHUW .2EHUKRO]HU7 -XQJLQJHU6%LHVWHUIHOG &6FKLPDQVNL3 0LOGHQEHUJHU&'XHEHU0DLQ]'( 'VVHOGRUI'(OROOHUW#UDGLRORJLHNOLQLNXQLPDLQ]GH 3XUSRVH7 RHYDOXDWHFRUUHODWLRQVEHWZHHQG\QDPLFFRQWUDVWHQKDQFHGPDJQHWLF UHVRQDQFHLPDJLQJ'&(05,DQGFOLQLFRSDWKRORJLFDOGDWDDVZHOODVLPPXQRVWDLQ LQJRIWKHPDUNHUVRIDQJLRJHQHVLV(*)5DQG&;&5LQSDWLHQWVZLWKUHFWDOFDQFHU 0HWKRGV DQG 0DWHULDOV 3UHVXUJLFDO '&(05, ZDV SHUIRUPHG LQ SDWLHQWV DFFRUGLQJWRDVWDQGDUGLVHGLPDJLQJSURWRFRO7V\VWHP7ZHLJKWHGUDSLG WXUER)/$6+VHTXHQFH)R9PPPDWUL[[VOLFHWKLFNQHVVPP 757(7,PVÁLSDQJOH+]S[EDQGZLGWKYR[HOVL]H [ [ PP 7ZR TXDQWLWDWLYH SDUDPHWHUV N$ ZHUH GHULYHG IURP D SKDUPDFRNLQHWLFWZRFRPSDUWPHQWPRGHORQHVHPLTXDQWLWDWLYHSDUDPHWHU773 ZDV DVVHVVHG 6WDQGDUGLVHG VXUJHU\ DQG KLVWRSDWKRORJLFDO H[DPLQDWLRQ ZHUH DSSOLHGIRUWKHZKROHSDWLHQWSRSXODWLRQ,PPXQRVWDLQLQJIRU(*)5DQG&;&5 ZDV SHUIRUPHG XVLQJ WKH DYLGLQELRWLQ FRPSOH[ PHWKRG DQG HYDOXDWHG ZLWK D VWDQGDUGLVHGVFRULQJV\VWHP 5HVXOWV '&(05, SDUDPHWHU$ FRUUHODWHG VLJQLÀFDQWO\ ZLWK WKH 1FDWHJRU\ S DQGNZLWKWKHRFFXUUHQFHRIV\QFKURQRXVDQGPHWDFKURQRXVGLVWDQW PHWDVWDVHVS $VLJQLÀFDQWFRUUHODWLRQEHWZHHQ'&(05,GDWD773DQG WKHH[SUHVVLRQRI(*)5ZDVIRXQGS $WUHQGWRDFRUUHODWLRQEHWZHHQN DQG(*)5H[SUHVVLRQFRXOGEHVKRZQS '&(05,GDWDGLGQRWFRUUHODWH ZLWK&;&5H[SUHVVLRQ &RQFOXVLRQ'&(05,LVDQRQLQYDVLYHPHWKRGZKLFKFDQFKDUDFWHULVHDQJLRJHQ HVLVLQUHFWDOFDQFHUDQGFRUUHODWHVZLWK(*)5H[SUHVVLRQ'XHWRWKHUHODWLRQVKLS EHWZHHQWKHG\QDPLFSDUDPHWHUVDQGFOLQLFRSDWKRORJLFDOGDWD'&(05,PLJKW EHDSURJQRVWLFLQGLFDWRUIRUO\PSKQRGHVWDWXVDQGGLVWDQWPHWDVWDVHVLQSDWLHQWV ZLWKUHFWDOFDQFHU % +LJKEYDOXHGLIIXVLRQZHLJKWHGLPDJLQJZLWKEDFNJURXQGERG\ VLJQDOVXSSUHVVLRQDSLYRWDOUROHIRUWKHHYDOXDWLRQRIFRPSOHWH UHVSRQVHWRQHRDGMXYDQWWUHDWPHQWVLQUHFWDOFDQFHU /0RQJX]]L',SSROLWR0&RORPER3 $%RQDIÀQL66LURQL0RQ]D,7 OHWL]LDPRQJX]]L#JPDLOFRP 3XUSRVH 7 R HYDOXDWH WKH HIÀFDF\ RI ':, TXDOLWDWLYH DQG TXDQWLWDWLYH WRRO LQ FRPELQDWLRQZLWK7ZHLJKWHGLPDJLQJLQDVVHVVLQJWXPRXUUHVSRQVHWR&57 DV FRPSDUHGWR7:,DORQHE\FRUUHODWLQJKLVWRORJLFGRZQVWDJLQJDVWKHUHIHUHQFH VWDQGDUG 0HWKRGVDQG0DWHULDOV/$5&SDWLHQWVXQGHUZHQWSUHDQGSRVW&5705,H[ DPLQDWLRQZHHNVDIWHUWKHFRPSOHWLRQRIWUHDWPHQWRQD7VFDQQHU$FKLHYD 3KLOLSVZLWKIROORZLQJSURWRFROPXOWLSODQDU7DQG776(LPDJHVDQG':,%6 VHTXHQFHVEIDFWRUDQGPPVHF$IWHUWRWDOPHVRUHFWDOH[FLVLRQWKH KLVWRSDWKRORJLFDOUHVSRQVHZDVFODVVLÀHGDVWXPRXUUHJUHVVLRQJUDGHDFFRUGLQJ WR0DQGDUGҋVFULWHULD75*UHVSRQGHUVQRQUHVSRQGHUV7ZRUHDGHUVLQ FRQVHQVXVEOLQGHGWRWKHUHVXOWVHYDOXDWHG7:,ZLWKRXWDQGZLWK':,WRGHWHFW WKHSUHVHQFHRIFRPSOHWHUHVSRQVHE\DIRXUSRLQWVFDOHDVIROORZVGHÀQLWHO\ DEVHQWSUREDEO\DEVHQWSUREDEO\SUHVHQWGHÀQLWHO\SUHVHQW0HDQYDOXH RI $'&RISUHDQGSRVW&57':,ZHUHPHDVXUHGDQGFRPSDUHGEHWZHHQUHVSRQG HUVDQGQRQUHVSRQGHUV 5HVXOWV 2Q WKH EDVLV RI SDWKRORJLFDO IHDWXUHV DFFRUGLQJ WR 0DQGDUGҋV FULWHULD SDWLHQWVZHUHFODVVLÀHGDVUHVSRQGHUVVKRZLQJFRPSOHWHRUVXEWRWDO UHJUHVVLRQDQGZHUHFODVVLÀHGDVQRQUHVSRQGHUV0HDQ$'&YDOXHLQ 05H[DPLQDWLRQZDV[PPòVHFZKHUHDVPHDQYDOXHVDIWHU&57 ZHUH[PPòVHF2Q7:LPDJHVERWKUHDGHUVFRUUHFWO\LGHQWLÀHG SDWLHQWV ZLWK FRPSOHWH UHVSRQVH VSHFLÀFLW\ ZKLOH DIWHU DGGLWLRQ RI ':, WKH UHDGHUV FRUUHFWO\ LGHQWLÀHG RI &5 VSHF 2XU SUHOLPLQDU\ UHVXOWVVKRZHGWKDWWKHWZRUHDGHUVDFKLHYHGPRUHDFFXUDWHUHVXOWVFRPELQLQJ WKHDQDO\VLVRI':LPDJHVZLWK7:,WKDQ7:LPDJHVDORQH 6FLHQWLILF6HVVLRQ 6 &$' ( ) *+% (XURSHDQ&RQJUHVVRI 5DGLRORJ\ DQG,QDOOSDWLHQWVWKHPHDQYDOXHVRI689PD[LQ3(7ZHUHKLJKHUWKDQWKH PHDQYDOXHRI689PD[LQ3(7DQG3(7SZKHUHDVWKHPHDQ$'& YDOXHV ZHUH ORZHU LQ 50 WKDQ 50 S ZLWK D VLJQLÀFDQW SHUFHQWDJH GHFUHDVHRIYDOXHVDIWHUWKHWUHDWPHQWS7KHEHVWSUHGLFWRUVIRU75* UHVSRQVHZHUH689WKUHVKROGRIDQG $'&[PPVHFZLWKVHQ VLWLYLW\VSHFLÀFLW\DFFXUDF\QHJDWLYHSUHGLFWLYHYDOXHDQGSRVLWLYHSUHGLFWLYHYDOXH RIDQGUHVSHFWLYHO\$VLJQLÀFDQWFRUUHODWLRQ OLQHDUUHJUHVVLRQEHWZHHQ $'&YDOXHVDQG75*ҋVGDWDZDVDOVRIRXQGS &RQFOXVLRQ':05,DQG)'*3(7&7KDYHDFRPSOHPHQWDU\GLDJQRVWLFUROHLQ WKHIROORZXSRISDWLHQWVZLWK/$5&E\GLIIHUHQWLDWLQJÀEURVLVIURPYLDEOHWXPRXU WLVVXHDIWHU&57 % /\PSKQRGHVWDJLQJLQFRORUHFWDOFDQFHUE\FRQWUDVWHQKDQFHG&7 GHYHORSPHQWRIDQHZUHSRUWLQJPRGHOIRUKLJKHUGLDJQRVWLFDFFXUDF\ $%DUWHOV(2HYHUPDQQ6+ROOPDQQ-+0DU[VHQ) 09RJW$.RYDFV 3 +XQROG/EHFN'($QWRQLDEDUWHOV#JP[GH 3XUSRVH/\PSKQRGH/1VWDJLQJLQSDWLHQWVZLWKFRORUHFWDOFDQFHU&5&LV LPSRUWDQWIRURSWLPDOWUHDWPHQWSODQQLQJ+RZHYHULWLVGLIÀFXOWE\&7EDVHGRQ VLPSOH FULWHULD 3XUSRVH RI WKLV VWXG\ ZDV WR HVWDEOLVK D UHSRUWLQJ PRGHO WR DF FXUDWHO\ GLVWLQJXLVK KLVWRORJLFDOO\ SURYHQ /1 QHJDWLYH 1 IURP SRVLWLYH 1 &5&SDWLHQWVE\&7 0HWKRGVDQG0DWHULDOV7KLVUHWURVSHFWLYHVWXG\LQFOXGHGSDWLHQWVZLWKSURYHQ &5& DQG SUHRSHUDWLYH FRQWUDVWHQKDQFHG &7 IURP DQ LQWHUGLVFLSOLQDU\ WXPRXU ERDUGGDWDEDVH,QDEOLQGHGPDQQHUWKHIROORZLQJ/1IHDWXUHVZHUHHYDOXDWHG GLIIHUHQWPHWULFWUDLWVWRWDO/1FRXQWIRUPVWUXFWXUHGHQVLW\SUHVHQFHRIDKLOXP FRQWUDVWPHGLXPHQKDQFHPHQW7KHDFFXUDF\RIWKRVHFULWHULDLQFRPELQDWLRQZDV H[DPLQHG E\ ORJLVWLF UHJUHVVLRQ$OO FROOHFWHG SDUDPHWHUV ZHUHFRUUHODWHG ZLWK SRVWRSHUDWLYHKLVWRSDWKRORJLFDOÀQGLQJV1YV1 5HVXOWV 6RPH SDUDPHWHUV UHDFKHG VLJQLÀFDQFH IRU SUHGLFWLQJ /1PHWDVWDVHV KRZHYHURQO\LQWHUPHGLDWHDFFXUDFLHV/DUJHVW/1!PPVHQVVSHF DFFXUDF\6'RIORQJHVW/1GLDPHWHUV!PP Q!ORFRUHJLRQDO/1!PP7KHFRPELQDWLRQRIWKHIROORZLQJ FULWHULDVLJQLÀFDQWO\SUHGLFWHG/1PHWDVWDVHV3UHVHQFHRIDPRUSKRXV/1V6' RI/1ORQJLWXGLQDOGLDPHWHUV!PPPHDQRIWKH/1FURVVGLDPHWHU!PP DQG6'RIWKHFURVVGLDPHWHUORQJLWXGLQDOGLDPHWHUUDWLR!,IRIWKHVH IRXUFULWHULDZHUHIXOÀOOHG/1PHWDVWDVHVZHUHSUHGLFWDEOHZLWKDVOLJKWO\KLJKHU DFFXUDF\$UHSRUWLQJPRGHOZDVGHYHORSHGIRUFOLQLFDOGHFLVLRQ PDNLQJRQ/1PDOLJQDQF\ &RQFOXVLRQ7KHGHYHORSHGUHSRUWLQJPRGHOGHFLVLRQWUHHPLJKWIDFLOLWDWHDQG LPSURYH/1VWDJLQJE\FRQWUDVWHQKDQFHG&7LQ&5&SDWLHQWV3URVSHFWLYHVWXGLHV KDYHWRFRQÀUPWKLVVXJJHVWLRQ 5RRP' &KHVW 66 3XOPRQDU\QRGXOHV 0RGHUDWRUV 0'DV0DDVWULFKW1/ %)HUDJDOOL&KLHWL,7 % ,RGLQHXSWDNHUDWLR,85DQRYHODSSURDFKWRGLIIHUHQWLDWHEHWZHHQ PDOLJQDQWDQGEHQLJQOXQJOHVLRQV **/R (8HQR:+<HXQJ5.3 :RQJ$0&KRZ6.<X +DSS\9DOOH\+.7 RN\R-3FZK\#KNVKFRP 3XUSRVH7 RLQYHVWLJDWHWKHIHDVLELOLW\RILRGLQHXSWDNHUDWLR,85IRUGLIIHUHQWLDWLQJ PDOLJQDQWDQGEHQLJQOXQJOHVLRQVXVLQJFRQWUDVWHQKDQFHG&7VSHFWUDOLPDJLQJ 0HWKRGVDQG0DWHULDOVSDWLHQWVZLWKNQRZQELRSV\SURYHQOHVLRQVZHUHSUR VSHFWLYHO\HYDOXDWHG$OO&7H[DPLQDWLRQVZHUHSHUIRUPHGRQDKLJKGHÀQLWLRQ&7 VFDQQHU'LVFRYHU\&7+'*()RUHDFKLPDJLQJVHVVLRQP/RILRGLQDWHG FRQWUDVWDJHQWPJ,P/ZDVLQMHFWHGLQWUDYHQRXVO\DWP/V$IWHUDGHOD\ WLPHRIVVSHFWUDOLPDJHVZHUHDFTXLUHGZLWKGXDOHQHUJ\DWN9S0DWH ULDOGHFRPSRVLWLRQLRGLQHLPDJHVZHUHUHFRQVWUXFWHG&LUFXODU52,ZHUHGHÀQHG LQWKHLRGLQHGHQVLW\LPDJHVRYHUWKHOXQJOHVLRQVZLWKPD[LPXPHQKDQFHPHQW DQGQRUPDOOXQJSDUHQFK\PDIRULRGLQHFRQFHQWUDWLRQPHDVXUHPHQWV,85ZDV GHÀQHGDVWKHUDWLREHWZHHQLRGLQHFRQFHQWUDWLRQRIWKHOHVLRQDQGWKDWRIQRUPDO OXQJSDUHQFK\PD 0HWKRGVDQG0DWHULDOV7KHVWDJLQJDQGUHVWDJLQJ05,ZDVSHUIRUPHGIRUVL[ SDWLHQWVRQD7VFDQQHUXVLQJDSKDVHGDUUD\FRLO$URXWLQHLPDJLQJSURWRFRO ZDVFRPSOHPHQWHGZLWKDG\QDPLF7ZHLJKWHGVFDQ7(75 PVњ WLPHUHVROXWLRQ VPDWUL[ ðPPRONJRIJDGRIRVYHVHWZDVDGPLQ LVWHUHGGXULQJWKHDFTXLVLWLRQ0D[LPDOLQWHQVLW\SURMHFWLRQVZHUHGHULYHGIURPWKH GLIIHUHQFHLPDJHVREWDLQHGE\VXEWUDFWLQJWKHSUHFRQWUDVWEDVHOLQHIURPPLQ SRVWFRQWUDVWLPDJHV7KHQXPEHURIYDVFXODUEUDQFKHVZDVGHWHUPLQHGLQWKH WXPRXUQHLJKERXULQJDQGWXPRXUGLVWDQWPHVRUHFWXPXVLQJWKHSULPDU\VWDJLQJ GDWD7KHSUHDQGSRVWFKHPRUDGLRWKHUDS\YDVFXODUPDSVZHUHFRPSDUHGZLWK UHVSHFWWRWKHQXPEHURIYDVFXODUEUDQFKHVWKHLUOHQJWKDQGGLDPHWHUXVLQJ2VLUL; 5HVXOWV$ VLJQLÀFDQWO\ KLJKHU QXPEHU RI YHVVHOV ZDV IRXQG LQ WKH WXPRXU QHLJKERXULQJPHVRUHFWXPFRPSDUHGWRWXPRXUGLVWDQWPHVRUHFWXPS 7KH GLIIHUHQFHZDVEHWZHHQWZRDQGHLJKWIROGIRUGLIIHUHQWSDWLHQWV7KHFRPSDULVRQ RISUHDQGSRVWFKHPRUDGLRWKHUDS\PDSVUHYHDOHGDORZHUYHVVHOEUDQFK LQJDIWHUWUHDWPHQWS 0RUHRYHUWKHYDVFXODUGLDPHWHURIPPDW WKHSULPDU\VWDJLQJZDVVLJQLÀFDQWO\GHFUHDVHGWRPPDIWHUWKHWKHUDS\ S 1RGLIIHUHQFHZDVIRXQGLQWKHYHVVHOOHQJWK &RQFOXVLRQ 9DVFXODU PDSSLQJ RI WKH PHVRUHFWXP RI UHFWDO FDQFHU SDWLHQWV UHYHDOHGWKHHQKDQFHGYDVFXODWXUHDURXQGWKHWXPRXUDQGYDVFXODUUHPRGHOOLQJ DIWHUFKHPRUDGLRWKHUDS\ % $VVHVVPHQWRISUHRSHUDWLYHUDGLRFKHPRWKHUDS\S&57DQRYHO QXPHULFDOVHPLTXDQWLWDWLYH'&(05,SDUDPHWHUFRPSDUHGZLWK PRUSKRORJLF05,P05,DQGTXDOLWDWLYHWLPHLQWHQVLW\FXUYHVW05, 03HWULOOR5)XVFR9*UDQDWD2&DWDODQR06DQVRQH$5RWRQGR 5*UDVVL$3HWULOOR1DSOHV,7PDULRSHWULOOR#JPDLOFRP 3XUSRVHP05,HYDOXDWLRQLVFRQVLGHUHGWKHEHVWDYDLODEOHWRROIRU/$5&VWDJ LQJDIWHUS&57 7 RFRPSDUHWKHDFFXUDF\RIDQRYHOVHPLTXDQWLWDWLYHQXPHULFDO SDUDPHWHUEDVHGRQSDWWHUQDQDO\VLV6,6ZLWKP05,DQG'&(05,EDVHGRQ TXDOLWDWLYHW05,LQGLIIHUHQWLDWLQJEHWZHHQUHVSRQGHUV575*RU75*DQGQRW UHVSRQGHUV1575*RU75*DIWHUS&57 0HWKRGV DQG 0DWHULDOV SDWLHQWV XQGHUZHQW '&(05, H[DPLQDWLRQ EHIRUH DQGDIWHUS&57 3UHDQGSRVWFRQWUDVW7ZVFDQVZHUHDFTXLUHGDIWHU*G'27$ LQMHFWLRQ 5HJLRQV RI LQWHUHVW 52, ZHUH GUDZQ LQVLGH WKH WXPRXU UHVSHFWLYHO\ 7,&HYDOXDWLRQDQG6,6DQDO\VLVZHUHFRPSXWHGIRUHDFK52,P05,W05,DQG 6,6EDVHGHYDOXDWLRQVZHUHSHUIRUPHG 5HVXOWVP05,HYDOXDWLRQJDYHVHQVLWLYLW\6(1VSHFLÀFLW\63( SRVLWLYHSUHGLFWLYHYDOXH339DQGQHJDWLYHSUHGLFWLYHYDOXH139 3HUIRUPLQJW705,HYDOXDWLRQ6(163(339DQG139 ZHUHREWDLQHGZKLOVWXVLQJDFXWRIIYDOXHRILQ6,6FKDQJH6(1 63(339DQG139ZHUHREWDLQHG3HUIRUPLQJD6,6EDVHG HYDOXDWLRQDUHOHYDQWJDLQUHVSHFWWRP05,DORQHDQGDQGW05, DQGZDVREWDLQHG &RQFOXVLRQ 6WDQGDUGLVHG LQGH[ RI VKDSH 6,6 EDVLQJ RQ D QXPHULFDO VHPL TXDQWLWDWLYH '&(05, SDUDPHWHU REWDLQHG WKURXJK SDWWHUQ DQDO\VLV UHVXOWV DQ DFFXUDWHWRROWRSUHGLFWWXPRXUDFWLYLW\RIS&57LQ/$5&SDWLHQWVWKURXJKDZHOO GHÀQHGFXWRIIWRGLIIHUHQWLDWH5E\15 % 7UHDWPHQWPRQLWRULQJLQ/$5&UROHRIGLIIXVLRQZHLJKWHGLPDJLQJ DQG)'*3(7&7LQHYDOXDWLRQRIWXPRXUUHJUHVVLRQJUDGHGXULQJ DQGDIWHU&57 /0RQJX]]L',SSROLWR/*XHUUD('H3RQWL&0HVVD66LURQL0RQ]D,7 OHWL]LDPRQJX]]L#JPDLOFRP 3XUSRVH7 RDVVHVVWKHUROHRI $'&YDOXHV':05,LQFRPSDULVRQZLWK689PD[ YDOXHV)'*3(77&EHIRUHGXULQJDQGDIWHUFKHPRUDGLDWLRQWKHUDS\LQSDWLHQW ZLWK/$5&EHLQJWKHKLVWRORJLFH[DPLQDWLRQDVUHIHUHQFHVWDQGDUG 0HWKRGVDQG0DWHULDOV7KUHHVHTXHQWLDO))'*3(7&7VWXGLHVZHUHSHU IRUPHGLQSDWLHQWVZLWKELRSV\SURYHQSULPDU\UHFWDOFDUFLQRPDDVIROORZVEHIRUH VWDUWLQJ&573(7&7GXULQJ&573(7&7DQGDIWHUFRPSOHWLRQRIWUHDWPHQW 3(7&705VFDQQLQJZDVSHUIRUPHGEHIRUH05DQGDIWHU&5705RQ 7PDJQHW3KLOLSV$FKLHYDDQGFRPSULVHG776(PXOWLSODQDUVHTXHQFHVDQG ':,%6EIDFWRUDQGPPVHF7KHSHUFHQWDJHGHFUHDVHRI689PD[ у689DQGDQG$'&у$'&YDOXHVIURPEDVHOLQHWRSUHVXUJLFDOVFDQZHUH DVVHVVHGDQGFRUUHODWHGZLWKSDWKRORJLFUHVSRQVHFODVVLÀHGDVWXPRXUUHJUHVVLRQ JUDGH0DQGDUGҋVFULWHULD75* FRPSOHWHUHJUHVVLRQ75* QRUHJUHVVLRQ 5HVXOWV7XPRXUZDVGHWHFWHGLQDOOSDWLHQWVDWERWK05LPDJLQJDQG)'*3(7&7 DQGDIWHU&57DOOSDWLHQWVZHUHVXEPLWWHGWRVXUJHU\$FFRUGLQJWRWKH0DQGDUGҋV FULWHULDVKRZHGFRPSOHWH75*RUVXEWRWDOUHJUHVVLRQ75*DQGZHUH FODVVLÀHGDVUHVSRQGHUVQLQHZHUHFODVVLÀHGDVQRQUHVSRQGHUV75* 6FLHQWLILF6HVVLRQ $ 6&'()*+% 7KXUVGD\ (XURSHDQ&RQJUHVVRI 5DGLRORJ\ 6SHDUPDQҋVUDQNFRUUHODWLRQFRHIÀFLHQWEHWZHHQJURXSV&DQG $ZHUH5 DQG5 S &RQFOXVLRQ8OWUDORZGRVH&7ZLWK$,'5KDVFRPSDUDEOHFOLQLFDOSHUIRUPDQFH WRFRQYHQWLRQDO/'&7IRUOXQJQRGXOHGHWHFWLRQDQGDFKLHYHVGRVHUHGXFWLRQ % 6PDOOSXOPRQDU\QRGXOHVOHVVWKDQPPKRZWRGLVWLQJXLVK PDOLJQDQF\DQGEHQLJQLW\" .<RRQ*-LQ< +DQ< /HH-HRXQMX.5VKLQJKD#SDUDQFRP 3XUSRVH :H LQYHVWLJDWHG UDGLRORJLFSDWKRORJLF FRUUHODWLRQ RI VPDOO SXOPRQDU\ QRGXOHVOHVVWKDQPPWRHYDOXDWHWKHPDMRUGLIIHUHQFHVRIEHQLJQDQGPDOLJQDQW QRGXOHVRQ&7ÀQGLQJV 0HWKRGV DQG 0DWHULDOV 7KH VWXG\ LQFOXGHG SDWLHQWV 0) PHDQ DJHZLWKVPDOOSXOPRQDU\QRGXOHVOHVVWKDQPP7LVVXHGLDJQRVLVZDVPDGH LQDOOSDWLHQWVZLWKVXUJLFDOUHVHFWLRQ7KHKLVWRORJLFFKDUDFWHULVWLFVRIWKHQRGXOH ZHUHFRUUHODWHGZLWKUDGLRORJLFÀQGLQJVVXFKDVVKDSHPDUJLQDQGGHQVLW\:HDOVR HYDOXDWHGWKHPDMRUGLIIHUHQFHVRIEHQLJQDQGPDOLJQDQWQRGXOHVOHVVWKDQPP 5HVXOWV0HDQGLDPHWHURIQRGXOHVRQ&7ZDVFP,QWKHQRGXOHVPDOLJ QDQWQRGXOHVZHUHDQGEHQLJQ0DMRUGLIIHUHQFHVRIEHQLJQ DQGPDOLJQDQWQRGXOHVZHUHVKDSHGHQVLW\DQGPDUJLQ,QPDUJLQVSLFXODWLRQDQG OREXODWLRQRFFXUUHGZLWKDVLJQLÀFDQWO\KLJKHUIUHTXHQF\DPRQJPDOLJQDQWQRGXOHV S,QVXEVROLGQRGXOHVPDOLJQDQF\UDWHVZHUHVLJQLÀFDQWO\KLJKHUWKDQ VROLGQRGXOHVS,QVXEVROLGQRGXOHVDOREXODWHGRUVSLFXODWHGPDUJLQ ZDVDVVRFLDWHGZLWKDKLJKHUULVNRIPDOLJQDQF\S ,PSRUWDQWSUHGLFWLYH ÀQGLQJVRIÀEURWLFQRGXOHVDQGDQWKUDFRWLFSLJPHQWDWLRQVRIEHQLJQQRGXOHV FRPSDUHGWRPDOLJQDQWQRGXOHVZHUHDVIROORZVVPRRWKPDUJLQDQGVROLGDWWHQX DWLRQ(VSHFLDOO\LQQRGXOHVOHVVWKDQPPVPRRWKERUGHUDQGVROLGDWWHQXDWLRQ ZHUH SURYHG DV LQGHSHQGHQW PRUSKRORJLFDO SUHGLFWRUV RI EHQLJQLW\ SUHGLFWLYH YDOXH &RQFOXVLRQ0DOLJQDQWSXOPRQDU\QRGXOHVOHVVWKDQPPVKRZVSLFXODWHGPDU JLQ**2RUPL[HG**2ZLWKVLJQLÀFDQWO\JUHDWHUIUHTXHQF\(VSHFLDOO\VPRRWK ERUGHUDQGVROLGDWWHQXDWLRQZHUHLQGHSHQGHQWSUHGLFWRUVRIEHQLJQLW\LQOHVVWKDQ PPQRGXOHV % 'LIIHUHQWLDWLQJVXEVROLGDQGVROLGSXOPRQDU\QRGXOHVRQ&7 LQWHU DQGLQWUDREVHUYHUDJUHHPHQWDPRQJH[SHULHQFHGWKRUDFLFUDGLRORJLVWV $<LOGLULP&$5LGJH3 0%RLVHOOH7 )UDQTXHW3 $*HYHQRLV &06FKDHIHU3URNRS'7 DFN$$%DQNLHU.D\VHUL75 %RVWRQ0$86%DUFHORQD(6%UXVVHOV%($PHUVIRRUW1/%DXGRXU%( DIUDB\LOGLULP#KRWPDLOFRP 3XUSRVH7KHUHFRPPHQGHG&7VXUYHLOODQFHSHULRGLVORQJHUIRUVXEVROLGWKDQ IRU VROLG SXOPRQDU\ QRGXOHV GXH WR WKH VORZHU JURZWK UDWH RI EURQFKRDOYHRODU FDUFLQRPDFRPSDUHGWRRWKHUOXQJFDQFHUV7KLVVWXG\WHVWVWKHK\SRWKHVLVWKDW LQWHUDQGLQWUDREVHUYHUDJUHHPHQWZKHWKHUDSXOPRQDU\QRGXOHLVVXEVROLGLV´JRRGµ 0HWKRGV DQG 0DWHULDOV 6L[ WKRUDFLF UDGLRORJLVWV IURP ÀYH LQVWLWXWLRQV ZLWK DQ DYHUDJHRI\HDUҋV&7H[SHULHQFHVXEPLWWHGLPDJHVRIVXEVROLGDQGVROLG QRGXOHVHDFKWRFRQVWUXFWDGDWDEDVHRISXOPRQDU\QRGXOHV,QGLYLGXDOQRGXOH VHOHFWLRQVZHUHVHWDVWKHUHIHUHQFHVWDQGDUG7ZHOYHUDQGRPO\DUUDQJHGLPDJH GDWDEDVHVZHUHFUHDWHG(DFKEOLQGHGUDGLRORJLVWUHDGWZRGLIIHUHQWYHUVLRQVZLWKLQ DSHULRGRIGD\VLQGLFDWLQJZKHWKHURUQRWHDFKQRGXOHZDVVXEVROLG$FRUUHFW DQVZHUZDVGHÀQHGE\WKHUHIHUHQFHVWDQGDUG6HOHFWLRQVZHUHFRUUHODWHGZLWK QRGXOH VL]H ,QWHUDQG LQWUDREVHUYHU DJUHHPHQW ZDV DVVHVVHG XVLQJ WKH NDSSD VWDWLVWLFNDVVXPLQJ´JRRGµDJUHHPHQWOLHVZLWKLQWKHNDSSDUDQJHRI 5HVXOWV)RUUHDGLQJVDQGDQGRISXOPRQDU\QRGXOHVZHUHFRU UHFWO\LGHQWLÀHGDVHLWKHUVXEVROLGRUVROLG7KHUHZDVQRVWDWLVWLFDOO\VLJQLÀFDQW FRUUHODWLRQZLWKQRGXOHVL]HUV 3 UV 3 DQGUV 3 UV 3 ,QWHUREVHUYHUDJUHHPHQWZDVDWWKHORZHUUDQJHRI ´JRRGµIRUUHDGLQJVDQGN DQGN ,QWUDREVHUYHUDJUHHPHQWZDV DOVR´JRRGµN &RQFOXVLRQ5DGLRORJLVWLQWHUDQGLQWUDREVHUYHUDJUHHPHQWLQWKHGHFLVLRQZKHWKHU RUQRWDSXOPRQDU\QRGXOHLVVXEVROLGLVLQWKHORZHUUDQJHRI´JRRGµ1RGXOHVL]H LVQRWDFRQWULEXWRUWRREVHUYHUDJUHHPHQW 5HVXOWV 3DWKRORJLFDO UHVXOWV VKRZHG WKDW OHVLRQV ZHUH PDOLJQDQW OHVLRQV ZKLOHOHVLRQVZHUHEHQLJQ,85RIPDOLJQDQWOHVLRQVZDVVLJQLÀ FDQWO\KLJKHUSWZRWDLOHG0DQQ:KLWQH\WHVWWKDQWKDWRIEHQLJQOHVLRQV 7KHDUHDXQGHUUHFHLYHURSHUDWLQJFKDUDFWHULVWLFFXUYHZDV LQGLFDWLQJWKHSRWHQWLDOFDSDELOLW\RI,85LQGLIIHUHQWLDWLQJPDOLJQDQWDQGEHQLJQOXQJ OHVLRQV$Q,85WKUHVKROGYDOXHRIZDVGHWHUPLQHGDOORZLQJGLIIHUHQWLDWLRQ EHWZHHQPDOLJQDQWDQGEHQLJQOXQJOHVLRQVZLWKVHQVLWLYLW\VSHFLÀFLW\DQGDFFXUDF\ RIDQGUHVSHFWLYHO\ &RQFOXVLRQ,85LVÀUVWGHPRQVWUDWHGDVDQRYHODSSURDFKWRGLIIHUHQWLDWHEHWZHHQ PDOLJQDQWDQGEHQLJQOXQJOHVLRQVVXJJHVWLQJLWVSRWHQWLDODSSOLFDWLRQVLQPRQLWRU LQJGLVHDVHSURJUHVVLRQVDQGWKHUDSHXWLFLQWHUYHQWLRQV % 1HZO\GHYHORSHGPDWKHPDWLFDOPRGHOIRUSHUIXVLRQ&7XVLQJ GHWHFWRUURZ&7LQSDWLHQWVZLWKSXOPRQDU\QRGXOHV FRPSDULVRQRIGLDJQRVWLFFDSDELOLW\ZLWKSUHYLRXVO\XWLOLVHGPRGHOV IRUÀUVWSDVVSHUIXVLRQ&7DQG)'*3(7&7 < 2KQR 01LVKLR+.R\DPD'7 DNHQDND7 <RVKLNDZD60DWVXPRWR < )XMLVDZD.6XJLPXUD.REH-32KWDZDUD-3\RVLUDG#NREHXDFMS 3XUSRVH7 RFRPSDUHGLDJQRVWLFFDSDELOLWLHVDPRQJQHZO\GHYHORSHGDQGSUHYL RXVO\XWLOLVHGPDWKHPDWLFDOPRGHOVRQÀUVWSDVVSHUIXVLRQGHWHFWRUURZ&7 DQG)'*3(7&7 0HWKRGVDQG0DWHULDOVFRQVHFXWLYHSDWLHQWVZLWKQRGXOHVXQGHUZHQWÀUVW SDVVSHUIXVLRQ&7XVLQJDGHWHFWRUURZ&7 3(7&7 DQGPLFUREDFWHULDODQGRU SDWKRORJLFDOH[DPLQDWLRQVQRGXOHVZHUHFODVVLÀHGLQWRWZRJURXSVEDVHGRQWKH ÀQDOGLDJQRVHVPDOLJQDQWQ DQGEHQLJQQRGXOHVQ )URPSHUIXVLRQ&7 GDWDLQHDFKQRGXOHWRWDOEORRGÁRZ7)ZDVFDOFXODWHGIURPSXOPRQDU\DUWHULDO ÁRZDQGEURQFKLDODUWHULDOÁRZE\GXDOLQSXWPD[LPXPVORSHPRGHO,QDGGLWLRQ EORRGÁRZZLWKLQWKHQRGXOH%)HMHFWLRQIUDFWLRQ()DQGGLVWULEXWLRQYROXPH '9ZHUHDOVRFDOFXODWHGE\VLQJOHLQSXWPD[LPXPVORSHRU3DWODNSORWPRGHV 2Q3(7&7 689PD[ZLWKLQHDFKQRGXOHZDVGHWHUPLQHGE\52,PHDVXUHPHQW 7 RFRPSDUHGLDJQRVWLFFDSDELOLW\DPRQJDOOLQGH[HV52&WHVWVZHUHSHUIRUPHG )LQDOO\ VHQVLWLYLW\ VSHFLÀFLW\ DQG DFFXUDF\ ZHUH FRPSDUHG HDFK RWKHU XVLQJ 0F1HPDUҋVWHVW 5HVXOWV$UHDXQGHUWKHFXUYHRI7)$] SZDVVLJQLÀFDQWO\ODUJHU WKDQWKDWRI()$] '9$] SDQG689PD[$] :KHQ IHDVLEOHFXWRIIYDOXHVZHUHDGRSWHGVSHFLÀFLW\DQGDFFXUDF\RI7)ZHUHVLJQLÀ FDQWO\KLJKHUWKDQWKRVHRI%)S()SDQG689PD[S ,QDGGLWLRQVHQVLWLYLW\DQGDFFXUDF\RI7)ZHUHVLJQLÀFDQWO\KLJKHUWKDQWKRVHRI '9S &RQFOXVLRQ1HZO\GHYHORSHGPRGHOIRUÀUVWSDVVSHUIXVLRQ&7RQGHWHFWRU URZ&7ZDVPRUHDFFXUDWHWKDQSUHYLRXVO\XWLOLVHGPRGHOVDQGFDQSOD\DVPRUH VSHFLÀFDQGDFFXUDWHUROHIRUGLDJQRVLVRISXOPRQDU\QRGXOHWKDQ3(7&7 % (YDOXDWLRQRIDGDSWLYHLWHUDWLYHGRVHUHGXFWLRQ$,'5IRUOXQJ QRGXOHGHWHFWLRQLQXOWUDORZGRVHWKRUDFLF&7 163DXO+0HKUH]0+DVKHPL6$OKXPD\\G*0XUSK\5&REEROG 7 RURQWR21&$QDULQGHUSDXO#XKQRQFD 3XUSRVH7 RGHPRQVWUDWHWKHDFFXUDF\RIXOWUDORZGRVH&78/'&7ZLWK$,'5 LPDJHUHFRQVWUXFWLRQIRUOXQJQRGXOHGHWHFWLRQFRPSDUHGWR8/'&7DQG/'&7 ÀOWHUHGEDFNSURMHFWLRQ)%3LPDJHV 0HWKRGV DQG 0DWHULDOV 5DZ GDWD IURP /'&7 [ PP N9S DQG P$VGRVHaP6YZHUHVHOHFWHGVRWKDWVWXGLHVFRQWDLQHGDVLQJOHOXQJQRG XOHPHDQGLDPHWHUPPPPPHDQGHQVLW\+8+8WR+8 ZLWKYDULDEOHORFDWLRQIURPDSLFHVWREDVHV/'&7LPDJHVZHUHUHFRQVWUXFWHGZLWK )%3JURXS$DQGWDNHQDVWKHFOLQLFDOUHIHUHQFH1RLVHZDVDSSOLHGWRWKHUDZ GDWDWRJHQHUDWHVLPXODWHG8/'&7DWP$VGRVHaP6YDQGUHFRQVWUXFWHG LPDJHVZLWK)%3JURXS%DQG$,'5JURXS&DWPP7ZRFKHVWIHOORZV 55UHDGDOOLPDJHVLQUDQGRPLVHGEOLQGHGVWXG\DQGSHUIRUPHGDSRLQW 52&DQDO\VLVIRUOXQJQRGXOHGHWHFWLRQDQGDSRLQWVFDOHIRULPDJHTXDOLW\,4 SRRU JRRG H[FHOOHQW 5HVXOWV4XDOLWDWLYHDQDO\VLV,4UDWLQJIRUJURXSV $%DQG&IRUHDFKUHDGHUZHUH 5 DQGDQG5 DQG4XDQWLWDWLYHDQDO\VLVQRGXOH GHWHFWLRQE\55IRUDOOLPDJHVHWVZHUHJURXS$VHQVLWLYLW\ VSHFLÀFLW\ DFFXUDF\ $8& JURXS % VHQVLWLYLW\ VSHFLÀFLW\ DFFXUDF\ $8& JURXS&VHQVLWLYLW\ VSHFLÀFLW\ DFFXUDF\ $8& 5HVXOWVRIJURXS&8/'&7$,'5 ZHUHVXSHULRUWRJURXS%8/'&7)%3DQGFRPSDUDEOHWRJURXS$/'&7)%3 6FLHQWLILF6HVVLRQ 6 &$' ( ) *+% (XURSHDQ&RQJUHVVRI 5DGLRORJ\ E\WKHSHUFHQWDJHRIUHDGHUVZKRFRQFXUUHG&$'PDUNVIRUÀQGLQJVUHSRUWHGE\ IHZHUWKDQUHDGHUVZHUHFRQVLGHUHGIDOVH 5HVXOWV2QWKHFKHVWUDGLRJUDSKVQRGXOHVZHUHFRQVLGHUHGUHSRUWDEOH &$'VHQVLWLYLW\IRUQRGXOHVZLWKFRQFXUUHQFHZDVDQGLWGHFUHDVHG WRDQGZLWKDQGFRQFXUUHQFHUH VSHFWLYHO\7KHUHDGHUVҋSHUFHQWDJHFRQFXUUHQFHDQG&$'VHQVLWLYLW\ZHUHKLJKO\ FRUUHODWHG5 7KH&$'IDOVHPDUNUDWHZDVZKLOHWKHUHDGHUVҋIDOVH PDUNUDWHUDQJHGIURPWRPHDQRI &RQFOXVLRQ&;5&$'GHVLJQHGWRPLPLFWKHSHUIRUPDQFHRIH[SHUWVUDWKHUWKDQ WR GHWHFW &7FRQÀUPHG QRGXOHV VKRXOG LPSURYH WKH XVHIXOQHVV RI &$' LQ WKH FOLQLFDOVHWWLQJDVLWZLOOLQFUHDVHWKHZLOOLQJQHVVRIJHQHUDOUDGLRORJLVWVWRDFFHSW WKH&$'SURPSWVRQFKHVWUDGLRJUDSKV % &RPSXWHUDLGHGOXQJQRGXOHYROXPHWU\FDQ0'&7EHUHSODFHGE\ KLJKÀHOG05,DW7" 05HJLHU 6.DQGHO+%ROWH%+RIIPDQQ*$GDP-%LHGHUHU +DPEXUJ'(%HUOLQ'(.LHO'(PUHJLHU#XNHGH 3XUSRVH7 RGHWHUPLQHWKHDFFXUDF\RIFRPSXWHUDLGHGYROXPHWU\RIDUWLÀFLDOSXO PRQDU\QRGXOHVLQKLJKÀHOG05,DW7LQDQLQWUDLQGLYLGXDOFRPSDULVRQWR0'&7 0HWKRGVDQG0DWHULDOV%\LQMHFWLQJPORIDQDJDURVHVROXWLRQQRGXOHV RIGLDPHWHUVUDQJLQJPPZHUHLPSOHPHQWHGLQWRSRUFLQHOXQJVZLWKLQD GHGLFDWHG FKHVW SKDQWRP 6LJQDO RQ7ZHLJKWHG LPDJHV DQG UDGLRSDFLW\ ZHUH DGMXVWHGE\DGGLQJPPROO*G'73$DQGJORILRGLQH$7ZHLJKWHG WKUHHGLPHQVLRQDOJUDGLHQWHFKRVHTXHQFH7'*5(757(PVVOLFH PP)29PPPDWUL[[)OLSDQJOHZDVDSSOLHGLQD[LDORULHQWD WLRQIROORZHGE\0'&7[PPUHFRQVWUXFWHGVOLFHWKLFNQHVVPPLQFUHPHQW PPZKLFKVHUYHGDVWKHUHIHUHQFH&RPSXWHUDLGHGYROXPHWU\ZDVSHUIRUPHG XVLQJDFRPPHUFLDOO\DYDLODEOHVRIWZDUHWRRO2QFRWUHDW0H9LV*HUPDQ\$IWHU WKH H[SHULPHQWV DOO VSHFLPHQV ZHUH KDUYHVWHG DQG WUXH OHVLRQ VL] H D Q G V K D S H ZHUHDVVHVVHGIRUDOOQRGXOHV6WDWLVWLFVLQFOXGHGFRPSDULVRQRIPHDQYDOXHVDQG ORJLVWLFUHJUHVVLRQDQDO\VLV 5HVXOWV&RPSDUHGWRWKH0'&7GDWDXVLQJ05,PHDQOHVLRQYROXPHZDVRYHU HVWLPDWHGE\&RQVHTXHQWO\WKHVORSHRIWKHUHJUHVVLRQOLQHZDVIRUWKH 05,GDWDDQGZDVVXERUGLQDWHWRWKHLGHQWLW\OLQH &RQFOXVLRQ'XHWRWKHORZHUVSDWLDOUHVROXWLRQWKHDFFXUDF\RIFRPSXWHUDLGHG YROXPHWU\ZDVORZHUIRUWKH05,EDVHGGDWDVHWVWKDQIRU0'&7GDWD1HYHUWKH OHVVDYDULDQFHLQYROXPHDVVHVVPHQWRILPSOLHVWKDW05,FDQVXIÀFLHQWO\ EHXVHGWRPRQLWRUWKHYROXPHRIVPDOOSXOPRQDU\QRGXOHVDQGWRGHWHFWGRXEOLQJ RIQRGXOHYROXPHLQGLFDWLQJPDOLJQDQF\ % 3RVLWURQHPLVVLRQWRPRJUDSK\DQGOXQJQRGXOHVSURJQRVWLFYDOXH RIVWDQGDUGXSWDNHYDOXH $%D]]RFFKL6%URFFKL) 3RQWL9$PEURVLQL*)DFFKLQL6)DQWL %RORJQD,7VWHIDQREURFFKL #JPDLOFRP 3XUSRVH2XUDLPZDVWRLQYHVWLJDWHWKHSURJQRVWLFYDOXHRIVWDQGDUGLVHGXSWDNH YDOXH 689 LQ SDWLHQWV VXEPLWWHG WR SRVLWURQ HPLVVLRQ WRPRJUDSK\ 3(7 IRU VROLWDU\OXQJQRGXOH 0HWKRGV DQG 0DWHULDOV :H UHWURVSHFWLYHO\ DQDO\VHG WKH FOLQLFDO KLVWRU\ RI SDWLHQWVPDOHVIHPDOHV\HDUROGZKRXQGHUZHQW3(7&7IRU OXQJQRGXOHVLQDVLQJOHFHQWUHH[SHULHQFH7KHDQDO\VLVLQFOXGHGHYDOXDWLRQRI LPDJHV DQG SK\VLFLDQV UHSRUWV RI 3(7&7 H[DPV DQDPQHVLV RI SDWLHQWV DQG VXEVHTXHQWGLDJQRVWLFH[DPLQDWLRQVLQWKHLUIROORZXSLPDJLQJELRSV\VSHFLPHQ DQGRUSDWKRORJLFDODQDO\VLVDIWHUVXUJLFDOUHVHFWLRQ)ROORZXSRIDOOSDWLHQWVHQGHG ZLWKVXUYLYDOFRQWUROLQ6HSWHPEHU5HFHLYHURSHUDWLQJFKDUDFWHULVWLFFXUYHV DQG.DSODQ0HLHUPHWKRGZHUHXVHG 5HVXOWV0HDQIROORZXSZDVPRQWKV7KUHHRXWRISDWLHQWV ZHUH DIIHFWHG E\ OXQJ PHWDVWDVHV DQG ZHUH H[FOXGHG IURP IXUWKHU DQDO\VLV ,Q VXEMHFWVDQRQVPDOOFHOOOXQJFDQFHUZDVGLDJQRVHGDGHQR FDUFLQRPDVDQGVTXDPRXVFDUFLQRPDVSDWLHQWVXQGHUZHQW VXUJHU\,QDOORWKHUSDWLHQWVOHVLRQVZHUHFODVVLÀHGDVQRQRQFRORJLF GLVHDVHVRUEHQLJQ7KHEHVWFRPELQDWLRQWRSURSHUO\FKDUDFWHULVHWKHQHRSODVWLF QDWXUHRIQRGXOHVIRXQGD689PD[FXWRIIYDOXHRIUHVXOWLQJLQDQG VHQVLWLYLW\DQGVSHFLÀFLW\UHVSHFWLYHO\1RGXOHVZLWKKLJKHU689PD[YDOXH !ZHUHDVVRFLDWHGZLWKORZHUVXUYLYDOUDWHS LQGHSHQGHQWO\IURPVXUJL FDOQRQVXUJLFDODSSURDFK)RU689!DQGWKHVXUYLYDOUDWHV\HDUDIWHU 3(7LPDJLQJZHUHDQGZKLOHVXUYLYDOH[SHFWDQFLHVDIWHU\HDUV ZHUHDQGUHVSHFWLYHO\ &RQFOXVLRQ ,Q FRQFOXVLRQ SURJQRVWLF YDOXH RI 689PD[ YDOXH ZDV SURYHG D FXWRIIYDOXHRIVHHPVWRRIIHUJRRGUHOLDELOLW\DQGDFFXUDF\ % :KLFKVROLWDU\JURXQGJODVVRSDFLW\SXOPRQDU\OHVLRQQHFHVVLWDWHV LQYDVLYHLQYHVWLJDWLRQ" 55R]HQEHUJ,.RJDQ0/HLGHUPDQ$(QJHO/*XUDOQLN+DLID,/ UBUR]HQEHUJ#UDPEDPKHDOWKJRYLO 3XUSRVH7 RHYDOXDWHWKHKLVWRORJLFDOVLJQLÀFDQFHRIVROLWDU\JURXQGJODVVRSDF LW\**2LQRUGHUWRGHWHUPLQHWKHFDVHVLQZKLFK&7JXLGHG)1$VKRXOGEHWKH QH[WVWHSLQHYDOXDWLRQ 0HWKRGV DQG 0DWHULDOV :H UHWURVSHFWLYHO\ UHYLHZHG &7JXLGH )1$ RI SXOPRQDU\ OHVLRQV DV D SULPDU\ GLDJQRVWLF ZRUN XS SHUIRUPHG DWRXU LQVWLWXWLRQ EHWZHHQDQG2XUVWXG\LQFOXGHGSDWLHQWVWKDWKDGDVROLWDU\**2 SXOPRQDU\OHVLRQZLWKDPHDQDJHRI\HDUV7KHOHVLRQVZHUHLQWKH58/LQ 50/LQ5//LQ/8/LQDQG///LQRISDWLHQWV 7KHPHDQGLDPHWHURIWKH**2OHVLRQZDVFPZLWKDUDQJHIURPWRFP (DFKFDVHZDVUHYLHZHGIRUGLDJQRVWLF\LHOGDQGFRPSOLFDWLRQV 5HVXOWV$IWHU F\WRORJLFDO H[DPLQDWLRQ PDOLJQDQF\ ZDV GLDJQRVHG LQ RI SDWLHQWVLQDGHQRFDUFLQRPD16&/&DQGXQVSHFLÀHGPDOLJ QDQF\ $QHJDWLYHUHVXOWZDVREWDLQHGLQSDWLHQWVDPRQJWKHPFDVHVUHYHDOHG PDOLJQDQF\DIWHUVXUJLFDOH[FLVLRQ &RQFOXVLRQ0RVWRIWKHVROLWDU\**2SXOPRQDU\OHVLRQVWXUQHGRXWWREHPDOLJQDQW (YHQWKRXJKKLVWRORJLFDOO\PRVWRIWKHPDUHVORZJURZLQJDGHQRFDUFLQRPDVIRU WKRVHOHVLRQVZLWKPDOLJQDQWDSSHDUDQFHVXUJLFDOH[FLVLRQVKRXOGIROORZWKH&7 GLDJQRVWLF:HUHFRPPHQG&7JXLGHG)1$LQFDVHVRIHTXLYRFDO**2OHVLRQV RULQSDWLHQWVWKDWDUHQRWDEOHWRXQGHUJRDVXUJLFDOSURFHGXUHDQGDGLDJQRVLVLV PDQGDWRU\IRUIXUWKHUWUHDWPHQW % &RPSXWHUDLGHGGHWHFWLRQRIJURXQGJODVVQRGXOHVLQOXQJFDQFHU VFUHHQLQJUHWURVSHFWLYHHYDOXDWLRQRISRWHQWLDOEHQHÀW &-DFREV (7 6FKROWHQ6&6DXU7 7ZHOOPDQQ3 $GH-RQJ %YDQ*LQQHNHQ%UHPHQ'(+DDUOHP1/8WUHFKW1/1LMPHJHQ1/ FROLQMDFREV#PHYLVIUDXQKRIHUGH 3XUSRVH*URXQGJODVVQRGXOHV**1VKDYHDKLJKSUREDELOLW\RIEHLQJPDOLJQDQW :H UHWURVSHFWLYHO\ LQYHVWLJDWHG WKH XVHIXOQHVV RI D GHGLFDWHG FRPSXWHUDLGHG GHWHFWLRQ&$'V\VWHPIRU**1VLQDFOLQLFDOVFUHHQLQJVHWWLQJ 0HWKRGV DQG 0DWHULDOV$ VHW RI ORZGRVH FKHVW &7 VFDQV [ PP N9SP$VZHUHUDQGRPO\VHOHFWHGIURPDOXQJFDQFHUVFUHHQLQJWULDO $OOVFDQVZHUHSURFHVVHGZLWKDUHVHDUFKSURWRW\SH&$'V\VWHPIRU**1V'L DJQRVWLF,PDJH$QDO\VLV*URXS1LMPHJHQ7KH1HWKHUODQGV)UDXQKRIHU0(9,6 %UHPHQ*HUPDQ\7ZRFKHVWUDGLRORJLVWVLQVSHFWHGDOO&$'PDUNVDQGFODVVLÀHG WKHPDV**1RWKHUOHVLRQRUIDOVHSRVLWLYH)LQGLQJVZHUHFRPSDUHGZLWKWKH DQQRWDWLRQVUHFRUGHGLQWKHVFUHHQLQJWULDOGDWDEDVHZKLFKZHUHREWDLQHGZLWKRXW WKHVXSSRUWRI&$' 5HVXOWV**1&$'IRXQGPDUNVSHUVFDQ5DGLRORJLVWFODVVLÀHG PDUNVDV**1DVRWKHUOHVLRQVDQGDVIDOVHSRVLWLYHV)RUUDGLRORJLVW WKHVHQXPEHUVZHUHDQGUHVSHFWLYHO\)LIWHHQÀQGLQJVZHUHFRQ VLGHUHGWREH**1VE\ERWKUDGLRORJLVWV2IWKHVHRQO\KDGEHHQDQQRWDWHG LQWKHVFUHHQLQJWULDO&$'PDUNVWKDWZHUHFODVVLÀHGE\WKHUDGLRORJLVWVDVRWKHU OHVLRQVLQYROYHGPDLQO\VFDUVDQGDUHDVRILQÁDPPDWLRQ $FRPPRQVRXUFHRI&$' IDOVHSRVLWLYHVZHUHKD]\RSDFLWLHVFDXVHGE\FDUGLDFPRWLRQ &RQFOXVLRQ$WOHVVWKDQIDOVHSRVLWLYHVSHUVFDQWKH&$'V\VWHPFDQVXE VWDQWLDOO\LQFUHDVHWKHQXPEHURI**1VLGHQWLÀHGLQDOXQJFDQFHUVFUHHQLQJWULDO DWDIDOVHSRVLWLYHUDWHWKDWGRHVQRWLPSRVHDEXUGHQRQWKHUHDGLQJSURFHVV % 1HZJROGVWDQGDUGIRUGHVLJQLQJD&;5&$'DOJRULWKPIRUOXQJ QRGXOHVDQGDVVHVVLQJLWVSHUIRUPDQFH '6KDKDP,/HLFKWHU$0DQHYLWFK1%RJRW5/HGHUPDQ-HUXVDOHP,/ GVKDKDP#KDGDVVDKRUJLO 3XUSRVH&XUUHQWO\UHDGHUVDUHUHOXFWDQWWRDFFHSWORZFRQVSLFXLW\OXQJQRGXOHV GHWHFWHGE\&$'RQFKHVWUDGLRJUDSKVHYHQZKHQWKH\DUH&7FRQÀUPHG7KLV VWXG\GHVFULEHVDQHZ&$'DOJRULWKPGHVLJQHGWRGHWHFWOXQJQRGXOHVFRQVLGHUHG UHSRUWDEOHE\H[SHUWUDGLRORJLVWV 0HWKRGVDQG0DWHULDOV7KHQHZSURWRW\SH&;5&$'DOJRULWKP6LHPHQVZDV WUDLQHGRQGLJLWDOIURQWDOFKHVWUDGLRJUDSKVIURPYHQGRUVFXOOHGIURPVLWHV DQGUHYLHZHGUHWURVSHFWLYHO\E\LQGHSHQGHQWH[SHUWUDGLRORJLVWV7 RHVWDEOLVK WKHQHZJROGVWDQGDUGDQRGXOHUHSRUWHGE\DWOHDVWUHDGHUVZDVFRQVLGHUHG UHSRUWDEOHVXFKQRGXOHVPPZHUHIRXQG7KHSHUIRUPDQFHRI&$' XVLQJWKHQHZJROGVWDQGDUGZDVWHVWHGRQDGLIIHUHQWVHWFKHVWUDGLRJUDSKV UHYLHZHGIRUQRGXOHVE\LQGHSHQGHQWUHDGHUV&$'VHQVLWLYLW\ZDVHYDOXDWHG 6FLHQWLILF6HVVLRQ $ 6&'()*+% 7KXUVGD\ (XURSHDQ&RQJUHVVRI 5DGLRORJ\ % &RQWUDVWHQKDQFHGXOWUDVRXQG&(86LPSURYHVUHDOWLPHLPDJLQJRI DEODWLRQUHJLRQGXULQJUDGLRIUHTXHQF\DEODWLRQ5)$SUHOLPLQDU\UHVXOWV 3 :LJJHUPDQQ(0-XQJ&6WURV]F]\QVNL 5HJHQVEXUJ'(SKLOLSSZLJJHUPDQQ#JRRJOHPDLOFRP 3XUSRVH7 RDVVHVVWKHDGGHGYDOXHRIGHSLFWLQJWXPRXUPLFURYDVFXODULVDWLRQ XVLQJFRQWUDVWHQKDQFHGXOWUDVRXQG&(86GXULQJ5)$DVDPHDQVRIDFKLHYLQJ DFRPSOHWHDEODWLRQ&$RIPDOLJQDQWOLYHUOHVLRQV 0HWKRGVDQG0DWHULDOVFRQVHFXWLYHSDWLHQWVIHPDOHVPDOHVDJHUDQJH \HDUV PHDQ \HDUV ZLWK KLVWRORJLFDOO\ FRQÀUPHG KHSDWLF PDOLJQDQFLHV +&& Q OLYHU PHWDVWDVHV Q XQGHUZHQW5)$ %HIRUH 5)$FRQYHQWLRQDO86&(86DQGFRQWUDVWHQKDQFHG&7FH&7RIWKHOLYHUZHUH SHUIRUPHG'XULQJWKH&7JXLGHG5)$SURFHGXUH&(86ZDVSHUIRUPHGWRDVVHV WKHDEODWLRQGHIHFW,QFDVHRISDUWLDODEODWLRQDVXEVHTXHQWDEODWLRQZDVSHUIRUPHG ZLWKDFRUUHFWHGHOHFWURGHSRVLWLRQDQGHYDOXDWHGDJDLQXVLQJ&(867KLVSURFHGXUH ZDVUHSHDWHGXQWLOD&$ZDVDFKLHYHG7KHQXPEHURIDEODWLRQVSHUSDWLHQWZDV UHFRUGHG6HFRQGDU\HIÀFDF\SDUDPHWHUVDVVHVVHGZHUHOHVLRQGHWHFWDELOLW\LQWKH GLIIHUHQWLPDJLQJPRGDOLWLHVDQGFRQWUDVWSKDVHV 5HVXOWV2YHUDOOLQWUDSURFHGXUDO&(86OHGWRDFKDQJHLQWKHUDSHXWLFPDQDJHPHQW LQRIFDVHVUHVXOWLQJLQDGGLWLRQDODEODWLRQV/HVLRQGHWHFWDELOLW\GXULQJ &7ÁXRURVFRS\ZDVWKHVROHVWDWLVWLFDOVLJQLÀFDQWSUHGLFWRURILQFRPSOHWHDEODWLRQV S 7KHPHDQQXPEHURIDEODWLRQVIRUGHWHFWDEOHOHVLRQVZDVYV DEODWLRQVIRUQRWGHWHFWDEOHOHVLRQVS 7KHFRPELQHG&7DQG&(865)$ SURFHGXUHOHGWRD&$IRUDOOWUHDWHGOHVLRQVLQIROORZXSPRQWKSRVWLQWHUYHQWLRQ &RQFOXVLRQ&(86GRHVDOORZDUHOLDEOHLPPHGLDWHDVVHVVPHQWRIWKHUDSHXWLF HIÀFDF\RISHUFXWDQHRXV5)$SURFHGXUHVRIPDOLJQDQWOLYHUOHVLRQV % 3HUFXWDQHRXV86JXLGHGLQWHUVWLWLDOODVHUDEODWLRQRIPHWDVWDWLF O\PSKQRGHVLQWKHQHFNIURPSDSLOODU\WK\URLGFDUFLQRPDIROORZLQJ WK\URLGHFWRP\DQGO\PSKDGHQHFWRP\ *0DXUL /&RYD7 ,HUDFH7 7 RQGROR*/RPXVFLR$%DUROL/6ROELDWL 0LODQ,7%XVWR$UVL]LR,7JLRPDXUL#WLVFDOLLW 3XUSRVH :H UHSRUW RXU H[SHULHQFH ZLWK SHUFXWDQHRXV 86JXLGHG LQWHUVWLWLDO ODVHUDEODWLRQIRUPHWDFKURQRXVFHUYLFDOQRGDOPHWDVWDVHVIURPSDSLOODU\WK\URLG FDUFLQRPDIROORZLQJWRWDOWK\URLGHFWRP\DQGFHQWUDOODWHURFHUYLFDOO\PSKQRGH 0HWKRGV DQG 0DWHULDOV 7ZHQW\WKUHH PHWDFKURQRXV PHWDVWDWLF QRGHV PHDQ VL]HFPUDQJHFPLQSDWLHQWVZHUHWUHDWHG$QP1G<$* ODVHU(FKR/DVHU;(VDRWH*HQRD,WDO\ZDVXVHG$OOFDVHVZHUHQHJDWLYHDW ,ZKROHERG\VFDQEXWKDGSRVLWLYH))'*3(7DQGHOHYDWHGVHUXPOHYHOV RIWK\URJOREXOLQ8QGHUORFDODQDHVWKHVLDDѥPTXDUW]ÀEHURSWLFJXLGHZDV SODFHGLQWRWKHQRGHWKURXJKD*QHHGOH1RGHVZHUHWUHDWHGZLWKRQHFDVHV RUWZRÀEHULQVHUWLRQVHDFKRQHZLWK:SRZHUIRUVHFWRWDOHQHUJ\ MRXOHV$OOFDVHVZHUHIROORZHGDWDQGPRQWKVZLWK%PRGH86 &(86))'*3(7DQGDVVHVVPHQWRIVHUXPOHYHOVRI7J 5HVXOWV/DVHUDEODWLRQZDVWHFKQLFDOO\IHDVLEOHDQGZHOOWROHUDWHGLQDOOSDWLHQWV ZLWK HLWKHU LPPHGLDWH RU ODWH FRPSOLFDWLRQV ,Q QRGHV FRPSOHWH DEODWLRQODFNRIHQKDQFHPHQWDW&(86QHJDWLYH))'*3(7ZLWKQRUPDOLVD WLRQRI689DQG!GHFUHDVHRI7JVHUXPOHYHOVZDVDFKLHYHG,QFDVHV UHVLGXDOXSWDNHDW))'*3(7ZLWKDEQRUPDO689ZDVIRXQGDQGODVHUDEODWLRQ ZDVUHSHDWHG &RQFOXVLRQ3HUFXWDQHRXV86JXLGHGLQWHUVWLWLDOODVHUDEODWLRQVHHPVWREHDQ HIIHFWLYHORZFRVWDQGVDIHWKHUDSHXWLFWRROIRUWKHWUHDWPHQWRIPHWDFKURQRXVQRGDO PHWDVWDVHVIURPSDSLOODU\WK\URLGFDUFLQRPDLQWKHQHFNZKLFKZRXOGRWKHUZLVH UHTXLUHRIWHQFKDOOHQJLQJIXUWKHUUHVHFWLRQV % 7KHFUXFLDOUROHRIÀGXFLDOPDUNHUVRQDVVHVVPHQWRIDEODWLYHPDUJLQ 07UDN\PDV$8O\V9LOQLXV/7PDQWDVWUDN\PDV#YXRLOW 3XUSRVH7 RDVVHVVWKHEHQHÀWRILPSODQWHGÀGXFLDOPDUNHUVRQH[DFWGHWHFWLRQ RIDEODWLYHPDUJLQDQGRQORFDOWXPRXUSURJUHVVLRQUDWH 0HWKRGVDQG0DWHULDOV(DFKRIPHWDVWDWLFOLYHUWXPRXUVPPPHGLDQ PPZDVPDUNHGZLWKWKUHHWLWDQLXPÀGXFLDOVEHIRUHUDGLRIUHTXHQF\DEODWLRQ )LGXFLDOVZHUHLPSODQWHGQHDUWKHWXPRXUXQGHUXOWUDVRXQGJXLGDQFH7KHWKUHH SKDVHFRQWUDVWHQKDQFHG0'&7VFDQZDVSHUIRUPHGIRUHDFKSDWLHQWDIWHUWKH LPSODQWDWLRQ RI ÀGXFLDOV$OO WKH WXPRXUV ZHUH WUHDWHG E\ 86JXLGHG 5)$ XVLQJ SHUIXVHGDQGPXOWLSRODULQWHUQDOO\FRROHGHOHFWURGHV7KHFRQWUROFRQWUDVWHQKDQFHG 0'&7 VFDQ ZDV SHUIRUPHG QH[W GD\ DIWHU DEODWLRQ 7KH HYDOXDWLRQ RI DEODWLYH PDUJLQZDVPDGHE\IXVLQJ&7VFDQVDFFRUGLQJWRHDFKÀGXFLDO 5RRP' ,QWHUYHQWLRQDO5DGLRORJ\ 66 $EODWLRQ 0RGHUDWRUV 5)'RQGHOLQJHU/LqJH%( ')LOLSSLDGLV$WKHQV*5 % &7 PRUSKRORJLFDOFKDQJHRIDOGRVWHURQHSURGXFLQJDGHQRPDDIWHU UDGLRIUHTXHQF\DEODWLRQ .//HH< 6/LX6&7 RQJ(.1J$7 $KXMD+RQJ.RQJ+. OHHNDORN #\DKRRFRPKN 3XUSRVH 7 R HYDOXDWH WKH PRUSKRORJLFDO FKDQJHV RI DOGRVWHURQHSURGXFLQJ DGHQRPD$3$RQFRPSXWHGWRPRJUDSK\VFDQEHIRUHDQGDIWHUUDGLRIUHTXHQF\ DEODWLRQ5)$DQGWRLGHQWLI\IDFWRUVWKDWDUHLPSRUWDQWLQGHWHUPLQLQJVXFFHVVIXO FRPSOHWHDEODWLRQRIWKHVHWXPRUV 0HWKRGVDQG0DWHULDOV%HWZHHQ$XJXVWDQG$XJXVWFRQVHFX WLYHSDWLHQWVZLWK$3$XQGHUJRLQJ&7JXLGHGSHUFXWDQHRXV5)$ZHUHLGHQWLÀHG IURPRXUSURVSHFWLYHGDWDEDVH7KHSUH5)$DQGSRVW5)$&7DSSHDUDQFHVRI WKHVH$3$ZHUHUHWURVSHFWLYHO\UHYLHZHGIRUWKHLUWKUHHGLPHQVLRQDOVL]HWXPRU YROXPHDQG+RXQVÀHOGXQLWV+8&RPSDULVRQRIWKHVHSDUDPHWHUVEHIRUHDQG DIWHU5)$ZDVSHUIRUPHG 5HVXOWV,QWKLVVWXG\WKHUHZHUH $3$WKDWVKRZHGELRFKHPLFDOFXUHRISULPDU\ DOGRVWHURQLVPDIWHU5)$&RPSDULQJSRVW5)$WRSUH5)$&7VFDQVWKHUHZDV QRVLJQLÀFDQWFKDQJHLQWXPRUVL]HDQWHULRUSRVWHULRUGLPHQVLRQPPYHUVXV PP3 PHGLDOODWHUDOGLPHQVLRQPPYHUVXVPP3 FUDQLDOFDXGDOGLPHQVLRQPPYHUVXVPP3 DQGWXPRXUYROXPH FPYHUVXVFP3 DIWHU5)$,QQRQHQKDQFHG&7LPDJHVWKHUH ZDVQRVLJQLÀFDQWUHGXFWLRQLQ+8IURPSUH5)$WRSRVW5)$PHDVXUHPHQWV YHUVXV3 ,QFRQWUDVWHQKDQFHG&7VFDQVWKHUHZDVDVLJQLÀFDQWGURS LQ+8DIWHU5)$IURPWR3 1RQHRIWKHLQFOXGHGFDVHVVKRZHG IRFDOUHJLRQRIFRQWUDVWHQKDQFHPHQWWRVXJJHVWUHVLGXDOWXPRXU &RQFOXVLRQ&KDQJHLQWXPRXUVL]HWXPRXUYROXPHDQG+8LQQRQHQKDQFHG&7 ZHUHXQUHOLDEOHLQGHÀQLQJUDGLRORJLFDOWUHDWPHQWVXFFHVV2QO\FKDQJHLQ+8LQ FRQWUDVWHQKDQFHG&7VFDQZDVXVHIXOLQFRQÀUPLQJSRVLWLYHWUHDWPHQWUHVSRQVH DIWHU5)$IRU$3$ % 5DGLRIUHTXHQF\DEODWLRQRIKHSDWLFPHWDVWDVHVDIWHUFXUDWLYH UHVHFWLRQRIH[WUDKHSDWLFFKRODQJLRFDUFLQRPD 6< 3DUN-.LP+:RQ< 6KLQ3 .LP6HRXO.5VXQ\SDUN #QDYHUFRP 3XUSRVH7 RUHWURVSHFWLYHO\HYDOXDWHORFDOFRQWURODQGVXUYLYDODIWHUUDGLRIUHTXHQF\ DEODWLRQ5)$LQSDWLHQWVZLWKOLYHUPHWDVWDVHVDULVLQJIURPH[WUDKHSDWLFFKRODQJL RFDUFLQRPD(&&ZKRKDGSUHYLRXVO\XQGHUJRQHFXUDWLYHUHVHFWLRQ 0HWKRGVDQG0DWHULDOV)URP0D\WR0D\5)$XVLQJDQLQWHUQDOO\ FRROHGHOHFWURGHZDVSHUIRUPHGRQPHWDFKURQRXVOLYHUPHWDVWDVHVWXPRXU SHUSDWLHQWDULVLQJIURP(&&LQSDWLHQWVPHDQDJH\HDUV7XPRXUVL]H UDQJHGIURPFPWRFPLQPD[LPXPGLPHQVLRQPHDQFP $VKLVWRULFDO FRPSDULVRQVZHLQFOXGHGSDWLHQWVGLDJQRVHGZLWKUHFXUUHQWPHWDVWDVLVOLPLWHG WRWKHOLYHUEHWZHHQ)HEUXDU\DQG $SULODQGZKRPHWWKHLQFOXVLRQFULWHULD IRU5)$SDWLHQWVUHFHLYHGVXSSRUWLYHWKHUDS\RQO\ZKLOHSDWLHQWVXQGHUZHQW FKHPRUDGLRWKHUDS\ 5HVXOWV)LYHSDWLHQWVKDGPDMRUFRPSOLFDWLRQVIRXUZLWKOLYHUDEVFHVVDQGRQH ZLWK ELOLDU\ VWULFWXUH SHU WUHDWPHQW EXW WKHUH ZHUH QR SURFHGXUHUHODWHG GHDWKV&RPSOHWHWXPRXUQHFURVLVZDVDFKLHYHGLQDOOWXPRXUVDIWHURQHVHV VLRQRI5)$7KHORFDOWXPRXUSURJUHVVLRQUDWHZDVPHGLDQWLPHWRGHWHF WLRQPRQWKV)URPWKHÀUVWGLDJQRVLVRIOLYHUPHWDVWDVLVWKHPHGLDQRYHUDOO VXUYLYDOZDVPRQWKVDQGWKH\HDUVXUYLYDOUDWHZDV3DWLHQWVXUYLYDO ZDVVLJQLÀFDQWO\ORQJHULQSDWLHQWVZKRUHFHLYHG5)$WKDQLQWKRVHZKRUHFHLYHG FKHPRUDGLRWKHUDS\PHGLDQVXUYLYDOPRQWKVRUVXSSRUWLYHWUHDWPHQWPHGLDQ VXUYLYDOPRQWKV3 &RQFOXVLRQ 3HUFXWDQHRXV 5)$ UHVXOWV LQ HIIHFWLYH ORFDO WXPRXU FRQWURO DQG PD\SURORQJVXUYLYDOLQSDWLHQWVZLWKUHFXUUHQWKHSDWLFPHWDVWDVHVDIWHUFXUDWLYH UHVHFWLRQIRU(&& 6FLHQWLILF6HVVLRQ 6 &$' ( ) *+% (XURSHDQ&RQJUHVVRI 5DGLRORJ\ % 5HQDOUDGLRIUHTXHQF\DEODWLRQ5)$HIIHFWRISULPDU\WKHUPDO DEODWLRQRQWKHPHGLXPWHUPVXUYLYDO &0LJOLRULVL) %DUERVD&7LFFD01LFKHODWWL'0D]]RQH 59HUFHOOL06ROFLD$5DPSROGL*&RUQDOED0LODQ,7 FDUPHORPLJOLRULVL#RVSHGDOHQLJXDUGDLW 3XUSRVH7 RDVVHVVWKHHIIHFWRISULPDU\WKHUPDODEODWLRQFRPSOHWHRULQFRP SOHWHRQWKHVXUYLYDO3UHYDOHQFHRIV\QFKURQRXVPHWDFKURQRXVOHVLRQVUHODSVH PHWDVWDVLVORFDOWXPRXUSURJUHVVLRQDVZHOOFRPSOLFDWLRQUDWHVZHUHUHSRUWHG 0HWKRGV DQG 0DWHULDOV )LIW\WZR SDWLHQWV UHQDO OHVLRQV XQGHUZHQW 5)$ ZHUH UHWURVSHFWLYHO\ VHOHFWHG 7KH DYHUDJH IROORZXS WLPH ZDV PRQWKV PRQWKV0HDQDJHZDV\HDUV\HDUVPDOHVIHPDOHV 7KHPHDQWXPRXUVL]HRI650VZDVPPPP5)$ZHUHFDUULHGRXW XQGHUXOWUDVRXQGRU&7JXLGDQFH&KLVTXDUHGWHVW)LVKHUҋVH[DFWWHVW.DSODQ 0H\HUDQG&R[VHPLSDUDPHWULFUHJUHVVLRQZHUHXVHG 5HVXOWV5)$ZDVVXFFHVVIXOO\SHUIRUPHGLQRIOHVLRQV650V UHVLGXDO OHVLRQV DQG UHODSVH GLVHDVH &RPSOHWH SULPDU\ WKHUPDO DEODWLRQ 37$RI650VZDVRIUHVLGXDOOHVLRQVDQGRIUHODSVHGLVHDVH &RPSOLFDWLRQVZHUHREVHUYHGLQRIWUHDWHGOHVLRQVPLQLPXPJURXQG EORRGKDHPDWRPDKDHPDWRPDDQGLQIHFWLRQDQGOLYHUGDPDJH QRQUHODWLRQEHWZHHQSURFHGXUHFRPSOLFDWLRQVDQGSULPDU\WKHUPDODEODWLRQ ZDVREVHUYHG6\QFKURQRXVOHVLRQVZDVSUHVHQWLQSDWLHQWV'XU LQJIROORZXSSDWLHQWVGHYHORSHGPHWDFURQRXVOHVLRQVDQG UHODSVHSUHVHQWHGPHWDVWDWLFGLVHDVHRIWKHVHDOUHDG\ KDGPHWDVWDVLVEHIRUHWUHDWPHQW/RFDOWXPRXUSURJUHVVLRQZHUHSUHVHQWLQ SDWLHQWVRIWKHVHGLHG &RQFOXVLRQ5)$SURYLGHDQIHDVLEOHVDIHW\DQGHIIHFWLYHPLQLPDOO\LQYDVLYHWUHDW PHQWRIUHQDOOHVLRQVLQVHOHFWHGSDWLHQWVZLWKORZUDWHRIUHFXUUHQFH % 3HUFXWDQHRXVPLFURZDYHDEODWLRQ0:$ZLWKDKLJKHQHUJ\ DQWHQQDHV\VWHPRISXOPRQDU\PDOLJQDQFLHVWHFKQLFDOVXFFHVV VDIHW\DQGLPDJLQJIROORZXS '< ) &KXQJ0/LWWOH3 %RDUGPDQ) 9*OHHVRQ(0$QGHUVRQ2[IRUG8. 3XUSRVH (YDOXDWLRQ RI WKH WHFKQLFDO VXFFHVV VDIHW\ DQG LPDJLQJ IROORZXS RI PDOLJQDQWSXOPRQDU\QRGXOHVWUHDWHGZLWKKLJKHQHUJ\SHUFXWDQHRXV0:$ 0HWKRGVDQG0DWHULDOV)URP-XO\WR6HSWHPEHUSDWLHQWVIH PDOHVPHDQDJHZLWKSXOPRQDU\PDOLJQDQFLHVRIPHGLDQGLDPHWHUPP UDQJHPPZHUHWUHDWHGZLWKSHUFXWDQHRXV0:$XQGHU&7JXLGDQFH $* PLFURZDYHQHHGOHDQWHQQD0LFURVXOLV3RUWVPRXWK8.ZDVXVHGZLWKSRZHUXS WR:7 HFKQLFDOVXFFHVVRIDEODWLRQZDVGHÀQHGDV!PPJURXQGJODVVRU VROLGRSDFLÀFDWLRQPDUJLQDURXQGWKHDEODWHGOHVLRQDWFRQWUDVWHQKDQFHG&7GD\ SRVWSURFHGXUH/RFDOWXPRXUUHFXUUHQFHZDVDVVHVVHGDWDQGPRQWKV SRVWDEODWLRQ 0HDVXUHPHQWV DQG DVVHVVPHQW RI ORFDO WXPRXU UHFXUUHQFH ZHUH XQGHUWDNHQE\WKHUDGLRORJLVWSHUIRUPLQJWKHSURFHGXUHDQGDVHFRQGUDGLRORJLVW QRW LQYROYHG LQ WKH SDWLHQW V FDUH &RPSOLFDWLRQV ZHUH UHFRUGHG DW WKH WLPH RI SURFHGXUHDQGDWIROORZXS 5HVXOWV0HGLDQDEODWLRQWLPHZDVPLQUDQJHPLQ7KHSURFHGXUHZDV WHFKQLFDOO\ VXFFHVVIXO LQ OHVLRQV SDWLHQWV GHYHORSHG SQHX PRWKRUD[GXULQJWKHSURFHGXUHRIZKLFKUHTXLUHGDFKHVWGUDLQRISDWLHQWV ZHUHGLVFKDUJHGGD\SRVWSURFHGXUH1RSDWLHQWVGLHGDVDGLUHFWUHVXOWRIWKH SURFHGXUH$WPRQWKIROORZXSORFDOUHFXUUHQFHZDVLGHQWLÀHGLQSDWLHQWV &RQFOXVLRQ0:$XVLQJDQRYHOKLJKSRZHUDQWHQQDRIOXQJOHVLRQVLVDVDIH VXFFHVVIXOWHFKQLTXHWKDWDOORZVVKRUWHUDEODWLRQWLPHVFRPSDUHGWRUDGLRIUHTXHQF\ DEODWLRQ5)$7KHFRPSOLFDWLRQUDWHVDUHFRPSDUDEOHWR5)$ % /RFDOFRQWURORIIRFDOKHSDWLFPDOLJQDQFLHVWUHDWHGZLWKPLFURZDYH DEODWLRQZLWKDKLJKSRZHUDSSOLFDWRUV\VWHPLQSDWLHQWV *0DXUL /&RYD7 ,HUDFH7 7 RQGROR61*ROGEHUJ/6ROELDWL %XVWR$UVL]LR,7-HUXVDOHP,/YDQQLPDXUL#JPDLOFRP 3XUSRVH7 RDVVHVVWKHHIÀFDF\DQGVDIHW\RIPLFURZDYHDEODWLRQIRUWKHWUHDWPHQW RIKHSDWLFPDOLJQDQFLHVXVLQJDKLJKSRZHUDSSOLFDWRUV\VWHP 0HWKRGVDQG0DWHULDOV2YHUDPRQWKSHULRGKHSDWLFPDOLJQDQFLHV +&&FKRODQJLRFDUFLQRPDDQGPHWDVWDVHVLQSDWLHQWVZHUHSHUFXWD QHRXVO\ WUHDWHG XQGHU 86 JXLGDQFH XVLQJ D KLJKSRZHU :DWW *+] PLFURZDYHV\VWHP$0,&$3UREH+RVSLWDO6HUYLFH$SULOLD,WDO\2QHQ RUWZRQ DQWHQQDLQVHUWLRQVZHUHSHUIRUPHG3RZHUDQGWLPHRIDSSOLFDWLRQ UDQJHGIURPWR:DWWDQGIURPWRPLQUHVSHFWLYHO\,PDJLQJHLWKHU FRQWUDVWHQKDQFHG0'&7RU05,DWPRQWKVZDVXVHGIRUSRVWDEODWLRQ 5HVXOWV 5)$ ZDV WHFKQLFDOO\ VXFFHVVIXO LQ DOO FDVHV 7KH GHWHFWHG PLQLPDO DEODWLYHPDUJLQUDQJHGIURPWR!PPDQGWKHDFFXUDWHGHWHFWLRQRIDEODWLYH PDUJLQZDVSRVVLEOHIRUDOOWKHWXPRXUV,QIRXUFDVHVWKHUHSHDWHGDEODWLRQZDV SHUIRUPHGVLQFHWKHDEODWLRQPDUJLQZDVOHVVWKDQPPDQGDODJHUDEODWLRQRI SDUWLFXODU UHJLRQ ZDV IHDVLEOH 2Q IROORZXS PRQWKV PHGLDQ PRQWKV RQO\RQHORFDOWXPRXUSURJUHVVLRQZDVGHWHFWHG,QWKLVFDVHWKHDEODWLYHPDUJLQ ZDVPPDQGWKHUHDEODWLRQZDVQRWIHDVLEOHGXHWRWKHSUR[LPLW\RIWKHWXPRXU WRDODUJHSRUWDOYHLQ &RQFOXVLRQ 7KH XVH RI ÀGXFLDO PDUNHUV IRU DEODWLRQ WUHDWPHQW JLYHV XV QHZ SRVVLELOLWLHVIRUUDGLFDOWUHDWPHQWRSWLRQVHQDEOHVGLUHFWDVVHVVPHQWRIDEODWLYH PDUJLQDQGUDLVHVWKHDEODWLRQWRDKLJKHUTXDOLWDWLYHOHYHO % 7KHVLJQLÀFDQFHRISHUVLVWHQWLQWUDOHVLRQDOHQKDQFHPHQWRIUHQDO WXPRXUVIROORZLQJSHUFXWDQHRXVFU\RDEODWLRQ %6KHSKHUG3 .XPDU7 -&%U\DQW'-%UHHQ6RXWKDPSWRQ8. EHWKBVKHS#KRWPDLOFRP 3XUSRVH :H HYDOXDWHG WKH RFFXUUHQFH RI ҊWKUHDGOLNHҋ LQWUDWXPRUDO HQKDQFH PHQWRQLQLWLDOFURVVVHFWLRQDOLPDJLQJLQUHQDOWXPRXUVWUHDWHGE\SHUFXWDQHRXV FU\RDEODWLRQ 0HWKRGVDQG0DWHULDOV:HSHUIRUPHGDUHWURVSHFWLYHUHYLHZRIWKHSRVWSURFH GXUDOLPDJLQJRIDOOVROLGUHQDOWXPRXUVWUHDWHGZLWKSHUFXWDQHRXVFU\RDEODWLRQIURP 0D\WR-XQH:HUHFRUGHGDOOSDWLHQWVZLWKLQWUDWXPRUDOHQKDQFHPHQW VHHQRQWKHLQLWLDO&7RU05SHUIRUPHGZLWKLQZHHNV 5HVXOWVWXPRXUVLQSDWLHQWVZHUHLGHQWLÀHGRXWRIWKHWXPRXUV VKRZHGLQLWLDOҊWKUHDGOLNHҋLQWUDWXPRXUDOHQKDQFHPHQW2IWKHVHWX PRXUVQRQHKDGHYLGHQFHRIUHVLGXDORUUHFXUUHQWGLVHDVHDWDPHDQUDGLRORJLFDO IROORZXSRIPRQWKV2IWKHWXPRXUVZHUHFRQÀUPHGUHQDOFHOOFDUFL QRPDRQFRF\WRPDVDQGZHUHLQGHWHUPLQDQW7KLVZDVSURSRUWLRQDOZLWKWKH SDWKRORJLFDOGLVWULEXWLRQRIWKHODUJHUFRKRUW &RQFOXVLRQ $VPDOOEXWVLJQLÀFDQWPLQRULW\RIVROLGUHQDOFHOOWXPRXUVGHPRQVWUDWH VHHPLQJO\EHQLJQLQWUDOHVLRQDOҊWKUHDGOLNHҋHQKDQFHPHQWSRVWFU\RDEODWLRQ,WLV LPSRUWDQWWREHDZDUHRIWKLVSKHQRPHQRQDVWRDYRLGWKHVHTXHODHRIPLVUHSRUWLQJ WKLVDVUHVLGXDOGLVHDVH % 0LFURZDYHDEODWLRQ0:$YHUVXVUDGLRIUHTXHQF\DEODWLRQ5)$IRU VPDOOOLYHUPDOLJQDQFLHVUDWHVRIWHFKQLFDOVXFFHVV *0DXUL7 7 RQGROR/&RYD7 ,HUDFH/6ROELDWL%XVWR$UVL]LR,7 YDQQLPDXUL#JPDLOFRP 3XUSRVH7 RFRPSDUHSULPDU\WHFKQLFDOVXFFHVVRI0:$DQG5)$IRUWKHWUHDW PHQWRIVPDOOOLYHUWXPRXUV 0HWKRGVDQG0DWHULDOVOLYHUPDOLJQDQFLHV+&&VDQGPHWDVWDVHV VPDOOHUWKDQFPLQSDWLHQWVXQGHUJRQH86JXLGHGWKHUPDODEODWLRQZLWK 0:$Q RU5)$Q EHWZHHQ-DQXDU\DQG-XQHZHUHUHWUR VSHFWLYHO\HYDOXDWHG $VLQJOHQHHGOHLQVHUWLRQZDVSUHRSHUDWLYHSODQQHG3ULPDU\ WHFKQLFDOVXFFHVVFRPSOHWHFRYHUDJHRIWKHWXPRXUDIWHURQHDEODWLRQDFKLHYHG LQWKH0:$JURXSDQGLQWKH5)$JURXSZDVGLVWLQFWO\DVVHVVHGE\LQWUDRSHUDWLYH FRQWUDVWHQKDQFHG86&(86)XUWKHUDEODWLRQVZHUHSHUIRUPHGGXULQJWKHVDPH VHVVLRQZKHQ&(86VKRZHGUHVLGXDOOHVLRQDOHQKDQFHPHQWXQWLODFKLHYHPHQW RIFRPSOHWHODFNRIHQKDQFHPHQWKRXU&7RU05,ZHUHSHUIRUPHGWRDVVHVV WKHÀQDOWHFKQLFDOVXFFHVV 5HVXOWV 3ULPDU\ WHFKQLFDO VXFFHVV ZDV DFKLHYHG LQ WXPRXUV LQWKH0:$JURXSDQGLQLQWKH5)$JURXSS LQ +&&VLQWKH0:$JURXSDQG+&&VLQWKH5)$JURXS S LQPHWDVWDVHVLQWKH0:$JURXSDQGLQPHWDVWDVHV LQWKH5)$JURXSS &RPSOHWHDEODWLRQDWKRXUVZDVDFKLHYHG LQ WXPRXUV WXPRXUV LQ WKH 0:$JURXS DQG LQWKH5)$JURXSS &RQFOXVLRQ0:$SURYLGHVDVLJQLÀFDQWO\KLJKHUSULPDU\WHFKQLFDOVXFFHVVWKDQ 5)$LQOLYHUWXPRXUVVPDOOHUWKDQFPDQGSDUWLFXODUO\LQ+&&V$IWHUPXOWLSOH DEODWLRQVWHFKQLFDOHIIHFWLYHQHVVLVVLPLODUEHWZHHQ0:$DQG5)$0:$VKRXOG EHFRQVLGHUHGWKHÀUVWFKRLFHWUHDWPHQWIRUVPDOO+&&V 6FLHQWLILF6HVVLRQ $ 6&'()*+% 7KXUVGD\ (XURSHDQ&RQJUHVVRI 5DGLRORJ\ IROORZLQJVFRUHVDEVHQFHRIOHVLRQXQFHUWDLQLQWHUSUHWDWLRQDGHJHQHUDWLYH OHVLRQEFRPSOHWHIUDFWXUHDQGRUSDUDPHQLVFDOF\VWDQGRUEXFNHWKDQGOHOHVLRQ 5HVXOWV5HDGHU$VHQVLWLYLW\DQGVSHFLÀFLW\7 7 GLDJQRVWLF DFFXUDF\ UHVSHFWLYHO\ 5HDGHU % VHQVLWLYLW\ DQGVSHFLÀFLW\77GLDJQRVWLFDFFXUDF\ IRUERWKV\VWHPV &RQFOXVLRQ7KHWZR05V\VWHPVKDYHVLPLODUGLDJQRVWLFDFFXUDF\LQGHWHFWLQJ DQGFODVVLI\LQJPHQLVFDOOHVLRQVWKXVVXJJHVWLQJWKDWDOHVVH[SHQVLYHGHGLFDWHG 05FDQEHHPSOR\HGLQWKLVGLDJQRVWLFGRPDLQDYRLGLQJWKHLQFRQYHQLHQFHIRU WKHSDWLHQWWREHVFDQQHGLQDZKROHERG\V\VWHP % 6RGLXP1D05,RI$FKLOOHVWHQGRQGLVHDVHDW7HVODSUHOLPLQDU\ UHVXOWV 9-XUDV&3UHVVO6=E\Q6$SSULFK3 6]RPRODQ\L-:LPPHU6'RPD\HU 67UDWWQLJ9LHQQD$7YODGLPLUMXUDV#PHGXQLZLHQDFDW 3XUSRVH ,W KDV EHHQ UHSRUWHG WKDW WKH JO\FRVDPLQRJO\FDQ *$* FRQWHQWLQ FUHDVHVLQFKURQLF$FKLOORWHQGLQRSDWK\FRPSDUHGWRKHDOWK\$FKLOOHVWHQGRQ$7 7KHDLPRIWKLVVWXG\ZDVWRXWLOLVHVRGLXP05,DW7 HVODWRYLVXDOLVHDQGTXDQWLI\ ELRFKHPLFDOFRPSRVLWLRQFKDQJHVZLWKLQWKHWHQGRQEHWZHHQKHDOWK\WHQGRQDQG FKURQLF$FKLOORWHQGLQRSDWK\ 0HWKRGVDQG0DWHULDOV7ZHQW\KHDOWK\VXEMHFWVDQGHLJKWSDWLHQWVZLWKFKURQLF $FKLOORWHQGLQRSDWK\GLDJQRVHGRQVWDQGDUG05,DW7ZHUHLQFOXGHGLQWKHVWXG\ $OOVRGLXP05PHDVXUHPHQWVZHUHSHUIRUPHGRQD7ZKROHERG\05V\VWHP XVLQJDFLUFXODUO\SRODULVHG1DWUDQVPLWUHFHLYHNQHHFRLO'*5(VHTXHQFH RSWLPLVHGIRUVRGLXPLPDJLQJZDVXVHGZLWKWKHIROORZLQJSDUDPHWHUV7( PV 75 PVDYHUDJHV PDWUL[ [ÁLSDQJOH )29 [DQGVOLFH WKLFNQHVV PP6LJQDOWRQRLVHUDWLRVZHUHFDOFXODWHGIRUWKUHHGLIIHUHQWUHJLRQV RIVHJPHQWHG$FKLOOHVWHQGRQLQVHUWLRQPLGGOHSRUWLRQDQGWHQGRQPXVFOHMXQF WLRQ7KHGLIIHUHQFHRIVRGLXPVLJQDOWRQRLVHUDWLREHWZHHQKHDOWK\VXEMHFWVDQG SDWLHQWVZDVFDOFXODWHGXVLQJWZRVDPSOHXQHTXDOYDULDQFH77 HVW 5HVXOWV0HDQEXON615RI$7LQKHDOWK\VXEMHFWVZDVDQGLQSDWLHQWV ,QUHVSHFWLYHUHJLRQVKHDOWK\!SDWLHQWWKHIROORZLQJPHDQ615YDOXHV ZHUHREVHUYHG!LQLQVHUWLRQ!LQ PLGGOHSRUWLRQDQG!LQWHQGRQPXVFOHMXQFWLRQ6WDWLVWLFDOO\ VLJQLÀFDQWGLIIHUHQFHVRIVRGLXP615ZHUHREVHUYHGLQLQVHUWLRQS PLGGOH SRUWLRQS DQGWHQGRQPXVFOHLQWHUIDFHS &RQFOXVLRQ7KHUHVXOWVRIWKHVWXG\FOHDUO\GHPRQVWUDWHGWKHDELOLW\RIVRGLXP 05 LPDJLQJ WR GHWHFW DQG TXDQWLI\ FKDQJHV LQ FKURQLF$FKLOOHV WHQGLQRSDWK\ 7KRVHÀQGLQJVFRXOGOHDGWRQHZDSSURDFKHVFRQFHUQLQJHDUO\RQVHWGLDJQRVLV DQGLQGLYLGXDOLVHGWUHDWPHQWPRQLWRULQJ % $QNOHFDUWLODJHFRUUHODWLRQEHWZHHQ7YDOXHDQGOLJDPHQWLQMXU\ 6/HH< <RRQ6HRXO.5RGG#JPDLOFRP 3XUSRVH7 RHYDOXDWHGLIIHUHQFHVLQ7YDOXHVLQDQNOHFDUWLODJHDWPDJQHWLFUHVR QDQFH05LPDJLQJLQSDWLHQWVZLWKLQMXU\RIDQWHULRUWDORÀEXODUOLJDPHQW$7)/ FRPSDUHGZLWKKHDOWK\VXEMHFWV 0HWKRGVDQG0DWHULDOV$QNOHFDUWLODJHZDVHYDOXDWHGLQVXEMHFWVZLWKDQNOH SDLQZKRZHUHFDWHJRULVHGDVKDYLQJQRUPDO$7)/Q PHDQDJHSDUWLDO WHDU37Q PHDQDJHRUFRPSOHWHWHDU&7RI $7)/Q PHDQDJH XVLQJPXOWLHFKRVSLQHFKR7ZHLJKWHGVHTXHQFHV7URFKOHDUFDUWLODJHUHJLRQV RI WKH WDOXV ZHUH GLYLGHG LQWR VL[ FRPSDUWPHQWV DQWHURPHGLDOPHGLDO FHQWUH SRVWHURPHGLDO DQWHURODWHUDO ODWHUDO FHQWUH DQG SRVWHURODWHUDO 0HDQ YDOXH RI FRPSDUWPHQWDOUHJLRQRILQWHUHVW7PHDVXUHPHQWVZDVREWDLQHGLQWKUHHJURXSV 6WDWLVWLFDODQDO\VLVRIYDULDQFHZDVSHUIRUPHG 5HVXOWV0HDQYDOXHRIFRPSDUWPHQWDO7YDOXHVVKRZHGVLJQLÀFDQWGLIIHUHQFH EHWZHHQQRUPDO37 DQG&73 7UHOD[DWLRQWLPHEHWZHHQWKUHHOLJD PHQWJURXSVZDVVLJQLÀFDQWO\GLIIHUHQWLQWKHFRPSDUWPHQWRIDQWHURPHGLDOPHGLDO FHQWUHDQWHURODWHUDODQGODWHUDOFHQWUHFDUWLODJH3 UHVSHFWLYHO\1RVLJQLÀFDQWGLIIHUHQFHZDVIRXQGEHWZHHQQRUPDODQG $7)/LQMXU\ JURXSVLQSRVWHURPHGLDODQGSRVWHURODWHUDOFRPSDUWPHQW&7JURXSKDGKLJKHU7 YDOXHVFRPSDUHGZLWKQRUPDOLQDQWHURPHGLDOPHGLDOFHQWUHDQWHURODWHUDODQG ODWHUDOFHQWUH37JURXSKDGKLJKHU7YDOXHVFRPSDUHGZLWKQRUPDOLQDQWHURPHGLDO DQGDQWHURODWHUDOFRPSDUWPHQW &RQFOXVLRQ $7)/LQMXU\LVDVVRFLDWHGZLWKDQLQFUHDVHLQ7YDOXHRIWKHDUWLFXODU FDUWLODJHRIWKHWURFKOHDRIWKHWDOXVLQDQNOHHVSHFLDOO\LQDQWHULRUDQGSRVWHULRU FRPSDUWPHQW IROORZXS5HVXOWVZHUHDVVHVVHGDIWHUDPLQLPXPPRQWKIROORZXSIRUDWRWDO RIPDOLJQDQFLHV+&&VDQGPHWDVWDVHVVL]HUDQJHFPPHDQ LQSDWLHQWV 5HVXOWV ,PPHGLDWH FRPSOHWH DEODWLRQ ZDV DFKLHYHG LQ PDOLJQDQFLHV RI +&&V DQG PHWDVWDVHV /RFDO WXPRXU SURJUHVVLRQ RFFXUUHG LQ PDOLJQDQFLHV ZLWK VL]HV FPIRUWXPRXUVUDQJLQJFPDQGIRUWXPRXUV !FP$OOORFDOSURJUHVVLRQZDVVXFFHVVIXOO\UHWUHDWHGZLWKLQPRQWKVXVLQJ WKHVDPHPHWKRG0LQRUFRPSOLFDWLRQVRFFXUUHGLQSDWLHQWV2QO\ RQHGHOD\HGPDMRUFRPSOLFDWLRQZDVQRWHG &RQFOXVLRQ,QRXUVHULHVYDOXDEOHORFDOFRQWURORIKHSDWLFPDOLJQDQFLHVZLWKRXW VLJQLÀFDQWFRPSOLFDWLRQVZDVDFKLHYHG(YHQOHVLRQVELJJHUWKDQFPZHUHVXF FHVVIXOO\WUHDWHGZLWKIHZDQWHQQDLQVHUWLRQVDQGLQDVKRUWWLPH 5RRP( 0XVFXORVNHOHWDO 66 05,RIOLJDPHQWVWHQGRQVDQGPXVFOHV 0RGHUDWRUV 05HLMQLHUVH/HLGHQ1/ 9=XEOHU=XULFK&+ % 7KHXVHRIGLIIXVLRQZHLJKWHGDQGG\QDPLFFRQWUDVWHQKDQFHG05, IRUTXDQWLWDWLYHHYDOXDWLRQRIWKHWLELDOWXQQHODIWHUDQWHULRUFUXFLDWH OLJDPHQWUHFRQVWUXFWLRQZLWKLQWUDRSHUDWLYHO\DGPLQLVWHUHGSODWHOHW ULFKSODVPDJHO 05XSUHKW 09RJULQ0-HYVHN,6HUVD9-HYWLĀ0DULERU6, /MXEOMDQD6,PLWMDUXSUHKW#JXHVWDUQHVVL 3XUSRVH7 RTXDQWLWDWLYHO\HYDOXDWHWKHHIIHFWRISODWHOHWULFKSODVPDJHO353* ORFDOO\ DGPLQLVWHUHG GXULQJ WKH DQWHULRU FUXFLDWH OLJDPHQW $&/ UHFRQVWUXFWLRQ 7KH SUR[LPDO WLELDO WXQQHO ZDV DVVHVVHG ZLWK GLIIXVLRQZHLJKWHG LPDJLQJ ':, DQGZLWKG\QDPLFFRQWUDVWHQKDQFHGLPDJLQJ'&(, 0HWKRGVDQG0DWHULDOV,QÀIW\SDWLHQWVDUWKURVFRSLF$&/UHFRQVWUXFWLRQVZHUH SHUIRUPHG7KHSDWLHQWVLQWKH353*JURXSQ UHFHLYHGDORFDODSSOLFDWLRQRI 353*LQWRWKHERQHWXQQHOVDQGLQWRWKHJUDIWLWVHOI':,DQG'&(,ZHUHXWLOLVHGWR H[DPLQHWKHSUR[LPDOWLELDOWXQQHOZLWKVXEVHTXHQWFDOFXODWLRQRIDSSDUHQWGLIIXVLRQ FRHIÀFLHQW$'&YDOXHVDVZHOODVWKHFRQWUDVWHQKDQFHPHQWJUDGLHQW*HQK DQGHQKDQFHPHQWIDFWRU)HQKYDOXHV 5HVXOWV$WRQHPRQWKWKH$'&YDOXHLQWKH353*JURXSPPV ZDVVLJQLÀFDQWO\ORZHUWKDQLQWKHFRQWUROPPVJURXSS $WWZRDQGDKDOIDQGDWVL[PRQWKVWKHGLIIHUHQFHVLQWKH$'&YDOXHVZHUHQRW VLJQLÀFDQW$W WKH ÀUVW DQG VHFRQG FRQWURO *HQK ZDV VLJQLÀFDQWO\ KLJKHU LQ WKH 353*VDQGVWKDQLQWKHFRQWUROVDQGVJURXS S DQG$WVL[PRQWKVWKHUHZDVQRVLJQLÀFDQWGLIIHUHQFHLQ*HQK YDOXHV7KHUHZHUHQRVLJQLÀFDQWGLIIHUHQFHVLQ)HQKEHWZHHQWKHJURXSVDWDQ\ FRQWUROH[DPLQDWLRQ &RQFOXVLRQ':,DQG'&(,PHDVXUHPHQWVLQGLFDWHDUHGXFHGH[WHQWRIRHGHPD GXULQJWKHÀUVWSRVWRSHUDWLYHPRQWKDVZHOODVDQLQFUHDVHGYDVFXODUGHQVLW\DQG PLFURYHVVHOSHUPHDELOLW\LQWKHSUR[LPDOWLELDOWXQQHODWRQHDQGWZRDQGDKDOI SRVWRSHUDWLYHPRQWKVDVWKHHIIHFWRIWKHDSSOLFDWLRQRI353* % 'HGLFDWHG705YVZKROHERG\705LQWKHGLDJQRVLVRI PHQLVFDOOHVLRQVZLWKDUWKURVFRSLFFRUUHODWLRQ '&DUDPHOOD$3DROLFFKL) 5XVFKL69LWDOL,&DVWHOOLQL3 3DUFKL0/LVDQWL 3LVD,7GDYLGHFDUDPHOOD#PHGXQLSLLW 3XUSRVH7 RFRPSDUHWKHGLDJQRVWLFDFFXUDF\RIDGHGLFDWHG05V\VWHP7 DQGDKLJKÀHOGZKROHERG\05VFDQQHU7LQWKHVWXG\RIPHQLVFL 0HWKRGV DQG 0DWHULDOV 7KLUW\VHYHQ SDWLHQWV XQGHUZHQW WZR VXEVHTXHQW 05 H[DPLQDWLRQVZLWKWKHGHGLFDWHG05V\VWHPDQGWKHKLJKÀHOGWUDGLWLRQDOVFDQQHU ,QFOXVLRQFULWHULDZHUHDJHEHWZHHQDQG\HDUVFOLQLFDOVXVSLFLRQRIPHQLVFDO OHVLRQQRKLVWRU\RIVXUJHU\RQWKHDIIHFWHGNQHH6HTXHQFHVXVHGZHUHVDJLW WDO6(7)6(3'67,5LQERWKVFDQQHUV2QWKHFRURQDOSODQH;%21(ZDV XVHGDW7DQG*(7IDWVDWDW7 7KLUW\RQHSDWLHQWVZLWKSRVLWLYH05, XQGHUZHQWDUWKURVFRS\ZKLOHZLWKQHJDWLYH05,ZHUHIROORZHGXSFOLQLFDOO\7ZR H[SHUWUDGLRORJLVWVSHUIRUPHGDGRXEOHEOLQGUHDGLQJZLWKDUWKURVFRS\DVWKHJROG VWDQGDUG)RUHDFKPHQLVFXVDQWHULRUDQGSRVWHULRUKRUQVZHUHFRQVLGHUHGZLWKWKH 6FLHQWLILF6HVVLRQ 6 &$' ( ) *+% (XURSHDQ&RQJUHVVRI 5DGLRORJ\ ZLWKRXW VHGDWLRQ DW EDVHOLQH DQG DIWHU QLQH PRQWKV$[LDO DQGFRURQDO 6( 7 PXOWLHFKR767,5)6(7ZHLJKWHGZDQG'7+5,9(LPDJHVRIWKHOHJVDQG WKLJKVZHUHDFTXLUHG$IWHUWKUHVKROGVHJPHQWDWLRQRQ7ZLPDJHVWKHPXVFOH YROXPHV09ZHUHPHDVXUHGDQGQRUPDOLVHGWRWKHHQWLUHOLPEYROXPH0XVFOH VLJQDOLQWHQVLW\GHULYHGIURP7ZLPDJHVZDVQRUPDOLVHGWRQHDUE\IDWLQWHQVLW\ WRREWDLQPXVFXODUVLJQDOLQWHQVLW\UDWLRV6,5VDVPDUNHUVRIIDWW\GHJHQHUDWLRQ 09VDQG6,5VZHUHFRPSDUHGZLWKFOLQLFDOPHDVXUHVDQGWHVWVLQFOXGLQJ1RUWK 6WDU6FRUHDQG.LQ&RP6L[SDWLHQWVXQGHUZHQWIXUWKHU05,H[DPLQDWLRQVHYHU\ PRQWKVEHIRUHEHLQJWUHDWHGZLWKLQWUDDUWHULDOLQMHFWLRQRIPHVRDQJLREODVWV 5HVXOWV'0'SDWLHQWVҋ09ZDVORZHUWKDQKHDOWK\VXEMHFWV([FHSWIRUVDUWRULXV DQGJUDFLOLVSDWLHQWVҋ6,5VZHUHVLJQLÀFDQWO\KLJKHUWKDQFRQWUROVҋRQHV'XULQJ IROORZXSSDWLHQWVVKRZHGVLJQLÀFDQWWKLJK09GHFUHDVHDQGOHJ09LQFUHDVH ZKLOH6,5VZHUHVWDEOHRULQFUHDVHGRYHUWLPH6LJQLÀFDQW6SHDUPDQFRUUHODWLRQV EHWZHHQ6,5VIXQFWLRQDOPHDVXUHVDQGWKLJK09VZHUHIRXQG,QVRPHSDWLHQWV ZLWK VXVSHFWHG EDG FRPSOLDQFH 05, GLVFRQÀUPHG WKH SRRU FOLQLFDO UHVXOWV )ROORZXSDIWHUPHVRDQJLREODVWWUDQVSODQWDWLRQLVRQJRLQJ &RQFOXVLRQ05,FRXOGSURYLGHUHOLDEOHPDUNHUVRIPXVFOHGHJHQHUDWLRQZKLFK FRUUHODWHWRQHXURORJLFDOIXQFWLRQDOSHUIRUPDQFHVDQGVKRXOGEHHPSOR\HGLQFOLQLFDO WULDOVDVRXWFRPHPHDVXUHV % ,QYLYRDVVHVVPHQWRIVNHOHWDOPXVFOHLVFKDHPLDLQGLDEHWLFUDWVE\ 05DQJLRJUDSK\05LPDJLQJDQGSURWRQ05VSHFWURVFRS\ 6'HOOL3L]]L50DGRQQD$*LDPPDULQL*/5RPDQL5'H&DWHULQD $7 DUWDUR&KLHWL,7VGHOOLSL]]L#JPDLOFRP 3XUSRVH7 RHYDOXDWHWKHIHDVLELOLW\RIXVLQJ05WHFKQLTXHVIRULQYLYRLQYHVWLJDWLQJ DUDWGLDEHWLFPRGHORIKLQGOLPELVFKDHPLD 0HWKRGVDQG0DWHULDOV([SHULPHQWVZDVDSSURYHGE\RXU,QVWLWXWLRQDO(WKLFV &RPPLWWHH IRU DQLPDO UHVHDUFK 8QLODWHUDO KLQG OLPE LVFKDHPLD ZDV LQGXFHG E\ OLJDWLRQRIWKHIHPRUDODUWHU\LQPDOHVWUHSWR]RWRFLQ67=WUHDWHGEORRGJOXFRVH PJG/DQGKHDOWK\QRQGLDEHWLFFRQWUROUDWV)RXUZHHNVDIWHUOLJDWLRQUDWV XQGHUZHQW'WLPHRIÁLJKW72)05DQJLRJUDSK\05$7ZHLJKWHG7: DQGVKRUWWLPHLQYHUVLRQUHFRYHU\67,5VHTXHQFHVDQGPXVFOHSURWRQ05VSHF WURVFRS\+056RQERWKKLQGOLPEV$IWHU05H[DPLQDWLRQVLPPXQREORWWLQJ DQGLPPXQRÁXRUHVFHQFHDQDO\VLVZHUHSHUIRUPHG 5HVXOWV05$VKRZHGDVLJQDOYRLGGXHWRÁRZGLVFRQWLQXDWLRQGLVWDOWRWKHOLJD WLRQRIFRPPRQLOLDFIHPRUDODUWHU\05,VKRZHGWKHSUHVHQFHRIWLVVXHVZHOOLQJ S IRUQRQGLDEHWLFS IRUGLDEHWLFUDWVDQGVLJQDOK\SHULQWHQVLW\LQ WLVVXHDIIHFWHGE\RFFOXVLRQ+056VKRZHGDVLJQLÀFDQWUHGXFWLRQRIWRWDOFUHD WLQHZDWHULQRFFOXGHGYVQRQRFFOXGHGOLPEVS IRUQRQGLDEHWLFS IRUGLDEHWLFUDWV05,DQG+056FKDQJHVZHUHPRUHSURQRXQFHGLQGLDEHWLF WKDQLQQRQGLDEHWLFRFFOXGHGOLPEVS 05ÀQGLQJVZHUHFRQÀUPHGXVLQJ KLVWRORJLFDOÀQGLQJV &RQFOXVLRQ&RPELQHG05WHFKQLTXHVFDQEHXVHGWRGHPRQVWUDWHWKHSUHVHQFH RIVWUXFWXUDODQGPHWDEROLFFKDQJHVSURGXFHGLQDUDWGLDEHWLFPRGHORIOLPELVFKDH PLD7KLV05SURWRFROFRXSOHGZLWKDQH[SHULPHQWDOUDWPRGHORISHULSKHUDODUWHU\ RFFOXVLRQPD\EHXVHIXOIRUHYDOXDWLQJLQYLYRWKHHIÀFDF\RIQRYHOSKDUPDFRORJLFDO DVZHOODVJHQHDQGFHOOEDVHGWKHUDSLHV % 4XDQWLWDWLYHDVVHVVPHQWRIIDWLQÀOWUDWLRQLQWKHURWDWRUFXIIPXVFOHV XVLQJ05, /1DUGR-&DUEDOOLGR*DPLR'.DUDPSLQRV+$OL]DL%&0D7 0/LQN 5.UXJ6DQ)UDQFLVFR&$86 3XUSRVH7 RYDOLGDWHWKHHVWDEOLVKHGTXDOLWDWLYH*RXWDOOLHUҋVFODVVLÀFDWLRQ*& RIIDWW\LQÀOWUDWLRQ),ZLWKLQWKHURWDWRUFXII5&PXVFOHVXVLQJDQRYHOFKHPLFDO VKLIWEDVHG05,WHFKQLTXH,'($/DQGWRHVWDEOLVKWKHUHSURGXFLELOLW\RI,'($/ LQWKHDVVHVVPHQWRI), 0HWKRGVDQG0DWHULDOVSDWLHQWVZLWK5&WHDUV\PSWRPVPDOHVIHPDOHV DJHG\HDUVZDVXVHGDQGRIWKHVHSDWLHQWVZHUHVFDQQHGWZLFH6KRXOGHU 05H[DPLQDWLRQVZHUHSHUIRUPHGDW7 HVODZLWKDQFKDQQHOVKRXOGHUVXUIDFH FRLO XVLQJ VDJLWWDO SODQ 3')6( DQG ,'($/ )29 67 PP IRUERWK )DW IUDFWLRQPDSVZHUHUHFRQVWUXFWHGRQOLQHZLWK7 FRUUHFWLRQDQGDPXOWLSHDNIDW VSHFWUXP),IRUHDFKRIWKHURWDWRUFXIIPXVFOHZDVVFRUHGLQWKHSURWRQGHQVLW\ ZHLJKWHGLPDJHVXVLQJ*&6SHDUPDQҋVFRUUHODWLRQFRHIÀFLHQWFRPSDUHG,'($/ IDWIUDFWLRQYDOXHVZLWK*&IRUHDFK5&PXVFOHUHSURGXFLELOLW\RI,'($/WHFKQLTXH ZDVGHWHUPLQHGXVLQJDEVROXWHSUHFLVLRQHUURULQWKHGRXEOHGVFDQQHGSDWLHQWV 5HVXOWV6SHDUPDQҋVFRHIÀFLHQWEHWZHHQ,'($/DQG*&ZDVS 8VLQJ,'($/PHDVXUHPHQWVWKHDPRXQWRI),UDQJHGIRU*RXWDOOLHUJUDGHIURP WRIRUJUDGHIURPWRIRUJUDGHIURPWRIURPJUDGH % 5KDEGRP\RO\VLVUHYLVLWHGPDJQHWLFUHVRQDQFH05LPDJLQJ ÀQGLQJLQGHWDLO 6&KR < .LP6&KR.+/HH%.LP5.LP6&KRL6.RK 0./LP,QFKHRQ.5$Q\DQJ.5MRVXQJHKQ#QDYHUFRP 3XUSRVH7 RUHWURVSHFWLYHO\HYDOXDWHPDJQHWLFUHVRQDQFH05LPDJLQJÀQGLQJ RIUKDEGRP\RO\VLVLQGHWDLO 0HWKRGVDQG0DWHULDOV(LJKWHHQSDWLHQWVPDOHVDQGZRPHQDJHUDQJH \HDUVPHDQDJH\HDUVZHUHLQFOXGHGLQWKLVVWXG\6LJQDOLQWHQVLW\ RQ7DQG7ZHLJKWHGLPDJHVSUHVHQFHRILQWUDPXVFXODUKDHPRUUKDJHSUHV HQFH RI VWLSSOH VLJQ SUHVHQFH RI QRQHQKDQFLQJ SRUWLRQ LQ PXVFOH LQFUHDVHG YROXPHRIPXVFOHDEQRUPDOVLJQDOLQWHQVLW\LQVXEFXWDQHRXVIDWOD\HUDQGGHHS IDVFLDDUHHYDOXDWHG 5HVXOWV2Q7ZHLJKWHGLPDJHSDWLHQWVVKRZHGKRPRJHQHRXV LVRVLJQDOLQWHQVLW\DQGSDWLHQWVVKRZHGKHWHURJHQHRXVPL[HG KLJKDQGLVRVLJQDOLQWHQVLW\2Q7ZHLJKWHGLPDJHSDWLHQWVVKRZHG KHWHURJHQHRXVVLJQDOLQWHQVLW\FRPELQHGKLJKDQGORZVLJQDOLQWHQVLW\7 HQSDWLHQWV KDG 7 KLJK RU 7 GDUN VLJQDO LQWHQVLW\ LQ PXVFOH UHSUHVHQWLQJ KDHPRUUKDJH7ZHOYHSDWLHQWVKDGVWLSSOHGVLJQ6HYHQSDWLHQWV KDGIRFDORUGLIIXVHQRQHQKDQFLQJSRUWLRQLQLQYROYHGPXVFOH)LIWHHQ SDWLHQWVVKRZHGLQFUHDVHGYROXPHRIPXVFOH1LQHSDWLHQWV KDG7KLJKVLJQDOLQWHQVLW\RHGHPDLQVXEFXWDQHRXVIDWOD\HU7KLJKVLJQDO LQWHQVLW\LQIDFLDOSODQHLVVHHQSDWLHQWV &RQFOXVLRQ ,QFUHDVHG YROXPH RI PXVFOH LV PRVW FRPPRQ LPDJLQJ ÀQGLQJ LQ UKDEGRP\RO\VLVRQ05,2WKHUFRPPRQLPDJLQJÀQGLQJVZHUHVWLSSOHGVLJQ7 KLJK VLJQDO LQWHQVLW\ LQ IDFLDO SODQH LQWUDPXVFXODU KDHPRUUKDJH7 KLJK VLJQDO LQWHQVLW\RHGHPDLQVXEFXWDQHRXVIDWOD\HUDQGIRFDORUGLIIXVHQRQHQKDQFLQJ SRUWLRQLQLQYROYHGPXVFOH % 0DJQHWLFUHVRQDQFHTXDQWLWDWLYHPRQLWRULQJRIPXVFOHKHDOLQJ WKURXJKGLIIXVLRQWHQVRULPDJLQJ'7,DQG7PDSSLQJDVVHVVPHQW $(VSRVLWR) 'H&REHOOL$3DOPLVDQR7 &DQX/&DPSDQD *3H]]HWWL$0DQIUHGL3 5RYHUH4XHULQL$'HO0DVFKLR0LODQ,7 HVSRVLWRDQWRQLR#KVULW 3XUSRVH 7 R SURVSHFWLYHO\ HYDOXDWH D PXOWLSDUDPHWULF 05, SURWRFRO DV DQRQ LQYDVLYH DQG TXDQWLWDWLYH WRRO IRU PRQLWRULQJ PXVFOH GDPDJHKHDOLQJ SURFHVV REWDLQLQJG\QDPLFLQIRUPDWLRQDERXWLQÁDPPDWRU\LQÀOWUDWHDQGÀEUHVUHJHQHUDWLRQ 0HWKRGVDQG0DWHULDOV$FXWHPXVFOHLQMXU\ZDVREWDLQHGE\FDUGLRWR[LQ&7; LQMHFWLRQLQWRWLELDOLVDQWHULRU7$RI&%/PLFH$Q05,VWXG\LQFOXGLQJ7 PDSSLQJ GLIIXVLRQZHLJKWHG LPDJLQJ DQG GLIIXVLRQWHQVRU LPDJLQJ '7, ZDV SHUIRUPHGEHIRUHDQGDQGGD\VDIWHULQMXU\$WHDFKWLPHSRLQW DQLPDOVXQGHUZHQW05,DQGZHUHVDFULÀFHGLPPHGLDWHO\DIWHULPDJLQJWRREWDLQ WLVVXHҋVVDPSOHVIRUKLVWRORJLFDODQDO\VLV 5HVXOWV7UHOD[DWLRQWLPH7UWVLJQLÀFDQWO\LQFUHDVHGDIWHULQMXU\UHDFKLQJWKH WRS DW GD\V VXEVHTXHQWO\ 7UW SURJUHVVLYHO\ GHFUHDVH IURP UG WR WK GD\ UHFRYHULQJ D FRPSOHWH QRUPDOLVDWLRQ$ JHQHUDO LQFUHDVH RI PXVFOH GLIIXVLYLW\ DVVRFLDWHGZLWKDQLPSRUWDQWORVVRIIUDFWLRQDODQLVRWURS\)$ZDVREVHUYHG KRXUVDIWHULQMXU\ $IWHUZDUG)$SURJUHVVLYHO\LQFUHDVHGIURPGD\WRGD\XSWR YDOXHVDERYHWKHQRUPDOOHYHO)URPGD\IRUZDUG)$VKRZHGDYHU\VORZSURJUHV VLYHGHFUHDVHWRZDUGVEDVDOOHYHO3HDUVRQWHVWUHYHDOHGJRRGFRUUHODWLRQVRI7UW ZLWKKLVWRORJLFDOGDPDJHVFRUHU SDQGHVSHFLDOO\ZLWKQXPEHURI LQÀOWUDWLQJOHXFRF\WHVU S)$FRUUHODWHGZLWKWKHKLVWRORJLFDOFRXQW RIFHQWUHQXFOHDWHGUHJHQHUDWLQJÀEUHVU S &RQFOXVLRQ 05, ZLWK 7PDSSLQJ DQG '7, FRXOG EH FRQVLGHUHG DQ HIIHFWLYH QRQLQYDVLYHWRROWRREWDLQSDQRUDPLFPRQLWRULQJRIPXVFOHGDPDJHDQGUHSDLU LQJSURFHVVZLWKTXDQWLWDWLYHUHDGRXWDERXWOHXFRF\WHVLQÀOWUDWLRQDQGWKHÀEUHV UHJHQHUDWLRQ % 4XDQWLWDWLYHPDJQHWLFUHVRQDQFHLPDJLQJRIWKHORZHUOLPEPXVFOHV LQ'XFKHQQHPXVFXODUG\VWURSK\DQHZDSSURDFKIRUPRQLWRULQJ WKHGLVHDVHSURJUHVVLRQDQGUHVSRQVHWRWKHUDS\ &*RGL6*HUHYLQL61DSROLWDQR) &LFHUL*&RVVX< 7 RUUHQWH*6FRWWL /63ROLWL0LODQ,7FODXGLDJRGL#FROOHJLRGLPLODQRLW 3XUSRVH7 RGHWHUPLQHWKURXJKPDJQHWLFUHVRQDQFHLPDJLQJ05,WKHSDWWHUQ RIORZHUOLPELQYROYHPHQWLQ'XFKHQQHPXVFXODUG\VWURSK\'0'WRFRPSDUH TXDQWLWDWLYH05,SDUDPHWHUVZLWKIXQFWLRQDOPHDVXUHVLQ'0'SDWLHQWV 0HWKRGV DQG 0DWHULDOV 7ZHQW\VL[ WR \HDUROG '0' SDWLHQWV DQG PDWFKHG KHDOWK\ FRQWUROV XQGHUZHQW 7 05, H[DPLQDWLRQV RI WKHORZHU OLPEV 6FLHQWLILF6HVVLRQ $ 6&'()*+% 7KXUVGD\ (XURSHDQ&RQJUHVVRI 5DGLRORJ\ VLJPRLGRFHOHDQGHQWHURFHOHZDVUHVSHFWLYHO\DQGVKRZLQJDQ LQIHULRUGLDJQRVWLFFDSDFLW\LIFRPSDUHGZLWKWKDWRI(&&' &RQFOXVLRQ05'VKRZVORZHUVHQVLWLYLW\WKDQ(&&'LQWKHGHWHFWLRQRI03+ GHYHORSPHQW7KHOHVVLQYDVLYH05'PD\KDYHDUROHLQDEHWWHUHYDOXDWLRQRI WKHHQWLUHSHOYLFDQDWRP\DQGSHOYLFRUJDQLQWHUDFWLRQHVSHFLDOO\LQSDWLHQWVZLWK PXOWLFRPSDUWPHQWDOGHIHFWVSODQQHGIRUVXUJHU\ % ,PSURYLQJDQRUHFWDODQJOHPHDVXUHPHQWUHSURGXFLELOLW\E\DVHPL DXWRPDWHGPHWKRG 0$$ONXEH\\HU %-(ULFNVRQ-*)OHWFKHU5L\DGK6$5RFKHVWHU0186 GUPHWDE#JPDLOFRP 3XUSRVH 0XFK KDV EHHQ ZULWWHQ DERXW SRRU UHSURGXFLELOLW\ RI DQRUHFWDODQJOH $5$PHDVXUHPHQWLQGHIHFRJUDSK\$5$LVRIWHQGHWHUPLQHGE\HVWLPDWLQJD VWUDLJKWOLQHDORQJWKHSRVWHULRUERUGHURIWKHUHFWXPDQGWKHDQDOFDQDO$VHPL DXWRPDWHGPHWKRGIRU $5$PHDVXUHPHQWLVLQWURGXFHGWRHQKDQFHUHSURGXFLELOLW\ 0HWKRGVDQG0DWHULDOVFRQVHFXWLYHFDVHVRIPDJQHWLFUHVRQDQFHGHIHFRJ UDSK\ZLWKYDULDEOHHYDFXDWRU\GLVRUGHUVZHUHUHFUXLWHG$IWHUDGGLQJP/RI XOWUDVRXQGJHOWRWKHUHFWXPPLGVDJLWWDOLPDJHVRIWKHSHOYLVDWUHVWVTXHH]H DQGVWUDLQZHUHREWDLQHGXVLQJ7ZHLJKWHGVWHDG\VWDWHIUHHSUHFHVVLRQ66)3 VHTXHQFH7ZRUHDGHUV0.IHOORZVKLSWUDLQHGUDGLRORJLVWDQG=.0'3K'VWX GHQWKDYHPHDVXUHG$5$PDQXDOO\DQGVHPLDXWRPDWLFDOO\LQWZRVHVVLRQZLWK RQHZHHNLQWHUYDO0DQXDOPHDVXUHPHQWKDVEHHQGRQHE\SORWWLQJDOLQHWKURXJK WKHDQDOD[LVDQGWKURXJKWKHSRVWHULRUDVSHFWRIWKHORZHUUHFWXP6HPLDXWRPDWLF PHDVXUHPHQWKDVEHHQGRQHE\FOLFNLQJDORQJWKHSUR[LPDODQGWKHGLVWDOHQGRI WKHDQDOFDQDODQGWKHSURJUDPZLOODXWRPDWLFDOO\HVWLPDWHWKH$5$E\WKUHVKROGLQJ WKHORZHUUHFWXPWKHQDSSO\LQJDFRQYROXWLRQÀOWHUIROORZHGE\RYDOÀWWLQJWRWKH ODUJHVWÀOWHUHGSRVWHULRUVHJPHQWRIWKHUHFWXP 5HVXOWV%ODQG$OWPDQDQDO\VLVVKRZHGKLJKUHSURGXFLELOLW\RI $5$PHDVXUHPHQWV XVLQJWKHVHPLDXWRPDWHGPHWKRGFRPSDUHGWRPDQXDOPHWKRGZLWKELDVVWDQGDUG GHYLDWLRQOLPLWVRIDJUHHPHQWRI>@DQG >@UHVSHFWLYHO\ &RQFOXVLRQ $VHPLDXWRPDWHGPHWKRGFDQGHFUHDVHWKHLQWHUREVHUYHUYDULDELOLW\ RI$5$PHDVXUHPHQWIRUZKLFKIXWXUHGHIHFRJUDSK\FRPSDUDWLYHVWXGLHVEHFRPH PRUHIHDVLEOHDQGUHSURGXFLEOH % 6FDWWHUHGUDGLDWLRQGRVHVWRRSHUDWRUVSHUIRUPLQJÁXRURVFRSLF VWXGLHVRQEDULDWULFSDWLHQWV 0$$UVKDG$6HUJRW'%OXQW/0RUULV/RQGRQ8. PXEDULN#GRFWRUVRUJXN 3XUSRVH)OXRURVFRS\LVIUHTXHQWO\XVHGIRUDVVHVVLQJSRVWRSHUDWLYHFRPSOLFD WLRQVDQGVXUYHLOODQFHDIWHUEDULDWULFVXUJHU\,QWKLVVWXG\WKHDPRXQWRIVFDWWHUHG UDGLDWLRQHQFRXQWHUHGZDVPHDVXUHG 0HWKRGVDQG0DWHULDOV $SURVSHFWLYHVWXG\LQYROYLQJSRVWRSHUDWLYHEDULDWULF VXUJHU\ SDWLHQWV DQG FRQWUROV ZDV XQGHUWDNHQ 7KH VFDWWHUHGUDGLDWLRQ ZDV PHDVXUHG ZKLOVW SHUIRUPLQJ XSSHU JDVWURLQWHVWLQDO ÁXRURVFRSLF VWXGLHV XVLQJ D EDGJHGRVLPHWHUZRUQRYHUWKHSURWHFWLYHOHDGVKLHOGLQJ7KHERG\PDVVLQGH[ %0,VFUHHQLQJWLPHDQGGRVHDUHDSURGXFW'$3ZHUHDOVRPHDVXUHG 5HVXOWV ,Q WKH EDULDWULF JURXS WKH PHDQ %0, ZDV &, FRQWUROJURXSRIS)RUWKHEDULDWULFJURXSWKHDYHUDJH VFUHHQLQJWLPHZDVDQGIRUWKHFRQWUROS 7KH'$3PHDVXUHG *\FPLQWKHEDULDWULFJURXSFRQWUROJURXSS 7KHDYHUDJHGHHSGRVHVFDWWHUUHDGLQJIRUHDFKEDULDWULFSDWLHQWZDVP6Y FRPSDUHGZLWKIRUHDFKFRQWURODQGWKHDYHUDJHVXUIDFHUHDGLQJGRVHIRUD EDULDWULFSDWLHQWZDVFRPSDUHGZLWKIRUQRQEDULDWULFSDWLHQWV &RQFOXVLRQ7KHVFUHHQLQJWLPHVZHUHVLPLODUGXHWRDFRPELQDWLRQ RIFDUHIXO FROOLPDWLRQDQGXVLQJODVWLPDJHKROGLQWKHEDULDWULFJURXS7KHUHZDVKRZHYHU DWRWLPHLQFUHDVHLQWKHDPRXQWRIVFDWWHUHGUDGLDWLRQZKLOVWVFUHHQLQJEDUL DWULFSDWLHQWV7KLVVWXG\KLJKOLJKWVWKHLQFUHDVHGUDGLDWLRQH[SRVXUHWRRSHUDWRUV SURYLGLQJEDULDWULFÁXRURVFRSLFVHUYLFHV7KHLPSOLFDWLRQVRIWKLVDUHGLVFXVVHG ZLWKUHIHUHQFHWRWKHLQFUHDVLQJYROXPHRIEDULDWULFVXUJLFDOSURFHGXUHVDQGWKHLU LPSDFWRQUDGLRORJ\GHSDUWPHQWV IURPWRDQGIRUJUDGHIURPWR7KHSUHFLVLRQHUURURIWKH ,'($/IDWIUDFWLRQYDOXHUDQJHGIURPWRIRUHDFK5&PXVFOH &RQFOXVLRQ5&TXDOLWDWLYHFOLQLFDOJUDGLQJRI),XVLQJWKH*&DQGTXDQWLWDWLYH IDWIUDFWLRQYDOXHVGHULYHGXVLQJ,'($/ZHUHVWURQJO\DVVRFLDWHG,'($/SHUPLWWHG DTXDQWLWDWLYHDQGZHOOUHSURGXFLEOHPHDVXUHPHQWRI), % /HVLRQVRIWKHELFHSVSXOOH\GLDJQRVWLFDFFXUDF\RI05 DUWKURJUDSK\RIWKHVKRXOGHUDQGHYDOXDWLRQRIQHZDQGHVWDEOLVKHG GLDJQRVWLFFULWHULD &6FKDHIIHOHU6:DOGW.+RO]DSIHO&.LUFKKRII3 -XQJPDQQ3 :ROI (-5XPPHQ\$%,PKRII.:RHUWOHU0XQLFK'(VFKDHIIHOHU#PHFRP 3XUSRVH7 RUHWURVSHFWLYHO\GHWHUPLQHWKHGLDJQRVWLFDFFXUDF\RIPDJQHWLFUHVR QDQFHDUWKURJUDSK\05$RIWKHVKRXOGHULQWKHHYDOXDWLRQRIOHVLRQVRIWKHELFHSV SXOOH\DQGWRHYDOXDWHHVWDEOLVKHGDQGQHZGLDJQRVWLFFULWHULD 0HWKRGVDQG0DWHULDOV05DUWKURJUDPVRIFRQVHFXWLYHSDWLHQWVPHDQDJH \HDUVPDOHIHPDOHZLWKDUWKURVFRSLFDOO\SURYHQHLWKHULQWDFWRUWRUQ SXOOH\V\VWHPVZHUHDVVHVVHGE\WKUHHUDGLRORJLVWV(YDOXDWHGGLDJQRVWLFFULWHULD ZHUHGLVSODFHPHQWRIWKHORQJKHDGRIWKHELFHSVWHQGRQ/+%7UHODWLYHWRWKH VXEVFDSXODULVPXVFOHWHQGRQRQSDUDVDJLWWDOLPDJHVGLVSODFHPHQWVLJQPHGLDO VXEOX[DWLRQRIWKH/+%7RQWUDQVYHUVHLPDJHVGLVFRQWLQXLW\RULQYLVLELOLW\RIWKH VXSHULRUJOHQRKXPHUDOOLJDPHQW6*+/SUHVHQFHRIWHQGLQRSDWK\RIWKH/+%7RQ WUDQVYHUVHRUSDUDVDJLWWDOLPDJHVURWDWRUFXIIWHDUVDGMDFHQWWRWKHURWDWRULQWHUYDO ,QWHUUDWHUDQGLQWUDREVHUYHUYDULDELOLW\ZDVFDOFXODWHG 5HVXOWV 2Q DUWKURVFRS\ SXOOH\ OHVLRQV ZHUH GLDJQRVHG 05$ VKRZHG D VHQVLWLYLW\ RI UHDGHU UHDGHU UHDGHU DQG D VSHFLÀ FLW\ RI ,QWHUREVHUYHU DJUHHPHQW ZDV VXEVWDQWLDO ѣ $VVHVVPHQW RI WKH 6*+/ VKRZHG D VHQVLWLYLW\ RI DQG D VSHFLÀFLW\ RI :LWK WKH GLVSODFHPHQW VLJQ VHQVLWLYLW\ ZDV VSHFLILFLW\ ZDV 7 HQGLQRSDWK\ RI WKH /+%7 RQ SDUDVDJLWWDO LPDJHV VKRZHG D VHQVLWLYLW\ RI VSHFLÀFLW\ ZDV 6XEOX[DWLRQ RI WKH /+%7 ZDV LQVHQVLWLYH EXWVSHFLÀF &RQFOXVLRQ05$LVDFFXUDWHLQWKHHYDOXDWLRQRIWKHELFHSVSXOOH\7KHGLVSODFH PHQWVLJQLQYLVLELOLW\RUGLVFRQWLQXLW\RIWKH6*+/DQGVLJQVRIWHQGLQRSDWK\RI WKH/+%7RQSDUDVDJLWWDOLPDJHVDUHWKHPRVWDFFXUDWHFULWHULDLQWKHGHWHFWLRQ RISXOOH\OHVLRQV 5RRP( *,7UDFW 66D *,WUDFWVWUXFWXUHDQGIXQFWLRQ 0RGHUDWRUV 6-DFNVRQ3O\PRXWK8. %/XFH\*DOZD\,( % '\QDPLF05,GHIHFRJUDSK\YVHQWHURFROSRF\VWRGHIHFRJUDSK\LQ WKHHYDOXDWLRQRIPLGOLQHSHOYLFÁRRUKHUQLDVLQIHPDOHSHOYLFÁRRU GLVRUGHUV *'L*UH]LD**DWWD5/LHWR) ,DFREHOOLV/8UFLXROL93DUODWR5*UDVVL $5RWRQGR1DSOHV,7JUD]LHOODGLJUH]LD#\DKRRLW 3XUSRVH7KHDLPRIWKLVVWXG\ZDVWRFRPSDUHWKHGLDJQRVWLFHIÀFDF\RIG\QDPLF 05 GHIHFRJUDSK\ 05' ZLWK HQWHURFROSRF\VWRGHIHFRJUDSK\ (&&' LQ WKH DVVHVVPHQWRIPLGOLQHSHOYLFÁRRUKHUQLDV03+LQIHPDOHSHOYLFÁRRUGLVRUGHUV 0HWKRGVDQG0DWHULDOV)URP $XJXVWWR $XJXVWIHPDOHSDWLHQWV ZKRUHTXLUHG(&&'IRUWKHHYDOXDWLRQRISHOYLFÁRRUGLVRUGHUVZHUHHQUROOHGLQWKLV VWXG\$OOWKHSDWLHQWVZLWK(&&'ÀQGLQJVRI03+ZHUHDVNHGWRXQGHUJR 05'DFFHSWHGWRXQGHUJR05'DQGFRQVWLWXWHGWKHREMHFWRIDQDO\VLV 7KLVVWXG\ZDVDSSURYHGE\WKH,QVWLWXWLRQDO(WKLFDO&RPPLWWHH$OOWKHSDWLHQWV JDYHWKHLUZULWWHQLQIRUPHGFRQVHQWWRWDNHSDUWLQWKHVWXG\ 5HVXOWV 2YHUDOO WKH SUHYDOHQFH RI 03+ DW (&&' ZDV KLJKHU LI FRPSDUHG ZLWKWKDWDW05'&RQFHUQLQJWKHKHUQLDFRQWHQWWKHUHZHUHVLJQLÀFDQWO\PRUH HQWHURFHOHVDQGVLJPRLGRFHOHVRQ(&&'WKDQRQ05'ZKHUHDVLQUHODWLRQWR WKHKHUQLDGHYHORSPHQWPRGDOLWLHVWKHSUHYDOHQFHRIHO\WURFHOHVHGURFHOHVDQG 'RXJODVҋ KHUQLDV DW (&&' ZDV VLJQLÀFDQWO\ KLJKHU WKDQ WKDW DW 05' ,Q VSLWH RIDVSHFLÀFLW\WKHVHQVLELOLW\RI05'LQWKHGHWHFWLRQRIDQRPHQWRFHOH 6FLHQWLILF6HVVLRQ 6 &$' ( ) *+% (XURSHDQ&RQJUHVVRI 5DGLRORJ\ WKLFNQHVVDQGDSSDUHQWGLIIXVLRQFRHIÀFLHQW$'&RIFDQFHUDQGQRUPDOVWRPDFK ZDOOZHUHFRPSDUHG 5HVXOWV $OORIWKHJDVWULFFDQFHUVGLVSOD\HGK\SHULQWHQVLW\FRPSDUHGWRWKHQHDUE\ QRUPDOJDVWULFZDOORQ':,$WKUHHOD\HUVDQGZLFKVLJQWKDWGHPRQVWUDWHGKLJK VLJQDOVLQWKHLQQHUDQGRXWHUOD\HUDQGORZVLJQDOLQWKHLQWHUPHGLDWHOD\HUZDV REVHUYHGLQRIFDQFHUVRQ':,7KHORZVLJQDOUHSUHVHQWVWKHPXVFXODULV SURSULD WKURXJK WKH FRPSDULVRQ ZLWK SDWKRORJ\ DQG LW LV SRVWXODWHG VFDWWHULQJ GLVWULEXWLRQRIWKHFDQFHUFHOOVLQWKLVOD\HUFDXVHVOHVVGDPDJHDQGVXEVHTXHQWO\ OHVVUHVWULFWLRQRIZDWHUPRYHPHQWZKLFKFDXVHVWKHORZVLJQDORQ':,7KHPHDQ $'&YDOXHRI%7JDVWULFFDQFHUZDVVLJQLÀFDQWO\ORZHUWKDQWKHSRRUO\GLVWHQGHG QRUPDOVWRPDFKZDOOðPPVYV[PPV3 &RQFOXVLRQ ':, FDQ KLJKOLJKW WKH VLJQDOV RI %7 JDVWULF FDQFHU ZKLFK PD\ SUHVHQWDFKDUDFWHULVWLFWKUHHOD\HUVDQGZLFKVLJQDQG$'&YDOXHVDUHKHOSIXOLQ WKHGLVFULPLQDWLRQRIJDVWULFFDQFHUIURPSRRUO\GLVWHQGHGVWRPDFKZDOO % $FXWHPHVHQWHULFLVFKDHPLDGRGLIIHUHQWÀQGLQJVVXJJHVWGLIIHUHQW DHWLRORJ\"705,RQDUDWPRGHO '%HUULWWR) 6RPPD) ,DFREHOOLV0%HOÀRUH6&DSSDELDQFD$5RWRQGR 5*UDVVL1DSOHV,7GDQLHODEHUULWWR#OLEHURLW 3XUSRVH 7KH VLJQV RI DFXWH PHVHQWHULF LVFKDHPLD $0, YDU\ GHSHQGLQJ RQ WKH FDXVH DQG XQGHUO\LQJ SDWKRSK\VLRORJ\ 0DJQHWLF UHVRQDQFH 05 ÀQGLQJV LQWHVWLQDOPRUSKRG\QDPLVPDQGKLVWRORJLFDOSDWWHUQRI$0,GXHWRYDULRXVSULPDU\ FDXVHVDUHGLVFXVVHG 0HWKRGV DQG 0DWHULDOV 7ZHOYH 6SUDJXH'DZOH\ UDWV ZHUH GLYLGHG LQWR WKUHH JURXSVQ 7ZRUDWVRIHDFKJURXSXQGHUZHQWVXSHULRUPHVHQWHULFDUWHU\60$ JURXSVDQGRUYHLQ609JURXSOLJDWLRQ([WHUQDOLVHGERZHOXQGHUZHQW PDFURVFRSLFPRQLWRULQJ7KHUHPDLQLQJWZRUDWVRIHDFKJURXSKDGDQRQRFFOXGLQJ ORRSWLHGDURXQG609RU60$DQGWKUHHGD\VDIWHUVXUJHU\YHVVHOVZHUHRFFOXGHG E\ VTXHH]LQJ WKH WLSV WXQQHOOHG WR WKH SRVWHULRU FHUYLFDO DUHD 6HYHQ7 HVOD 05 %UXNHU%LRVSHF86 VFDQV ZHUH SHUIRUPHG$OO UDWV RI JURX S V D Q G ZHUHPRQLWRUHGXQWLOKRXULQJURXSWKHOLJDWLRQZDVORRVHQDIWHUKRXUDQG UHSHUIXVLRQZDVREVHUYHGXQWLOKRXUV7KHERZHOZDVUHPRYHGIRUKLVWRORJLFDO DQDO\VLVDWWKHHQGRIREVHUYDWLRQ 5HVXOWV,QDOOW\SHRI $0,WKHPHVHQWHU\LVWKHÀUVWWRUHDFW,QWKHDUWHULDOLVFKDH PLD LWDSSHDUVWKHFRQWUDFWLRQ RIERZHO ZDOO IROORZHG E\K\SRWRQ\ DQG DERZHO ZDOO WKLQQLQJ LV GLVWLQFWLYH ,Q FDVH RI 609 OLJDWLRQ WKH VSDVP LV DEVHQW GXH WR ERZHOZDOOFRQJHVWLRQEXWWKLFNHQLQJDQGHDUO\FKURPDWLFFKDQJHRIWKHLQWHVWLQDO ZDOOPHVHQWHULFXOFHUVDQGWKXPESULQWLQJDUHW\SLFDO,QFDVHRIUHSHUIXVLRQWKH DSSHDUDQFHVWHHUWKHFRXUVHRI609OLJDWLRQ &RQFOXVLRQ7KLVDQLPDOPRGHOGHWHFWHGPRUSKRIXQFWLRQDODOWHUDWLRQVRILVFKDHPLF ERZHODQGLGHQWLI\WKHVSHFLÀFSDWWHUQRIOHVLRQVRI$0, % (DUO\05,ÀQGLQJVRIVPDOOERZHOREVWUXFWLRQDQH[SHULPHQWDOVWXG\ ) ,DFREHOOLV'%HUULWWR) 6RPPD03 %HOÀRUH6&DSSDELDQFD$5RWRQGR 5*UDVVL1DSOHV,7IUDQFHVFDLDFREHOOLV#OLEHURLW 3XUSRVH7KHDLPRIWKLVVWXG\LVWRGRFXPHQWWKHHDUO\7PLFUR05,ÀQGLQJV RIVPDOOERZHOREVWUXFWLRQDQGWKHLUHYROXWLRQLQWKHWLPHFRUUHODWLQJWKHPWRWKH DQDWRPRSDWKRORJLFDOIHDWXUHV 0HWKRGV DQG 0DWHULDOV$GXOW 6SUDJXH 'DZOH\ UDWV Q ZHUH GLYLGHG LQWR JURXSVLQWKHÀUVWQ UDWVXQGHUZHQWDVXUJLFDOSURFHGXUHRIVPDOOERZHOOLJD WLRQIROORZHGE\KUVPDFURVFRSLFDOPRQLWRULQJLQWKHODWWHUQ 7PLFUR05 VFDQQLQJVZHUHSHUIRUPHGEHIRUHDQGDIWHUOLJDWLRQ,QERWKFDVHVLQMXUHGERZHO ZDVSURFHVVHGIRUKLVWRORJLFDODQDO\VLV 5HVXOWV3DWKRORJLFDOÀQGLQJVJRWHYLGHQWDOUHDG\PLQDIWHUVPDOOERZHOOLJD WLRQ ZKHQ D VSDVWLF UHÁH[ LOHXV DQG D FKURPDWLF FKDQJH RI WKHLQMXUHG ERZHO ZHUH IRXQG 7 PLFUR05 LPDJLQJ JDYH HDUO\ HYLGHQFH PLQ RI ERZHO ZDOO K\SHULQWHQVLW\DQGPXUDOWKLFNQHVVDVVRFLDWHGZLWKOLWWOHDPRXQWRISHULWRQHDOIUHH ÁXLG7KHVHÀQGLQJVJRWZRUVHQDQGZRUVHQWLOOWKHHQGRIWKHPRQLWRULQJSHULRG ZKHQDQLQFUHDVHRIK\SHULQWHQVLW\ERZHOZDOOWKLFNQHVVLQLWLDOORRSFDOLEUHGLOD WLRQ DQG SHULWRQHDO IUHHÁXLG ZHUH IRXQG7KHVH ÀQGLQJV ZHUH FRQÀUPHG DWWKH DQDWRPRSDWKRORJLFDOH[DPLQDWLRQ &RQFOXVLRQ7KLVVWXG\DOORZVWRGHÀQHWKHHDUO\05,IHDWXUHVRIERZHORFFOXVLRQ DQGWKHLUFKURQRORJLFDOHYROXWLRQDOVRFRQÀUPHGE\DQDWRPRSDWKRORJLFDOH[DP 2XUGDWDVXJJHVWDUHOHYDQWUROHRI05LPDJLQJLQWKHHDUO\GLDJQRVWLFDVVHVV PHQWDQGPDQDJHPHQWRISDWLHQWVZLWKVPDOOERZHOREVWUXFWLRQ7KHFKDQFHWR DFKLHYHDQHDUO\GHWHFWLRQRIERZHOLQMXU\DQGWRFRUUHODWHWKHKLVWRORJLFDOSDWWHUQ ZLWKLPDJLQJÀQGLQJVFRXOGDGGUHVVWRZDUGVDÀQHUDQGHDUOLHUGLDJQRVLVDQGD PRUHHIIHFWLYHWUHDWPHQW % 0XOWLSOHVZDOORZLQJGLVRUGHUVRIRURRHVRSKDJHDOWUDFWDQGJDVWUR RHVRSKDJHDOMXQFWLRQUROHRI05ÁXRURVFRS\ZLWKKLJKVSHHG NLQHWLFVHTXHQFHV ,6DQVRQL&/3LFFROR) 3LWRFFR5/$OORQL5'HO9HVFRYR5&RSSROD %%HRPRQWH=REHO5RPH,7 3XUSRVH7 RGHÀQHXSSHUDQGORZHUVZDOORZLQJGLVRUGHUVWHVWLQJWKHIHDVLELOLW\RI KLJKVSHHGNLQHWLF05VHTXHQFHV 0HWKRGVDQG0DWHULDOVSDWLHQWVPDOHDQGIHPDOHZLWKRURRHVRSKDJHDO DQGJDVWURRHVRSKDJHDOGLVRUGHUVXQGHUZHQW05H[DPLQDWLRQRQD7 HVODVFDQ QHU:HDFTXLUHG%+*5(XQVSRLOHG7ZDQG+$67(7ZVHTXHQFHVRQPXOWLSOH SODQHVLQRUGHUWRGHÀQHWKHDQDWRPLFGHWDLOVIH1LVVHQIXQGRSOLFDWLRQSRVLWLRQ DERYHRUEHORZGLDSKUDJPDWLFSODQH9LVXDOLVDWLRQRIRHVRSKDJHDOEROXVWUDQVLW EROXVWUDQVLWWLPHSHULVWDOVLVJDVWURRHVRSKDJHDOMXQFWLRQSDWHQF\DQGFRPSHWHQF\ GXULQJRUDODGPLQLVWUDWLRQRIFRQWUDVWHG\RJXUWZHUHHYDOXDWHG 5HVXOWV05ÁXRURVFRS\UHYHDOHGWREHDUHOLDEOHWRROWRHYDOXDWHEROXVSURSXOVLRQ IURPRHVRSKDJXVWRVWRPDFK05ÁXRURVFRS\VKRZHGVZDOORZLQJDEQRUPDOLWLHVLQ SDWLHQWVXSSHUPRWLOLW\GLVRUGHUDFKDODVLDPHJDRHVRSKDJXVSDUD RHVRSKDJHDO+MDWDO+HUQLDJDVWURRHVRSKDJHDOUHÁX[RIWKRVHZLWKVOLGLQJ +MDWDO+HUQLDDIWHU1LVVHQIXQGRSOLFDWLRQDIWHUJDVWUHFWRP\05ÀQGLQJVZHOO FRUUHODWHGZLWKRWKHUGLIIHUHQWLQVWUXPHQWDOH[DPLQDWLRQÀQGLQJV &RQFOXVLRQ,QV\PSWRPDWLFVXEMHFWVDIWHU1LVVHQIXQGRSOLFDWLRQ05ÁXRURVFRS\ FDQ GHWHFW PRWLOLW\ DOWHUDWLRQV SURYLGLQJ DGGLWLRQDO LQIRUPDWLRQ IRU GLDJQRVWLF ZRUNXS)LQDOO\05)OXRURVFRS\LVDUDGLDWLRQIUHHDQGQRQLQYDVLYHWRRODEOHWR HYLGHQFHVZDOORZLQJGLVRUGHULWLVVLPSOHQRQLQYDVLYHUDSLGDQGZHOOWROHUDWHG IRUGLDJQRVLQJ*(UHÁX[RUPRWLOLW\GLVRUGHUV % 05,VLQRJUDSK\ÀVWXORJUDSK\LVDQHZHUDQGOHVVXVHGWHFKQLTXHIRU LPDJLQJSDWLHQWVZLWKVLQXVÀVWXODVZKHQFRPSDUHGWRFRQYHQWLRQDO VLQRJUDSK\ÀVWXORJUDSK\EXWPRUHKHOSIXODQGDFFXUDWHZLWKRXWUDGLDWLRQ +3 3DUHNK18%DKUL'3 9DVDYDGD-DPQDJDU,1 3XUSRVH05,VLQRJUDSK\ÀVWXORJUDSK\LVFRQVLGHUHGDQHZHUDQGOHVVXVHGWHFK QLTXHIRULPDJLQJSDWLHQWVZLWKSHULDQDOVLQXVÀVWXODV7 RHYDOXDWHVWHULOHOLJQRFDLQH MHOO\DVDFRQWUDVWDJHQWIRU05,DVDFKHDSHUDOWHUQDWLYHWRJDGROLQLXPEDVHG FRQWUDVWIRUOHVLRQVZKHUHQRYDVFXODUFRPPXQLFDWLRQLVSUREDEOH 0HWKRGVDQG0DWHULDOVSDWLHQWVDUHVWXGLHGWRGDWHWRFRPSDUHWKHLQIRUPDWLRQ SURYLGHGE\FRQYHQWLRQDOLPDJLQJYHUVXV05,SDWLHQWVLQZKRPWKHH[WHUQDO RSHQLQJZDVYLVLEOHVWHULOHOLJQRFDLQHMHOO\ZDVLQMHFWHGDQG05,ZDVGRQH SDWLHQWVLQZKRPWKHH[WHUQDORSHQLQJZDVQRWYLVLEOH+HDYLO\7:,LPDJHVZHUH WDNHQZLWKRXWLQMHFWLQJOLJQRFDLQH$OOWKHLPDJHVVWXGLHGIRUH[DFWORFDWLRQWUDFN RSHQLQJVERWKLQWHUQDODQGH[WHUQDODQGDQ\YLVFHUDOFRPPXQLFDWLRQ5HVXOWVZHUH DQDO\VHGDQGFRPSDUHGZLWKWKHÀQGLQJVRIFRQYHQWLRQDOVWXG\ 5HVXOWV ,Q WKH SDWLHQWV VWXGLHG SDWLHQWV KDG WKH VDPH ÀQGLQJV RQE R W K PRGDOLWLHV SDWLHQWV KDG DGGLWLRQDO LQIRUPDWLRQ RQ 05, LQWHUFRPPXQLFDWLQJ RUPRUHWUDFNVV\PSWRPDWLFSDWLHQWVKDGQRQFRQFOXVLYHFRQYHQWLRQDOVWXG\ ZKHUH05,GHOLQHDWHGGHWDLOHGSDWKRORJ\6WHULOHOLJQRFDLQHMHOO\SURYLGHGDGHTXDWH FRQWUDVWDORQJZLWKKHDYLO\7ZHLJKWHGLPDJLQJSURYLGHGGLDJQRVWLFLQIRUPDWLRQ DQGQRDGYHUVHUHDFWLRQVZHUHQRWHG &RQFOXVLRQ05VLQRJUDSK\EHLQJDQHZHUDQGDGYDQFHGWHFKQLTXHVKRXOGEH DSSOLHGLQDOOV\PSWRPDWLFSDWLHQWVZKHUHWKHFRQYHQWLRQDOLPDJLQJÀQGLQJVDUH QRWVDWLVIDFWRU\,QDGGLWLRQV\PSWRPDWLFSDWLHQWVZLWKRXWYLVLEOHH[WHUQDORSHQLQJ 05,LVPRVWXVHIXOIRUGHWHFWLRQDQGVXUJLFDOJXLGDQFH6WHULOHOLJQRFDLQHMHOO\LV FKHDSHUHDVLO\DYDLODEOHDQGVXLWDEOHFRQWUDVWPDWHULDOIRUWKLVVWXG\ZLWKJRRG SDWLHQWFRPSOLDQFH % 6DQGZLFKVLJQRI%RUUPDQQW\SHJDVWULFFDQFHURQGLIIXVLRQ ZHLJKWHGPDJQHWLFUHVRQDQFHLPDJLQJ /7 DQJ;3 =KDQJ< 66XQ=< /L-) -L;7 /L< 4/LX4:X %HLMLQJ&1WDQJOHL#EMFDQFHURUJ 3XUSRVH 7 R DVVHVV WKH DSSHDUDQFH RI %RUPDQQ W\SH %7 JDVWULF FDQFHU RQGLIIXVLRQZHLJKWHGPDJQHWLFUHVRQDQFHLPDJLQJ':,DQGWRLQYHVWLJDWHWKH SRWHQWLDORITXDOLWDWLYHDQGTXDQWLWDWLYH':LPDJHVDQDO\VLVWRGLIIHUHQWLDWH%7 JDVWULFFDQFHUIURPSRRUO\GLVWHQGHGQRUPDOVWRPDFKZDOO 0HWKRGV DQG 0DWHULDOV ':, ZDV SHUIRUPHG RQ SDWLHQWV ZLWK %7 JDVWULF FDQFHU DQG KHDOWK\ YROXQWHHUV 7KH VLJQDO FKDUDFWHULVWLFV DQG FRUUHODWHG KLVWRSDWKRORJLFDOEDVLVRIWKHFDQFHUVRQ':,ZHUHLQYHVWLJDWHG7KHFRQWUDVWWR QRLVHUDWLRV&15RIFDQFHUZHUHFRPSDUHGEHWZHHQ':,DQG7:,7:,7KH 6FLHQWLILF6HVVLRQ $ 6&'()*+% 7KXUVGD\ (XURSHDQ&RQJUHVVRI 5DGLRORJ\ % &7YLUWXDOK\VWHURVDOSLQJRJUDSK\H[SHULHQFHLQFDVHV -9DOOHMRV3 &DUUDVFRVD&&DSXQD\$9DVFRQFHORV0%DURQLR 63DSLHU9LFHQWH/RSH]$5%XHQRV$LUHV$5MDYVV#\DKRRFRPDU 3XUSRVH7 RLOOXVWUDWHWKHVSHFWUXPRIÀQGLQJVDQGWKHGLIIHUHQWLDOGLDJQRVLVZLWK RWKHU SDWKRORJLHV LQ FRPSXWHG WRPRJUDSK\ YLUWXDO K\VWHURVDOSLQJRJUDSK\ &7 9+6*VWXGLHV 0HWKRGVDQG0DWHULDOV:HUHWURVSHFWLYHO\ HYDOXDWHG &79+6*VWXGLHV SHUIRUPHGLQRXULQVWLWXWLRQIRUWKHHYDOXDWLRQRILQIHUWLOLW\7KHH[DPVZHUHSHUIRUPHG XVLQJDURZDQGURZ&7VFDQQHUV6FDQVSDUDPHWHUVZHUHPPVOLFH WKLFNQHVVPPUHFRQVWUXFWLRQLQWHUYDON9DQGP$V $WRWDOYROXPH RIPOLRGLQHFRQWUDVWGLOXWLRQPORILRGLQHFRQWUDVWDQGPORIVDOLQHVROX WLRQZHUHDGPLQLVWHUHGLQWRWKHXWHULQHFDYLW\XVLQJDVHPLULJLGSODVWLFFDQQXOD 5HVXOWV,QWKHFHUYLFDOUHJLRQ&79+6*GHPRQVWUDWHGZDOOLUUHJXODULWLHV IROGVWKLFNHQLQJFHUYLFDOSRO\SVGLYHUWLFXODHVFHUYLFDOVWHQRVLV FHUYLFDOV\QHFKLDHV8WHULQHFDYLW\ÀQGLQJVZHUHSRO\SVVXE PXFRXV P\RPDV V\QHFKLDHV 8WHULQH ZDOO DEQRUPDOLWLHV LQFOXGHG LQWUDPXUDODQGVXEVHURXVP\RPDVXWHULQHPDOIRUPDWLRQVDGHQRP\RVLV \&VHFWLRQVFDU)DOORSLDQWXEHVÀQGLQJVLQFOXGHGXQLODWHUDOK\GURV DOSLQ[DQGELODWHUDOK\GURVDOSLQ[WXEDOREVWUXFWLRQ7KHRIWKH IDOORSLDQWXEHVZHUHSDUWLDOO\YLVXDOLVHGLQWKH&79+6*VWXGLHV7KHVFDQWLPH ZDVVHF7KHHIIHFWLYHUDGLDWLRQGRVHZDVP6Y7KHRI WKHSDWLHQWVUHIHUUHGRQO\PLOGRUQRGLVFRPIRUW &RQFOXVLRQ&79+6*DOORZHGDQDGHTXDWHDQGDFFXUDWHHYDOXDWLRQRIWKHIHPDOH LQWHUQDOJHQLWDORUJDQVSURYLGLQJFRPSUHKHQVLYHGLDJQRVWLFLQIRUPDWLRQLQSDWLHQWV ZLWKLQIHUWLOLW\7KLVLVPLQLPDOO\LQYDVLYHORZUDGLDWLRQGRVHWHFKQLTXHZHOOWROHUDWHG IRUWKHYDVWPDMRULW\RIWKHSDWLHQWV % 'HWHFWDELOLW\RIVPDOOXULQDU\VWRQHVRQYLUWXDOQRQHQKDQFHGLPDJHV ZLWKGLIIHUHQWVOLFHWKLFNQHVVJHQHUDWHGDWS\HORJUDSKLFSKDVHGXDO HQHUJ\&7 6/LP< /HH60RRQ'.DQJ6:HH0.LP,NVDQ.5 3XUSRVH7 RHYDOXDWHWKHGHWHFWDELOLWLHVRIVPDOOXULQDU\VWRQHVE\PPPP PPVOLFHWKLFNQHVVYLUWXDOQRQHQKDQFHG91(LPDJHV 0HWKRGV DQG 0DWHULDOV SDWLHQWV ZKR KDG XQGHUJRQH DEGRPLQRSHOYLF &7 VFDQVZKLFKFRQVLVWHGRIWUXHQRQHQKDQFHG71(DQGS\HORJUDSKLFSKDVHGXDO VRXUFHGXDOHQHUJ\&7VFDQVZHUHHQUROOHGSDWLHQWVZKRKDYHXULQDU\VWRQHV OHVVWKDQPPLQGLDPHWHUZHUHHQUROOHGUDQGRPO\DQGSDWLHQWVZKRKDYHQR XULQDU\VWRQHZHUHHQUROOHGIRUFRQWUROJURXS7 RWDOVWRQHVZHUHHQUROOHG7ZR UDGLRORJLVWVLQGHSHQGHQWO\HYDOXDWHGWKH91(LPDJHVIRUWKHSUHVHQFHRIVWRQH VL]HDQGORFDWLRQ,QDGGLWLRQWKHLPDJHTXDOLW\DUWHIDFWVDVVRFLDWHGUHQDODEQRU PDOLWLHVDQGUDGLDWLRQGRVHZHUHDOVRFDOFXODWHG6HQVLWLYLWLHVZHUHFDOFXODWHGIRU VWRQHVZLWKGLDPHWHURIPPPPDQGRYHUDOO6SHFLÀFLWLHVDFFXUDFLHV DQGSRVLWLYHSUHGLFWLYHYDOXHVZHUHDOVRFDOFXODWHG7KH71(LPDJHZDVFRQVLGHUHG WKHUHIHUHQFHVWDQGDUG 5HVXOWV 7KH PHDQ RYHUDOO VHQVLWLYLWLHV RI WZR REVHUYHUV IRU GHWHFWLQJVWRQHV DWPPPPPP91(LPDJHVZHUH7KHVHQVLWLYLWLHVIRU GHWHFWLQJPPVL]HGVWRQHVZHUH7KHVHQVLWLYLWLHV IRUPPVL]HGVWRQHVZHUH7KHRYHUDOOVSHFLÀFLWLHV ZHUH$FFXUDFLHVZHUH339 ZHUH,QWHUREVHUYHUDJUHHPHQWVKRZHGJRRGN RIWRWDOUDGLDWLRQGRVHFRXOGKDYHEHHQUHGXFHGLI71(LPDJHVZHUHQRW WDNHQ6\PSWRPDWLFXUHWHUDODQGXUHWHURYHVLFDOMXQFWLRQVWRQHVRIVWRQHV ZHUHGHWHFWDEOHLQ &RQFOXVLRQ91(LPDJHLVXVHIXOHYHQIRUGHWHFWLQJVPDOOXULQDU\VWRQHVDQG GHWHFWDELOLW\RIVPDOOVWRQHVFDQEHHQKDQFHGZLWKPPVOLFHWKLFNQHVV91(LPDJH % &7LQXURUROLWKLDVLVSRWHQWLDORIGRVHUHGXFWLRQDQGLPSDFWRQLPDJH TXDOLW\XVLQJLWHUDWLYHUHFRQVWUXFWLRQ -+DQVPDQQ*06FKRHSSOHU7 +HQ]OHU++DXEHQUHLVVHU 05HLFKHUW8,$WWHQEHUJHU626FK|QEHUJ&)LQN 0DQQKHLP'(MDQKDQVPDQQ#PHGPDXQLKHLGHOEHUJGH 3XUSRVH7 RGHWHUPLQHWKHSRWHQWLDORIGRVHUHGXFWLRQDQGLPSDFWRQLPDJHTXDOLW\ XVLQJLWHUDWLYHUHFRQVWUXFWLRQIRU&7RIXUROLWKLDVLV 0HWKRGVDQG0DWHULDOV$[PPXULFDFLGXUHWHUDOVWRQHZDVSODFHGLQVLGH DQDQWKURSRPRUSKLF$OGHUVRQSKDQWRPDWWKHSHOYLFOHYHO0HDVXUHPHQWVZHUH SHUIRUPHGRQDFKDQQHO0'&7V\VWHPXVLQJGLIIHUHQWN9N9DQG P$VVHWWLQJV)RUHDFKN9DQGP$VVHWWLQJPPGDWDVHWVZHUH % &RQWUDVWHQKDQFHGXOWUDVRXQGIRUGLIIHUHQWLDOGLDJQRVLVRI VXVSHFWHG*Y+'LQSDWLHQWVDIWHUDOORJHQHLFWUDQVSODQWDWLRQ /0'HQGO./DQGIULHG(0-XQJ13ODW]%DWLVWDGD6LOYD &)ULHGULFK&6WURV]F]\QVNL$*6FKUH\HU 5HJHQVEXUJ'(OHQDBPDULHBGHQGO#\DKRRGH 3XUSRVH(DUO\GLDJQRVLVRI*Y+'JUDIWYHUVXVKRVWGLVHDVHDIWHUGLIIHUHQWLDWLRQ IURPRWKHUFDXVHVOHDGLQJWRWKHVDPHV\PSWRPVVXFKDVYLUDORUEDFWHULDOHQWHULWLV LVLPSRUWDQWEHFDXVHWKHWLPHQHHGHGIRUGLDJQRVLQJ*Y+'LVGLUHFWO\FRUUHODWHGWR DZRUVHQLQJRIWKHRXWFRPH:HHYDOXDWHWKHYDOXHRIFRQWUDVWHQKDQFHGXOWUDVRXQG &(86IRUWKHGLIIHUHQWLDOGLDJQRVLVRI*Y+' 0HWKRGVDQG0DWHULDOV:HH[DPLQHGSDWLHQWVSUHVHQWLQJZLWKWKHDEGRPL QDOV\PSWRPVRI*Y+'$OOSDWLHQWVXQGHUZHQW&(86ZLWKSDUWLFXODUDWWHQWLRQWR SHQHWUDWLRQRIWKHLQWUDYHQRXVO\DSSOLHGPLFUREXEEOHVLQWKHERZHOOXPHQ,QWKH SDWLHQWVKDYLQJDOOR6&7LQWKHLUKLVWRU\ZHKDGKLVWRORJLFDOFRQÀUPDWLRQRI*Y+' 7KHUHVXOWLQJH[DPLQDWLRQVZHUHGRFXPHQWHGGLJLWDOO\ 5HVXOWV2XWRISDWLHQWVZLWKFRQÀUPHG*Y+'RIWKH*,WUDFWVKRZHGSHQ HWUDWLRQRIWKHLQWUDYHQRXVO\DSSOLHGPLFUREXEEOHVLQWRWKHERZHOOXPHQOHDGLQJ WRDVHQVLWLYLW\DQGVSHFLÀFLW\RIDQGIRUWUDQVPXUDOEXEEOHSHQHWUDWLRQ IRU*Y+'RIWKH*,7UDFWVLQFHWKHSDWLHQWVZLWKRXW*Y+'RIWKH*,WUDFWVKRZHG QRWUDQVPXUDOEXEEOHSHQHWUDWLRQ,QSDWLHQWVZLWKYLUDORUEDFWHULDOLQIHFWLRQVRI WKH*,WUDFWQRWUDQVPXUDOSHQHWUDWLRQRIWKHPLFUREXEEOHVLQWRWKHERZHOOXPHQ ZDVREVHUYHG)RUPLFUREXEEOHSHQHWUDWLRQDVDFULWHULRQIRU*Y+'RIWKH*,7UDFW WKLVOHDGVWRDQHJDWLYHSUHGLFWLYHYDOXH139RIDQGDSRVLWLYHSUHGLFDWLYH YDOXH339RI &RQFOXVLRQ2XUVWXG\VWUHQJWKHQVWKHK\SRWKHVLVWKDWWUDQVPXUDOEXEEOHSHQ HWUDWLRQPD\EHDKLJKO\VSHFLÀFDQGDGHTXDWHO\VHQVLWLYHQRQLQYDVLYHGLDJQRVWLF FULWHULRQIRU*Y+'RIWKH*,WUDFW 5RRP) *HQLWRXULQDU\ 66 *HQLWRXULQDU\&7 0RGHUDWRUV 21LNROLF1RYL6DG56 -6WRNHU$PVWHUGDP1/ % ,PSDFWRIWKJHQHUDWLRQLWHUDWLYHUHFRQVWUXFWLRQWHFKQLTXHVRQ LPDJHTXDOLW\LQORZGRVHFRPSXWHGWRPRJUDSK\RIWKHXSSHUXULQDU\WUDFW 05HJLHU$/DTPDQL+&YRQ6FKXOW]HQGRUII'+DPPHUOH) 2+HQHV 0*URWK+'1DJHO*$GDP-+%XKN+DPEXUJ'(PUHJLHU#XNHGH 3XUSRVH7 RLQWUDLQGLYLGXDOO\FRPSDUHDQGHYDOXDWHWKHLQÁXHQFHRIWKHWKJHQ HUDWLRQLWHUDWLYHUHFRQVWUXFWLRQ,5WHFKQLTXHL'RVH70RQORZGRVH0'&7RIWKH XSSHUXULQDU\WUDFWZLWKUHJDUGWRDQDWRPLFDOGHOLQHDWLRQDQGDUWHIDFWUHGXFWLRQ 0HWKRGVDQG0DWHULDOV,QFRQVHFXWLYHSDWLHQWVVXIIHULQJIURPXUROLWKLDVLVWKH UDZ GDWD RI XQHQKDQFHG 0'&7 VFDQV N9 PHDQ &7',YRO P*\ ZHUH UHFRQVWUXFWHG XVLQJ D SURWRW\SLF UHFRQVWUXFWLRQ SURFHVVRU IHDWXULQJ L'RVH70 VRIWZDUH3KLOLSV%HVWWKH1HWKHUODQGVL'RVH70OHYHOVYDULHGEHWZHHQ DQG)RUHDFKVHWWLQJWZRGLIIHUHQWNHUQHOVZHUHDSSOLHGVWDQGDUG %VKDUS & $OO LPDJHV ZHUH UHFRQVWUXFWHG ZLWK D VOLFH WKLFNQHVV RI PP %OLQGHG LPDJH DQDO\VLVZDVSHUIRUPHGE\WKUHHUDGLRORJLVWV$SRLQWJUDGLQJVFDOHZDVDSSOLHG UHJDUGLQJ WKH GHSLFWLRQ RI DQDWRPLFDO GHWDLOV DQG GHJUHH RI DUWHIDFWV ZRUVW H[FHOOHQW7KHVLJQDOWRQRLVHUDWLR615ZDVDVVHVVHG6WDWLVWLFVLQFOXGHG NDSSDDQDO\VLVDQG:LOFR[RQWHVW 5HVXOWV 7KH KLJKHVW LPDJH TXDOLW\ ZDV DVVHVVHG DSSO\LQJ DQ L'RVH70 OHYHO RI(YHQDWWKHORZHUL'RVH70OHYHORIWKHUDWLQJVZHUHVXSHULRUWRVWDQGDUG ÀOWHUHGEDFNSURMHFWLRQL'RVH70OHYHO,IWKHFRPSDULVRQZDVPDGHDWDOPRVW LGHQWLFDOLPDJHQRLVHWKHUHZDVDWUHQGWRZDUGVWKHVXSHULRULW\RIÀOWHU&RYHU %2YHUDOOLQWHUUDWHUUHOLDELOLW\ZDVH[FHOOHQWщ!:LWKLQFUHDVLQJL'RVH70 OHYHOVUHGXFWLRQRIVWUHDNDUWHIDFWVZDVVXFFHVVIXOO\TXDQWLÀHGE\DGHFUHDVHRI WKHVWDQGDUGGHYLDWLRQDWFRQVWDQWPHDQDWWHQXDWLRQYDOXHV &RQFOXVLRQ,WHUDWLYHUHFRQVWUXFWLRQVHHPVWREHDSRZHUIXOWRROIRUWKHLPSURYH PHQWRILPDJHTXDOLW\LQORZGRVH0'&7RIWKHXSSHUXULQDU\WUDFW(YHQDWUHODWLYHO\ ORZL'RVH70OHYHOVKLJKHULPDJHTXDOLW\FRPSDUHGWRÀOWHUHGEDFNSURMHFWLRQFDQ EHDFKLHYHG 6FLHQWLILF6HVVLRQ 6 &$' ( ) *+% (XURSHDQ&RQJUHVVRI 5DGLRORJ\ 615LPDJHTXDOLW\DQGOHVLRQGHWHFWDELOLW\7KLVFDQSRWHQWLDOO\REYLDWHWKHQHHG WRREWDLQ71&LPDJHVLQ&7XURJUDSK\ % 7ULSOHEROXVWHFKQLTXHZLWKGXDOHQHUJ\0'&7 DQHZSHUVSHFWLYHLQ &7XURJUDSK\ +67 HK616KLNKDUH3 3 /6HH..<HRZ6LQJDSRUH6* F\EHUB[UD\#\DKRRFRP 3XUSRVH7 RUHWURVSHFWLYHO\HYDOXDWHDQGFRPSDUHUHQDOYDVFXODUDQGXULQDU\WUDFW YLVXDOLVDWLRQDVZHOODVUDGLDWLRQGRVHHIÀFLHQF\IROORZLQJWULSOHEROXVLQMHFWLRQVLQ DVLQJOHDFTXLVLWLRQZLWKFRQYHQWLRQDOWULSKDVLF&7XURJUDSK\WHFKQLTXH 0HWKRGV DQG 0DWHULDOV SDWLHQWV XQGHUZHQW WULSOH EROXV &7 XURJUDSK\ XV LQJGXDOVRXUFH&7VFDQQHU7KHSURWRFROIROORZHGZDVP/RILYFRQWUDVWDW P/VHFDWDQGVHFRQGVDQGP/DWP/VHFDWVHFRQGVZLWKWRWDO VFDQQLQJWLPHRIVHFRQGV9LUWXDOQRQHQKDQFHGLPDJHVZHUHREWDLQHGXVLQJ FRPPHUFLDOGXDOHQHUJ\VRIWZDUH7ZRUHDGHUVLQGHSHQGHQWO\DQGUHWURVSHFWLYHO\ UHYLHZHGDQGUDWHGWKHLPDJHVIRUFRQWUDVWRSDFLÀFDWLRQRIWKHUHQDOSDUHQFK\PD YDVFXODWXUHDQGXULQDU\WUDFWGLVWHQVLRQDQGFRPSDUHGZLWKFRQYHQWLRQDOWULSKDVLF &7XURJUDSK\F&78LPDJHV 5HVXOWV&RPSOHWHRSDFLÀFDWLRQRIWKHLQWUDUHQDOFROOHFWLQJV\VWHPDQGSUR[LPDO XUHWHUZDVDFKLHYHGLQRIVHJPHQWVUHVSHFWLYHO\F&78DQG7KH GLVWDOXUHWHUDQGEODGGHUZDVQRWRSDFLÀHGLQDQGRIFDVHVUHVSHFWLYHO\ F&78DQGS!,PDJHTXDOLW\RIUHQDOSDUHQFK\PDOHQKDQFHPHQW ZDVH[FHOOHQWLQFDVHVFRQYHQWLRQDO&78S!9DVFXODULPDJH TXDOLW\ZDVH[FHOOHQWLQRIFDVHVF&78S!:LWKWKLVQHZVWXG\ FDOFXODWHGUDGLDWLRQGRVHZDVP*\PXFKOHVVWKDQWKHFRQYHQWLRQDOWULSKDVLF &7XURJUDSK\P*\ &RQFOXVLRQ7ULSOHEROXV&7XURJUDSK\WHFKQLTXHXVLQJGXDOHQHUJ\&7LVDGRVH HIÀFLHQWSURWRFROSHUPLWWLQJFRPSUHKHQVLYHVWXG\RIWKHXULQDU\V\VWHPLQDVLQJOH DFTXLVLWLRQDQGFDQEHSRWHQWLDOO\XVHGDVVWDQGDUGSURWRFROIRU&7XURJUDSK\ % 7KHGLDJQRVWLFDFFXUDF\RIPXOWLGHWHFWRUFRPSXWHGWRPRJUDSK\ ZLWKPXOWLSODQDUUHIRUPDWWHGLPDJLQJDQGYLUWXDOF\VWRVFRS\LQWKH HDUO\GHWHFWLRQDQGHYDOXDWLRQRIEODGGHUFDUFLQRPD 0) $PLQ$$$EG(O.DI\(OPLQ\D(*0RKDPPHGBDPLQ #\DKRRFRP 3XUSRVH 7 R HYDOXDWH WKH GLDJQRVWLF DFFXUDF\ RI PXOWLGHWHFWRU FRPSXWHGW R PRJUDSK\ZLWKPXOWLSODQDU UHIRUPDWWHGLPDJLQJ DQGYLUWXDOF\VWRVFRS\LQHDUO\ GHWHFWLRQ DQG HYDOXDWLRQ RI EODGGHU PDVVHV ZLWK FRPSDULVRQ ZLWK FRQYHQWLRQDO F\VWRVFRSLFÀQGLQJV 0HWKRGVDQG0DWHULDOV7KLVSURVSHFWLYHVWXG\LQFOXGHGWKLUW\ÀYHSDWLHQWVZLWK VXVSHFWHGEODGGHUFDQFHUZHUHVWXGLHGE\FRPSXWHGWRPRJUDSKLFF\VWRJUDSK\ &7&DQGYLUWXDOF\VWRJUDSK\9&LQERWKWKHVXSLQHDQGSURQHSRVLWLRQVDIWHU GLVWHQGLQJWKHEODGGHUZLWKDLU7KHSDWLHQWSRSXODWLRQZDVGLYLGHGLQWRWKUHHJURXSV EDVHGRQOHVLRQVL]HDWFRQYHQWLRQDOF\VWRVFRS\5HVXOWVRIWKH&7VWXG\ZHUH FRPSDUHGZLWKWKRVHRIFRQYHQWLRQDOF\VWRVFRS\&&0DLQRXWFRPHPHDVXUHV VHQVLWLYLW\VSHFLÀFLW\SRVLWLYHDQGQHJDWLYHSUHGLFWLYHYDOXHZDVXVHGWRVWXG\WKH DVVRFLDWLRQEHWZHHQ9&DQG&&DVUHJDUGLQJOHVLRQGHWHFWLRQ 5HVXOWV7KHVL]HRIWKHWXPRXUVYDULHGIURPPPWRRFFXS\LQJPRUHWKDQWKUHH TXDUWHUVRIWKHEODGGHU2IWKHOHVLRQVGHWHFWHGRQ&&OHVLRQVZHUHSRVLWLYH LQKLVWRSDWKRORJ\ZHUHPPZHUHGHWHFWHGE\9&DQGRIPP7KH ORFDWLRQVRIDOOZHUHFRUUHFWO\GHVFULEHGDW9&ZKHQFRPSDUHGZLWK&&7KHRYHUDOO VHQVLWLYLW\RI9&YHUVXV&&ZDVVSHFLÀFLW\339ZDVDQG 139ZDV &RQFOXVLRQ&\VWRVFRS\UHPDLQVWKHVWDQGDUGRIUHIHUHQFHIRUWKHHYDOXDWLRQRI WKHXULQDU\EODGGHUEXW0'&7LVLQGLFDWHGIRUH[DPLQDWLRQRISDWLHQWVRQZKRP FRQYHQWLRQDOF\VWRVFRS\LVFRQWUDLQGLFDWHGGLIÀFXOWWRSHUIRUPXQVDWLVIDFWRU\LQ LQWHUSUHWDWLRQDQGDVDQDGMXYDQWWRROLQWKHHYDOXDWLRQRIDUHDVGLIÀFXOWWRDVVHVV ZLWKFRQYHQWLRQDOF\VWRVFRS\ % (YDOXDWLRQRIGLDJQRVWLFVWUDWHJLHVIRUGLDJQRVLQJEODGGHUFDQFHU XVLQJ&7XURJUDSK\ÁH[LEOHF\VWRVFRS\DQGYRLGHGXULQHF\WRORJ\ UHVXOWVIRUSDWLHQWV -06WHGPDQ&*7 %OLFN6$1D]LU60DOOHWW%:7XUQH\ 112QZX,6'5REHUWV-3 &UHZ1&&RZDQ2[IRUG8. MRQDWKDQVWHGPDQ#GRFWRUVRUJXN 3XUSRVH7 RHYDOXDWHGLDJQRVWLFVWUDWHJLHVIRUGLDJQRVLQJEODGGHUFDQFHU%&D XVLQJ&7XURJUDSK\&78DVDGGLWLRQDOUHSODFHPHQWRUWULDJHWHVWV UHFRQVWUXFWHGXVLQJVWDQGDUGÀOWHUHGEDFNSURMHFWLRQDQGLWHUDWLYHUHFRQVWUXFWLRQ VRIWWLVVXHNHUQHOV%DQG,7KHUHVXOWLQJVFDQVZHUHUDQGRPLVHGLQWR JURXSVDQGLPDJHTXDOLW\ZDVLQGHSHQGHQWO\DVVHVVHGE\WZREOLQGHGUHDGHUV7KH EHVWWZRVFDQVRIHDFKJURXSZHUHDJDLQUDQGRPLVHGDQGSLWWHGDJDLQVWHDFKRWKHU XQWLOWKHEHVWVFDQVZHUHGHWHUPLQHG(IIHFWLYHGRVH('ZDVHVWLPDWHGIRUHDFK GDWDVHWIURPGRVHOHQJWKSURGXFWDQGDFRQYHUVLRQIDFWRU1RLVHPHDVXUHPHQWV ZHUHSHUIRUPHGLQDQDGGLWLRQDOZDWHUSKDQWRPXVHGZLWKHDFKVFDQ 5HVXOWV/RZGRVHLPDJHVXVLQJDP$VVHWWLQJRIZHUHQRWGLDJQRVWLFDQGFRXOG QRWYLVXDOLVHWKHVWRQH$PRQJWKHEHVWGDWDVHWVZHUHEDVHGRQLWHUDWLYHUH FRQVWUXFWLRQV,PDJHTXDOLW\XVLQJLWHUDWLYHUHFRQVWUXFWLRQDWWKHKLJKHVWGRVHZHUH UDWHGWRKDYHWKHEHVWLPDJHTXDOLW\NYP$V(' 1RLVHOHYHO /RZHU GRVH VHWWLQJV N9 P$V (' 1RLVH OHYHODOORZHG IRU GLDJQRVWLFLPDJHTXDOLW\ZLWKDGRVHVDYLQJVSRWHQWLDORI &RQFOXVLRQ,WHUDWLYHUHFRQVWUXFWLRQDOORZVIRUDSRWHQWLDOGRVHVDYLQJRIXSWR ZKLOHVWLOO\LHOGLQJGLDJQRVWLFLPDJHTXDOLW\LQ&7RIXUROLWKLDVLV % 'XDOHQHUJ\VSOLWEROXV&7IRUWKHGHWHFWLRQRIXULQDU\VWRQHGLVHDVH 2QHSKDVHDFTXLVLWLRQWKUHHIROGLQIRUPDWLRQ 3 6WRO]PDQQ5*QDQQW$:LQNOHKQHU0)LVFKHU+$ONDGKL&.DUOR =XULFK&+SDXOVWRO]PDQQ#XV]FK 3XUSRVH7 RSURVSHFWLYHO\DVVHVVLPDJHTXDOLW\GLDJQRVWLFSHUIRUPDQFHDQGUDGLD WLRQGRVHRIGXDOHQHUJ\VSOLWEROXV&7IRUWKHHYDOXDWLRQRIXULQDU\VWRQHGLVHDVH 0HWKRGV DQG 0DWHULDOV )LIW\ FRQVHFXWLYH SDWLHQWV ZRPHQ \UV UHIHUUHGIRUWKHHYDOXDWLRQRIXULQDU\VWRQHGLVHDVHDQGXULQDU\WUDFWREVWUXFWLRQ XQGHUZHQW&7ZLWKDVWDQGDUGXQHQKDQFHGDQGGXDOHQHUJ\GXDOVRXUFH&7 N9SZWLQÀOWHUFRQWUDVWHQKDQFHGSKDVH&RQWUDVWPHGLDPJ,RGLQHPO ZDVDGPLQLVWHUHGLQDVSOLWEROXVIDVKLRQVWEROXVPOQGEROXVPODIWHU PLQ'XDOHQHUJ\GDWDZHUHDFTXLUHGPLQDIWHULQLWLDWLRQRIFRQWUDVWLQMHFWLRQ 9LUWXDOQRQHQKDQFHG91&LPDJHVZHUHUHFRQVWUXFWHGE\LRGLQHVXEWUDFWLRQ7ZR EOLQGHGUHDGHUVLQGHSHQGHQWO\DVVHVVHGLPDJHTXDOLW\6HQVLWLYLW\VSHFLÀFLW\DQG GLDJQRVWLFDFFXUDF\IRUWKHGHWHFWLRQRIXULQDU\VWRQHGLVHDVHZHUHFDOFXODWHGIRU 91&LPDJHVXVLQJVWDQGDUGXQHQKDQFHGLPDJHVDVWKHUHIHUHQFH 5HVXOWV,PDJHTXDOLW\RIFRQWUDVWHQKDQFHGGXDOHQHUJ\DQG91&LPDJHVZHUH UDWHGGLDJQRVWLFLQDOOSDWLHQWV,PDJHQRLVHRI91&LPDJHVZDVORZ +8+86WDQGDUGXQHQKDQFHG&7UHYHDOHGXULQDU\VWRQHVLQ SDWLHQWV91&GHPRQVWUDWHGXUROLWKVLQSDWLHQWV7KHWZR PLVVHGVWRQHVPPZHUHVLJQLÀFDQWO\SVPDOOHUWKDQWKHGHWHFWHG RQHV6HQVLWLYLW\VSHFLÀFLW\DQGGLDJQRVWLFDFFXUDF\ZHUHDQG RQDSHUXUROLWKDQGDQGRQDSHUSDWLHQWEDVLVUHVSHFWLYHO\7KH HIIHFWLYHGRVHRIGXDOHQHUJ\VSOLWEROXV&7ZDVVLJQLÀFDQWO\SORZHUWKDQ WKDWRIVWDQGDUGELSKDVLFSURWRFRO &RQFOXVLRQ6SOLWEROXVGXDOHQHUJ\&7DOORZVIRUWKHHYDOXDWLRQRIXULQDU\VWRQHV QHSKURJUDSKLF DQG H[FUHWRU\ SKDVHV LQ D VLQJOH DFTXLVLWLRQ WKXV LW IDFLOLWDWHV FRPSUHKHQVLYH&7HYDOXDWLRQRIXULQDU\VWRQHGLVHDVHDWDFRQVLGHUDEO\UHGXFHG UDGLDWLRQGRVH % &DQYLUWXDOQRQFRQWUDVWLPDJHVRIGXDOHQHUJ\&7UHSODFHWUXHQRQ FRQWUDVWLPDJHVLQHYDOXDWLRQRIUHQDOSDWKRORJLHV +67 HK616KLNKDUH0,2WKPDQ..<HRZ6LQJDSRUH6* F\EHUB[UD\#\DKRRFRP 3XUSRVH7 RDVVHVVWKHHIÀFDF\RIWKHYLUWXDOQRQFRQWUDVW&791&LQHYDOXDW LQJWKHUHQDOOHVLRQVFRPSDUHGWRWUXHQRQFRQWUDVW&771&DQGLWVFDSDELOLW\WR UHGXFHWKHUDGLDWLRQGRVH 0HWKRGVDQG0DWHULDOVSDWLHQWVXQGHUZHQWWULSOHEROXV&7XURJUDSK\XVLQJ '(&7VFDQQHU91&LPDJHVZHUHREWDLQHGXVLQJFRPPHUFLDOGXDOHQHUJ\VRIWZDUH 7ZRUHDGHUVLQGHSHQGHQWO\DQGUHWURVSHFWLYHO\UHYLHZHGUDWHGDQGFRPSDUHG91& LPDJHVZLWK71&FRQWUROLPDJHVXVLQJPHDQ+8YDOXHVLJQDOWRQRLVHUDWLR615 LPDJHTXDOLW\OHVLRQGHWHFWDELOLW\DQGUDGLDWLRQGRVHVDVSDUDPHWHUV6WDWLVWLFDO DQDO\VLVZDVSHUIRUPHG 5HVXOWV2IWKHFDVHVVWXGLHGZHUHQRUPDOVLPSOHF\VWVUHQDOFDU FLQRPDFRPSOLFDWHGF\VWVDQGUHQDOFDOFXOL7KHPHDQ+8YDOXHVDQG 615RIWKHVHOHVLRQVZHUHFRPSDUDEOHLQ91&LPDJHVDQGFRUUHVSRQGLQJ71& LPDJHV7KHLPDJHTXDOLW\RI91&LPDJHVZDVFRPSDUDEOHDQGGLDJQRVWLF91& LPDJHVZHUHHTXDOO\HIÀFLHQWDV71&LPDJHVLQGHWHFWLQJVROLGIRFDOOHVLRQVDQG F\VWV+RZHYHURIFDOFXOLZHUHGHWHFWHGXVLQJ91&LPDJHVZKHUHDV DOOZHUHYLVXDOLVHGRQ71&LPDJHV:LWKWKLVQHZWHFKQLTXHFDOFXODWHGUDGLDWLRQ GRVHZDVP*\YVP*\UHFHLYHGXVLQJFRQYHQWLRQDOWHFKQLTXH &RQFOXVLRQ 2EWDLQLQJ 91& LPDJHV RI WKH NLGQH\V DQG WKH XULQDU\ WUDFW XVLQJ '(&7VRIWZDUHVLJQLÀFDQWO\UHGXFHVHIIHFWLYHUDGLDWLRQGRVHZLWKRXWFRPSURPLVLQJ 6FLHQWLILF6HVVLRQ $ 6&'()*+% 7KXUVGD\ (XURSHDQ&RQJUHVVRI 5DGLRORJ\ % 'LIIHUHQWLDOSKDVHFRQWUDVWPDPPRJUDSK\DQHZWRROIRUEUHDVWLPDJLQJ 06WDPSDQRQL=:DQJ&'DYLG(5RHVVO07ULSSHO*6LQJHU 5$.XELN+XFK0.+RKO1+DXVHU9LOOLJHQ&++DPEXUJ'( %DGHQ&+PDUFRVWDPSDQRQL#SVLFK 3XUSRVH3KDVHFRQWUDVWDQGVFDWWHULQJEDVHG[UD\LPDJLQJDUHNQRZQWRSURYLGH DGGLWLRQDODQGFRPSOHPHQWDU\LQIRUPDWLRQWRFRQYHQWLRQDODEVRUSWLRQEDVHGPHWK RGV:HUHSRUWRQWKHÀUVWPDPPRJUDSKLFLQYHVWLJDWLRQRIQDWLYHWKDWLVIUHVKO\ GLVVHFWHGEUHDVWVFDUULHGRXWZLWKDJUDWLQJLQWHUIHURPHWHUDQGDFRQYHQWLRQDO[UD\ WXEHVRXUFH)RXUSDWLHQWVLQWKLVVWXG\KDGKLVWRSDWKRORJLFDOO\SURYHQLQYDVLYH EUHDVWFDQFHU2QHPDOHSDWLHQWZLWKRXWWKHSUHVHQFHRIDQ\PDOLJQDQWIRUPDWLRQV ZLWKLQWKHUHVHFWHGEUHDVWZDVLQFOXGHGDVDFRQWUROVSHFLPHQ 0HWKRGVDQG0DWHULDOV:HXVHGD7 DOERW/DXLQWHUIHURPHWHULQVWDOOHGRQDORZ EULOOLDQFH[UD\VRXUFHWKHLQWHUIHURPHWHUZDVRSHUDWHGDWWKHÀIWK7 DOERWGLVWDQFH WXEHYROWDJHRIN9SZLWKPHDQHQHUJ\RINH9DQGFXUUHQWRIP$7KHGHYLFH VLPXOWDQHRXVO\UHFRUGHGDEVRUSWLRQGLIIHUHQWLDOSKDVHDQGVPDOODQJOHVFDWWHULQJ 7KHVHTXDQWLWLHVZHUHFRPELQHGLQWRQRYHOFRORXUDQGKLJKIUHTXHQF\HQKDQFHG UDGLRJUDSKLF LPDJHV 3UHVXUJLFDO LPDJHV FRQYHQWLRQDO PDPPRJUDSK\ XOWUD VRQRJUDSK\DQG05,VXSSRUWHGWKHÀQGLQJVDQGFOLQLFDOUHOHYDQFHZDVYHULÀHG 5HVXOWV2XUDSSURDFK\LHOGVFRPSOHPHQWDU\DQGRWKHUZLVHLQDFFHVVLEOHLQIRUPD WLRQRQHOHFWURQGHQVLW\GLVWULEXWLRQDQGVPDOODQJOHVFDWWHULQJSRZHURIWKHVDPSOH DWPLFURVFRSLFVFDOH7KLVLQIRUPDWLRQFDQEHXVHGWRDQVZHUFOLQLFDOO\UHOHYDQW \HWXQUHVROYHGTXHVWLRQVVXFKDVXQHTXLYRFDOO\GLVFHUQLQJEHWZHHQPDOLJQDQW SUHPDOLJQDQWFKDQJHVDQGSRVWRSHUDWLYHVFDUVDQGGLVWLQJXLVKLQJFDQFHULQYDGHG UHJLRQVZLWKLQKHDOWK\WLVVXH &RQFOXVLRQ :H SUHVHQW WKH ÀUVW H[ YLYR LPDJHV RI IUHVK QDWLYH EUHDVW WLVVXH REWDLQHGIURPPDVWHFWRP\VSHFLPHQVXVLQJJUDWLQJLQWHUIHURPHWU\7KLVWHFKQLTXH \LHOGVLPSURYHGGLDJQRVWLFFDSDELOLWLHVZKHQFRPSDUHGZLWKFRQYHQWLRQDOPDP PRJUDSK\HVSHFLDOO\ZKHQGLVFHUQLQJWKHW\SHRIPDOLJQDQWFRQYHUVLRQVDQGWKHLU EUHDGWKZLWKLQQRUPDOEUHDVWWLVVXH % 3LORWVWXG\IRUWKHGHWHFWLRQRIVLPXODWHGOHVLRQVDWD'UHVS' GLJLWDOIXOOÀHOGGLJLWDOPDPPRJUDSK\V\VWHPZLWKDQHZGHYHORSHG KLJKUHVROXWLRQGHWHFWRURQWKHEDVHRIWZRVKLIWVRID6H 56FKXO]:HQGWODQG00HLHU0HLWLQJHU0+HLQ]%$GDPLHW]08GHU 66FKZDE(UODQJHQ'(UXHGLJHUVFKXO]ZHQGWODQG#XNHUODQJHQGH 3XUSRVH ([SHULPHQWDO VWXG\ DW D QHZ V\VWHP IRU GLJLWDO ' UHVS ' IXOOÀHOG PDPPRJUDSK\ZLWKDKLJKUHVROXWLRQGHWHFWRURQWKHEDVHRIWZRVKLIWVRID6H 0HWKRGVDQG0DWHULDOV7KHH[DPLQDWLRQVZHUHDFTXLUHGDWDQHZ))'0V\VWHP $PXOHW)XML)LOP-DSDQD6HGHWHFWRUUHFHSWRU[FPSL[HOVL]HP PHPRU\ GHSWK ELW VSDWLDO UHVROXWLRQ OSPP '4( ! ,QWHJUDWHG LQ WKHGHWHFWRUWKHUHLVDQHZPHWKRGIRUGDWDWUDQVIHUEDVHGRQWKHRSWLFDOVZLWFK WHFKQRORJ\7KHREMHFWRILQYHVWLJDWLRQZDVWKH:LVFRQVLQPDPPRJUDSKLFUDQGRP SKDQWRPPRGHO$XVLQJWKHVDPHSDUDPHWHUVDQGH[SRVXUHGDWD7XQJVWHQ P$VN9:HDFTXLUHGGLIIHUHQWLPDJHVLQFFDQGREOLTXHSODQH' UHVSLQFFDQGFFSODQHZLWKDQDQJOHRIGHJUHH')LYHLQPDPPRJUDSK\ H[SHULHQFHGUDGLRORJLVWVUHDGWKHLPDJHV0RQLWRUUDQGRPO\HQFRGHGUDQGRP JHQHUDWRUZLWKUHJDUGWRUHFRJQLVDELOLW\RIGHWDLOVOLNHVSHFNVRIDOXPLQLXPR[LGH WRPLFURPHWHUVÀEUHVRIQ\ORQWRPPDQGURXQGOHVLRQVPDVVHV GLDPHWHUVWRPPIRUGHFLVLRQDQGFRPSDUHGWKHVHUHVXOWV 5HVXOWVULJKWSRVLWLYHGHFLVLRQVZHUHSRVVLEOHWRGHWHFWZHIRXQGIRU'DQG 'LQHDFKFDVHULJKWSRVLWLYHUHVXOWV &RQFOXVLRQ7KHUHVXOWVRIWKLVSKDQWRPVWXG\GHPRQVWUDWHIRU'DVZHOODV' IXOOÀHOGGLJLWDOPDPPRJUDSK\WKHVDPHGHWHFWLRQUDWH7KLVPXVWEHSURYHQLQ IXUWKHUFOLQLFDOWULDOV % 'LJLWDOPDPPRJUDSK\ZLWKDQHZQHHGOHEDVHGGHWHFWRUV\VWHP FOLQLFDOUHVXOWVDIWHUDRQH\HDUWULDO &3 :DOOQHU0+LWWLQJHU0.RHUQHU8/LQVHQPDLHU05HLVHU 0XQLFK'(FZDOOQHU#PHGXQLPXHQFKHQGH 3XUSRVH7 RHYDOXDWHGLDJQRVWLFLPDJHTXDOLW\RIGLJLWDOPDPPRJUDSK\ZLWKDQHZ QHHGOHEDVHGGHWHFWRUV\VWHPZLWKUHVSHFWWRDGRVHUHGXFWLRQ 0HWKRGVDQG0DWHULDOV:HFRPSDUHGPDPPRJUDSKLHVZLWKVWDQGDUGGRVH Q DQG GRVH UHGXFWLRQ Q SHUIRUPHG RQ D *( 6HQRJUDSKH '05 UXQQLQJWKHQHZ $JID';0QHHGOHEDVHGLPDJLQJSODWHV\VWHP1,3WRWKHLUFRU UHVSRQGLQJSUHOLPLQDU\H[DPLQDWLRQVPHDQLQWHUYDO\ZKLFKZHUHDFTXLUHG RQWKHVDPH*(PDPPRJUDSK\V\VWHPZLWKWKH$JID&5;VWDQGDUGVWRUDJH SKRVSKRULPDJLQJSODWHV\VWHP3,3)RUGRVHUHGXFWLRQWKHDXWRPDWLFH[SRVXUH 0HWKRGV DQG 0DWHULDOV 7KH FOLQLFDO FRKRUW ZDV D FRQVHFXWLYH VHULHV RI SDWLHQWVUHIHUUHGWRDKDHPDWXULDFOLQLFZLWKYLVLEOHKDHPDWXULDDJHRYHU\HDUV ZLWK XULQDU\ WUDFW LQIHFWLRQ H[FOXGHG$OO SDWLHQWV XQGHUZHQW &78 DQG ÁH[LEOH F\VWRVFRS\ )& VFRUHG XVLQJ SRLQW V\VWHPV DQG XULQH PLFURVFRS\ 5HIHU HQFHVWDQGDUGFRQVLVWHGRIUHYLHZRILPDJLQJKLVWRSDWKRORJ\DQGPHGLFDOQRWHV )ROORZXSZDVPRQWKV 5HVXOWV7KHSUHYDOHQFHRI%&DLQWKHFRKRUW Q )RU&78DVDQ ҊDGGLWLRQDOWHVWҋWR)&VHQVLWLYLW\6H &,VSHFLÀFLW\6S &,SRVLWLYHSUHGLFWLYHYDOXH339 &,DQG QHJDWLYHSUHGLFWLYHYDOXH139 &,)RU&78DVDҊUHSODFHPHQW WHVWҋIRU)&6H &,6S &,339 &,DQG139 &,)RU)&IRUGLDJQRVLQJ%&D 6H &,6S &,339 &, DQG 139 &, )RU &78 DQG )& DV D ҊWULDJHWHVWҋ IRU ULJLG F\VWRVFRS\ 5& DQG IROORZXS QRUPDO DQG HTXLYRFDOVFRUHV UHIHUUHG IRU )& RSWLRQ6H &,6S &,339 &,139 &,)RU&78DQG)&DVDҊWULDJHWHVWҋ IRU 5& DQG IROORZXS QRUPDOVFRUH UHIHUUHG IRU IROORZXS RSWLRQ 6H &, 6S &, 339 &, 139 &, &RQFOXVLRQ7KHRSWLPXPҊGLDJQRVWLFVWUDWHJ\ҋIRUGLDJQRVLQJ%&DXVHV&78DQG )&DVDҊWULDJHWHVWҋIRU5&DQGIROORZXSRSWLRQ3DWLHQWVZLWKSRVLWLYH&78 VFRUHVIRU%&DJRGLUHFWIRU5&DQGQRUPDODQGHTXLYRFDOVFRUHVXQGHUJR)& 'LDJQRVWLFDFFXUDF\LVWKHVDPHDVWKHDGGLWLRQDOWHVWVWUDWHJ\ZLWKWKHDGYDQWDJH RIDUHGXFWLRQRIWKHQXPEHURI)&VSHUIRUPHG 5RRP) %UHDVW 66D 1HZWHFKQRORJLHV 0RGHUDWRUV 33DQL]]D0LODQ,7 (6]DEy6]HJHG+8 % &RQWUDVWHQKDQFHGVSHFWUDOPDPPRJUDSK\YHUVXV05,LQWXPRXU VL]HDVVHVVPHQWLQLWLDOUHVXOWV (0)DOOHQEHUJ0.URKQ-)RHUVWHU+:LHEH-06LQJK)'LHNPDQQ 8%LFN%HUOLQ'(HYDIDOOHQEHUJ#FKDULWHGH 3XUSRVH7 RFRPSDUHFRQWUDVWHQKDQFHGVSHFWUDOPDPPRJUDSK\&(60WRPDP PRJUDSK\0;DQG05,LQGHWHFWLRQDQGVL]HHVWLPDWLRQRIKLVWRORJLFDOO\SURYHQ EUHDVWFDQFHUVXVLQJSRVWRSHUDWLYHKLVWRORJ\DVJROGVWDQGDUG 0HWKRGVDQG0DWHULDOV7KHVWXG\ZDVDSSURYHGE\KHDOWKDXWKRULWLHVDQGLQVWL WXWLRQDOUHYLHZERDUGDQGDOOSDWLHQWVHQUROOHGSURYLGHGZULWWHQLQIRUPHGFRQVHQW $OOH[DPLQDWLRQVDQGÀQDOKLVWRORJLFDOUHVXOWVZHUHDYDLODEOHIRUSDWLHQWV&(60 H[DPLQDWLRQVZHUHELODWHUDOFUDQLRFDXGDODQGPHGLRODWHUDOYLHZVZLWKH[SRVXUHV VWDUWLQJPLQXWHVDIWHU,9LQMHFWLRQRIPOLRGLQDWHGFRQWUDVWDJHQWSHUNJRI ERG\ZHLJKWZLWKDÁRZRIPOVHF05,ZDVSHUIRUPHGXVLQJD7V\VWHPDQGD GHGLFDWHGFKDQQHOEUHDVWFRLO'\QDPLF'7ZHLJKWHGJUDGLHQWHFKRVHTXHQFHV ZHUHDFTXLUHGEHIRUHDQGDIWHULQMHFWLRQRIPPRONJ%:JDGROLQLXPFRQWUDVW DJHQW05,0;DQG&(60LPDJHVZHUHUHDGE\WZRLQGHSHQGHQWUDGLRORJLVWV 5HVXOWV7KHWXPRXUZDVYLVLEOHLQ0;&(60DQG05,H[DPLQDWLRQV :KHQ YLVLEOH WKH DYHUDJH OHVLRQ VL]H ODUJHVW GLPHQVLRQ ZDV PP 6' LQ0;PP6'LQ&(60DQGPP6'LQ05,YHUVXV PP 6' IURP SRVWRSHUDWLYH KLVWRORJ\ %UHDVW GHQVLW\FODVVHV ZHUH $&5 $&5 $&5 $&5 'LIIHUHQFH LQ OHVLRQ VL]H PHDVXUHPHQWV ZDVVLJQLÀFDQWEHWZHHQ&(60DQG0;S DQGQRWVLJQLÀFDQWEHWZHHQ &(60DQG05,S &RQFOXVLRQ&(60VKRZHGDEHWWHUOHVLRQGHWHFWLRQDQGVL]HHVWLPDWLRQFRP SDUHG WR PDPPRJUDSK\ ,QLWLDO UHVXOWV VKRZHG QR GLIIHUHQFH EHWZHHQ &(60 DQG05,LQWXPRXUGHWHFWLRQDQGVL]HDVVHVVPHQWERWKLQJRRGFRUUHODWLRQZLWK SRVWRSHUDWLYHKLVWRORJ\ 6FLHQWLILF6HVVLRQ 6 &$' ( ) *+% (XURSHDQ&RQJUHVVRI 5DGLRORJ\ WRPVE\HODVWLFLW\7KHUHVXOWVDUHVLPLODUWRXOWUDVRXQGHODVWRJUDSK\DQGWRWKH JROGVWDQGDUGUKHRPHWU\7KLVWHFKQLTXHPD\LQIXWXUHEHXVHIXOIRUDVVHVVLQJ HODVWLFLW\RIEUHDVWOHVLRQV,QLWLDOUHVXOWVIURPFOLQLFDOH[SHULPHQWVDSSHDUSURPLV LQJH[DPSOHVZLOOEHVKRZQ % )XQFWLRQDOLQIUDUHGLPDJLQJRIWKHEUHDVWDXWRPDWLFEUHDVWFDQFHU GHWHFWLRQXVLQJPXOWLSDUDPHWULFFRPSXWHUDQDO\VLV 06NODLU/HY\ 7 6HOOD0&RKHQ05RVLQ7 $OOZHLV 06KDSLUR(/LEVRQ',]KDN\5DPDW*DQ,/-HUXVDOHP,/ 3HWDFK7LTYD,/7 HO$YLY,/5HKRYRW,/.IDU6DYD,/$LU3RUW&LW\,/ 0LUL6NODLU/HY\#VKHEDKHDOWKJRYLO 3XUSRVH$QRYHOSURWRW\SHV\VWHPSHUIRUPLQJIXQFWLRQDOWKUHHGLPHQVLRQDO' LQIUDUHGLPDJLQJ587+FRXSOHGZLWKPXOWLSDUDPHWULFFRPSXWHUDQDO\VLV0,5$ ZDVHYDOXDWHGIRUQRQLQYDVLYHGHWHFWLRQRIEUHDVWFDQFHU7KHWHFKQLTXHXWLOL]HV QRQLRQLVLQJUDGLDWLRQDQGDXWRPDWLFDOO\SURYLGHVULVNDVVHVVPHQWEDVHGRQSD UDPHWHUVGHULYHGIURPDFOLQLFDOO\NQRZQWUDLQLQJVHW 0HWKRGVDQG0DWHULDOV)ROORZLQJ,5%DSSURYDODSURVSHFWLYHPXOWLFHQWUHWZR DUPHGEOLQGHGVWXG\ZDVSHUIRUPHGRQZRPHQZKLFKLQFOXGHGSDWLHQWV ZLWKKLVWRORJLFDOO\SURYHQEUHDVWFDQFHUDQGZRPHQZLWKDQRUPDO%,5$'6 PDPPRJUDP 587+ LPDJLQJ 5HDO ,PDJLQJ /WG ,VUDHO ZDV DFTXLUHG RQ D FRQWLQXRXVWHPSRUDOWLPHOLQHIRUPLQXWHDW+]$FTXLUHGGDWDZHUHDQDO\VHG XVLQJPXOWLSOHFRPSXWHGDOJRULWKPV0,5$ZKLFKZHUHFRPELQHGWRGHYHORSD PDVWHUDOJRULWKPIRUULVNDVVHVVPHQWRIEUHDVWFDQFHU$QDO\VLVZDVEOLQGHGWR WKHSDWKRORJLFDOGLDJQRVLVDQGPDPPRJUDSK\3HUIRUPDQFHZDVHYDOXDWHGXVLQJ 52&DQDO\VLV 5HVXOWV)LIW\HLJKWRIFDQFHUVZHUHLGHQWLÀHGXVLQJWKLVWHFKQRORJ\ 7KHVHQVLWLYLW\DQGVSHFLÀFLW\RI587+LPDJHUFRXSOHGZLWK0,5$IRUGHWHFWLQJ EUHDVWFDQFHUZHUHDQGUHVSHFWLYHO\52& $8&ZDV'HWHFWHG WXPRXUVUDQJHGPPPPPHDQPPLQVL]H &RQFOXVLRQ7KLVSUHOLPLQDU\VWXG\VKRZVKLJKVHQVLWLYLW\DQGVSHFLÀFLW\RIWKH QRYHOWHFKQRORJ\H[DPLQHGIRUGHWHFWLQJEUHDVWFDQFHU3HUIRUPDQFHZDVEHWWHU WKDQWKHSXEOLVKHGVHQVLWLYLW\RIPDPPRJUDSK\DQGFRPSDUDEOHWRWKHUHSRUWHG SHUIRUPDQFHRIQHZDGMXQFWLYHEUHDVWLPDJLQJWHFKQRORJLHV2XUUHVXOWVZDUUDQW IXUWKHUHYDOXDWLRQRIWKH587+LPDJHULQGHWHFWLQJDQGFKDUDFWHULVLQJEUHDVWFDQFHU % 0ROHFXODUEUHDVWLPDJLQJ0%,GRVHORZHUHGWRPDWFK PDPPRJUDSK\SRWHQWLDOIRUVFUHHQLQJGHQVHEUHDVWV -:+XJJ 0.2ҋ&RQQRU&%+UXVND$/:HLQPDQQ$/&RQQHUV '-5KRGHV) 3 'L)LOLSSR%(3DWW1RUWKULGJH&$86 5RFKHVWHU0186&OHYHODQG2+86MDPHVKXJJ#JDPPDPHGLFDFRP 3XUSRVH0ROHFXODUEUHDVWLPDJLQJ0%,XVHVVLQJOHJDPPDSKRWRQVWRYLVXDOLVH EUHDVWWXPRXUVWKDWDUHRIWHQRFFXOWRQPDPPRJUDSK\RIUDGLRJUDSKLFDOO\GHQVH EUHDVWV2XUSXUSRVHZDVWRUHGXFHWKH0%,GRVHDQGHYDOXDWHLWVSRWHQWLDOIRU IXWXUHVFUHHQLQJRIZRPHQZLWKGHQVHEUHDVWV 0HWKRGV DQG 0DWHULDOV :H RSWLPLVHG WKH LPDJLQJ SK\VLFV IRU WKH /XPD*(0 0%,VFDQQHU*DPPD0HGLFDWKDWXVHVWZRGHWHFWRUKHDGVZLWKSL[HOODWHG&=7 JDPPDGHWHFWRUVZLWKPPVTXDUHSL[HOV:HGHVLJQHGDORZGRVHFROOLPDWRU ZLWK WXQJVWHQ VHSWD DQG VTXDUH KROHV WKDW PDWFK WKH &=7 GHWHFWRU SL[HOV :H GHYHORSHGZLWKDEUHDVWOHVLRQSKDQWRPWKDWIDFLOLWDWHVPHDVXUHPHQWRIFRQWUDVW UHFRYHU\FXUYHVXVHIXOIRUFRPSDULVRQRIYDULRXV0%,V\VWHPVDQGIRUSUHGLFWLQJ OHVLRQGHWHFWDELOLW\ 5HVXOWV,QFOLQLFDOWULDOVDW0D\R&OLQLFZHKDYHGHPRQVWUDWHGORZGRVH0%,ZLWK P7 F6HVWDPLELDWDZKROHERG\GRVHHTXLYDOHQWWRVFUHHQLQJPDPPRJUDSK\ :HDUHFRQGXFWLQJDFOLQLFDOWULDOWRHYDOXDWH0%,VFUHHQLQJRIDERXWZRPHQ ZLWKGHQVHEUHDVWV0%,KDVSURYHQIDUPRUHVHQVLWLYHDQGVSHFLÀFDWGHWHFWLQJ ELRSV\SURYHQFDQFHUVWKDQPDPPRJUDSK\LQGHQVHEUHDVWV7KHEUHDVWOHVLRQ SKDQWRPGHPRQVWUDWHVWKDWRXUPPSL[HOVL]HLVRSWLPDOIRU0%,HQDEOLQJWKH ORZHVWGRVHFRPSDUHGWRV\VWHPVXVLQJPPRUPPSL[HOV &RQFOXVLRQ'RVHKDVEHHQHIIHFWLYHO\PLWLJDWHGDVDQREVWDFOHWR0%,VFUHHQLQJ RIUDGLRJUDSKLFDOO\GHQVHEUHDVWV $QRQJRLQJFOLQLFDOWULDOVXJJHVWVWKDW0%,FRXOG EHDYHU\HIIHFWLYHVFUHHQLQJWRROLQWKHGHQVHEUHDVWSRSXODWLRQXSWRRI (XURSHDQDQG$PHULFDQZRPHQPRUHWKDQRI$VLDQZRPHQ FRQWURO$(&VHWWLQJVZHUHPRGLÀHGGRVLPHWU\SURYHGDGRVHUHGXFWLRQRI $FFRUGLQJWRWKH$&5%UHDVW,PDJLQJ5HSRUWLQJDQG'DWD6\VWHP%,5$'6WKH PDPPRJUDPVZHUHFDWHJRU\EUHDVWWLVVXHGHQVLW\ZDV$&5OHYHO7KH PDPPRJUDPVZHUHUHDGWZLFHE\H[SHULHQFHGUDGLRORJLVWVZLWKDSRLQWVFRUH RQ GLDJQRVWLF LPDJH TXDOLW\ DQG WKH YLVXDOLVDWLRQ RI SDUHQFK\PD FXWLV EHQLJQ OHVLRQVDVZHOODVFDOFLÀFDWLRQV 5HVXOWV1,3FRPSDUHGWR3,3DWVWDQGDUGGRVHVKRZHGDEHWWHURYHUDOOLPDJH TXDOLW\DW$&5ZKLFKZDVVLJQLÀFDQWO\EHWWHUDW$&5S$W$&5 LPDJHTXDOLW\ZDVVLPLODUZLWKVWDQGDUGDQGUHGXFHGGRVHRQ1,3DQG3,3 :LWK GRVHUHGXFWLRQZHIRXQGQRVLJQLÀFDQWORVVRILPDJHTXDOLW\ZLWKLQWKH1,3 H[DPLQDWLRQV 7KH UHDGLQJ VKRZHG D JRRG LQWUD DQG LQWHUREVHUYHU DJUHHPHQW U &RQFOXVLRQ:LWKWKHQHZQHHGOHEDVHGLPDJLQJSODWH1,3WHFKQRORJ\LQGLJLWDO PDPPRJUDSK\GRVHUHGXFWLRQRILVSRVVLEOHZLWKRXWORVVRIGLDJQRVWLFLP DJHTXDOLW\ % 0DPPRJUDSKLFWH[WXUHUHVHPEODQFHJHQHUDOLVHVDVDQLQGHSHQGHQW ULVNIDFWRURIEUHDVWFDQFHU .&KHUQRII 6&KULVWRSKHU*.DUHPRUH1.DUVVHPHLMHU&9DFKRQ 01LHOVHQ&RSHQKDJHQ'.5RFKHVWHU01861LMPHJHQ1/ 3XUSRVH%UHDVWGHQVLW\LVDQHVWDEOLVKHGULVNIDFWRURIEUHDVWFDQFHU0DPPR JUDSKLFWH[WXUHUHVHPEODQFH075ZDVVKRZQWREHDGHQVLW\LQGHSHQGHQWULVN IDFWRUEXWRQO\RQDVLQJOHVWXG\:HVKRZWKDW075JHQHUDOLVHVDFURVVGLIIHUHQW FRKRUWV 0HWKRGVDQG0DWHULDOV075ZDVFRPSXWHGIURPGLJLWDOLVHGPDPPRJUDPVRID \HDUSURVSHFWLYHVWXG\6'XWFKVFUHHQLQJSURJUDPFDQFHUVPDWFKHG FRQWUROVFDQFHUVZHUHDVFHUWDLQHG\HDUVSULRUWRGLDJQRVLVDQGIURPDQ LQGHSHQGHQWFRKRUWVWXG\60D\R0DPPRJUDSK\+HDOWK6WXG\FRKRUW FDQFHUDJHPDWFKHGFRQWUROV0DPPRJUDSKLFSHUFHQWDJHGHQVLW\3'DQGRWKHU PDMRUULVNIDFWRUVZHUHDVFHUWDLQHGLQ6)LQDOO\6ZDV075VFRUHGEDVHGRQ WH[WXUHVIURP6DQG6LQDOHDYHWZRRXWIDVKLRQ6FRUHVRQ6ZHUHUHODWHGWR IXWXUHEUHDVWFDQFHULQFLGHQFHE\DQDO\VLQJ$8&DQGTXDUWLOHVDGMXVWHGIRU%0, PHQRSDXVHVWDWXVDQGSRVWPHQRSDXVDOKRUPRQH30+XVH 5HVXOWV075VFRUHVRQ6VKRZHGDVLJQLÀFDQWFDSDELOLW\WRVHSDUDWHFDQFHUV IURPFRQWUROV$8& S$JHRI6DQG6ZDVDQG \HDUVUHVSHFWLYHO\'LIIHUHQFHVLQ%0,PHQRSDXVHVWDWXVDQG30+ EHWZHHQFDVHVDQGPDWFKHGFRQWUROVLQ6ZHUHLQVLJQLÀFDQW6VKRZHGDQ $8& RIDQGEDVHGRQSHUFHQWDJHGHQVLW\075VFRUHVWUDLQHGRQ6 DQG6UHVSHFWLYHO\ $GMXVWHGIRU3'075VFRUHVRI6WUDLQHGRQ6VKRZHG25 LQTXDUWLOHVRIUHIUHVSHFWLYHO\ DQGDFRPELQHG$8&RI &RQFOXVLRQ7KHKHWHURJHQHLWLHVWKDWFKDUDFWHULVHGEUHDVWFDQFHUULVNLQ6ZHUH DOVRGHQVLW\LQGHSHQGHQWULVNIDFWRUVLQ6+HQFHWKH075SUHGLFWHGULVNSHUVLVWHG XQGHUGLIIHUHQFHVLQ[UD\WHFKQRORJ\SRSXODWLRQGHPRJUDSKLFVDQGJHRJUDSK\ % 7RPRV\QWKHVLVHODVWRJUDSK\HYDOXDWLRQRIDQRYHOHODVWRJUDSK\ WHFKQLTXHRQVLPXODWHGWXPRXUVLQEUHDVWPLPLFNLQJSKDQWRPV ) (QJHONHQ,6DFN'.ODWW7 )LVFKHU()DOOHQEHUJ) 'LHNPDQQ %HUOLQ'(ÁRULDQHQJHONHQ#FKDULWHGH 3XUSRVH7 RHYDOXDWHZKHWKHUPHDVXUHPHQWRIVWUDLQXQGHUVWDWLFFRPSUHVVLRQLQ WRPRV\QWKHVLVRIEUHDVWPLPLFNLQJSKDQWRPVFDQEHXVHGWRGLVWLQJXLVKWXPRXU VLPXODWLQJLQFOXVLRQVRIGLIIHUHQWHODVWLFLWLHV7 RFRPSDUHWKHUHVXOWVRIWKLVWHFKQLTXH WRXOWUDVRXQGHODVWRJUDSK\DVZHOODVYDOXHVSUHGLFWHGE\UKHRPHWULFDQDO\VLV 0HWKRGV DQG 0DWHULDOV :H SUHSDUHG WKUHH VRIW EUHDVWPLPLFNLQJ SKDQWRPV FRQWDLQLQJVLPXODWHGWXPRXUVRIGLIIHUHQWHODVWLFLWLHVYDU\LQJZLWKLQDUDQJHW\SLFDO IRUEHQLJQDQGPDOLJQDQWOHVLRQV7KHSKDQWRPVZHUHLPDJHGXVLQJDZLGHDQJOH WRPRV\QWKHVLVV\VWHPZLWKFRPSUHVVLRQVHWWLQJVUDQJLQJIURP11LQVWHSV RI16WUDLQRIWKHLQFOXVLRQVZDVPHDVXUHGLQWZRSODQHV8OWUDVRXQGHODVWRJ UDSK\RIWKHLQFOXVLRQVZDVSHUIRUPHGXVLQJWZRGLIIHUHQWXOWUDVRXQGHODVWRJUDSK\ DOJRULWKPV ,Q D VHSDUDWH H[SHULPHQW WKH HODVWLFLW\ RI WKH SKDQWRP PDWUL[ DQG LQFOXVLRQPDWHULDOZDVGHWHUPLQHGE\UKHRPHWU\ 5HVXOWV7KHPHDQVWUDLQUDWLRVREWDLQHGIRUWKHVRIWLQWHUPHGLDWHDQGÀUPLQFOX VLRQVZHUHDQGUHVSHFWLYHO\IRUWRPRV\QWKHVLV HODVWRJUDSK\DQGUHVSHFWLYHO\IRUXOWUDVRXQGWLVVXHVWUDLQLPDJ LQJDQGDQGUHVSHFWLYHO\IRUXOWUDVRXQGUHDOWLPHHODVWRJUDSK\ 7KH VWUDLQ UDWLRV SUHGLFWHG E\ UKHRPHWU\ ZHUH DQG IRU WKH VRIW LQWHUPHGLDWHDQGÀUPLQFOXVLRQVUHVSHFWLYHO\ &RQFOXVLRQ 7 RPRV\QWKHVLV HODVWRJUDSK\ LV D QRYHO HODVWRJUDSK\ PHWKRG WKDW DOORZV GLIIHUHQWLDWLRQ RI WXPRXUVLPXODWLQJ LQFOXVLRQV LQ EUHDVWPLPLFNLQJ SKDQ 6FLHQWLILF6HVVLRQ $ 6&'()*+% 7KXUVGD\ (XURSHDQ&RQJUHVVRI 5DGLRORJ\ 5RRP*+ %UHDVW 66E 05,FRQWUDVWPHGLDDQGFOLQLFDODSSOLFDWLRQV 0RGHUDWRUV 500DQQ1LMPHJHQ1/ -/5D\D3RYHGDQR&yUGRED(6 % ,QÁXHQFHRIEUHDVWSDUHQFK\PDGHQVLW\RQPDOLJQDQWOHVLRQ GHWHFWLRQZLWKJDGREHQDWHGLPHJOXPLQHHQKDQFHG05,FRPSDUHGWR JDGRSHQWHWDWHGLPHJOXPLQHHQKDQFHG05,PDPPRJUDSK\DQGXOWUDVRXQG ) -*LOEHUW +&YDQGHQ%RVFK$3HWULOOR.6LHJPDQQ-7 +HYHUKDJHQ 6&RUFLRQH0)DLYUH3LHUUHW&0=HFKPDQQ/0DUWLQFLFK$EHUGHHQ8. (LQGKRYHQ1/1DSOHV,77ELQJHQ'(0DUEXUJ'()HUUDUD,7/LOOH)5 +HLGHOEHUJ'(&DQGLROR,7IMJLOEHUW#DEGQDFXN 3XUSRVH7 RGHWHUPLQHWKHLQÁXHQFHRIEUHDVWSDUHQFK\PDGHQVLW\RQPDOLJQDQW OHVLRQGHWHFWLRQLQSDWLHQWVXQGHUJRLQJJDGREHQDWHGLPHJOXPLQHHQKDQFHG05, JDGRSHQWHWDWHGLPHJOXPLQHHQKDQFHG05,PDPPRJUDSK\DQGXOWUDVRXQG 0HWKRGVDQG0DWHULDOV2QHKXQGUHGDQGHLJKWZRPHQ\HDUVWKDW XQGHUZHQWPDPPRJUDSK\DQGZKRKDG%,5$'6ÀQGLQJVRQPDPPRJUDSK\ DQGRUXOWUDVRXQGXQGHUZHQWWZRLGHQWLFDOEUHDVW05,H[DPVLQUDQGRPLVHGRUGHU RQHZLWKJDGREHQDWHGLPHJOXPLQHDQGWKHRWKHUZLWKJDGRSHQWHWDWHGLPHJOXPLQH HDFKDWDGRVHRIPPRONJ%:05,ZDVSHUIRUPHGDW7XVLQJ7ZDQG' VSRLOHG7Z*5(VHTXHQFHVZLWKDWHPSRUDOUHVROXWLRQRIPLQ,PDJHVZHUH HYDOXDWHGLQGHSHQGHQWO\E\WKUHHXQDIÀOLDWHGEOLQGHGUDGLRORJLVWVIRUFDQFHUGHWHF WLRQ,PDJLQJÀQGLQJVZHUHPDWFKHGZLWKKLVWRORJ\GDWDE\DIRXUWKLQGHSHQGHQW EOLQGHGUDGLRORJLVW0DOLJQDQWOHVLRQGHWHFWLRQUDWHVZHUHFRPSDUHG0F1HPDU V WHVWDFURVVGLIIHUHQWFDWHJRULHVRIEUHDVWWLVVXHGHQVLW\ 5HVXOWVPDOLJQDQWOHVLRQVZHUHFRQÀUPHGDWKLVWRORJ\LQSDWLHQWVXQGHUJR LQJ 05, DQG PDPPRJUDSK\XOWUDVRXQG ,Q SUHGRPLQDQWO\ IDWW\ EUHDVWV JODQGXODUHDFKUHDGHUGHWHFWHGPDOLJQDQWOHVLRQVRQJDGREHQDWH GLPHJOXPLQHHQKDQFHG 05, FRPSDUHG ZLWK OHVLRQV RQ JDGRSHQWHWDWHGLPHJOXPLQHHQKDQFHG05,DQGOHVLRQVRQPDP PRJUDSK\XOWUDVRXQG ,Q KHWHURJHQHRXVO\ GHQVH DQG H[WUHPHO\ GHQVH EUHDVWV !JODQGXODUWKHWKUHHUHDGHUVGHWHFWHGPDOLJQDQW OHVLRQVRQJDGREHQDWHGLPHJOXPLQHHQKDQFHG05,FRPSDUHGZLWK OHVLRQVRQJDGRSHQWHWDWHGLPHJOXPLQHHQKDQFHG05,DQG OHVLRQVRQPDPPRJUDSK\XOWUDVRXQG*DGREHQDWHGLPHJOXPLQHHQKDQFHG05, ZDVVLJQLÀFDQWO\SVXSHULRUIRUPDOLJQDQWOHVLRQGHWHFWLRQSDUWLFXODUO\LQ KHWHURJHQHRXVO\GHQVHEUHDVWV &RQFOXVLRQ*DGREHQDWHGLPHJOXPLQHHQKDQFHGEUHDVW05,SHUPLWVVLJQLÀFDQWO\ LPSURYHGFDQFHUQRGXOHGHWHFWLRQUHJDUGOHVVRIEUHDVWWLVVXHGHQVLW\ % ,QWUDLQGLYLGXDOUDQGRPLVHGFRPSDULVRQRIWKH05,FRQWUDVWDJHQWV *DGRYLVWYHUVXV0XOWL+DQFHIRUSUHRSHUDWLYHEUHDVW05 LPDJLQJHYDOXDWHGLQDEOLQGHGUHDG ) 3HGLFRQL 5.XELN%&KLOOD&6FKZHQNH..LQNHO5RPH,7 %DGHQ&+%HUOLQ'(&KrQH%RXJHULHV&+NDUHQNLQNHOWUXJOL#ZDQDGRRIU 3XUSRVH7 RLQWUDLQGLYLGXDOO\FRPSDUHPPRONJ*DGRYLVWJDGREXWURO DQG0XOWL+DQFHJDGREHQDWHE\SURVSHFWLYHO\HYDOXDWLQJWKHDJUHHPHQWUDWH LQEUHDVWOHVLRQGHWHFWLRQDQGFKDUDFWHULVDWLRQDWFRQWUDVWHQKDQFHGEUHDVW05 0HWKRGVDQG0DWHULDOV7ZREUHDVW05,VZHUHSHUIRUPHGIRUVWDJLQJLQSDWLHQWV ZLWKELRSV\SURYHQEUHDVWFDQFHUZLWKDQLQWHUYDORIKRXUVDQGGD\VEHWZHHQ WKHH[DPLQDWLRQV0*DGRYLVWRU00XOWL+DQFHZDVDGPLQLVWHUHGLQ DUDQGRPLVHGRUGHU/HVLRQGHWHFWLRQDQGFKDUDFWHULVDWLRQZDVSHUIRUPHGE\WZR LQGHSHQGHQWEOLQGHGUHDGHUV/HVLRQWUDFNLQJFRPSDUHGWRRQVLWHUHDGLQJVDQG WRKLVWRORJ\IURPVXUJHU\RUELRSV\ZDVSHUIRUPHGE\DWKLUGUHDGHU'LIIHUHQFHV LQOHVLRQGHWHFWLRQIRUWKHNQRZQFDQFHUDQGIRUDOOOHVLRQVZLWKSDWKRORJ\OHVLRQ FKDUDFWHULVDWLRQ DQG EDFNJURXQG HQKDQFHPHQW LQ ERWK EUHDVWV ZHUH FRPSDUHG EHWZHHQWKHWZRFRQWUDVWDJHQWV 5HVXOWV$PRQJOHVLRQVKDGSDWKRORJ\PDOLJQDQWEHQLJQ7KH DJUHHPHQWUDWHIRUOHVLRQGHWHFWLRQE\WKHEOLQGHGUHDGHUVVKRZHGQRGLIIHUHQFH EHWZHHQERWKFRQWUDVWDJHQWVIRUWKHLQGH[OHVLRQDQGDOOOHVLRQV IRU*DGRYLVWIRU00XOWL+DQFH6HQVLWLYLW\LQOHVLRQFKDUDFWHULVD WLRQDFURVVUHDGHUVVKRZHGQRGLIIHUHQFHEHWZHHQ*DGRYLVWDQG 0XOWL+DQFH7KHUHZDVQRGLIIHUHQFHEHWZHHQFRQWUDVWDJHQWVLQWKH % 1RQLQYDVLYHGLIIHUHQWLDWLRQRIVPDOOEUHDVWOHVLRQVYLD'07LPDJLQJ *=RJUDIRV'.RXORFKHUL3 /LDNRX3 *ULJRURSRXORV06RIUDV 6+DGMLDJDSLV90DUPDUHOLV$WKHQV*5/RV$QJHOHV&$86 PDUPDUHOLV#KRWPDLOFRP 3XUSRVH7KH'QRQLRQLVLQJGLDJQRVWLFLPDJLQJWHFKQRORJ\RIPXOWLPRGDOWRP RJUDSK\07ZDVLQWURGXFHGLQ(&507ZDVUHFHQWO\VKRZQWRGLIIHUHQWLDWH EUHDVWOHVLRQVGRZQWRPPLQVL]HLQ%,5$'6YROXQWHHUV 0HWKRGV DQG 0DWHULDOV 7KH 07 FOLQLFDO SURWRW\SH SHUIRUPV ' WRPRJUDSKLF VFDQ RI WKH SHQGXODQW EUHDVW LQ ZDWHUEDWK XVLQJ WUDQVPLVVLRQ XOWUDVRXQG LQ D À[HGFRRUGLQDWHV\VWHP'HVLJQGHWDLOVZHUHSUHVHQWHGLQWKH(,%,5:RUNVKRS RI(&507UHFRQVWUXFWVPXOWLSOHLPDJHVIRUHDFKFRURQDOVOLFHXVLQJPHDV XUHPHQWVRIUHIUDFWLYLW\DQGIUHTXHQF\GHSHQGHQWDWWHQXDWLRQDQGGLVSHUVLRQ07 GHWHFWVDQGGLIIHUHQWLDWHVOHVLRQVXVLQJIXVLRQRIWKHVHPXOWLPRGDOLPDJHV7KLV \HDU07UHVXOWVIURP%,5$'6IHPDOHYROXQWHHUVDJHVDYHUDJH \HDUVZHUHFRPSDUHGZLWKKLVWRSDWKRORJ\UHVXOWVIURPELRSV\RIWKHVXVSLFLRXV OHVLRQVVL]HVPPDYHUDJHPPWDNHQE\PLQLPDOO\LQYDVLYHFRUHELRSV\ )1$)LVFKHU0DPPRWRPHDQG%/(67KHK\SRWKHVLVWKDW07FDQGHWHFWDQG FODVVLI\FRUUHFWO\PDOLJQDQWOHVLRQVGRZQWRPPLQVL]HZDVWHVWHG 5HVXOWV07GHWHFWHGDQGFRUUHFWO\FODVVLÀHGRXWRIPDOLJQDQWOHVLRQV VHQVLWLYLW\LQWKHELRSV\VDPSOHV$PRQJWKHGHWHFWHGPDOLJQDQWOHVLRQV KDGPD[LPXPGLPHQVLRQ PPPRVWO\'&,67KHVPDOOHVWGHWHFWHG PDOLJQDQWOHVLRQV'&,6KDGPD[LPXPGLPHQVLRQRIPP7KHUHZDVRQO\RQH IDOVHSRVLWLYH07UHVXOWLQWKHELRSVLHGOHVLRQVVSHFLÀFLW\ &RQFOXVLRQ,QLWLDOFOLQLFDOUHVXOWVFRQÀUPHGWKHDELOLW\RI07WHFKQRORJ\WRGHWHFW DQGFODVVLI\EUHDVWOHVLRQVGRZQWRPPLQVL]HDPRQJ%,5$'6IHPDOH YROXQWHHUVZLWKVHQVLWLYLW\DQGVSHFLÀFLW\ % )XVLRQRI86DQG)'*3(7&7LPDJHIRUHYDOXDWLRQRIORFRUHJLRQDO UHFXUUHQFHRIEUHDVWFDQFHUXVLQJUHDOWLPHYLUWXDOVRQRJUDSK\ 596ÀUVWH[SHULHQFH 61DNDQR.)XMLL.<RUR]X\D0<RVKLGD-.RXVDND< 6KLRPL 7 )XNXWRPL7 ,VKLJXFKL2$UDL$LFKLJXQ-3VQDNDQR #DLFKLPHGXDFMS 3XUSRVH)ÁXRURGHR[\JOXFRVH)'*SRVLWURQHPLVVLRQWRPRJUDSK\&73(7 &7LVPRUHVHQVLWLYHWKDQFRQYHQWLRQDOLPDJLQJLQGHWHFWLQJPHWDVWDWLFRUUHFXU UHQWGLVHDVHRIWKHEUHDVW:KHQLQFLGHQWDO)'*XSWDNHZLWKKLJKVWDQGDUGXSWDNH YDOXH 689 LV GHWHFWHG LQ ORFRUHJLRQDO OHVLRQ E\ )'*3(7&7 VRQRJUDSKLF FRQÀUPDWLRQQHHGVWREHGRQHLPPHGLDWHO\:HUHFHQWO\GHYHORSHGDUHDOWLPH YLUWXDOVRQRJUDSK\596V\VWHPWKDWHQDEOHVVLPXOWDQHRXVGLVSOD\RIERWKD86 DQGWKH&7LPDJHVRIWKHVDPHVLWHLQUHDOWLPHXVLQJPDJQHWLFSRVLWLRQWUDFNLQJ V\VWHP7KHDLPRIWKLVVWXG\ZDVWRHYDOXDWHWKHUROHRI596LQWKHVRQRJUDSKLF ORFDOLVDWLRQRI)'*DFWLYLW\ 0HWKRGV DQG 0DWHULDOV %HWZHHQ 0DUFK DQG -XQH ZH SHUIRUPHG )'*3(7&7IRUVXVSHFWHGUHFXUUHQWEUHDVWFDQFHULQSDWLHQWV7KHVRQRJUDSKLF GHWHFWLRQUDWHZDVGHWHUPLQHGIRU)'*XSWDNHLQORFRUHJLRQDOUHFXUUHQFHZLWK RUZLWKRXW596 5HVXOWV2IWKHSDWLHQWVDWRWDORI)'*XSWDNHOHVLRQVLQVHYHQSDWLHQWVZHUH GHWHFWHGDVORFRUHJLRQDOUHFXUUHQFH7KHPHGLDQWXPRXUVL]HZDVPPUDQJH PP2IWKHOHVLRQVFRXOGEHLGHQWLÀHGLQWDUJHWHG86ZLWKRXW 596EXWZHUHLGHQWLÀHGLQWDUJHWHG86ZLWK596S 7KH596 ZDVDEOHWRFRUUHFWO\SURMHFW)'*XSWDNHLQIRUPDWLRQRQWRDERG\VXUIDFHZLWKRXW RSHUDWRUҋVVNLOODVZHFKHFNHGVRQRJUDSK\IRUPLPDJHV &RQFOXVLRQ2XUUHVXOWVVXJJHVWWKDW596FDQVRQRJUDSKLFDOO\LGHQWLI\)'*XSWDNH OHVLRQVZLWKH[FHOOHQWDFFXUDF\ 6FLHQWLILF6HVVLRQ 6 &$' ( ) *+% (XURSHDQ&RQJUHVVRI 5DGLRORJ\ % ,PSDFWRI7VWDJHRQOHVLRQFKDUDFWHULVWLFVDQGRYHUDOOGLDJQRVWLF DFFXUDF\RIEUHDVW05,GRHVVL]HUHDOO\PDWWHU" 0'LHW]HO+3 %XUPHLVWHU5=RXEL7 *URHVFKHO 05*DMGD,%5XQQHEDXP:$.DLVHU3 $7 %DOW]HU -HQD'(GLHW]HOPDWWKLDV #KRWPDLOFRP 3XUSRVH+LVWRSDWKRORJLFDOFKDUDFWHULVWLFVRIEUHDVWWXPRXUVFKDQJHGXULQJWKHLU FRXUVHRIJURZWK+RZHYHULQUDGLRORJLFDOSUDFWLFHOHVLRQFKDUDFWHULVWLFVDUHDS SOLHGLUUHVSHFWLYHRIWXPRXUVWDJH:HDLPHGWRLGHQWLI\PRUSKRORJLFDQGG\QDPLF SURÀOHVRIEUHDVWWXPRXUVLQFRUUHODWLRQWRWKH76WDJHDQGWRHYDOXDWHWKHLPSDFW RQRYHUDOOGLDJQRVWLFDFFXUDF\RIEUHDVW05,E05, 0HWKRGVDQG0DWHULDOV%DVLVRIWKLVLQYHVWLJDWLRQZDVDFURVVVHFWLRQDOGDWDEDVH RIFRQVHFXWLYHKLVWRORJLFDOO\YHULÀHGEUHDVWOHVLRQVLPDJHGE\E05,VWDQGDUGLVHG SURWRFROVHWKLFDOERDUGDSSURYDO $OOOHVLRQVZHUHSURVSHFWLYHO\HYDOXDWHGE\WZR UDGLRORJLVWLQFRQVHQVXV!E05,H[DPVXVLQJVWDQGDUGLVHGPRUSKRORJL FDODQGG\QDPLFGHVFULSWRUV$FFRUGLQJWRWKH710V\VWHPVVL]HRIHDFKOHVLRQ ZDVFDWHJRULVHGDV,FPQ,,FPQDQG,,,FPQ 6WDWLVWLFVDGGUHVVHGDFFXUDF\RILQGLYLGXDOGHVFULSWRUVLQDVVRFLDWLRQZLWKHDFKVL]H VXEJURXSFRQWLQJHQF\WDEOHV&KLVTXDUHWHVWV7KHQGHVFULSWRUVZHUHFRPELQHG LQWRDPXOWLYDULDWHPRGHOWRLGHQWLI\RYHUDOODFFXUDF\RIE05,LQDVVRFLDWLRQZLWK WKH76WDJHORJLVWLFUHJUHVVLRQKLVWRORJ\WDUJHWYDULDEOHEHQLJQYVPDOLJQDQW )LQDOO\UHVXOWVEHWZHHQHDFKVXEJURXSZHUHFRPSDUHG$8&FRPSDULVRQ>DUHD XQGHUWKHUHFHLYHURSHUDWLQJFKDUDFWHULVWLFVFXUYH@ 5HVXOWV 0DMRULW\ RI E05, GHVFULSWRUV ZHUH DVVRFLDWHG ZLWK 76WDJH 3 UHVXOWLQJ LQ GLIIHUHQW DFFXUDF\ RI VXFK IHDWXUHV DFFRUGLQJ WR WXPRXU VL]H7KLVFRQWULEXWHGWRWKHKLJKHUSHUIRUPDQFHRIE05,LQDGYDQFHG76WDJHV,, $8& ,,,$8& FRPSDUHGWRVPDOOHUWXPRXUV,$8& 3 &RQFOXVLRQ 2XU UHVXOWV VXJJHVW WKDW OHVLRQV FKDUDFWHULVWLFV LQ E05, FKDQJH GXULQJWKHWXPRXUVFRXUVHRIJURZWK7KLVFDXVHVFKDUDFWHULVWLFPRUSKRORJLFDQG G\QDPLFSURÀOHVLQFRUUHODWLRQZLWKWKH76WDJHDQGIXUWKHULQFUHDVHVGLDJQRVWLF DFFXUDF\RIE05,LQODUJHUOHVLRQV % %UHDVW05,DQGGXFWDOFDUFLQRPDLQVLWXZKHQFDQZHH[SHFWWR KDYHQRHQKDQFHPHQW" 6'H6WHIDQL&0ROLQDUL3 &ODXVHU$'DO&RO9/RQGHUR5*LURPHWWL &=XLDQL0%D]]RFFKL8GLQH,7VLOYLDGHVWHIDQL #JPDLOFRP 3XUSRVH7 RHYDOXDWHWKHFKDUDFWHULVWLFVRIGXFWDOFDUFLQRPDLQVLWXQRWLGHQWLÀHG RQG\QDPLF05,H[DPLQDWLRQSHUIRUPHGIRUEUHDVWFDQFHUVWDJLQJ 0HWKRGV DQG 0DWHULDOV 7ZR H[SHULHQFHG EUHDVW UDGLRORJLVWV UHWURVSHFWLYHO\ HYDOXDWHGLPDJHVRISDWLHQWVZLWKGXFWDOFDUFLQRPDLQVLWX'&,6KLVWRSDWKRORJL FDOO\SURYHQRQVXUJLFDOVSHFLPHQZKRKDGDOVRSHUIRUPHGDG\QDPLFEUHDVW05, LQYHVWLJDWLRQEHIRUHVXUJHU\LQPRQWKV:HGLYLGHGWKHSDWLHQWVZLWK'&,6LQWR WZRJURXSVGHSHQGLQJRQWKHUHVXOWRIG\QDPLF05,LQYHVWLJDWLRQWKHDEVHQFHRI VXVSLFLRXVFRQWUDVWHQKDQFHPHQWLQFOXGLQJLQWKHODWHSKDVHZDVFRQVLGHUHGWR EHDIDOVHQHJDWLYHH[DPLQDWLRQ7KHSUHVHQFHRIHQKDQFHPHQWZDVFRQVLGHUHG SRVLWLYH)LVKHUH[DFWWHVWVZDVXVHGIRUVWDWLVWLFDODQDO\VLVVWDWLVWLFDOO\VLJQLÀFDQW SYDOXH 5HVXOWV 05, FRUUHFWO\ GHPRQVWUDWHG WKH SUHVHQFH RI '&,6 VHQVLELOLW\ ,QSDWLHQWVQRHQKDQFHPHQWZDVLGHQWLÀHGLQWKHDUHDRIQHRSODVP &',6VPDOOHUWKDQRUHTXDOWRPPRQPDPPRJUDSK\GLGQRWSUHVHQWHQKDQFH PHQW GXULQJ 05, LQYHVWLJDWLRQ PRUH RIWHQ WKDQ WKRVH RYHU PP S 7KH DEVHQFH RI VXVSLFLRXV FRQWUDVW HQKDQFHPHQW DW 05, ZDV PRUHIUHTXHQWO\ DVVRFLDWHGZLWKORZRULQWHUPHGLDWHKLVWRORJLFDOJUDGHFRPSDUHGZLWKKLJKJUDGH S0DPPRJUDSKLFSUHVHQWDWLRQZDVQRWDVLJQLÀFDQWSUHGLFWRURIDEVHQFH RIVXVSLFLRXVFRQWUDVWHQKDQFHPHQWDWEUHDVW05, &RQFOXVLRQ 05, GHPRQVWUDWHG KLJK VHQVLWLYLW\ LQ WKH LGHQWLÀFDWLRQ RI EUHDVW FDQFHUHYHQZLWKRXWLQYDVLYHIHDWXUHV0DOLJQDQWOHVLRQVLQVLWXWKDWGRQRWVKRZ HQKDQFHPHQWDUHPRUHRIWHQVPDOODQGORZJUDGH % 9DOLGDWLRQRI(8620$FULWHULDIRUVHOHFWLQJWR05,SUHRSHUDWLYH VWDJLQJSDWLHQWVHOLJLEOHIRUFRQVHUYDWLYHVXUJHU\DWFRQYHQWLRQDOVWDJLQJ 6&LDWWR'%HUQDUGL03HOOHJULQL7UHQWR,7VWHIDQRFLDWWR#JPDLOFRP 3XUSRVH7 RYHULI\WKHYDOLGLW\RI(8620$FULWHULDSURPSWLQJ05,SUHRSHUDWLYHVWDJ LQJE\PDJQHWLFUHVRQDQFH05,LQVXEMHFWVHOLJLEOHIRUEUHDVWFRQVHUYLQJWKHUDS\ %&7OREXODUKLVWRORJLFDOW\SHVL]HGLVFUHSDQF\!FPEHWZHHQPDPPRJUDSK\ DQGXOWUDVRQRJUDSK\KLJKHUHGRIDPLOLDOULVNDQGSODQQHGSDUWLDOEUHDVWLUUDGLDWLRQ 0HWKRGV DQG 0DWHULDO :H UHYLHZHG DQ XQVHOHFWHG VHULHV RI VXEMHFWV HOLJLEOH IRU%&7DQGFRQVHFXWLYHO\XQGHUJRLQJ05,VWDJLQJDW7UHQWR%UHDVW&OLQLF:H DVVHVVPHQWRI%,5$'VOHVLRQHQKDQFHPHQWFXUYHRUEDFNJURXQGHQKDQFHPHQW 0RUSKRORJ\DVVHVVPHQWGLIIHUHGVLJQLÀFDQWO\EHWZHHQWKHUHDGHUVS DQG ERWKFRQWUDVWDJHQWVS ZLWKPRUHQRQIRFDOHQKDQFHPHQWIRU*DGRYLVW WKDQIRU0XOWL+DQFH &RQFOXVLRQ%RWKFRQWUDVWPHGLDVKRZHGQRGLIIHUHQFHLQEUHDVWOHVLRQVGHWHF WLRQDQGVHQVLWLYLW\LQOHVLRQFKDUDFWHULVDWLRQDWFRQWUDVWHQKDQFHGEUHDVW05, % 'RHVSUHRSHUDWLYH05,LQEUHDVWFDQFHULQFUHDVHWKHUDWHRIPDVWHFWRP\" $*DUFLDODOODQD*9LWHUL,6LPRQ,$QWRQ$(OL]DOGH/3LQD3DPSORQD(6 JYLWHUL#XQDYHV 3XUSRVH7 RHYDOXDWHZKHWKHUSUHRSHUDWLYH05,LQIHPDOHSDWLHQWVGLDJQRVHGZLWK EUHDVWFDQFHULQFUHDVHVWKHUDWHRIPDVWHFWRP\ 0HWKRGVDQG0DWHULDOV7ZRVHULHVRIFRQVHFXWLYHZRPHQVXUJLFDOO\WUHDWHGIRU EUHDVWFDQFHUZHUHUHWURVSHFWLYHO\UHYLHZHG*URXSSDWLHQWVZLWKSUHRSHUD WLYH05,*URXSSDWLHQWVZLWKRXWSUHRSHUDWLYH05,3DWLHQWDJHPHQRSDXVDO VWDWXVWXPRXUVL]HVWDJLQJVXUJLFDOWUHDWPHQWQHRDGMXYDQWFKHPRWKHUDS\DQG UHLQWHUYHQWLRQVGXHWRDIIHFWHGPDUJLQVZHUHHYDOXDWHG6WDWLVWLFDODQDO\VLVZDV SHUIRUPHGZLWK6WXGHQWҋVWDQG&KLVTXDUHWHVWV6366 5HVXOWV%RWKJURXSVZHUHVLPLODULQDJHDQG\HDUVS DQGPHQRSDXVDOVWDWXVDQGZRPHQS 7KHDYHUDJHSDWKRORJLFDO WXPRXUVL]HZDVVPDOOHULQJURXSPPYVPPS 0XOWLIRFDOPXOWLFHQWULFWXPRXUVZHUHPRUHIUHTXHQWLQJURXSYV S%LODWHUDOWXPRXUVZHUHGLDJQRVHGRQO\LQJURXS7KHUDWHRI PDVWHFWRP\ZDVORZHULQJURXSYVS2QFRSODVWLFDQG ELODWHUDOVXUJHULHVZHUHRQO\SHUIRUPHGLQJURXS7KHUDWHRIQHRDGMXYDQW FKHPRWKHUDS\ZDVKLJKHULQJURXSYVS5HLQWHUYHQWLRQVGXH WRPDUJLQLQÀOWUDWLRQZHUHDOVRPRUHIUHTXHQWLQJURXSYVS &RQFOXVLRQ 'HVSLWH GLDJQRVLQJ PRUH PXOWLIRFDOPXOWLFHQWULF FDVHV LQ JURXS SUHRSHUDWLYH05,RXUVWXG\VKRZVDGHFUHDVHLQWKHUDWHRIPDVWHFWRP\IURP WRZKHQRQFRSODVWLFVXUJHU\DQGQHRDGMXYDQWFKHPRWKHUDS\DUHDYDLO DEOH+RZHYHUWKHLQFUHDVHRIWXPRUHFWRPLHVKDVOHGWRPRUHUHLQWHUYHQWLRQVGXH WRDIIHFWHGPDUJLQVIURPWR % 7KHUROHRISUHRSHUDWLYH05,LQEUHDVWFDQFHULVWKHPHQRSDXVDO VWDWXVRIUHOHYDQFH" $*DUFLD/DOODQD,6LPRQ<DU]D*9LWHUL,$QWRQ$(OL]DOGH/3LQD 3DPSORQD(6PV\DU]D#XQDYHV 3XUSRVH7 RHYDOXDWHWKHUROHRI05,LQWKHSUHRSHUDWLYHVHWWLQJRIEUHDVWFDQFHU DFFRUGLQJWRWKHSUHPHQRSDXVDOYVPHQRSDXVDOVWDWXV 0HWKRGVDQG0DWHULDOVEUHDVW05,H[DPVRISDWLHQWVZLWKEUHDVWFDQFHU GLDJQRVHGE\SHUFXWDQHRXVELRSV\ZHUHUHWURVSHFWLYHO\HYDOXDWHG7KH\ZHUHGL YLGHGLQWRWZRJURXSVSUHPHQRSDXVDOJURXSDQGPHQRSDXVDOJURXS &KDQJHVLQVXUJLFDOPDQDJHPHQWLQGXFHGE\05,ÀQGLQJVVXUJLFDOWUHDWPHQW05, VWDJLQJ VL]H ELODWHUDOLW\ PXOWLFHQWULFLW\ DQG PXOWLIRFDOLW\ IUHH WXPRUDO PDUJLQV DQG UHTXLUHPHQW RI QHRDGMXYDQW FKHPRWKHUDS\ 1$4 ZHUH HYDOXDWHG 6WDWLVWL FDODQDO\VLVZDVSHUIRUPHGZLWK6WXGHQWҋV7DQG&KLVTXDUHWHVWV6366 5HVXOWV,QLWLDOO\SODQQHGVXUJHU\ZDVPRGLÀHGLQRIWKHSDWLHQWVGXHWR 05,ÀQGLQJVZLWKQRVLJQLÀFDQWGLIIHUHQFHVEHWZHHQJURXSVS 7KLVDG GLWLRQDO LQIRUPDWLRQ JLYHQ E\ 05, ZDV SURYHG WR EH PDOLJQDQW LQ RI WKH FDVHVELODWHUDOVXUJHULHVPDVWHFWRPLHVRQFRSODVWLFVXUJHULHVDQG WXPRUHFWRPLHV ZHUH SHUIRUPHG ZLWK PRUH PDVWHFWRPLHV FDUULHG RXW LQ *URXS YVS05,GHWHFWHGELODWHUDOFDQFHUVXQVXVSHFWHG ZLWKFRQYHQWLRQDOWHFKQLTXHVPXOWLFHQWULFDQGPXOWLIRFDOLW\ ZLWKQRVLJQLÀFDQWGLIIHUHQFHVEHWZHHQJURXSVS 0HDQVL]HRIWKHWXPRXUV ZDVVLPLODULQERWKJURXSVS )UHHPDUJLQVZHUHREWDLQHGLQZLWKQR VLJQLÀFDQWGLIIHUHQFHVS 0RUHZRPHQXQGHUZHQW1$4LQJURXS YVS &RQFOXVLRQ05,LVPRUHVHQVLWLYHWKDQFRQYHQWLRQDOWHFKQLTXHVIRUVWDJLQJEUHDVW FDQFHUFKDQJLQJLQLWLDOSODQQHGWUHDWPHQWLQXSWRRQHWKLUGRIWKHSDWLHQWV%RWK PHQRSDXVDO DQG SUHPHQRSDXVDO SDWLHQWV PD\ EHQHÀW IURP SUHRSHUDWLYH 05, 3UHPHQRSDXVDOZRPHQXQGHUJRPRUHPDVWHFWRPLHVDQG1$4 6FLHQWLILF6HVVLRQ $ 6&'()*+% 7KXUVGD\ (XURSHDQ&RQJUHVVRI 5DGLRORJ\ &RQFOXVLRQFRQYHQWLRQDO05,DQG':05,VKRZHGFRPSDUDEOH'$LQSUHGLFW LQJUHVLGXDOGLVHDVHDIWHU1$&7 %DVHOLQH$'&DQGLWVFKDQJHVDIWHUZHHNV SUHGLFWHGUHVLGXDOGLVHDVHLQRXUFRKRUW % 'LIIXVLRQZHLJKWHGLPDJLQJ':,DVDPDPPDFDUFLQRPD FKDUDFWHULVWLFDVVRFLDWLRQRIDSSDUHQWGLIIXVLRQFRHIÀFLHQW$'& DQGSDWKRORJLFDORXWFRPHLQSDWLHQWVWUHDWHGZLWKQHRDGMXYDQW FKHPRWKHUDS\ 9+3 7UDQ09ROPHULQN$,PKRO]0/RXZHQ5YDQ'LMN'HYHQWHU1/ 3XUSRVH 7KH UROH RI ':, LV FXUUHQWO\ XQGHU LQYHVWLJDWLRQ LQ WXPRXU UHVSRQVH HYDOXDWLRQLQSDWLHQWVZLWKQHRDGMXYDQWO\WUHDWHGPDPPDFDUFLQRPD+RZHYHUWKH UROHRI':,SULRUWRWUHDWPHQWDVDWXPRXUFKDUDFWHULVWLFLQUHODWLRQWRSDWKRORJLFDO RXWFRPHLVVWLOOXQFOHDU 0HWKRGVDQG0DWHULDOV,QWKLVUHWURVSHFWLYHVWXG\ZHÀUVWLQYHVWLJDWHGWKHDVVR FLDWLRQEHWZHHQEDVHOLQH $'&DQGSDWKRORJLFDORXWFRPHHLWKHUFRPSOHWHRULQFRP SOHWHUHVSRQVHE\ORJLVWLFUHJUHVVLRQLQFRQVHFXWLYHSDWLHQWVZLWKQHRDGMXYDQWO\ WUHDWHGPDPPDFDUFLQRPDLQRXUKRVSLWDOEHWZHHQDQG6HFRQGZH LQYHVWLJDWHGLIFKDQJHRI$'&DQGFKDQJHRIWXPRXUVL]HZHUHPHGLDWLQJIDFWRUV 5HVXOWV +LJK EDVHOLQH$'& EYDOXH ZDV DVVRFLDWHG ZLWK SDWKRORJLFDO FRPSOHWHUHVSRQVHRGGVUDWLR ð&, ððS 0HDQ$'&LQUHVSRQGHUVZDVðPPVHFDQGLQLQFRPSOHWHUHVSRQGHUV ð PPVHF XQSDLUHG 6WXGHQWҋV WWHVW S 7KLV DVVRFLDWLRQ ZDV LQGHSHQGHQWRIFKDQJHVLQWXPRXUVL]H5(6,67 ZDVKRXWDQGFKDQJHVLQ$'& DIWHUQHRDGMXYDQWFKHPRWKHUDS\ &RQFOXVLRQ+LJKEDVHOLQH$'&ZDVDVVRFLDWHGZLWKFRPSOHWHSDWKRORJLFDOUH VSRQVHLQGHSHQGHQWRIFKDQJHVLQ$'&DQGWXPRXUJHRPHWU\GXULQJWKHFRXUVH RIQHRDGMXYDQWFKHPRWKHUDS\7KHUHIRUHWKHUHLVDSRWHQWLDOUROHIRU$'&DVD WXPRXUFKDUDFWHULVWLFLQSUHGLFWLQJSDWKRORJLFDORXWFRPH 5RRP,. $EGRPLQDO9LVFHUD 66E &7WHFKQLTXH 0RGHUDWRUV $$OFDOi*DOLDQR0DGULG(6 66WRMDQRYLF1RYL6DG56 % 9DULDELOLW\RI&7FRQWUDVWHQKDQFHPHQWLQWKHSDQFUHDVDFDXVHIRU FRQFHUQ" /'HOUXH 3 %ODQFNDHUW'0HUWHQV3 'X\FN*HQW%(%UXVVHOV%( ORXNHGHOUXH#X]JHQWEH 3XUSRVH0XOWLGHWHFWRU&7LVDYDOXDEOHWHFKQLTXHIRUGLDJQRVLVVWDJLQJLQVHYHUDO SDQFUHDWLFSDWKRORJLHV'LDJQRVLVLVXVXDOO\EDVHGRQWLVVXHGHQVLW\PHDVXUHPHQWV 5HFHQWO\QHZHUIXQFWLRQDO&7WHFKQLTXHVZHUHLQWURGXFHG7KHDLPRIWKLVVWXG\ ZDVWRDVVHVVYDULDELOLW\RQSHUIXVLRQDQGGXDOHQHUJ\&7GDWDDQGWRFRPSDUH WKHVHGDWDZLWKGHQVLW\PHDVXUHPHQWVLQWKHSDQFUHDVRIDKHDOWK\SRSXODWLRQ 0HWKRGVDQG0DWHULDOV7ZRJURXSVZHUHLQFOXGHGWZHQW\SDWLHQWVXQGHUZHQW SHUIXVLRQ&7LPDJLQJWHQSDWLHQWVZHUHVFDQQHGXVLQJDGXDOHQHUJ\SURWRFRO,Q ERWKJURXSVWLVVXHGHQVLW\+RXQVÀHOGXQLWVZDVPHDVXUHGLQSDQFUHDWLFKHDG ERG\ DQG WDLO )XQFWLRQDO GDWD ZHUH FDOFXODWHG EORRG ÁRZEORRG YROXPH LQ WKH SHUIXVLRQ&7JURXSLRGLQHFRQFHQWUDWLRQLQWKHGXDOHQHUJ\JURXSDQGYDULDELOLW\ ZDVDVVHVVHG 5HVXOWV'HQVLW\PHDVXUHPHQWVZHUHFRPSDUDEOHIRUWKHSHUIXVLRQDQGGXDOHQ HUJ\&7JURXSVDQGUDQJHGIURPWR+80D[LPDOHQKDQFHPHQWGLIIHUHQFHV EHWZHHQKHDGERG\WDLORIWKHSDQFUHDVUDQJHGEHWZHHQDQG+8&RQVLGHU DEOHYDULDELOLW\ZDVREVHUYHGERWKRQGHQVLW\PHDVXUHPHQWVUDQJLQJIURPWR DQGRQIXQFWLRQDOSDUDPHWHUVPHDQYDULDELOLW\RQSHUIXVLRQ&7SDUDPHWHUV EORRGÁRZDQGEORRGYROXPHZDVDQGUHVSHFWLYHO\PHDQYDULDELOLW\ RQGXDOHQHUJ\LRGLQHPDSSLQJUHVXOWVZDV &RQFOXVLRQ7KLVVWXG\GHPRQVWUDWHGWKHSUHVHQFHRILPSRUWDQWLQWUDLQGLYLGXDO YDULDELOLW\LQSDQFUHDWLFWLVVXHFRQWUDVWHQKDQFHPHQWUHJDUGOHVVRIWKH&7WHFKQLTXH XVHG&RQVLGHULQJWKHYDULDELOLW\REVHUYHGLQWKLVVWXG\WKHXVHRIFXWRIIYDOXHVWR FKDUDFWHULVHSDQFUHDWLFSDWKRORJLHVVHHPVWURXEOHVRPHDQGPRUSKRORJLFSULPDU\ DQGVHFRQGDU\FKDQJHVZLOOUHPDLQLPSRUWDQWHYHQZKHQXVLQJQRYHOIXQFWLRQDO LPDJLQJWHFKQLTXHV UHWURVSHFWLYHO\VLPXODWHGKRZPDQ\05,SURFHGXUHVZRXOGKDYHEHHQVSDUHGDQG KRZPDQ\%&7ZRXOGQRWKDYHEHHQFRQYHUWHGWRPDVWHFWRP\0;LQGLFDWLRQKDG 05,VWDJLQJEHHQSHUIRUPHGRQO\LQFDVHVIXOÀOOLQJ(8620$FULWHULD 5HVXOWV05,LQGLFDWLRQIRU0;ZDVREVHUYHGLQRIFDVHVLQWKH WRWDOVHULHV%DVHGRQ(8620$FULWHULD05,VWDJLQJZRXOGKDYHEHHQLQGLFDWHG RQO\LQFDVHVJHQHUDWLQJ0;LQGLFDWLRQV05,ZRXOGKDYH EHHQ VSDUHG LQ VXEMHFWV LQ ZKRP LWGLG DFWXDOO\ JHQHUDWH 0;LQGLFDWLRQV RIWRWDO0;LQGLFDWLRQV(8620$FULWHULDVLQJOHRUFRPELQHGZHUHQRW HIÀFLHQWLQVHOHFWLQJVXEMHFWVDWKLJKHUULVNRI05,LQGLFDWLRQWR0;LQSDUWLFXODU OREXODUKLVWRORJLFDOW\SHZKLFKLQWKHSUHVHQFHVHULHVZDVDVVRFLDWHGZLWKORZHU ULVN$SSO\LQJ (8620$ FULWHULD ZRXOG RQO\ UHGXFH 05, VWDJLQJ SURFHGXUHV E\ DQGLQGLFDWLRQWR0;ZLWKDFRPSDUDEOHUDWHE\ &RQFOXVLRQ:HTXHVWLRQWKHYDOLGLW\RI(8620$FULWHULDIRUVHOHFWLQJSDWLHQWVWR 05,VWDJLQJSULRUWR%&7 7KH\VKRXOGEHYDOLGDWHGLQFRQWUROOHGVWXGLHVRIJUHDWHU VWDWLVWLFDOSRZHUEHIRUHEHLQJDGRSWHGLQFXUUHQWSUDFWLFH % '\QDPLFFRQWUDVWHQKDQFHPHQW05,DVDSUHGLFWLYHDQGVXUURJDWH PDUNHURISDWKRORJLFDOFRPSOHWHUHVSRQVHRIQHRDGMXYDQWWUHDWPHQW IRUORFDOO\DGYDQFHGEUHDVWFDQFHU 6'ULVLV0&DSHODQ6O&KDR03DHVPDQV0/HPRUW%UXVVHOV%( VWHOLRVGULVLV#\DKRRFRP 3XUSRVH7 RHYDOXDWHWKHSKDUPDFRNLQHWLFSDUDPHWHUVRI'&(05,DVDSUHGLFWLYH DQGVXUURJDWHPDUNHUIRUSDWLHQWVUHFHLYLQJQHRDGMXYDQWFKHPRWKHUDS\1$&IRU ORFDOO\DGYDQFHGEUHDVWFDQFHU 0HWKRGV DQG 0DWHULDOV$ UHWURVSHFWLYH VWXG\ RI SDWLHQWV ZDV SHUIRUPHG ZKHUHDOOSDWLHQWVXQGHUZHQWWZR'&(05,H[DPLQDWLRQVEHIRUH(;DQGGXU LQJ 1$& (; 0D[LPXP GLDPHWHU 'PD[ DQG SKDUPDFRNLQHWLF SDUDPHWHUV IURP'&(05,VXFKDV.WUDQV.HS9HDQG9SZHUHFRQFHUQHG3RVWRSHUDWLYH SDWKRORJLFDOH[DPLQDWLRQZDVXVHGDVWKHJROGHQVWDQGDUGZLWKDELQDU\UHVSRQVH UHVSRQGHUVSDWLHQWVVKRZLQJFRPSOHWHUHPLVVLRQRU´LQVLWXµUHVLGXDOGLVHDVHDQG QRQUHVSRQGHUVIRUWKHUHVWRIWKHSDWLHQWV:LOFR[RQWHVW52&FXUYHVFRPSDULVRQ RI52&ZHUHHPSOR\HGIRUWKHVWDWLVWLFDODQDO\VLV 5HVXOWV)URPWKHSDWLHQWVZHUHQRQUHVSRQGHUVDQG VKRZHGFRPSOHWHSDWKRORJLFDOUHVSRQVH $W(;DVLJQLÀFDQWGLIIHUHQFHZDVIRXQG EHWZHHQWKHUHVSRQVHJURXSVRQO\IRUWKH.WUDQV(;S DQGDW(;IRU 'PD[SDQGDOOSKDUPDFRNLQHWLFSDUDPHWHUV.WUDQVS.HS S 9HS DQG9SS 0RUHRYHUDVLJQLÀFDQWGLIIHUHQFH ZDVIRXQGEHWZHHQWKHUHVSRQVHJURXSVIRUWKHDEVROXWHFKDQJHVRI.WUDQV9H DQG9SDQGIRUWKHSHUFHQWDJHFKDQJHVRI'PD[.WUDQVDQG9HDQG9SEHWZHHQ (;DQG(;7KH52&FXUYHDQDO\VLVVKRZHGWKHEHVWSHUIRUPDQFHIRU.WUDQVDW (;IRU'PD[DW(;DQGIRUGHFUHDVHRI9HEHWZHHQWKHWZRH[DPLQDWLRQV &RQFOXVLRQ'&(05,SKDUPDFRNLQHWLFSDUDPHWHUVFRXOGEHDSRWHQWLDOSUHGLFWLYH DQGVXUURJDWHPDUNHURIQHRDGMXYDQWWUHDWPHQWLQORFDOO\DGYDQFHGEUHDVWFDQFHU % &RQYHQWLRQDODQGGLIIXVLRQZHLJKWHGPDJQHWLFUHVRQDQFHLPDJLQJ LQSUHGLFWLQJUHVLGXDOGLVHDVHDIWHUQHRDGMXYDQWFKHPRWKHUDS\LQ SDWLHQWVZLWKEUHDVWFDQFHU ) 3ULROR*3HWUDOLD/%RQHOOR65DLPRQGL5'L)LOLSSL0&ROOHRQL (&DVVDQR0%HOORPL0LODQ,7IUDQFHVFDSULROR#LHRLW 3XUSRVH7 RHYDOXDWHWKHUROHRIFRQYHQWLRQDOPDJQHWLFUHVRQDQFHLPDJLQJ05, DQGGLIIXVLRQZHLJKWHG':05,LQSUHGLFWLQJUHVLGXDOGLVHDVHDIWHUQHRDGMXYDQW FKHPRWKHUDS\1$&7LQSDWLHQWVZLWKORFDOO\DGYDQFHGEUHDVWFDQFHU/$%& 0HWKRGV DQG 0DWHULDOV ZH HQUROOHG SDWLHQWV ZLWK /$%& ZKR XQGHUZHQW FRQ YHQWLRQDO 05, DQG ':05, DW EDVHOLQH GXULQJ DQG DIWHU FRPSOHWLRQ RI 1$&7 7ZRUHDGHUVFDUULHGRXWDTXDOLWDWLYHDQDO\VLVIRUFRQYHQWLRQDO05,DQG':05, SHUIRUPHGDIWHUFRPSOHWLRQRI1$&7 DORQHDQGLQFRPELQDWLRQLQRUGHUWRHYDOX DWHWKHSUHVHQFHRIUHVLGXDOGLVHDVH:HHYDOXDWHGWKHSRWHQWLDORIWKHEDVHOLQH DSSDUHQWGLIIXVLRQFRHIÀFLHQW$'&DQGLWVFKDQJHVDIWHUZHHNVWRSUHGLFW UHVLGXDOGLVHDVH 5HVXOWV :H HQUROOHG SDWLHQWV RI ZKRP SDWLHQWV ZLWK EUHDVW FDQFHUV XQGHUZHQWVXUJHU\7KHTXDOLWDWLYHDQDO\VLVRIFRQYHQWLRQDO05,DORQH':05, DORQH DQG RI FRQYHQWLRQDO 05, DQG ':05, LQ FRPELQDWLRQ ZDV SHUIRUPHG LQ WXPRXUVVKRZLQJDGLDJQRVWLFDFFXUDF\'$IRUSUHGLFWLQJUHVLGXDOGLVHDVH RI DQG UHVSHFWLYHO\ 3DWLHQWV ZLWK SDWKRORJLFDO FRPSOHWH UHVSRQVH S&5 VKRZHG D ORZHU EDVHOLQH$'& S ZKHQ FRPSDUHG WR WKRVH ZLWK UHVLGXDO GLVHDVH 7KH FKDQJH LQ$'& DIWHU ZHHNV RI 1$&7 ZDV VLJQLÀFDQWS LQSDWLHQWVZLWKS&5QRVLJQLÀFDQWFKDQJHZDVREVHUYHGLQ SDWLHQWVZLWKUHVLGXDOGLVHDVH 6FLHQWLILF6HVVLRQ 6 &$' ( ) *+% (XURSHDQ&RQJUHVVRI 5DGLRORJ\ % +\SHUYDVFXODUOLYHUOHVLRQDWGXDOHQHUJ\&7 HQKDQFHPHQW HYDOXDWLRQDWGLIIHUHQWWXEHYROWDJHV $&ROOHRQL$6FULPLHUL50DUROGL3 &DEDVVD%UHVFLD,7SDRORFDE#OLEHURLW 3XUSRVH 7 R FRPSDUH DWWHQXDWLRQ YDOXHV RI K\SHUYDVFXODU OLYHU OHVLRQ ZLWK NYSLPDJHV NYSLPDJHV DQG ZLWK ZHLJKWHGDYHUDJH :$ VLPXODWHG NYSLPDJHVXVLQJGXDOHQHUJ\&7'(&7 0HWKRGVDQG0DWHULDOV,QWKLVSURVSHFWLYHVWXG\WKLUW\ÀYHSDWLHQWVPDOHV DJHUDQJHXQGHUZHQWLQDWZRPRQWKSHULRGDEGRPLQDO'(&7VFDQQLQJIRU VXVSHFWHGRUNQRZQK\SHUYDVFXODUOHVLRQV $QRQHQKDQFHGVHTXHQFHDQDUWHULDO SKDVHZLWK'(WHFKQLTXH.YS.YSDQG:$DQGDYHQRXVDFTXLVLWLRQ NYSZHUHSHUIRUPHG $UWHULDOLPDJHVZHUHREWDLQHGDIWHUDVWDQGDUGWULJJHUHG WKUHVKROG7KHDWWHQXDWLRQYDOXHVZHUHFDOFXODWHGXVLQJ52,VSODFHGLQDUWHULDO '(LPDJHVRQGLIIHUHQWDUHDVOHVLRQDRUWDSVRDVPXVFOHVXEFXWDQHRXVIDW KHDOWK\ULJKWDQGOHIWOLYHU7KH//5OHVLRQWROLYHUUDWLRDQGWKH&15FRQWUDVWWR QRLVHUDWLRZHUHFDOFXODWHGLQGHSHQGHQWO\E\WZRUDGLRORJLVWV7KH&15E\52, OHVLRQ52,ULJKWOLYHUOREH6'VXEFXWDQHRXVIDWDQGWKH//5E\PHDQYDOXH RIWKHOHVLRQPHDQYDOXHRIKHDOWK\ULJKWOLYHUOREH$WVWXGHQWWHVWZDVXVHGIRU VWDWLVWLFDODQDO\VLV 5HVXOWV )LIWHHQ OHVLRQV ZHUH GHWHFWHG 7KH PHDQ DWWHQXDWLRQ YDOXHV RIWKH OHVLRQV ZHUH +8 IRU NYLPDJHV +8 IRU NY LPDJHV+8LQ:$LPDJHV//5ZDVLQNYLPDJHVLQ NYLPDJHVDQGLQ:$LPDJHVS7KHPHDQ&15ZDVLQ NYLPDJHVLQNYLPDJHVDQGLQ:$LPDJHV &RQFOXVLRQNYSDFTXLVLWLRQLPDJHVRIK\SHUYDVFXODUOHVLRQVGHPRQVWUDWHGD KLJKHU//5WKDQDFTXLUHGLPDJHVDWNYSDQGDW:$.Y3 7KHN9SLPDJHV FRXOGEHXVHGLQFOLQLFDOSUDFWLFHWREHWWHUHYDOXDWHK\SHUYDVFXODUOLYHUOHVLRQV % 0XOWLRUJDQSHUIXVLRQ&7LQWKHDEGRPHQXVLQJDGHWHFWRUURZ &7VFDQQHUSUHOLPLQDU\UHVXOWVRISHUIXVLRQFKDQJHVLQWKHOLYHU VSOHHQDQGSDQFUHDVRIFLUUKRWLFSDWLHQWV .6DQR80RWRVXJL+0RULVDND+6RX7 ,FKLNDZD7 $UDNL&KXR-3 VQNWKU#\DKRRFRMS 3XUSRVH7 RFRPSDUHWKHSHUIXVLRQRIPXOWLSOHDEGRPLQDORUJDQVEHWZHHQSDWLHQWV ZLWKDQGZLWKRXWOLYHUFLUUKRVLVXVLQJSHUIXVLRQ&7ZLWKGHWHFWRUURZ&7 0HWKRGV DQG 0DWHULDOV7KLV VWXG\ LQFOXGHG SDWLHQWV ZLWK FLUUKRVLV DQG ZLWKRXWFLUUKRVLV7KHGHWHFWRUURZ&7VFDQQHUHQDEOHGPXOWLRUJDQSHUIXVLRQ &7 ZLWKRXW UHTXLULQJ WKH VFDQQHU WDEOH WR EH PRYHG 3HUIXVLRQ ZDV FDOFXODWHG XVLQJWKHPD[LPXPVORSHPRGHOIRUWKHDRUWDWKHSRUWDOYHLQWKHULJKWDQGOHIW OREHVRIWKHOLYHUWKHKHDGDQGERG\RIWKHSDQFUHDVWKHVSOHHQDQGWKHFRUSXV DQGDQWUXPRIWKHVWRPDFK3HUIXVLRQLQHDFKRUJDQRISDWLHQWVZLWKDQGZLWKRXW FLUUKRVLVZDVFRPSDUHG 5HVXOWV3RUWDOYHQRXVSHUIXVLRQRIWKHULJKWDQGOHIWOREHVRIWKHOLYHULQSDWLHQWV ZLWK FLUUKRVLV DQG P/ÃPLQÃ P/ UHVSHFWLYHO\ ZDV VLJQLÀFDQWO\ OHVVWKDQWKDWLQSDWLHQWVZLWKRXWFLUUKRVLVDQGP/ÃPLQÃP/UH VSHFWLYHO\S DQGUHVSHFWLYHO\$UWHULDOSHUIXVLRQRIWKHVSOHHQ P/ÃPLQÃP/DQGWKHERG\RIWKHSDQFUHDVP/ÃPLQÃP/ LQSDWLHQWVZLWKFLUUKRVLVZDVDOVRVLJQLÀFDQWO\GHFUHDVHGFRPSDUHGZLWKWKDWLQ SDWLHQWVZLWKRXWFLUUKRVLVVSOHHQP/ÃPLQÃP/S ERG\RI SDQFUHDVP/ÃPLQÃP/S &RQFOXVLRQ 7KH UHVXOWV RI WKH SHUIXVLRQ &7 VXJJHVW WKDW DUWHULDO SHUIXVLRQ RI WKHVSOHHQDQGWKHERG\RIWKHSDQFUHDVDVZHOODVSRUWDOSHUIXVLRQRIWKHOLYHU LQFLUUKRWLFSDWLHQWVZDVGHFUHDVHGFRPSDUHGZLWKWKDWLQQRQFLUUKRWLFSDWLHQWV % ,QÁXHQFHRIGLIIHUHQWLWHUDWLRQOHYHOVLQIRXUWKJHQHUDWLRQLWHUDWLYH UHFRQVWUXFWLRQWHFKQLTXHRQLPDJHQRLVHLQ&7H[DPLQDWLRQVRIWKH DEGRPHQ 3 6WXPSS 0)HUQDX.YDQ'DDO'*RVFK+'1DJHO7 .DKQ /HLS]LJ'(%XFKKRO]'(SDWULFNVWXPSS#PHGL]LQXQLOHLS]LJGH 3XUSRVH7KHREMHFWLYHRIWKLVVWXG\ZDVWRHYDOXDWHWKHHIIHFWRIWKHIRXUWKJHQ HUDWLRQUDZGDWDEDVHGLWHUDWLYHUHFRQVWUXFWLRQWHFKQLTXH,57L'RVH3KLOLSV +HDOWKFDUH FRPSDUHG WR WUDGLWLRQDO UHFRQVWUXFWLRQ ZLWK ÀOWHUHG EDFNSURMHFWLRQ )%3RQLPDJHQRLVHLQDUHSUHVHQWDWLYHJURXSRISDWLHQWVXQGHUJRLQJDEGRPLQDO &7H[DPLQDWLRQV 0HWKRGVDQG0DWHULDOV,QWKLVSURVSHFWLYHVWXG\FRQVHFXWLYHSDWLHQWVXQ GHUZHQWURXWLQH&7H[DPLQDWLRQVRIWKHDEGRPHQIPPHDQDJH\UV PHDQ%0,3DWLHQWVZHUHVFDQQHGRQD3KLOLSV%ULOOLDQFHZLWKWKHXVHRI DQDXWRPDWLFGRVHFRQWUROV\VWHPN9SURWRFROP$V5DZGDWDZHUH % 0HDVXUHPHQWRIWUDQVSODQWHGSDQFUHDWLFYROXPHE\FRPSXWHG WRPRJUDSK\UHOLDELOLW\E\LQWUDDQGLQWHUREVHUYHUYDULDELOLW\ (/XQGTYLVW$5%LJODUQLD06HJHOVMR$0DJQXVVRQ8SSVDOD6( HYDOXQGTYLVW#VWXGHQWXXVH 3XUSRVH7KH DLP RI WKLV VWXG\ ZDV WR HYDOXDWH WKH UHOLDELOLW\ RI PHDVXUHPHQW RISDQFUHDWLFYROXPHE\&7LQWUDQVSODQWHGSDWLHQWV7 RGD\WKHUHLVQRVXIÀFLHQW SURJQRVWLFPHWKRGIRUSUHGLFWLQJIDLOXUHRIWUDQVSODQWHGSDQFUHDV7KHK\SRWKHVLV LV WKDW PHDVXUHPHQW RI SDQFUHDWLF YROXPH E\ &7 YROXPHWU\ FRXOGEH D XVHIXO PHWKRGIRUFOLQLFDOSXUSRVHDVDSURJQRVWLFPHWKRGDQGWRIROORZWKHQDWXUDOFDXVH RISDQFUHDWLFWUDQVSODQWV 0HWKRGVDQG0DWHULDOV&7H[DPLQDWLRQZDVSHUIRUPHGRQWZHQW\RQHFRQVHFX WLYHSDWLHQWVWKDWKDGXQGHUJRQHSDQFUHDVWUDQVSODQWDWLRQ9ROXPHPHDVXUHPHQWV ZHUHSHUIRUPHGE\WZRREVHUYHUVZKRWUDFHGWKHSDQFUHDWLFFRQWRXUVLQDOOVOLFHV 7KHFRUUHVSRQGLQJYROXPHZDVWKHQDXWRPDWLFDOO\FDOFXODWHG2EVHUYHUSHUIRUPHG PHDVXUHPHQW IRU HDFK SDWLHQW WZLFH 2EVHUYHU SUHIRUPHG WKH PHDVXUHPHQWV RQFHIRUHDFKSDWLHQW'LIIHUHQFHVLQYROXPHPHDVXUHPHQWZHUHXVHGWRHYDOXDWH LQWUDDQGLQWHUREVHUYHUYDULDELOLW\ 5HVXOWV ,QWUDREVHUYHU YDULDELOLW\ RI SDQFUHDWLF YROXPH PHDVXUHPHQW RQ &7 ZDVIRXQGWRKDYHDQDOPRVWSHUIHFWDJUHHPHQWZLWK,&&7KHLQWHUREVHUYHU YDULDELOLW\ZDVDOVRIRXQGWRKDYHDQDOPRVWSHUIHFWDJUHHPHQW,&&IRUWKHÀUVW PHDVXUHPHQWVRIREVHUYHUYHUVXVWKHPHDVXUHPHQWVRIREVHUYHUZDVIRXQG WREH,&&IRUWKHVHFRQGPHDVXUHPHQWVRIREVHUYHUYHUVXVWKHPHDVXUH PHQWVRIREVHUYHUZDVIRXQGWREH &RQFOXVLRQ ,QWUD DQG LQWHUREVHUYHU YDULDELOLWLHV RI WUDQVSODQWHG SDQFUHDWLF YROXPHPHDVXUHPHQWKDYHEHHQHYDOXDWHGFRQFOXGLQJWKHPHWKRGLVUHOLDEOHDQG UHSURGXFLEOH ZLWK DOPRVW SHUIHFW LQWUD DQG LQWHUREVHUYHU YDULDELOLW\ DJUHHPHQW 7KHUHE\ &7 YROXPHWU\ FRXOG EH FRQVLGHUHG D SURSHU PHWKRG IRU IROORZLQJ DQG HYDOXDWLQJVL]HYROXPHGHYHORSPHQWRISDQFUHDWLFWUDQVSODQWV % (YDOXDWLRQRITXDQWLWDWLYHSHUIXVLRQPDSZLWK&7SHUIXVLRQ WHFKQLTXHDVDQHDUO\SUHGLFWRUIRUWXPRXUUHVSRQVHWR UDGLRIUHTXHQF\DEODWLRQLQSDWLHQWVZLWK+&&OHVLRQVLQLWLDOUHVXOWV ',SSROLWR3 %RQDIÀQL&&DSUDUR00HORQL66LURQL0RQ]D,7 GDYLGHDWHQD#WLVFDOLQHWLW 3XUSRVH7 RDVVHVVWKHUROHRI&7SHUIXVLRQ&7SWHFKQLTXHLQGHWHFWLRQRIEORRG ÁRZFKDQJHVUHODWHGWRWKHWKHUDSHXWLFHIIHFWVLQ+&&OHVLRQWUHDWHGZLWK5)$ 0HWKRGVDQG0DWHULDOV$WRWDORISDWLHQWVZLWKNQRZQFLUUKRWLFOLYHUGLVHDVH DQGELRSV\SURYHQGLDJQRVLVRI+&&OHVLRQWKDWXQGHUZHQW5)$WUHDWPHQWZHUH SURVSHFWLYHO\HQUROOHGLQRXUVWXG\3HUIXVLRQVWXG\RIKHSDWLFSDUHQFK\PDDQG RIWUHDWHGOHVLRQZDVSHUIRUPHGDERXWPRQWKDIWHUWUHDWPHQWRQDPXOWLGHWHFWRU VOLFH&7 3KLOLSV %ULOOLDQFH S 1/ &RQWUDVW PHGLXPHQKDQFHG G\QDPLF &7ZDVSHUIRUPHGZLWKVWDWLFWDEOHSRVLWLRQDFTXLULQJG\QDPLFVOLFHVFDQIRUD WRWDORIVFDQVDIWHULQWUDYHQRXVLQMHFWLRQRIPORIFRQWUDVWPHGLXP7UHDWHG OHVLRQDQGVXUURXQGLQJSDUHQFK\PDZHUHHYDOXDWHGXVLQJDGHGLFDWHGSHUIXVLRQ VRIWZDUH&73HUIXVLRQ3KLOLSV7KHIROORZLQJSDUDPHWHUVZHUHFRQVLGHUHG KHSDWLFSHUIXVLRQ+3DUWHULDOSHUIXVLRQ$3EORRGYROXPH%9KHSDWLFSHUIXVLRQ LQGH[+3,DQGWLPHWRSHDN7738QLYDULDWHSDLUHG:LOFR[RQVLJQHGUDQNHGWHVW ZDVXVHGIRUVWDWLVWLFDODQDO\VLV 5HVXOWV3HUIXVLRQSDUDPHWHUVRIWUHDWHGOHVLRQVFRXOGEHTXDQWLWDWLYHDVVHVVHG XVLQJ&7SDQDO\VLV6HYHQRXWRISDWLHQWVKDGDUHVLGXDOGLVHDVHDQGYDOXHV RISHUIXVLRQSDUDPHWHUVPHDVXUHGZLWKLQWXPRXUWLVVXHZHUH+3PO VHF JU$3 POPLQ 773 VHF %9 PO PJ +3, 7KH FRUUHVSRQGLQJ SHUIXVLRQ YDOXHV FDOFXODWHGLQ SDWLHQWV ZLWKRXWUHVLGXDOWXPRXUZHUH+3POVHFJU $3POPLQ773 VHF %9 PO PJ +3, $ VLJQLÀFDQW GLIIHUHQFH S ZDV REVHUYHG LQ PHDQ YDOXH RI DOO SDUDPHWHUV FDOFXODWHG EHWZHHQ WUHDWHGOHVLRQVZLWKUHVLGXDOWXPRXUDQGWKRVHVXFFHVVIXOO\WUHDWHG&7SWHFKQLTXH KDVGHPRQVWUDWHGKLJKO\SHUIXVHGDUHDVUHODWHGWRWKHSUHVHQFHRIUHVLGXDODUWHULDO YHVVHOVZLWKLQWKHYLDEOHSRUWLRQRIWUHDWHG+&&OHVLRQV &RQFOXVLRQ 3HUIXVLRQ&7 LQ SDWLHQWV ZLWK KHSDWRFHOOXODU FDUFLQRPD HQDEOHV DVVHVVPHQWRIWXPRXUYDVFXODULW\DIWHU5)$E\DGGLQJTXDQWLWDWLYHLQIRUPDWLRQ DERXWYLDEOHWXPRXUWLVVXH 6FLHQWLILF6HVVLRQ $ 6&'()*+% 7KXUVGD\ (XURSHDQ&RQJUHVVRI 5DGLRORJ\ % ,VLWDYDLODEOHE\LRGLQHFRQFHQWUDWLRQRIWKHDFWLYHSDUWRIUHQDO PDVVIRUGLIIHUHQWLDWLRQEHWZHHQUHQDODQJLROHLRP\ROLSRPDDQG UHQDOFHOOFDUFLQRPD" -6XQ;7 /L&<RQJ;< =KDQJ6< *DR=/:DQJ< 66XQ ;3 =KDQJ%HLMLQJ&1[QTLXTLX# FRP 3XUSRVH7 RHYDOXDWHWKHSRWHQWLDORILRGLQHFRQFHQWUDWLRQRIWKHDFWLYHSDUWRI WKH UHQDO PDVV DV D WRRO WR GLIIHUHQWLDWH DQJLRP\ROLSRPD $0/DQG UHQDO FHOO FDUFLQRPD5&& 0HWKRGVDQG0DWHULDOV2IWKHVHWZHQW\WZRSDWLHQWVZLWKKLJKO\VXVSHFWHGUHQDO GLVHDVHZKRXQGHUZHQWVLQJOHVRXUFHGXDOHQHUJ\&7VFDQQLQJEHWZHHQ-XO\ DQG$SULOVHYHQWHHQHLJKWSDWLHQWVKDG$0/QLQH5&&XQGHUZHQWFRUWL FRPHGXOODU\QHSKURJUDSKLFDQGH[FUHWRU\SKDVHHQKDQFHGVFDQQLQJ7KHUHJLRQV RILQWHUHVW52,ZHUHPDQXDOO\SODFHGRQWKHDFWLYHSDUWRIWKHUHQDOPDVVDQG WKHDEGRPLQDODRUWD7KHDYHUDJHLRGLQHFRQFHQWUDWLRQVRI52,VDQGDEGRPLQDO DRUWDZHUHREWDLQHG5HSHDWHGPHDVXUHDQDO\VLVZDVFRQGXFWHGZLWK6366DQG %RQIHUURQLDGMXVWHGSZDVXVHGIRUPXOWLSOHFRPSDULVRQV 5HVXOWV 7KH DYHUDJH LRGLQH FRQFHQWUDWLRQV RI WKH DFWLYH SDUW RI$0/ LQ WKUHH HQKDQFHG SKDVHV ZHUH PJFF PJFF DQG PJ FFUHVSHFWLYHO\$QGWKRVHRI5&&ZHUHPJFFPJFFDQG PJFF7KHDYHUDJHLRGLQHFRQFHQWUDWLRQVZHUHVLJQLÀFDQWO\GLIIHUHQW EHWZHHQ$0/ DQG 5&& LQ DOO HQKDQFHG SKDVHV S S S HVSHFLDOO\LQFRUWLFRPHGXOODU\SKDVH7KHLRGLQHFRQFHQWUDWLRQFKDQJHSDWWHUQV RIWKUHHSKDVHVEHWZHHQ $0/DQG5&&ZHUHDOVRVLJQLÀFDQWO\GLIIHUHQWS &RQFOXVLRQ7KHVH SUHOLPLQDU\ UHVXOWV VXJJHVW WKDW LRGLQH FRQFHQWUDWLRQ FRXOG SURYLGH DQRWKHU KHOSIXO PHWKRG WR GLIIHUHQWLDWH$0/ DQG 5&& LQDGGLWLRQ WR FRQYHQWLRQDO &7 ,I WKHVH UHVXOWV DUH FRQÀUPHG WKLV DSSURDFK FRXOG SRWHQWLDOO\ GLIIHUHQWLDWH$0/DQG5&&ZLWKWKHDFWLYHSDUWRIWKHPDVVQRPDWWHUWKHIDWLQ $0/DUHPLQLPDORUPXFK % /RZGRVHXQHQKDQFHG0'&7ZLWKUDGLDWLRQGRVHHTXLYDOHQWWR DEGRPLQDOUDGLRJUDSKLQHYDOXDWLRQRIDFXWHÁDQNSDLQ 6*RHO$7 DQGRQ*0HKURWUD6.%KDUJDYD6%KDWW,6LQJK $6ULYDVWDYD1HZ'HOKL,1GRFVDQGHHSJRHO#JPDLOFRP 3XUSRVH7 RGHWHUPLQHWKHGLDJQRVWLFHIÀFDF\RIORZGRVHXQHQKDQFHG0'&7 GHOLYHULQJ UDGLDWLRQ GRVH HTXLYDOHQW WR DEGRPLQDO UDGLRJUDSK LQ HYDOXDWLRQ RI SDWLHQWVZLWKDFXWHÁDQNSDLQLQFRPSDULVRQWRVWDQGDUGGRVH&7 0HWKRGVDQG0DWHULDOV $SURVSHFWLYHVWXG\ZDVFRQGXFWHGLQSDWLHQWVSUHVHQW LQJZLWKDFXWHÁDQNSDLQDIWHUHWKLFDOFRPPLWWHHFOHDUDQFHDQGLQIRUPHGFRQVHQW $OO SDWLHQWV XQGHUZHQW XQHQKDQFHG ORZ GRVH &7 /'&7 HIIHFWLYH P$V DQGIROORZHGE\XOWUDVRXQGDQGVWDQGDUGGRVH&76'&7HIIHFWLYHP$V 7KUHH UHYLHZHUV ZKR ZHUH EOLQGHG WR FOLQLFDO ÀQGLQJV LQGHSHQGHQWO\ UHYLHZHG /'&7 XOWUDVRXQGDQG6'&7IRUSDWKRORJ\DQGLPDJHTXDOLW\JUDGHGDVJRRG DFFHSWDEOHRUSRRU 5HVXOWVRISDWLHQWVKDGFDOFXOXVGLVHDVHZKLOHKDGQRQFDOFXOXVXUR ORJLFDOFDXVHVDQGKDGH[WUDXULQDU\FDXVHVUHVSRQVLEOHIRUSDLQ1RFDXVH ZDVIRXQGLQSDWLHQWV&DOFXOXVGHWHFWLRQUDWHZDVIRU/'&7 IRU 6'&7DQGIRUXOWUDVRXQG7KHPHDQVL]HRIFDOFXOXVPLVVHGRQ/'&7ZDV PP,QWHUREVHUYHUDJUHHPHQWLQFDOFXOXVGHWHFWLRQDPRQJVWWKUHHUHYLHZHUV ZDVH[FHOOHQW7KHVHQVLWLYLW\IRUGHWHFWLRQRIQRQFDOFXOXVFDXVHVZDVIRU /'&7 IRU6'&7DQGIRUXOWUDVRXQG0HDQUDGLDWLRQGRVHLQ/'&7 DQG6'&7ZDVP6YDQGP6YUHVSHFWLYHO\2QO\RIORZGRVHVFDQV ZHUHUDWHGDVRISRRUTXDOLW\ &RQFOXVLRQ/RZGRVHXQHQKDQFHG0'&7UHYHDOHGDKLJKVHQVLWLYLW\IRUXUROLWKL DVLVDQGPRGHUDWHVHQVLWLYLW\IRUGLDJQRVLQJDOWHUQDWHFDXVHVRIDFXWHÁDQNSDLQ 7KXVLWKDVSRWHQWLDOWREHXVHGDVDÀUVWOLQHPRGDOLW\LQHYDOXDWLRQRIWKHVHSDWLHQWV UHFRQVWUXFWHGXVLQJ)%3DVZHOODV,57ZLWKGLIIHUHQWLWHUDWLRQOHYHOVZLWKDSURWR W\SHLPDJHUHFRQVWUXFWLRQV\VWHP5HVXOWLQJLPDJHVZHUHDQDO\VHGZLWKREMHFWLYH QRLVHPHDVXUHPHQWVGHÀQHGDVVWDQGDUGGHYLDWLRQRIDYHUDJHGHQVLW\YDOXHVLQ WKHOLYHUDVDKRPRJHQRXVRUJDQ 5HVXOWV $EVROXWHQRLVHOHYHOVLQLPDJHUHFRQVWUXFWLRQVZLWKÀOWHU%ZHUHUHGXFHG IURP )%3 WR +8 KLJKHVW OHYHO ,57 5HODWLYH QRLVH LQ ,57 LPDJHV FRPSDUHG WR )%3 LPDJHV ZDV UHGXFHG E\ ZLWK RQO\ PLQLPDO HIIHFWV RQ VXEMHFWLYHLPDJHTXDOLW\ &RQFOXVLRQ%\ WKH XVH RI D IRXUWK JHQHUDWLRQ ,57 IRU&7H[DPLQDWLRQV RI WKH DEGRPHQDUHGXFWLRQRILPDJHQRLVHRIXSWRFDQEHDFKLHYHG % 5HGXFLQJ[UD\GRVHIRUOLYHUSHUIXVLRQRQDQH[WHQGHGFRYHUDJH PXOWLVOLFH&7ZLWKDUHOD[HGWHPSRUDOUHVROXWLRQ < *H ==KRX7 &KHQJ< *XR;6X-/L=KHQJ]KRX&1%HLMLQJ&1 FMUJH\LQJKXL#YLSFRP 3XUSRVH7 RLQYHVWLJDWHWKHIHDVLELOLW\RIUHGXFLQJ&7[UD\GRVHLQOLYHUSHUIXVLRQ XVLQJDUHOD[HGWHPSRUDOUHVROXWLRQ75LQD[LDOVFDQPRGH 0HWKRGVDQG0DWHULDOVSDWLHQWVXQGHUZHQW&7SHUIXVLRQVFDQVIRUVXVSLFLRQ RIWXPRXUV7KHÀUVWSDWLHQWVJURXSXQGHUZHQWPPSHUIXVLRQVFDQVZLWK V75IRUVDPSOHVZKLOHWKHVHFRQGSDWLHQWVJURXSXQGHUZHQWPP SHUIXVLRQ VFDQV ZLWK V 75 IRU VDPSOHV 7XEH FXUUHQWV ZHUH P$V DQG P$VIRUJURXSVDQGUHVSHFWLYHO\7KHUHJLRQDOFHUHEUDOEORRGÁRZU&%) UHJLRQDOFHUHEUDOEORRGYROXPHU&%9PHDQWUDQVLWWLPH077DQGWKHUDGLDWLRQ GRVHIURPWKHWZRJURXSVZHUHDQDO\VHGE\WWHVW,QDGGLWLRQWKHGHWHFWLRQUDWHV IRUQRGXOHVZLWKULFKDUWHULDOEORRGVXSSO\ZHUHFRPSDUHGDQGYHULÀHGE\SDWKRORJ\ 5HVXOWV7KHUH ZHUH V+&& 51 &+ DQG OLYHU DEVFHVV SDWLHQWV7KH PP VFDQV GHWHFWHG PRUH V+&& IRFXVHV DQG PRUH &+ FDVHV 7KH U&%) POÃ JÃPLQ U&%9 POÃ J DQG 077 V IRU JURXSV DQG ZHUH DQG UHVSHFWLYHO\ZLWKQRVWDWLVWLFDOGLIIHUHQFHVEHWZHHQWKHVHSDUDPHWHUV S!7KHUDGLDWLRQGRVHIURPJURXSZLWKPPFRYHUDJHZDVVLPLODUWR JURXSZLWKPPFRYHUDJH &RQFOXVLRQ:LWKWKHXVHRIDQDSSURSULDWH75XSWRVWKHPPFRYHUDJH D[LDOSHUIXVLRQVFDQVSURYLGHGKLJKHUQRGXOHGHWHFWLRQUDWHZLWKRXWGRVHLQFUHDVH FRPSDUHGWRFRQYHQWLRQDOPPFRYHUDJH0'&7SHUIXVLRQVFDQV % $EGRPLQDO&7ZLWKPRGHOEDVHGLWHUDWLYHUHFRQVWUXFWLRQ FRPSDULVRQZLWKDGDSWLYHVWDWLVWLFDOLWHUDWLYHDQGÀOWHUHGEDFN SURMHFWLRQUHFRQVWUXFWLRQ &6X]XNL01DJDWD..LWDJDZD60XUDVKLPD11DJDVDZD+6DNXPD 7 VX0LH-3FKVX]XNL#FOLQPHGLFPLHXDFMS 3XUSRVH7 RLQYHVWLJDWHLIPRGHOEDVHGLWHUDWLYHUHFRQVWUXFWLRQ0%,5FDQLPSURYH WKHTXDOLW\RIDEGRPLQDO&7LPDJHVDQGYROXPHUHQGHUHG95&7SRUWRJUDSK\ LQFRPSDULVRQZLWKDGDSWLYHVWDWLVWLFDOLWHUDWLYHUHFRQVWUXFWLRQ$6,5DQGÀOWHUHG EDFNSURMHFWLRQ)%3 0HWKRGVDQG0DWHULDOV7ZHQW\SDWLHQWV\HDUVXQGHUZHQWWKUHHSKDVH FRQWUDVWHQKDQFHGVOLFH&7RIWKHOLYHU,PDJHVZHUHUHFRQVWUXFWHGZLWK0%,5 9HR$6,5DQG)%3 7KHFRQWUDVWWRQRLVHUDWLR&15UHODWLYHWRPXVFOH ZDVFDOFXODWHGIRUWKHOLYHUDQGSRUWDOYHLQRQPPWKLFNLPDJHVDFTXLUHGLQ SRUWDOYHQRXVSKDVH7KHLPDJHTXDOLW\RIWKEUDQFKHVRIWKHSRUWDOYHLQRQ95 LPDJHVZDVDVVHVVHGE\WZRREVHUYHUVXVLQJDSRLQWVFDOHSRRUIDLU JRRGH[FHOOHQWZLWKFOHDUGHOLQHDWLRQRIWKEUDQFKHV 5HVXOWV0%,5VKRZHGVLJQLÀFDQWO\LPSURYHG&15RIWKHOLYHULQFRP SDULVRQZLWKWKRVHE\$6,5S E\0DQQ:KLWQH\8WHVWDQG)%3 S 7KH&15RISRUWDOYHLQZDVEHLQJVLJQLÀFDQWO\KLJKHU WKDQWKRVHE\$6,5SDQG)%3S2QTXDOLWD WLYHDQDO\VLVWKHLPDJHTXDOLW\VFRUHRISRUWDOYHLQEUDQFKHVRQ95SRUWRJUDSK\ ZDVVLJQLÀFDQWO\LPSURYHGXVLQJ0%,5DVFRPSDUHGZLWKWKRVHE\$6,5 SE\:LOFR[RQVLJQHGUDQNVWHVWDQG)%3S &RQFOXVLRQ7KHQHZ0%,5DOJRULWKPVLJQLÀFDQWO\HQKDQFHV&15VRIDEGRPLQDO &7 DQGFDQSURYLGHVXEVWDQWLDOO\LPSURYHGYLVXDOLVDWLRQRISRUWDOYHQRXVEUDQFKHV ZKHQFRPSDUHGZLWK$6,5DQG)%3 6FLHQWLILF6HVVLRQ 6 &$' ( ) *+% (XURSHDQ&RQJUHVVRI 5DGLRORJ\ % 4XDQWLÀFDWLRQRIP\RFDUGLDOLVFKDHPLDDQGLQIDUFWVE\DGHQRVLQH VWUHVVKLJKSLWFK'6&7 7 'H=RUGR ) 9HJD+LJXHUD53 *RHWWL$3ODVV) 3ODQN$.ODXVHU 6/HVFKND+$ONDGKL*)HXFKWQHU,QQVEUXFN$7/D&RUXxD(6 =XULFK&+6W*DOOHQ&+%RVWRQ0$86 3XUSRVH 7 R HYDOXDWH TXDQWLÀFDWLRQ RI DGHQRVLQH P\RFDUGLDO VWUHVVUHVW&73 XVLQJDFRPELQHGKLJKSLWFKGXDOVRXUFH&73FRURQDU\&7$SURWRFROZLWKD QHZYROXPHWULF'SURWRW\SHVRIWZDUH 0HWKRGVDQG0DWHULDOV $GHQRVLQHVWUHVVKLJKSLWFKVOLFHGXDOVRXUFHP\RFDU GLDO&73SLWFKDQG&057'(ZDVSHUIRUPHGLQSDWLHQWV0\RFDUGLDO SHUIXVLRQGHIHFWVE\&73ZHUHFODVVLÀHGDVFRPSOHWHRUSDUWLDOUHYHUVLEOHDQGÀ[HG GXULQJVWUHVVDQGUHVW $QHZSURWRW\SH6LHPHQV70ZDVXVHGIRUTXDQWLÀFDWLRQRI &7GHQVLW\+8RIWKHP\RFDUGLXPEDVHGRQDXWRPDWHG'YROXPHVHJPHQWDWLRQ LQWR $+$P\RFDUGLDOVHJPHQWV7KHWRWDOVXEHQGRDQGVXEHSLFDUGLDO+8ZHUH TXDQWLÀHG,PDJHTXDOLW\ZDVHYDOXDWHGVFRUH 5HVXOWV7KHWRWDODQGVXEHQGRFDUGLDO+8RIP\RFDUGLDOVHJPHQWVZLWKFRPSOHWH Q DQGSDUWLDOQ UHYHUVLEOHLVFKDHPLDZHUHORZHUGXULQJVWUHVVDVFRP SDUHGWRUHVWWRWDOYVVXEHQGRFDUGLDOYV+8)RUÀ[HGSHUIXVLRQ GHIHFWV+8ZHUHWRWDOYV+8VXEHQGRFDUGLDOYV+8GXULQJ VWUHVVDQGUHVWQ $VFRPSDUHGWR&05'(WRWDODQGVXEHQGRFDUGLDO+8RI VHJPHQWVZLWKP\RFDUGLDOLQIDUFWVZHUHVOLJKWO\ORZHUGXULQJVWUHVVDQG+8 DVFRPSDUHGWRQRUPDOP\RFDUGLXPDQG+8'XULQJVWUHVVQRQHRI/$' DQG/0VHJPHQWVZHUHQRQGLDJQRVWLFZKHUHDVRI&;DQGRI5&$ VHJPHQWVZHUHQRQGLDJQRVWLFDQGUHVW&7$ZDVQHHGHGIRUDVVHVVPHQW5DGLDWLRQ GRVH&73ZDVP6Y &RQFOXVLRQ 4XDQWLÀFDWLRQ RI LVFKDHPLF P\RFDUGLXP GXULQJ DGHQRVLQH VWUHVV KLJKSLWFK'6&7LVSRVVLEOHDWDQXOWUDORZUDGLDWLRQGRVHRIP6Y5HVW&7$ LVUHTXLUHGWRFKDUDFWHULVHP\RFDUGLDOSHUIXVLRQGHIHFWVDQGWRHQVXUHFRURQDU\ &7$DQG'(IRUYLDELOLW\ % '\QDPLF&7SHUIXVLRQLPDJLQJRIWKHP\RFDUGLXPXVLQJDZLGH GHWHFWRU&7VFDQQHUÀUVWUHVXOWV '0XHQ]HO 3 %1RHO95HQ]%0*UDPHU09HPEDU$$)LQJHUOH (-5XPPHQ\$+XEHU0XQLFK'(+LJKODQG+HLJKWV2+86 3XUSRVH7 RHYDOXDWHWKHIHDVLELOLW\RI&7G\QDPLFP\RFDUGLDOSHUIXVLRQLPDJLQJ 03,DWDZLGHGHWHFWRU&7VFDQQHU 0HWKRGVDQG0DWHULDOVSLJVXQGHUZHQWVWUHVV&703,DWDVOLFH0'&7 VFDQQHU,QSLJVDVWHQRVLVRIDFRURQDU\DUWHU\/$'Q /&;Q GLDJRQDO EUDQFKQ ZDVLQGXFHGE\VXEWRWDOEDOORRQRFFOXVLRQVWHQRVLVJURXSSLJVZHUH H[DPLQHGZLWKRXWLQWHUYHQWLRQFRQWUROJURXS7KHVHPLTXDQWLWDWLYHSDUDPHWHUV WLPHWRSHDN773SHDNHQKDQFHPHQW3(XSVORSH86DQGWKHDUHDXQGHU WKHFXUYH$8&ZHUHFRPSDUHGLQWUDDQGLQWHULQGLYLGXDOO\LQSRVWVWHQRWLFDQG QRUPDOP\RFDUGLXP5DGLDWLRQGRVHZDVHVWLPDWHGE\&7',YRO 5HVXOWV 7KH LQWUDLQGLYLGXDO HYDOXDWLRQ VKRZHG VLJQLÀFDQWO\ S KLJKHU PHDQYDOXHVIRU773VDQGORZHUPHDQYDOXHVIRU3(+8 86+8VDQG$8&+8 VLQWKHK\SRSHUIXVHGP\RFDUGLXP FRPSDUHGWRWKHUHPRWHP\RFDUGLXPLQWKHVHSWXPDQGODWHUDOZDOO773 V V 3( +8 +8 86 +8V +8V $8&+8 V+8 67KHLQWHULQGLYLGXDOHYDOXDWLRQVKRZHG VLJQLÀFDQWO\SORZHUPHDQYDOXHVIRU773VDQGKLJKHUPHDQ YDOXHVIRU3(+886+8VDQG$8&+8 VLQ WKHFRQWUROJURXS&7',YROZDVP*\ &RQFOXVLRQ'\QDPLFVWUHVV&7SHUIXVLRQLPDJLQJRIIHUVWKHSRWHQWLDODVVHVVPHQW RIWKHSK\VLRORJLFDOVLJQLÀFDQFHRIFRURQDU\DUWHU\VWHQRVLVWKHUHE\RYHUFRPLQJ RQHRIWKHOLPLWDWLRQVRIFDUGLDF&7 % '\QDPLF&7SHUIXVLRQLPDJLQJRIWKHP\RFDUGLXPFRPSDULVRQRI UHFRQVWUXFWLRQVIURPDQG '0XHQ]HO 3 %1RHO%0*UDPHU95HQ]09HPEDU$$)LQJHUOH (-5XPPHQ\$+XEHU0XQLFK'(+LJKODQG+HLJKWV2+86 3XUSRVH7 RFRPSDUHWKHLPDJHTXDOLW\DQG]D[LVFRYHUDJHXVLQJVWDQGDUG DQG UHFRQVWUXFWLRQ DQDO\VLV IRU&7G\QDPLF P\RFDUGLDO SHUIXVLRQ LPDJLQJ 03, 0HWKRGVDQG0DWHULDOV,QSLJVFRURQDU\DUWHU\VWHQRVLVZDVLQGXFHGE\EDOORRQ RFFOXVLRQ&7G\QDPLF03,ZDVSHUIRUPHGXVLQJDVOLFH0'&7 ,PDJHQRLVH DQGVLJQDOWRQRLVHUDWLR615ZHUHDVVHVVHG7KHVHPLTXDQWLWDWLYHSDUDPHWHUV WLPHWRSHDN773SHDNHQKDQFHPHQW3(XSVORSH86DQGWKHDUHDXQGHU 5RRP/0 &DUGLDF 66D 3HUIXVLRQ&7DQG05, 0RGHUDWRUV 0)UDQFRQH5RPH,7 0*DUGDUVGRWWLU5H\NMDYtN,6 % 4XDQWLÀFDWLRQRIUHJLRQDOP\RFDUGLDOSHUIXVLRQDWGLIIHUHQWOHYHOVRI FRURQDU\ÁRZLQDODUJHDQLPDOPRGHOXVLQJG\QDPLFSHUIXVLRQ&7 $5RVVL(.ORW]'0HUNXV$8LWWHUGLMN10ROOHW3 GH)H\WHU ''XQFNHU*3 .UHVWLQ5RWWHUGDP1/)RUFKKHLP'( 3XUSRVH7 RTXDQWLI\UHJLRQDOFKDQJHVRIVHYHUDOP\RFDUGLDOSHUIXVLRQSDUDPHWHUV DWGLIIHUHQWOHYHOVRIFRURQDU\ÁRZXVLQJ(&*WULJJHUHGG\QDPLFFRQWUDVWHQKDQFHG &7'&(&7 0HWKRGVDQG0DWHULDOV,QVHYHQSLJVDQDGMXVWDEOHK\GUDXOLFRFFOXGHUZDVSODFHG DURXQGWKH/$'WRLQGXFHYDULRXVGHJUHHVRIFRURQDU\ÁRZUHGXFWLRQVFDQV ZHUHSHUIRUPHGXQGHUPD[LPXPDGHQRVLQHYDVRGLODWDWLRQQRREVWUXFWLRQDQGÁRZ UHGXFHGE\WR'\QDPLFGDWDZHUHDFTXLUHGIRUWKHZKROHKHDUWDIWHU EROXVLQMHFWLRQXVLQJDGHGLFDWHG(&*WULJJHUHGVFDQPRGHRQDGXDOVRXUFH&7 8VLQJDWZRFRPSDUWPHQWGHFRQYROXWLRQWHFKQLTXH'PDSVRIP\RFDUGLDOEORRG ÁRZ0%)ÀUVWSDVVGLVWULEXWLRQYROXPH)3'9SHUIXVHGFDSLOODU\EORRGYROXPH 3&%9 DQG ÁRZH[WUDFWLRQSURGXFW )( ZHUH FDOFXODWHG$OO SDUDPHWHUV ZHUH PHDVXUHGLQWKHGRZQVWUHDP/$'DUHDDQGZHUHFRUUHODWHGZLWKUHODWLYHLQSXWÁRZ 5HVXOWV 0%) EDVHOLQH PO POPLQ U VORSH )3'9 EDVHOLQH PO PO U VORSH DQG 3&%9 EDVHOLQH POPOU VORSH VLJQLÀFDQWO\GHFUHDVHGSURSRUWLRQDOWRWKH UHGXFWLRQRIFRURQDU\ÁRZLQWKH/$'S)(EDVHOLQHPOPO PLQRQWKHRWKHUKDQGUHPDLQHGFRQVWDQWXQWLOFRURQDU\ÁRZZDVUHGXFHGWROHVV WKDQ)(YDOXHVEHORZFRURQDU\ÁRZZHUHVLJQLÀFDQWO\ORZHUWKDQ)( YDOXHVDERYH0DQQ:KLWQH\S7KLVDJUHHVZLWKWKHDVVXPSWLRQWKDW SDUHQFK\PDOÁRZGRHVQRWGHFUHDVHXQWLOWKHFRURQDU\ÁRZUHVHUYHLVH[KDXVWHG &RQFOXVLRQ'&(&7LVVXLWDEOHIRUWKHDVVHVVPHQWRIUHJLRQDOP\RFDUGLDOSHU IXVLRQSDUDPHWHUVDQGFDQEHXVHGWRVWXG\PLFURFLUFXODWRU\FKDQJHVDWYDULRXV GHJUHHVRIFOLQLFDOO\UHOHYDQWFRURQDU\ÁRZUHGXFWLRQVLQDODUJHDQLPDOPRGHO % 0\RFDUGLDOSHUIXVLRQ05,DW7XVLQJNW%/$67LQSDWLHQWVZLWK FRURQDU\DUWHU\VWHQRVHVRIXQFOHDUKDHPRG\QDPLFUHOHYDQFH 3 %LVFKRII5/'XVFKND) +LPPHO.0D\3 :5DGNH$.RYDFV) 09RJW -%DUNKDXVHQ3 +XQROG/EHFN'( 3XUSRVH7 RHYDOXDWHKLJKÀHOGP\RFDUGLDOSHUIXVLRQ05,XVLQJNW%/$67IRULV FKDHPLDGHWHFWLRQLQNQRZQFRURQDU\VWHQRVLVRIXQFOHDUKDHPRG\QDPLFUHOHYDQFH 0HWKRGVDQG0DWHULDOV7ZHOYHSDWLHQWVDJH\UVPDOHVZLWKNQRZQ FRURQDU\ DUWHU\ GLVHDVH &$' DQG DQJLRJUDSKLFDOO\ FDWK SURYHQ VWHQRVLV RI LQGHÀQLWHKDHPRG\QDPLFUHOHYDQFHZHUHLQFOXGHG)LUVWSDVVP\RFDUGLDOSHUIXVLRQ VWUHVV05,7 $FKLHYD3KLOLSVZDVSHUIRUPHGLQFOXGLQJ&LQH66)3LQORQJDQG VKRUW D[HV DFFHOHUDWHG NW%/$67 SHUIXVLRQ VSDWLDO UHVROXWLRQ [ PP LQ VKRUWD[HVGXULQJDGHQRVLQHVWUHVVDQGDWUHVWZLWKPPRONJJDGREXWURO HDFK IROORZHG E\ ',57)( ODWH HQKDQFHPHQW LPDJLQJ 05, SHUIXVLRQ GDWD ZHUHFRPSDUHGWRFDWKUHVXOWVVXJJHVWHGPHGLXPWRKLJKJUDGHVWHQRVLVRQD FRURQDU\YHVVHOEDVLV 5HVXOWV,QWRWDOFRURQDU\WHUULWRULHV/$'5&$5&;ZHUHHYDOXDWHG,Q FRURQDU\WHUULWRULHVZLWKVXJJHVWHGKLJKJUDGHVWHQRVLV05,FRUUHVSRQGHG/$' Q 5&;Q 5&$Q 05,SHUIXVLRQGHIHFWVLQDQWLFLSDWHGORZJUDGHVWHQRVHV ZHUHGHWHFWHGLQYDVFXODUDUHDV/$'5&$ZKHUHDVSRVLWLYHFDWKÀQGLQJV ZLWKRXWLVFKDHPLDZHUHGHWHFWHGLQYDVFXODUDUHDV/$'5&;5&$ ,QYDVFXODUWHUULWRULHV05,DQGDQJLRJUDSK\VKRZHGQHJDWLYHUHVXOWV7KXV 05,GLVFRYHUHGGLVFUHSDQFLHVEHWZHHQYLVXDOJUDGLQJRIVWHQRVLVFDWKDQGWKH KDHPRG\QDPLFUHOHYDQFH05,LQSDWLHQWVYDVFXODUDUHDV &RQFOXVLRQ0\RFDUGLDOSHUIXVLRQ05,DW7XVLQJNW%/$67SURYLGHVUHOHYDQW LQIRUPDWLRQIRULQGLFDWLQJFRURQDU\LQWHUYHQWLRQLQNQRZQ&$'VROYLQJPLVPDWFK SUREOHPVEHWZHHQYLVXDOVWHQRVLVJUDGLQJDQDWRP\DQGSHUIXVLRQSK\VLRORJ\ 7KH FRPELQDWLRQ RI KLJKÀHOG DQG UDSLG DFTXLVLWLRQ \LHOGV LPSURYHG GLDJQRVWLF TXDOLW\ 3URVSHFWLYH 05, VWXGLHV LQ FRPSDULVRQ ZLWK FRURQDU\ ÁRZ UHVHUYH DUH QHHGHGWRDVVHVVWKHGLDJQRVWLFEHQHÀW 6FLHQWLILF6HVVLRQ $ 6&'()*+% 7KXUVGD\ (XURSHDQ&RQJUHVVRI 5DGLRORJ\ DQG139RIDVFRPSDUHGWR63(&703,$GGLWLRQRI&73ÀQGLQJVWR &7$LPSURYHGWKH339IURPWRSULPDULO\E\UHGXFHGIDOVHSRVLWLYHV &RQFOXVLRQ,QSDWLHQWVSUHVHQWLQJWRWKH('ZLWK&3 WKHHYDOXDWLRQRIUHVWP\R FDUGLDO&73GHPRQVWUDWHVKLJKGLDJQRVWLFSHUIRUPDQFHDVFRPSDUHGWR63(&7 03,$GGLWLRQRI&73WR&7$LPSURYHVWKHGLDJQRVWLFDFFXUDF\RI&7$SULPDULO\ E\UHGXFLQJUDWHVRIIDOVHSRVLWLYH&7$ % 3HUIXVLRQGHÀFLWVRIWKHP\RFDUGLXPDFRPSDULVRQRIG\QDPLF&7 SHUIXVLRQLPDJLQJDQGFRURQDU\FRPSXWHGWRPRJUDSK\DQJLRJUDSK\ %0*UDPHU '0XHQ]HO3 %1RHO95HQ]09HPEDU$$)LQJHUOH (-5XPPHQ\$+XEHU0XQLFK'(+LJKODQG+HLJKWV2+86 3XUSRVH7 RFRPSDUHWKHSRWHQWLDORIGHWHFWLRQRIP\RFDUGLDOSHUIXVLRQGHÀFLWV XVLQJ&7G\QDPLFP\RFDUGLDOSHUIXVLRQLPDJLQJ03,DQG´VLQJOHVKRWµFRURQDU\&7 DQJLRJUDSK\&&7$IRUGHWHFWLRQRIK\SRSHUIXVHGP\RFDUGLXPLQDQDQLPDOPRGHO 0HWKRGVDQG0DWHULDOVSLJVXQGHUZHQWUHVW&703,N9P$VDQG UHWURVSHFWLYHO\(&*JDWHG&&7$N9P$VXVLQJDVOLFHPXOWLGHWHFWRU FRPSXWHGWRPRJUDSK\VFDQQHU0'&7&RPSOHWHEDOORRQRFFOXVLRQRIDFRURQDU\ DUWHU\/$'Q /&; GLDJRQDOEUDQFKQ ZDVLQGXFHG$WWHQXDWLRQYDOXHV RISRVWVWHQRWLFDQGQRUPDOP\RFDUGLXPZHUHFRPSDUHGLQWUDLQGLYLGXDOO\IRU03, DQG&&7$,PDJHQRLVHDQGVLJQDOWRQRLVHUDWLR615IRUQRUPDOP\RFDUGLXP DQGK\SRSHUIXVHGP\RFDUGLXPZHUHDVVHVVHG 5HVXOWV 0HDQ GHQVLWLHV EHWZHHQ ERWK JURXSV ZHUH QRW VLJQLÀFDQWO\ GLIIHUHQW IRU &&7$ +8 DQG 03, +8 DW SHDN HQKDQFHPHQW S +\SRSHUIXVHG WHUULWRULHV VKRZHG VLJQLÀFDQWO\ ORZHU +8 FRPSDUHG WRUHPRWHP\RFDUGLXPLQWKHVHSWXPDQGODWHUDOZDOOLQ&&7$+8 YV +8 DQG +8 UHVSHFWLYHO\ S DQG 03, +8YV+8DQG+8UHVSHFWLYHO\S ,PDJHQRLVHZDV+8LQ&&7$DQG+8LQ03,S615 ZDVKLJKHULQ03,FRPSDUHGWR&&7$S &RQFOXVLRQ+\SRSHUIXVHGFRURQDU\WHUULWRULHVVXSSOLHGE\FRPSOHWHO\RFFOXGHG DUWHULHV FDQ EH GHWHFWHG LQ ERWK VLQJOH VKRW &&7$ DW RQH WLPH SRLQW DQG ZLWK G\QDPLF&703, % 0\RFDUGLDOSHUIXVLRQLPDJLQJXVLQJDGHQRVLQHLQGXFHGVWUHVVGXDO HQHUJ\FRPSXWHGWRPRJUDSK\RIWKHKHDUWFRPSDULVRQZLWKVLQJOH SKRWRQHPLVVLRQFRPSXWHGWRPRJUDSK\DQGFRQYHQWLRQDOFRURQDU\ DQJLRJUDSK\ 62X6Q/L*P3HQJ< [*XR*XDQJ]KRX&1OKT [[K#FRP 3XUSRVH7 RHYDOXDWHWKHIHDVLELOLW\DQGGLDJQRVWLFDFFXUDF\RIDGHQRVLQHVWUHVV GXDOHQHUJ\FRPSXWHGWRPRJUDSK\'(&7IRUGHWHFWLQJKDHPRG\QDPLFDOO\VLJQLÀ FDQWVWHQRVLVFDXVLQJUHYHUVLEOHP\RFDUGLDOSHUIXVLRQGHIHFW3'FRPSDUHGZLWK 63(&7 P\RFDUGLDO SHUIXVLRQ LPDJLQJ 63(&703, DQG FRQYHQWLRQDO FRURQDU\ DQJLRJUDSK\&&$ 0HWKRGVDQG0DWHULDOV7KLUW\IRXUSDWLHQWVZLWKNQRZQFRURQDU\DUWHU\GLVHDVH &$'GHWHFWHGE\GXDOVRXUFH&7'6&7ZHUHLQYHVWLJDWHGE\FRQWUDVWHQKDQFHG VWUHVV'(&7ZLWKKLJKDQGORZHQHUJ\[UD\VSHFWUDVHWWLQJVGXULQJDGHQRVLQH LQIXVLRQ'XDOVRXUFHFRPSXWHGWRPRJUDSK\'6&7ZDVSHUIRUPHGDVIROORZV VWUHVV&7 FRQWUDVWHQKDQFHGVFDQGXULQJDGHQRVLQHLQIXVLRQUHVW&7 FRQWUDVW HQKDQFHGVFDQXVLQJSURVSHFWLYHWULJJHULQJ 5HVXOWV7KH'6&7SURWRFROZDVVXFFHVVIXOO\FRPSOHWHGIRURIVXEMHFWV DYHUDJHDJH\HDUVPDOHERG\PDVVLQGH[NJPZLWKDQ DYHUDJHUDGLDWLRQGRVHRIP6Y$WRWDORIP\RFDUGLDOVHJPHQWVDQG YDVFXODUWHUULWRULHVRISDWLHQWVZHUHDQDO\VHGVHJPHQWVDQGYDVFXODU WHUULWRULHVLQSDWLHQWVVKRZHGUHYHUVLEOH3'VRQVWUHVV'(&76WUHVV'(&7KDG VHQVLWLYLW\ VSHFLÀFLW\ DQG DFFXUDF\ IRU GHWHFWLQJVHJPHQWV ZLWK UHYHUVLEOH3'VVHHQRQ63(&703,Q &RPSDUHGZLWK&&$Q VWUHVV '(&7KDGVHQVLWLYLW\VSHFLÀFLW\DQGDFFXUDF\IRUWKHGHWHFWLRQRI YDVFXODU WHUULWRULHV ZLWK UHYHUVLEOH P\RFDUGLDO 3'V WKDW KDG KDHPRG\QDPLFDOO\ UHOHYDQW&$' &RQFOXVLRQ $GHQRVLQHVWUHVV&7FDQLGHQWLI\VWUHVVLQGXFHGP\RFDUGLDOSHUIXVLRQ GHIHFWVZLWKGLDJQRVWLFDFFXUDF\FRPSDUDEOHWR63(&7 ZLWKVLPLODUUDGLDWLRQGRVH DQGZLWKWKHDGYDQWDJHRISURYLGLQJLQIRUPDWLRQRQFRURQDU\VWHQRVLV WKHFXUYH $8& ZHUH FRPSDUHG LQWUDLQGLYLGXDOO\ LQ SRVWVWHQRWLF DQG QRUPDO P\RFDUGLXP=D[LVFRYHUDJHRIUHFRQVWUXFWHG'VFDQYROXPHVZDVHVWLPDWHG LQFRURQDOUHIRUPDWLRQV 5HVXOWV7KHLQWUDLQGLYLGXDOHYDOXDWLRQVKRZHGVLJQLÀFDQWO\SKLJKHUYDOXHV IRU773VHFDQGORZHUYDOXHVIRU3(+886+8V DQG $8&+8 VLQWKHK\SRSHUIXVHGP\RFDUGLXPFRPSDUHGWRWKHUHPRWH P\RFDUGLXP773VHFVHF3(+8+8 86 +8V +8V$8& +8 V +8 6 ÀOWHUHGUHFRQVWUXFWLRQDQDO\VLVVLJQLÀFDQWO\UHGXFHGLPDJHQRLVHZLWK+8 FRPSDUHGWR+8LQUHFRQVWUXFWHGLPDJHVS615ZDV LQFUHDVHGZLWKYHUVXVS=FRYHUDJHZDV LQFUHDVHGRIDERXWFPXVLQJUHFRQVWUXFWLRQPPYV PPS &RQFOXVLRQ 5HFRQVWUXFWLRQV IURP LPSURYH LPDJH TXDOLW\ RI G\QDPLF &7 03, DQG LQFUHDVH ]D[LV FRYHUDJH RI ' LPDJLQJ YROXPHV XVLQJ DVOLFH 0'&7VFDQQHU % $VVRFLDWLRQEHWZHHQP\RFDUGLDOEORRGÁRZDVPHDVXUHG E\G\QDPLFDGHQRVLQHPHGLDWHGVWUHVVSHUIXVLRQFRPSXWHG WRPRJUDSK\DQGFRURQDU\DUWHU\ÁRZLQDODUJHDQLPDOPRGHO 53 0DUFXV) %DPEHUJ7 6DQGHU) 6FKZDU](%DORFK 5+LQNHO'7KHLVHQ.-+LOGHEUDQGW.1LNRODRX 0XQLFK'(IDELDQEDPEHUJ#PHGXQLPXHQFKHQGH 3XUSRVH7 RGHWHUPLQHWKHDVVRFLDWLRQEHWZHHQP\RFDUGLDOEORRGÁRZ0%)DV PHDVXUHGE\&7EDVHGG\QDPLFVWUHVVSHUIXVLRQLPDJLQJDQGFRURQDU\DUWHU\ÁRZ E\VHQVRUWLSSHGÁRZZLUHLQDSRUFLQHPRGHOZLWKYDULDEOHGHJUHHVRILQGXFHG FRURQDU\VWHQRVLV 0HWKRGVDQG0DWHULDOV6HYHQGRPHVWLFSLJVUHFHLYHGVWHQWVLQWKH/$'GLVWDOWR ÀUVWGLDJRQDOEUDQFKLQZKLFKDEDOORRQFDWKHWHUZDVLQÁDWHGWRVLPXODWHOXPLQDO QDUURZLQJ DQG GLDPHWHU VWHQRVLV ,QWUDDUWHULDO ÁRZ PHDVXUHPHQWV ZHUHSHUIRUPHGDWHDFKSHUIXVLRQVWDWH $OOPRGHOVXQGHUZHQWDGHQRVLQHPHGLDWHG ѥJNJPLQG\QDPLFVWUHVVDQGUHVWP\RFDUGLDOSHUIXVLRQ&7LPDJLQJXVLQJD GXDOVRXUFH&7VKXWWOHPRGHN9P$VPO,RSURPLGH0%)ZDVFDOFX ODWHGIRUHDFKP\RFDUGLDOVHJPHQWXVLQJDPRGHOEDVHGSDUDPHWULFGHFRQYROXWLRQ PHWKRGDQGFRUUHODWHGZLWKUHVXOWVRIFRURQDU\ÁRZPHDVXUHPHQW 5HVXOWV $WUHVWPHDVXUHGFRURQDU\ÁRZLQDQGFRURQDU\DUWHU\VWHQRVLV ZHUHDQGFPVHFUHVSHFWLYHO\8QGHUVWUHVVFRQGLWLRQFRUR QDU\ÁRZLQFUHDVHGWRFPVHFDWVWHQRVLVDQGGHFUHDVHGDW FRURQDU\VWHQRVLVWRFPVHFVLPLODUWR0%)GHULYHGE\&7YV POJPLQS7KHLQFUHDVHLQFRURQDU\ÁRZRIFPVHFDW VWHQRVLVXQGHUVWUHVVZDVDVVRFLDWHGZLWKDQLQFUHDVHRIPOJPLQLQ0%)&7 WKHGHFUHDVHLQFRURQDU\ÁRZDWXQGHUVWUHVVPOVHFZDVDVVRFLDWHG ZLWKDGHFUHDVHLQ0%)RIPOJPLQ &RQFOXVLRQ 2XU UHVXOWV LQGLFDWH WKDW &7GHULYHG H0%) PHDVXUHPHQWV DW UHVW DQGVWUHVVZLWKYDU\LQJGHJUHHVRIFRURQDU\VWHQRVLVDVVRFLDWHZHOOZLWKUHVXOWV RIFRURQDU\ÁRZPHDVXUHPHQWVLQDODUJHDQLPDOPRGHO % (YDOXDWLRQRIP\RFDUGLDO&7SHUIXVLRQLQSDWLHQWVSUHVHQWLQJZLWK DFXWHFKHVWSDLQWRWKHHPHUJHQF\GHSDUWPHQWFRPSDULVRQZLWK 63(&703, *)HXFKWQHU ) 3ODQN-%DWOOH-/HLSVLF7 'H]RUGR-0LQ-=LIIHU %.DW]HQ5&XU\,QQVEUXFN$70LDPL)/869DQFRXYHU'&&$ /RV$QJHOHV&$86*XGUXQ)HXFKWQHU#LPHGDFDW 3XUSRVH7 RHYDOXDWHUHVWLQJP\RFDUGLDO&7SHUIXVLRQ&73IURPFRURQDU\&7 DQJLRJUDSK\&7$GDWDVHWVLQSDWLHQWVSUHVHQWLQJZLWKFKHVWSDLQ&3WRWKH(' LQFRPSDULVRQZLWKP\RFDUGLDO63(&7 0HWKRGVDQG0DWHULDOVSDWLHQWVPHDQDJHIHPDOHVSULRU FRURQDU\UHYDVFXODULVDWLRQDQGZLWKSULRU0,SUHVHQWLQJZLWK&3WRWKH(' XQGHUZHQWFRURQDU\VOLFH&7DQJLRJUDSK\&7$0\RFDUGLDOSHUIXVLRQGHIHFWV ZHUHHYDOXDWHGIRU&73HPSOR\LQJDQ$+$VHJPHQWPRGHO&73UHVXOWVZHUH FRPSDUHGWRUHVWVHVWDPLEL63(&7P\RFDUGLDOSHUIXVLRQLPDJLQJ03,SHUSDWLHQW DQGSHUVHJPHQW&7$ZDVDVVHVVHGIRU!VWHQRVLVSHUYHVVHODQGFRPSDUHG WR VWUHVVUHVW 63(&7 &RPELQHG &7$&73 DSSURDFK ZDV WHVWHG XVLQJ YHVVHO WHUULWRU\EDVHGPHWKRG 5HVXOWV&73GHPRQVWUDWHGDQVHQVLWLYLW\RIDQGVSHFLÀFLW\RIDQG SRVLWLYH SUHGLFWLYH YDOXH 339 RI DQG DQG QHJDWLYH SUHGLFWLYH YDOXH139RIDQGRQDSHUSDWLHQWDQGSHUVHJPHQWEDVLVUHVSHFWLYHO\ 7KHLQWHUPRGDOLW\DJUHHPHQWRI&73WR63(&703,ZDVNDSSD S &7$VKRZHGDQDFFXUDF\RIVHQVLWLYLW\RIVSHFLÀFLW\RI339 6FLHQWLILF6HVVLRQ 6 &$' ( ) *+% (XURSHDQ&RQJUHVVRI 5DGLRORJ\ % &OLQLFDOHYDOXDWLRQDQGSRWHQWLDOUDGLDWLRQGRVHUHGXFWLRQRIWKH QRYHOVLQRJUDPDIÀUPHGLWHUDWLYHUHFRQVWUXFWLRQWHFKQLTXH6$),5( LQDEGRPLQDOFRPSXWHGWRPRJUDSK\DQJLRJUDSK\ &6FKDEHO '.HWHOVHQ0)HQFKHO%6FKPLGW7 *)ORKU$.RUQ &7KRPDV&'&ODXVVHQ0+HXVFKPLG&6FKUDPO7ELQJHQ'( )RUFKKHLP'( 3XUSRVH7 RHYDOXDWHWKHQRYHOVLQRJUDPDIÀUPHGLWHUDWLYHUHFRQVWUXFWLRQDOJR ULWKP6$),5(ZLWKUHVSHFWWRFOLQLFDOXVDELOLW\DQGSRWHQWLDOUHGXFWLRQRIUDGLDWLRQ H[SRVXUH 0HWKRGVDQG0DWHULDOV)RUW\VL[SDWLHQWVXQGHUZHQWURXWLQHFRQWUDVWHQKDQFHG &7IROORZXSDIWHUHQGRYDVFXODUDQHXU\VPUHSDLU7KHH[DPLQDWLRQZDVSHUIRUPHG ZLWKDGXDOVRXUFH&7UXQQLQJERWK[UD\WXEHGHWHFWRUV\VWHPVDWWKHVDPHYROW DJH5DZGDWDZHUHUHFRQVWUXFWHGXVLQJWKHSURMHFWLRQVRIERWKWXEHV)'ZLWK ÀOWHUHGEDFNSURMHFWLRQ)%3DQGXVLQJRQO\WKHSURMHFWLRQVRIRQHWXEH+'ZLWK )%3 DQG 6$),5( FRUUHVSRQGLQJ D V\QWKHWLF KDOIGRVH DFTXLVLWLRQ ,PDJH VHWV ZHUHREMHFWLYHO\FRPSDUHGZLWKUHJDUGWRLPDJHQRLVHDQGHGJHVKDUSQHVV7ZR LQGHSHQGHQWUDGLRORJLVWVDVVHVVHGDVHWRIVXEMHFWLYHFULWHULD 5HVXOWV +' 6$),5( LPDJHV VKRZHG VLJQLÀFDQWO\ ORZHU QRLVH WKDQ )' )%3 SDQGHTXDOHGJHVKDUSQHVVS 0RVWRIWKHVXEMHFWLYHO\DVVHVVHG SDUDPHWHUVOLNHGLDJQRVWLFXVDELOLW\DQGGHSLFWLRQRIFRQWUDVWHGYHVVHOVZHUHUDWHG VLPLODULQ+'6DÀUHDQG)')%3LPDJHV)')%3LPDJHVGHSLFWHGÀQHDQDWRPLF VWUXFWXUHVPRUHFOHDUO\SZKLOH+'6$),5(GDWDVHWVKDGVXEMHFWLYHO\OHVV QRLVHS+')%3LPDJHVZHUHVLJQLÀFDQWO\ZRUVHLQHYHU\VXEMHFWLYHDQG REMHFWLYHFULWHULRQS7KHLPDJHWH[WXUHRIWKH+'6$),5(UHFRQVWUXFWHG LPDJHVZDVUHJDUGHGHTXDOWR)')%3GDWDVHWV,QWHUUDWHUDJUHHPHQWZDVIRXQG WREHJRRG)')%3ѣ +')%3ѣ +'6$),5(ѣ &RQFOXVLRQ 8VLQJ WKH 6$),5( DOJRULWKP WKH UDGLDWLRQ GRVH RI KLJKFRQWUDVW DEGRPLQDO&7$FDQEHUHGXFHGIURPDURXWLQHFOLQLFDOOHYHOE\XSWRZKLOH PDLQWDLQLQJJRRGLPDJHTXDOLW\DQGGLDJQRVWLFDFFXUDF\ % +LJKHULRGLQHFRQFHQWUDWLRQSHUPLWVGRVHUHGXFWLRQZKLOHLQFUHDVLQJ FRQWUDVWWRQRLVHUDWLRLQKLJKSLWFKZLGHUDQJH&7DQJLRJUDSK\ ) 6FKZDU].*UDQGO$$UQROGL:+6RPPHU) %DPEHUJ0)5HLVHU &+%HFNHU0XQLFK'(ÁRULDQVFKZDU]#PHGOPXGH 3XUSRVH7 RFRPSDUHFRQWUDVWWRQRLVHUDWLR&15DQGHIIHFWLYHGRVHDWGLIIHUHQW LRGLQHFRQFHQWUDWLRQLQKLJKSLWFKZLGHUDQJH&7DQJLRJUDSK\ 0HWKRGVDQG0DWHULDOV$OOVFDQVZHUHSHUIRUPHGRQDVOLFH&7V\VWHPXV LQJDKLJKSLWFKDFTXLVLWLRQWHFKQLTXHS $VRIWZDUHDOJRULWKPRSWLPLVLQJN9 DQGP$VVHWWLQJVRQWKHEDVLVRIDGMXVWDEOHUHIHUHQFHYDOXHVDQGDWWHQXDWLRQRQ WKHLQLWLDOWRSRJUDPZDVDSSOLHG7ZRVFDQSURWRFROVZHUHFRPSDUHG3URWRFROB$ XVHGPJ,POFRQWUDVWLQMHFWHGDWPOVHFDQGUHIHUHQFHYDOXHVIRUN9DQG P$VVHWWRDQG3URWRFROB%XVHGPJ,POFRQWUDVWLQMHFWHGDWPO VHFDQGUHIHUHQFHYDOXHVIRUN9DQGP$VVHWWRDQGSDWLHQWVZKR KDG XQGHUJRQH &7DQJLRJUDSK\ RI WKH FKHVW DEGRPHQ DQG SHOYLV XVLQJ HLWKHU SURWRFROB$Q RUSURWRFROB%Q ZHUHLQFOXGHGLQWKLVDQDO\VLV7ZRUHDG HUVPHDVXUHGLQWUDYDVFXODUHQKDQFHPHQWDQGVWDQGDUGGHYLDWLRQDWGLIIHUHQW SRLQWV ZLWKLQ WKH DUWHULDO V\VWHP )RU GRVH HVWLPDWLRQ WKH GRVHOHQJWKSURGXFW '/3ZDVUHFRUGHG 5HVXOWV7KHUHZHUHQRVLJQLÀFDQWGLIIHUHQFHVLQVH[UDWLRRU%0,YV S EHWZHHQERWKJURXSV$XWRPDWLFN9VHOHFWLRQXVHGN9N9DQG N9LQDQGSDWLHQWVLQJURXS$DQGLQDQGSDWLHQWVLQJURXS% S2YHUDOOGDWDVHWVRIJURXS%VKRZHGVLJQLÀFDQWO\KLJKHUOHYHOVRIQRLVH +8YV+8S EXWDOVRRIVLJQDO+8YV+8S UHVXOWLQJ LQ KLJKHU &15 LQ JURXS % YV S $SSOLHG '/3 ZDV VLJQLÀFDQWO\ORZHULQJURXS%YVP*\FPS &RQFOXVLRQ,QKLJKSLWFKZLGHUDQJH&7DQJLRJUDSK\KLJKHULRGLQHFRQFHQWUD WLRQSHUPLWVVLJQLÀFDQWGRVHUHGXFWLRQVZKLOHLQFUHDVLQJFRQWUDVWWRQRLVHUDWLR % /RZGRVHPXOWLGHWHFWRUURZ&7DQJLRJUDSK\LQWKHHYDOXDWLRQRI LQIUDUHQDODRUWDDQGSHULSKHUDODUWHULDORFFOXVLYHGLVHDVH 01HVWROD5,H]]L06DQWRUR50DUDQR&'L6WDVL/%RQRPR5RPH,7 3XUSRVH7 RLQYHVWLJDWHWKHSRVVLELOLW\WRUHGXFH[UD\H[SRVXUHGXULQJ&7 $ RI SHULSKHUDO DUWHULHV DQG WR HYDOXDWH WKH LPSDFW RI UDGLDWLRQ GRVH RQ GLDJQRVWLF DFFXUDF\:HDOVRFRPSDUHGWKHGLDJQRVWLFSHUIRUPDQFHDFKLHYHGE\WKUHH&7$ DFTXLVLWLRQSURWRFROVXVLQJSUHWUHDWPHQW'6$DVJROGVWDQGDUG 0HWKRGVDQG0DWHULDOV:HSHUIRUPHGDSURVSHFWLYHVLQJOHFHQWUHUDQGRPLVHG FRPSDULVRQ RI GLIIHUHQW [UD\ H[SRVXUH &7DFTXLVLWLRQ SURWRFROV HQUROOLQJ % %HQHÀWRIFRPELQLQJTXDQWLWDWLYHFDUGLDF&7SDUDPHWHUVZLWK WURSRQLQ,IRUSUHGLFWLQJULJKWYHQWULFXODUG\VIXQFWLRQDQGDGYHUVH FOLQLFDOHYHQWVLQSDWLHQWVZLWKDFXWHSXOPRQDU\HPEROLVP 00H\HU&)LQN65RHJHU3 $SIDOWUHU'+DJKL:.DPLQVNL01HXPDLHU 626FK|QEHUJ7 +HQ]OHU0DQQKHLP'(PUPH\HUPDWKLDV#JPDLOFRP 3XUSRVH7 RSURVSHFWLYHO\HYDOXDWHWKHGLDJQRVWLFDFFXUDF\RITXDQWLWDWLYHFDUGLDF &7SDUDPHWHUVDORQHDQGLQFRPELQDWLRQZLWKWURSRQLQ,IRUWKHDVVHVVPHQWRIULJKW YHQWULFXODUG\VIXQFWLRQ59'LQSDWLHQWVZLWKDFXWHSXOPRQDU\HPEROLVP3( 0HWKRGV DQG 0DWHULDOV 7KLV SURVSHFWLYH VWXG\ KDG LQVWLWXWLRQDO ,5% DSSURYDO DQGZDV+,3$$FRPSOLDQWFRQVHFXWLYHSDWLHQWVZLWKVXVSHFWHG3(XQGHUZHQW SXOPRQDU\ &7 DQJLRJUDSK\ ,Q WRWDO SDWLHQWV ZLWK FRQÀUPHG 3( XQGHUZHQW HFKRFDUGLRJUDSK\DQGWURSRQLQ,VHUXPOHYHOPHDVXUHPHQWVZLWKLQKRXUV7KUHH HVWDEOLVKHGFDUGLDF&7PHDVXUHPHQWVIRUWKHDVVHVVPHQWRI59'ZHUHREWDLQHG 59/9D[LDO 59/9&+ DQG 59/9YROXPH &7 PHDVXUHPHQWV DQG WURSRQLQ , VHUXPOHYHOVZHUHFRUUHODWHGZLWK59'IRXQGRQHFKRFDUGLRJUDSK\DQGDGYHUVH FOLQLFDOHYHQWVDFFRUGLQJWR0$33(7FULWHULD 5HVXOWVRISDWLHQWVZLWK3(KDGDGYHUVHFOLQLFDOHYHQWVDQGRISDWLHQWV KDG59'RQHFKRFDUGLRJUDSK\$59/9YROXPHUDWLR!VKRZHGWKHKLJKHVW DUHD XQGHU WKH FXUYH $8& IRU WKH SUHGLFWLRQ RI DGYHUVH FOLQLFDO HYHQWV ZKHQFRPSDUHGWR59/9D[LDO59/9&KDQGWURSRQLQ,3DWLHQWVZLWK 59'VKRZHGVLJQLÀFDQWO\S S KLJKHU59/9UDWLRVDQGWURSRQLQ, OHYHOVFRPSDUHGWRWKRVHZLWKRXW59'7KH$8&RI59/9D[LDO59/9&K59 /9YROXPHDQGWURSRQLQ,IRUWKHGHWHFWLRQRI59'ZHUHDQG UHVSHFWLYHO\$FRPELQDWLRQRI59/9D[LDO59/9&K59/9YROXPHZLWKWURSRQLQ ,LQFUHDVHGWKH$8&WRDQGUHVSHFWLYHO\ &RQFOXVLRQ $FRPELQDWLRQRIFDUGLDF&7SDUDPHWHUVDQGWURSRQLQ,PHDVXUHPHQWV LPSURYHVWKHGLDJQRVWLFDFFXUDF\IRUGHWHFWLQJ59'DQGSUHGLFWLQJDGYHUVHFOLQLFDO HYHQWVLIFRPSDUHGWRHLWKHUWHVWDORQH 5RRP12 9DVFXODU 66 1HZDVSHFWVLQYDVFXODULPDJLQJ 0RGHUDWRUV 9&DQWLVDQL5RPH,7 39LODUHV0RUJDGR3RUWR37 % (VWLPDWHGUDGLDWLRQGRVHUHGXFWLRQIRUSURVSHFWLYH HOHFWURFDUGLRJUDSK\WULJJHUHGGXDOVRXUFH&7DQJLRJUDSK\RIWKH WKRUDFLFDRUWDXVLQJLWHUDWLYHUHFRQVWUXFWLRQDSURVSHFWLYHVWXG\ 3 %ODQNH6%XOOD*3DFKH%5\OVNL0/DQJHU )UHLEXUJ'(SKLOLSSEODQNH#XQLNOLQLNIUHLEXUJGH 3XUSRVH7 RSURVSHFWLYHO\LQYHVWLJDWHLPDJHTXDOLW\DQGUDGLDWLRQGRVHUHGXFWLRQ IRU SURVSHFWLYH (&*WULJJHUHG VHTXHQWLDO GXDO VRXUFH '6 &7$ XVLQJ LWHUDWLYH UHFRQVWUXFWLRQRIWKHWKRUDFLFDRUWDLQFRPSDULVRQWRSURVSHFWLYH(&*WULJJHUHG VHTXHQWLDOGXDOVRXUFH'6&7$ZLWKVWDQGDUGÀOWHUHGEDFNSURMHFWLRQ)%3 0HWKRGV DQG 0DWHULDOV 7ZRKXQGUHG DQG VL[W\ FRQVHFXWLYH SDWLHQWV UHIHUUHG IRU(&*DVVLVWHG'6&7$RIWKHWKRUDFLFDRUWDZHUHSURVSHFWLYHO\HQUROOHG7XEH YROWDJHZDVDGMXVWHGWRERG\PDVVLQGH[NJPN9Q NJ PN9Q 3DWLHQWVZHUHUDQGRPO\DVVLJQHGWRD&7SURWRFROZLWKUH GXFHGUHIHUHQFHWXEHFXUUHQWRIHLWKHURUP$VURWHPSOR\LQJLWHUDWLYH UHFRQVWUXFWLRQDQGZHUHFRPSDUHGWRDUHIHUHQFHFRKRUWSUHYLRXVO\H[DPLQHGZLWK RXULQVWLWXWLRQDOVWDQGDUGSURWRFROP$VURW)%3,PDJHQRLVHDQGVXEMHFWLYH LPDJH TXDOLW\ ZHUH DVVHVVHG (IIHFWLYH UDGLDWLRQ GRVH ZDV FDOFXODWHG IURP WKH GRVHOHQJWKSURGXFW 5HVXOWV0HDQHVWLPDWHGHIIHFWLYHGRVHZDVVLJQLÀFDQWO\ORZHUIRUSURWRFROVZLWK UHGXFHGWXEHFXUUHQWP$VURWFRPSDUHGWRWKHVWDQGDUGSURWRFRO ZLWKP$VURWN9P6YP6YP6YYVP6Y S N9 P6Y P6Y P6Y YV P6Y S:LWKGHFUHDVLQJWXEHFXUUHQWLPDJHQRLVHLQFUHDVHGEXWGLGQRWUHDFK OHYHORIWKHVWDQGDUGSURWRFRO6XEMHFWLYHLPDJHTXDOLW\GHFUHDVHGZLWKGHFUHDVLQJ WXEHFXUUHQWEXWLPDJHTXDOLW\RIWKHP$VURWVXEJURXSVZDVHTXLYDOHQWWRWKH VWDQGDUGSURWRFRON9YVN9YVS QV &RQFOXVLRQ,WHUDWLYHUHFRQVWUXFWLRQDOORZVIRUUHGXFWLRQRIDSSOLHGWXEHFXUUHQW DQGWKHUHE\IRUGRVHUHGXFWLRQRIDSSUR[LPDWHO\LQ&7$RIWKHWKRUDFLFDRUWD ZKLOH PDLQWDLQLQJ REMHFWLYH DQG VXEMHFWLYH LPDJH TXDOLW\ ZKHQ FRPSDUHG WR D VWDQGDUGSURWRFROZLWKÀOWHUHGEDFNSURMHFWLRQ 6FLHQWLILF6HVVLRQ $ 6&'()*+% 7KXUVGD\ (XURSHDQ&RQJUHVVRI 5DGLRORJ\ &RQFOXVLRQ$QH[YLYRWLVVXHFXOWXUHPRGHOZDVFUHDWHGWKDWFDQPDLQWDLQEDVLF ELRPRUSKRORJ\DQGUHFHSWRUVWDWXVRIKXPDQYHQRXVVHJPHQWVLQYLWURRYHU GD\V7KLVPRGHOSRWHQWLDOO\DOORZVIRUORQJWHUPLQYHVWLJDWLRQRIKXPDQYHVVHOVHJ PHQWVLQFOXGLQJVWXG\LQJWKHHIIHFWVRILQWHUYHQWLRQDOSURFHGXUHVLQDFRQYHQLHQW FRVWHIIHFWLYHFRQWUROOHGHQYLURQPHQW % ,QWHUREVHUYHUDJUHHPHQWRIZKROHERG\05DQJLRJUDSK\IRUWKH GHSLFWLRQRIDWKHURVFOHURVLV 7 &/DXHQVWHLQ&2GHQKDXVHQ$4XLQVWHQ0)RUVWLQJ6/DGG (VVHQ'(WKRPDVODXHQVWHLQ#XQLGXHGH 3XUSRVH 7 R HYDOXDWH WKH LQWHUREVHUYHU DJUHHPHQW IRU WKH GHSLFWLRQ RI DUWHULR VFOHURWLFFKDQJHVLQGLIIHUHQWDQDWRPLFDODUHDVDVDPDUNHUIRUWKHTXDOLW\RI05 DQJLRJUDSK\05$ 0HWKRGVDQG0DWHULDOVSDWLHQWVZHUHUHIHUUHGIRUZKROHERG\05$HLWKHUIRU VFUHHQLQJSXUSRVHVRUIRUVXVSHFWHGDWKHURVFOHURWLFGLVHDVH,PDJLQJZDVSHU IRUPHGRQD705V\VWHP0DJQHWRP$YDQWR6LHPHQV)RUVLJQDOUHFHSWLRQ DFRPELQDWLRQRIVHYHUDOVXUIDFHFRLOVZDVXVHG$IWHUWKHLQWUDYHQRXVLQMHFWLRQ RI*DGREXWURO*DGRYLVW%D\HUZHLJKWDGMXVWHGGRVHRIPPRONJIRXUWRÀYH RYHUODSSLQJ'*5(7ZVDJLWWDOGDWDVHWVZHUHFROOHFWHGIURPKHDGWRWKHFDOYHV ,PDJHVZHUHHYDOXDWHGE\WZRUHDGHUVLQGHSHQGHQWO\IRUWKHSUHVHQFHRIVWHQRWLF OHVLRQVLQDUWHULDOVHJPHQWVXVLQJDSRLQWVFDOHQRVWHQRVLVVWHQRVLV RIYHVVHOGLDPHWHUVWHQRVLVVWHQRVLVRFFOXVLRQ ,QWHUREVHUYHUDJUHHPHQWZDVFDOFXODWHGXVLQJWKH&RKHQ VNDSSDYDOXH 5HVXOWVDUWHULDOVHJPHQWVZHUHDVVHVVHG0HDQ.DSSDYDOXHDPRXQWHG WR/RZHVW.DSSDYDOXHVZHUHIRXQGIRUWKHDVVHVVPHQWRIWKHDRUWLFDUFK DQGWKHDVFHQGLQJDRUWD+LJKHVW.DSSDYDOXHVZHUHIRXQGIRU WKHHYDOXDWLRQRIWKHLOLDFDQGIHPRUDODUWHULHV &RQFOXVLRQ,QWHUREVHUYHUDJUHHPHQWRI05$GLIIHUVVXEVWDQWLDOO\ZLWKLQYDULRXV DQDWRPLFDO VHJPHQWV7KH RQO\ PRGHUDWH YDOXHV IRU WKH WKRUDFLFDRUWD PD\ EH H[SODLQHG E\ WKH FRPSOH[ GHSLFWLRQ RI WKH YHVVHO ZDOO GXH WR FDUGLDF PRWLRQ DUWHIDFWV +RZHYHU ODUJH DUWHULHV LQ WKH SHOYLF DQG IHPRUDO UHJLRQ SURYHG EHVW DJUHHPHQWSUREDEO\EHFDXVHRIDQHDV\DQGUREXVWGHOLQHDWLRQ % ,QWUDLQGLYLGXDOFRPSDULVRQRIZKROHERG\05DQJLRJUDSK\DWDQG 7HVODLQKLJKULVNSDWLHQWVZLWKKHUHGLWDU\K\SHUOLSLGDHPLD &:HEHU-%XKN7 %OH\$.)LQN:HGHO$.RRSV*$GDP3 %DQQDV +DPEXUJ'(FZHEHU#DPDOLHGH 3XUSRVH7 RSURVSHFWLYHO\DQGLQWUDLQGLYLGXDOO\FRPSDUHLPDJHTXDOLW\DQGGH WHFWDELOLW\RIVWHQRVHVLQFRQWUDVWHQKDQFHGZKROHERG\05$:%05$DWDQG 7 HVOD7LQSDWLHQWVZLWKKHUHGLWDU\K\SHUOLSLGDHPLD 0HWKRGVDQG0DWHULDOVSDWLHQWVZLWKKHUHGLWDU\K\SHUOLSLGDHPLDUHFHLYHGD DQG7JDGREXWUROFRQWUDVWHQKDQFHG:%05$GHÀQHGDUWHULDOVHJPHQWVZHUH DQDO\VHGUHJDUGLQJGHSLFWLRQRIWDUJHWYHVVHOVLPDJHTXDOLW\DFFRUGLQJWRDSRLQW VFDOH´QRWHYDOXDEOHµWR´H[FHOOHQWµGHJUHHRIVWHQRVLVDQG DVZHOODVYHVVHODOWHUDWLRQVVXFKDVDQHXU\VPV:LOFR[RQPDWFKHGSDLU WHVWDQG&KLVTXDUHWHVWZHUHSHUIRUPHGIRUFRPSDULVRQRIWKHWZRÀHOGVWUHQJWKV 5HVXOWV7DQG7VFDQV\LHOGHGKLJKTXDOLW\:%05$LQDOOSDWLHQWV0HDQ LPDJH TXDOLW\ RI DOO DUWHULDO VHJPHQWV DW 7 ZDV UDWHG VLJQLÀFDQWO\ KLJKHU WRLPDJHTXDOLW\DW7S )LHOGLQKRPRJHQHLW\ DUWHIDFWVGHWHULRUDWHGLPDJHTXDOLW\DW7LQSDWLHQWVDQGYHQRXVRYHUOD\ZDV GHVFULEHGPRUHRIWHQDW7Q WKDQDW7Q $OOUHOHYDQWVWHQRVHV Q RFFOXVLRQV Q DQG DQHXU\VPV Q ZHUH HYDOXDWHG VLPLODUO\ DW ERWKÀHOGVWUHQJWKV &RQFOXVLRQ:%05$FDQEHSHUIRUPHGDWDQG7ZLWKGLDJQRVWLFLPDJHTXDOLW\ 'XHWRWHFKQLFDOGUDZEDFNVREVHUYHGDW7 RYHUDOOLPDJHTXDOLW\ZDVUDWHGRQO\ PRGHVWO\KLJKHUIRU7H[DPLQDWLRQV,QRUGHUWRHIIHFWLYHO\WDNHDGYDQWDJHRIWKH KLJKHUÀHOGVWUHQJWKIXUWKHURSWLPLVDWLRQRIVHTXHQFHSDUDPHWHUVDQGLQMHFWLRQ SURWRFROVIRU:%05$DW7LVQHFHVVDU\ % 3XOVHZDYHYHORFLW\PHDVXUHPHQWVLQSRLQWYHORFLW\HQFRGHG UDGLDOO\XQGHUVDPSOHG'SKDVHFRQWUDVW05GDWD3&9,35 $)U\GU\FKRZLF] $/:HQWODQG.0-RKQVRQ&-)UDQFRLV 7 $*ULVW2:LHEHQ0DGLVRQ:,86/EHFN'(0DGLVRQ:,86 DOH[IU\GU\FKRZLF]#XNVKGH 3XUSRVH3XOVHZDYHYHORFLW\3:9LVDQRQLQYDVLYHPHDVXUHRIYDVFXODUVWLIIQHVV DQGELRPDUNHURIDUWKHURVFOHURVLV:HFRPSDUHGIRXUGLIIHUHQWPHDVXUHPHQWVRI SDWLHQWVZLWK3$2'UHIHUUHGWRRXUGHSDUWPHQWWRXQGHUJRDORZHUOLPE0'&7 DQJLRJUDSK\ PPFROOLPDWLRQ PO ,RPHSURO PJ,P/# POV 3DWLHQWV ZHUH UDQGRPLVHG LQWR WKUHH [UD\ H[SRVXUH DFTXLVLWLRQSURWRFROV$ VWDQGDUGGRVHQRLVHLQGH[60$57P$.9%ORZGRVHQRLVHLQGH[ 60$57P$.9&XOWUDORZGRVHQRLVHLQGH[60$57P$.9 $[LDO DQG 'LPDJHV ZHUH TXDOLWDWLYHO\ DQG TXDQWLWDWLYHO\ FRPSDUHG7KH WKUHH SURWRFROV ZHUH DOVR FRPSDUHG LQ WHUPV RI GLDJQRVWLF SHUIRUPDQFH XVLQJ SUH LQWHUYHQWLRQDO'6$DVJROGVWDQGDUG 5HVXOWV 6WDWLVWLFDOO\ VLJQLÀFDQWO\ KLJKHU DWWHQXDWLRQ YDOXHV ZHUH PHDVXUHG LQ WKHORZGRVHDQGXOWUDORZGRVHDFTXLVLWLRQSURWRFRO4XDOLWDWLYHO\LPDJHTXDOLW\ ZDVMXGJHGVOLJKWO\EHWWHUZLWKWKHVWDQGDUGSURWRFROWKDQZLWKWKHORZGRVHDQG XOWUDORZGRVHSURWRFROZLWKRXWVLJQLÀFDQWGLIIHUHQFHVRQ'LPDJHV1RVLJQLÀFDQW GLIIHUHQFHVZHUHIRXQGEHWZHHQWKHWKUHHSURWRFROVLQWHUPVRIFRQWUDVWWRQRLVH UDWLR&151RVLJQLÀFDQWGLIIHUHQFHVZHUHDOVRIRXQGDPRQJWKHWKUHHJURXSVRI SDWLHQWVFRQFHUQLQJWKHGLDJQRVWLFSHUIRUPDQFH $QRYHUDOOGRVHUHGXFWLRQRI DQGZDVREVHUYHGIRUWKHORZGRVHDQGXOWUDORZGRVHSURWRFROUHVSHFWLYHO\ &RQFOXVLRQ 8OWUDORZGRVH 0'&7DQJLRJUDSK\ RI SHULSKHUDO DUWHULHV SURYLGHV VXEVWDQWLDOO\UHGXFHGUDGLDWLRQH[SRVXUHZKLOHPDLQWDLQLQJDFRQVWDQW&15JRRG LPDJHTXDOLW\DQGDQDGHTXDWHGLDJQRVWLFSHUIRUPDQFH % ,PDJLQJÀQGLQJVLQDGLVWLQFWOHWKDOLQKHULWHGDUWHULRSDWK\V\QGURPH DVVRFLDWHGZLWKDQRYHOPXWDWLRQLQ)LEXOLQJHQH 55DMHVKNDQQDQ .0DKHVK&.XONDUQL60RRUWK\.3 6UHHNXPDU $'SDHSH61DPSRRWKLUL&RFKLQ,1*HQW%(UDMHVKNU#DLPVDPULWDHGX 3XUSRVH:HSUHVHQWWKHLPDJLQJÀQGLQJVRIDQHZOHWKDOLQKHULWHGDUWHULRSDWK\ V\QGURPHDVVRFLDWHGZLWKQRYHOPXWDWLRQLQ)%/1JHQHRFFXUULQJLQDGLVWLQFW FRPPXQLW\IURP6RXWK,QGLD 0HWKRGVDQG0DWHULDOV7ZHQW\IRXULQIDQWVIURPDGLVWLQFWSRSXODWLRQVXEJURXS SUHVHQWLQJ ZLWK FKDUDFWHULVWLF DUWHULDO GLODWDWLRQ DQG WRUWXRVLW\ GXULQJ WKH SHULRG $XJXVWWR$XJXVWZHUHVWXGLHG$OOLQIDQWVEHORQJHGWRXQUHODWHGIDPL OLHVIURPDQHWKQRUHOLJLRXVJURXS0XVOLPIURPWKHQRUWKHUQFRDVWDOEHOWRIWKH VRXWKHUQ ,QGLDQ VWDWH RI .HUDOD$OO SDWLHQWV XQGHUZHQW VOLFH &7 DQJLR DQG HFKRFDUGLRJUDSK\ 5HVXOWV'LODWDWLRQDQGHORQJDWLRQRIDRUWLFURRWDUFKGHVFHQGLQJDRUWDDQGPDLQ SXOPRQDU\DUWHULHVZLWKQDUURZLQJRILVWKPXVZHUHVHHQLQDOOSDWLHQWV)ROGLQJRI WKHHORQJDWHGWKRUDFRDEGRPLQDODRUWDZDVVHHQLQDOOSDWLHQWV6WHQRVLVRIDUFK EUDQFKHV DEGRPLQDO YLVFHUDO EUDQFKHV DQG SXOPRQDU\ DUWHU\ EUDQFKHV ZHUH VHHQLQDQGFDVHVUHVSHFWLYHO\&HUHEUDODUWHULDO LQYROYHPHQWZDVVHHQLQRXWRIFDVHVVFDQQHG,QRXWRI SDWLHQWV ZKR ZHUH PRUH WKDQ PRQWKV ROG VKRZHG SRRU RSDFLÀFDWLRQ RI GLVWDO DRUWDLQWKHÀUVWUXQGXHWRVORZFLUFXODWLRQ(FKRVKRZHGYHU\VORZIRUZDUGÁRZ LQGLODWHGDUWHULHV*HQHWLFVWXGLHVUHYHDOHGDQLGHQWLFDOF $!&S$VS $OD PXWDWLRQLQH[RQRIWKH)%/1JHQHLQDOOSDWLHQWV &RQFOXVLRQ:HGHVFULEHLPDJLQJÀQGLQJVRIDQHZOHWKDODUWHULRSDWK\V\QGURPH IURPDGLVWLQFWSRSXODWLRQVXEJURXS % 3HUIXVLRQV\VWHPIRUH[YLYRLQYHVWLJDWLRQRIKXPDQYHVVHOV *(GHOKDXVHU*(UPDQ&'RPHQLJ'%HU]DF]\03RSRYLF5%RUQ\ -/DPPHU0)XQRYLFV9LHQQD$7JXQGXODHGHOKDXVHU#PHGXQLZLHQDFDW 3XUSRVH)RUWKHXQGHUVWDQGLQJRIELRORJLFDOSURFHVVHVLQWKHYHVVHOZDOODIWHU LQWHUYHQWLRQDO SURFHGXUHV DQ H[YLYR WLVVXH FXOWXUH PRGHO RI KXPDQ YDVFXODU VHJPHQWVDFFHVVLEOHWRLQWHUYHQWLRQDOSURFHGXUHVDQGVXIÀFLHQWFXOWLYDWLRQWLPH WRVWXG\WKHLUHIIHFWVLVKLJKO\GHVLUDEOH:HGHYHORSHGDV\VWHPWRVXLWWKHVHUH TXLUHPHQWVDQGDVVHVVHGPRUSKRORJLFFKDUDFWHULVWLFVRIFXOWLYDWHGKXPDQYHVVHO VHJPHQWVIRUXSWRGD\V 0HWKRGV DQG 0DWHULDOV VDSKHQRXV YHLQ VHJPHQWV ZHUH KDUYHVWHG IURP SDWLHQWVXQGHUJRLQJE\SDVVVXUJHU\RIWKHOHJ7KHYHVVHOVHJPHQWVZHUHSODFHG LQDFXVWRPLVHGJODVVFKDPEHUFRQQHFWHGWRDUHJXODWHGUROOHUSXPS&XVWRPLVHG FXOWXUHPHGLXPZDVSXPSHGDWDVHWÁRZUDWHDQGWUDQVPXUDOSUHVVXUH7KHYHV VHOVHJPHQWVZHUHFXOWXUHGIRUDQGGD\V7KHVDPSOHVZHUHKLVWRORJLFDOO\ H[DPLQHGZLWKXQFXOWLYDWHGVHJPHQWVRIWKHRULJLQDOYHVVHOVHUYLQJDVFRQWUROV 0RUSKRORJ\DQGLQWHJULW\ZHUHLQYHVWLJDWHGDIWHUWUDQVPLVVLRQHOHFWURQPLFURVFRS\ DQGLPPXQRKLVWRFKHPLVWU\IRU&'$DQG.L 5HVXOWVVDPSOHVZHUHFXOWLYDWHGZLWKRXWGHWHFWDEOHLQIHFWLRQIRUWKHSODQQHG WLPHSHULRG7 HPSHUDWXUHPHGLXPS+DQGWUDQVPXUDOSUHVVXUHUHPDLQHGFRQVWDQW GXULQJWKHFXOWLYDWLRQ&RPSDUHGWRWKHFRQWUROVPHGLDOWKLFNQHVVUHPDLQHGZLWKLQ RIWKHRULJLQDOYDOXHVQRFKDQJHVLQHODVWLQFRQWHQWLQWLPDOPRUSKRORJ\RU UHFHSWRUGLVWULEXWLRQDQGGHQVLW\ZHUHGHWHFWDEOH 6FLHQWLILF6HVVLRQ 6 &$' ( ) *+% (XURSHDQ&RQJUHVVRI 5DGLRORJ\ 5RRP4 &DUGLDF 66E 9DOYXODUDQGFRQJHQLWDOKHDUWGLVHDVHV 0RGHUDWRUV 02XGNHUN*URQLQJHQ1/ (:RR$\OHVEXU\8. % $RUWLFYDOYHFDOFLXPVFRULQJ$9&6LVDSUHGLFWRURIVLJQLÀFDQW SDUDYDOYXODUDRUWLFLQVXIÀFLHQF\LQWUDQVDSLFDODRUWLFYDOYH LPSODQWDWLRQ7$9, //HKPNXKO0+DHQVLJ$-5DVWDQ-.HPSIHUW&0XNKHUMHH '0+RO]KH\0*URWKRII) :0RKU0*XWEHUOHW /HLS]LJ'(OXNDVOHKPNXKO#PHGXQLOHLS]LJGH 3XUSRVH7UDQVDSLFDODRUWLFYDOYHLPSODQWDWLRQ7$$9,KDVHYROYHGDVDURXWLQHIRU VHOHFWHGKLJKULVNSDWLHQWV+RZHYHUSDUDYDOYXODUOHDNVUHPDLQDQXQVROYHGLVVXH XVLQJFXUUHQWJHQHUDWLRQVRIWUDQVFDWKHWHUYDOYHGHYLFHV7KHSXUSRVHRIWKLVVWXG\ ZDVWRLQYHVWLJDWHWKHLPSDFWRIQDWLYHDRUWLFYDOYHFDOFLÀFDWLRQRQSDUDYDOYXODUOHDNV DQGRXWFRPHXVLQJWKH(GZDUGV6$3,(170SURVWKHVLVDQGWUDQVDSLFDODSSURDFK 0HWKRGV DQG 0DWHULDOV FRQVHFXWLYH SDWLHQWV RXW RI 7$$9,V ZLWK SUHRSHUDWLYH FRPSXWHG WRPRJUDSK\ DJH \HDUV IHPDOH ZHUH LQFOXGHG,PSODQWHGSURVWKHWLFYDOYHVL]HVZHUHPPQ DQGPPQ UHVSHFWLYHO\ 0HDQ ORJLVWLF (XUR6&25( ZDV DQG PHDQ 6766FRUH (&*JDWHGFDUGLDF&7DOORZHGWRTXDQWLI\WKHDPRXQWRIFDOFLÀFDWLRQRI DRUWLFYDOYHOHDÁHWVXVLQJDVFRULQJDQDORJRXVWRWKH$JDWVWRQFDOFLXPVFRULQJRI FRURQDU\DUWHULHV$9&63DUDYDOYXODUOHDNVZHUHDVVHVVHGLQWUDRSHUDWLYHO\E\ HFKRFDUGLRJUDSK\DQGURRWDQJLRJUDSK\ 5HVXOWV$OOYDOYHVZHUHLPSODQWHGVXFFHVVIXOO\0HDQ$9&6LQSDWLHQWVZLWKRXW SDUDYDOYXODU OHDNV Q ZDV ZLWK PLOG SDUDYDOYXODU OHDNV Q S DQG ZLWK PRGHUDWH SDUDYDOYXODU OHDNV Q S 7KHUH ZDV D VLJQLÀFDQW FRUUHODWLRQ EHWZHHQ$9&6 DQGSDUDYDOYXODU OHDNVU S DQGDWUHQGWRZDUGVDKLJKHULQFLGHQFHRIQHZSDFHPDNHU LPSODQWDWLRQ U S 1R FRUUHODWLRQ ZDV IRXQG WR GD\ PRUWDOLW\ PDMRUFDUGLDFHYHQWVDQGVWURNHUDWHU S U S DQG U S &RQFOXVLRQ 6HYHUH QDWLYH YDOYH FDOFLÀFDWLRQV DUH SUHGLFWLYH IRU SRVWRSHUDWLYH UHOHYDQWSDUDYDOYXODUOHDN$9&6SULRUWR7$$9,PLJKWVHUYHDVDQDGGLWLRQDOWRRO WRUHFRQVLGHUWKH7$9,LQGLFDWLRQWRUHGXFHWKHULVNRISDUDYDOYXODUOHDNVHVSHFLDOO\ LQVRFDOOHGRSHUDEOHSDWLHQWV % 0RUSKRORJLFDODVVHVVPHQWRIWKHDRUWLFYDOYHXVLQJFDUGLRYDVFXODU FRPSXWHGWRPRJUDSK\DQGFDUGLRYDVFXODUPDJQHWLFUHVRQDQFHLQ SDWLHQWVZLWKVHYHUHDRUWLFVWHQRVLVFRPSDULVRQZLWKLQWUDRSHUDWLYH ÀQGLQJ 6%DN6.R-&KRL06RQJ-6KLQ+-L6HRXO.5 #NXKDFNU 3XUSRVH7 RFRPSDUHWKHDFFXUDF\RIFDUGLRYDVFXODU&7&9&7DQGFDUGLRYDVFX ODU05&05IRUWKHPRUSKRORJLFDODVVHVVPHQWVRIWKHDRUWLFYDOYH$9LQSDWLHQWV ZLWK VHYHUH DRUWLF VWHQRVLV $6 DQG WR DVVHVV DFFXUDF\ RI WKH&9&7 IHDWXUHV GLIIHUHQWLDWLQJEHWZHHQELFXVSLG$9%$9DQGWULFXVSLG$97$9 0HWKRGVDQG0DWHULDOV1LQHW\IRXUSDWLHQWVZLWKVHYHUH $6XQGHUZHQW&9&7DQG &05EHIRUHVXUJHU\7ZRUDGLRORJLVWVDVVHVVHGPRUSKRORJLFSDWWHUQDVGHÀQLWH %$9GHÀQLWH7$9DQGERUGHUOLQHW\SH,QERUGHUOLQHW\SHRQ&9&7 XQHYHQFXVS VL]HURXQGVKDSHGRSHQLQJPLGOLQHFDOFLÀFDWLRQDQGOHQJWKRIFXVSIXVLRQZHUH DQDO\VHG'LDJQRVWLFDFFXUDF\RI&9&7DQG&05IRUGLVFULPLQDWLQJ%$9IURP7$9 ZDVFRPSDUHGZLWKVXUJLFDOÀQGLQJ 5HVXOWV$WVXUJHU\SDWLHQWVKDG7$9DQGSDWLHQWVKDG%$9'HÀQLWH%$9 GHÀQLWH7$9RUERUGHUOLQHW\SHZDVSUHVHQWLQDQGSDWLHQWVRQ&9&7 DQGDQGSDWLHQWVRQ&05,QERUGHUOLQHW\SHRQ&9&7%$97$9 RQO\URXQGVKDSHGRSHQLQJZDVVWURQJO\DVVRFLDWHGZLWK%$9V3 6HQVLWLYLW\VSHFLÀFLW\SRVLWLYHDQGQHJDWLYHSUHGLFWLYHYDOXHVIRUDVVHVVPHQWRI $9PRUSKRORJ\ZHUHUHVSHFWLYHO\RQ&9&7DQG DQGUHVSHFWLYHO\RQ&05 &RQFOXVLRQ&9&7DQG&05DUHDFFXUDWHIRUGLIIHUHQWLDWLRQEHWZHHQ%$9DQG7$9 LQSDWLHQWVZLWKVHYHUH$6)XUWKHUVWXGLHVDUHQHHGHGIRUDVVHVVPHQWRI&9&7 IHDWXUHVGLIIHUHQWLDWLQJEHWZHHQ%$9DQG7$9LQERUGHUOLQH$9W\SH 3:9EDVHGRQUDGLDOO\XQGHUVDPSOHGGLPHQVLRQDOSKDVHFRQWUDVW'3&05, XVLQJKLJKWHPSRUDOUHVROXWLRQ'3&DVVWDQGDUGRIUHIHUHQFH 0HWKRGV DQG 0DWHULDOV ,Q HLJKWHHQ KHDOWK\ YROXQWHHUV PHQZRPHQ \HDUV%0,SRLQWYHORFLW\HQFRGHG'3&9,35GDWDDQG'3& 05,ZHUHDFTXLUHGDW7ZLWKDFKDQQHOERG\FRLO.H\SDUDPHWHUVZHUH'' WLPHIUDPHVDQG[[PP[[PPVSDWLDOUHVROXWLRQ ' VOLFHV ZHUH SUHVFULEHG IURP D FRQWUDVWHQKDQFHG 05$ XVLQJ PPRONJ JDGRIRVYHVHWWULVRGLXP'DQG'3&GDWDZHUHDQDO\VHGZLWKD0$7/$%EDVHG VRIWZDUH3:9ZDVFRPSXWHGXVLQJWLPHWRSHDN773WLPHWRIRRW77)FURVV FRUUHODWLRQ;&RUUDQGWLPHWRXSVWURNH778%ODQG$OWPDQDQDO\VLVZDVXVHG WRFRPSDUH'DQG'UHVXOWVDQGLQWUDDQGLQWHUREVHUYHUUHSURGXFLELOLW\LQ VXEMHFWV'DWDYDULDELOLW\ZDVDVVHVVHGZLWKDPRGHORIDJHGHSHQGHQFH5HVLGX DOVRIGDWDZHUHFRPSDUHGZLWKD%URZQ)RUV\WKH$129$WHVW 5HVXOWV 2YHUDOO UHVXOWV ' PV ' PV ZHUH VLPLODU5 H VXOWV EDVHG RQ GLIIHUHQW DOJRULWKPV GLIIHUHG QRQVLJQLÀFDQWO\ ZLWK DYHUDJH EL DVHVPV778PV77)DQGPV;&RUU773 VKRZHGVLJQLÀFDQWGLIIHUHQFHVZLWKXQSK\VLRORJLFDOYDOXHV2YHUDOOLQWHUREVHUYHU PV DQG LQWUDREVHUYHU YDULDELOLW\ PV ZHUH ORZ %URZQ )RUV\WKHWHVWUHVXOWHGLQS IRU77877) DQG;&RUUGDWDLQGLFDWLQJHTXDO YDULDELOLW\%LQQLQJLQWRDJHJURXSV!\HDUVUHYHDOHGWKDW778DQG;&RUUDV RSSRVHGWR77)ZHUHDEOHWRGHWHFWWKHH[SHFWHGLQFUHDVHZLWKDJH &RQFOXVLRQ 3:9 FDOFXODWLRQV IURP UDGLDOO\ XQGHUVDPSOHG '3&9,35 DUH IHDVLEOHDQGPD\WKXVEHXVHIXOLQFRPSUHKHQVLYHYDVFXODUGLDJQRVLV778DQG ;&RUUZHUHWKHSUHIHUUHGDOJRULWKPV % ,PDJHTXDOLW\DQGUDGLDWLRQGRVHRI%0,DGMXVWHGSHULSKHUDO&7 DQJLRJUDSK\ZLWKN9SFRPSDUHGWRDVWDQGDUGSURWRFROZLWKN9 .00D\06LPRQ) 09RJW3 +XQROG-%DUNKDXVHQ$.RYDFV /EHFN'(.DWKDULQDPD\#XNVKGH 3XUSRVH 7 R FRPSDUH WKH LPDJH TXDOLW\ DQG UDGLDWLRQ GRVH RI D SHULSKHUDO &7DQJLRJUDSK\ S&7$ SHUIRUPHG ZLWK ORZN9S DQG %0,DGMXVWHG P$V WR WKH VWDQGDUGSURWRFRO 0HWKRGV DQG 0DWHULDOV 5HWURVSHFWLYH DQG SURVSHFWLYH JDLQHG GDWD RI SDWLHQWVUHFHLYLQJVOLFH&7$ZHUHDQDO\VHGSDWLHQWVDQDO\VHGUHWURVSHF WLYHO\UHFHLYHGDVWDQGDUGS&7$N9P$VDQG&DUH'RVHRIWKRVH ZHUHDVVLJQHGWR%0,JURXSLNJPWR%0,JURXS,,NJPDQG WR%0,JURXS,,,!NJPSDWLHQWVLQFOXGHGSURVSHFWLYHO\ZHUHH[DPLQHG ZLWK D %0,DGMXVWHG SURWRFRO JURXSL Q XVLQJ N9 P$V ,, Q N9P$VDQG,,,Q N9P$VUHVSHFWLYHO\&RQWUDVWDGPLQLVWUD WLRQZDVLGHQWLFDOLQDOOSDWLHQWVPO,RPHSUROPO1D&OÁRZUDWH POV7KHDUWHULDOHQKDQFHPHQW6,615&15DQGWKHLPDJHTXDOLW\3RLQW 6FDOHZHUHDQDO\VHGDWGHÀQHGOHYHOVRIWKHSHULSKHUDODUWHULHV7KHHIIHFWLYH UDGLDWLRQGRVHZDVFDOFXODWHGIRUDOOVFDQV 5HVXOWV 7KH DUWHULDO HQKDQFHPHQW ZDV VLJQLÀFDQWO\ KLJKHU PHDQ +8YV +8DWDOOYDVFXODUOHYHOVXVLQJWKHORZN9SSURWRFROV$OWKRXJKEDFNJURXQG QRLVHOHYHOVLJQLÀFDQWO\LQFUHDVHG615DQG&15ZHUHFRPSDUDEOHDQGWKHLPDJH TXDOLW\ZDVQRQLQIHULRUWRWKHVWDQGDUGSURWRFRO7KHPRGLÀHGSURWRFROVLJQLÀFDQWO\ UHGXFHGWKHUDGLDWLRQGRVHLQDOO%0,JURXSVJURXSLYVP6YS ,,YVP6YSDQGJURXS,,,YVP6YS &RQFOXVLRQ7KHLPDJHTXDOLW\RIS&7$ZLWKORZN9SDQG%0,DGMXVWHGWXEHFXU UHQWLVQRWFRPSURPLVHGZKHQFRPSDUHGWRDVWDQGDUGSURWRFRO+RZHYHUUDGLD WLRQGRVHFDQVLJQLÀFDQWO\EHUHGXFHGE\GHSHQGLQJRQWKHSDWLHQWV%0, 6FLHQWLILF6HVVLRQ $ 6&'()*+% 7KXUVGD\ (XURSHDQ&RQJUHVVRI 5DGLRORJ\ FDOYDOYHLPSODQWDWLRQ7$$9,ZLWKIRFXVRQSRVVLEOHLQWUDSURFHGXUDOREVWUXFWLRQ RIWKHFRURQDU\RVWLDXVLQJFRPSXWHGWRPRJUDSK\&7 0HWKRGVDQG0DWHULDOV&7VFDQVRISDWLHQWVPZPHDQDJH\ ZLWKVHYHUH$6VFKHGXOHGIRU7$$9,ZHUHLQFOXGHGUHWURVSHFWLYHO\'LVWDQFHVRI WKHFRURQDU\RVWLDWRWKHDRUWLFDQQXOXVZHUHPHDVXUHGLQV\VWROLFDQGGLDVWROLF SKDVHDQGFRPSDUHGWRWKHOHDÁHWOHQJWKPHDVXUHGLQGLDVWROLFSKDVH3RVVLEOH RYHUODSGLVWDQFH32'ZDVFDOFXODWHGXVLQJSDLUZLVHDQDO\VLV 5HVXOWV7KHPHDQ32'LQGLFDWHGWKHULVNRIDSRWHQWLDORFFOXVLRQRISDUWVRIWKH ULJKWFRURQDU\DUWHU\5&$RVWLXPE\WKHULJKWOHDÁHW32'PPS GXHWRWKH7$$9,SURFHGXUH7KHPHDQGLVWDQFHIURPWKHPRVWEDVDODWWDFKPHQW RIWKH/&/WRWKHOHIWFRURQDU\RVWLXPGLGQRWGLIIHUVLJQLÀFDQWO\S IURPWKH PHDQ/&/OHQJWKZLWKDPHDQGLIIHUHQFHRIPP &RQFOXVLRQ5LJKWFRURQDU\OHDÁHWPD\WKHRUHWLFDOO\RYHUODSDQGRFFOXGHDODUJH SDUWRIWKH5&$RVWLXPGXHWRWKH7$$9,SURFHGXUH % 5LJKWYHQWULFXODUK\SHUWURSK\DIWHUDWULDOVZLWFKRSHUDWLRQDQGLWV UROHLQDV\VWHPLF59QRUPDODGDSWDWLRQSURFHVVRUULVNIDFWRU"$ FDUGLRYDVFXODUPDJQHWLFUHVRQDQFHVWXG\ 0*URWKRII-+RIIPDQQ0*XWEHUOHW /HLS]LJ'(0DWWKLDV*URWKRII#KHU]]HQWUXPOHLS]LJGH 3XUSRVH6\VWHPLF59K\SHUWURSK\DQGLPSDLUHGV\VWROLFIXQFWLRQRFFXUDIWHUDWULDO VZLWFK$6LQGWUDQVSRVLWLRQRIWKHJUHDWDUWHULHVG7*$(FKRFDUGLRJUDSK\KDV OLPLWDWLRQLQWKHDVVHVVPHQWRIWKHULJKWYHQWULFOH59,QWKLVVWXG\ZHVRXJKWWR HYDOXDWHV\VWHPLF59P\RFDUGLDOPDVVDQGIXQFWLRQDIWHU$6IRUG7*$DQGWR DQDO\VHWKHUROHRIH[FHVVLYHK\SHUWURSK\IRUYHQWULFXODUIXQFWLRQXQGHUVSHFLDO FRQVLGHUDWLRQRIWKHLQWHUYHQWULFXODUVHSWDO,96PRYHPHQW 0HWKRGVDQG0DWHULDOV7KLUW\VHYHQSDWLHQWVDIWHU$6ZHUHVWXGLHGDWD7 VFDQQHU ,QWHUD &9 3KLOLSV XVLQJ D GHGLFDWHG FKDQHOSKDVHDUUD\ VXUIDFH FDUGLDFFRLO&LQHVWHDG\VWDWHIUHHSUHFHVVLRQVHTXHQFHVZHUHDFTXLUHGWRREWDLQ ELYHQWULFXODUP\RFDUGLDOPDVVHVDQGIXQFWLRQ7KHV\VWROLFPRYHPHQWRIWKH,96 ZDVGHÀQHGDVSRVLWLYH360ZKHQPRYLQJWRZDUGVWKHFHQWURLGRIWKH59 RU HOVHDVQRQSRVLWLYH3DWLHQWSDUDPHWHUVZHUHFRPSDUHGWRDJHPDWFKHGFRQWUROV 5HVXOWV6\VWHPLF59VZHUHVLJQLÀFDQWO\ODUJHUSWKDQ/9VRIWKHFRQWURO JURXSV\VWROLFIXQFWLRQVLJQLÀFDQWO\LPSDLUHGSDQGP\RFDUGLDOPDVVLQGH[ 00, ZDV FRPSDUDEOH S QV 5900, DQG 59() GHPRQVWUDWHG D TXDGUDWLF FRUUHODWLRQU SPHDQLQJWKDWSDWLHQWVZLWK5900,EHORZJPò DQGDERYHJPòKDGDUHGXFHGV\VWROLFIXQFWLRQ3DWLHQWVZLWK360KDGDEHWWHU 59IXQFWLRQFRPSDUHGZLWKWKHQRQ360VXEJURXSS &RQFOXVLRQ$FHUWDLQDPRXQWRI59K\SHUWURSK\DIWHU$6LVDQRUPDODGDSWDWLRQ SURFHVVDIWHU $6DQGDVXIÀFLHQW59()FDQEHH[SHFWHGZLWKLQDUDQJHRIJ Pò360LVSUREDEO\WKHUHVXOWRIK\SHUWURSKLFVHSWDO59ÀEUHVZKLFKLVEHQHÀFLDO IRU59IXQFWLRQDQGPLJKWEHUHJDUGHGDVWKHSK\VLRORJLFDOFRQWUDFWLRQSDWWHUQ % &DUGLRYDVFXODU06&7DQJLRJUDSK\LQQHZERUQVZLWKNQRZQRU VXVSHFWHGFRQJHQLWDOKHDUWGLVHDVHDSSO\LQJPHDQHIIHFWLYHGRVHV RIP6Y 7 .OLQN*0OOHU-:HLO*$GDP7 $%OH\ +DPEXUJ'(WNOLQN#XNHXQLKDPEXUJGH 3XUSRVH7 RLQYHVWLJDWHWKHGLDJQRVWLFFDSDELOLW\RIFDUGLRYDVFXODU06&7DQ JLRJUDSK\LQFDUGLRSXOPRQDU\FRPSURPLVHGQHZERUQVDQGLQIDQWVZLWKVXVSHFWHG RUNQRZQFRQJHQLWDOKHDUWGLVHDVHDQGWRFRPSDUHGLIIHUHQWVFDQSURWRFROVZLWK UHJDUGWRUDGLDWLRQGRVHV 0HWKRGVDQG0DWHULDOV1LQHQHZERUQVDQGLQIDQWVPHDQZHLJKWJ DJH UDQJH GD\V WR PRQWKV ZHUH LQFOXGHG LQ WKLV UHWURVSHFWLYH VWXG\ &OLQL FDOO\LQGLFDWHGQRQ(&*WULJJHUHGFDUGLRYDVFXODU&7$ZDVSHUIRUPHGXWLOLVLQJD 06&7VFDQQHU9HQGRUVSHFLÀFSUHVHWVFDQSURWRFROVZHUHLQLWLDOO\XVHGDQG SURJUHVVLYHO\DGDSWHG,PDJHVZHUHDFTXLUHGZLWKKHOLFDORUDVLQJOHD[LDOURWDWLRQ VFDQDQGWXEHYROWDJHVRIN9RUN9UHVSHFWLYHO\7ZRREVHUYHUVHYDOXDWHG WKRUDFLFFDUGLRYDVFXODUÀQGLQJVDQGLPDJHTXDOLW\(IIHFWLYHUDGLDWLRQGRVHVZHUH HVWLPDWHGIURPGRVHOHQJWKSURGXFW 5HVXOWV $OOPDMRUFDUGLRYDVFXODUGHIHFWVFRXOGEHGHWHFWHGDQGDOOLPDJHVZHUH RIGLDJQRVWLFTXDOLW\7ZRVPDOODWULDOVHSWDOGHIHFWVDQGRQHSHUVLVWHQWIRUDPHQ RYDOHZHUHVHHQRQHFKRFDUGLRJUDSK\RQO\,PDJHTXDOLW\RID[LDOVFDQVFRYHULQJ WKHHQWLUHKHDUWDQGJUHDWWKRUDFLFYHVVHOVZLWKLQDVLQJOHURWDWLRQZHUHVXSHULRUWR LPDJHVDFTXLUHGZLWKDKHOLFDOVFDQQLQJSURWRFRO5HGXFLQJWKHWXEHYROWDJHIURP N9WRN9UHVXOWHGLQDPHDQHIIHFWLYHGRVHRIP6Y % &DUGLDFPDJQHWLFUHVRQDQFHIRUHYDOXDWLRQRIELFXVSLGDRUWLFYDOYH PRUSKRORJ\ 5)DOHWWL *6FKLYD]DSSD$3DROLQR) $QJHOLQR) &HVDUDQL**DQGLQL 7XULQ,7$VWL,7ULFFDUGRBIDOHWWL#\DKRRLW 3XUSRVH7KHPRVWFRPPRQDRUWLFYDOYHDEQRUPDOLW\LVWKHELFXVSLGDRUWLFYDOYH %$97KHUROHRI&05WRHYDOXDWHDRUWLFYDOYHPRUSKRORJ\GLDPHWHUVRIWKH DVFHQGLQJDRUWDDQGWKHDUUDQJHPHQWRIWKHVLQXVHVRI9DOVDOYDZDVLQYHVWLJDWHG 0HWKRGVDQG0DWHULDOV)RUW\WZRRIFRQVHFXWLYHSDWLHQWVZLWKDRUWLFGLVHDVHV ZKRXQGHUZHQW&05SUHVHQWHGZLWK%$9%$9ZHUHSUHVHQWHGZLWKGLIIHUHQWSKH QRW\SHV%$9ZLWKRXWUDSKHDQG%$9ZLWKUDSKH:LWKLQWKHVHVXEJURXSVGLIIHUHQW SKHQRW\SHVDUHLGHQWLÀHG%$9ZLWKRXWUDIHLVVXEGLYLGHGLQWR $3DQWHURSRVWHULRU DQG/$ODWHUDODQWHULRU,Q%$9ZLWKUDSKHZHKDYHLGHQWLÀHGSKHQRW\SHV5/ OHIWDQGULJKWFXVSIXVLRQ51IXVLRQRIULJKWDQGQRQFRURQDU\FXVSDQG/1 IXVLRQRIWKHOHIWDQGQRQFRURQDU\FXVS7KHUHVXOWVZHUHFRPSDUHGZLWKUHFHQW OLWHUDWXUH:HDOVRHYDOXDWHWKHSRVVLEOHDVVRFLDWLRQEHWZHHQ%$9DQGDVFHQGLQJ DRUWDGLODWDWLRQ 5HVXOWV:HREVHUYHGSUHYDOHQFHRI%$9ZLWKUDSKHDQGZLWKLQWKLV JURXSWKHSKHQRW\SH5/7KHUHVXOWVKDYHVKRZQSDUWO\LQDJUHHPHQW ZLWKWKHVWXG\RI%XFKQHUDQGFROOHDJXHV%RWKVWXGLHVVKRZHGWKHSUHYDOHQFH RIWKHJURXSZLWK%$9ZLWKUDSKHLQRXUVWXG\IRU%XFKQHUS DQGWKHVXEJURXS5/YVS ,QRXUVWXG\SUHYDOH$3 SKHQRW\SHYV/$7KHUHZDVQRVLJQLÀFDQWFRUUHODWLRQS ZLWKLQ%$9DQGDVFHQGLQJDRUWDGLODWDWLRQ &RQFOXVLRQ&05LVFXUUHQWO\WKHPRVWFRPSOHWHLPDJLQJWHFKQLTXHIRUFODVVLÀFD WLRQDQGFKDUDFWHULVDWLRQRI%$9 % 05DVVHVVPHQWRISXOPRQDU\43WRV\VWHPLF46ÁRZXVLQJ' SKDVHFRQWUDVWWHFKQLTXHFRPSDULVRQZLWKFRQYHQWLRQDOWKURXJK SODQH'SKDVHFRQWUDVWWHFKQLTXH %-:LQWHUVSHUJHU06LYDJQDQDP163DXO''LYD(1JX\HQ $0&UHDQ/-LPHQH]-XDQ50:DOG6/H\7 RURQWR21&$ %HUQG:LQWHUVSHUJHU#XKQFD 3XUSRVH 7 R HYDOXDWH ' SKDVH FRQWUDVW 3& 05, LQ DVVHVVPHQW RI SRVVLEOH LQWUDFDUGLDFVKXQWVE\VLPXOWDQHRXVDVVHVVPHQWRISXOPRQDU\4SDQGV\VWHPLF 4VÁRZ 0HWKRGVDQG0DWHULDOVSDWLHQWVZLWKVXVSLFLRQRILQWUDFDUGLDFVKXQWVXQGHU ZHQWFDUGLDF05,DW7 HVOD$VVHVVPHQWRI4SDQG4VZDVSHUIRUPHGXVLQJ IUHHEUHDWKLQJUHWURJDWHG'3&*5([[PP75PVLPDJLQJZLWK' WKURXJKSODQHYHORFLW\HQFRGLQJJUDGLHQWYHQF FPVLQFRQVHFXWLYHPHDVXUH PHQWVIRUWKHPDLQSXOPRQDU\DUWHU\03$DQGDVFHQGLQJDRUWD$$UHVSHFWLYHO\ ,QDGGLWLRQDSURVSHFWLYHO\WULJJHUHG'3&*5(WHFKQLTXH[[PP75 PVZLWKWKUHHRUWKRJRQDOYHQFGLUHFWLRQVZDVHPSOR\HGZLWKYROXPHFRYHUDJH RI03$DQG$$'3&*5(ZDVSRVWSURFHVVHGXVLQJDFRPPHUFLDOO\DYDLODEOH VRIWZDUHDOJRULWKPDQG'3&*5(ZDVDQDO\VHGXVLQJFXVWRPEXLOWVRIWZDUH %RWKDSSURDFKHVZHUHFRPSDUHGIRUDEVROXWH4SDQG4VYDOXHVDQG4S4VUDWLR 5HVXOWV +HDUW UDWHV GXULQJ ' 3& PHDVXUHPHQWV IRU$$ DQG 03$ ZHUH ESPDQGESPUHVSHFWLYHO\3 ZKLOHKHDUWUDWHGXU LQJ'3&ZDVVLJQLÀFDQWO\ORZHUESP34SDVVHVVHGE\ '3&FRUUHODWHGKLJKO\ZLWKWKH'3&5 3EXWGHPRQVWUDWHG DVLJQLÀFDQWV\VWHPDWLFDQGUDQGRPHUURUPO3'3&4 YDOXHVDOVRGHPRQVWUDWHGKLJKFRUUHODWLRQ5 3ZLWKVLJQLÀFDQW V\VWHPLFDQGUDQGRPHUURUPO3 5HVXOWLQJ4S4VUDWLRVRI 'DQG'3&DFTXLVLWLRQVVKRZHGKLJKFRUUHODWLRQ5 3DQGQR VLJQLÀFDQWGLIIHUHQFHVYV3 &RQFOXVLRQ'YROXPHWULF3&ÁRZDVVHVVPHQWDOORZVIRUDFFXUDWHDVVHVVPHQW RI4S4VUDWLRVLQWKHHYDOXDWLRQRISRVVLEOHLQWUDFDUGLDFVKXQWV)XUWKHULQYHVWLJD WLRQVRIWKHDFFXUDF\RILQGLYLGXDOÁRZYROXPHVDUHZDUUDQWHG % &RPSXWHGWRPRJUDSK\HYDOXDWLRQRISRVVLEOHLQWUDSURFHGXUDO REVWUXFWLRQRIWKHFRURQDU\RVWLDE\WKHDRUWLFYDOYHOHDÁHWVGXULQJ WUDQVDSLFDODRUWLFYDOYHLPSODQWDWLRQ //HKPNXKO%)ROG\QD.YRQ$VSHUQ0+DHQVLJ &/XHFNH&$QGUHV61LW]VFKH0*URWKRII0*XWEHUOHW /HLS]LJ'(OXNDVOHKPNXKO#PHGXQLOHLS]LJGH 3XUSRVH7 RFRPSDUHWKHGLVWDQFHRIWKHFRURQDU\RVWLDIURPWKHEDVDODWWDFKPHQW RIWKHDRUWLFYDOYHOHDÁHWVDQGWKHOHQJWKRIWKHDRUWLFYDOYHOHDÁHWVSULRUWRWUDQVDSL 6FLHQWLILF6HVVLRQ 6 &$' ( ) *+% (XURSHDQ&RQJUHVVRI 5DGLRORJ\ &RQFOXVLRQ &DUGLRYDVFXODU &7 H[DPLQDWLRQV FDQ EH SHUIRUPHG LQ FDUGLR SXOPRQDU\ FRPSURPLVHG QHZERUQV DQG LQIDQWV ZLWK UDGLDWLRQ GRVHV DV ORZ DV P6YDQGGLDJQRVWLFLPDJHTXDOLW\$SURWRFROXWLOLVLQJDVLQJOHVKRRWD[LDO QRQ(&* WULJJHUHG 06&7 VFDQ LV PRVW IDYRXUDEOH7XEH YROWDJH RI N9 UHGXFHGUDGLDWLRQVLJQLÀFDQWO\ZLWKRXWUHOHYDQWGHJUDGDWLRQRILPDJHTXDOLW\ZKHQ VWXG\LQJWKHKHDUWDQGJUHDWWKRUDFLFYDVFXODWXUH % ,QYLYRLPDJLQJFKDUDFWHULVWLFVRIDWUDQVFDWKHWHUKHDUWYDOYH SURVWKHVLVZLWKPXOWLVOLFHFRPSXWHGWRPRJUDSK\ /0GH+HHU-+DEHWV-.OXLQ:3 7 00DOL3 56WHOOD/$YDQ+HUZHUGHQ 53 -%XGGH8WUHFKW1//0GHKHHU #XPFXWUHFKWQO 3XUSRVH7UDQVFDWKHWHUKHDUWYDOYH7+9SURVWKHVHVDUHH[SORUHGDVDQDOWHUQD WLYHWRFRQYHQWLRQDODRUWLFYDOYHUHSODFHPHQW3RVWLPSODQWHFKRFDUGLRJUDSKLFIRO ORZXSÀQGLQJVFDQEHFRPSOHPHQWHGE\PXOWLVOLFHFRPSXWHGWRPRJUDSK\06&7 +RZHYHUOLWWOHLVNQRZQRQLPDJHTXDOLW\,4RIWKHVHVWHQWHG7+9SURVWKHVHVWKDW PD\EHKDPSHUHGE\PHWDOLQGXFHGDUWHIDFWV:HDVVHVVHGWKH&7LPDJHTXDOLW\RI WKHFRPPRQO\LPSODQWHG(GZDUGV6DSLHQ7+9SURVWKHVLVZLWKDFREDOWFKURPLXP VWHQWLQSDWLHQWVDIWHUWUDQVFDWKHWHUDRUWLFYDOYHLPSODQWDWLRQ7$9, 0HWKRGVDQG0DWHULDOV7ZHQW\WZRSDWLHQWVDIWHU7$9,XQGHUZHQWUHWURVSHFWLYHO\ (&*JDWHGFDUGLDF&7$RQDVOLFH&7VFDQQHUN9P$V$IWHU UHFRQVWUXFWLRQLQWKUHHSHUSHQGLFXODUSODQHV7KHJHQHUDO,4DQG,4RIWKHVXSUD SURVWKHWLF VXESURVWKHWLF SHULSURVWKHWLF LQWUDSURVWKHWLF DQG YDOYXODU UHJLRQV ZDV VFRUHG RQ D IRXUSRLQW VFDOH QRQGLDJQRVWLF PRGHUDWH JRRG DQG H[FHOOHQWLQWKHEHVWV\VWROLFDQGGLDVWROLFSKDVH 5HVXOWV7ZHQW\WZRSDWLHQWVXQGHUZHQWDFDUGLDF&7$IHPDOHSDWLHQWVDJH \HDUV0HDQKHDUWUDWHGXULQJVFDQQLQJZDVEHDWVSHUPLQXWH7KH JHQHUDO,4VFRUHZDVPRGHUDWHDQGJRRGGXULQJV\VWROHDQGPRGHU DWHJRRGDQGH[FHOOHQWGXULQJGLDVWROHS $VLJQLÀFDQW GLIIHUHQFHEHWZHHQWKHV\VWROLFDQGGLDVWROLF,4LQWKHVXSUDSURVWKHWLFGLDVWROLF EHWWHU S SHULSURVWKHWLF V\VWROLF EHWWHU S DQG LQWUDSURVWKHWLF UHJLRQV\VWROLFEHWWHUS H[LVWHG $VLJQLÀFDQWFRUUHODWLRQEHWZHHQWKHKHDUW UDWHDQGJHQHUDOV\VWROLF,4ZDVSUHVHQWS &RQFOXVLRQ7KHFRPPRQO\LPSODQWHG(GZDUGV6DSLHQ7+9SURVWKHVLVDQGWKH SHULSURVWKHWLFUHJLRQVFDQEHYLVXDOLVHGZLWKPRGHUDWHWRJRRGLPDJHTXDOLW\E\ 06&7 GHVSLWHWKHSUHVHQFHRIDFREDOWFKURPLXPVWHQWIUDPH % 7KHGLDJQRVWLFYDOXHRIGXDOVRXUFH&7LQFRPSOH[FRQJHQLWDOKHDUW GLVHDVH 6;2X'6/XR*03HQJ04LDQ*XDQJ]KRX&1OKT [[K#FRP 3XUSRVH7 RGLVFXVVWKHGLDJQRVWLFYDOXHRIWKUHHGLPHQVLRQDOUHFRQVWUXFWHGWHFK QLTXHZLWKFRQWUDVWHQKDQFHPHQWRIGXDOVRXUFH&7'6&7LQFRPSOH[FRQJHQLWDO KHDUWGLVHDVH&&+' 0HWKRGVDQG0DWHULDOV7KH06&7GDWDRISDWLHQWVZLWK&&+'FRQÀUPHGE\ VXUJHU\ZHUHUHWURVSHFWLYHO\DQDO\VHG$OOSDWLHQWVZHUHSHUIRUPHGZLWKWUDQVWKR UDFLFHFKRFDUGLRJUDPV77(DQGZHUHFRPSDUHGZLWKFLQHDQJLRFDUGLRJUDPV &$*EHIRUHVXUJHU\ 5HVXOWV $WRWDORIFDUGLDFGHIRUPLWLHVZHUHIRXQGE\RSHUDWLRQ7KHDFFXUDF\ RI'6&7 77(DQG&$*LQGHWHFWLQJGHIRUPLWLHVZDVDQG UHVSHFWLYHO\7KHUHZHUHLQWUDFDUGLDFGHIRUPLWLHVPLVVHGE\'6&7 PLVVHG E\77(DQGPLVVHGE\$*7KHUHZDVQRVLJQLÀFDQFHGLIIHUHQFHLQGLDJQRVLV DFFXUDF\ZLWKWKUHHPHWKRGV3!7KHUHZHUHH[WUDFDUGLDFDQRPDOLHV 7KHGHÀQLWHGLDJQRVLVUDWHRI06&7 77(DQG&$*IRUH[WUDFDUGLDFDQRPDOLHV ZHUHDQGUHVSHFWLYHO\06&7DQG&$*ZHUHVXSHULRUWR 77(LQWKHLGHQWLÀFDWLRQRIH[WUDFDUGLDFGHIRUPLWLHV3DQGWKHGLDJQRVLV DFFXUDF\RI06&7DQG&$*VKRZHGQRGLIIHUHQFH3!06&7FRPELQHG ZLWK77(FRXOGLQFUHDVHWKHGHÀQLWHGLDJQRVLVUDWHWR &RQFOXVLRQ 06&7 PD\ EH XVHG WR FOHDUO\ GLVSOD\ WKH SDWKRORJLF DQDWRP\ RI &&+' ZKLFK LV VXSHULRU WR77( UHPDUNDEO\ LQ WKH GLDJQRVLV RI H[WUDFDUGLDF DQRPDOLHV 7KHUHIRUH DV D QRQLQYDVLYH WHFKQLTXH 06&7 KDV D YHU\ KLJKHU GLDJQRVWLFYDOXHLQ&&+' % ;UD\LQGXFHG'1$GRXEOHVWUDQGEUHDNVLQO\PSKRF\WHVRIFKLOGUHQ XQGHUJRLQJFDUGLDFÁDWSDQHO&7DQGDQJLRJUDSK\ 0%UDQG0*ORHFNOHU06RPPHU&(QJHUW08GHU0$.XHIQHU (UODQJHQ'(PLFKDHOEUDQG#XNHUODQJHQGH 3XUSRVH)ODWSDQHO&7'\QD&7HQDEOHV&7OLNHFURVVVHFWLRQDOLPDJLQJE\ FUHDWLQJ'VRIWWLVVXHGDWDVHWVE\URWDWLRQRIWKHGHWHFWRUDURXQGWKHSDWLHQWҋV ERG\3XUSRVHRIWKLVVWXG\ZDVWRLQYHVWLJDWHWKHHIIHFWRIFDUGLDFÁDWSDQHO&7RQ [UD\LQGXFHG'1$GRXEOHVWUDQGEUHDNV'6%VLQEORRGO\PSKRF\WHVLQFKLOGUHQ 0HWKRGV DQG 0DWHULDOV %ORRG VDPSOHV ZHUH REWDLQHG IURP WKLUWHHQ FKLOGUHQ EHIRUH DQG PLQXWHV DIWHU FDUGLDF ÁDWSDQHO &7 /\PSKRF\WHV ZHUH LVRODWHG VWDLQHGDJDLQVWWKHSKRVSKRU\ODWHGKLVWRQHYDULDQW+$;DQGIRFLUHSUHVHQWLQJ '6%VZHUHYLVXDOLVHGXVLQJÁXRUHVFHQFHPLFURVFRS\'RVHDUHDSURGXFW'$3 ZDVUHJLVWHUHGDVSURYLGHGE\WKHSDWLHQWSURWRFRO 5HVXOWV'$3UDQJHGIURPWRѥ*\PAPHGLDQ'6%FHOO'6% OHYHOVUDQJHGIURPWRFHOOPHGLDQ'6%FHOOEHIRUHDQGIURP WRFHOOPHGLDQ'6%FHOODIWHUÁDWSDQHO&7 WKHLQFUHDVHRI'6%VZDV VWDWLVWLFDOO\VLJQLÀFDQWS $FRUUHODWLRQZDVREWDLQHGEHWZHHQWKHLQGXFHG '6%DQGWKH'$3U &RQFOXVLRQ,QHYHU\SDWLHQWDVLJQLÀFDQWLQFUHDVHRI'6%VZDVGHWHFWDEOHDIWHU ÁDWSDQHO&7 [UD\LQGXFHG'6%VGHSHQGRQWKHGHOLYHUHGGRVH,QFRQFOXVLRQ LPPXQÁXRUHVFHQFHPLFURVFRS\LVDYDOLGPHWKRGWRGHWHFWGLVWLQFW'1$GDPDJHV HYHQDIWHUUDWKHUORZGLDJQRVWLFGRVHVDQGWKHUHIRUHLWFDQEHXVHGDVDPHDVXUH RIELRORJLFDOUDGLDWLRQHIIHFWV 6FLHQWLILF6HVVLRQ $ 6&'()*+% )ULGD\0DUFK (XURSHDQ&RQJUHVVRI 5DGLRORJ\ 6FLHQWLILF6HVVLRQ 6 &$' ( ) *+% (XURSHDQ&RQJUHVVRI 5DGLRORJ\ % 3VHXGRHPEROLFSHUIXVLRQGHIHFWVLQ&23'HYDOXDWLRQZLWKGXDO HQHUJ\&7DQJLRJUDSK\'(&7LQSDWLHQWV ) 3RQWDQD&&KDOD\HU-%)DLYUH&) 0XUSK\05pP\-DUGLQ-5HP\ /LOOH)5IUDQFRLVSRQWDQD#FKUXOLOOHIU 3XUSRVH7 RLQYHVWLJDWHWKHIUHTXHQF\RISVHXGRHPEROLFSHUIXVLRQGHIHFWVVHFRQG DU\WRWKHXQGHUO\LQJEURQFKRSXOPRQDU\GLVHDVHLQ&23'SDWLHQWV 0HWKRGVDQG0DWHULDOVSDWLHQWVZLWKVWDEOH&23'DQGQRKLVWRU\RIDFXWH DQGRUFKURQLFSXOPRQDU\YDVFXODUGLVHDVHXQGHUZHQW'(&7ZLWKUHFRQVWUXFWLRQ RIGLDJQRVWLFDQGSHUIXVLRQVFDQV7KLVYROXPHWULFDFTXLVLWLRQDWGHHSLQVSLUDWLRQ ZDV FRPSOHWHG E\ VHTXHQWLDO H[SLUDWRU\ VFDQV 7ZR UDGLRORJLVWVHYDOXDWHG E\ FRQVHQVXVWKHSUHVHQFHRISVHXGRHPEROLFSHUIXVLRQGHIHFWVLHWULDQJXODU SOHXUDOEDVHGDQGVKDUSO\PDUJLQDWHGK\SRDWWHQXDWHGDUHDVRQOXQJSHUIXVLRQ VFDQVZLWKV\VWHPDWLFGHSLFWLRQRIPRUSKRORJLFDOFKDQJHVLQWKHFRUUHVSRQGLQJ DUHDVRQLQVSLUDWRU\DQGH[SLUDWRU\GLDJQRVWLFLPDJHV 5HVXOWV$ WRWDO RI SVHXGRHPEROLF SHUIXVLRQ GHIHFWV ZHUH GHSLFWHGLQ SDWLHQWVZLWKDDSUHGRPLQDQWGLVWULEXWLRQLQWKHORZHUOREHV EREVHUYHGZLWKWKHFRQFXUUHQWSUHVHQFHRIVPDOODLUZD\VGLVHDVHDORQH HPSK\VHPDWRXVOHVLRQVDORQHDYDULDEOHDVVRFLD WLRQRIVPDOODLUZD\VGLVHDVHDQGHPSK\VHPDQ RUWKHH[FOXVLYHÀQGLQJ RIFHQWUDODLUZD\VDEQRUPDOLWLHVQ LQWKHFRUUHVSRQGLQJDQDWRPLFDO]RQHV 7KH&7IHDWXUHVRIVPDOODLUZD\VGLVHDVHGHSLFWHGLQWKHDUHDVRISVHXGRHPEROLF SHUIXVLRQ GHIHFWV LQFOXGHG DLU WUDSSLQJ IRFDOK\SRDWWHQXDWHG DUHDPXFRLGLPSDFWLRQVDQGRUEURQFKLROHFWDVLV 1RVWDWLVWLFDOO\VLJQLÀFDQWGLIIHUHQFHZDVIRXQGLQWKHIUHTXHQF\RI SVHXGRHPEROLFGHIHFWVEHWZHHQWKH&7SKHQRW\SHVRI&23'S &RQFOXVLRQ3VHXGRHPEROLFSHUIXVLRQGHIHFWVZHUHLGHQWLÀHGLQRI&23' SDWLHQWVPDLQO\VHHQLQDVVRFLDWLRQZLWK&7IHDWXUHVRIVPDOODLUZD\VGLVHDVH % )UHTXHQF\DQGRULJLQRIOXQJSHUIXVLRQGHIHFWVRQGXDOHQHUJ\ FRPSXWHGWRPRJUDSK\'(&7LQDQXQVHOHFWHGSDWLHQWJURXS $(2GLQN 05RVVLXV:9HUPHXOH&06FKDHIHU3URNRS,+DUWPDQQ 5RWWHUGDP1/$PHUVIRRUW1/ 3XUSRVH/XQJSHUIXVLRQGHIHFWVVHHQRQ'(&7DUHQRWQHFHVVDULO\FDXVHGE\ DFXWHSXOPRQDU\HPEROLVP$3(DQGWKHUHIRUHPD\FDXVHLQWHUSUHWDWLRQGLIÀFXOWLHV 3XUSRVHRIWKHVWXG\ZDVWRDVVHVVIUHTXHQF\DQGXQGHUO\LQJFDXVHRISHUIXVLRQ GHIHFWVRQ'(&7LQDQXQVHOHFWHGSDWLHQWJURXS 0HWKRGVDQG0DWHULDOV7KHVWXG\JURXSFRQVLVWHGRIFRQVHFXWLYHSDWLHQWV ZKRXQGHUZHQW'(&7IRUVXVSHFWHG$3(EHWZHHQ0D\DQG)HEUXDU\ 6WDWHRIWKHDUWSURWRFROVZHUHXVHGZLWKDVHFRQGJHQHUDWLRQ'(&7VFDQQHU$OO VFDQVZHUHUHWURVSHFWLYHO\UHYLVHGE\WZRUDGLRORJLVWVZLWKUHVSHFWWRWKHSUHV HQFHPRUSKRORJ\DQGORFDWLRQRISHUIXVLRQGHIHFWVDQGWRWKHSUHVHQFHDQGW\SH RI DUWHIDFWV )LQGLQJV ZHUH FRUUHODWHG ZLWK WKH ÀQGLQJV DW OXQJ ZLQGRZ VHWWLQJV DQGWKH&7$ÀQGLQJV 5HVXOWV,QRIWKHLQFOXGHGSDWLHQWVSHUIXVLRQPDSVZHUHDYDLO DEOHIRUHYDOXDWLRQ7ZHQW\WKUHHSDWLHQWVZHUHSRVLWLYHIRU$3(RIZKRP KDGZHGJHVKDSHGSHUIXVLRQ,QRIWKHSDWLHQWVXQGHUO\LQJOXQJ GLVHDVHVZHUHLGHQWLÀHGFDXVLQJSHUIXVLRQGHIHFWV7KHVHLQFOXGHGHPSK\VHPD SOHXUDOÁXLGZLWKFRPSUHVVLRQDWHOHFWDVLVDQGRUSQHXPRQLFFRQVROLGDWLRQV '(&7SHUIXVLRQPDSVVKRZHGVRPHW\SHRISHUIXVLRQGHIHFWV FDXVHGE\DUWHIDFWVVXFKDVEHDPKDUGHQLQJRUSXOVDWLRQDUWHIDFWVQRQHRIWKHP ZHUHIRXQGWRLQWHUIHUHZLWKWKHGLDJQRVLV &RQFOXVLRQ,QDQXQVHOHFWHGVWXG\JURXSWKHPDMRULW\RISDWLHQWVVKRZSHUIXVLRQ GHIHFWVRQ'(&7ZKLFKDUHQRWFDXVHGE\ $3(DQGFRUUHFWLQWHUSUHWDWLRQUHTXLUHV FORVHFRUUHODWLRQZLWKOXQJSDUHQFK\PDOÀQGLQJVDQG&7$ÀQGLQJV % ,PSDFWRILRGLQHGHOLYHU\UDWHZLWKYDU\LQJÁRZUDWHVRQGXDOHQHUJ\ &7LPDJHTXDOLW\LQSDWLHQWVZLWKVXVSHFWHGSXOPRQDU\HPEROLVP -+DQVPDQQ&)LQN00H\HU3 $SIDOWUHU626FK|QEHUJ7+HQ]OHU 0DQQKHLP'(MDQKDQVPDQQ#PHGPDXQLKHLGHOEHUJGH 3XUSRVH7 RSURVSHFWLYHO\FRPSDUHGLIIHUHQWFRQWUDVWPDWHULDOLQMHFWLRQSURWRFROV IRUGXDOHQHUJ\&7SXOPRQDU\DQJLRJUDSK\'(&73$LQSDWLHQWVZLWKVXVSHFWHG SXOPRQDU\HPEROLVP3( 0HWKRGV DQG 0DWHULDOV FRQVHFXWLYH SDWLHQWV ZKR XQGHUZHQW &73$ IRU H[FOXVLRQRI3(ZHUHUDQGRPLVHGLQWRGLIIHUHQWFRQWUDVWPDWHULDO&0LQMHFWLRQ SURWRFROVGHÀQHGE\GLIIHUHQWLRGLQHFRQFHQWUDWLRQVDQGLRGLQHGHOLYHU\UDWHV,'5 $PO,RSURPLGHP/V,'5J,V%PO,RSURPLGHDWP/V ,'5J,V&PO,RSURPLGHDWP/V,'5J,V'PO,RSUR 5RRP' &KHVW 66 &73$GXDOHQHUJ\DQGGRVHUHGXFWLRQ 0RGHUDWRUV 7)UDXHQIHOGHU=XULFK&+ %*KD\H%UXVVHOV%( % (YDOXDWLRQRIGXDOHQHUJ\&7OXQJSHUIXVLRQPDSVDFRUUHODWLRQ ZLWK94VFDQDQGOXQJSDUHQFK\PDOFKDQJHV 0/HIHUH0'HPHWHU) 'H.H\]HU-&RROHQ-9HUVFKDNHOHQ:'H:HYHU /HXYHQ%(PDWKLHXOHIHUH#X]OHXYHQEH 3XUSRVH 'XDO HQHUJ\ FRPSXWHG WRPRJUDSK\ '(&7 SHUIXVLRQPDSV FDQ EH XVHG WR YLVXDOLVH SXOPRQDU\ SHUIXVLRQ LQ WKH GLDJQRVWLF ZRUNXS RI SXOPRQDU\ HPEROLVP3(DQGRWKHUSXOPRQDU\GLVHDVHV6WXG\SXUSRVHDUHWRREVHUYH LQWHUREVHUYHUYDULDELOLW\LQSHUIXVLRQPDSUHDGLQJWRFRPSDUHSHUIXVLRQPDSV ZLWK 94 VFDQ WR FRUUHODWH SHUIXVLRQGHIHFWV 3' ZLWK OXQJSDUHQFK\PDO FKDQJHVRQ'(&7LPDJHV 0HWKRGVDQG0DWHULDOV7ZHQW\VL[SDWLHQWVXQGHUZHQW'(&7DQJLRJUDSK\DQG 94VFDQWRH[FOXGH3('(&7SHUIXVLRQPDSVZHUHHYDOXDWHGE\WZRUDGLROR JLVWV ,RGLQH GLVWULEXWLRQ SDWWHUQV ZHUH UDWHG DV KRPRJHQHRXV SHUIXVLRQ +3 ZHGJHVKDSHGGHIHFW:6'SDWFK\GHIHFW3D'FLUFXPVFULEHGGHIHFW&'RU DUWHIDFW'XDOHQHUJ\SHUIXVLRQÀQGLQJVZHUHFRUUHODWHGZLWK&7ÀQGLQJVQRUPDO HPSK\VHPDPRVDLFSHUIXVLRQJURXQGJODVVRSDFLWLHV**2DQGFRQVROLGDWLRQ DQG94ÀQGLQJVQRUPDOSHUIXVLRQGHIHFW3'ZLWKDQGZLWKRXWYHQWLODWLRQGHIHFW 9'LQSHUVHJPHQWDQDO\VHV 5HVXOWV 7KHUH ZDV D JRRG LQWHUREVHUYHU DJUHHPHQW UHDGLQJ SHUIXVLRQPDSV NDSSD 3HUIXVLRQPDSVVKRZHG+3 :6'3D'&'DUWHIDFWVLQ DQGUHVSHFWLYHO\94VKRZHG3'ZLWKRXW DQGZLWK9'IRU+3 3'DOOZLWKRXW9'IRU:6'3' ZLWKRXWDQGZLWK9'IRU3D'DQG3'ZLWKRXWDQGZLWK 9'IRU&'1RUPDOOXQJVKRZHG+3DQG3D'(PSK\VHPDWRXV OXQJVKRZHG3D'DQG+3 0RVDLFSHUIXVLRQVKRZHG+3DQG 3D' **2 VKRZHG +3 DQG 3D' &RQVROLGDWLRQ VKRZHG +3RU&' &RQFOXVLRQ7KHUHLVDJRRGLQWHUREVHUYHUDJUHHPHQWLQUHDGLQJ'(&7SHUIXVLRQ PDSV:6'FRUUHVSRQGZLWKUHDOSHUIXVLRQGHIHFWV3D'DQG&'FDQFRUUHVSRQG ZLWK SHUIXVLRQ GHIHFWV KRZHYHU WKH\ DUH PRUH OLNHO\ FRUUHVSRQGLQJ ZLWK RWKHU SDUHQFK\PDODEQRUPDOLWLHV % 8VHIXOQHVVRIYDVFXODULRGLQHGLVWULEXWLRQPDSVLQWKHGLDJQRVLVRI SXOPRQDU\HPEROLVP -,(%RVFR+67 HK6LQJDSRUH6* ERVFRMHURPHLH#DOH[DQGUDKHDOWKFRPVJ 3XUSRVH7 RHYDOXDWHWKHYDOXHRIYDVFXODULRGLQHPDSV9,'PDSVLQGXDOHQHUJ\ &7SXOPRQDU\DQJLRJUDPIRUGHWHFWLRQRISXOPRQDU\HPEROLVP 0HWKRGVDQG0DWHULDOV2QHKXQGUHGDQGWZHQW\VL[FRQVHFXWLYHSDWLHQWVZLWK VXVSHFWHG3(XQGHUZHQW&7SXOPRQDU\DQJLRJUDSK\&73$ZLWKGXDOHQHUJ\&7 '(&76LHPHQV6RPDWRP'HÀQLWLRQ)ODVKLQRXU'HSDUWPHQWVLQFH'HFHPEHU ZHUH HYDOXDWHG 9,' PDSV ZHUH REWDLQHG IRU DOO SDWLHQWV XVLQJ VWDQGDUG 6LHPHQVVRIWZDUH&7LPDJHVZHUHDVVHVVHGDQGFRPSDUHGIRUOXQJSDWKRORJ\ DQJLRJUDSKLFÀQGLQJVDQG9,' 5HVXOWV7KLUW\WKUHHRISDWLHQWVKDG3(EDVHGRQWKH&73$ÀQGLQJV2IWKHVH ZHUHLQLWLDOO\UHSRUWHGDVQRUPDOEXWVKRZHGHYLGHQFHRIVHJPHQWDOVXEVHJPHQ WDOWKURPELDIWHUDQJLRJUDSKLFLPDJHVZHUHUHYLHZHGZKHQ9,'LPDJHVUHYHDOHG :3':3'ZDVDEVHQFHLQSDWLHQWVZKRKDG3(RQ&73$8QGHUO\LQJGLIIXVH OXQJSDWKRORJ\ZDVSUHVHQWLQWKHVHSDWLHQWVZKLFKSUREDEO\REVFXUHGWKH:3' 1LQHSDWLHQWVVKRZHG:3'EXWQHJDWLYH&73$7KUHHKDGH[WHQVLYHSDUHQFK\PD DEQRUPDOLW\KDGSDXFLW\RISXOPRQDU\YHVVHOVLQWKHFRUUHVSRQGLQJDUHDV,QWKH UHPDLQLQJQRREYLRXVSDUHQFK\PDRUYDVFXODUDEQRUPDOLWLHVZHUHQRWHG2Q SHUSDWLHQWEDVLVSRVLWLYHSUHGLFWLYHYDOXHVQHJDWLYHSUHGLFWLYHYDOXHVVHQVLWLYLW\ VSHFLÀFLW\DQGDFFXUDF\ZHUHDQGUHVSHFWLYHO\ &RQFOXVLRQ9,'DQDO\VLVPDGHSRVVLEOHE\'(&7ZKHQXVHGZLWKWKHDQJLRJUDSKLF LPDJHVVLJQLÀFDQWO\LPSURYHVWKHDFFXUDF\RI3(GHWHFWLRQ 6FLHQWLILF6HVVLRQ $ 6&'()*+%(XURSHDQ&RQJUHVVRI 5DGLRORJ\ )ULGD\ % 'RVHUHGXFWLRQLQ&7SXOPRQDU\DQJLRJUDSK\LVLWVDIHWROLPLWVFDQ FRYHUDJH" -+DOSHULQ-5DMFKJRW'2GHGUD.+DQ\0+DVKHPL163DXO 7 RURQWR21&$MKDOSHULQ#TPHGFD 3XUSRVH7 RGHWHUPLQHLIVFDQOHQJWKUHVWULFWLRQGXULQJ&7SXOPRQDU\DQJLRJUDSK\ &73$UHVXOWVLQQRQGHWHFWLRQRIVLJQLÀFDQWÀQGLQJV 0HWKRGVDQG0DWHULDOV5HWURVSHFWLYHUHYLHZVRIFRQVHFXWLYHSDWLHQWV) PHDQDJH\KDYLQJ&73$IURPWR7ZRREVHUYHUVUHYLHZHG DOOLPDJHVLQHDFKVWXG\IXOOVFDQDQGWKHQRQO\LPDJHVVXSHULRUWRWKHDRUWLF DUFKDQGLQIHULRUWRWKHKHDUWOLPLWHGVFDQWRGHWHFWUDGLRORJLFDODEQRUPDOLWLHV,W ZDVGHWHUPLQHGZKHWKHUWKHDEQRUPDOLWLHVZRXOGEHPLVVHGRQOLPLWHGVFDQVDQG LIWKH\ZHUHVLJQLÀFDQWLQGHWHUPLQDWHRULQVLJQLÀFDQWEDVHGRQLPDJLQJIHDWXUHV FKDUWUHYLHZDQGSUHYLRXVLPDJLQJ'HGLFDWHGRQOLQHVRIWZDUH5DGLPHWULFV,QF 7 RURQWRFDOFXODWHGSDWLHQWDQGRUJDQVSHFLÀFGRVHIRUIXOODQGOLPLWHGVFDQV 5HVXOWV 0HDQ VFDQ OHQJWK IXOO PP OLPLWHG PP DYHUDJH FKDQJH PPSSDWLHQWVKDGDEQRUPDOLWLHVPLVVHGRQOLPLWHG &73$ ZHUH VLJQLÀFDQW EXW RQO\ ZHUH QHZ 2YHUDOO SDWLHQWV KDG QHZ VLJQLÀFDQW ÀQGLQJV PLVVHG UHQDOFDUFLQRPD DQGSHULWRQHDOGLVHDVH/LPLWHGVFDQ&73$SURGXFHVSDWLHQWUDGLDWLRQGRVH UHGXFWLRQRIIURPWRP6Y,&53DQGRUJDQGRVHUHGXFWLRQ !NLGQH\VFRORQWK\URLG!WHVWLFOHV VNLQVPDOOLQWHVWLQH!VSOHHQVWRPDFK RHVRSKDJXVUHGPDUURZEUDLQH\HOHQVDQG EUHDVWV &RQFOXVLRQ/LPLWHGVFDQOHQJWK&73$LVDVDIHSURFHGXUHLQRISDWLHQWV UHVXOWVLQUHGXFWLRQLQSDWLHQWGRVHDQGVLJQLÀFDQWUHGXFWLRQVLQRUJDQGRVH WRUDGLRVHQVLWLYHWLVVXHV % 5DZGDWDEDVHGLWHUDWLYHUHFRQVWUXFWLRQIRUFKHVWFRPSXWHG WRPRJUDSK\&7DQJLRJUDSK\FRPSDULVRQRIORZGRVHORZ N9LWHUDWLYHUHFRQVWUXFWLRQ&7DQGVWDQGDUGGRVHÀOWHUHGEDFN SURMHFWLRQ&7LQSDWLHQWV -3DJQLH]) 3RQWDQD-%)DLYUH7 )ORKU05pP\-DUGLQ-5HP\/LOOH)5 PDUWLQHUHP\#FKUXOLOOHIU 3XUSRVH7 RHYDOXDWHWKHLPDJHQRLVHDQGLPDJHTXDOLW\RIDUDZGDWDEDVHGLWHUD WLYHUHFRQVWUXFWLRQWHFKQLTXHLQORZN9SXOPRQDU\&7DQJLRJUDPVLQFRPSDULVRQ ZLWKVWDQGDUGGRVHÀOWHUHGEDFNSURMHFWLRQ)%3&7 0HWKRGVDQG0DWHULDOVFRQVHFXWLYHSDWLHQWVUHIHUUHGIRUDIROORZXSFKHVW&7 DQJLRJUDSKLFH[DPLQDWLRQXQGHUZHQWDORZGRVH&7H[DPLQDWLRQLH7VFDQ LQ VLPLODU WHFKQLFDO FRQGLWLRQV WR WKRVH RI WKH LQLWLDO H[DPLQDWLRQ LH7 VFDQ H[FHSWIRUDWKHNLORYROWDJHVHOHFWLRQUHGXFHGE\N9ZLWKDGDSWDWLRQRIWKH PLOOLDPSHUDJHWRHQVXUHDUHGXFWLRQRIWKH&7',DQGEWKHUHSODFHPHQWRI UHJXODU)%3E\LWHUDWLYHUHFRQVWUXFWLRQV6$),5( 5HVXOWV'HVSLWHDPHDQGHFUHDVHRILQWKH'/37P*\FP7 P*\FP7VFDQVVKRZHGDVLJQLÀFDQWO\OHVVREMHFWLYHQRLVHPHDVXUHG DW WKH OHYHO RI WKH WUDFKHD RQ PHGLDVWLQDO 7 7 SDQGOXQJLPDJHV77SE VLJQLÀFDQWO\KLJKHUVLJQDOWRQRLVH77DQGFRQWUDVW WRQRLVH77UDWLRVSFDVLPLODUYLVXDO SHUFHSWLRQRIQRLVHRQPHGLDVWLQDOS DQGOXQJLPDJHVS PDLQO\ UDWHGDVPRGHUDWHDQGGDVLPLODURYHUDOOLPDJHTXDOLW\UDWHGDVH[FHOOHQWLQ YV7DQGJRRGLQ7RI&7 H[DPLQDWLRQVS &RQFOXVLRQ7KHUDZGDWDEDVHGLWHUDWLYHUHFRQVWUXFWLRQWHFKQLTXHDOORZHGEHWWHU REMHFWLYHDQGVLPLODUVXEMHFWLYHLPDJHTXDOLW\RIORZNLORYROWDJH&7DQJLRJUDPV FRPSDUHGWRVWDQGDUGGRVH)%3&7H[DPLQDWLRQV % ,PDJHTXDOLW\DQGUDGLDWLRQGRVHRSWLPLVDWLRQIRUKLJKUHVROXWLRQ&7 SXOPRQDU\DQJLRJUDSK\XVLQJN9SDQGDXWRPDWLFH[SRVXUHFRQWURO 6$OUDMKL6$OKXPD\\G+.DVKDQL'2GHGUD-%OREHO163DXO 7 RURQWR21&$=RHWHUPHHU1/6XODLPDQ$OUDMKL#XKQRQFD 3XUSRVH 7 R DQDO\VH SDWLHQW H[SRVXUH DQG LPDJH TXDOLW\ ,4 XQLIRUPLW\IRU KLJKUHVROXWLRQ PP N9S &7 SXOPRQDU\ DQJLRJUDSK\ &73$FRPSDULQJ FRQVWDQWP$VWRDXWRPDWLFH[SRVXUHFRQWURO$(&YDULDEOHP$VZLWKHTXLYDOHQW LPDJHQRLVH,1 0HWKRGV DQG 0DWHULDOV 7ZR UHDGHUV LQGHSHQGHQWO\ PHDVXUHG ,1 5 5 SXOPRQDU\DUWHU\5 DRUWLFDUFK5 SUR[LPDOGHVFHQGLQJDRUWD5 GLVWDO PLGHDWP/V,'5J,V $WWHQXDWLRQYDOXHVZHUHPHDVXUHGRQ´YLUWXDOµ N9LPDJHVLQWKHLQÁRZWUDFWVXEFODYLDQYHLQVXSHULRUYHQDFDYDULJKWDWULXP WDUJHWWUDFWULJKWYHQWULFOHSXOPRQDU\WUXQNSXOPRQDU\DUWHULHVDQGRXWÁRZWUDFW OHIWDWULXPOHIWYHQWULFOHDVFHQGLQJDRUWDDQGFRPSDUHGXVLQJWKH:LOFR[RQUDQN VXPWHVW6XEMHFWLYHLPDJHTXDOLW\RI´YLUWXDOµN9LPDJHVDQGFDOFXODWHGLRGLQH SHUIXVLRQPDSVZDVDVVHVVHGE\WZRUHDGHUVSRLQW/LNHUWVFDOHѣVWDWLVWLFV 5HVXOWV7 DUJHWWUDFWDWWHQXDWLRQZDVKLJKHVWIRUSURWRFRO $ZLWK+RXQVÀHOG 8QLWV+8KLJKO\FRQFHQWUDWHG&0KLJK,'5LIFRPSDUHGWRDOORWKHUSURWRFROV DOOS1RVWDWLVWLFDOO\VLJQLÀFDQWGLIIHUHQFHZDVIRXQGEHWZHHQSURWRFRO% +8SURWRFRO&+8DQG'+8,PDJHTXDOLW\RISURWRFRO $ZDVUDWHGVLJQLÀFDQWO\KLJKHUFRPSDUHGWRDOORWKHUSURWRFROVZLWKDPHGLDQVFRUH RIS,QWHUUHDGHUDJUHHPHQWZDVJRRGZLWKDNDSSDRI &RQFOXVLRQ+LJKO\FRQFHQWUDWHGLRGLQDWHGFRQWUDVWPDWHULDOLQFRPELQDWLRQZLWK KLJKÁRZUDWHVSURYLGHVLPSURYHGGLDJQRVWLFLPDJHTXDOLW\DQGKDVWKHKLJKHVW WDUJHWWUDFWDWWHQXDWLRQIRUD'(&73$SURWRFRO % 3XOPRQDU\HPEROLVPDWGXDOVRXUFH&7DQJLRJUDSK\GRZHRYHUGRVH" 52FD*7 DUGDJXLOD&'HOJDGR&7ULQGDG$)HUQDQGH]'HO9DOOH ) 7 DUGDJXLOD0RQWHUR9LJR(6 3XUSRVH7 RFRPSDUHWKHUDGLDWLRQGRVHRIGXDOVRXUFHPXOWLGHFWRU&7 '6&7ZLWKFRQYHQWLRQDOPXOWLGHWHFWRU&70'&7LQSXOPRQDU\DQJLRJUDSK\ IRUWKHGLDJQRVLVRISXOPRQDU\HPEROLVP3( 0HWKRGVDQG0DWHULDOV7KHORFDOHWKLFVFRPPLWWHHDSSURYHGWKLVVWXG\:HUHW URVSHFWLYHO\UHYLHZHGSDWLHQWVZLWKFOLQLFDOVXVSLFLRQRISXOPRQDU\HPEROLVP 3(XQGHUZHQW'6&7DQGXQGHUZHQW0'&7 (IIHFWLYHGRVHVZHUH FRPSDUHGZLWKHVWLPDWHVEDVHGRQWKHPRVWFRPPRQO\XVHGPHWKRGLQFOLQLFDO OLWHUDWXUHPXOWLSO\LQJGRVHOHQJWKSURGXFW'/3E\DJHQHUDOFRQYHUVLRQFRHIÀFLHQW P6YÃP*\"ÃFP"GHWHUPLQHGIURP0RQWH&DUORVLPXODWLRQVRIFKHVW&7 5HVXOWV 7KH WZR JURXSV PDWFKHG ZHOO IRU FOLQLFDO FKDUDFWHULVWLFV WKHUH ZHUH LQFOXGHGPHQDQGZRPHQZLWKDQDYHUDJHRIDJHRI\HDUV7KH SHUFHQWDJHRISDWLHQWVZLWK3(GLDJQRVLVZDVIRUHDFKJURXS0HDQHIIHF WLYHGRVHVZLWK'6&7DQG0'&7ZHUHP6YDQGP6Y UHVSHFWLYHO\S &RQFOXVLRQ 0HDQ HIIHFWLYH GRVHV GR QRW LQFUHDVH XVLQJ D GRXEOH VRXUFH &7 SURWRFROFRPSDUHGZLWKFRQYHQWLRQDOPXOWLGHWHFWRU&7LQWKH3(VWXGLHV'HVSLWH WKHZLGHVSUHDGLGHDWKDWGRXEOHVRXUFHVWXGLHVFRXOGLQFUHDVHUDGLDWLRQGRVHZH IRXQGWKHUHLVQRLQFUHDVHEXWDVOLJKWUHGXFWLRQRIPHDQHIIHFWLYHGRVHZLWKGXDO HQHUJ\ WHFKQLTXH$FFRUGLQJ WR WKH DGGLWLRQDO LQIRUPDWLRQ SURYLGHG IRU WKH GXDO VRXUFHWHFKQLTXHVLRGLQHPDSVDQGOXQJSHUIXVLRQZHUHFRPPHQGXVLQJWKLV PHWKRGURXWLQHO\LIDYDLODEOH % N9S0'&7WRGLDJQRVHSXOPRQDU\HPEROLVPZLWKPLQLPLVHG UDGLDWLRQGRVH 81\PDQ 3 %MRUNGDKO%*ROGPDQ0/2OVVRQ6:HWWHPDUN 7UHOOHERUJ6(0DOP|6(XOIQ\PDQ#EUHGEDQGQHW 3XUSRVH7 R FRPSDUH UDGLDWLRQ GRVH DQG LPDJH TXDOLW\ RI N9S PXOWLURZ GHWHFWRUFRPSXWHGWRPRJUDSK\0'&7WRGLDJQRVHSXOPRQDU\HPEROLVP3( ZLWKWKDWRIDQGN9SZLWKDOORWKHUVFDQQLQJSDUDPHWHUVEHLQJHTXDOZKLOH LQVWHDGRIPJ,NJZHUHXVHGDWN9SWRFRPSHQVDWHIRUWKHGHFUHDVHG WKHRUHWLFDOFRQWUDVWWRQRLVHUDWLRQ&15 0HWKRGVDQG0DWHULDOV3DWLHQWVZLWKDQHVWLPDWHG*)5P/PLQXQGHUZHQW PD[LPXPZHLJKWNJDQGN9SSDWLHQWVLQHDFKJURXS0'&7 XVLQJWKHVDPHVFDQQHUDQG4XDOLW\UHIHUHQFHHIIHFWLYHP$V3XOPRQDU\ DUWHU\DWWHQXDWLRQLPDJHQRLVHVWDQGDUGGHYLDWLRQDQG&15SURYLGLQJDFORW RI+8ZHUHHYDOXDWHG6XEMHFWLYHLPDJHTXDOLW\ZDVDVVHVVHG&RPSXWHG WRPRJUDSK\GRVHLQGH[&7',YRODQGGRVHOHQJWKSURGXFW'/3ZHUHUHFRUGHG DQGHIIHFWLYHGRVHFDOFXODWHGEDVHGRQSXEOLVKHGFRQYHUVLRQIDFWRUV 5HVXOWV0HGLDQSDWLHQWZHLJKWDQG%0,DWN9SZHUHNJDQG NJP0HGLDQSXOPRQDU\DUWHU\DWWHQXDWLRQLPDJHQRLVH&15&7',YRO '/3DQGHIIHFWLYHGRVHDWN9SZHUH+8+8 P*\P*\ FPDQGP6Y$WN9S DOOH[DPLQDWLRQVZHUHDGHTXDWHFODVVLÀHGDVH[FHOOHQWFRPSDUHGZLWK DQGDWDQGN9S &RQFOXVLRQ5DGLDWLRQGRVHWRSDWLHQWVPD\EHGHFUHDVHGWRDERXWRQHWKLUGE\ UHGXFLQJ[UD\WXEHSRWHQWLDOIURPWRN9SZLWKRXWGHWHULRUDWLRQRIGLDJQRV WLFLPDJHTXDOLW\LIWKHGHFUHDVHG&15LVFRPSHQVDWHGZLWKDVOLJKWO\LQFUHDVHG LRGLQHGRVH7KHSURWRFROPD\EHRIVSHFLDOEHQHÀWLQ\RXQJLQGLYLGXDOVNJ ZLWKDGHTXDWH*)5 6FLHQWLILF6HVVLRQ 6 &$' ( ) *+% (XURSHDQ&RQJUHVVRI 5DGLRORJ\ % $FFXUDF\RI&7JXLGDQFHIRUOXPEDUIDFHWEORFNV 0:HLQLQJHU-0LOOV=5XPEROGW:+XGD$&LDQIRQL&KDUOHVWRQ6&86 ZHLQLQJH#PXVFHGX 3XUSRVH/XPEDUIDFHWMRLQWEORFNV)-%UHTXLUHSUHFLVHLQWUDDUWLFXODULQMHFWLRQIRU GLDJQRVWLFVSHFLÀFLW\HIÀFDF\2XUSXUSRVHZDVWRDVVHVVWKHSURFHGXUDOVXFFHVV SURÀOHRI)-%XQGHU&7JXLGDQFHDQGWRHVWLPDWHSHULSURFHGXUDOUDGLDWLRQGRVHV 0HWKRGV:HUHWURVSHFWLYHO\UHYLHZHGFOLQLFDOO\LQGLFDWHG)-%SURFHGXUHVLQ FRQVHFXWLYHSDWLHQWVPHQPHDQDJH\HDUVSURFHGXUHVWDUJHWHG IDFHWMRLQWV8QGHU&7JXLGDQFHDSRVWHULRUSDUDYHUWHEUDODFFHVVZDVXVHG $SUH SURFHGXUHORFDOLVLQJVFDQZDVIROORZHGE\LQWHUPLWWHQWORZGRVHN9P$V JXLGDQFHVFDQVVOLFHVPPVOLFHWKLFNQHVVRYHUODSPPFRYHUDJH 3UHVHQFH RI SRVWHULRU IDFHW RVWHRSK\WHV RYHUO\LQJ D GLUHFW MRLQW DFFHVV QHHGOH GLUHFWLRQIRUMRLQWDFFHVVREOLTXHLSVLODWHUDOVWUDLJKWLVSLODWHUDOREOLTXHFRQWUDODW HUDODQGQXPEHURI&7JXLGDQFHVFDQVQHHGHGIRUÀQDOQHHGOHSODFHPHQWDQG GRVHOHQJWKSURGXFW'/3ZHUHUHFRUGHG,QWUDDUWLFXODUQHHGOHSODFHPHQWZDV FRQÀUPHGE\MRLQWVSDFHFRQWUDVWRSDFLÀFDWLRQ 5HVXOWV)-%ZHUHWHFKQLFDOO\VXFFHVVIXOLQFDVHV $FFHVVVLGHDQGGLUHFWLRQ ZHUHDVIROORZVLSVLODWHUDOVWUDLJKWREOLTXHFRQWUDODWHUDOREOLTXH )-%ZHUHDW//DW/6DW//DQGDW//IDFHW MRLQWVSUHVHQWHGSRVWHULRURVWHRSK\WHV$YHUDJHQXPEHURIJXLGLQJVFDQVQHHGHG WRREWDLQÀQDOQHHGOHSRVLWLRQZDV$YHUDJH'/3SHU)-%ZDVHVWLPDWHGDW P*\FPFRUUHVSRQGLQJWRDQHIIHFWLYHGRVHRIP6Y &RQFOXVLRQ)-%XVLQJ&7JXLGDQFHLVVDIHDQGUDSLGHQVXUHVUHOLDEOHQHHGOH JXLGDQFHLQGLYLGXDOWRHDFKIDFHWMRLQWҋVDQDWRP\DQGDOORZVSUHFLVHLQWUDDUWLFXODU LQMHFWLRQZLWKH[WUHPHO\KLJKSURFHGXUDODFFXUDF\7KHHIIHFWLYHGRVHLVFRPSDUDEOH WRWKDWRIRQHPLQXWHRIÁXRURVFRS\JXLGDQFH % ([WUDSOHXUDOSDUDYHUWHEUDO&7JXLGHGÀQHQHHGOHELRSV\RI VXEFDULQDOO\PSKQRGHV :+7 DQWDZ\$6,EUDKLP0$0RKDPHG(+(O*HPHLH&DLUR(* WDQWDZ\Z#\DKRRFRP 3XUSRVH7 RUHSRUWRXUH[SHULHQFHLQ&7JXLGHGH[WUDSOHXUDOSDUDYHUWHEUDOVXE FDULQDOO\PSKELRSV\XVLQJDWKLQJDXJH*WKLQQHHGOHZLWKRXWWKHQHHGRI LQMHFWLRQRIVDOLQHWRZLGHQWKHPHGLDVWLQXP 0HWKRGVDQG0DWHULDOV%LRSV\ZDVSHUIRUPHGXVLQJD*QHHGOHZKLFKZDV DGYDQFHGODWHUDOWRWKHYHUWHEUDOERG\EHWZHHQWKHHQGRWKRUDFLFIDVFLDDQGWKH SDULHWDO SOHXUD WR JDLQ DFFHVV WR VXEFDULQDO O\PSK QRGHV 2QH KXQGUHG DQG IRUW\RQHSDWLHQWVZHUHLQFOXGHGLQWKHVWXG\IHPDOHVPDOHV1RDUWLÀFLDO ZLGHQLQJRIWKHPHGLDVWLQXPXVLQJVDOLQHLQMHFWLRQZDVUHTXLUHG7KHVWXG\ZDV SHUIRUPHG LQ WKH SUHVHQFH RI D F\WRSDWKRORJLVW VHQVLWLYLW\ DQG VSHFLÀFLW\ UDWHV ZHUH FDOFXODWHG &RPSOLFDWLRQV ZHUH GRFXPHQWHG IRU HDFK FDVH HVSHFLDOO\ IRU SQHXPRWKRUD[DQGKDHPRUUKDJH 5HVXOWV&\WRSDWKRORJLFDOGLDJQRVLVZDVUHDFKHGLQDOOFDVHV$OOUHDVSLUDWLRQV ZHUHGRQHLQWKHVDPHVHVVLRQWRUHDFKDSULPDU\GLDJQRVLVDWWKHWLPHRIWKHELRSV\ ,PXQRSKHQRW\SLQJVWXG\ZDVGRQHLQFDVHVWRFRQÀUPWKHSULPDU\GLDJQRVLV DQGWRFODVVLI\WKHPDOLJQDQWOHVLRQV1RSQHXPRWKRUD[ZDVHQFRXQWHUHG6PDOO KDHPDWRPDVZHUHQRWHGLQFDVHV&\WRSDWKRORJ\VKRZHGDVHQVLWLYLW\RI DQGVSHFLÀFLW\RI%\DGGLQJLPPXQRSKHQRW\SLQJDVHQVLWLYLW\ DQGVSHFLÀFLW\ZDVDFKLHYHG &RQFOXVLRQ)LQHQHHGOHDVSLUDWLRQF\WRORJ\)1$&XVLQJDJDXJHQHHGOHIRU VXEFDULQDOO\PSKQRGHVYLDDSHUFXWDQHRXVH[WUDSOHXUDOSDUDYHUWHEUDO&7JXLGHG DSSURDFK LV D VDIH PLQLPDOO\ LQYDVLYH DQG WROHUDEOH SURFHGXUH \LHOGLQJ D KLJK VHQVLWLYLW\DQGVSHFLÀFLW\UDWHVZLWKRXWWKHQHHGRIDUWLÀFLDOZLGHQLQJ % ,QLWLDOH[SHULHQFHRIDQRYHO&7ÁXRURVFRS\JXLGHGSHUFXWDQHRXV JDVWURVWRP\WHFKQLTXHZLWKORRSJDVWURSH[\DQGSHHODZD\VKHDWK WURFDUWHFKQLTXHLQDP\RWURSKLFODWHUDOVFOHURVLVSDWLHQWV 0GH%XFRXUW) &ROOHWWLQL&$OWKRII) 6WUHLWSDUWK-*UHXSQHU%+DPP 87 HLFKJUlEHU%HUOLQ'(PGE#FKDULWHGH 3XUSRVH7 RUHSRUWRXULQLWLDOH[SHULHQFHRIDQRYHO&7ÁXRURVFRS\JXLGHGSHU FXWDQHRXV JDVWURVWRP\ WHFKQLTXH ZLWK ORRS JDVWURSH[\ DQG SHHODZD\ VKHDWK WURFDUWHFKQLTXH 0HWKRGVDQG0DWHULDOV$FRQVHFXWLYHVHULHVRIDP\RWURSKLFODWHUDOVFOHURVLV SDWLHQWV LQ ZKRP HQGRVFRSLF JDVWURVWRP\ ZDV FRQVLGHUHG WRR GDQJHURXV RU LPSRVVLEOH XQGHUZHQW &7JXLGHG SHUFXWDQHRXV JDVWURSH[\ DQG JDVWURVWRP\ DQGSURVSHFWLYHIROORZXS$OOSURFHGXUHVZHUHSHUIRUPHGZLWKD)5)UHND 3H[DFWJDVWURVWRP\NLW)UHVHQLXV.DEL%DG+RPEXUJ*HUPDQ\URZVFDQQHU WKRUDFLFDRUWD*SFRQVHFXWLYHSDWLHQWVDJH\)VFDQQHGXVLQJ N9SDQGP$V)RUHDFKSDWLHQWPHDQ,1ZDVDYHUDJHGIRUERWKUHDGHUV DWHDFK52,DQGVXEVHTXHQWO\DYHUDJHGRYHUDOOSDWLHQWVIRU55*SDYHUDJHG ,1 +8*SVXEVHTXHQWSDWLHQWVPHDQDJH\)KDG&73$ ZLWKN9SDQG$(&GHWHUPLQHGYDULDEOHP$VZLWKPDWFKHGWDUJHW,1 +8 PHDVXUHPHQWVWHVWHGIRUQRUPDOGLVWULEXWLRQ.ROPRJRURY6PLUQRYWHVWDQG UHDGHUDJUHHPHQWVSDLUHG:LOFR[RQ7 HVW,155DQGSDWLHQW'/3P*\ FP ZHUHFRPSDUHGEHWZHHQ*SDQG*SXVLQJWKH0DQQ:KLWQH\WHVWIRU,1DJUHH PHQWDQG%DUOHWWWHVWIRUVWDQGDUGGHYLDWLRQѫDJUHHPHQWRI,1 5HVXOWV0HDQѫERG\ZHLJKW>NJ@*S*S,1>+8@ *S5 5 5 5 *S5 5 5 5 '/3>P*\ FP@*SDQG *S1RVLJQLÀFDQWGLIIHUHQFHVLQSDWLHQWERG\ZHLJKWS DQG '/3S LQLQWHUUHDGHUUHVXOWVRI,1IRU55S RULQ,1IRU 55DOOS!6LJQLÀFDQWGLIIHUHQFHVLQѫVWDQGDUGGHYLDWLRQS IRU55ZLWKѫUHGXFWLRQRIDYHUDJHG55YDOXHVLQ*S &RQFOXVLRQ +LJKUHVROXWLRQ N9S &73$ XVLQJ$(& SURYLGHV PRUH XQLIRUP LPDJHTXDOLW\DGDSWHGWRSDWLHQWERG\KDELWXVDFURVVWKHHQWLUHFKHVWZLWK UHGXFWLRQLQVWDQGDUGGHYLDWLRQѫRILPDJHQRLVHFRPSDUHGZLWKDÀ[HGP$V WHFKQLTXHDWHTXLYDOHQWSDWLHQWH[SRVXUH 5RRP' ,QWHUYHQWLRQDO5DGLRORJ\ 66 &7DQG05JXLGHGLQWHUYHQWLRQV 0RGHUDWRUV 3$OPHLGD&RLPEUD37 6.RV%DVOH&+ % &7ÁXRURVFRS\JXLGHGSHUFXWDQHRXVYHUWHEURSODVW\LQVSLQDO PDOLJQDQF\WHFKQLFDOUHVXOWV300$OHDNDJHVDQGFRPSOLFDWLRQVLQ SDWLHQWV &*7UXPP 7 .+HOPEHUJHU7 ) -DNREV&-=HFK56WDKO 7 $6DQGQHU3 03DSURWWND0) 5HLVHU57 +RIIPDQQ0XQLFK'( 'UHVGHQ'(FKULVWRSKWUXPP#PHGXQLPXHQFKHQGH 3XUSRVH 7 R UHWURVSHFWLYHO\ HYDOXDWH WKH LQFLGHQFH DQG FOLQLFDO LPSDFWRI ORFDO SRO\PHWK\OPHWKDFU\ODWHOHDNVDQGSXOPRQDU\FHPHQWHPEROLVPV3&(RFFXUULQJ XQGHU&7ÁXRURVFRS\JXLGHGYHUWHEURSODVW\RIPDOLJQDQWYHUWHEUDOFRPSUHVVLRQ IUDFWXUHV9&)DQGRVWHRO\VHV 0HWKRGV DQG 0DWHULDOV )URP WR FDQFHU SDWLHQWV ZRPHQPHQDJHZLWKSDLQIXO9&)DQGVSLQDORVWHRO\VHVXQGHUZHQW YHUWHEURSODVW\YHUWHEUDHZHUHWUHDWHGLQVHVVLRQVXQGHU&7ÁXRURVFRS\ JXLGDQFHN9P$VLQJOHVOLFHDQGURZ&72VWHRO\WLF LQYROYHPHQW LH QRQH RU RI WKH YHUWHEUDO FURVV VHFWLRQDODUHDDQGWKHSRVWHULRUZDOOZHUHDVVHVVHGLQWKHSUHYHUWHEURSODVW\&7 /RFDO 300$ OHDNV ZHUH DQDO\VHG XVLQJ WKH SRVWYHUWHEURSODVW\ &7 3UHVHQFH DQGORFDWLRQRI3&(ZHUHHYDOXDWHGLQDOOSDWLHQWVKDYLQJXQGHUJRQHFRQYHQWLRQDO UDGLRJUDSK\&5Q RU&7Q RIWKHFKHVWDIWHUYHUWHEURSODVW\GXHWRWKHLU XQGHUO\LQJWXPRXUGLVHDVH3DWLHQWFKDUWVZHUHUHYLHZHGUHJDUGLQJDGYHUVHHYHQWV UHODWHGWRYHUWHEURSODVW\ 5HVXOWVDQGRIWUHDWHGYHUWHEUDHVKRZHGPRUHWKDQRV WHRO\WLFLQYROYHPHQWRIWKHYHUWHEUDOFURVVVHFWLRQDODUHDDQGWKHSRVWHULRUZDOO UHVSHFWLYHO\/RFDO300$OHDNDJHUDWHZDVRIYHUWHEUDH3&( VHJPHQWDO Q FHQWUDO Q ZHUH VHHQ DIWHU RI WKH SURFHGXUHV ZLWK IROORZXSLPDJLQJRIWKHFKHVW1RPDMRUFRPSOLFDWLRQVRFFXUUHGZLWKLQDGD\ SHULRGDIWHUYHUWHEURSODVW\ &RQFOXVLRQ9HUWHEURSODVW\RIVSLQDOPDOLJQDQF\FDQEHVDIHO\SHUIRUPHGXQGHU &7ÁXRURVFRS\JXLGDQFHHYHQLQSDWLHQWVZLWKVXEVWDQWLDORVWHRO\WLFLQYROYHPHQW ,QRXUSDWLHQWFROOHFWLYHORFDO300$OHDNVDQG3&(YLVXDOLVHGLQSRVWSURFHGXUDO UDGLRJUDSK\DQG&7LPDJHVKDGQRFOLQLFDOLPSDFW 6FLHQWLILF6HVVLRQ $ 6&'()*+%(XURSHDQ&RQJUHVVRI 5DGLRORJ\ )ULGD\ % 3HUFXWDQHRXVGUDLQDJHXQGHU&7JXLGDQFHRIGHHSDEVFHVVXVLQJD EOXQWWLSLQWURGXFHU &GH%D]HODLUH) 6DEDWLHU0&KDSHOOLHU$6FHPDPD $3OXYLQDJH3 %RXUULHU$0=DJGDQVNL(GH.HUYLOHU3DULV)5 FHGULFGHED]HODLUH#VOVDSKSIU 3XUSRVH 'HHS DEVFHVV GUDLQDJHV XQGHU &7 JXLGDQFH DUH XVXDOO\ GLIÀFXOWWR UHDFKEHFDXVHRIYLWDOVWUXFWXUHVLQWHUYHQLQJLQWKHQHHGOHSDWKZD\2XUSXUSRVH LVWRHYDOXDWHWKHHIÀFDF\DQGWKHVDIHW\RIGHHSGUDLQDJHVXQGHU&7JXLGDQFH XVLQJDEOXQWWLSLQWURGXFHU 0HWKRGVDQG0DWHULDOV7ZRKXQGUHGDQGVHYHQFRQVHFXWLYHSDWLHQWVUHIHUUHG IRU&7JXLGHGDEVFHVVGUDLQDJHZHUHLQFOXGHGLQWKLVUHWURVSHFWLYHVWXG\,QÀIW\ SDWLHQWVDEOXQWWLSLQWURGXFHUZDVXVHGWRUHDFKWKHDEVFHVVDQGLQDVWDQGDUG QHHGOHZDVXVHGFRQWUROJURXS3URFHGXUHVZHUHDQDO\VHGLQWHUPRIGXUDWLRQ LUUDGLDWLRQVXFFHVVDQGFRPSOLFDWLRQV 5HVXOWV 7KH SURFHGXUH GXUDWLRQ ZDV ORQJHU LQ WKH EOXQWWLS JURXS PLQ YV PLQ S +RZHYHU SDWLHQW V GRVLPHWU\ ZDV QRW VLJQLÀFDQWO\ KLJKHU LQWKHEOXQWWLSJURXSYVP*\FP1RVLGHHIIHFWZDVREVHUYHGLQWKH EOXQWWLSJURXSZKHUHDVKDHPDWRPDVDQGERZHOSHUIRUDWLRQVZHUHVHHQLQWKH FRQWUROJURXS'XULQJWKHIROORZXSDVHFRQGGUDLQDJHZDVQHFHVVDU\LQLQ WKHEOXQWWLSJURXSDQGLQWKHRWKHUJURXSS &RQFOXVLRQ%OXQWWLSLQWURGXFHUVUHSUHVHQWDYLDEOHDVDIHDOWHUQDWLYHWRVWDQGDUG QHHGOHVZKHQSHUIRUPLQJ&7JXLGHGSHUFXWDQHRXVGUDLQDJHVRIGHHSDEVFHVV % 7RZDUGVFDUGLRYDVFXODULQWHUYHQWLRQVJXLGHGE\PDJQHWLFSDUWLFOH LPDJLQJ03,ÀUVWLQVWUXPHQWFKDUDFWHULVDWLRQ -+DHJHOH6%LHGHUHU+:RMWF]\N0*UDHVHU7 .QRSS7 0%X]XJ -%DUNKDXVHQ) 09RJW/EHFN'(KDHJHOH#UDGLRORJLHXQLOXHEHFNGH 3XUSRVH0DJQHWLFSDUWLFOHLPDJLQJ03,LVDQHZWRPRJUDSKLFLPDJLQJPHWKRG DQGDYHU\SURPLVLQJDSSOLFDWLRQIRUFDUGLRYDVFXODULQWHUYHQWLRQDOUDGLRORJ\:H HYDOXDWHGWKH03,SHUIRUPDQFHRIYDULRXVFRPPHUFLDOO\DYDLODEOHLQVWUXPHQWVDQG DVHOIFRDWHGFDWKHWHUXVLQJPDJQHWLFSDUWLFOHVSHFWURVFRS\036 0HWKRGVDQG0DWHULDOV6HYHQWHHQFRPPHUFLDOO\DYDLODEOHLQWHUYHQWLRQDOGHYLFHV ZHUHVHOHFWHGQLQHFDWKHWHUVÀYHEUDLGHGRQHQLWLQROIRXUVWDLQOHVVVWHHODQG IRXU QRQEUDLGHG DQG HLJKW JXLGH ZLUHV IRXU VWDLQOHVVVWHHOWKUHH QLWLQRO RQH SRO\HWKHUHWKHUNHWRQH3((.PPVL]HGSLHFHVZHUHWDNHQIURPWKHWLSWKHGLVWDO SDUWPPSUR[LPDOWKHWLSDQGIURPWKHVKDIWRIHDFKGHYLFHDQGHYDOXDWHG XVLQJ036 $VDPHDVXUHRISHUIRUPDQFHWKHWRWDOKDUPRQLFGLVWRUWLRQ7+'ZDV GHWHUPLQHG,QDVHFRQGVWHSRQHFRPPHUFLDOO\DYDLODEOHFDWKHWHUZLWKRXWVLJQDO UHVSRQVHLQ036ZDVH[SHULPHQWDOO\FRDWHGDWWKHWLSZLWK63,2VWRHYDOXDWHWKH WUDFHDELOLW\RID63,2FRDWLQJ 5HVXOWV 6LJQDOJHQHUDWLQJ DQG QRQVLJQDOJHQHUDWLQJ GHYLFHV FRXOG EH GLVWLQ JXLVKHGUHOLDEO\XVLQJ0367KH7+'RIVLJQDOJHQHUDWLQJLQVWUXPHQWVZDVVLJ QLÀFDQWO\KLJKHUWKDQRIQRQVLJQDOJHQHUDWLQJLQVWUXPHQWV6'G% YV 6' G% S RI VWDLQOHVVVWHHO FRQWDLQLQJ GHYLFHV JHQHUDWHG D VLJQDO UHVSRQVH ZKHUHDV QLWLQROFRQWDLQLQJ RI DQG PHWDOIUHH LQVWUXPHQWVRIGLGQRW)XUWKHUPRUHWKH63,2FRDWHGFDWKHWHUJHQHUDWHGD VLJQDOLQFRQWUDVWWRWKHVDPHXQFRDWHGFDWKHWHUYVG% &RQFOXVLRQ,WLVSRVVLEOHWRUHOLDEO\GLVWLQJXLVKVLJQDOJHQHUDWLQJDQGQRQVLJQDO JHQHUDWLQJLQVWUXPHQWVDQGWRODEHOLQVWUXPHQWVZLWK63,2VIRUDEHWWHUWUDFHDELOLW\ XVLQJ03,7KLVLVDSUHFRQGLWLRQIRUIXUWKHUGHYHORSPHQWRIVXLWDEOHLQVWUXPHQWV % 3HUFXWDQHRXV05JXLGHGFU\RDEODWLRQRISURVWDWHFDQFHUWHFKQLFDO IHDVLELOLW\DQGSUHOLPLQDU\UHVXOWV *7 VRXPDNLGRX+/DQJ2$EGHOOL;%X\0GH0DWKHOLQ'-DFTPLQ $*DQJL6WUDVERXUJ)5JWVRXPDNLGRX#\DKRRFRP 3XUSRVH :H KHUHLQ UHSRUW RXU LQLWLDO H[SHULHQFH DQG WHFKQLFDO IHDVLELOLW\ RI WUDQVSHULQHDOSURVWDWHFU\RDEODWLRQXQGHUPDJQHWLFUHVRQDQFHJXLGDQFH 0HWKRGVDQG0DWHULDOV)URP-XO\WLOO-XO\SHUFXWDQHRXV05JXLGHG FU\RDEODWLRQZDVSHUIRUPHGLQSDWLHQWVZLWKSURVWDWLFDGHQRFDUFLQRPDFRQWUDLQ GLFDWHGIRUVXUJHU\PHDQDJH\HDUVPHDQ*OHDVRQVFRUHPHDQ36$ QJUPO 7F10 PHDQ SURVWDWHYROXPH PO )UHHKDQG SUREH SRVLWLRQLQJZDVSHUIRUPHGXQGHUUHDOWLPH05LPDJLQJ)RXUWRVHYHQFU\RSUREHV ZHUHLQVHUWHGLQWKHSURVWDWHGHSHQGLQJRQWKHWRWDOJODQGYROXPH7KHLFHEDOO ZDVPRQLWRUHGXVLQJUHDOWLPH7UXÀDQGKLJKUHVROXWLRQ7:%ODGHPXOWLSODQDU LPDJLQJ3DWLHQWVZHUHIROORZHGDWPRQWKVDIWHUWKHSURFHGXUHZLWK VHUXP36$OHYHODQGSRVWDEODWLRQ05, $TXLOLRQ7 RVKLED0HGLFDO6\VWHPV(XURSH7KH1HWKHUODQGVDQGVLQJOHVKRW &7ÁXRURVFRS\PRGH 5HVXOWV7KHSURFHGXUHZDVSHUIRUPHGVXFFHVVIXOO\LQRISDWLHQWVPHQ ZRPHQPHGLDQDJH\HDUVUDQJH,QWKHUHPDLQLQJFDVHWKHVWRPDFK ZDVSXQFWXUHGXQGHU&7ÁXRURVFRS\DQG&2LQVXIÁDWLRQZDVLQLWLDWHGWKHUHDIWHU OHDGLQJ WR VXFFHVVIXO JDVWURVWRP\ ZLWKRXW SULRU JDVWURSH[\ DQGZLWKRXW IXUWKHU DGYHUVHHYHQWVGXULQJIROORZXS7ZRSDWLHQWVUHSRUWHGXQSUREOHPDWLFH[FKDQJH RIDEDOORRQWXEHGXHWRVNLQLUULWDWLRQVZLWKQRIXUWKHUDGYHUVHHYHQWV2QHSDWLHQW UHSRUWHGDFFLGHQWDOGLVSODFHPHQWRIDQH[FKDQJHGQHZEDOORRQWXEHLQGRPHVWLF HQYLURQPHQWGXHWREDOORRQOHDNDJH$QHZEDOORRQWXEHZDVHDVLO\UHLQVHUWHGLQ DKRVSLWDOWKHVDPHGD\1RVHULRXVDGYHUVHHYHQWVVXFKDVSHULWRQLWLVSHUVLVWHQW ORFDOEOHHGLQJRUDQ\ORFDOLQIHFWLRQUHTXLULQJVXUJLFDOLQWHUYHQWLRQZHUHREVHUYHG 8QWLO$XJWKIROORZXSUHVXOWHGLQFXPXODWLYHJDVWURVWRP\GD\VIURP WKHGDWHRIÀUVWSODFHPHQW &RQFOXVLRQ ,QLWLDO UHVXOWV VXJJHVW WKH RXWFRPH RI WKH GHVFULEHG WHFKQLTXHW R EHFRPSDUDEOHWRFRQYHQWLRQDOUDGLRORJLFJDVWURVWRP\DQGLWFDQEHVXFFHVVIXOO\ SHUIRUPHGZKHUHHQGRVFRSLFJDVWURVWRP\DQGVHGDWLRQDUHFRQWUDLQGLFDWHG % 6SKHQRSDODWLQHJDQJOLRQDOFRKROQHXURO\VLVXQGHU&7JXLGDQFHLQ WKHPDQDJHPHQWRIFUDQLRIDFLDOSDLQLQSURFHGXUHV $.DVWOHU 6$XEU\*&DGHO%.DVWOHU&OHUPRQW)HUUDQG)5 %HVDQFRQ)5 3XUSRVH7KHSXUSRVHRIWKLVVWXG\LVWRGHVFULEHDQGHYDOXDWHWKHVDIHW\DQG HIIHFWLYHQHVVRIDOFRKROQHXURO\VLVRIWKHVSKHQRSDODWLQHJDQJOLRQXQGHU&7JXLG DQFHLQWKHPDQDJHPHQWRIIDFLDOYDULRXVSDLQV\QGURPHV 0HWKRGVDQG0DWHULDOV7KLUW\HLJKWSDWLHQWVZHUHLQFOXGHGLQWKLVUHWURVSHFWLYH VWXG\EHWZHHQ'HFHPEHUDQG-XQH$WRWDORIVSKHQRSDODWLQHQHX URO\VLV631ZHUHSHUIRUPHGXVLQJDEVROXWHDOFRKRO7KH631ZDVFRQVLGHUHGWR EHHIIHFWLYHZKHQSDLQUHOLHIZDVHTXDOWRRUJUHDWHUWKDQODVWLQJIRUDWOHDVW RQHZHHN7KHPHDQSDLQUHOLHISHULRGIROORZLQJWKHSURFHGXUHIRUHDFKSDWLHQWZDV QRWHG,QFDVHRIUHFXUULQJSDLQERWKGXUDWLRQDQGLQWHQVLW\RISDLQZHUHQRWHG$OO SURFHGXUHVZHUHUHDOLVHGRQDQRXWSDWLHQWEDVLVXQGHUORFDODQDHVWKHVLD 5HVXOWV0HDQGXUDWLRQRIIDFLDOSDLQEHIRUHSURFHGXUHZDV\HDUV7KLUW\VL[RXW RIWKH631SURFHGXUHVSHUIRUPHGZHUHVXFFHVVIXO7KHRYHUDOOPHDQ GXUDWLRQRISDLQUHOLHIZDVPRQWKVDIWHU631SURFHGXUH,QVXFFHVVIXO 631UHFXUULQJSDLQRFFXUUHGZLWKDPHDQGXUDWLRQRIPRQWKVDIWHULQLWLDOSUR FHGXUH6XFFHVVUDWHRI631GHSHQGLQJRISDLQW\SHDUHDVIROORZVDW\SLFDOIDFLDO SDLQSFOXVWHUKHDGDFKH3WULJHPLQDOQHXUDOJLD SFRPSUHVVLRQE\QHRSODVPS &RQFOXVLRQ&7JXLGHGDOFRKROQHXURO\VLVRIWKHVSKHQRSDODWLQHJDQJOLRQLVDVDIH DQGHIIHFWLYHWUHDWPHQWRIUHIUDFWRU\FKURQLFFUDQLRIDFLDOSDLQV\QGURPHVHVSHFLDOO\ LQFDVHVRIFOXVWHUKHDGDFKHVDW\SLFDOIDFLDOSDLQDQGWULJHPLQDOQHXUDOJLD % 7DLORUHGLQWHUDFWLYHVHTXHQFHVIRUFRQWLQXRXV05LPDJHJXLGHG IUHHKDQGELRSVLHVRIGLIIHUHQWRUJDQVLQDQRSHQV\VWHPDW7HVOD SUHOLPLQDU\UHVXOWV 0GH%XFRXUW ) 6WUHLWSDUWK87 HLFKJUlEHU%HUOLQ'( -HQD'(PGE#FKDULWHGH 3XUSRVH7 RDVVHVVIHDVLELOLW\LPDJHTXDOLW\DQGDFFXUDF\RIIUHHKDQGELRSVLHV RIOXQJOLYHUVRIWWLVVXHDQGERQHOHVLRQVXVLQJE))(JUDGLHQWVSLQHFKR))( IDVWJUDGLHQWHFKRDQG76(IDVWVSLQHFKRVHTXHQFHVIRULQWHUDFWLYHFRQWLQXRXV QDYLJDWLRQLQDQRSHQ05,V\VWHPDW7 0HWKRGVDQG0DWHULDOV05JXLGHGELRSVLHVOXQJOLYHUERQHVRIW WLVVXHDQGRWKHURUJDQVZHUHSHUIRUPHGLQD7RSHQPDJQHWLFUHVRQDQFH05 VFDQQHU3DQRUDPD+)23KLOLSV+HDOWKFDUH%HVW7KH1HWKHUODQGVWR JDXJH 05FRPSDWLEOH ELRSV\ VHWV 6RPDWH[ 0HGLFDO 7 HOWRZ *HUPDQ\ VHPL DXWRPDWLFELRSV\JXQV,QYLYR6FKZHULQ*HUPDQ\RUJDXJH05FRPSDWLEOH ERQHPDUURZELRSV\QHHGOHV6RPDWH[0HGLFDO7 HOWRZ*HUPDQ\ZHUHHPSOR\HG &RPSOLFDWLRQVDQGSDWKRORJLFDOELRSV\UHSRUWVDVDQLQGLFDWRUIRUOHVLRQVKLWZHUH UHFRUGHG $YHUDJHSDWLHQWVҋDJHZDVPLQPD[IHPDOHDQGPDOH SDWLHQWVZHUHLQFOXGHG7KHPHDQLQWHUYHQWLRQWLPHZDVPLQ 5HVXOWV2XULQLWLDOUHVXOWVLQGLFDWHWKDWE))(LVSDUWLFXODUO\VXLWDEOHIRUIDVWPRYLQJ RUJDQVSXOPRQDOSDUDFDUGLDOPRYLQJRUJDQVDUHWDUJHWHGEHWWHUZLWK7:76( 7:))(OLYHURU7:76(DGUHQDOJODQGVDQGVWDWLFRUJDQVDUHVXFFHVVIXOO\ DSSURDFKHG ZLWK 3' VSLQH RU 7: 76( SHULSKHUDO ERQHV PXVFXORVNHOHWDO V\VWHP1RPDMRUFRPSOLFDWLRQVRFFXUUHG$YHUDJHOHVLRQVL]HZDVPPPLQ PD[ &RQFOXVLRQ$SSO\LQJ WDLORUHG LQWHUDFWLYH G\QDPLF LPDJLQJ VHTXHQFHV IRU FRQ WLQXRXVQDYLJDWLRQZLWKDUELWUDU\VOLFHVHOHFWLRQIRUPDQHXYHULQJHYHQWRGHOLFDWH ORFDWLRQVLPSURYHVLQWHUYHQWLRQDODFFXUDF\DQGIHDVLELOLW\RIIUHHKDQG05JXLGHG ELRSVLHVDQGPD\KHQFHUHGXFHWKHULVNRIFRPSOLFDWLRQV 6FLHQWLILF6HVVLRQ 6 &$' ( ) *+% (XURSHDQ&RQJUHVVRI 5DGLRORJ\ 7KHPHGLDQVRQRHODVWRJUDSK\VFRUHLQJURXS$ZDV>WKWKSHUFHQWLOH@ ZKLOHLWZDVLQJURXS%S*URXS $WHQGRQVSUHVHQWHGZLWKDUHODWLYHO\ KRPRJHQHRXVFRORXUSDWWHUQZKLOHJURXS%WHQGRQVSUHVHQWHGZLWKDUHODWLYHO\ SDWFK\FRORXUSDWWHUQ&RUUHODWLRQEHWZHHQ86DQGVRQRHODVWRJUDSK\ZDVKLJK U S &RQFOXVLRQ 6RQRHODVWRJUDSK\ ZDV DEOH WR GHWHFW GHJHQHUDWLYH FKDQJHV RI 663WHQGRQVLQHOGHUO\YROXQWHHUVZLWKJRRGFRUUHODWLRQWR86VRLWFRXOGKHOS LQLQFUHDVLQJ86GLDJQRVWLFDFFXUDF\LQGHWHFWLRQRI663WHQGRQGHJHQHUDWLRQ % &OLQLFDOLQGLFDWLRQVIRUPXVFXORVNHOHWDOXOWUDVRXQGFRQVHQVXV SDSHURIWKH(XURSHDQ6RFLHW\RI0XVFXORVNHOHWDO5DGLRORJ\ $.ODXVHU $7 DJOLDÀFR*0$OOHQ1%RXWU\5&DPSEHOO 0&RXUW3D\HQ$-*UDLQJHU+*XHULQL(*0F1DOO\3 -2ҋ&RQQRU 62VWOHUH3 3HHWURQV05HLMQLHUVH/06FRQÀHQ]D(6LOYHVWUL '-:LOVRQ&0DUWLQROL,QQVEUXFN$7*HQRD,72[IRUG8./LOOH)5 /LYHUSRRO8.&RSHQKDJHQ'./HHGV8.3DULV)5%UXVVHOV%( /HLGHQ1/0LODQ,7DWDJOLDÀFR#VLUPRUJ 3XUSRVH7 RGHYHORSFOLQLFDOJXLGHOLQHVIRUPXVFXORVNHOHWDOXOWUDVRXQG06.86 UHIHUUDOLQ(XURSH 0HWKRGV DQG 0DWHULDOV 6L[WHHQ PXVFXORVNHOHWDO UDGLRORJLVWV IURP VHYHQ (X URSHDQFRXQWULHVSDUWLFLSDWHGLQDFRQVHQVXVEDVHGLQWHUDFWLYHSURFHVV'HOSKL PHWKRGXVLQJFRQVHFXWLYHTXHVWLRQQDLUHVDQGFRQVHQVXVSURFHGXUHDW(XURSHDQ PHHWLQJV)LUVWHYLGHQFHYDOLGLW\ZDVFRQÀUPHGE\OLWHUDWXUHUHVHDUFKIROORZHG E\FRQVHQVXVRQFOLQLFDOXWLOLW\LQHYDOXDWLRQRIPXVFXORVNHOHWDOGLVHDVHVLQWKUHH FRQVHQVXVPHHWLQJV7KLVLQYROYHGDWKRURXJKWUDQVSDUHQWLWHUDWLYHDSSURDFK HPSOR\LQJ TXDQWLWDWLYH DQG TXDOLWDWLYH UHVHDUFK WHFKQLTXHV LQFOXGLQJ LQWHUYLHZ TXHVWLRQQDLUH'HOSKLDQGVWDQGDUGVHWWLQJPHWKRGRORJLHV $OOUHOHYDQWVWDNHKROGHUV ZHUHHQJDJHGLQFOXGLQJ(XURSHDQ06.H[SHUWVZLWKVSHFLDOIRFXVRQ06.86 7ZRGLIIHUHQWH[SHUWJURXSVZRUNHGRQDFRQVHQVXVLQDÀUVWDQGVHFRQGPHHWLQJ 7KHWKLUGFRQVHQVXVPHHWLQJVUHVROYHGTXHVWLRQVWKDWGLGQRWDFKLHYHFRQVHQVXV OLPLWE\WKHÀUVWWZRTXHVWLRQQDLUHV 5HVXOWV2QJHQHUDOFRQVHQVXVPXVFXORVNHOHWDOXOWUDVRXQGLVLQGLFDWHGWRGHWHFW MRLQWV\QRYLWLVÁXLGDQGVHSWLFHIIXVLRQIRUSRWHQWLDODVSLUDWLRQDQGSRRUO\LQGLFDWHGWR GHWHFWORRVHERGLHV5HFRPPHQGDWLRQVIRUPRVWDSSURSULDWHXVHRIPXVFXORVNHOHWDO XOWUDVRXQGDUHUHSRUWHGLQVL[DUHDVUHOHYDQWWRPXVFXORVNHOHWDOXOWUDVRXQGKDQG ZULVWHOERZVKRXOGHUKLSNQHHDQNOHIRRW &RQFOXVLRQ $FRPSUHKHQVLYHHYLGHQFHEDVHGH[SHUWFRQVHQVXVGHÀQHGHGXFD WLRQDOIUDPHZRUNLVSUHVHQWHG7KLVVKRXOGIDFLOLWDWHUHIHUUDOVIRUPXVFXORVNHOHWDO XOWUDVRXQGWKURXJKRXW(XURSH % )DFWRUVLQÁXHQFLQJTXDQWLWDWLYHYDOXHVRIFRQWUDVWHQKDQFHG XOWUDVRXQGDQGFRUUHODWLRQVZLWKFOLQLFDOYDOXHVLQUKHXPDWRLGDUWKULWLV &&\WHYDO0RQWSHOOLHU)5FF\WHYDO#FKXPRQWSHOOLHUIU 3XUSRVH7 RHYDOXDWHWKHUHOLDELOLW\RITXDQWLWDWLYHSDUDPHWHUVRIWKHWLPHLQWHQVLW\ FXUYHVLQFRQWUDVWHQKDQFHGXOWUDVRXQG&(86IRUWKHDVVHVVPHQWRIV\QRYLDO YDVFXODULVDWLRQ LQ 5$ DQG WKHLU FRUUHODWLRQ ZLWK FOLQLFDO DQG ELRORJLFDO VLJQV RI LQÁDPPDWLRQGXULQJWKHIROORZXSRIWKHGLVHDVH 0HWKRGVDQG0DWHULDOVSDWLHQWVZLWKDFWLYH5$DQGFRQWUROSDWLHQWVZHUH UHFUXLWHG 7ZR DFTXLVLWLRQV RI D VHOHFWHG MRLQW ZLWK 'RSSOHU V\QRYLWLV ZHUH SHU IRUPHGDWKRXULQWHUYDOIRUHDFKSDWLHQWE\WKHVDPHLQYHVWLJDWRUDIWHULQMHFWLRQ RIPLFUREXEEOHFRQWUDVWDJHQW,QDGGLWLRQLQSDWLHQWVZLWK5$DWKLUGDFTXLVLWLRQ ZDV SHUIRUPHG PRQWKV ODWHU 6\QRYLDO YDVFXODULVDWLRQ ZDV TXDQWLÀHG XVLQJ WLPHLQWHQVLW\FXUYHSDUDPHWHUVPD[LPXPVLJQDOLQWHQVLW\$8&DUHDXQGHUWKH FXUYH773WLPHWRSHDN&RUUHODWLRQVRIWKHFXUYHSDUDPHWHUVZLWKWKHIROORZLQJ YDULDEOHVSDWLHQWDFTXLVLWLRQVL]HDQGORFDOLVDWLRQRI52,DVZHOODVZLWKFOLQLFDO DQGELRORJLFDOVLJQVRILQÁDPPDWLRQZHUHDQDO\VHGXVLQJORJLVWLFUHJUHVVLRQVDQG 3HDUVRQRU:LOFR[RQWHVWV 5HVXOWV5$SDWLHQWVSUHVHQWHGWKHIROORZLQJIHDWXUHVPHGLDQDJH \HDUVPHGLDQGLVHDVHGXUDWLRQ\HDUV1RVLJQDOLQWHQVLW\LQFUHDVH ZDVREVHUYHGLQFRQWUROSDWLHQWVPHGLDQDJH\HDUV7KHFXUYHSDUDP HWHUVZHUHLQGHSHQGHQWIURPWKHDFTXLVLWLRQDQGWKH52,ORFDOLVDWLRQS $WWKHPRQWKIROORZXSYDULDWLRQRI$8&ZDVFRUUHODWHGZLWK'$6YDULDWLRQ U >@DQGZLWK&53YDULDWLRQU >@ &RQFOXVLRQ2XUSUHOLPLQDU\ÀQGLQJVVKRZWKDWV\QRYLWLVPD\EHUHOLDEO\IROORZHG XVLQJ&(86WLPHLQWHQVLW\FXUYHSDUDPHWHUVDQGVXJJHVWWKDW $8&DUHFRUUHODWHG ZLWKWKHYDULDWLRQRIWKH'$6LQSDWLHQWVZLWK5$ 5HVXOWV3URVWDWHFU\RDEODWLRQZDVWHFKQLFDOO\IHDVLEOHLQRXWRISDWLHQWV7KH LFHEDOOZDVFOHDUO\DQGVKDUSO\YLVXDOLVHGLQDOOFDVHVDVDVLJQDOYRLGDUHD0HDQ LFHEDOOYROXPHZDVPO0HDQIROORZXSZDVPRQWKVUDQJHPRQWKV 0HDQ36$QDGLUZDVQJUPOUDQJHQJUPO0HDQKRVSLWDOL]DWLRQ ZDVGD\VUDQJHGD\V&RPSOLFDWLRQVLQFOXGHGDXUHWKUDUHFWXPÀVWXOD XULQDU\LQIHFWLRQWUDQVLHQWG\VXULDDQGVFURWDOSDLQ &RQFOXVLRQ 05JXLGHG SURVWDWH FU\RDEODWLRQ LV IHDVLEOH DQG SURPLVLQJ ZLWK H[FHOOHQWPRQLWRULQJRIWKHLFHEDOO)XWXUHSHUVSHFWLYHVFRXOGLQFOXGHWKHXVHRI 05JXLGDQFHIRUWKHIRFDOSURVWDWHFDQFHUFU\RWKHUDS\ % &OLQLFDOLPSRUWDQFHRI&7DVVLVWHGV\PSDWKLFRO\VLVLQSULPDU\IRFDO SODQWDUDQGSDOPDUK\SHUKLGURVLV ) 6FKHHU $:LQV3 .DPXVHOOD3 :LJJHUPDQQ&:LVVJRWW5$QGUHVHQ +HLGH'(5RVWRFN'(5HJHQVEXUJ'(&:LVVJRWW#ZNNKHLGH 3XUSRVH7KHREMHFWLYHRIWKLVVWXG\ZDVWRHYDOXDWHWKHEHQHÀWRIWKRUDFLFDQG OXPEDUFRPSXWHGWRPRJUDSKLFDVVLVWHGV\PSDWKLFRO\VLV&76\LQSDWLHQWVZLWK SULPDU\IRFDOK\SHUKLGURVLV 0HWKRGVDQG0DWHULDOV7KRUDFLFDQGRUDOXPEDU&76\ZDVFRQGXFWHGRQ SDWLHQWVDYHUDJHDJH\HDUVZLWKSULPDU\IRFDOK\SHUKLGURVLVRIWKH KDQGVDQGRUIHHWZKRH[SHULHQFHGSHUVLVWHQWV\PSWRPVDIWHUDOOFRQVHUYDWLYH WUHDWPHQWRSWLRQVKDGEHHQH[KDXVWHG7KHSDWLHQWVZHUHGLYLGHGLQWRJURXSVZLWK SDOPDUSDOPRSODQWDUDQGSODQWDUK\SHUKLGURVLV7KHSDWLHQWVHYDOXDWHGWKHVHYHU LW\RIWKHLUV\PSWRPVSULRUWRWKHLQWHUYHQWLRQGD\VPRQWKVDQGPRQWKV DIWHUWKHLQWHUYHQWLRQXVLQJD'HUPDWRORJ\4XDOLW\RI/LIH,QGH['/4,DQGVLGH HIIHFWVH[SHULHQFHG 5HVXOWV7KHLQWHUYHQWLRQVSHUIRUPHGOHGWRDVWDWLVWLFDOO\VLJQLÀFDQWGHFUHDVHLQ WKHIROORZXSDIWHU&76\LQDOOJURXSVS7KHWHFKQLFDOVXFFHVVUDWHRIWKH &76\ ZDV 1R PDMRU FRPSOLFDWLRQV RFFXUUHG$V WKH PRVW FRPPRQ VLGH HIIHFWRIWKHSDWLHQWVUHSRUWHGFRPSHQVDWRU\SHUVSLUDWLRQRYHUWKHFRXUVH RIWUHDWPHQW1HXUDOJLDH[SHULHQFHGE\DQGSDUDHVWKHVLDE\RIWKH SDWLHQWVVXEVLGHGVSRQWDQHRXVO\LQDOORIWKRVHDIIHFWHGDIWHUDSHULRGRIZHHNV DWPRVW7KHGLIIHUHQWLDWHGDVVHVVPHQWRIWKHVWUHQJWKRISHUVSLUDWLRQRIWKHKDQGV DQG IHHW VKRZHG VWDWLVWLFDOO\ VLJQLÀFDQW GLIIHUHQFHV EHWZHHQ WKH IRRW DQG KDQG UHJLRQ ZKHUHE\ WKH GHFUHDVH LQ VZHDW VHFUHWLRQ RI WKH IHHW ZDV VWURQJHU DQG PRUHODVWLQJS &RQFOXVLRQ $IWHUFRQVHUYDWLYHPHDVXUHVKDYHEHHQH[KDXVWHG&76\UHSUHVHQWV DWKHUDSHXWLFRSWLRQORZLQVLGHHIIHFWVIRUSDWLHQWVZLWKSULPDU\IRFDOK\SHUKLGURVLV 5RRP( 0XVFXORVNHOHWDO 66 8OWUDVRXQG 0RGHUDWRUV '0LNOLþ=DJUHE+5 *7XUyF]\%XGDSHVW+8 % 6RQRHODVWRJUDSK\FDQKHOSLQWKHHYDOXDWLRQRIVXSUDVSLQDWXV WHQGRQGHJHQHUDWLRQ &0DUWLQL()DEEUR*)HUUHUR'2UODQGL(6LOYHVWUL*HQRD,7 FKLDUDSLR#OLEHURLW 3XUSRVH7 RGHVFULEHXWLOLW\RIVRQRHODVWRJUDSK\LQWKHHYDOXDWLRQRIVXSUDVSLQD WXVWHQGRQ663GHJHQHUDWLRQLQWZRJURXSVRI\RXQJDQGHOGHUO\DV\PSWRPDWLF YROXQWHHUV 0HWKRGVDQG0DWHULDOV6L[W\DV\PSWRPDWLFVXEMHFWVZHUHLQFOXGHGLQRXUHYDOX DWLRQ WKLUW\ \RXQJ VXEMHFWV JURXS$ PHDQ DJH UDQJH WKLUW\ HOGHUO\ VXEMHFWVJURXS%PHDQDJHUDQJH$OOVXEMHFWVZHUHVFUHHQHGE\86 0+]SUREH0\/DE;Y*(VDRWH,WDO\7ZR\RXQJVKRXOGHUVZHUHIRXQG WRKDYHSDUWLDOWKLFNQHVVWHDURIWKH663 ZKLOHHOGHUO\VKRXOGHUVZHUHIRXQGWR KDYHSDUWLDOIXOOWKLFNQHVVWHDURIWKH663 7KXVRXUVWXG\JURXSZDVPDGHE\ \RXQJDQGHOGHUO\VKRXOGHUV)RUHDFKVKRXOGHUZHGHWHFWHGWKHSUHVHQFHRI VLJQVRIWHQGRQGHJHQHUDWLRQÀEUHLQWHUUXSWLRQIUDJPHQWDWLRQDQGFDOFLÀFDWLRQV 7KHQDOOWHQGRQVZHUHHYDOXDWHGE\VRQRHODVWRJUDSK\ZKRVHRXWFRPHZDVWUDQV ODWHGLQWRDVHPLTXDQWLWDWLYHVFDOHKDUG WRVRIW &KLVTXDUH.UXVNDO:DOOLV DQG6SHDUPDQҋVVWDWLVWLFVZHUHXVHG 5HVXOWV,QJURXS$ZHIRXQGLQWHUUXSWLRQQ IUDJPHQWDWLRQQ DQGFDO FLÀFDWLRQVQ ZKLOHLQJURXS%Q Q DQGQ UHVSHFWLYHO\S 6FLHQWLILF6HVVLRQ $ 6&'()*+%(XURSHDQ&RQJUHVVRI 5DGLRORJ\ )ULGD\ QHZDOWHUQDWLYHPLQLPDOO\LQYDVLYHWUHDWPHQWWKDWDFWXDOO\WDUJHWVSDWKRSK\VLRORJ\ RIURWDWRUFXIIWHQGRQSDWKRORJ\WKDWKDVIDLOHGWUDGLWLRQDOQRQVXUJLFDOUHPHGLHV 0HWKRGV DQG 0DWHULDOV SDWLHQWV ZLWK FOLQLFDO VXVSLFLRQ RI URWDWRU FXII WHDU XQGHUZHQW05,H[DPLQDWLRQ:KHQHYLGHQFHRIDVXSUDVSLQDWXVORQJLWXGLQDOVSOLW WHDUZDVFRQÀUPHGWKHSDWLHQWZDVSURVSHFWLYHO\HQUROOHGLQWKHVWXG\DQGKDG86 DVVHVVPHQWGLDJQRVLVFRQÀUPHGDFFRUGLQJWRHFKRWH[WXUHLQWHUVWLWLDOWHDULQJDQG QHRYDVFXODULW\,QGLYLGXDOVUDQGRPLVHGLQWRJURXSVÀUVWJURXSSDWLHQWVDJH UHFHLYHGVWDQGDUGWUHDWPHQWZLWKP/%XSLYDFDLQHDQGPJWULDPFLQRORQH LQWRWKHVXEDFURPLDOVXEGHOWRLGEXUVD7KHVHFRQGJURXSSDWLHQWVDJH UHFHLYHGWKHVWDQGDUGWKHUDS\DVZHOODV$%,LQWRWKHVLWHRILQWHUVWLWLDOWHDULQJDQG ÀEULOODUGLVFRQWLQXLW\:HSHUIRUPHGWZRLQMHFWLRQVDQGPRQLWRUHGDQ\FKDQJHVLQ WKHWHQGRQZLWKXOWUDVRXQGDQGDVVHVVHGSDLQVFRUHVDQGIXQFWLRQDOLPSURYHPHQW XVLQJWKHYDOLGDWHG2[IRUG6KRXOGHU6FRUH266 5HVXOWV3UHSURFHGXUDO266DQGWKRVHDWGD\VZHHNVDQGPRQWKV SRVWSURFHGXUHZHUHFRPSDUHG'LIIHUHQFHVLQVRQRJUDSKLFHFKRJHQLFLW\QHRYDV FXODULW\DQGLQWHUVWLWLDOWHDUVL]HQRWHG3DWLHQWVLQWKH $%,JURXSVKRZHGVWDWLVWLFDO DQGFOLQLFDOORQJWHUPSDLQUHOLHIDQGIXQFWLRQDOLPSURYHPHQWDVDVVHVVHGE\WKH RYHUDOO266 &RQFOXVLRQ$XWRORJRXV EORRG LQMHFWLRQ DSSHDUV WR EH D YLDEOH DOWHUQDWLYHDQG PRUHFOLQLFDOO\HIIHFWLYHZKHQFRPSDUHGWRVWDQGDUGVWHURLGLQMHFWLRQWKHUDS\IRU URWDWRUFXIIGHODPLQDWLRQWHDULQJ % (YDOXDWLRQRIHFKRJXLGHGDXWRORJRXVSODWHOHWJHO$3*WUHDWPHQWLQ SDWLHQWVZLWKWHQGLQRVLV 6%DWWLVWL/*UHJRUL) $UULJRQL$/D0DUUD/=XJDUR$%DULOH &0DVFLRFFKL/ҋ$TXLOD,7DQWRQLREDULOH#FFXQLYDTLW 3XUSRVH3XUSRVHRIRXUVWXG\ZDVWRHYDOXDWHWKHHIIHFWRISODWHOHWJHOWUHDWPHQW LQSDWLHQWVZLWKWHQGLQRVLVWKDWWRGD\LVQRWVXUJLFDOO\WUHDWHG7KHHYDOXDWLRQZDV EDVHGRQREVHUYDWLRQRIFOLQLFDOLPSURYHPHQWDQG05,LPDJLQJ7KHSODWHOHWJHO VKRZV DQWLLQÁDPPDWRU\ DQG UHJHQHUDWLYH HIIHFWV ZKLFK DOORZ UHFRYHU\ RI WKH IXQFWLRQDOLW\ 0HWKRGVDQG0DWHULDOV:HHYDOXDWHGSDWLHQWVZLWKWHQGLQRVLVRIVXSUDVS LQDWXVSWV$FKLOOHVҋSWVDQGSDWHOODUWHQGRQVSWV&OLQLFDODVZHOODV IXQFWLRQDOHYDOXDWLRQVRIWKHSDWLHQWVZHUHSHUIRUPHGXVLQJWKHYLVXDODQDORJXH VFDOH9$6IRUSDLQDQG&RQVWDQW6FDOH9,6$$DQG9,6$3 IRUIXQFWLRQDOLW\ 7KH LQVWUXPHQWDO HYDOXDWLRQ ZDV EDVHG RQ 86 DQG 05,7KH SURWRFRO LQFOXGHG WKUHHLQÀOWUDWLRQVSHUIRUPHGDWDGLVWDQFHRIGD\VWKHRQHIURPWKHRWKHU7KH FRQWURO05,ZDVSHUIRUPHGEHIRUHWUHDWPHQWDQGGD\VDIWHUWKHODVWLQÀOWUDWLRQ 5HVXOWV7KH9$6PHDQYDOXHRIWKHVXSUDVSLQDWXVWHQGRQDWWKHHQGRIWUHDW PHQWLPSURYHGRYHUDOOE\DQGWKH&RQVWDQWVFDOHE\,QWKHSDWLHQWV ZLWKWHQGLQRVLVRI$FKLOOHVWHQGRQVZHIRXQGDQLPSURYHPHQWRI9$6DQG 9,6$$7KHSDWHOODUWHQGRQ9$6YDOXHLQFUHDVHGRIDQGWKH9,6$3 YDOXH RI &RPSDUHG ZLWK WKHVH JRRG FOLQLFDO UHVXOWV WKH LPDJLQJ ÀQGLQJV ZHUHOHVVVLJQLÀFDQW &RQFOXVLRQ%HVLGHVSURGXFLQJ YHU\VDWLVIDFWRU\UHVXOWV LQ WHUPVRIV\PSWRPV DQGIXQFWLRQDOLW\LQSDWLHQWVZLWKWHQGLQRVLVWKHXVHRISODWHOHWJHODOVRJLYHVVLJQV RIPRUSKRORJLFDOUHFRYHU\+RZHYHUIXUWKHULQYHVWLJDWLRQVDUHQHHGHGWRFRQÀUP FRQVLVWHQF\RIWKHVHUHVXOWV % &RPELQHGXOWUDVRXQG86JXLGHGSHUFXWDQHRXVWUHDWPHQWRI HSLWURFKOHLWLVDUDQGRPLVHGFRQWUROOHGWULDO '2UODQGL ()DEEUR&0DUWLQL*)HUUHUR/6FRQÀHQ]D*6HUDÀQL (6LOYHVWUL*HQRD,76DQ'RQDWR0LODQHVH,73LHWUD/LJXUH69,7 WKHDER#OLEHURLW 3XUSRVH(SLWURFKOHLWLVLVDFRPPRQFDXVHRIHOERZSDLQWKDWFRXOGEHWUHDWHG ZLWKFRQVHUYDWLYHRUVXUJLFDOLQWHUYHQWLRQ7KHSXUSRVHRIRXUZRUNZDVWRFRPSDUH SDWLHQWVZLWKFOLQLFDOGLDJQRVHVRIHSLWURFKOHLWLVWUHDWHGZLWKDFRPELQHG86JXLGHG SHUFXWDQHRXVDSSURDFKGU\QHHGOLQJDQGVWHURLGDQGVLPLODUSDWLHQWVWUHDWHGZLWK HLWKHUORFDOVWHURLGLQMHFWLRQRUGU\QHHGOLQJ 0HWKRGV DQG 0DWHULDOV SDWLHQWV VXIIHULQJ IURP HSLWURFKOHLWLV XQGHUZHQW WR 86JXLGHG SHUFXWDQHRXV WUHDWPHQW PDOHV DJH >PHDQVWGHY@ ZHUHWUHDWHGZLWKGU\QHHGOLQJDQGORFDOVWHURLGLQMHFWLRQWRJHWKHUPDOHVDJH ZLWKGU\QHHGOLQJRQO\DQGPDOHVDJHZLWKORFDOVWHURLG LQMHFWLRQRQO\$YLVXDODQDORJXHVFDOH9$6IURPWRZDVXVHGWRHYDOXDWH WKHGHJUHHRISDLQDWEDVHOLQHDQGDWZHHNVDIWHUWKHSURFHGXUH 86VFDQQLQJZDVSHUIRUPHGDWEDVHOLQHZHHNV 5HVXOWV1RLPPHGLDWHRUGHOD\HGFRPSOLFDWLRQV ZHUHREVHUYHG3DWLHQWVZKR XQGHUZHQWVWHURLGLQMHFWLRQRQO\KDGDSURPSWSDLQGHFUHDVHEXWOLPLWHGHIIHFWVRQ DORQJWHUPEDVLVEDVHOLQH9$6 ZHHNV9$6 9$6 % &(86HYDOXDWLRQLQWKHSVHXGDUWKURVLVEHIRUHDQGDIWHUWUHDWPHQW ZLWKDXWRORJRXVWUDQVSODQWDWLRQRIERQHPDUURZVWHPFHOOV SUHOLPLQDU\UHVXOWV 63R]]D $'H0DUFKL03HWUD]'$ORM*%LLQR&)DOHWWL7XULQ,7 3DYLD,7VLPRQDSR]]D#WLQLW 3XUSRVH7 RGHPRQVWUDWHWKHHIIHFWLYHQHVVRI&(86LQHYDOXDWLQJWKHSURFHVVRI UHSDUDWLYHERQHUHJHQHUDWLRQE\PRQLWRULQJDQJLRJHQHVLVDURXQGWKHIUDFWXUHVLWH LQSDWLHQWVZLWKSVHXGDUWKURVLVZKRZHUHWUHDWHGZLWKWUDQVSODQWDWLRQRIPDUURZ GHULYHGPHVHQFK\PDOVWHPFHOOV 0HWKRGVDQG0DWHULDOV7KHPHWKRGZDVXVHGLQSDWLHQWVRIWKH7UDXPDWRO RJ\ &HQWUH LQ 7 RULQR ,WDO\ IURP )HEUXDU\ WR 0D\ $OO SDWLHQWV ZHUH WUHDWHGIRUGHOD\HGPXOWLIUDJPHQWDU\IUDFWXUHHYROYHGLQSVHXGDUWKURVLV $XWRORJRXV FRQFHQWUDWHRIERQHPDUURZVWHPFHOOVZDVDSSOLHGLQWRWKHDUHDRIERQHGHIHFW &(86H[DPLQDWLRQZDVSHUIRUPHGEHIRUHWKHJHODWLQRXVFRPSRXQGZDVDSSOLHG DQGDWRQHIRXUDQGWZHOYHZHHNIROORZXSWLPHSRLQWVLQRUGHUWRHYDOXDWHWKH SK\VLRORJLFDO IRUPDWLRQ RI QHZ EORRG YHVVHOV$W WKH HQG RI WKH VWXG\ DQ ;UD\ FRQÀUPVWKHSUHVHQFHRIFDOOXV 5HVXOWV(FRJUDSKLFVLJQVRIQHRYDVFXODULVDWLRQZHUHQRWHGDWRQHZHHNLQ RISDWLHQWVDVWHDG\LQFUHDVHLQYDVFXODULW\ZDVGHPRQVWUDWHGLQSDWLHQWVLQ VXEVHTXHQWWHVWVUHSHDWHGPHDVXUHV $129$GHPRQVWUDWHGVWDWLVWLFDOO\VLJQLÀFDQW GLIIHUHQFHV LQ WKH H[WHQW RI YDVFXODULVDWLRQ DW VXEVHTXHQW IROORZXS WLPH SRLQWV 3$WWKHHQGRIWKHVWXG\[UD\H[DPLQDWLRQUHYHDOHGLQLWLDODWWDFKPHQW RIFDOFLÀHGFDOOXVLQWKRVHSDWLHQWVZKRGHPRQVWUDWHGDQLQFUHDVHLQYDVFXODULW\ DW&(867KHRWKHUWZRSDWLHQWVVKRZHGQRLPSURYHPHQWEHFDXVHRIWKHSUHV HQFHRIKDHPDWRPD &RQFOXVLRQ7UDQVSODQWDWLRQRIVWHPFHOOVLVDQHZWUHDWPHQWRISVHXGRDUWKURVLV RXUUHVXOWVGHPRQVWUDWHWKDW&(86KDVDJRRGSUHGLFWLYHYDOXHRQWKHIRUPDWLRQ RIFDOOXVLQWKDWLWDIIRUGVWKHPRQLWRULQJRIWKHUHSDUDWLYHWLVVXHYDVFXODULW\ % 9LVXDOLVDWLRQRIP\RIDVFLDOWULJJHUSRLQWVLQORZEDFNPXVFOHVE\ UHDOWLPHVRQRHODVWRJUDSK\ 10$EGHO5D]HN2.DWWDEHL0.1DVVLI0(O/LWKH\&DLUR(* QDJODDEGHOUD]HN#\DKRRFRP 3XUSRVH0\RIDVFLDOWULJJHUSRLQWV07U3VDUHDFRPPRQVRXUFHRISDLQDQGKDV EHHQUHSRUWHGWRYDU\IURPWRLQPXVFXORVNHOHWDOSDLQ+RZHYHUWKHUH LVVWLOODODFNRIREMHFWLYHPHDQVWRHLWKHUTXDQWLI\RUYLVXDOLVHWKHLUFRUHIHDWXUHV 3XUSRVHLVWRH[DPLQHWKHDELOLW\RIYLEUDWLRQVRQRHODVWURJUDSK\(FRORXUPRGH WRYLVXDOLVH07U3VXSHUÀFLDODVZHOODVGHHSRQHVDQGWRGLIIHUHQWLDWHWKHPIURP WKHLULPPHGLDWHVXUURXQGLQJP\RIDVFLDOVWUXFWXUH$OVRWRFRPSDUHEHWZHHQDF WLYHDQGODWHQW07U3VLQWKHTXDGUDWHVOXPERUPORQJLVVLPXVWKRUDFLVLOLRFRVWDOLV OXPERUXPSLULIRUPLVDQGJOXWHXVPHGLXVPXVFOHV 0HWKRGVDQG0DWHULDOV7KLUW\HLJKWVXEMHFWVZLWKPRUHWKDQWZR07U3V ZHUHUDQGRPO\DVVLJQHGWRDQDFWLYH07U3JURXSDQGDODWHQW07U3JURXS07U3 LGHQWLÀFDWLRQZDVEDVHGRQWKHLUHVVHQWLDODQGFRQÀUPDWRU\FULWHULDDOVRDKDQG KHOGGLJLWDOHOHFWURQLFDOJRPHWHUZDVXVHGWRPHDVXUH07U3VWHQGHUQHVVWKURXJK SUHVVXUHSDLQWKUHVKROGYDOXH$KDQGKHOGYLEUDWRU+]ZDVXVHGRYHU07U3V ZKLOHVRQRHODVWRJUDSK\UHDGLQJVZHUHWDNHQ2XWFRPHPHDVXUHVSHUFHQWDJHRI WLVVXHVWLIIQHVVRI07U3DQGWKHLULPPHGLDWHVXUURXQGLQJP\RIDVFLDOVWUXFWXUHDV ZHOODVWKHLUVWUDLQUDWLR 5HVXOWV9LEUDWLRQVRQRHODVWURJUDS\FOHDUO\GLIIHUHQWLDWHGZLWKVWDWLVWLFDOO\VLJQLÀFDQW GLIIHUHQFHEHWZHHQ07U3VVWLIIQHVVDQGWKHLULPPHGLDWHVXUURXQGLQJP\RIDVFLDO VWUXFWXUHVWLIIQHVVZLWKD39DOXH 39DOXH+RZHYHUWKHUHZDVQR VLJQLÀFDQWGLIIHUHQFHEHWZHHQWLVVXHVWUDLQUDWLRVRIERWKDFWLYHDQGODWHQW07U3V ZLWKD39DOXH 39DOXH! &RQFOXVLRQ7KHVHSUHOLPLQDU\UHVXOWVLQGLFDWHWKDWYLEUDWLRQVRQRHODVWURJUDS\FDQ DFWXDOO\YLVXDOLVH07U3VDQGFDQGLIIHUHQWLDWHWKHPIURPLWVVXUURXQGLQJP\RIDVFLDO VWUXFWXUHWKURXJKWLVVXHVWUDLQ+RZHYHULWFRXOGQRWGLIIHUHQWLDWHEHWZHHQDFWLYH DQGODWHQW07U3VZKHUHWLVVXHVWUDLQV\LHOGVLPLODUYDOXHV % 6RQRJUDSKLFJXLGHGWUHDWPHQWRIURWDWRUFXIIGHODPLQDWLRQWHDUV XVLQJDXWRORJRXVEORRGDRQH\HDUIROORZXSVWXG\DVVHVVLQJ UDGLRORJLFDOIHDWXUHVSDLQVFRUHVDQGVKRXOGHUIXQFWLRQ :$%DVKLU'&RQQHOO/RQGRQ8.ZDEDVKLU#GRFWRUVQHWXN 3XUSRVH 7 R DVVHVV XOWUDVRXQGJXLGHG DXWRORJRXV EORRG LQMHFWLRQ $%, DV DQ HIIHFWLYHWUHDWPHQWIRUURWDWRUFXIILQWHUVWLWLDOGHODPLQDWLRQWHDUVZKLFKDUHGLIÀFXOW WRGLDJQRVH E\ DUWKURVFRS\ DQG DUH WKHUHIRUH SUREOHPDWLF WRWUHDW$%,RIIHUVD 6FLHQWLILF6HVVLRQ 6 &$' ( ) *+% (XURSHDQ&RQJUHVVRI 5DGLRORJ\ 5RRP) *HQLWRXULQDU\ 66 *\QDHFRORJLFDO05LPDJLQJ 0RGHUDWRUV &'$OW+HLGHOEHUJ'( 6%DUWHU&DPEULGJH8. % 05LPDJLQJRIWKHQRUPDOHQGRPHWULXPGRDSSDUHQWGLIIXVLRQ FRHIÀFLHQWYDOXHVFKDQJHDPRQJWKHSRUWLRQVRIWKHXWHUXVDQGRYHU WKHSKDVHVRIWKHPHQVWUXDOF\FOH" ) )RUQDVD) 3DQWDORQH$'LEHQHGHWWR16FKLR$4XDJOLD6%RQLIDFLR,7 IUDQFHVFDIRUQDVD#OLEHURLW 3XUSRVH7 RHVWDEOLVKZKHWKHUWKHDSSDUHQWGLIIXVLRQFRHIÀFLHQW$'&PHDVXUHG ZLWKGLIIXVLRQZHLJKWHGPDJQHWLFUHVRQDQFHLPDJLQJ':,LQWKHHQGRPHWULXPRI KHDOWK\ZRPHQVLJQLÀFDQWO\YDULHVEHWZHHQWKHIXQGXVDQGWKHLVWKPXVRIWKHXWHUXV DQGIURPWKHHDUO\SUROLIHUDWLYHWRWKHSHULRYXODWRU\SKDVHRIWKHPHQVWUXDOF\FOH 0HWKRGVDQG0DWHULDOV$VHULHVRIKHDOWK\IHUWLOHZRPHQPLQLPXPHQGRPHWULDO WKLFNQHVV PP QR HQGRPHWULDO ÁXLG XQGHUZHQW ':, 7 E YDOXHV DQG PPVHF ,Q ZRPHQ WK WKURXJK WK PHQVWUXDO GD\ WKHHQGRPHWULDO $'&VPHDVXUHGDWWKHIXQGXVDVKLJKDVSRVVLEOHZHUHFRPSDUHGWRWKRVHWDNHQ DWWKHLVWKPXVFPIURPWKHLQWHUQDOFHUYLFDORV7KHIXQGDOHQGRPHWULDO $'&V ZHUHPRUHRYHUFDOFXODWHGLQZRPHQERWKDWWKHWKGD\DIWHUWKHEHJLQQLQJ RIWKHF\FOHDQGDWWKHWKGD\EHIRUHWKHVXEVHTXHQWF\FOH(DFK$'&YDOXH ZDVREWDLQHGWKURXJKWKHDYHUDJHRIWKUHHGLIIHUHQWPHDVXUHPHQWV7KHVWDWLVWLFDO VLJQLÀFDQFH RI WKH GLIIHUHQFHV IXQGDO YV LVWKPLF SUROLIHUDWLYH YV SHULRYXODWRU\ SKDVH$'&VZDVGHWHUPLQHGXVLQJWKH6WXGHQWҋVWWHVWSHUSDLUHGGDWD 5HVXOWV7KH$'&VDWWKHIXQGXVPHDQPPVHFUDQJHZHUH ORZHUWKDQDWWKHLVWKPXVPHDQUDQJH7KHIXQGDO$'&VLQ WKH SUROLIHUDWLYH SKDVH PHDQ UDQJH ZHUH ORZHU WKDQ LQ WKH SHULRYXODWRU\SKDVHPHDQUDQJH%RWKGLIIHUHQFHVZHUHKLJKO\ VLJQLÀFDQWDWVWDWLVWLFDODQDO\VLVS &RQFOXVLRQ 7KH PDJQLWXGH RI WKH YDULDWLRQV LQ HQGRPHWULDO$'&V RFFXUULQJ LQQRUPDOZRPHQVKRXOGPDNHWKHUDGLRORJLVWVFDXWLRXVZKHQLQWHUSUHWLQJ':, H[DPLQDWLRQVLQSDWLHQWVZLWKGLVHDVH % 6FDOHGVLJQDOLQWHQVLW\RIXWHULQHÀEURLGVLQ7ZHLJKWHG05LPDJHV QHZREMHFWLYHSDUDPHWHUWRGHWHUPLQHWKHVXLWDELOLW\IRUPDJQHWLF UHVRQDQFHJXLGHGIRFXVHGXOWUDVRXQGVXUJHU\RIXWHULQHÀEURLGV 6:<RRQ*\XQJJL'R.5MDQVRQVUDG#JPDLOFRP 3XUSRVH 05JXLGHG IRFXVHG XOWUDVRXQG VXUJHU\ 05J)86 LV D QRQLQYDVLYH WUHDWPHQWIRUV\PSWRPDWLFXWHULQHÀEURLGV3DWLHQWVHOHFWLRQLVWKHPRVWLPSRUWDQW VWHSWRDFKLHYHJRRGUHVXOW7KHSXUSRVHRIWKLVVWXG\LVWRDVVHVVWKHLQLWLDOHIÀFDF\ RIVFDOHGVLJQDOLQWHQVLW\66,RIXWHULQHÀEURLGVLQ7ZHLJKWHG05LPDJHVDVD QHZREMHFWLYHSDUDPHWHUWRGHWHUPLQHWKHVXLWDELOLW\IRU05J)86 0HWKRGV DQG 0DWHULDOV7ZHQW\IRXU XWHULQH ÀEURLGV LQ WZHQW\ SUHPHQRSDXVDO $VLDQ SDWLHQWV ZHUH WUHDWHG XVLQJ 05J)86 7UHDWPHQWV ZHUH SHUIRUPHG IURP 2FWREHUWR-DQXDU\DQGPHDQDJHRIWKHSDWLHQWVZDV\HDUV 66, ZDV PHDVXUHG DW7ZHLJKWHG 05 LPDJHV E\ VWDQGDUGLVLQJ LWVPHDQ SL[HO LQWHQVLW\WRDVFDOHXVLQJUHIHUHQFHLQWHQVLWLHVRIPXVFOHDQGIDW UHVSHFWLYHO\ 66, LQ HDFK ÀEURLG ZDV UHWURVSHFWLYHO\ DQDO\VHGDFFRUGLQJ WR WKH QRQSHUIXVLRQYROXPH139UDWLR 5HVXOWV 0HDQ 139 UDWLR LQ XWHULQH ÀEURLG RI 66, OHVV WKDQ Q ZDV ,QWKHFDVHRIXWHULQHÀEURLGRI66,PRUHWKDQQ PHDQ139 UDWLRZDV8WHULQHÀEURLGVRI66,OHVVWKDQLQ7ZHLJKWHG05LP DJHVVKRZHGKLJKHU139UDWLRWKDQXWHULQHÀEURLGVRI66,PRUHWKDQ &RQFOXVLRQ6FDOHGVLJQDOLQWHQVLW\RIXWHULQHÀEURLGVLQ7ZHLJKWHG05LPDJHV FDQEHVXJJHVWHGDVDQHZREMHFWLYHSDUDPHWHUIRUWKHSDWLHQWVHOHFWLRQLQ05J)86 8WHULQHÀEURLGVRI66,OHVVWKDQLVPRUHHOLJLEOHIRU05J)86 9$6 9$6 ZHHNV 3DWLHQWVWUHDWHGZLWKGU\ QHHGOLQJRQO\KDGDGHOD\HGGHFUHDVHRIV\PSWRPVEXWSHUPDQHQWORQJODVWLQJ HIIHFWV EDVHOLQH 9$6 ZHHNV 9$6 9$6 9$6 9$6 9$6 3DWLHQWV WUHDWHGZLWK WKH FRPELQHG SURFHGXUH KDG D IDVWHU DQG PRUH SHUPDQHQW GHFUHDVH RIV\PSWRPV EDVHOLQH9$6 ZHHNV9$6 9$6 9$6 9$6 9$6 SIRUDOO &RQFOXVLRQ 3DWLHQWV WUHDWHG ZLWK WKH 86JXLGHG FRPELQHG SURFHGXUH KDG D EHWWHURXWFRPHWKDQRWKHUJURXSVDQGSDLQUHOLHIZDVIDVWHUDQGPRUHSHUPDQHQW % $QHZPLQLPDOO\LQYDVLYHVDIHDQGUHSURGXFLEOHWHFKQLTXHIRU PDQDJHPHQWRIFHUYLFDOUDGLFXORSDWK\XOWUDVRXQGJXLGHGFHUYLFDO WUDQVIRUDPLQDOHSLGXUDOQHUYHURRWLQMHFWLRQV :$%DVKLU'$&RQQHOO/RQGRQ8.ZDEDVKLU#GRFWRUVQHWXN 3XUSRVH&HUYLFDOUDGLFXORSDWK\LVDFRPPRQSUREOHPOHDGLQJWRLQWROHUDEOHGH ELOLWDWLQJSDLQ,QUHIUDFWRU\FDVHVLQYDVLYHWKHUDSLHVLQFOXGH&7DQGÁXRURJXLGHG WUDQVIRUDPLQDOHSLGXUDOVWHURLGLQMHFWLRQV7)(6,VDVZHOODVVXUJHU\8QIRUWX QDWHO\WKHUHLVLQFUHDVLQJOLWHUDWXUHLOOXVWUDWLQJSRWHQWLDOIRUEUDLQDQGVSLQDOFRUGLQ IDUFWLRQIROORZLQJLQMHFWLRQ8OWUDVRXQGDOORZVVDIHDFFXUDWHDQGUHDOWLPHLQMHFWLRQ 0HWKRGVDQG0DWHULDOV7KLVSLORWVWXG\LQYROYHGSDWLHQWVZKRZHUHUHIHUUHG WR WKH UDGLRORJ\ GHSDUWPHQW IROORZLQJ DSSURSULDWH DQDHVWKHWLF DQG VXUJLFDO DV VHVVPHQW ZLWK UHTXLUHPHQW IRU FHUYLFDO 7)(6,V 1RUPDOO\ SDWLHQWV ZRXOG KDYH XQGHUJRQHÁXRURVFRSLFRU&7JXLGHGLQMHFWLRQEXWZHUHHQUROOHGLQWKLVVWXG\DIWHU IXOO\ LQIRUPHG ZULWWHQ FRQVHQW$ JDXJH VSLQDO QHHGOH ZDV DGYDQFHG XQGHU VRQRJUDSKLFJXLGDQFHWRDWUDQVIRUDPLQDOSRVLWLRQQHUYHURRWOHYHOVPDSSHGE\ LGHQWLI\LQJWUDQVYHUVHSURFHVVHVDQGFRXQWLQJQHUYHURRWVFUDQLDOO\7KHQHUYHURRW XQGHU LQYHVWLJDWLRQ FOHDUO\ VKRZHG WKLFNHQLQJ DQG ZDV EDWKHG LQ FRUWLFRVWHURLG DQGDQDHVWKHWLF 5HVXOWV3UHDQGSRVWSDLQVFRUHVSHUIRUPHGUHJXODUO\WLOOPRQWKVSRVWWKHUDS\ $OOSDWLHQWVKDGVLJQLÀFDQWUHGXFWLRQLQSDLQVFRUHVDWPRQWKVZLWKVRQRJUDSKLF HYLGHQFHRIUHGXFWLRQLQQHUYHWKLFNQHVV1RFRPSOLFDWLRQVZHUHUHSRUWHGGXULQJ WKLVVWXG\ &RQFOXVLRQ 8OWUDVRXQG 7)(6,V DYRLG WKH ULVNV RI LRQLVLQJ UDGLDWLRQ 6RQR JUDSKLFJXLGDQFHDOORZVDFFXUDWHUHDOWLPHYLVXDOLVDWLRQZLWKKLJKUHVROXWLRQRIORFDO DQDWRP\DQGQHHGOHWUDMHFWRU\1HHGOHWLSSRVLWLRQLVVHHQFOHDUO\&RORXU'RSSOHU DOORZVVFUXWLQ\RIYDVFXODUÁRZDQGWKHUHIRUHWKHLQYHVWLJDWRUFDQKDYHJUHDWHU FRQÀGHQFHLQDYRLGLQJLQWUDYDVFXODULQMHFWLRQ&HUYLFDOQHUYHURRWLQMHFWLRQKDVEHHQ VKRZQWREHDIHDVLEOHDQGHIIHFWLYHWKHUDS\IRUSDWLHQWVZLWKFKURQLFV\PSWRPV % 0HUDOJLDSDUHVWKHWLFDXOWUDVRXQGJXLGHGLQMHFWLRQZLWKPRQWK IROORZXSGDWD 5)DVFKLQJEDXHU &6LHGHQWRSI*)HXFKWQHU&0DUWLQROL:-DVFKNH $.ODXVHU,QQVEUXFN$7*HQRD,7FKULVWLDQVLHGHQWRSI#LPHGDFDW 3XUSRVH7 RHYDOXDWHWKHHIÀFDF\RIXOWUDVRXQGJXLGHGLQMHFWLRQVDURXQGWKHODWHUDO IHPRUDOFXWDQHRXVQHUYH/)&1LQSDWLHQWVFRPSODLQLQJRIPHUDOJLDSDUHVWHWLFD QRFWXUQDDQGWRGRFXPHQWORQJWHUPUHVXOWVDWPRQWKV 0HWKRGVDQG0DWHULDOV7KLV+,33$FRPSOLDQWVWXG\ZDVDSSURYHGE\RXUORFDO ,QVWLWXWLRQDO5HYLHZ%RDUGLQIRUPHGRUDODQGZULWWHQFRQVHQWZHUHREWDLQHG%H WZHHQDQGVHYHQWHHQSDWLHQWVZLWKV\PSWRPVRIPHUDOJLDSDUHVWKHWLFD QRFWXUQDLQFOXGLQJPHQPHDQDJH\HDUVUDQJH\HDUV6' DQGZRPHQPHDQDJH\HDUVUDQJH\HDUV6'ZHUHWUHDWHG ZLWK86JXLGHGLQMHFWLRQRIVWHURLGVDORQJWKH/)&1$YLVXDODQDORJVFDOH9$6 PHDVXUHRIV\PSWRPVEHIRUHWUHDWPHQWDQGDIWHUPRQWKVZDVFRPSDUHG 5HVXOWV &RPSOHWH UHVROXWLRQ RI V\PSWRPV ZDV GRFXPHQWHG LQ SDWLHQWV &,>@DQGSDUWLDOUHVROXWLRQLQWKHUHPDLQLQJ7KHVHSDWLHQWV UHPDLQHGV\PSWRPIUHHRUPDLQWDLQHGWKHLUV\PSWRPDWLFLPSURYHPHQWDWPRQWK IROORZXS:KHQFRPSDUHGZLWKKLVWRULFDOFRQWUROVIDLOXUHRIWUHDWPHQWRXU XOWUDVRXQGJXLGHG WHFKQLTXH UHVXOWHG LV VWDWLVWLFDOO\ VLJQLÀFDQW LPSURYHPHQW LQ SDWLHQWRXWFRPHS &RQFOXVLRQ 86JXLGHG LQMHFWLRQ RI VWHURLGV DORQJ WKH /)&1 LQ SDWLHQWV FRP SODLQLQJRI0HUDOJLDSDUHVWKHWLFDUHVXOWVLQPRUHIUHTXHQWORQJWHUPLPSURYHPHQW LQ V\PSWRPV DV FRPSDUHG ZLWK KLVWRULFDO FRQWUROV WUHDWHG E\ LQMHFWLRQ ZLWKRXW XOWUDVRXQGJXLGDQFH 6FLHQWLILF6HVVLRQ $ 6&'()*+%(XURSHDQ&RQJUHVVRI 5DGLRORJ\ )ULGD\ 0HWKRGVDQG0DWHULDOV7KLUW\HLJKWSDWLHQWVZLWKFHUYLFDOFDQFHUZHUHSUHRSHUD WLYHO\XQGHUZHQWLQWHUVWLWLDO05/*ZLWK2PQLVFDQDIWHUFRPSOHWLQJWKHFRQYHQWLRQDO 05,DQG':,H[DPLQDWLRQVDQGWKHÀUVWO\PSKQRGHLQWKHO\PSKDWLFGUDLQDJH SDWKZD\ ZDV GHÀQHG DV WKH 6/1 %OXH G\H 6/1 ELRSV\ ZDV SHUIRUPHG RQ DOO SDWLHQWV7KHPRUSKRORJLFIHDWXUHVRIDOOWKH6/1VRQ05O\PSKRJUDSKLFLPDJHV ZHUH DQDO\VHG 7KH UHODWLYH DSSDUHQW GLIIXVLRQ FRHIÀFLHQW U$'& RI HDFK 6/1 ZDVPHDVXUHG'LDJQRVWLFDFFXUDFLHVRIWKHFRPELQHG05/*DQG':,DSSURDFK FRPSDUHGZLWKRQO\05/*ZLWKRXW':,YHUVXVKLVWRSDWKRORJ\ZHUHHYDOXDWHG 5HVXOWV $OOORFDOLVHG6/1VFRUUHVSRQGHGZHOOZLWK6/1VLGHQWLÀHGRQ6/1ELRSV\ ,QSDWLHQWVZLWKQRQPHWDVWDWLF6/1VRYDOHQKDQFHG6/1VZHUHYLVXDOLVHGE\05 /*,QSDWLHQWVZLWKPHWDVWDWLF6/1VWKHHQKDQFHG6/1VZHUHYLVXDOLVHGZLWKRU ZLWKRXWÀOOLQJGHIHFWVLQDOOSDWLHQWVH[FHSWWKUHHLQZKLFK6/1VZHUHQRWHQKDQFHG 7KHVHQVLWLYLW\VSHFLÀFLW\DFFXUDF\DQGSRVLWLYHDQGQHJDWLYHSUHGLFWLYHYDOXHV 339DQG139IRUXVLQJÀOOLQJGHIHFWVRQ05/*DVDGLDJQRVWLFFULWHULRQZHUH DQGUHVSHFWLYHO\0HDQZKLOHWKHUHZHUHVWDWLVWLFDOO\ VLJQLÀFDQW GLIIHUHQFHV EHWZHHQ PHWDVWDWLF DQG QRQPHWDVWDWLF 6/16 LQ U$'& 3:LWKWKHDGGLWLRQRI':,WKHGLDJQRVWLFDFFXUDFLHVLQFUHDVHGVHQVLWLYLW\ VSHFLÀFLW\DFFXUDF\339139 &RQFOXVLRQ7KHFRPELQDWLRQRI':,DQG05/*ZDVXVHIXOLQGHWHFWLQJWKH6/1V DQGLQLPSURYLQJWKHGLDJQRVWLFDFFXUDF\RI6/1PHWDVWDVHVLQFHUYLFDOFDQFHU % (YDOXDWLRQRIWKHUDSHXWLFUHVSRQVHWRFRQFXUUHQW FKHPRUDGLRWKHUDS\LQFHUYLFDOFDQFHUXVLQJEORRGR[\JHQDWLRQ OHYHOGHSHQGHQW05LPDJLQJDW7 SUHOLPLQDU\H[SHULHQFH $.LP&.LP%3DUN6+XK< &KRQJ< &KRL-3DUN6HRXO.5 DK\HRQJNLP#VDPVXQJFRP 3XUSRVH7 RLQYHVWLJDWHWKHFKDQJHVLQWKHUDWHRIVSLQGHSKDVLQJ5 YDOXHVDW EORRGR[\JHQDWLRQOHYHOGHSHQGHQW%2/'05,LQFHUYLFDOFDQFHUSDWLHQWVUHFHLYLQJ FRQFXUUHQWFKHPRUDGLRWKHUDS\&&57DQGWRDVVHVVWKHUHODWLRQVKLSEHWZHHQ WXPRXU5 YDOXHVDQGÀQDOWXPRXUUHVSRQVHVWRWUHDWPHQW 0HWKRGV DQG 0DWHULDOV FRQVHFXWLYH SDWLHQWV ZLWK ELRSV\SURYHQ FHUYLFDO FDQFHU ZHUH H[DPLQHG E\7ZHLJKWHG DQG %2/' 05, DW 7 %2/' 05, ZDV SHUIRUPHGXVLQJDPXOWLSOHIDVWÀHOGHFKRP))(VHTXHQFHWRDFTXLUH7 ZHLJKWHGLPDJHVZLWKLQDVLQJOHEUHDWKKROG$OOSDWLHQWVZKRWUHDWHGZLWK&&57 SHUIRUPHGWZRVHULDO05H[DPLQDWLRQV>LHSULRUWRWKHUDS\SUH7[DQGPRQWK DIWHUWKHFRPSOHWLRQRIWKHUDS\SRVW7[@$WHDFKWKHUDSHXWLFSRLQW5 YDOXH VHFZDVFDOFXODWHGLQWKHWXPRXUDQGQRUPDOP\RPHWULXP)LQDOWXPRXUUHVSRQVH DVGHWHUPLQHGE\FKDQJHVLQWXPRXUVL]HXVLQJ05,^SUH7[SRVW7[SUH7[` ZDVFRUUHODWHGZLWKWXPRXU5 YDOXHVDWSUH7[ 5HVXOWV7KHÀQDOWXPRXUVL]HUHVSRQVHZDV7KHPHDQ5 YDOXHVRIWKH WXPRXUVZHUHDWSUH7[DQGDWSRVW7[UHVSHFWLYHO\ZKLFK VKRZHG D VLJQLÀFDQW GLIIHUHQFH 3 +RZHYHU WKH PHDQ 5 YDOXHV RI QRUPDOP\RPHWULXPZHUHDWSUH7[DQGDWSRVW7[UHVSHF WLYHO\ZKLFKGLGQRWVKRZDVLJQLÀFDQWGLIIHUHQFH3 $WSUH7[WXPRXU5 YDOXHVVKRZHGVLJQLÀFDQWO\QHJDWLYHFRUUHODWLRQZLWKÀQDOWXPRXUVL]HUHVSRQVH 3 6SHDUPDQ VFRHIÀFLHQW &RQFOXVLRQ%2/'05,DW7PD\EHKHOSIXOWRHYDOXDWHWKHUDSHXWLFUHVSRQVH LQFHUYLFDOFDQFHUV7KHVHSRVVLELOLWLHVDZDLWIXUWKHUVWXGLHV % 3UHRSHUDWLYHVWDJLQJRISDWLHQWVZLWKFHUYLFDOFDUFLQRPD FRPSDULVRQRIPDJQHWLFUHVRQDQFHLPDJLQJDQGKLVWRSDWKRORJLF HYDOXDWLRQ %%DQNR50LOHQNRYLF0.UDWRYDF'XQMLF*/LOLF-'MRNLF.RYDF 50DNVLPRYLF%HOJUDGH56ERMDQEDQNR#\DKRRFRP 3XUSRVH0DJQHWLFUHVRQDQFHLPDJLQJ05,LVUHFRPPHQGHGIRUSUHRSHUDWLYH DVVHVVPHQWRIORFDOWXPRXUH[WHQVLRQLQSDWLHQWVZLWK),*2VWDJH,%RUKLJKHU DIWHUKLVWRORJLFDOFRQÀUPDWLRQ7KHSXUSRVHRIWKLVVWXG\ZDVWRHYDOXDWHGLDJQRVWLF YDOXHRI05LQSUHRSHUDWLYHDVVHVVPHQWRISDWLHQWVZLWKFHUYLFDOWXPRXUVDQGWR RSWLPLVHIXUWKHUWKHUDSHXWLFDSSURDFK 0HWKRGVDQG0DWHULDOV7KLVSURVSHFWLYHVWXG\LQFOXGHGSDWLHQWVZLWKSUHRS HUDWLYH05,DQGFHUYLFDOELRSV\WKDWFRQÀUPHGFHUYLFDOFDUFLQRPD7KHUHIRUHWKH SDWLHQWVZHUHGLYLGHGLQWRWZRJURXSVJURXSSDWLHQWVZLWK),*2,,DZKRXQGHUJR VXUJHU\DQGJURXS),*2EZKRGLGQRWKDYHVXUJHU\,QDGGLWLRQLQSDWLHQWV ZKR XQGHUZHQW VXUJHU\ 05 ÀQGLQJV ZHUH FRPSDUHG ZLWK WKH KLVWRSDWKRORJLFDO UHSRUWRIWKHK\VWHUHFWRP\VSHFLPHQ 5HVXOWV$FFRUGLQJWR05,ÀQGLQJVSDWLHQWVZHUHFODVVLÀHGDV7 SDWLHQWVZHUHFODVVLÀHGDV7DSDWLHQWVDV7EDV7 DQGSDWLHQWVDV7ZKLOHRQSDWKRKLVWRORJLFDOVSHFLPHQVDIWHUVXUJHU\ ZHUHFODVVLÀHGDV7DV7DDV7EDV7DQG % 'HHSO\LQÀOWUDWLQJHQGRPHWULRVLVHYDOXDWLRQRIUHWURFHUYLFDOVSDFH RQ05,DIWHUYDJLQDORSDFLÀFDWLRQ 9)LDVFKHWWL$0HVFKLQL6&UXVFR9&DPD/'L9LWR*6LPRQHWWL5RPH,7 DPHVNR#OLEHURLW 3XUSRVH7 RSURVSHFWLYHO\LQYHVWLJDWHGLDJQRVWLFYDOXHDQGWROHUDELOLW\RI05,ZLWK LQWUDYDJLQDOJHORSDFLÀFDWLRQIRUGLDJQRVLVDQGSUHRSHUDWLYHDVVHVVPHQWRIGHHSO\ LQÀOWUDWLQJHQGRPHWULRVLV 0HWKRGVDQG0DWHULDOV2QHKXQGUHGDQGVL[ZRPHQZLWKFOLQLFDOVXVSLFLRQRI GHHSO\LQÀOWUDWLQJHQGRPHWULRVLVZHUHSUHYLRXVO\H[DPLQHGZLWKWUDQVYDJLQDOXOWUD VRQRJUDSK\DQGZLWK05,SUHDQGSRVWDGPLQLVWUDWLRQRIYDJLQDOJHO:HHYDOXDWHG WKHWROHUDELOLW\RIWKLVSURFHGXUHZLWKDVFRULQJVFDOHIURPWR:HDOVRDVVHVVHG ZLWKDVFRUHIURPWRWKHYLVLELOLW\RIIRXUUHJLRQV'RXJODVSRXFKXWHURVDFUDO OLJDPHQWVSRVWHULRUYDJLQDOIRUQL[DQGUHFWRYDJLQDOVHSWXP $OOSDWLHQWVXQGHUZHQW ODSDURVFRSLFVXUJHU\DIWHU05, 5HVXOWV1LQHSDWLHQWVFRQVLGHUHGSURFHGXUHLQWROHUDEOH9LVLELOLW\RIXWHURVDFUDO OLJDPHQWVDQGSRVWHULRUYDJLQDOIRUQL[VKRZHGWREHLQFUHDVHGZLWKJHOS ,QRXWRISDWLHQWV05,KDVDOORZHGXVWRGLDJQRVHGHHSO\LQÀOWUDWLQJHQGRPH WULRVLV7KHSHUFHQWDJHVRI05,VHQVLWLYLW\VSHFLÀFLW\SRVLWLYHSUHGLFWLYHYDOXHDQG QHJDWLYHSUHGLFWLYHYDOXHZHUHUHVSHFWLYHO\DQGZLWKRXW JHODQGDQGZLWKJHOWUDQVYDJLQDOXOWUDVRQRJUDSK\ VHQVLWLYLW\VSHFLÀFLW\SRVLWLYHSUHGLFWLYHYDOXHDQGQHJDWLYHSUHGLFWLYHYDOXHZHUH DQG,QHYDOXDWLRQRIXWHURVDFUDOOLJDPHQWVWUDQVYDJLQDO XOWUDVRQRJUDSK\05,ZLWKRXWJHODQGZLWKJHOVHQVLWLYLW\ZDVUHVSHFWLYHO\ DQG IRU UHFWRYDJLQDOVHSWXP WKHVH YDOXHV ZHUH DQG IRUSRXFKRI'RXJODVDQGIRUSRVWHULRUYDJLQDOIRUQL[ DQG &RQFOXVLRQ05,ZLWKJHORSDFLÀFDWLRQRIYDJLQDVKRXOGEHUHFRPPHQGHGIRUVXV SLFLRQRIGHHSLQÀOWUDWLQJHQGRPHWULRVLVLQSDUWLFXODUIRUWKHDGGHGYDOXHLQHYDOX DWLRQRIUHFWRYDJLQDOVHSWXPXWHURVDFUDOOLJDPHQWVDQGSRVWHULRUYDJLQDOIRUQL[ % 05J)86WUHDWPHQWRIXWHULQHOHLRP\RPDVUHVXOWVRQTXDOLW\RIOLIH QRQSHUIXVHGYROXPHUDWLRDQGVL]HUHGXFWLRQRYHUPRQWKV ) &LROLQD$1DSROL0$Q]LGHL) =DFFDJQD*&DUWRFFL/%HUWDFFLQL 91RFH) %RQL&&DWDODQR5RPH,7IHGHULFDFLROLQD#JPDLOFRP 3XUSRVH7 RLQYHVWLJDWHWKHHIÀFDF\RIVRQLFDWLRQLQV\PSWRPVUHOLHIDQGYROXPH UHGXFWLRQRYHUWLPH 0HWKRGVDQG0DWHULDOVOHLRP\RPDVLQZRPHQDYHUDJHDJH\HDUV UDQJHZHUHWUHDWHGZLWK05,JXLGHGIRFXVHGXOWUDVRXQG05J)867KH V\VWHP ([$EODWH,Q6LJKWHF HTXLSSHG ZLWK D SKDVHGDUUD\ WUDQVGXFHU FRPSXWHUFRQWUROOHG SRVLWLRQLQJ V\VWHP UDGLRIUHTXHQF\ DPSOLÀHU V\VWHP RSHU DWHV LQ FRQMXQFWLRQ ZLWK D 7 05 XQLW *( :H VFRUHG VHYHULW\ RI V\PSWRPV DVPHQRUUKDJLDXULQDU\IUHTXHQF\SHOYLFSDLQRUEXONV\PSWRPVXVLQJDWR SRLQWVFDOHEHIRUHDQGDIWHUWUHDWPHQW:HDOVRPHDVXUHGWKHLULPSDFWRQTXDOLW\ RIOLIHXVLQJDYLVXDODQDORJVFDOHWKHFKRLFHEDVHGZDLWLQJWUDGHRIIDQGWKHWLPH WUDGHRII3UHWUHDWPHQWLPDJLQJVHW7Z7ZSUHDQGSRVW*G%237$LPDJHV ZHUHREWDLQHGWRPHDVXUHOHLRP\RPDYROXPH,PPHGLDWHO\DIWHUWUHDWPHQW7Z FRQWUDVWHQKDQFHGIDWVXSSUHVVHG05LPDJHVLQWKUHHSODQHVZHUHXVHGWRPHDV XUHQRQSHUIXVHGYROXPH1397KHDYHUDJHYROXPHRIWUHDWHGÀEURLGVZDV 6'FP)ROORZXSLPDJHVZHUHREWDLQHGDQGPRQWKVDIWHUWUHDWPHQWWR GHWHUPLQH OHLRP\RPD VKULQNDJH 4XDOLWDWLYH DQG TXDQWLWDWLYH UHODWLRQV EHWZHHQ ÀEURLGYROXPH139UDWLRDWWUHDWPHQWDQGPRQWKVKULQNDJHZHUHPHDVXUHG 5HVXOWV$OO SDWLHQWV VKRZHG D FRPSOHWH UHOLHI RI V\PSWRPV UHODWHG WR XWHULQH ÀEURLGVDQGDQLQFUHDVHGTXDOLW\RIOLIH7KHDYHUDJH139UDWLRZDV LPPHGLDWHO\DIWHUWUHDWPHQW $WIROORZXSWUHDWHGÀEURLGVVKRZHGYROXPHGHFUHDVH WRFPZLWKDQDYHUDJHYROXPHUHGXFWLRQRI$OLQHDUUHJUHVVLRQ PRGHOVKRZHGKLJKO\VLJQLÀFDQWFRUUHODWLRQEHWZHHQSRVWWUHDWPHQWQRQSHUIXVHG YROXPHUDWLRDQGVKULQNDJHDWPRQWKV &RQFOXVLRQ05J)86WKHUDS\RIOH\RPLRPDVKRZVDVDQRQLQYDVLYHO\DQGVDIH PHWKRGWRREWDLQVLJQLÀFDQWUHOLHIRIV\PSWRPVJRRG139UDWLRDQGLQPLOGVKULQN DJHDWDQGPRQWKV % &RPELQHGGLIIXVLRQZHLJKWHGPDJQHWLFUHVRQDQFHLPDJLQJDQG05 O\PSKRJUDSK\UHOLDEO\GHWHFWDQGHYDOXDWHVHQWLQHOO\PSKQRGHLQ FHUYLFDOFDQFHU ==KRX+<X%=KX< +RQJ-)DQJ1DQMLQJ&1]\]KRX#QMXHGXFQ 3XUSRVH7 RHYDOXDWHZKHWKHU':,DQG05O\PSKRJUDSK\05/*UHOLDEO\GHWHFW DQGHYDOXDWHVHQWLQHOO\PSKQRGHV6/16PHWDVWDVLVLQFHUYLFDOFDQFHU 6FLHQWLILF6HVVLRQ 6 &$' ( ) *+% (XURSHDQ&RQJUHVVRI 5DGLRORJ\ 5RRP) %UHDVW 66 8OWUDVRXQGQHZGHYHORSPHQWV 0RGHUDWRUV 8%LFN%HUOLQ'( 6*DQDX0DFtDV6DEDGHOO(6 % $GGLWLRQDOEUHDVWXOWUDVRQRJUDSK\86WRQHJDWLYHPDPPRJUDSK\ LPSDFWRQFDQFHUGHWHFWLRQDQGLQYDVLYHDVVHVVPHQWUDWH 9*LUDUGL07 RQHJXWWL(0DQIULQ) %RQHWWL3HVFKLHUDGHO*DUGD,7 JLUDYHUR#\DKRRLW 3XUSRVH7 RHYDOXDWHWKHRXWFRPHRIOHVLRQVGHWHFWHGE\86LQDV\PSWRPDWLF ZRPHQZLWKQHJDWLYHPDPPRJUDSK\ 0HWKRGVDQG0DWHULDOV2XWRIVHOIUHIHUULQJZRPHQXQGHUJRLQJWRFOLQLFDO H[DPLQDWLRQPDPPRJUDSK\DQGXOWUDVRXQGSHULRGDV\PS WRPDWLFZRPHQZHUHVFUHHQHGZLWKELODWHUDO8686FKDUDFWHULVDWLRQZDVEDVHG RQ%,5$'6FULWHULDQHJDWLYHEHQLJQ%,5$'6SUREDEO\EHQLJQ%,5$'6 LQGHWHUPLQDWHVXVSLFLRXV%,5$'6 $OOLQGHWHUPLQDWHVXVSLFLRXV86ÀQGLQJV XQGHUZHQW LQYDVLYH DVVHVVPHQW )LQH QHHGOH DVSLUDWLRQ F\WRORJ\)1$& JDXJHQHHGOHZDVFXUUHQWO\WKHÀUVWVWHSIROORZHGE\QHHGOHFRUHELRSV\1&% JDXJHQHHGOH7KHPDOLJQDQWDQGDW\SLFDOOHVLRQVZHUHUHIHUUHGWRVXUJHU\7KH SDWKRORJLFDOUHVXOWVUHSUHVHQWHGWKHUHIHUHQFHVWDQGDUG 5HVXOWV2YHUDOOWKHUHZHUHFDQFHUVFDQFHUVZHUHGHWHFWHGE\ PDPPRJUDSK\DQGRQO\E\862IWRWDOLQYDVLYHSURFHGXUHV ZHUHSURPSWHGE\PDPPRJUDSK\DQGZHUHSURPSWHGRQO\ E\86)1$&1&%/HVLRQVGHWHFWHGE\PDPPRJUDSK\UHVXOWHGPDOLJQDQW LQDQGEHQLJQLQ/HVLRQVGHWHFWHGE\86UHVXOWHG PDOLJQDQWLQDQGEHQLJQLQ7KHEHQLJQWRPDOLJQDQW RSHQVXUJLFDOELRSV\UDWLRE\86ZDVEHQLJQYHUVXVPDOLJQDQW&RP SDUHGWRPDPPRJUDSK\WKHUHODWLYHLQFUHPHQWDOEUHDVWFDQFHUGHWHFWLRQUDWHE\ 86ZDVDQGWKHUHODWLYHLQFUHPHQWDOEHQLJQOHVLRQVGHWHFWLRQUDWH E\86ZDV &RQFOXVLRQ$GGLWLRQRI86WRQHJDWLYHPDPPRJUDSK\DOORZVIRUDVXEVWDQWLDO FDQFHUGHWHFWLRQLQFUHDVHRI86JHQHUDWHGDPDMRULQFUHPHQWRILQYD VLYHGLDJQRVWLFDVVHVVPHQW,WWRRNDERXW86H[DPLQDWLRQVDQGLQYDVLYH SURFHGXUHVWRGHWHFWRQHDGGLWLRQDOFDQFHU,IWKHFRVWVZHUHVXVWDLQDEOHZRPHQ PD\EHQHÀWIURP86VFUHHQLQJ % 'LDJQRVWLFDVVHVVPHQWRIGLJLWDOPDPPRJUDSK\VFUHHQLQJ HYLGHQFHRQLQFUHPHQWDOEUHDVWFDQFHUGHWHFWLRQE\ELODWHUDO XOWUDVRXQGH[DPLQDWLRQ 6:HLJHO:+HLQGHO&%LHVKHXYHO 0XHQVWHU'(ELHVKHXYHO#UHIHUHQ]]HQWUXPPVGH 3XUSRVH 7 R HYDOXDWH WKH FRQWULEXWLRQ RI ELODWHUDO XOWUDVRXQG 86 LQ GHWHFWLQJ DGGLWLRQDOEUHDVWFDQFHUDWGLDJQRVWLFDVVHVVPHQWRIOHVLRQVGHWHFWHGZLWKGLJLWDO PDPPRJUDSK\VFUHHQLQJ 0HWKRGV DQG 0DWHULDOV ZRPHQ XQGHUZHQW DGGLWLRQDO PDPPRJUDSKLF LPDJLQJDQGELODWHUDOZKROHEUHDVW86H[DPLQDWLRQDWRXUVFUHHQLQJDVVHVVPHQW XQLW:HFDOFXODWHGWKHLQFUHPHQWDOEUHDVWFDQFHUGHWHFWLRQUDWHDQGDVVRFLDWHG IDOVHSRVLWLYHUDWHIRU86DQGPDPPRJUDSK\SHUDVVHVVPHQWSDUWLFLSDQWDQGSHU EUHDVWVLGHUHFDOODQGFRQWUDODWHUDO 5HVXOWV ZRPHQ ZHUH GLDJQRVHG ZLWK FDQFHU OHVLRQV 6HYHQ SDWLHQWV ZHUHGLDJQRVHGZLWKDFDQFHUOHVLRQGHWHFWHGE\86RQO\\LHOGLQJDQLQFUHPHQWDO EUHDVWFDQFHUGHWHFWLRQUDWHRISHUDVVHVVPHQWSDUWLFLSDQW)RUDQDGGLWLRQDO WZRSDWLHQWV86FKDQJHGWKHGLDJQRVLVIURPXQLODWHUDOWRELODWHUDOEUHDVWFDQFHU 7KXVDWRWDORIQLQHFDQFHUOHVLRQVZHUHGHWHFWHGE\86RQO\IRXUZHUHGHWHFWHGLQ UHFDOOVLGHVÀYHLQFRQWUDODWHUDOVLGHVUHVXOWLQJLQLQFUHPHQWDOEUHDVWFDQFHUGHWHF WLRQUDWHVRIDQGUHVSHFWLYHO\7KHDVVRFLDWHGIDOVHSRVLWLYHELRSV\ UDWHVZHUHLQUHFDOOVLGHVDQGLQFRQWUDODWHUDOVLGHV FRPSDUHGWRDQGUHVSHFWLYHO\IRUPDPPRJUDSK\RQO\ LQGLFDWHGELRSVLHV7KHSURSRUWLRQRILQYDVLYHFDQFHUVPPZDVVLJQLÀFDQWO\ ORZHUDPRQJ86RQO\GHWHFWHGFDQFHUVFRPSDUHGWRWKRVHGHWHFWHGZLWK PDPPRJUDSK\RQO\S SDWLHQWVZHUHFODVVLÀHGSDWLHQWVDV77KHUHZDVDVLJQLÀFDQWFRUUHODWLRQ EHWZHHQ05VWDJLQJDQGKLVWRSDWKRORJLFDOÀQGLQJVRIELRSV\VSHFLPHQVѩ S)XUWKHUPRUHVHQVLWLYLW\DQGVSHFLÀFLW\IRU05,IRUJURXSZDVDQG UHVSHFWLYHO\ZKLOHIRUJURXSZDVDQGUHVSHFWLYHO\ &RQFOXVLRQ05LVDXVHIXOGLDJQRVWLFPHWKRGLQSUHRSHUDWLYHDVVHVVPHQWDQG IXUWKHUWKHUDSHXWLFGHFLVLRQPDNLQJSURFHVVLQSDWLHQWVZLWKFHUYLFDOFDUFLQRPD % '\QDPLFFRQWUDVWHQKDQFHGLPDJLQJIRUHYDOXDWLRQRIWKHUDSHXWLF UHVSRQVHWRFRQFXUUHQWFKHPRUDGLRWKHUDS\LQFHUYLFDOFDQFHU < .LP-0LQ&.LP%3DUN6HRXO.5\N NLP#VDPVXQJFRP 3XUSRVH7 RHYDOXDWHWKHFKDQJHVRITXDQWLWDWLYHSDUDPHWHUVRIG\QDPLFFRQWUDVW HQKDQFHGLPDJLQJ'&(,LQFHUYLFDOFDQFHUVEHIRUHGXULQJDQGDIWHUFRQFXUUHQW FKHPRUDGLRWKHUDS\ &&57 DQG WR DVVHVV UHODWLRQVKLS EHWZHHQ TXDQWLWDWLYH SDUDPHWHUVRIWKHWXPRXUVDQGÀQDOWXPRXUUHVSRQVHVWRWUHDWPHQW 0HWKRGV DQG 0DWHULDOV FRQVHFXWLYH SDWLHQWV ZLWK ELRSV\SURYHQ FHUYLFDO FDQFHUZHUHHQUROOHG'&(,ZDVREWDLQHGXVLQJ7ZHLJKWHG'IDVWÀHOGHFKR VHTXHQFHDW7 3KDUPDFRNLQHWLFDQDO\VLVXVLQJDQH[WHQGHG.HW\PRGHOZDV SHUIRUPHG$OO SDWLHQWV ZKR WUHDWHG ZLWK &&57 SHUIRUPHG WKUHH VHULDO 05 H[ DPLQDWLRQV>LHSULRUWRWKHUDS\SUH7[DWWKHIRXUWKZHHNRIWKHUDS\PLG7[ DQGPRQWKDIWHUWKHFRPSOHWLRQRIWKHUDS\SRVW7[@$WHDFKWKHUDSHXWLFSRLQW TXDQWLWDWLYHSDUDPHWHUVLH.WUDQV9HDQG.HSZHUHFDOFXODWHGLQWKHWXPRXUV DQGQRUPDOJOXWHXVPXVFOHV)LQDOWXPRXUUHVSRQVHVDVGHWHUPLQHGE\FKDQJHV LQWXPRXUVL]HRUYROXPHXVLQJ05,^SUH7[SRVW7[SUH7[`ZDVFRUUHODWHGZLWK TXDQWLWDWLYHSDUDPHWHUVRIWKHWXPRXU 5HVXOWV%HWZHHQWKHUDSHXWLFSRLQWVDOOTXDQWLWDWLYHSDUDPHWHUVRIWKHWXPRXUV UHYHDOHGDVLJQLÀFDQWGLIIHUHQFH3ZKLOHWKRVHRIQRUPDOJOXWHXVPXV FOHVVKRZHGQRVLJQLÀFDQWGLIIHUHQFH3!7KHPHDQYDOXHRIÀQDOWXPRXU UHVSRQVHIRUWKHVL]HDQGYROXPHZDVDQGUHVSHFWLYHO\4XDQWLWDWLYH SDUDPHWHUVRIWKHWXPRXUVDWSUH7[RUPLG7[ZHUHQRWVWDWLVWLFDOO\DVVRFLDWHG ZLWKÀQDOWXPRXUVL]HRUYROXPHUHVSRQVHV &RQFOXVLRQ4XDQWLWDWLYHSDUDPHWHUVRI'&(,UHYHDOHGWKHWKHUDSHXWLFFKDQJHV WR&&57LQFHUYLFDOFDQFHUVFRPSDUHGZLWKQRUPDOJOXWHXVPXVFOHV+RZHYHU WKHSDUDPHWHUVLQFHUYLFDOFDQFHUVZHUHQRWDVVRFLDWHGZLWKÀQDOWXPRXUVL]HRU YROXPHUHVSRQVHV % &RUUHODWLRQEHWZHHQWXPRXUVL]HDQGVXUYHLOODQFHRIO\PSKQRGH PHWDVWDVLVIRU,EDQG,,DFHUYLFDOFDQFHUE\05, %.ZRQ6.LP%5KR($KQ'DHJX.5UDGRUL\D#QDYHUFRP 3XUSRVH7 RDVVHVVWKHIHDVLELOLW\RISUHRSHUDWLYH05,EDVHGPHDVXUHPHQWRIWX PRXUVL]HZLWKUHJDUGWRO\PSKQRGH/1PHWDVWDVLVLQHDUO\XWHULQHFHUYLFDOFDQFHU 0HWKRGVDQG0DWHULDOV$UHWURVSHFWLYHUHYLHZRISDWLHQWVZLWK),*2VWDJH,% ,,$FHUYLFDOFDQFHUZKRXQGHUZHQWO\PSKDGHQHFWRP\ZDVSHUIRUPHG'LDJQRVWLF DFFXUDF\RI05,LQGHWHFWLQJ/1PHWDVWDVLVDQGUDWHRI/1UHFXUUHQFHLQWHUPVRI WXPRXUVL]HFPYHUVXV!FPZHUHDQDO\VHG52&FXUYHDQDO\VLVZDVXVHG WR GHWHUPLQH /1 VL]H IRU GLIIHUHQWLDWLQJ /1 PHWDVWDVLV LQ WHUPV RI WXPRXU VL]H 3ZDVFRQVLGHUHGVWDWLVWLFDOO\VLJQLÀFDQW 5HVXOWV2IWKHSDWLHQWVKDG/1PHWDVWDVLV7KHUHZDVQRVWDWLVWL FDOGLIIHUHQFHEHWZHHQSDWLHQWVEDVHGDQGUHJLRQVSHFLÀFDQDO\VLV7KHSDWLHQWV ZLWKWXPRXUVL]HZLWK!FPUHYHDOHGKLJKHUGLDJQRVWLFDFFXUDF\RI05,LQGH WHFWLQJ/1PHWDVWDVLVYHUVXV3 DQGUDWHRI/1UHFXUUHQFH YHUVXV3 LQWKDQWKRVHZLWKVL]HZLWKFPWKHGLIIHUHQFHV ZDVVWDWLVWLFDOO\VLJQLÀFDQW'LVFULPLQDQWDQDO\VLVRI/1VL]HIRUWKHGLIIHUHQWLDWLRQ RIPHWDVWDVLVIURPQRQPHWDVWDVLVUHVXOWHGLQFXWRIIYDOXHVPPVL]HZLWK !FPYHUVXVPPVL]HZLWKFPDQGGLDJQRVWLFDFFXUDF\RIVL]H ZLWK!FPYHUVXVRIVL]HZLWKFP &RQFOXVLRQ05,KDVOLPLWHGVHQVLWLYLW\EXWKLJKVSHFLÀFLW\LQSUHGLFWLQJVXUYHLO ODQFHRI/1PHWDVWDVLVLQWKHSUHRSHUDWLYHHDUO\FHUYLFDOFDQFHUHVSHFLDOO\XVHIXO WRROIRUSDWLHQWVZLWKWXPRXUVL]HZLWK!FP 6FLHQWLILF6HVVLRQ $ 6&'()*+%(XURSHDQ&RQJUHVVRI 5DGLRORJ\ )ULGD\ % $XWRPDWHGZKROHEUHDVWXOWUDVRXQGUDGLRORJLVWVҋGHWHFWLRQ SHUIRUPDQFHDQGLQWHUREVHUYHUYDULDELOLW\ +.DQJ6.LP%.DQJ6HRXO.5KHUD#FDWKROLFDFNU 3XUSRVH7 RHYDOXDWHWKHGHWHFWLRQSHUIRUPDQFHRIDXWRPDWHGZKROHEUHDVWXO WUDVRXQG$:86LQFRPSDULVRQZLWKKDQGKHOGEUHDVWXOWUDVRXQG++86DQGWR HYDOXDWHWKHLQWHUREVHUYHUYDULDELOLW\LQWKHLQWHUSUHWDWLRQRI$:86 0HWKRGVDQG0DWHULDOV)URP2FWREHURIWR0DUFKRIELODWHUDODXWR PDWHGZKROHEUHDVWXOWUDVRXQGZDVSHUIRUPHGLQFRQVHFXWLYHEUHDVWFDQFHU SDWLHQWVZKRZHUHVFKHGXOHGIRUEUHDVW05,7 RWDOOHVLRQVZHUHLQFOXGHG LQGH[FDQFHUVDGGLWLRQDOPDOLJQDQFLHVDQGEHQLJQOHVLRQV7KUHHEUHDVW UDGLRORJLVWVLQGHSHQGHQWO\UHYLHZHG$:86GDWDDQGDQDO\VHGWKHEUHDVWOHVLRQV DFFRUGLQJWRWKH%,5$'6FODVVLÀFDWLRQ'HWHFWLRQUDWHVHQVLWLYLW\DQGVSHFLÀFLW\ RIEHQLJQDQGPDOLJQDQWOHVLRQGHWHFWLRQVZHUHFDOFXODWHGDQGLQWHUREVHUYHUYDUL DELOLWLHVZHUHFDOFXODWHGXVLQJ&RKHQҋVNDSSDVWDWLVWLFV 5HVXOWV 'HWHFWLRQ UDWH RI LQGH[ OHVLRQ DQG DGGLWLRQDO PDOLJQDQF\ ZDV LQ++86DQGIRUWKUHHUHDGHUV RI$:866HQVLWLYLW\DQGVSHFLÀFLW\ZHUHLQ++86 LQUHDGHULQUHDGHU DQGLQUHDGHU7KHUHZDVQRVLJQLÀFDQWGLIIHUHQFH LQUDGLRORJLVWVҋGHWHFWLRQSHUIRUPDQFHVHQVLWLYLW\DQGVSHFLÀFLW\DPRQJ++86DQG $:86S7KHLQWHUREVHUYHUDJUHHPHQWZDVIDLUWRDOPRVWSHUIHFWDJUHHPHQW IRU86IHDWXUHVFDWHJRULVDWLRQVL]HDQGORFDWLRQRILQGH[PDVVHV &RQFOXVLRQ$:86 LV WKRXJKW WR EH XVHIXO IRU GHWHFWLQJ EUHDVW OHVLRQ$:86 VKRZHG QR VLJQLÀFDQW GLIIHUHQFH RI GHWHFWLRQ UDWH VHQVLWLYLW\DQG VSHFLÀFLW\ LQ FRPSDULVRQZLWK++86DQGWKHUHZHUHKLJKGHJUHHVRILQWHUREVHUYHUDJUHHPHQW % :KDWLVSDWKRORJ\XQGHUO\LQJVWLIIQHVV"8OWUDVRXQGHODVWRJUDSK\RI DKXPDQEUHDVWFDQFHUPRGHOZLWKSDWKRORJLFDOFRUUHODWLRQ ) &KDPPLQJҋV+/DWRUUH9)LWRXVVL0$/H)UHUH%HOGD/3LGLDO -/*HQQLVVRQ&$&XHQRG2&OHPHQW/6)RXUQLHU3DULV)5 IRXFDXOGFKDPPLQJV#HJSDSKSIU 3XUSRVH7KH SXUSRVH RI WKLV VWXG\ ZDV WR DVVHVV VWLIIQHVV XVLQJ VKHDUZDYH HODVWRJUDSK\6:(GXULQJWXPRXUJURZWKLQDKXPDQEUHDVWFDQFHULPSODQWHGLQ PLFHDQGWRFRUUHODWHWKHUHVXOWVZLWKSDWKRORJ\ 0HWKRGVDQG0DWHULDOV$KXPDQLQYDVLYHGXFWDOFDUFLQRPDZDVLPSODQWHGVXE FXWDQHRXVO\LQDWK\PLFIHPDOHPLFH8OWUDVRXQGZDVORQJLWXGLQDOO\SHUIRUPHG GXULQJJURZWKLQWXPRXUVXVLQJD0+]SUREHHYHU\ZHHNV0D[LPXP GLDPHWHUDQGPHDQHODVWLFLW\YDOXHZHUHFROOHFWHG6HYHQWXPRXUVZHUHPHDVXUHG LQ YLYR DQG H[ YLYR )RU SDWKRORJLFDO DQDO\VLV WXPRXUV RI GLIIHUHQW VL]HV ZHUH UHPRYHG7KHIROORZLQJHOHPHQWVZHUHTXDQWLÀHGWKHSURSRUWLRQRIҊYLDEOHҋDQG ҊQRQYLDEOHҋWLVVXHWKHҊRYHUDOOFHOOXODULW\ҋWKHҊRYHUDOOÀEURVLVUDWHҋDQGWKHҊRYHUDOO 0LFUR9DVFXODU'HQVLW\09'ҋ$ҊSDWKRORJLFDOVWLIIQHVVVFRUHҋ366FRPELQLQJ WKHVHSDWKRORJLFDOHOHPHQWVZDVFDOFXODWHG 5HVXOWV$ WRWDO RI 6:( ORQJLWXGLQDO PHDVXUHPHQWV ZHUH SHUIRUPHG 7KH PHDQHODVWLFLW\YDOXHLQFUHDVHGGXULQJWXPRXUJURZWKZLWKDQH[FHOOHQWFRUUHODWLRQ ZLWKVL]HU S:HIRXQGQRVLJQLÀFDQWGLIIHUHQFHVEHWZHHQWKH YDOXHVRIHODVWLFLW\LQYLYRDQGH[YLYRS 7KHUHZDVDVLJQLÀFDQWFRUUHODWLRQ EHWZHHQHODVWLFLW\DQG09'U S DQGFHOOXODULW\U S EXWQRVLJQLÀFDQWFRUUHODWLRQZLWKÀEURVLVU S 7KHFRUUHODWLRQEHWZHHQ HODVWLFLW\DQGWKH 366 ZDVYHU\JRRGU S &RQFOXVLRQ6:(PHDVXUHGVWLIIQHVVFKDQJHVGXULQJWXPRXUJURZWKLQDKXPDQ EUHDVWFDQFHUPRGHOLPSODQWHGLQPLFHUHÁHFWLQJXQGHUO\LQJSDWKRORJLFDOFKDQJHV 7KHUHZDVDJRRGFRUUHODWLRQEHWZHHQHODVWLFLW\DQGDҊ366ҋ % 6KHDU:DYHHODVWRJUDSK\ZRUOGZLGHEUHDVWWULDOPRGHOFDQ DGGLWLRQDO6:(IHDWXUHVVXSSRUWGRZQJUDGLQJ%,5$'6WR%,5$'6" ) .:6FKDHIHU:%HUJ'&RVJURYH-*D\06+HQU\2:ROI &&RKHQ%DFULH,QWHUQDWLRQDO%( FROODERUDWLYHVWXG\JURXS .LHO'(IVFKDHIHU#HPDLOXQLNLHOGH 3XUSRVH7 RGHWHUPLQHWKHDGGHGYDOXHRI6KHDU:DYH(ODVWRJUDSK\6:(LQ WKHFKDUDFWHULVDWLRQRI%,5$'6EUHDVWOHVLRQVDVFRPSDUHGWRFRQYHQWLRQDO XOWUDVRXQG DORQH LQ DQ LQWHUQDWLRQDOPXOWLFHQWUHVWXG\ %(FROODERUDWLYHVWXG\ JURXSZRUOGZLGHWULDO 0HWKRGVDQG0DWHULDOV3DWLHQWVVFKHGXOHGIRUDEUHDVWXOWUDVRXQGZHUHUHFUXLWHG WRWKH%(VWXG\ZKLFKZDVDSSURYHGE\WKH,5%RIHDFKFHQWUHOHVLRQVIURP FHQWUHVZRUOGZLGHZHUHHQWHUHGDOOKLVWRORJLFDOF\WRORJLFDOFRQÀUPHG6LJQLÀFDQW 6:(IHDWXUHVWRDGG%,5$'6WRLPSURYHOHVLRQFKDUDFWHULVDWLRQTXDOLWDWLYH &RQFOXVLRQ:HVKRZHGWKDWVXSSOHPHQWDOZKROHEUHDVW86GHWHFWHGDGGLWLRQDO EUHDVWFDQFHUOHVLRQVLQERWKUHFDOODQGFRQWUDODWHUDOEUHDVWVLGHVWKDWZHUHRFFXOW RQPDPPRJUDP7KLVH[WUDFDQFHU\LHOGVKRXOGEHZHLJKHGFDUHIXOO\DJDLQVWWKH DVVRFLDWHGIDOVHSRVLWLYHELRSVLHVDQGVXEVWDQWLDOFRVWVRIELODWHUDO86 % $GGLWLRQDOEUHDVWXOWUDVRQRJUDSK\86LQDV\PSWRPDWLFZRPHQ ZLWKQHJDWLYHPDPPRJUDSK\DUHWKHUHULVNFDWHJRULHVWKDWEHQHÀW PRUHWKDQRWKHUV" 9*LUDUGL07 RQHJXWWL(0DQIULQ) %RQHWWL3HVFKLHUDGHO*DUGD,7 JLUDYHUR#\DKRRLW 3XUSRVH 7 R DVVHVV WKH FDQFHU GHWHFWLRQ RI 86 LQ DGGLWLRQ WR QHJDWLYH PDP PRJUDSK\LQDV\PSWRPDWLFZRPHQDQGWRFRUUHODWHZLWKDJHULVNIDFWRUVPDP PRJUDSKLFGHQVLW\ 0HWKRGVDQG0DWHULDOV'XULQJD\HDUSHULRGDVHULHVRI VHOIUHIHUULQJZRPHQXQGHUZHQWWRFOLQLFDOH[DPLQDWLRQPDPPRJUDSK\DQGXOWUD VRXQGDV\PSWRPDWLFZRPHQQREUHDVWD[LOODU\VLJQZLWKQHJDWLYHPDP PRJUDSK\FRQVWLWXWHGWKHSRSXODWLRQVWXG\DJH\HDUVLQ\HDUVLQ \HDUVLQSUHYLRXVKLVWRU\RIEUHDVWFDQFHULQ&DQFHUVGHWHFWHG E\86ZDVDVVHVVHGLQWKHSRSXODWLRQDVZHOODVLQVXESRSXODWLRQVJURXSHGE\ DJH\HDUV\HDUVEUHDVWGHQVLW\%,5$'6 $&5FDWHJRULHVIDWW\EUHDVWV 'GHQVHEUHDVWV'SDWLHQWKLVWRU\SUHYLRXVEUHDVWFDQFHUQRSUHYLRXV FDQFHUKRUPRQDOVWDWXVIHUWLOHPHQRSDXVDO)LVKHU VH[DFWWHVWZDVXVHGIRU VWDWLVWLFDODQDO\VLVVLJQLÀFDQWSYDOXH 5HVXOWV2YHUDOOEUHDVWFDQFHUVZHUHGLDJQRVHGFDQFHUVZHUH LGHQWLÀHGE\PDPPRJUDSK\7KHUHPDLQLQJFDQFHUVZHUHGLDJQRVHGE\ 86DORQH7KH86GHWHFWLRQUDWHIRUWRWDOSRSXODWLRQZDVÆ,QWKHVXEJURXSVLW ZDVÆLQZRPHQ\HDUVYVÆLQZRPHQ!\HDUVS Æ LQGHQVHEUHDVWVYVÆLQIDWW\EUHDVWVS ÆLQZRPHQZLWKSUHYLRXV FDQFHUYVÆLQZRPHQZLWKRXWSUHYLRXVFDQFHUS &RQFOXVLRQ7KHDGGLWLRQRIXOWUDVRXQGWRPDPPRJUDSK\UHVXOWHGLQDQLQFUHDVHRI EUHDVWFDQFHUGHWHFWHGRI7KHDJHDQGWKHEUHDVWGHQVLW\KDYHQRVLJQLÀFDQW HIIHFW RQ 86 SHUIRUPDQFH 0RVW 86GHWHFWHG FDQFHUV RFFXUUHG LQZRPHQ ZLWK SHUVRQDOKLVWRU\RIEUHDVWFDQFHU % /HVLRQGHWHFWLRQLQ'86DXWRPDWHGEUHDVWYROXPHVFDQV$%96 FRUUHODWLRQZLWKEUHDVW05, 7 $)DVVDHUW,-0'XEHODDU0') GH-RQJ*--DJHU0-&05XWWHQ 'HQ%RVFK1/WIDVVDHUW#KRWPDLOFRP 3XUSRVH7 RGHWHUPLQHWKHGLDJQRVWLFDFFXUDF\RI'86DXWRPDWHGEUHDVWYROXPH VFDQQLQJ$%96UHODWHGWR05EUHDVWLPDJLQJXVLQJ%,5$'6FODVVLÀFDWLRQDV GLVFULPLQDWRU 0HWKRGV DQG 0DWHULDOV 'XULQJ D PRQWK SHULRG DOO SDWLHQWV ZKR XQGHUZHQW EUHDVW05,ZHUHUHTXHVWHGWRKDYHDGGLWLRQDO$%96FRQGXFWHGRIWKHLUEUHDVWV 3DWLHQWVXQGHU\HDUVRIDJHPDOHVSDWLHQWVXQDEOHWRXQGHUJR05,RUJLYH LQIRUPHGFRQVHQWZHUHH[FOXGHG7LPHEHWZHHQEUHDVW05,DQG$%96ZDV GD\V6FDQSURWRFROGHSHQGVRQEUHDVWVL]H,QFXS$&VFDQVDQGLQVL]H' DQG'VFDQVSHUEUHDVWDUHREWDLQHG5HVXOWLQJ'86GDWDLVHYDOXDWHGRQD GHGLFDWHGZRUNVWDWLRQE\DQH[SHULHQFHGUDGLRORJLVWZKRLVEOLQGHGIRU05,ÀQGLQJV 7KH'86ÀQGLQJVDUHHYDOXDWHGXVLQJWKH%,5$'6FODVVLÀFDWLRQIRUXOWUDVRXQG 05ÀQGLQJVDUHXVHGDVJROGVWDQGDUGDQGZKHQDYDLODEOHDOVRKLVWRSDWKRORJLF FRUUHODWLRQZDVSHUIRUPHG 5HVXOWV2XWRIFRQVHFXWLYHVFDQQHGSDWLHQWVZLWK05LPDJLQJRIWKHEUHDVWV SDWLHQWVSDUWLFLSDWHGLQRXUVWXG\,QQHDUO\DOOSDWLHQWV$%96ZDVWHFKQLFDOO\ VXFFHVVIXODQGEUHDVWWLVVXHZDVYLVLEOHIURPVNLQWRWKRUDFLFZDOO7KHD[LOODU\ UHJLRQFRXOGQRWVXIÀFLHQWO\EHYLVXDOLVHGIRUHYDOXDWLRQLQPRVWSDWLHQWV6RIDU SDWLHQWVDUHHYDOXDWHG'86HYDOXDWLRQRIWKHEUHDVWVKRZVDVHQVLWLYLW\RI DQGVSHFLÀFLW\RIFRPSDUHGWR05LPDJLQJÀQGLQJV,QFRPLQJPRQWKV DOOSDWLHQWVZLOOEHHYDOXDWHG &RQFOXVLRQ&RPSDUHGWR05,'86VKRZVKLJKVHQVLWLYLW\DQGVSHFLÀFLW\LQ WKH GHWHFWLRQ RI VXVSLFLRXV OHVLRQV$%96 VHHPV D SURPLVLQJ QHZ XOWUDVRXQG WHFKQLTXHLQEUHDVWHYDOXDWLRQ 6FLHQWLILF6HVVLRQ 6 &$' ( ) *+% (XURSHDQ&RQJUHVVRI 5DGLRORJ\ EUHDVWV6HQVLWLYLW\RIPXFLQRXVFDUFLQRPDVDQG/&,6ZDVORZHU WKDQ WKH RWKHU PDOLJQDQFLHV 6SHFLÀFLW\ RI SDSLOORPDWD DQG ÀEURF\VWLF FKDQJHZDVORZHUWKDQIRURWKHUEHQLJQFRQGLWLRQV &RQFOXVLRQ ,OOGHÀQHG OHVLRQV LUUHJXODU VKDSHG OHVLRQV OHVLRQV ZLWK SRVWHULRU DFRXVWLFVKDGRZLQJVPDOOOHVLRQVPXFLQRXVFDUFLQRPDV/&,6SDSLOORPDWDDQG ÀEURF\VWLFFKDQJHDSSHDUWREHUHODWHGWRSRRUHUXOWUDVRXQGHODVWRJUDSKLFGLDJ QRVWLFSHUIRUPDQFH % 8WLOLW\RIVHFRQGORRN86ZLWKUHDOWLPHYLUWXDOVRQRJUDSK\596IRU 05,GHWHFWHGOHVLRQVRIWKHEUHDVW 61DNDQR .<RUR]X\D.)XMLL0<RVKLGD-.RXVDND< 6KLRPL 7 )XNXWRPL7 ,VKLJXFKL2$UDL$LFKLJXQ-3.DVKLZD-3 3XUSRVH7KHDLPRIWKLVVWXG\ZDVWRYHULI\WKHXWLOLW\RIVHFRQGORRN86ZLWK XVLQJ UHDOWLPH YLUWXDO VRQRJUDSK\ 596 IRU WKH LGHQWLÀFDWLRQRI 05,GHWHFWHG OHVLRQVRIWKHEUHDVW 0HWKRGV DQG 0DWHULDOV )URP EUHDVW 05, DOO 05,GHWHFWHG OHVLRQV DQG VXEVHTXHQWELRSV\ZHUHLGHQWLÀHGEHWZHHQ)HEUXDU\DQG'HFHPEHU $OOSDWLHQWVZHUHH[DPLQHGXVLQJ596WKDWFRXOGV\QFKURQLVHD86LPDJHDQGWKH 05,RIWKHVDPHVLWHLQUHDOWLPH,QRUGHUWRDFKLHYHWKHVDPHSRVLWLRQRISDWLHQWҋV ERG\DVLQ8605,ZDVREWDLQHGRQD7LPDJHULQWKHVXSLQHSRVLWLRQXVLQJD ERG\VXUIDFHFRLO:HVHDUFKHGDOOFDVHVIRU05,GHWHFWHGOHVLRQVDQGLQYHVWLJDWHG VHFRQGORRN86ZLWKRUZLWKRXW596LQLGHQWLI\LQJWKHOHVLRQV 5HVXOWV2ISDWLHQWV05,GHWHFWHGVXVSLFLRXVOHVLRQVZHUHGHWHFWHGLQ SDWLHQWV$WRWDORI05,GHWHFWHGOHVLRQVLQSDWLHQWVFRPSULVHGWKLV DQDO\VLV2IOHVLRQVZHUHPDOLJQDQWDQGZHUHEHQLJQ2YHUDOO PHDQOHVLRQVL]HZDVPP $WRWDORIPDVVOHVLRQVZHUHLGHQWLÀHGFRPSDUHG ZLWKIRFLDQGQRQPDVVOLNHOHVLRQVOHVLRQVZHUHGHWHFWHGLQ VHFRQGORRN86ZLWKRXW596DQGZHUHUHYHDOHGDVFDQFHUVLQHLJKWEHQLJQOHVLRQV LQ,QFRQWUDVWOHVLRQVZHUHGHWHFWHGLQVHFRQGORRN86ZLWK 596DQGZHUHUHYHDOHGDVFDQFHUVLQEHQLJQOHVLRQVLQ &RQFOXVLRQ7KHSUHVHQWUHVXOWVVXJJHVWWKDWVHFRQGORRN86ZLWK596FDQLGHQWLI\ DODUJHSDUWRI05,GHWHFWHGOHVLRQVZLWKRXWRSHUDWRUҋVVNLOO 5RRP*+ 1HXUR 66 $JHLQJGHJHQHUDWLYHGLVRUGHUVDQGHSLOHSV\ 0RGHUDWRUV 76WRVLF2SLQFDO%HOJUDGH56 77RXUGLDV%RUGHDX[)5 % 5HJLRQDOFRUWLFDOWKLFNQHVVGHWHULRUDWLRQLQHOGHUO\KHDOWK\SHUVRQV IURP$,%/05,7GDWDD05,VWXG\XVLQJEUDLQVXUIDFHLQWHQVLW\ PRGHO%6,0 =/LQ .0F0LOODQ/<DQ8$YLQDVK:DXNHVKD:,86 0HQRPRQHH)DOOV:,86]KRQJPLQOLQ#JHFRP 3XUSRVH&RUWLFDOWKLQQLQJPD\EHDQHIIHFWLYHELRPDUNHUIRUQRUPDODJHLQJSURF HVV7UDGLWLRQDO PHWKRGV XVHG IRU PHDVXULQJ WKLV ELRPDUNHU RQ SHRSOH RYHU KDYHVKRZQYHU\VPDOOGHFOLQHUDWHV$QHZPHWKRGZDVGHYHORSHGWRPHDVXUH FRUWLFDOWKLFNQHVVFRQVLVWHQWO\DQGZDVXVHGWRVWXG\FRUWLFDOGHWHULRUDWLRQUDWHV RIQRUPDODJHLQJEHWZHHQDQG 0HWKRGVDQG0DWHULDOVKHDOWK\PHQDQGKHDOWK\ZRPHQRIWKHDJHJURXSV EHWZHHQDQGDQGDQGDQGIURP $XVWUDOLDQ,PDJLQJ%LRPDUNHUV DQG/LIHVW\OH$,%/VWXG\ZHUHXVHGWRPHDVXUHLQGLYLGXDODQGDYHUDJHFRUWLFDO WKLFNQHVVLQIXQFWLRQDOEUDLQUHJLRQVXVLQJ%6,05HJLRQDOFRUWLFDOWKLFNQHVV RILQGLYLGXDOVDQGJURXSDYHUDJHVZHUHVWXGLHGWRHYDOXDWHWKLFNQHVVGHWHULRUD WLRQRIQRUPDODJHLQJ%6,0UHJLVWHUVEUDLQLPDJHVWRDVWDQGDUGLVHGDWODVZLWK SUHGHÀQHG EUDLQ VXUIDFH SRLQWV )URP HDFK SRLQW D 05 LQWHQVLW\ SURÀOH SHUSHQGLFXODUWRWKHEUDLQVXUIDFHLVH[WUDFWHGDQGPRGHOOHGWRFDOFXODWHFRUWLFDO WKLFNQHVVDWWKHSRLQW 5HVXOWV 5HJLRQDO FRUWLFDO WKLFNQHVV ZLWKLQ DQ DJH JURXS ZDV ZLGHVSUHDGD Q G RYHUODSSHGEHWZHHQJURXSV&RPSDUHGWRSHRSOHLQWKHLUҋVWKLFNQHVVORVWDW GLIIHUHQWUDWHVLQIXQFWLRQDOUHJLRQVPPGHFDGHLQWHPSRUDODQGPHGLDOSDULHWDO DQGPPGHFDGHLQSRVWHULRUFLQJXODWHZHUHREVHUYHG5HVXOWVDOVRVKRZSHRSOH LQWKHLUVORVWFRUWH[DWIDVWHUUDWHVWKDQLQWKHV YDULDEOHVHODVWRJUDSK\VKDSHHODVWRJUDSK\KRPRJHQHLW\TXDQWLWDWLYHYDULDEOHV OHVLRQGLPHQVLRQPD[LPXPVWLIIQHVVN3DPHGLDQHODVWLFLW\PHDQOHVLRQIDWUDWLR PHDQHODVWLFLW\GLDPHWHUUDWLR$OO VWDQGDUG FDOFXODWLRQV RI VHQVLWLYLW\VSHFLÀFLW\ QHJDWLYHDQGSRVLWLYHSUHGLFWLYHYDOXHDQGSYDOXHZHUHSHUIRUPHG 5HVXOWVOHVLRQVZHUHEHQLJQPDOLJQDQWOHVLRQV ZHUHVFRUHG%,5$'67KHUHIHUHQFHWHVWZDV%,5$'6DQG%,5$'6 !7KHUHZHUHQRFDQFHUVLQWKH%,5$'6JURXS7KHUHIRUHWKHUHFODVVLÀFDWLRQ RIWKHOHVLRQVFRQVLVWHGRQO\LQGRZQJUDGLQJ%,5$'6WRDQHZ%,5$'6CJURXS ZKHQWKH6:(IHDWXUHZDVQRWVXVSLFLRXV%,5$'6DORQHKDGDVHQVLWLYLW\RI VSHFLÀFLW\3391395RXQGVKDSHRQ6:(DSSHDUVWR EHDKHOSIXOÀQGLQJWRDOWHUFOLQLFDOPDQDJHPHQWQRPDOLJQDQWOHVLRQVS 1RPDOLJQDQFLHVZHUHIRXQGZLWKPD[LPXPVWLIIQHVVN3DJDLQRIVSHFLÀFLW\ SPHGLDQHODVWLFLW\PHDQN3DJDLQRIVSHFLÀFLW\S OHVLRQIDWUDWLRN3DJDLQRIVSHFLÀFLW\SPHDQHODVWLFLW\GLDPHWHU UDWLRN3DJDLQRIVSHFLÀFLW\S &RQFOXVLRQ$OO 6:(IHDWXUHV WDNHQ VHSDUDWHO\ LQFUHDVHG VSHFLÀFLW\ RI EUHDVW XOWUDVRXQGLQFDVHRI%,5$'6ÀQGLQJVDQGUHFODVVLÀFDWLRQLQ%,5$'6C%HVW PRGHOZLWKKLJKHVWFOLQLFDOLPSDFW%,5$'66:(PD[LPXPVWLIIQHVVN3D % ,VVKHDUZDYHHODVWRJUDSK\DFRXVWLFUDGLDWLRQIRUFHLLPSXOVHDEOH WRLPSURYHWKHDVVHVVPHQWRI%,5$'6EUHDVWVROLGOHVLRQV" :%HQ+DVVHQ6&DQDOH3 9LHOK0&0DWKLHX6'HODORJH&%DOOH\JXLHU 9LOOHMXLI)5ZDJLK #\DKRRIU 3XUSRVH7 RHYDOXDWHWKHSHUIRUPDQFHRIVKHDUZDYHHODVWRJUDSK\LQEUHDVWOH VLRQVIRUWKHFKDUDFWHULVDWLRQRI%,5$'6VROLGOHVLRQV 0HWKRGVDQG0DWHULDOV6ROLGPDVVOHVLRQVFDWHJRULVHGDV%,5$'6RQXOWUD VRQRJUDSK\ZHUHSURVSHFWLYHO\LQFOXGHG%PRGHLPDJHVDQGUHVXOWVRIDFRXVWLF UDGLDWLRQIRUFH,PSXOVH$5),LPDJLQJERWKTXDOLWDWLYHVXVSLFLRXVHODVWRJUDP LPDJH RU QRW DQG TXDQWLWDWLYH VKHDU ZDYH VSHHG PV ZHUH FRUUHODWHG ZLWK F\WRKLVWRORJLFDOUHVXOWV)1$RUELRSV\9DOXHVRIWKHVKHDUZDYHYHORFLW\ZHUH GHWHUPLQHGLQERWKWKHVROLGPDVVHVDQGQRUPDOVXUURXQGLQJWLVVXHZLWKPHDVXUH PHQWVSHUIRUPHGDWWKHVDPHGHSWKDQGZLWKWKHVDPHSUREHSUHVVXUH3HUFHQWDJH RIVSHHGLQFUHDVHZDVFDOFXODWHGWROLPLWWKHELDVGXHWRYDULDEOHSUHVVXUHDQG FRUUHODWHGWRSDWKRORJ\ 5HVXOWVVROLGPDVVOHVLRQVZHUHVWXGLHGEHQLJQPDOLJQDQWPHDQVL]H PPLQSDWLHQWV7KHPHDQVKHDUZDYHYHORFLW\LQEHQLJQPDVVHVZDV VWDWLVWLFDOO\VLJQLÀFDQWO\ORZHUWKDQLQPDOLJQDQWOHVLRQVUHVSHFWLYHO\PVDQG PVS8VLQJWKHUHFHLYLQJRSHUDWLQJFKDUDFWHULVWLFFXUYHDFXWRII OHYHOIRUVKHDUZDYHVSHHGRIPVSUHGLFWHGPDOLJQDQF\ZLWKVSHFLÀFLW\ DQGVHQVLWLYLW\ZLWKDQDUHDXQGHUWKHFXUYH$8&RI$VSHHG LQFUHDVHKDGVSHFLÀFLW\DQGVHQVLWLYLW\ZLWKDQ$8&RI,QDGGLWLRQ DOOFDQFHUFDVHVH[KLELWHGDVXVSLFLRXVDSSHDUDQFHXVLQJ $5),TXDOLWDWLYHLPDJLQJ &RQFOXVLRQ $5),LQFRPELQDWLRQZLWK%PRGHLPDJLQJFDQLPSURYHWKHDVVHVV PHQWRIEUHDVWOHVLRQVHVSHFLDOO\IRUEHQLJQOHVLRQVPLVFDWHJRULVHGDV%,5$'6 DQGPLJKWKHOSGHFUHDVLQJWKHQXPEHURIEHQLJQOHVLRQVUHIHUUHGIRUELRSV\ % /HVLRQFKDUDFWHULVWLFVDQGKLVWRSDWKRORJLFDOIDFWRUVDIIHFWLQJ GLDJQRVWLFSHUIRUPDQFHRIEUHDVWXOWUDVRXQGHODVWRJUDSK\ /&+/HRQJ/66LP60&)RRN&KRQJ$5-DUD/D]DUR3 +7 DQ 6LQJDSRUH6*OHVWHUOHRQJFK#VJKFRPVJ 3XUSRVH7 RLGHQWLI\IDFWRUVDIIHFWLQJWKHGLDJQRVWLFSHUIRUPDQFHRIEUHDVWXOWUD VRXQGHODVWRJUDSK\ 0HWKRGV DQG 0DWHULDOV VRQRJUDSKLFDOO\ YLVLEOH EUHDVW PDVVHV WKDW ZHUH UHIHUUHG WR RXU GHSDUWPHQW IRU LPDJHJXLGHG ELRSV\ ZHUH HYDOXDWHG ZLWK XOWUD VRXQG HODVWRJUDSK\ (ODVWRJUDSKLF DVVHVVPHQW LQWHUSUHWHG DV SUREDEO\ EHQLJQ RUPDOLJQDQWEDVHGRQDFRPELQDWLRQRIHODVWRJUDSKLFVL]HUDWLRVDQGJUH\VFDOH VWUDLQSDWWHUQDVVHVVPHQW8VLQJKLVWRORJLFDOGLDJQRVLVDVWKHJROGVWDQGDUGWKH VHQVLWLYLW\DQGVSHFLÀFLW\IRUYDULRXVOHVLRQVZHUHDVVHVVHG 5HVXOWV 7KHUH ZDV QR VWDWLVWLFDOO\ VLJQLÀFDQW GLIIHUHQFH LQ WKH VHQVLWLYLWLHV RI ZHOOGHÀQHGYVLOOGHÀQHGOHVLRQVUHJXODUYVLUUHJXODUVKDSHGOHVLRQVDQGOHVLRQV ZLWKDQGZLWKRXWDFRXVWLFVKDGRZLQJ6WDWLVWLFDOO\VLJQLÀFDQWGLIIHUHQFHZDVQRWHG LQWKHVSHFLÀFLWLHVRIZHOOGHÀQHGOHVLRQVYVLOOGHÀQHGOHVLRQV SUHJXODUYVLUUHJXODUVKDSHGOHVLRQVS QR DFRXVWLF VKDGRZLQJ YV SRVWHULRU VKDGRZLQJ YV FRPELQHG VKDGRZLQJ S 6HQVLWLYLW\ DQG VSHFLÀFLW\ RI OHVLRQV PHDVXULQJ PPRUOHVVZHUHDQGYVS DQGS UHVSHFWLYHO\IRUOHVLRQVPRUHWKDQPP7KHUHZDVQRVWDWLVWLFDOO\VLJQLÀFDQW GLIIHUHQFHLQVHQVLWLYLW\DQGVSHFLÀFLW\IRUOHVLRQVZLWKDQGZLWKRXWFDOFLÀFDWLRQV OHVLRQVRIGLIIHUHQWHFKRJHQLFLW\DQGOHVLRQVLQPDPPRJUDSKLFDOO\GHQVHRUIDWW\ 6FLHQWLILF6HVVLRQ $ 6&'()*+%(XURSHDQ&RQJUHVVRI 5DGLRORJ\ )ULGD\ VFLHQWLÀFLQWHUHVWDUHODFNLQJ7KHUHIRUHZHDLPHGWRLQYHVWLJDWHWKHWHVWUHWHVW UHOLDELOLW\RI561VLQDPQHVWLFPLOGFRJQLWLYHLPSDLUHGD0&,SDWLHQWVDSURGURPDO VWDJHRI$O]KHLPHUҋVGLVHDVHDQGKHDOWK\HOGHUO\FRQWUROV+& 0HWKRGVDQG0DWHULDOV)RXUWHHQD0&,SDWLHQWVDQG+&XQGHUZHQWUHVWLQJ VWDWHI05,UVI05,DQGQHXURSV\FKRORJLFDOWHVWLQJ&(5$'EDWWHU\DWEDVHOLQH DQGRQDIROORZXSH[DPLQDWLRQDIWHUPRQWKV5HVWLQJVWDWHI05,GDWDZHUH GHFRPSRVHGLQWRLQGHSHQGHQWFRPSRQHQWV,&VXVLQJ)6/ҋVWHPSRUDOFRQFDWH QDWLRQ JURXS ,&$ 7&*,&$ DQG GXDO UHJUHVVLRQ 7KH ZLWKLQJURXS WHVWUHWHVW UHOLDELOLW\ZDVGHWHUPLQHGE\FDOFXODWLQJVSDWLDOQRUPDOLVHGFRUUHODWLRQFRHIÀFLHQWV 61&&VIRUWKHFRUUHVSRQGLQJDYHUDJHGJURXSOHYHOFRPSRQHQWVGHULYLQJIURP ERWK05,H[DPLQDWLRQV 5HVXOWV%RWKJURXSVUHPDLQHGFRJQLWLYHO\VWDEOHRYHUWLPH7KH7&*,&$DSSURDFK SURGXFHG,&VFRQVLGHUHGDV561VDQG,&VFRQVLGHUHGDVDUWHIDFWV2YHUDOO 61&&VZHUHORZPRGHUDWHWRKLJKUDQJLQJIURPWRDQGGLGQRWGLIIHU VLJQLÀFDQWO\EHWZHHQJURXSVS!*URXSOHYHOFRPSRQHQWVFRQVLGHUHGDV 561VH[SUHVVHG61&&VUDQJLQJIURPWR+LJKHVWWHVWUHWHVWUHOLDELOLW\ ZDVREVHUYHGLQWZRVXEQHWZRUNVRIWKHGHIDXOWPRGHQHWZRUNWZRVHQVRULPRWRU QHWZRUNVDQGDYLVXDOQHWZRUN &RQFOXVLRQ7KHORQJWHUPWHVWUHWHVWUHOLDELOLW\RI561VLVPRGHUDWHWRKLJKLQ FRJQLWLYHO\VWDEOHKHDOWK\HOGHUO\DQGD0&,SDWLHQWV7KLVÀQGLQJLVHVVHQWLDOWR HVWDEOLVKUVI05,DVDWRROLQWKHGLDJQRVLVDQGIROORZXSRIQHXURSV\FKLDWULFDQG QHXURGHJHQHUDWLYHGLVRUGHUV % 0XOWLWUDFHU3(7HDUO\IUDPHVDVDIXQFWLRQDOPDUNHULQ$O]KHLPHUҋV GLVHDVH 9$EUHX 6&DUWHU$1RUGEHUJ*HQHYD&+6WRFNKROP6( 3XUSRVH:HLQYHVWLJDWHGZKHWKHUWKHGLVWULEXWLRQRI&3LWWVEXUJKFRPSRXQG% 3,%DQG&/GHSUHQ\O'(3LQGXDOWUDFHU3(7HDUO\IUDPHVLVÁRZGHSHQGHQW DQGLWVSRWHQWLDOFOLQLFDOXVH 0HWKRGVDQG0DWHULDOV'XDOWUDFHU3(7VFDQVZHUHSHUIRUPHGLQDJURXSRI SDWLHQWVZLWKFOLQLFDOGLDJQRVLVRI´SUREDEOH $'µPHDQDJH6'\PHDQ 0LQL0HQWDO6WDWH([DPLQDWLRQ>006(@VFRUH6'DQGDJURXSRIDJH PDWFKHGFRQWUROVPHDQDJH6'\PHDQ006(VFRUH6' ERWKUHFUXLWHGIURP.DUROLQVND8QLYHUVLW\+RVSLWDO4XDQWLWDWLYHGDWDZHUHREWDLQHG E\VXPPLQJDOOHDUO\3,%DQG'(3IUDPHVDQGDQLWHUDWLYHDOJRULWKPJHQHUDWHG QRUPDOLVHGSHUIXVLRQLPDJHVZLWKVWDQGDUGXSWDNHYDOXHVIRUVHOHFWHGUHJLRQVRI LQWHUHVWIURQWDOSDULHWDOWHPSRUDODQGSRVWHULRUFLQJXODWHFRUWH[:HFDOFXODWHG 3HDUVRQ VFRUUHODWLRQFRHIÀFLHQWIRUWKHFRPELQHGIUDPHVLQDOOEUDLQWLVVXHYR[HOV DQGJURXSGLIIHUHQFHVZHUHDQDO\VHGZLWKWZRWDLOHGWWHVWV 5HVXOWV3(7IUDPHVEHWZHHQPLQXWHVSURGXFHGWKHRQO\YR[HOZLVHFRUUHODWLRQ IRXQG5 LQERWKJURXSV,QWKLVPLQZLQGRZZHUHWKHORZHVW3,%DQG '(3XSWDNHYDOXHVPHDVXUHGEXWWKHELQGLQJÁRZUDWLRZDVVLJQLÀFDQWO\KLJKHU S LQ PRVW$' SDWLHQWV Q WKDQ LQ WKH FRQWURO JURXS VXJJHVWLQJ WKDW WUDFHUGLVWULEXWLRQPD\EHÁRZGHSHQGHQW1RFRUUHODWLRQZDVIRXQGLQWKHRWKHU IUDPHVVWXGLHGPLQXWHV%UDLQUHJLRQVRILQWHUHVWLGHQWLÀHGDVVLJQLÀFDQW GLVFULPLQDWRUVSRI $'GLVHDVHZHUHSRVWHULRUFLQJXODWHDQGWHPSRUDOFRUWH[ &RQFOXVLRQ7KHGLVWULEXWLRQRI3(7WUDFHUVLQWKHYHU\HDUO\IUDPHVLVOLNHO\ÁRZ GHSHQGHQWZKLFKPD\EHXVHIXOWRGHULYHFOLQLFDOHVWLPDWHVRIFHUHEUDOEORRGÁRZ DQGQHXURLQÁDPPDWLRQIURPDVLQJOHPXOWLWUDFHU3(7VFDQ % 7UHOD[RPHWU\RQ705PDGHWHPSRUDOOREHHSLOHSV\GLDJQRVLVHDV\ +3 3DUHNK'3 9DVDYDGD-DPQDJDU,1 3XUSRVH7KHSXUSRVHRIWKLVVWXG\ZDVWRHYDOXDWHZKHWKHU7UHOD[RPHWU\PDGH KLSSRFDPSDOSDWKRORJ\GLDJQRVLVHDV\DQGODWHUDOLVHWKHHSLOHSWLFIRFXVLQSDWLHQWV ZLWKLQWUDFWDEOHWHPSRUDOOREHHSLOHSV\ 0HWKRGVDQG0DWHULDOV2XUVWXG\LQFOXGHVSDWLHQWVZLWKXQLODWHUDOWHPSRUDO OREHHSLOHSV\ZKRKDGXQLODWHUDOKLSSRFDPSDODWURSK\DQGSDWLHQWVZLWKXQLODWHUDO WHPSRUDOOREHHSLOHSV\ZKRKDGQRHYLGHQFHRIDWURSK\RQ05,2QD705 VFDQXVLQJDGXDOHFKRVHTXHQFHFRQWLJXRXVREOLTXHFRURQDOVOLFHVLQDOO SDWLHQWVDQGLQKHDOWK\VXEMHFWVZHUHWDNHQ$YHUDJHVRIVL[VOLFHVFRQWDLQLQJ WKHKHDGERG\DQGWDLORIWKHKLSSRFDPSXVZHUHXVHGWRFDOFXODWHKLSSRFDPSDO 7UHOD[DWLRQWLPHV 5HVXOWV$OOÀUVWSDWLHQWVZLWKKLSSRFDPSDODWURSK\DQGSDWLHQWV ZLWKQRUPDO05,KDGDEQRUPDOO\KLJKKLSSRFDPSDO7UHOD[DWLRQLSVLODWHUDOWRWKH HSLOHSWLFIRFXV%LODWHUDODEQRUPDOKLSSRFDPSDOUHOD[DWLRQYDOXHVZHUHIRXQGLQ SDWLHQWVZLWKXQLODWHUDOKLSSRFDPSDODWURSK\DQGSDWLHQWV ZLWK QRUPDO 05, +RZHYHU WKLV LQFUHDVH ZDV DOZD\V JUHDWHU LSVLODWHUDO WR WKH HSLOHSWLFIRFXV &RQFOXVLRQ :LGHVSUHDG FRUWLFDO WKLFNQHVV VKRZV GLYHUVLÀHG GLVWULEXWLRQ RI FRUWLFDOWKLFNQHVVDPRQJLQGLYLGXDOKHDOWK\SHUVRQV7KHQRUPDODJHLQJGHFOLQH UDWHVPHDVXUHGIURP$,%/7GDWDXVLQJ%6,0DUHKLJKHUWKDQZKDWKDVEHHQ SUHYLRXVO\UHSRUWHG % $UWHULDOVSLQODEHOOLQJSHUIXVLRQPDJQHWLFUHVRQDQFH05LPDJLQJ FRQWULEXWHVWRWKHHDUO\GLDJQRVLVRIGHPHQWLD 50(6WHNHWHH62RPV0/XLMWHQ*+RXVWRQ-&YDQ6ZLHWHQ06PLWV 5RWWHUGDP1/UVWHNHWHH#HUDVPXVPFQO 3XUSRVH (DUO\ GLDJQRVLV RI GHPHQWLD LV FKDOOHQJLQJ DV EUDLQ DWURSK\ PD\ QRW \HWEHDSSDUHQW&KDQJHVLQFHUHEUDOEORRGÁRZ&%)SUHFHGLQJDWURSK\PD\ EHGHWHFWHGZLWKDUWHULDOVSLQODEHOOLQJ$6/7KLVVWXG\DLPVWRDVVHVV$6/IRU GLDJQRVLQJHDUO\GHPHQWLD 0HWKRGVDQG0DWHULDOV)LIWHHQSDWLHQWVZLWKVXVSHFWHGGLDJQRVLVRIGHPHQWLD PHDQDJH\PDOHVPHDQ0LQL0HQWDO6WDWH([DPLQDWLRQDQGFRQWUROV PHDQDJH\PDOHVXQGHUZHQW'3&$6/DQG7Z05VFDQQLQJDW7*( +HDOWKFDUH86'DWDZHUHFRUHJLVWHUHGDQGQRUPDOLVHGXVLQJ630/RQGRQ 8.52,DQDO\VLVRIWKH&%)PDSVPDVNHGIRUJUH\PDWWHURQO\ZDVSHUIRUPHG ZLWK0DUV%D50DUVHLOOHV)5LQUHJLRQVLQYROYHGLQGHPHQWLDDQGUHJLRQVLQLWLDOO\ VSDUHG0HDQ&%)YDOXHVZHUHFRPSDUHGEHWZHHQJURXSVXVLQJVDPSOHWWHVWV 5HVXOWV $JHDQGJHQGHUZHUHQRWGLIIHUHQWEHWZHHQJURXSVS!0HDQ&%) YDOXHVLQGHPHQWLDUHODWHGEUDLQUHJLRQVZHUHVLJQLÀFDQWO\ORZHULQSDWLHQWVWKDQ FRQWUROVS ULJKWOHIWPHGLDO WHPSRUDOOREHYHUVXVULJKWOHIW SUHFXQHXVYHUVXVULJKWOHIWSRVWHULRUFLQJXOXPYHUVXVV POJ1RGLIIHUHQFHZDVIRXQGLQUHJLRQVQRWLPSOLFDWHGLQGHPHQWLDULJKW OHIWSUHFHQWUDOJ\UXVYHUVXVULJKWOHIWRFFLSLWDOJ\ULYHUVXV VPOJIRUSDWLHQWVDQGFRQWUROVUHVSHFWLYHO\ &RQFOXVLRQ3DWWHUQVRIK\SRSHUIXVLRQDVVHVVHGZLWK$6/LQHDUO\GHPHQWLDDUH FRQFRUGDQWZLWKWKRVHLQHVWDEOLVKHGGHPHQWLDDQGWKRVHDVVHVVHGZLWKSRVLWURQ HPLVVLRQWRPRJUDSK\LQGLFDWLQJWKHFRQWULEXWLRQRI$6/LQWKHHDUO\GLDJQRVLVRI GHPHQWLD)XWXUHDLPVDUHWRDVVHVV$6/IRUHDUO\GLIIHUHQWLDWLRQEHWZHHQW\SHV RIGHPHQWLD % +056DQG':,IRUGLIIHUHQWLDWLRQRI3DUNLQVRQҋVGLVHDVH3'IURP SDUNLQVRQLDQV\QGURPHV36 ==5R]KNRYD06KNOLDU.LHY8$LQYLYR#XNUQHW 3XUSRVH :H WU\ WR ÀQG GLDJQRVWLF PDUNHUV WR GLIIHUHQWLDWH 3' IURP PXOWLSOH V\VWHP DWURSK\ 06$ DQG SURJUHVVLYH VXSUDQXFOHDU SDOV\ 363 XVLQJ$'&ҋV DQG7YDOXHVLQWKHEDVDOJDQJOLD%*DQGLQPLGGOHFHUHEUDOSHGXQFOHV0&3 0HWKRGV DQG 0DWHULDOV )RXU JURXSV RI SDWLHQWV 3'*06$*363*&* DUH VWXGLHGZLWK76LJQD([FLWH*(7KH3'*LQFOXGHVSDWLHQWVZLWK3'WKH 06$*LQFOXGHVSDWLHQWVZLWK06$WKH363*LQFOXGHVSDWLHQWVZLWK363 DQG&*JURXSLQFOXGHVFRQWUROV+VSHFWUDDUHREWDLQHGLQ%*DQGLQ0&3ZLWK 69667($0757( PV)URPWKHHFKRWLPHGHSHQGHQFH RIWKHVLJQDOSHDNDUHDV$00 &KR&U1$$70DUHFDOFXODWHG 5HVXOWV7KHPHDQYDOXHVRI70LQ%*DUHPVLQ3'* PVLQ06$*PVLQ363*PV &*7KHVHGLIIHUHQFHVLQ70DOORZXVWRGLVWLQJXLVKVXEMHFWVRI&*IURPSDWLHQWV RI3'*DQG36*EXWWKH\DUHQRWVSHFLÀFIRUGLIIHUHQWLDWLRQRI06$IURPRWKHU SDWLHQWV7KHPHDQYDOXHVRI70LQ0&3DUHPV3'* PV06$*PV363*PV &*7KHVKRUWHQLQJRI70LQ0&3IRUWKHSDWLHQWVRI06$*LVH[WUHPHO\VSH FLÀF$'&VPPVIRUWKHSDWLHQWVRI3'*06$*363*&*LQWKHUHJLRQRI %*DUH0RUHSURQRXQFHGGLIIHUHQFHVRI$'&DUHIRXQGLQ 0&3IRU3'*06$*363*&*UHVSHFWLYHO\,QFUHDVLQJ $'&VLQ0&3IRUWKHSDWLHQWVRI06$*DOORZVXVWRGLIIHUHQWLDWH06$IURP363 DQG3'ZLWKKLJKVHQVLWLYLW\ &RQFOXVLRQ$'&DQG70LQ0&3IRU06$LQFRPSDULVRQZLWK3'DQG363DUH WKHLQYLYRGLDJQRVWLFPDUNHUVRI06$ % 7HVWUHWHVWUHOLDELOLW\RIUHVWLQJVWDWHQHWZRUNVLQKHDOWK\HOGHUO\ VXEMHFWVDQG0&,SDWLHQWV -%ODXW]LN '.HHVHU$%HUPDQ03DROLQL9.LUVFK 60XHOOHU05HLVHU67 HLSHO7 0HLQGO0XQLFK'( 5RVWRFN'(MDQXVFKEODXW]LN#PHGXQLPXHQFKHQGH 3XUSRVH/RQJLWXGLQDOVWXGLHVLQYHVWLJDWLQJWKHUHOLDELOLW\RIWKHEUDLQҋVUHVWLQJVWDWH QHWZRUNV561VKDYHIRFXVHGRQ\RXQJKHDOWK\VXEMHFWVGDWDRQKHDOWK\HOGHUO\ VXEMHFWV DQG YDULRXV SDWLHQW JURXSV ZKLFK UHSUHVHQW LQGLYLGXDOV RI FOLQLFDO DQG 6FLHQWLILF6HVVLRQ 6 &$' ( ) *+% (XURSHDQ&RQJUHVVRI 5DGLRORJ\ % 'LIIXVLRQWHQVRULPDJLQJDQGYR[HOEDVHGPRUSKRPHWU\LQ 3DUNLQVRQGLVHDVH $(ÀPWVHY9)RNLQ$7UXIDQRY$3DVKNRYD'.KDLPRY 6DLQW3HWHUVEXUJ58DWUDOI#PDLOUX 3XUSRVH7KHSXUSRVHRIWKLVVWXG\ZDVWRÀQGRXWLIDPLFURVWUXFWXUDOGDPDJHWR FHUHEUDOZKLWHPDWWHUFRUUHODWHVZLWKJUH\PDWWHUYROXPHFKDQJHVDQGFRJQLWLYH V\PSWRPVLQLGLRSDWKLF3DUNLQVRQGLVHDVH3' 0HWKRGVDQG0DWHULDOVSDWLHQWVZLWKGHQRYR3'ZHUHH[DPLQHG+RHKQDQG <DKUVWDJHV,,,,WZRDJHVXEJURXSVWR$DQGWR%\HDUVROGZLWK DQG ZLWKRXW FRJQLWLYH LPSDLUPHQWV7 ZHLJKWHG LPDJHV JUDGLHQW HFKR YR[HO PPGLIIXVLRQWHQVRULPDJHV'7,ZHUHREWDLQHG7 RWDOEUDLQJUH\PDWWHU*0 ZKLWH PDWWHU :0 YROXPHV ZHUH GHÀQHG IURP 7ZHLJKWHG LPDJHVIUDFWLRQDO DQLVRWURS\)$PHDQLQJVZHUHFDOFXODWHGXVLQJ)6/ 5HVXOWV3DWLHQWVRI$DJHVXEJURXSDOVRGLGQRWVKRZDQ\VLJQLÀFDQWGLIIHUHQFH ZLWK FRQWUROV GHVSLWH WKDW GXUDWLRQ RI LOOQHVV ZDV WZLFH ORQJHU WKDQ LQ SDWLHQWV WR\HDUV6XEJURXS%KDGVKRZQGHFUHDVHGYROXPHLQPHGLXPWHPSRUDO J\UXVIURQWRWHPSRUDODUHDSRQV3XWDPHQWKDODPXVFDXGDWHQXFOHXVDP\JGDOD YROXPHVGLGQRWGHPRQVWUDWHGLIIHUHQFHZLWKFRQWUROV)$PHDVXUHGLQDOOSDWLHQWV ZDVXQDOWHUHGLQWKHPLGEUDLQORZHUHGLQWKHFRUWLFRVSLQDOWUDFWLQVSOHQLXPRI FRUSXVFDOORVXPIURQWOREHVFHQWUXPVHPLRYDOHSRQVLQSURMHFWLRQRIVXEVWDQWLD QLJUD7KHUHZHUHORZHU)$PHDQLQJVLQFRUSXVFDOORVXPDQGLQWHUQDOFDSVXOHLQ SDWLHQWVZLWKFRJQLWLYHLPSDLUPHQWVDQG,,,+RHKQDQG<DKUVWDJHQRWGHSHQGLQJ RQDJHRUGXUDWLRQRILOOQHVV &RQFOXVLRQ&RUUHODWLRQRI)$GHFUHDVHDQGZRUVHFRJQLWLYHVWDWHLQSDWLHQWVRI DQ\DJHZLWKRXWEUDLQVWUXFWXUHYROXPHFKDQJHVFDQEHDSURYHGWKDWZLGHVSUHDG QHXURGHJHQHUDWLRQLVDOUHDG\SUHVHQWDWWKHWLPHRIFOLQLFDORQVHW % 7KHUHODWLRQRIQHXURLPDJLQJÀQGLQJVLQFDUERQLFDQK\GUDVHW\SH,, GHÀFLHQF\V\QGURPHWRFRJQLWLYHGLVWXUEDQFHDQGYLVXDOORVV ,$$ORUDLQ\7 0%RVOH\0$6DOLK'7 2\VWUHFN6$O0DONL $+$O6XKDLEDQL+.KLDUL..$EX$PHUR5L\DGK6$DORUDLQ\#NVXHGXVD 3XUSRVH7KLVZRUNGHVFULEHVWKHQHXURLPDJLQJÀQGLQJVLQFDUERQLFDQK\GUDVH W\SH,,GHÀFLHQF\V\QGURPH&$'6DQGWKHUHODWLRQRIWKHVHÀQGLQJVWRFRJQLWLYH GLVWXUEDQFHDQGYLVXDOORVV 0HWKRGVDQG0DWHULDOV5HWURVSHFWLYHDQDO\VLVRIVHULDOQHXURLPDJLQJVWXGLHV SHUIRUPHGLQLQGLYLGXDOVIURPXQUHODWHGFRQVDQJXLQHRXVIDPLOLHVZLWK&$'6 IROORZHGIRU\HDUVZDVSHUIRUPHGDQGFRUUHODWHGZLWKYLVXDOORVVDQGPHQWDO UHWDUGDWLRQ 5HVXOWV%UDLQFDOFLÀFDWLRQZDVSUHVHQWLQSDWLHQWVDV\RXQJDVWZR\HDUVROG EXWDEVHQWLQSDWLHQWVDVROGDVQLQH\HDUVDQGZDVJHQHUDOO\SURJUHVVLYHDQG IROORZHGDGLVWLQFWGLVWULEXWLRQLQYROYLQJSUHGRPLQDQWO\EDVDOJDQJOLDDQGWKDODPL DQG JUH\ZKLWH PDWWHU MXQFWLRQ LQ IURQWDO UHJLRQV PRUH WKDQ SRVWHULRU UHJLRQV 3DWLHQWVZLWKPRUHVHYHUHFRJQLWLYHGLVWXUEDQFHKDGOHVVSURIRXQGEUDLQFDOFLÀFD WLRQV,QJHQHUDOEDVDOJDQJOLDDQGWKDODPLZHUHVSDUHGLQLQGLYLGXDOVZLWKPRUH VHYHUHPHQWDOUHWDUGDWLRQDOWKRXJKJUH\ZKLWHMXQFWLRQFDOFLÀFDWLRQVWLOORFFXUUHG 3URJUHVVLYHFDOFLÀFDWLRQZDVQRWHGHYHQLQLQGLYLGXDOVZLWKPLQLPDORUQRFRJQLWLYH GLVWXUEDQFH6PDOORSWLFFDQDOZDVDOZD\VDVVRFLDWHGZLWKYHU\SRRUYLVLRQZKLOH FDQDOVL]HJUHDWHUWKDQPPZDVDVVRFLDWHGZLWKQRUPDORSWLFGLVNDSSHDUDQFH 2SWLFFDQDOVL]HZDVFRUUHODWHGZLWKYLVXDODFXLW\U S DQGZLWK GHJUHHRIRSWLFDWURSK\U S &RQFOXVLRQ %UDLQ FDOFLÀFDWLRQ LQ &$'6 PD\ QRW EH SUHVHQW GXULQJ FKLOGKRRG :RUVHPHQWDOUHWDUGDWLRQLVDVVRFLDWHGZLWKOHVVEUDLQFDOFLÀFDWLRQHVSHFLDOO\LQ WKHGHHSJUH\PDWWHU9DULDELOLW\RIEUDLQFDOFLÀFDWLRQDQGFRJQLWLYHGLVWXUEDQFHPD\ LPSO\DGGLWLRQDOJHQHWLFRUHSLJHQHWLFLQÁXHQFHVDIIHFWLQJWKHFRXUVHRIWKHGLVHDVH &RQFOXVLRQ+LSSRFDPSDO7PDSSLQJSURYLGHVHYLGHQFHRIKLSSRFDPSDOGDPDJH LQWKHPDMRULW\RISDWLHQWVZLWKLQWUDFWDEOHWHPSRUDOOREHHSLOHSV\ZKRPD\RUPD\ QRWKDYHKLSSRFDPSDODWURSK\RQ05,DQGFDQFRUUHFWO\ODWHUDOLVHWKHHSLOHSWLF IRFXVLQPRVWSDWLHQWV $GGLQJ7UHOD[RPHWU\LQ05SURWRFROIRUVXVSHFWHGWHPSRUDO OREHHSLOHSV\KHOSVLQHVWDEOLVKLQJWKHGLDJQRVLVDQGODWHUDOLVDWLRQRIHSLOHSV\ % +LSSRFDPSDOPDOURWDWLRQQRWHYHU\WKLQJLVPHVLDOVFOHURVLV 53DVWRU7 ROHGR-//HRQ*XLMDUUR,/ySH]%ODVFR63D]0D\D /$ULxR0RQWDQHU'6RULDQR0HQD$/ODQHV5LYDGD-8FKL\DPDGD 56DQFKH]2UR9DOHQFLD(6 3XUSRVH 'HPRQVWUDWH WKH LPDJLQJ ÀQGLQJ LQ 0DJQHWLF 5HVRQDQFH ,PDJLQJ 05,LQSDWLHQWVZLWKHSLOHSV\DQGKLSSRFDPSDOPDOURWDWLRQXVLQJKLJKUHVROXWLRQ YROXPHWULFVHTXHQFHV 0HWKRGVDQG0DWHULDOV5HYLHZRIVWXGLHVRI05,EUDLQSDWLHQWҋVZLWKHSLOHSV\RI RXUKRVSLWDOGLDJQRVHGZLWKPHVLDOVFOHURVLVIURP-DQXDU\WKURXJK'HFHPEHU )RUQRZZHKDYHREWDLQHGSDWLHQWV7KHVWXGLHVZHUHFRQGXFWHGRQD KLJKÀHOG7DQG7 DFFRUGLQJWRWKHSURWRFRORIHSLOHSV\LQFOXGHVDJLWWDO7 D[LDO7DQG7FRURQDO)/$,5FRURQDO7KLJKUHVROXWLRQDQG'YROXPHWULF VHTXHQFHV,5PPWKLFN 5HVXOWV:HKDYHREWHLQHGSDWLHQWVZLWKKLSSRFDPSDOPDOURWDWLRQLQZKLFKWKHUH KDGEHHQDPLVGLDJQRVLV&RPPRQIHDWXUHVIRXQGLQKLSSRFDPSDOPDOURWDWLRQZHUH KLSSRFDPSXVDEQRUPDOO\VLWXDWHGLQDPHGLDOORFDWLRQZKLFKKDVQRWURWDWHGWRWKH QRUPDOGHSWKZLWKLQWKHZDOOPHGLDOWHPSRUDOOREH7KHYHUWLFDOGLDPHWHULVVLPLODU RUJUHDWHUWKDQWKHWUDQVYHUVH7KHWHPSRUDOKRUQDSSHDUVHQODUJHGDQGFKRURLGDO ÀVVXUHLVSURPLQHQWDQGHPSW\7KHFROODWHUDOVXOFXVLVRIWHQYHUWLFDOL]HVDOWHULQJLWV DQJOHFDXVLQJDWHPSRUDU\LPSULQWRQWKHSROHNQRZQDVWHPSRUDOHPLQHQFH7KH LQWHUQDOVWUXFWXUHRIWKHKLSSRFDPSDOJ\UXVLVEOXUUHGNHHSLQJWKHVL]HDQGQRUPDO LQWHUQDOVLJQDODQGFKDQJHVLQVXUURXQGLQJVWUXFWXUHVDSSHDUDVSDUDKLSSRFDPSDO J\UXV GHFUHDVH LQ LWV XSSHU WUDQVYHUVH WKH VXELFXOXP WKH ÀPEULD DQG IRUQL[ WKLQQLQJDQGÁRZSRVLWLRQEXWDOOLQDWHPSRUDOOREHPDLQWDLQVLWVQRUPDOVL]H &RQFOXVLRQ+LSSRFDPSDOPDOURWDWLRQEXLOWDPDOIRUPDWLRQWKDWVKRXOGEHFRQVLG HUHGLQWKHGLIIHUHQWLDOGLDJQRVLVRISDWLHQWVZLWKHSLOHSV\ % &HUHEHOODUFKDQJHVLQHVVHQWLDOWUHPRUSDWLHQWVGHWHFWHGE\ PDJQHWLFUHVRQDQFHVSHFWURVFRS\ ,/DWQHURYD-.HOOHU$5XOVHK) -LUX$6NRFK0+RVNRYFRYD(5X]LFND -9\PD]DO3UDJXH&=LYDODWQHURYD#JPDLOFRP 3XUSRVH(VVHQWLDOWUHPRU(7LVRQHRIWKHPRVWFRPPRQPRYHPHQWGLVRUGHUV LQKXPDQVFKDUDFWHULVHGE\DNLQHWLFWUHPRURIDUPVKHDGDQGHYHQWKHYRLFH 7KHSUHYDOHQFHRI(7LVGHSHQGHQWRQWKHLQFUHDVLQJDJH7KHDLPRIRXUVWXG\ ZDVWRÀQGRXWLIWKHPHWDEROLWHFRQFHQWUDWLRQVPHDVXUHGLQFHUHEHOOXPDUHDOVR DJHGHSHQGHQW 0HWKRGV DQG 0DWHULDOV 3DWLHQWV ZLWK (7 Q 0 ) DJH DQG KHDOWK\YROXQWHHUVQ 0) DJH ZHUHGLYLGHGLQWRDJHJURXSV \HDUV FRQWUROV SDWLHQWV \HDUV F S \HDUV F S !\HDUVF S :HIRFXVHGRQWKHFHUHEHOOXPDQGPHDVXUHG1 DFHW\ODVSDUWDWH1$$FUHDWLQH&UDQGSKRVSKRFKROLQH3FKFRQFHQWUDWLRQV 6SHFWURVFRS\ZDVSHUIRUPHGRQ6LHPHQV$YDQWRVFDQQHUXVLQJVLQJOHVOLFH &6,VHTXHQFH75 PV7( PVDQGSURFHVVHGXVLQJ6LSURVRIWZDUH SDFNDJHZLWK/&0RGHO2QO\YR[HOVZLWKORZÀWWLQJHUURUZHUHFKRVHQ'RXEOHWDLOHG :HOFKWZRVDPSOHWWHVWZDVXVHGIRUVWDWLVWLFDODQDO\VLV 5HVXOWV:HIRXQG1$$FRQWUROV SDWLHQWV SYDOXH ( DQG 3FK FRQWUROV SDWLHQWV SYDOXH UHGXFWLRQ LQ (7 SDWLHQWV QR &U UHGXFWLRQ ZDV IRXQG 7KH JUHDWHVW GLIIHUHQFH EHWZHHQ FRQWUROV DQGSDWLHQWVZDVIRXQGLQWKHDJHJURXS\HDUV:HIRXQGDOOFRQFHQWUDWLRQ YDOXHVZLWKQRGURSLQLQFUHDVLQJDJH &RQFOXVLRQ:HIRXQGWKHVLJQLÀFDQWUHGXFWLRQRI1$$DQG3FKFRQFHQWUDWLRQVLQ (7FRPSDUHGWRKHDOWK\FRQWUROVKRZHYHUWKHVHFKDQJHVZHUHQRWUHODWHGWRDJH 6XSSRUWHG IURP JUDQWV ,*$ 0= &5 16 17 0ä0 DQG0ä0,*$0=&516 6FLHQWLILF6HVVLRQ $ 6&'()*+%(XURSHDQ&RQJUHVVRI 5DGLRORJ\ )ULGD\ % 0XOWLFHQWHUUDQGRPLVHGFRPSDULVRQVWXG\WRHYDOXDWHRXWFRPHV DQGUHVRXUFHQHHGVRILPDJLQJDQGWUHDWPHQWIROORZLQJ*G(2% '73$HQKDQFHG05,RIWKHOLYHULQFRPSDULVRQWRH[WUDFHOOXODU FRQWUDVWPHGLD(&&0HQKDQFHG05,DQGFRQWUDVWHQKDQFHG PXOWLGHWHFWRUFRPSXWHGWRPRJUDSK\0'&7LQSDWLHQWVZLWKD KLVWRU\RIFRORUHFWDOFDQFHUDQGNQRZQRUVXVSHFWHGPHWDFKURQRXV OLYHUPHWDVWDVHVWKHYDOXHVWXG\ &-=HFK 6*VFKZHQG$%D6VDODPDK7 9$/8(6WXG\*URXS 0XQLFK'(%HUOLQ'(9LHQQD$7&KULVWRSK=HFK#PHGXQLPXHQFKHQGH 3XUSRVH7 RFRPSDUHJDGR[HWLFDFLGHQKDQFHG05,*G(2%'73$05,05, ZLWK H[WUDFHOOXODU FRQWUDVW PHGLD (&&005, DQG FRQWUDVWHQKDQFHG 0'&7 &(0'&7 DV LQLWLDO GLDJQRVWLF PRGDOLWLHV LQ WKH ORFDO ZRUNXS RI SDWLHQWV ZLWK FRORUHFWDOOLYHUPHWDVWDVHV 0HWKRGVDQG0DWHULDOVVWXG\FHQWUHVLQFOXGHGSDWLHQWVZLWKVXVSHFWHG OLYHUPHWDVWDVHVIURPWR7KHLQLWLDOLPDJLQJWHFKQLTXHWREHXVHG ZDVUDQGRPLVHG7KHSULPDU\YDULDEOHZDVWKHSURSRUWLRQRISDWLHQWVIRUZKRP IXUWKHULPDJLQJZDVUHTXLUHGDIWHULQLWLDOLPDJLQJ)RUWKLVGHFLVLRQDFRQVHQVXV EHWZHHQDOLYHUVXUJHRQDQGUDGLRORJLVWRQVLWHZDVUHDFKHG6HFRQGDU\YDULDEOHV LQFOXGHGFRQÀGHQFHGLDJQRVWLFHIÀFDF\SDUDPHWHUVDQGLPSDFWRQWKHVXUJLFDOSODQ LQWKHVXEJURXSRISDWLHQWVZLWKKLVWRSDWKRORJ\DQGRULQWUDRSHUDWLYHXOWUDVRXQG 5HVXOWV)XUWKHULPDJLQJZDVUHTXLUHGLQDQG FDVHV DIWHU *G(2%'73$05, (&&005, DQG &(0'&7 UHVSHF WLYHO\ S 'LDJQRVWLF FRQÀGHQFH ZDV KLJKYHU\ KLJK LQ DQG UHVSHFWLYHO\ ,Q WKH VXEJURXS RI SDWLHQWV ZKR XQGHUZHQW VXUJHU\ VHQVLWLYLW\IRUGHWHFWLRQRIPHWDVWDVHVZDVDQGIRU *G(2%'73$05,(&&005,DQG&(0'&7 UHVSHFWLYHO\6XUJLFDOSODQZDV FKDQJHGDQGVXUJHU\WLPHLQFUHDVHGLQDQGRISDWLHQWVDIWHU *G(2%'73$05, (&&005, DQG &(0'&7 UHVSHFWLYHO\ *G(2%'73$ 05,DVVHFRQGLPDJLQJDYRLGHGXQQHFHVVDU\VXUJHULHVLQSDWLHQWV VFKHGXOHGIRUVXUJHU\ &RQFOXVLRQ7KHUHVXOWVVKRZVXSHULRULW\RI*G(2%'73$05,RYHU&(0'&7 DQG(&&005,IRUHYDOXDWLQJSDWLHQWVIRUOLYHUVXUJHU\3DWLHQWVUDQGRPLVHGIRU *G(2%'73$05,DVLQLWLDOVWDJLQJVWUDWHJ\QHHGHGQRIXUWKHULPDJLQJWRDVVHVV RSHUDELOLW\ZLWKLPSOLFDWLRQVIRUZRUNÁRZDQGFRVWV7KHFRPSDULVRQRIGLDJQRVWLF HIÀFDF\SDUDPHWHUVGHPRQVWUDWHVWKHGLDJQRVWLFEHQHÀWRI*G(2%'73$05, % .LQHWLFVRI*G(2%'73$LQOLYHUOHVLRQVVXVSHFWIRUPHWDVWDVHV DV\VWHPDWLFFRPSDULVRQRIUDZGDWDZLWKDUWHULDOLQSXWIXQFWLRQ FRUUHFWHGGDWD 3 $7 %DOW]HU0%HQQGRUI:$.DLVHU0'LHW]HO -HQD'(SDVFDOEDOW]HU#PHGXQLMHQDGH 3XUSRVH *G(2%'73$ LV D OLYHUVSHFLÀF FRQWUDVW DJHQW IRU GLIIHUHQWLDWLRQ RI IRFDOOLYHUOHVLRQV+HUHLQRXUDLPLVWRFRPSDUH*G(2%'73$NLQHWLFVDPRQJ EHQLJQ DQG PDOLJQDQW OHVLRQV DQG WR DVVHVV WKH HIIHFW RI DUWHULDOLQSXWIXQFWLRQ $,)FRUUHFWLRQRQWKLVFRPSDULVRQ 0HWKRGVDQG0DWHULDOV7ZREOLQGHGREVHUYHUVUHWURVSHFWLYHO\UHYLHZHGFRQVHFX WLYHH[DPLQDWLRQVRISDWLHQWVDQGLGHQWLÀHGIRFDOOLYHUOHVLRQVEHQLJQ PDOLJQDQW5HIHUHQFHVWDQGDUGZDVHVWDEOLVKHGRQWKHEDVLVRIKLVWRSDWKRORJ\ DQGIROORZXSH[DPLQDWLRQV6LJQDOLQWHQVLWLHV6,ZHUHREWDLQHGIRUDOOLGHQWLÀHG OHVLRQVKHDOWK\OLYHUSDUHQFK\PDDRUWDDQGQRLVH)RUHDFKOHVLRQWKHVHVLJQDO LQWHQVLWLHV ZHUH PHDVXUHG LQ WKH SUHFRQWUDVW LPDJHV DV ZHOO DVLQ WKH DUWHULDO SRUWDOYHQRXVYHQRXVDQGODWHSKDVH/HVLRQVLJQDOVQRZZHUHHYDOXDWHGXVLQJ WZRGLIIHUHQWDSSURDFKHV0DQG00HPSOR\HGWKHOHVLRQVҋDEVROXWH6,DQG ZDVFRUUHFWHGIRUWKH$,)ZLWKWKHDRUWDҋV6,0HPSOR\HGWKHOHVLRQVҋFRQWUDVW WRQRLVHUDWLRDQGZDVFRUUHFWHGIRUWKH$,)ZLWKWKHDRUWDҋVVLJQDOWRQRLVHUDWLR 0DQG0ZHUHFRPSDUHG 5HVXOWV,Q0WKHUHZDVDVLJQLÀFDQWGLIIHUHQFHEHWZHHQEHQLJQDQGPDOLJQDQW IRFDO OLYHU OHVLRQV LQ WKH ODWH SKDVH 3 ,Q0 WKHUH ZDV D GLIIHUHQFH LQ WKHDUWHULDOSKDVH31RRWKHUVLJQLÀFDQWGLIIHUHQFHVRFFXUUHGLQ0DQG 09LVXDOFRPSDULVRQVKRZHGWKDWFRUUHFWLRQOHDGVWRPRUHVWUHDPOLQHGNLQHWLFV DPRQJDOOOHVLRQV &RQFOXVLRQ$,)FRUUHFWLRQPD\OHDGWRIXUWKHULQIRUPDWLRQDERXWIRFDOOLYHUOH VLRQVGHSHQGLQJRQZKDWNLQGRIFRUUHFWLRQLVSHUIRUPHG:KHWKHUWKLVLQIRUPDWLRQ LVGLDJQRVWLFDOO\UHOHYDQWQHHGVWREHGHWHUPLQHG 5RRP/0 $EGRPLQDO9LVFHUD 66 /LYHUQRQSULPDU\OHVLRQV 0RGHUDWRUV %-2SGH%HHFN$QWZHUS%( $6LHPLDQRZLF]3LHNDU\ŊOćVNLH3/ % 3DUDGR[LFDOXSWDNHRI*G(2%'73$RQWKHKHSDWRELOLDU\SKDVH LQWKHHYDOXDWLRQRIKHSDWLFPHWDVWDVLVIURPEUHDVWFDQFHULVWKH ´WDUJHWVLJQµDFRPPRQÀQGLQJ" -6KLP&/HH$.LP..LP-&KRL-/HH< 3DUN&3DUN6HRXO.5 NLNRRNLH#KDQPDLOQHW 3XUSRVH7 RGHVFULEH05,ÀQGLQJVRIEUHDVWFDQFHUOLYHUPHWDVWDVLVXVLQJJDGR[ HWLFDFLGZLWKDQHPSKDVLVRQWKHDGGHGYDOXHRIWKHKHSDWRELOLDU\SKDVH+%3 0HWKRGVDQG0DWHULDOV1LQHSDWLHQWVZLWKOLYHUPHWDVWDVHVZHUHLQFOXGHGLQ WKHVWXG\DIWHUUHYLHZLQJWKHPHGLFDOUHFRUGVRIEUHDVWFDQFHUSDWLHQWVZKR XQGHUZHQW*G(2%'73$HQKDQFHG05,EHWZHHQ)HEUXDU\DQG-XQH 7KHGLDJQRVHVRIOLYHUPHWDVWDVLVZHUHHVWDEOLVKHGE\SHUFXWDQHRXVOLYHUELRSV\ RU VXUJHU\ DQG RQ WKH EDVLV RI LPDJH ÀQGLQJV 7ZR UDGLRORJLVWVUHWURVSHFWLYHO\ HYDOXDWHG6,DQGVL]HVRIPHWDVWDVHVDQGSDWWHUQVRIHQKDQFHPHQWLQ+%3 7KH6, UDWLRZDVFDOFXODWHGDVWKH6,RIWKHFHQWUDOK\SHULQWHQVHSRUWLRQLQ´WDUJHWµOHVLRQV GLYLGHGE\WKH6,RIQHDUE\QRUPDOOLYHUSDUHQFK\PDRQ+%3 :HDOVRPHDVXUHG $'&YDOXHVIURP':, 5HVXOWV/LYHUPHWDVWDVHVZHUHDOOK\SRLQWHQVHRQ7:,DQGPDQ\OH VLRQVKDG´WDUJHWµDSSHDUDQFHVZLWKFHQWUDOKLJK6,DQGSHULSKHUDOORZ6,ULP RQ7:,'\QDPLFVWXG\VKRZHGULPHQKDQFHPHQWRQDUWHULDOSKDVHDQG ´WDUJHWµDSSHDUDQFHFRQVLVWLQJRIFHQWUDOHQKDQFLQJSRUWLRQZLWKSHULSKHUDOZDVK RXWRUK\SRLQWHQVHULPRQ+%37KHPHDQ6,UDWLRZDV7KHPHDQ $'& YDOXHRI´WDUJHWµDSSHDULQJPHWDVWDVHVZDVðóPPòVFRPSDUHG ZLWKDPHDQYDOXHRIðóPPòVLQKRPRJHQHRXVGHIHFWRQ+%3 7KHUHZDVVWDWLVWLFDOO\VLJQLÀFDQWGLIIHUHQFHS &RQFOXVLRQ%UHDVWFDQFHUOLYHUPHWDVWDVHVFRPPRQO\GHPRQVWUDWHGDVSHULSKHUDO ULQJHQKDQFHPHQWRQDUWHULDOGRPLQDQWSKDVHDQGWDUJHWVLJQZLWKFHQWUDOURXQG HQKDQFLQJSRUWLRQDQGSHULSKHUDOK\SRLQWHQVHULPRQ+%3 % 'HWHFWLRQRIFRORUHFWDOKHSDWLFPHWDVWDVHVXVLQJ*G(2%'73$ 05LPDJLQJDQGGLIIXVLRQZHLJKWHGLPDJLQJ':,DORQHDQGLQ FRPELQDWLRQLQSDWLHQWVDIWHUFKHPRWKHUDSLFWUHDWPHQW $0DFHUD03HWUDFFKLQL$%DOER0XVVHWWR$)RUQDUL&/DULR7 *DOOR 6&LULOOR7XULQ,7PDFHUDDQQDOLVD#JPDLOFRP 3XUSRVH7 RFRPSDUHWKHDFFXUDF\DQGVHQVLWLYLW\RI*G(2%'73$05LPDJLQJ DQG':,DORQHDQGLQFRPELQDWLRQIRUGHWHFWLQJFRORUHFWDOOLYHUPHWDVWDVHVLQ SDWLHQWVZLWKPHWDVWDWLFGLVHDVHDIWHUFKHPRWKHUDSLFWUHDWPHQW 0HWKRGV DQG 0DWHULDOV FRQVHFXWLYH SDWLHQWV ZLWK D WRWDO RI OHVLRQV XQGHUZHQW05LPDJLQJ2XWRIOHVLRQVZHUHPHWDVWDVHVRQKLV WRSDWKRORJ\DQGRULQWUDRSHUDWLYHVRQRJUDSK\7KUHHLPDJHVHWV*G(2%'73$ ':,DQGFRPELQHG*G(2%'73$DQG':,ZHUHUHYLHZHGLQGHSHQGHQWO\E\WZR REVHUYHUV6WDWLVWLFDODQDO\VLVZDVSHUIRUPHGRQDSHUOHVLRQVEDVLV 5HVXOWV05,VFDQVHYDOXDWHGE\WKHLPDJHVHWXQHQKDQFHGVHTXHQFHVDQG DIWHU LQWUDYHQRXV DGPLQLVWUDWLRQ RI *G(2%'73$ FRUUHFWO\ LGHQWLÀHG OHVLRQVZLWKDFFXUDF\RI&,DQGPHWDVWDVHVZLWK DVHQVLWLYLW\RI&,05,VFDQVHYDOXDWHGE\WKHLPDJHVHW XQHQKDQFHGVHTXHQFHVDQG':,FRUUHFWO\LGHQWLÀHGZLWKDFFXUDF\RI &,DQGPHWDVWDVHVZLWKDVHQVLWLYLW\RI &,05,VFDQVHYDOXDWHGE\WKHLPDJHVHWXQKHQDQFHGVHTXHQFHV DIWHU LQWUDYHQRXV DGPLQLVWUDWLRQ RI *G(2%'73$ DQG ':, FRUUHFWO\ LGHQWLÀHG ZLWKDFFXUDF\RI&,DQGPHWDVWDVHVZLWK DVHQVLWLYLW\RI&, &RQFOXVLRQ7KHVHQVLWLYLW\DQGDFFXUDF\RIVHWLVVLJQLÀFDQWO\EHWWHUWKDQERWK VHWVDQGS7KHVHQVLWLYLW\DQGDFFXUDF\RIVHWLVVLJQLÀFDQWO\ EHWWHUWKDQVHWS 6FLHQWLILF6HVVLRQ 6 &$' ( ) *+% (XURSHDQ&RQJUHVVRI 5DGLRORJ\ ZLWKDQGEYDOXHVDQGDQG$'&DSSDUHQWGLI IXVLRQFRHIÀFLHQWYDOXHVZHUHREWDLQHG9DULDQFHDQDO\VLVZDVDSSOLHGE\.UDXVH :DOOLV.:IRUPXODZLWKXQLODWHUDOVLJQLÀFDWLRQIRUWKHGLIIXVLRQPHDVXUHV7KH $852&ZHUHFDOFXODWHGZLWKD&,RIIRUVLJQLÀFDWLYHOLYHUÀEURVLVGHWHFWLRQ 0HWDYLU6FDOH!) 5HVXOWVSDWLHQWVZHUH+,9+&9+%9+%9+&9KDGDXWRLPPXQH OLYHUGLVHDVHVDQGRWKHUFDXVHV6WDJHV0HWDYLU6FDOH))) ))7KH $'&YDOXHVó[PPòVHJZHUHDVIROORZV)) DQGZLWK.: DQGS ZLWK .: DQGS ZLWK.: DQGS 7KH $852&IRUVLJQLÀFDWLYHOLYHUÀEURVLVGHWHFWLRQIRUWKHWKUHH $'&UHVSHFWLYHO\ ZHUHRI&,S &,S DQG &,S &RQFOXVLRQ ':05, ZLWK E YDOXHV RI DQG PV GR QRW DGHTXDWHO\ GLVFULPLQDWH WKH GLIIHUHQW OLYHU ÀEURVLV VWDJHV 7KLV WHFKQLTXH LV QRW XVHIXO IRU VLJQLÀFDWLYHOLYHUÀEURVLVGHWHFWLRQ % 0DJQHWLFUHVRQDQFHDVVHVVPHQWRIIXQFWLRQDOFKDQJHVLQOLYHU SHUIXVLRQUHODWHGWRLQWUDKHSDWLFLVOHWVWUDQVSODQWDWLRQLVOHWW[DQG FOLQLFDORXWFRPHSUHOLPLQDU\UHVXOWV $3DOPLVDQR$(VSRVLWR) 'H&REHOOL3 0DIÀ7 &DQX3 0DJLVWUHWWL *,URQL$6HFFKL$'HO0DVFKLR0LODQ,7 3XUSRVH3DQFUHDWLFLVOHWWUDQVSODQWDWLRQLVOHWW[WKURXJKLQWUDSRUWDOYHLQLQIX VLRQLVDSURPLVLQJWKHUDSHXWLFDSSURDFKIRU7'0EXWPRVWLVOHWVDUHORVWLQWKH ÀUVWSKDVHVDIWHUWUDQVSODQWDWLRQ$SRWHQWLDOFUXFLDOIDFWRUIRULVOHWVHQJUDIWPHQW VHHPVWREHYDVFXODULVDWLRQ $SUHYLRXVSUHFOLQLFDOVWXG\IRXQGDVWURQJFRUUHODWLRQ EHWZHHQG\QDPLFFRQWUDVWHQKDQFHPHQWPDJQHWLFUHVRQDQFHLPDJLQJ'&(05, SDUDPHWHUVDQGLPPXQRKLVWRFKHPLFDOPHDVXUHVRILVOHWVQHRYDVFXODULVDWLRQ $LPRI RXUVWXG\ZDVWRDVVHVVWKHFKDQJHVLQWKHOLYHUSHUIXVLRQRFFXUULQJDWGD\VIURP LQWUDKHSDWLFLVOHWVLQIXVLRQLQKXPDQVDQGFRUUHODWHWKLVGDWDZLWKLVOHWW[RXWFRPH 0HWKRGVDQG0DWHULDOVGLDEHWLFSDWLHQWVSWVUHFHLYHGLVOHWW['&(05,VWXGLHV ZHUHSHUIRUPHGEHIRUHLVOHWW[DQGDWZHHNIURPWUDQVSODQWDWLRQRQD7 XVLQJ D7Z'75,9(VHTXHQFHVOLFHWKLFNQHVVPPG\QDPLFVFDQVWHPSRUDO UHVROXWLRQVHFHQFRPSDVVLQJWKHHQWLUHOLYHUGXULQJLQWUDYHQRXVJDGROLQLXP LQMHFWLRQ'&(05,ZDVTXDQWLWDWLYHO\DQDO\VHGWRREWDLQPD[LPXPHQKDQFHPHQW 0( DQG DUHD XQGHU FXUYH $8& '&(05,SDUDPHWHUV PRGLÀFDWLRQV ZHUH FRPSDUHGZLWKPHWDEROLFIXQFWLRQ>&SHSWLGHJO\FDWHGKDHPRJORELQ+E$F@DW PRQWKVDIWHUWUDQVSODQWDWLRQ 5HVXOWV '&(05, SDUDPHWHUV LQFUHDVHG GD\V DIWHU WUDQVSODQWDWLRQ LQ S W V SWу0(у$8&SWу0(у$8&7KHVHSWVVKRZHG D JRRG JUDIW IXQFWLRQ DW PRQWKV DIWHU WUDQVSODQWDWLRQ SW&SHS QJPO у+E$F SW&SHS QJPO у+E$F '&(05, SDUDPHWHUV VWURQJO\GHFUHDVHGLQWKHRWKHUSWVDWZHHNDIWHUWUDQVSODQWDWLRQSWу0( у$8&SWу0(у$8& 7KH\ H[SHULPHQWHG JUDIW IDLOXUH UHVSHFWLYHO\DQGPRQWKVDIWHUWUDQVSODQWDWLRQ&SHSVHFUHWLRQDIWHUDUJLQLQH VWLPXOXVSWSW &RQFOXVLRQ)URPRXUSUHOLPLQDU\UHVXOWV'&(05,FKDQJHVDSSHDUWRSUHGLFW LVOHWVW[ RXWFRPH VXSSRUWLQJ WKH K\SRWKHVLV WKDW HDUO\ LVOHWVYDVFXODULVDWLRQ LV FUXFLDOIRUHQJUDIWPHQW % (YDOXDWLRQRIHIÀFLHQF\DQGLPDJHTXDOLW\EHWZHHQDPDQXDODQGD QRYHODXWRPDWHG05VFDQQHULQWHUIDFHLQOLYHU05LPDJLQJ &.ORHWHUV /8PXWOX&0RHQQLQJKRII0/DGG$6RPEHW]NL *$QWRFK06FKODPDQQ0)RUVWLQJ7 &/DXHQVWHLQ(VVHQ'( 'VVHOGRUI'(FKULVWLDQNORHWHUV#XNHVVHQGH 3XUSRVH 7 R HYDOXDWH WKH SRWHQWLDO EHQHÀWV RI DQ DXWRPDWHG 05, DOJRULWKP LQ SDWLHQWVZLWKFRQWUDVWHQKDQFHGOLYHUH[DPLQDWLRQV7XQGHUFRQVLGHUDWLRQRI H[DPLQDWLRQHIÀFLHQF\DQGLPDJHTXDOLW\ 0HWKRGVDQG0DWHULDOV6HYHQW\SDWLHQWV\HDUVZHUHSURVSHFWLYHO\HQ UROOHGDQGUHIHUUHGWRDFRQWUDVWHQKDQFHG05H[DPLQDWLRQRIWKHOLYHU3DWLHQWV ZHUHUDQGRPLVHGWRRQHRIWKHIROORZLQJVFDQQHUV70$*1(720 $HUDLQFOXGLQJ DFRPSOHWHO\DXWRPDWHGXVHULQWHUIDFHRUD70$*1(720$YDQWRZLWKPDQX DOO\RSHUDWHGVFDQQHUVRIWZDUH6LHPHQV*HUPDQ\7ZREOLQGHGUHDGHUVUDWHG WKHLPDJHTXDOLW\LQGLIIHUHQWFDWHJRULHVDQJXODWLRQV)29LPDJHFRQWUDVW LPDJHQRLVHDUWHIDFWVDQGSUHVHQWDWLRQRIWKHWDUJHWRUJDQIURPH[FHOOHQW ´µWRLQVXIÀFLHQW´µ7KHGHJUHHRIGLDJQRVWLFFRQÀGHQFHWRGHSLFWOLYHUOHVLRQV ZDVUDWHGIURP´FHUWDLQµ´µWR´XQFHUWDLQµ´µ$ERYHQDPHGFDWHJRULHVZHUH DVVHVVHGIRUWKHIROORZLQJVHTXHQFHV7UXH),63 7Z76(+$67( % 'HWHFWLRQRIFRORUHFWDOOLYHUPHWDVWDVHVVHQVLWLYLW\RI7ZHLJKWHG DQGGLIIXVLRQZHLJKWHGLPDJLQJXVLQJSDWKRORJLFDOH[DPLQDWLRQDV PHWKRGRIUHIHUHQFHLQDUDWPRGHO 0:DJQHU/0DJJLRUL05RQRW99LOJUDLQ< 3DQLV%(9DQ%HHUV &OLFK\)5ZDJQHUPDWKLOGH#JPDLOFRP 3XUSRVH7 RFRPSDUHWKHVHQVLWLYLW\RI7ZHLJKWHGDQGGLIIXVLRQZHLJKWHGLPDJLQJ ':,LQGHWHFWLQJFRORUHFWDOOLYHUPHWDVWDVHVLQDUDWPRGHO 0HWKRGVDQG0DWHULDOV(LJKWHHQ%',;UDWVKDGVXUJHU\ZLWKLQMHFWLRQVRI PLOOLRQ'+'.FHOOVLQWKHOHIWOLYHU05H[DPLQDWLRQLQFOXGHG5$5(7ZHLJKWHG LPDJLQJDQG6(':,E DQGVPP6DFULÀFHZDVSHUIRUPHGLPPH GLDWHO\DIWHU05,SURFHGXUH,PDJHVZHUHDQDO\VHGE\WZRLQGHSHQGHQWUHDGHUV 3DWKRORJLFDO H[DPLQDWLRQ ZDV SHUIRUPHG DIWHU VOLFLQJ WKH ZKROHOHIW OLYHU HYHU\ PP $YHUDJHGLDPHWHURIHDFKOLYHUPHWDVWDVLVZDVFRPSXWHG&RFKUDQ4WHVW ZDVXVHGWRFRPSDUHWKHGHWHFWLRQUDWHV 5HVXOWV$WRWDORIOLYHUPHWDVWDVHVZHUHLGHQWLÀHGRQSDWKRORJLFDOH[DPLQD WLRQ0HDQDYHUDJHGLDPHWHUZDVPP)RUERWKUHDGHUVDVLJQLÀFDQWO\ KLJKHUQXPEHURIPHWDVWDVHVZDVGHWHFWHGRQ':,WKDQRQ7ZHLJKWHGLPDJHV YVSIRUUHDGHUDQGYV S IRUUHDGHU$IWHUVWUDWLÀFDWLRQDFFRUGLQJWRPHWDVWDVLVDYHUDJH GLDPHWHU':,KDGDVLJQLÀFDQWO\KLJKHUGHWHFWLRQUDWHWKDQ7ZHLJKWHGLPDJLQJ IRUPHWDVWDVHVZLWKDQDYHUDJHGLDPHWHUEHWZHHQDQGPP YVSIRUUHDGHUDQGYVS IRUUHDGHU1RGLIIHUHQFHZDVIRXQGEHWZHHQWKHWZRLPDJLQJWHFKQLTXHVIRU PHWDVWDVHVODUJHUWKDQPPRUVPDOOHUWKDQPP &RQFOXVLRQ7KLVH[SHULPHQWDOVWXG\ZLWK05DQGSDWKRORJLFDOFRUUHODWLRQVVKRZV WKH EHWWHU VHQVLWLYLW\ RI ':, UHODWLYH WR 7ZHLJKWHG LPDJLQJ IRU GHWHFWLQJ OLYHU PHWDVWDVHVHVSHFLDOO\WKRVHRIVPDOOVL]H % ,PSDFWRIFRQWUDVWHQKDQFHGLQWUDRSHUDWLYHXOWUDVRXQGRQRSHUDWLRQ VWUDWHJ\LQFDVHRIFRORUHFWDOOLYHUPHWDVWDVLV $6FKXO]-%'RUPDJHQ$'UROVXP%$%M¡UQEHWK.-/DERUL1(.ORZ 2VOR12DQVHOPVFKXO]#JPDLOFRP 3XUSRVH 7 R HYDOXDWH WKH FXUUHQW LPSDFW RI FRQWUDVWHQKDQFHG LQWUDRSHUDWLYH XOWUDVRXQG &(,286 RQ WKH LQLWLDO VXUJLFDO VWUDWHJ\ IRU UHVHFWLRQ RI FRORUHFWDO OLYHUPHWDVWDVLV&5/0 0HWKRGVDQG0DWHULDOV(LJKW\VL[FRQVHFXWLYHSDWLHQWVXQGHUJRLQJRSHQOLYHU UHVHFWLRQIRU&5/0ZHUHHYDOXDWHGUHWURVSHFWLYHO\RYHUD\HDUVSHULRG7KH SDWLHQWV XQGHUZHQW RSHUDWLRQV 3UHRSHUDWLYH VWDJLQJ ZDV SHUIRUPHG ZLWK FRQWUDVWHQKDQFHG&7DQG05,RIRSHUDWLRQV $FXVRQ6HTXRLDXOWUD VRXQGV\VWHPZDVXVHGLQDOOFDVHV&RQWUDVWDJHQWXVHGZDVPO6RQR9XH 7UDQVGXFHUVZHUHFXUYHGDUUD\&DQGOLQHDU/&(,286ZDVSHUIRUPHG LQ DOO SDWLHQWV ZLWK VWDQGDUGLVHG H[DPLQDWLRQ WHFKQLTXH &5/0 ZHUH LGHQWLÀHG LQYHQRXVSKDVHDVK\SRHFKRLFOHVLRQV&(,286ÀQGLQJVZHUHFRPSDUHGZLWK SUHRSHUDWLYHVWDJLQJ 5HVXOWV&RPELQHG&705,LGHQWLÀHGSUHRSHUDWLYH&5/06HYHQW\WZRDG GLWLRQDOOHVLRQVZHUHLGHQWLÀHGGXULQJWKHRSHUDWLRQ,QWUDRSHUDWLYHO\DGGLWLRQDO &5/0ZHUHLGHQWLÀHGE\LQVSHFWLRQSDOSDWLRQDQG&(,286DQGDQRWKHU &5/0ZHUHLGHQWLÀHGE\&(,286DORQH$OODGGLWLRQDO&5/0GHWHFWHG E\&(,286ZHUHFRQÀUPHGE\KLVWRORJ\&(,286FKDQJHGSODQQHGRSHUDWLRQ VWUDWHJ\ LQ RI RSHUDWLRQV$ ODUJHU UHVHFWLRQ ZDV QHFHVVDU\ LQ RI FDVHVUHGXFHGOLYHUUHVHFWLRQZDVIRXQGVXIÀFLHQWLQDQGDQGZDV IRXQG LQRSHUDEOH )RU SDWLHQWV GLDJQRVHG SUHRSHUDWLYHO\ VWDJHGVROLWDU\ OHVLRQV &(,286FKDQJHGRSHUDWLRQVWUDWHJ\LQ7KXVUDGLFDOWXPRXUUHVHFWLRQZRXOG KDYHIDLOHGLQZLWKRXW&(,286 &RQFOXVLRQ&(,286LVVWLOODQHVVHQWLDOWRROWRHQVXUHRSWLPDODQGFRPSOHWH WXPRXU UHVHFWLRQ ,Q FDVH RI D VROLWDU\ &5/0 WKH DGGLWLRQDO YDOXH RI &(,286 PLJKWEHGHEDWDEOH % 'LIIXVHGZHLJKWHG05,IRUTXDQWLÀFDWLRQRIOLYHUÀEURVLV -0$OXVWL]D -$UHQDV0$9RQ:LFKPDQQ$&DVWLHOOD-,(PSDUDQ]D (6DOYDGRU0*DUFLD%HQJRHFKHD(=DSDWD6DQ6HEDVWLDQ(6 0HQGDUR(6MPDOXVWL]D#RVDWHNHV 3XUSRVH7 RHYDOXDWHWKHDFFXUDF\RIGLIIXVHGZHLJKWHG':05,IRUDVVHVVLQJ WKHGLIIHUHQWVWDJHVRIOLYHUÀEURVLV 0HWKRGVDQG0DWHULDOVFRQVHFXWLYHSDWLHQWVVXIIHULQJGLIIHUHQWFKURQLFOLYHU GLVHDVHVZHUHVWXGLHGE\OLYHUELRSV\DQGE\05,3DWLHQWVZLWKGHFRPSHQVDWHG OLYHUGLVHDVHVZHUHH[FOXGHG'LIIXVLRQZHLJKWHG05,VHTXHQFHZDVSHUIRUPHG 6FLHQWLILF6HVVLRQ $ 6&'()*+%(XURSHDQ&RQJUHVVRI 5DGLRORJ\ )ULGD\ %0,YDOXHV3 DWEDVHOLQHZHUHDVVRFLDWHGZLWKDVLJQLÀFDQWGHFUHDVHRI PHDQDRUWLFOXPHQDUHDLLK\SHUWHQVLRQ3 ZDVDVVRFLDWHGZLWKDVLJQLÀ FDQWO\LQFUHDVHGUDWHRISURJUHVVLRQLQPHDQ&:9LLLPDOHJHQGHU3 ZDV DVVRFLDWHGZLWKDVLJQLÀFDQWO\LQFUHDVHGUDWHRISURJUHVVLRQLQPHDQ3)9DQGLY VPRNLQJ3 ZDVDVVRFLDWHGZLWKDVLJQLÀFDQWO\LQFUHDVHGUDWHRISURJUHV VLRQLQPHDQ7%5YDOXHV$OORWKHUGRFXPHQWHGULVNIDFWRUVZHUHQRWVLJQLÀFDQWO\ DVVRFLDWHGZLWKFKDQJHVLQDWKHURVFOHURWLFGLVHDVHSURJUHVVLRQ &RQFOXVLRQ$WKHURVFOHURWLF GLVHDVH SURJUHVVLRQ DV DVVHVVHG E\ ZKROH ERG\ )'*3(7&7 LVDVVRFLDWHGZLWKDQXPEHURIIDFWRUVVXFKDVDUWHULDO)'*XSWDNH KLJK%0,K\SHUWHQVLRQPDOHJHQGHUDQGVPRNLQJ % 'LDJQRVLVRIODUJHYHVVHOYDVFXOLWLVZLWK))'*3(7&7 VLQJOH FHQWUHH[SHULHQFHRQSDWLHQWV 85R]]DQLJR$3HOOHJULQ0&HQWRQ]H*&DVDJUDQGD0&HWUXOR ''RQQHU7UHQWR,7DQGUHDSHOOHJULQ#DSVVWQLW 3XUSRVH7KLVLVDUHWURVSHFWLYHVWXG\WKDWDLPVWRDVVHVVWKHGLDJQRVWLFSHUIRUP DQFHRI))'*3(7&7LQODUJHYHVVHOYDVFXOLWLV/99FRPSDULQJIRXUGLIIHUHQW VWDQGDUGVRILPDJHHYDOXDWLRQDQGWDNLQJLQWRDFFRXQWFRQFRPLWDQWLPPXQRVXS SUHVVLYHWKHUDS\ 0HWKRGV DQG 0DWHULDOV &RQVHFXWLYH SDWLHQWV Q PDOH IHPDOH PHDQDJH\RUDQJH\RVHQWZLWKFOLQLFDOVXVSLFLRQRI/99ZLWKDWOHDVW V\PSWRPVDPRQJIHYHUZHLJKWORVVDUWKUDOJLDP\DOJLDXQGHUZHQW))'*3(7 &7H[DPLQDWLRQ$WWKHPRPHQWRI3(7&7VFDQRQSDWLHQWVZHUHXQGHU LPPXQRVXSSUHVVLYHWKHUDS\)LQDOGLDJQRVLVRI/99ZDVREWDLQHGRQFOLQLFDOFRQ VHQVXVLQRISDWLHQWV)RXUW\SHVRIDQDO\VLVZHUHXVHGDQGFRPSDUHGZLWK 0F1HPDUWHVWVHPLTXDQWLWDWLYHPD[LPDOVWDQGDUGLVHGXSWDNHYDOXH689PD[ TXDOLWDWLYHHYDOXDWLRQRQPD[LPXPLQWHQVLW\SURMHFWLRQ0,3LPDJHVZLWKD IRXUJUDGHVFDOHWRUHSHDWHGZLWKWZRGLIIHUHQWFXWRIIVTXDOLWDWLYHHYDOXD WLRQZLWKFROOHJLDOFOLQLFRUDGLRORJLFDOFRUUHODWLRQFRQVLGHULQJFRQFXUUHQWYDVFXODU SDWKRORJ\IRFDOGLVWULEXWLRQDJHFDUGLRYDVFXODUULVNIDFWRUV 5HVXOWV 4XDQWLWDWLYH DQDO\VLV ZLWK 689PD[ FXWRII YDOXH VHQV VSHF DFF GLG QRW VKRZ VWDWLVWLFDO VLJQLÀFDQW GLIIHUHQFHV FRP SDUHGWRVHPLTXDQWLWDWLYHHYDOXDWLRQZLWKKLJKHUFXWRIIJUDGHVHQV VSHF DFF 6HPLTXDQWLWDWLYH DQDO\VLV ZLWK ORZHUFXWRII JUDGH KDGVXSHULRUVHQVLWLYLW\EXWUHGXFHGVSHFLÀFLW\VHQVVSHF DFF (YDOXDWLRQ ZLWK FROOHJLDO FOLQLFRUDGLRORJLFDO FRUUHODWLRQ VKRZHG LQFUHDVHVSHFLÀFLW\ZLWKRXWDGHFUHDVHLQVHQVLELOLW\VHQVVSHF DFF &RQFOXVLRQ,QWHUSUHWDWLRQRI))'*3(7&7H[DPVLQ/99QHHGVWREHEDVHG RQHIÀFLHQWLQWHJUDWLRQRIFOLQLFRUDGLRORJLFDOGDWDFXVWRPLVHGIRUHDFKSDWLHQW % &RQWUDVWHQKDQFHGPDJQHWLFUHVRQDQFHDQJLRJUDSK\LQ PDQDJHPHQWRISXOPRQDU\DUWHULRYHQRXVPDOIRUPDWLRQVLQSDWLHQWV ZLWK++72VOHUGLVHDVH *.6FKQHLGHU$0DVVPDQQ$%XHFNHU3 )ULHV +RPEXUJDG6DDU'(GUJXHQWKHUVFKQHLGHU#XNVHX 3XUSRVH7 RHYDOXDWHFRQWUDVWHQKDQFHGPDJQHWLFUHVRQDQFHDQJLRJUDSK\&( 05$ IRU PDQDJHPHQW RI SXOPRQDU\ DUWHULRYHQRXV PDOIRUPDWLRQV 3$90 LQ SDWLHQWVZLWKKHUHGLWDU\KDHPRUUKDJLFWHODQJLHFWDVLD++7DVZHOODVDVFUHHQLQJ SURFHGXUHIRUWKHGHWHFWLRQDQGIRUIROORZXSDIWHUHPEROLVDWLRQWKHUDS\ 0HWKRGVDQG0DWHULDOVSDWLHQWVPHDQDJH\PDOHIHPDOH ZLWKFRQÀUPHG++7RUWKHLUÀUVWGHJUHHUHODWLYHVXQGHUZHQWVFUHHQLQJSXOPRQDU\ &(05$*DGROLQLXP%237$PPRONJERG\ZHLJKWIRUWKHSUHVHQFHRI3$90 3DWLHQWVZLWKDWOHDVWRQH3$90!PPRUDIHHGLQJSXOPRQDU\DUWHU\GLDPHWHU !PPZHUHUHIHUUHGIRUFDWKHWHUDQJLRJUDSK\'6$IRUHPEROLVDWLRQWKHUDS\DQG XQGHUZHQWIROORZXS05$IRUGHWHFWLRQRIUHSHUIXVHG3$90V 5HVXOWV2YHUDOO&(05$GHWHFWHG3$90LQRISDWLHQWVLQ PHQLQZRPHQLQZRPHQRIFKLOGEHDULQJDJH0RVW3$90VGHWHFWHG RQ&(05$ZHUHVPDOOPPRISDWLHQWVZLWK3$90VGHWHFWHGRQ &(05$XQGHUZHQWJOREDORUVHOHFWLYH'6$6LJQLÀFDQWO\SIHZHU3$90V >@ZHUHGHPRQVWUDWHGRQJOREDO'6$RIZKLFKZHUHHPEROLVHG )ROORZXS &(05$ VKRZHG QHZO\ GHYHORSHG 3$90 LQ SDWLHQWVLQWHUYDO \HDUVDQGUHSHUIXVHG3$90GXHWRUHFDQDOLVDWLRQLQVXIÀFLHQWSDFNLQJLQ SDWLHQWVLQWHUYDOPRQWKV\HDUVRIZKLFKSDWLHQWVZHUHHPEROLVHGHOVH ZKHUH $OOUHSHUIXVHG3$90VZHUHFRQÀUPHGE\'6$DQGUHHPEROLVHGVXFFHVVIXOO\ &RQFOXVLRQ &(05$ VKRXOG EH WKH PHWKRG RI FKRLFH IRU WKH PDQDJHPHQW RI 3$90VLQ++7SDWLHQWV'XHWRWKHKLJKVHQVLWLYLW\DQGWKHODFNRILRQLVLQJUDGLDWLRQ 05VKRXOGEHSUHIHUUHGWR&7LIDYDLODEOH ,QRSSRVHGSKDVH05&3 'DQG')/$6+7 RWDOH[DPLQDWLRQWLPHZDV UHFRUGHG&KLVTXDUHWHVWDQG8WHVWZHUHXVHGIRUVWDWLVWLFDODQDO\VLV 5HVXOWV 7KH PHDQ LPDJH TXDOLW\ IRU WKH DXWRPDWHG SURFHVVHG H[DPLQDWLRQV ZDV UDWHG KLJKHU IRU DOO FDWHJRULHV DQG VKRZHG VWDWLVWLFDO VLJQLÀFDQW GLIIHUHQFH LQ DVVHVVPHQW RI LPDJH FRQWUDVW PHDQDXWRPDWHG YV PHDQPDQXDO DQG SUHVHQWDWLRQRIWDUJHWRUJDQPHDQDXWRPDWHGYVPHDQPDQXDO S 7KHGLDJQRVWLFFRQÀGHQFHZDVSUHVSHFWLYHO\0HDQH[DPLQDWLRQ WLPHZDVPLQLQWKHDXWRPDWLFDOO\DQGPLQLQWKHPDQXDOO\SURFHVVHG H[DPLQDWLRQV &RQFOXVLRQ7KHFRPSOHWHO\DXWRPDWHG05VFDQQHUXVHULQWHUIDFHVKRZVDQLQ FUHDVHLQLPDJHTXDOLW\DQGGLDJQRVWLFFRQÀGHQFH7KHH[DPLQDWLRQWLPHZDVKLJKHU LQWKHDXWRPDWLFDOO\SURFHVVHGH[DPLQDWLRQGXHWRORQJHUODVWLQJ05VHTXHQFHV % $OYHRODUHFKLQRFRFFRVLVRIWKHOLYHUGLIIXVLRQZHLJKWHG05LPDJLQJ ÀQGLQJV $3RPRQL66FKPLGW(8OGU\1+DONLF$'HQ\V50HXOL) %HFFH /DXVDQQH&+QSRPRQL#KRWPDLOFRP 3XUSRVH7 RUHSRUWWKHGLIIXVLRQZHLJKWHG05LPDJLQJ':,ÀQGLQJVLQKHSDWLF DOYHRODU HFKLQRFRFFRVLV $( 7 R HYDOXDWH WKH XVHIXOQHVV RI DSSDUHQW GLIIXVLRQ FRHIÀFLHQWV $'&V IRU GLIIHUHQWLDWLQJ WKH W\SHV RI$( OHVLRQV DV UHSRUWHG E\ .RGDPD5DGLRORJ\ 0HWKRGV DQG 0DWHULDOV :H UHWURVSHFWLYHO\ LQFOXGHG SDWLHQWV ZRPHQ PHDQDJH\HDUVZLWK $(OLYHUOHVLRQV!FPWKDWKDGEHHQLQYHVWLJDWHG E\ 7 HVOD 05 LPDJLQJ EHWZHHQ 0DUFK DQG$XJXVW SHUIRUPLQJ RXU VWDQGDUGSURWRFROLQFOXGLQJ':,EYDOXHVDQGVPP,QFRQVHQVXV WZR UDGLRORJLVWV DVVHVVHG OHVLRQ FKDUDFWHULVWLFV VXFK DV GLDPHWHU F\VWLF DQG RUÀEURWLFFRPSRQHQWVLQFOXGLQJ.RGDPDFODVVLÀFDWLRQVLJQDOLQWHQVLW\FRQWUDVW HQKDQFHPHQWFDOFLÀFDWLRQVRQ&7DQGPHDVXUHGWKH$'&RIHDFKOHVLRQ$( ZDVFRQÀUPHGE\VHURORJ\ELRSV\DQGRUVXUJHU\LQDOOSDWLHQWV 5HVXOWV6HYHQWHHQOHVLRQVRI.RGDPDW\SHRIW\SHRIW\SHRIW\SH DQGRIW\SHZHUHIRXQG0HDQ6' $'&RIDOO $(OHVLRQVZDVð PPV0HDQ6' $'&VRI.RGDPDW\SHDQGOHVLRQVZHUH DQGðPPVUHVSHFWLYHO\1RVLJQLÀFDQW GLIIHUHQFHZDVQRWHGEHWZHHQWKHGLIIHUHQW.RGDPDW\SHVS 3UHVHQFHRI ÀEURWLFS DQGRUFDOFLÀHGS FRPSRQHQWVRUFRQWUDVWHQKDQFHPHQW S RI$(OHVLRQVZHUHQRWFRUUHODWHGZLWKVLJQLÀFDQWGLIIHUHQFHVLQ$'&V &RQFOXVLRQ$'&VRI$(OHVLRQVDUHUHODWLYHO\ORZFRPSDUHGWRRWKHUF\VWLFOLYHU OHVLRQV ZKLFK LV KHOSIXO LQ VXJJHVWLQJ WKH GLDJQRVLV +RZHYHU$'&V ZHUH QRW IRXQGWREHXVHIXOIRUGLIIHUHQWLDWLQJ.RGDPDW\SHVRI$(OHVLRQV 5RRP12 9DVFXODU 66 ,PDJLQJLQYDVFXODUGLVHDVHV 0RGHUDWRUV +.$KOVWU|P8SSVDOD6( 23HOOHULQ3DULV)5 % ,PSDFWRIFDUGLRYDVFXODUULVNIDFWRUVDQGYHVVHOZDOOLQÁDPPDWLRQ RQDWKHURVFOHURWLFGLVHDVHSURJUHVVLRQD3(7&7VWXG\ 7 6DDP$5RPLQJHU0+DEV/:DOWHU3 %DUWHQVWHLQ&5LVW0) 5HLVHU 0+DFNHU.1LNRODRX0XQLFK'(7 RELDV6DDP#PHGXQLPXHQFKHQGH 3XUSRVH:HK\SRWKHVLVHGWKDWDWKHURVFOHURWLFULVNIDFWRUVDQGYHVVHOZDOOLQÁDP PDWLRQDUHDVVRFLDWHGZLWKDQDFFHOHUDWHGSURJUHVVLRQRIDWKHURVFOHURWLFGLVHDVH DVDVVHVVHGE\>)@ÁXRURGHR[\JOXFRVH)'*3(7&7 0HWKRGV DQG 0DWHULDOV WXPRXU SDWLHQWV XQGHUZHQW ZKROH ERG\ )'*3(7 DQGFRQWUDVWHQKDQFHG&7WZLFHZLWKLQPRQWKV&OLQLFDOULVNIDFWRUVIRUDWKHUR VFOHURVLVDQGPHGLFDWLRQVZHUHGRFXPHQWHG%ORRGSRROFRUUHFWHGVWDQGDUGLVHG XSWDNHYDOXH7%5DQGFDOFLÀHGZDOOYROXPH&:9ZHUHPHDVXUHGLQWKHDRUWD DQGERWKLOLDFDQGFDURWLGDUWHULHV)XUWKHUPRUHSHULFDUGLDOIDWYROXPH3)9DQG PHDQDRUWLFOXPHQDUHDLQWKHWKRUDFLFDRUWDZHUHPHDVXUHG7KHRQHVDPSOHWWHVW DQGPXOWLSOHUHJUHVVLRQDQDO\VLVZHUHXVHGIRUVWDWLVWLFDOFRPSDULVRQV 5HVXOWV2QDYHUDJHDRUWLFOXPHQDUHDGHFUHDVHGE\\HDU3 3)9 LQFUHDVHGE\\HDU3 DQG&:9LQFUHDVHGE\\HDU3 7%5YDOXHVGLGQRWFKDQJHVLJQLÀFDQWO\ZLWKLQPRQWKV\HDU0XOWLSOH UHJUHVVLRQDQDO\VLVGHPRQVWUDWHGWKDWLKLJKHU7%5YDOXHV3 DQGKLJKHU 6FLHQWLILF6HVVLRQ 6 &$' ( ) *+% (XURSHDQ&RQJUHVVRI 5DGLRORJ\ &RQFOXVLRQ:HREVHUYHGDVLJQLÀFDQWFRUUHODWLRQ3EHWZHHQWKHSUHV HQFHRIVWHQRVLVRI&$DQGWKHGHYHORSPHQWRI3)WKDWLVDPDMRUFRPSOLFDWLRQRI SDQFUHDWLFRGXRGHQHFWRP\DQGLVUHODWHGWRDPRUWDOLW\UDWHRI$VWHQRVLV RI&$LVHDVLO\WUHDWHGGXULQJWKHVXUJHU\DQGPXVWEHWKHUHIRUHLQFOXGHGLQWKH UHSRUWRIWKHSUHVXUJHU\&7H[DP % 9DVFXODUDQRPDOLHVLQDSRSXODWLRQZLWK7XUQHUV\QGURPHUHDO DGMXQFWLYHGLDJQRVWLFUROHDQGFOLQLFDOLPSDFWRIPDJQHWLFUHVRQDQFH DQJLRJUDSK\05$YVHFKRFDUGLRJUDSK\(&+2 *5LQDOGL*0LQHR) 0RQWDQDUL/0D]]DQWL'3UDQGVWUDOOHU95XVVR ) %XLD//RYDWR0=RPSDWRUL%RORJQD,7 3XUSRVH 7XUQHU V\QGURPH 76 LV DVVRFLDWHG ZLWK FRQJHQLWDO KHDUW GLVHDVHV &+'DRUWLFGLODWLRQDQGGLVVHFWLRQEXWDOVRZLWKDKLJKSUHYDOHQFHRIYDVFXODU DQRPDOLHV QRW HDVLO\ GHSLFWHG E\ (&+2 :H WHVWHG WKH DGMXQFWLYH GLDJQRVWLF YDOXHRI05YHUVXV(&+2WRLGHQWLI\WKHSUHYDOHQFHRIYDVFXODUDQRPDOLHVLQD76 SRSXODWLRQHFKRFDUGLRJUDSKLFDOO\SUHVHOHFWHGIRUWKHDEVHQFHRI&+'H[FHSWLQJ ELFXVSLGDRUWLFYDOYH%$9 0HWKRGV DQG 0DWHULDOV 5HWURVSHFWLYH DQDO\VLV RI 05 DRUWLF VWXG\ RI 76 SDWLHQWVZDVSHUIRUPHGWRHYDOXDWHPLQRUDQGPDMRUYDVFXODUDQRPDOLHV$OO05 VWXGLHV LQFOXGHG WKRUDFLF D[LDO DQG REOLTXH VDJLWWDO VSLQHFKRVHTXHQFHV DQG WKRUDFRDEGRPLQDO05$ 5HVXOWV05VKRZHGYDVFXODUDQRPDOLHVLQSDWLHQWVWKHPRVWIUHTXHQW LVDRUWLFDUFKHORQJDWLRQSDWLHQWV $PRQJPDMRUDQRPDOLHVPLVGLDJQRVHG E\(&+205DQDO\VLVLGHQWLÀHGSDUWLDODQRPDORXVSXOPRQDU\YHQRXVUHWXUQV 3$395LQIHULRUKROORZYHLQLQWHUUXSWLRQSHULSKHUDODUWHULHVDQHXU\VPV 7KHVXEJURXSZLWK%$9SDWLHQWVVKRZVKLJKHUSUHYDOHQFHRIPDOIRUPD WLRQVSH[SHFLDOO\HORQJDWLRQDQG3$395 $PRQJSDWLHQWVQRW DIIHFWHGE\%$9FRPSDUDWLYHDQDO\VLVEHWZHHQJURXSVZLWKDQGZLWKRXWYDVFXODU PDOIRUPDWLRQV3$395H[FOXGHGVKRZHGKLJKHUDRUWLFGLODWLRQSUHYDOHQFHLQWKH PDOIRUPDWLRQJURXSS05DQDO\VLVLGHQWLÀHG3$395QRWUHSRUWHGDW ÀUVWHYDOXDWLRQ &RQFOXVLRQ05KDVDQDGMXQFWLYHGLDJQRVWLFSRZHUYHUVXV(&+2LGHQWLI\LQJ VHYHUDOYDVFXODUPDOIRUPDWLRQVRWKHUZLVHPLVGLDJQRVHGDQGDSRWHQWLDOFOLQLFDO LPSDFWRQ76QDWXUDOKLVWRU\05$PXVWDOZD\VEHSHUIRUPHGLQ76WRLQWHJUDWH (&+2VWXG\05HYDOXDWLRQH[SHFLDOO\LQ%$9SDWLHQWVPXVWEHH[WHQGHGWRDOO WKHWKRUDFLFYDVFXODWXUH % 'UHFRQVWUXFWHGFRQWUDVWHQKDQFHG05DQJLRJUDSK\7HVODYV 7HVODLQGHWHFWLRQRIWKHGLIIHUHQWEUDQFKHVRIWKHLQWHUQDOLOLDFDUWHU\ LQIHPDOHVVFKHGXOHGIRUXWHULQHDUWHU\HPEROLVDWLRQ 1111DJXLE1($1RXU(OGLQ7 /HKQHUW7 *UXEHU5RXK0+DUWK 7 -9RJO)UDQNIXUWD0DLQ'(QDJ\QQQ#\DKRRFRP 3XUSRVH7 RFRPSDUHWKHDELOLW\RIWKH7 HVOD705,YHUVXVWKH7 HVOD 705,LQGHWHFWLQJWKHGLIIHUHQWEUDQFKHVRIWKHLQWHUQDOLOLDFDUWHU\,,$EHIRUH 8$(XVLQJ'UHFRQVWUXFWHGFRQWUDVWHQKDQFHG05DQJLRJUDSK\&(05$ 0HWKRGV DQG 0DWHULDOV 3UHHPEROLVDWLRQ &(05$ IURP IHPDOHV PHDQ DJH\HDUVZHUHUHWURVSHFWLYHO\HYDOXDWHGE\UDGLRORJLVWVLQFRQVHQVXV 6WXGLHVZHUHGRQHXVLQJD7Q ,,$DQG7Q ,,$05,DQG 'LPDJHV ZHUH UHFRQVWUXFWHG XVLQJ 6\QJR9HVVHO9LHZ$ VFRULQJV\VWHP RI *UDGHVZDVXVHGVFRUHPHDQVWKDWWKHDUWHU\ZDVQRWVHHQLQWHUUXSWHGRULWV RULJLQZDVQRWLGHQWLÀHGVFRUHPHDQVWKDWWKHDUWHU\ZDVIDLQWO\VHHQEXWFDQ EHWUDFHGZLWKQRPLVVLQJVHJPHQWVWLOOLWJLYHVRIILWVÀUVWEUDQFKVFRUHPHDQV WKDWWKHDUWHU\ZDVFOHDUO\VHHQ'LIIHUHQFHVEHWZHHQERWKV\VWHPVZHUHWHVWHG XVLQJ0DQWHO+DHQVHO7 HVW 5HVXOWV7KHVXSHULRUJOXWHDODUWHU\ZDVGHWHFWHGLQWKH7LQDUWHULHVVHQ VLWLYLW\6 LQWKH7LQDUWHULHV6 QRVWDWLVWLFDOO\VLJQLÀFDQWGLIIHUHQFH ZDV QRWHG EHWZHHQ ERWK V\VWHPV S ,QIHULRUJOXWHDO 7 Q 6 7 Q 6 QR GLIIHUHQFH S ,QWHUQDOSXGHQGDO 7 Q 6 7 Q 6 QR GLIIHUHQFH S 0LGGOHUHFWDO 7 Q 6 7 Q 6 QR GLIIHUHQFH S ,OLROXPEDU 7 Q 6 7 Q 6 VLJQLILFDQW GLIIHUHQFH QRWHG S /DWHUDOVDFUDO 7 Q 6 7 Q 6 VLJQLÀFDQW GLIIHUHQFH QRWHG S 8WHULQH7Q 6 7Q 6 VLJQLÀFDQWGLIIHUHQFHQRWHGS 2EWXUDWRU 7 Q 6 7 Q 6 VLJQLÀFDQW GLIIHUHQFH QRWHG S 6XSHULRUYHVLFDO7Q 6 7Q 6 VLJQLÀFDQW GLIIHUHQFHQRWHGS &RQFOXVLRQ7KH7ZDVVXSHULRUWRWKH7LQGHWHFWLQJDOO,,$EUDQFKHVH[FHSW WKHLQWHUQDOSXGHQGDOPLGGOHUHFWDOVXSHULRUDQGLQIHULRUJOXWHDODUWHULHVLQZKLFK ERWKV\VWHPVVKRZHGVLPLODUSHUIRUPDQFH % (YDOXDWLRQRIDFXWHSXOPRQDU\HPEROLVPGHWHFWLRQXVLQJQRQOLQHDU EOHQGLQJLQGXDOHQHUJ\FRPSXWHGWRPRJUDSK\ ) $O%XWPHK/.URNHU-0.HUO0&/DUVRQ%%RGHOOH%6FKHOO0%HHUHV 7 -9RJO5:%DXHU)UDQNIXUWD0DLQ'()LUDV$OEXWPHK#JPDLOFRP 3XUSRVH7 RFRPSDUHQRQOLQHDUEOHQGLQJZLWKVWDQGDUGOLQHDUEOHQGLQJYLUWXDO N9DQGORZN9LPDJHVRIGXDOHQHUJ\&7SXOPRQDU\DQJLRJUDSK\IRULPSURYHG GLDJQRVWLFLPDJHTXDOLW\ 0HWKRGVDQG0DWHULDOV:HFRPSDUHGGXDOHQHUJ\&7GDWDVHWVRIFHQWUDODQG SHULSKHUDODFXWHSXOPRQDU\HPEROLVP$QRQOLQHDUEOHQGLQJPHWKRGEDVHGRQD PRGLÀHGVLJPRLGIXQFWLRQZDVFRPSDUHGZLWKWKHORZN9LPDJHVHULHVDQGWKH VWDQGDUGOLQHDUEOHQGLQJPHWKRGWKDWVLPXODWHVWKHDWWHQXDWLRQRIDN9VFDQ )RUWKHQRQOLQHDUEOHQGLQJPHWKRGZHHYDOXDWHGGLIIHUHQWSDUDPHWHUVHWWLQJV ZLWKGLIIHUHQWEOHQGLQJFHQWUHDQGZLGWK&RQWUDVWWRQRLVHUDWLR&15ZDVFDOFX ODWHG7ZRLQGHSHQGHQWUDGLRORJLVWVHYDOXDWHGWKHWRWDOO\LPDJHVHWVIRUWKHLU YLVXDOSUHIHUHQFH2YHUDOOVXEMHFWLYHLPDJHTXDOLW\ZDVUDWHGZLWKDSRLQWVFDOH H[FHOOHQWLPDJH QRQGLDJQRVWLF 5HVXOWV:LWKHLWKHURQHRIWKHQRQOLQHDUEOHQGLQJVHWWLQJVWKH&15ZDVVLJQLÀ FDQWO\KLJKHUFRPSDUHGZLWKWKHORZN9&15 DQGVXEMHFWLYH RYHUDOOLPDJHTXDOLW\DQGOLQHDUEOHQGLQJVHULHV&15 DQG VXEMHFWLYHRYHUDOOLPDJHTXDOLW\7KHRSWLPDOEOHQGLQJFHQWUHDQGZLGWKIRUKLJKHVW &15 &15 DQG VXEMHFWLYH RYHUDOO LPDJH TXDOLW\ UHVXOWV VWURQJO\GHSHQGHGRQWKHOHYHORIFRQWUDVWHQKDQFHPHQWLQWKHSXOPRQDU\DUWHULHV +RZHYHURQVXEMHFWLYHLPDJHTXDOLW\UDWLQJWKHLPDJHVHULHVZLWKWKHKLJKHVW&15 ZDVUDWHGLQRIFDVHVDVWKHEHVWLQWHUPVRIRSWLPDOLPDJHTXDOLW\ &RQFOXVLRQ1RQOLQHDUEOHQGLQJRIGXDOHQHUJ\SXOPRQDU\FRPSXWHGWRPRJUDSK\ DOORZVVLJQLÀFDQWLQFUHDVHRI&15DQGLPDJHTXDOLW\ % ,PDJLQJÀQGLQJVLQDUWHULDOVWHQRVLVDQGPXUDOLQYROYHPHQWLQ 7DND\DVXDUWHULWLVRQ&(05$ $.66KDUPD1RLGD,1VKRNLH #KRWPDLOFRP 3XUSRVH 7 R DVVHVV YHVVHO LQYROYHPHQW DQG DFWLYLW\ RI 7 DND\DVX DUWHULWLV ZLWK ZKROHERG\05$ 0HWKRGVDQG0DWHULDOVSDWLHQWVZLWKGLDJQRVLVRI7$ZHUHVXEMHFWHGWRZKROH ERG\05$ZLWK*DGROLQLXPGLPHJOXPLQH$FFRUGLQJWRYDVFXOLWLVDFWLYLW\VFRUH SDWLHQWV ZHUH FODVVLÀHG DV KDYLQJ DFWLYHSHUVLVWHQW GLVHDVH DQG S D W L H Q W V D V KDYLQJUHPLVVLYHGLVHDVH7KHDUWHULDOV\VWHPZDVGLYLGHGLQWRVHJPHQWVRI UHJLRQV7KHLPDJHTXDOLW\ZDOOWKLFNQHVVDQGZDOOVLJQDOLQWHQVLW\ZHUHHYDOXDWHG E\ WKUHH UDGLRORJLVWV ZKR ZHUH QRW NQRZLQJ FOLQLFDO GDWD 4XDOLW\ DQDO\VLV ZDV SHUIRUPHG VWDWLVWLFDOO\ VLJQLÀFDQW GLIIHUHQFHV LQ 6, YDOXHV RI$' DQG 5' ZHUH WHVWHGRQDSHUUHJLRQEDVLV 5HVXOWV$WRWDODUWHLDOVHJPHQWVZLWKJRRGWRH[FHOOHQWLPDJHTXDOLW\ZHUH DVVHVVHGH[WUDYDVFXODUPDQLIHVWDWLRQZHUHLGHQWLÀHG,QSDWLHQWVPRQRVWDWLRQ FRXOGQRWGHSLFWYHVVHOLQYROYHPHQW7KHYHVVHOZDOOWKLFNQHVVRIWKH$'JURXS ZDVWKLFNHUWKDQWKDWRI5'JURXS3RVWFRQWUDVW6,UDWLRZDVVLJQLÀFDQWO\GLIIHUHQW IRUERWKWKHJURXSV3HUUHJLRQDQDO\VLVUHYHDOHGKLJKHUVLJQDOLQWHQVLW\LQFDURWLG DQGVXEFODYLDQUHJLRQVLQERWKJURXSV &RQFOXVLRQ:KROHERG\05$DOORZVDFRPSOHWHDQGFRPSKUHQVLYHGRFXPHQWDWLRQ RIWKHYHVVHOLQYROYHPHQW05$LVYHU\XVHIXOPRGDOLW\IRU7 DND\DVXDUWHULWLVVWDJLQJ ZKHWKHUGLVHDVHLVDFWLYHRUQRWDQGLVDOVRLQIROORZXSIRUWKHUDS\PDQDJHPHQW % 8VHIXOQHVVRI&7DQJLRJUDSK\RIFHOLDFD[LVSULRUWRSDQFUHDWLFR GXRGHQHFWRP\ 0%HOJUDQR%3HWURQLR:7 RVFDQR0$&RYD7ULHVWH,7 EHOJUDQRP#OLEHURLW 3XUSRVH7 RSHUIRUPD&7DQJLRJUDSK\RIWKHFHOLDFD[LV&$WRGHWHFWWKHSUHV HQFHRIVWHQRVLVGXHWRDWKHURVFOHURVLV$6RUWRWKHPHGLDQDUFXDWHOLJDPHQW 0$/DQGWRFRUUHODWHLWZLWKWKHSUHYDOHQFHRIFRPSOLFDWLRQDIWHUVXUJHU\ 0HWKRGVDQG0DWHULDOV:HUHYLVHGUHWURVSHFWLYHO\SDWLHQWVZKRXQGHUZHQW WRSDQFUHDWLFRGXRGHQHFWRP\EHWZHHQDQGLQWKH6XUJHU\'HSDUWPHQW RIRXU,QVWLWXWLRQ(DFKSDWLHQWXQGHUZHQWWRD&7DQJLRJUDSK\ZLWKLQGD\V EHIRUHWKHVXUJHU\ZLWKDVOLFH[PPVOLFHVVFDQQHUDIWHUDGPLQLVWUD WLRQRIPORILRGLQDWHGFRQWUDVWPHGLDWRGHWHFWWKHSUHVHQFHRIVWHQRVLVRI&$ !RIOXPHQUHGXFWLRQ7KHSUHYDOHQFHRISDQFUHDWLFÀVWXOD3)ZDVFROOHFWHG IURPWKH3DWLHQW VFOLQLFDOKLVWRU\ 5HVXOWV 2I WKH SDWLHQWV LQFOXGHG SUHVHQWHG D &$ VWHQRVLV GXH WR 0$/GXHWR$6$IWHUWKHVXUJHU\SDWLHQWVGHYHORSHGD3)RIWKLVJURXS SUHVHQWHGDVWHQRVLVRI&$ 6FLHQWLILF6HVVLRQ $ 6&'()*+%(XURSHDQ&RQJUHVVRI 5DGLRORJ\ )ULGD\ 5RRP3 3K\VLFVLQ5DGLRORJ\ 66 ,QWHUYHQWLRQDOUDGLRORJ\DQGPDPPRJUDSK\ 0RGHUDWRUV ($WDODU$QNDUD75 <.\ULDNRX)RUFKKHLP'( % 'HYHORSPHQWRILQKRVSLWDO[UD\UDGLRJUDSKLFV\VWHPXVLQJURWDWLQJ FHULXPDQRGHIRUFRURQDU\DQGFHUHEUDOPLFURDQJLRJUDSK\ +0RUL&7 DQDND< ,NH\D7 )XMLL7 6KL]XPD1)XNX\DPD,VHKDUD-3 3XUSRVH$VFRQYHQWLRQDODQJLRJUDSK\FDQQRWYLVXDOLVHVPDOODUWHULHVZLWKDGL DPHWHURIѥPZHGHYHORSHGDQLQKRVSLWDOPLFURDQJLRJUDSKLFV\VWHPDQG HYDOXDWHGLWVSHUIRUPDQFHVLQEDVLFH[SHULPHQWV 0HWKRGVDQG0DWHULDOV7KHPLFURDQJLRJUDSKLFV\VWHPFRQVLVWVRIDURWDWLQJFH ULXPDQRGHDQGDODUJHKHDWXQLW0+8[UD\JHQHUDWRU7KHTXDVLPRQRFKURPDWLF [UD\VSHFWUDKDVDSHDNDW.H9DQGKDYHDQDUURZHQHUJ\EDQGRI.H9 LQKDOIPD[LPXPZKLFKFDQHIÀFLHQWO\GHWHFWVPDOODPRXQWRILRGLQHFRQWUDVWLQ VPDOOYHVVHO7KHKLJK[UD\SKRWRQÁX[JHQHUDWHGE\0+8JHQHUDWRUDOORZVWR PDLQWDLQHQRXJKSKRWRQQXPEHUDWWKHVXUIDFHRIDÁDWSDQHOGHWHFWRURIVSDWLDO UHVROXWLRQRIѥPHYHQDIWHUSDVVLQJWKURXJKWKHDGXOWERG\&DQLQHKHDUWDQG EUDLQRIZKLFKDUWHULDOEHGVDUHÀOOHGZLWKLRGLQHFRQWDLQLQJPLFURVSKHUHVZLWKD GLDPHWHURIѥPZDVXVHGDVWKHWHVWVDPSOHV 5HVXOWV7KHDQJLRJUDSKLFV\VWHPYLVXDOLVHGLQWUDPXUDOVPDOOFRURQDU\DUWHULHV HQWLUHO\ IURP WKHLU HSLFDUGLDO RULJLQ WR VXEHQGRFDUGLDO WHUPLQDO SRUWLRQV LQ WKH H[FLVHGKHDUWDQGWKHSHUIRUDWLQJEUDQFKHVRIFHUHEUDODUWHULHVDULVLQJIURPWKH PLGGOHFHUHEUDODUWHULHVDQGUHDFKLQJWRWKHGHHSVXEFRUWLFDOOHVLRQVLQWKHEUDLQ PRGHO 9DVFXODU GLDPHWHU PHDVXUHPHQW UHYHDOHG D VWHSZLVH QDUURZLQJ ZLWK D À[HGUHGXFWLRQUDWLRDVEUDQFKLQJLQWKHUDQJHRIѥP &RQFOXVLRQ 7KH SUHVHQW DQJLRJUDSKLF V\VWHP ZLOO OHDG WR EHWWHU SUHGLFWLRQR I WKHUDSHXWLFHIIHFWVRISHUFXWDQHRXVFRURQDU\LQWHUYHQWLRQDQGRUFRURQDU\E\SDVV VXUJHU\ DQG EHWWHU XQGHUVWDQGLQJ RI FHUHEUDO ZKLWH PDWWHU GLVHDVH UHODWHG WR YDVFXODUFRJQLWLYHLPSDLUPHQWLQFOLQLFDOVHWWLQJV % '*XLGDQFHLQLQWHUYHQWLRQDOUDGLRORJ\SURWRW\SHGHYHORSPHQWDQG IHDVLELOLW\VWXG\ -.XQW] 66DZDOO06RFKHU:6HPPOHU0.DFKHOULHVV6%DUWOLQJ +HLGHOEHUJ'((UODQJHQ'(VEDUWOLQJ#GNI]GH 3XUSRVH7 RDOORZIRUYROXPHWULF'WLPHUDGLRORJLFDOJXLGDQFHRILQWHUYHQWLRQV DW WKH VDPH ORZ GRVH OHYHOV DV FRQYHQWLRQDO SURMHFWLRQ ÁXRURVFRS\ 'WLPH JXLGDQFH 0HWKRGV DQG 0DWHULDO 7 RGD\ UDGLRORJLFDO JXLGDQFH RI LQWHUYHQWLRQV LV OLPLWHG WR SURMHFWLRQ ÁXRURVFRS\ DQG UHSHWLWLYH IXOOGRVH YROXPHWULF &7 VFDQV7KH XVH RI FRQWLQXRXV &7 LPDJLQJ DOORZLQJ WUXH ' LQWHUYHQWLRQ JXLGDQFH VXIIHUV IURP SURKLELWLYHUDGLDWLRQGRVH7 RUHGXFHLWVGRVHWRDFFHSWDEOHOHYHOVDFRPSUHVVHG VHQVLQJ&7UHFRQVWUXFWLRQDOJRULWKPXVLQJSULRULQIRUPDWLRQZDVGHYHORSHGDQG LPSOHPHQWHG*XLGHGLQWHUYHQWLRQVZHUHVLPXODWHGLQSKDQWRPVDQGSLJPRGHOV 'XULQJLQWHUYHQWLRQVFRQWLQXRXVUDZGDWDDFTXLVLWLRQXVLQJDSURWRW\SHÁDWSDQHO &7V\VWHPZDVSHUIRUPHG'GDWDVHWVRIWKHLQWHUYHQWLRQSURFHVVZHUHUHFRQ VWUXFWHGZLWKYDULRXVXQGHUVDPSOLQJUDWLRVFRUUHVSRQGLQJWRYDULRXVGRVHOHYHOV ,PDJHTXDOLW\ZDVHYDOXDWHGIRUWKHXVHLQ'LQWHUYHQWLRQDOJXLGDQFHE\YLVXDO LQVSHFWLRQ;UD\GRVHVZHUHFRPSDUHGWRELSODQHÁXRURVFRS\ 5HVXOWV5HFRQVWUXFWLRQUHVXOWVVKRZHGVXIÀFLHQWLPDJHTXDOLW\IRUKLJKFRQWUDVW PDWHULDOVDOORZLQJDVIHZDVSURMHFWLRQVSHUUHFRQVWUXFWLRQ*XLGHZLUHVDQG VWHQWVZHUHYLVLEOHLQD'VHWWLQJFRXOGEHIROORZHGZKLOHPRYLQJDQGORFDWHG FOHDUO\ZLWKUHVSHFWWRYHVVHOVDQGWKHLUVXUURXQGLQJ5DGLDWLRQGRVHVRI'JXLG DQFH*\VDOEHLWVOLJKWO\KLJKHUZHUHVWLOOLQWKHRUGHURIELSODQHÁXRURVFRS\ *\V &RQFOXVLRQ'LQWHUYHQWLRQDOJXLGDQFHLVSRVVLEOHZLWKRXWH[FHHGLQJDFFHSWDEOH [UD\GRVHYDOXHV8VLQJSULRULQIRUPDWLRQDQGFRPSUHVVHGVHQVLQJLPDJHUHFRQ VWUXFWLRQWHFKQLTXHVUHDOWLPH'JXLGDQFHDSSURDFKHVPD\EHFRPHDQDWWUDF WLYHPHWKRGIRULQWHUYHQWLRQJXLGDQFHZLWKDJUHDWSRWHQWLDOWRPDNHLQWHUYHQWLRQV IDVWHUVDIHUDQGWRPDNHPRUHFRPSOH[LQWHUYHQWLRQVSRVVLEOHZLWKDVLJQLÀFDQW EHQHÀWIRUSDWLHQWKHDOWK % /RZGRVHFRQWUDVWHQKDQFHGWLPHUHVROYHG05DQJLRJUDSK\DW7 GLDJQRVWLFDFFXUDF\IRUWUHDWPHQWSODQQLQJDQGIROORZXSRIERG\ YDVFXODUPDOIRUPDWLRQV 3 /XFDWHOOL0$Q]LGHL%&DYDOOR0DULQFROD$1DSROL) )DQHOOL 53DVVDULHOOR5RPH,7 3XUSRVH7 RDVVHVVWKHDFFXUDF\RIORZGRVHFRQWUDVWHQKDQFHGWLPHUHVROYHG 705DQJLRJUDSK\05$IRUWKHPRUSKRORJLFDODQGIXQFWLRQDODVVHVVPHQWRI YDVFXODUPDOIRUPDWLRQV90DQGWRHYDOXDWHLWVGLDJQRVWLFSRWHQWLDOLQSODQQLQJ WUHDWPHQWDQGIRUWKHGHSLFWLRQRIWUHDWPHQWLQGXFHGFKDQJHV 0HWKRGVDQG0DWHULDOV7ZHQW\ÀYHSDWLHQWVZLWKNQRZQ90XQGHUZHQW05$WR HYDOXDWHWKHORFDWLRQDQGH[WHQWRIOHVLRQVDQGWKHLUKDHPRG\QDPLFFKDUDFWHULVWLFV '7ZHLJKWHGWLPHUHVROYHGVHTXHQFHVZHUHDFTXLUHGIROORZLQJWKHDGPLQLVWUD WLRQRIPPRONJRIJDGREHQDWHGLPHJOXPLQH%UDFFR0LODQ,WDO\90ZHUH FODVVLÀHGDFFRUGLQJWRWKHLUPRUSKRORJ\DQGKDHPRG\QDPLFFKDUDFWHULVWLFVKLJK ÁRZRUORZÁRZ7KLVOHDGWRWKHVXEVHTXHQWSDWLHQWҋVPDQDJHPHQWWUDQVDUWHULDO HPEROLVDWLRQIRUKLJKÁRZ90SHUFXWDQHRXVVFOHURWLVDWLRQLQFDVHRIORZÁRZ90 RUFRPELQHGDSSURDFKIRUDUWHURYHQRXV90)ROORZXS05$ZDVSHUIRUPHG GD\VDIWHUWUHDWPHQWWRDVVHVVPRUSKRORJLFDODQGIXQFWLRQDOFKDQJHV 5HVXOWV%DVHGRQKDHPRG\QDPLFFKDUDFWHULVWLFV90ZHUHFODVVLÀHGDVSUHGRPL QDQWO\DUWHULDO>@DUWHURYHQRXV>@RUYHQRXV>@7ZHQW\WKUHH OHVLRQVZHUHFODVVLÀHGDVKLJKÁRZ90DQGDVORZÁRZ90&RPSOHWH H[FOXVLRQRIWKHQLGXVZDVREWDLQHGLQSDWLHQWVRISDWLHQWVOHDGLQJWR DGLPHQVLRQDOUHGXFWLRQDQGUHJUHVVLRQRIDHVWKHWLFDOLPSDLUPHQWRUV\PSWRPV &RQFOXVLRQ/RZGRVHFRQWUDVWHQKDQFHGWLPHUHVROYHG705$FDQDFFXUDWHO\ GHÀQHPRUSKRORJLFDODQGIXQFWLRQDODVSHFWVRI90GXULQJWUHDWPHQWSODQQLQJDQG IROORZXS DQG FDQ LGHQWLI\ SRVWWKHUDS\ FKDQJHV WKDW SRVLWLYHO\ FRUUHODWH ZLWK WUHDWPHQWRXWFRPH0RUHRYHU05$FDQDYRLGUDGLDWLRQH[SRVXUHFRQVLGHULQJWKH \RXWKDJHRIWKHVHSDWLHQW % $XWRPDWHG'RSSOHUDQJOHFRUUHFWLRQLQOLYHUWUDQVSODQWXOWUDVRXQG 2.RORN\WKDV7 3 *DXWKLHU&&XHYDV3 %KDUJDYD/00LWVXPRUL '(*UHHQ$$6DDG6HDWWOH:$86(LQGKRYHQ1/%RWKHOO:$86 RUSKHXV#XZHGX 3XUSRVH 7 R HYDOXDWH WKH FOLQLFDO IHDVLELOLW\ RI DXWRPDWLFDOO\ FRUUHFWHG 'RSSOHU DQJOHLQKHSDWLFYHVVHOV 0HWKRGVDQG0DWHULDOV7KLVSURVSHFWLYHVWXG\ZDVDSSURYHGE\WKHLQVWLWXWLRQDO UHYLHZ ERDUG DOO SDWLHQWV JDYH WKHLU ZULWWHQ FRQVHQW WR SDUWLFLSDWH KHSDWLF YHVVHOVZHUHHYDOXDWHGLQSDWLHQWVWRWDORIDUWHULHVDQGYHLQVSHUSDWLHQW DIWHU OLYHU WUDQVSODQW ZLWK XOWUDVRXQG XVLQJ D FXUYLOLQHDU 0+] WUDQVGXFHU PDQXDO'RSSOHUDQJOHFRUUHFWLRQZDVSHUIRUPHGDVWKHJROGVWDQGDUGIROORZHGE\ DXWRPDWHG'RSSOHUDQJOHFRUUHFWLRQERWKSHUIRUPHGE\WKHVDPHRSHUDWRUZLWK \HDUVRIH[SHULHQFHLQDEGRPLQDO'RSSOHUXOWUDVRXQGEOLQGHGWRWKHPHDVXUHPHQWV RIWKHFRPSHWLQJPHWKRG'RSSOHUDQJOHVDQGSHDNYHORFLWLHVXVLQJPDQXDODQG DXWRPDWHGFRUUHFWLRQRI'RSSOHUDQJOHZHUHUHFRUGHG5HVXOWVZHUHDQDO\VHGXVLQJ UHJUHVVLRQDQDO\VLVDQGD%ODQG$OWPDQ'LIIHUHQFHSORW&DVHE\FDVHDQDO\VLV ZDVSHUIRUPHGIRU'RSSOHUDQJOHVGLVFUHSDQWE\PRUHWKDQGHJUHHVWRHYDOXDWH IRUSRVVLEOHDHWLRORJLHV 5HVXOWVYHVVHOVZHUHVXFFHVVIXOO\H[DPLQHG $VWURQJFRUUHODWLRQZDVIRXQG EHWZHHQWKHPDQXDOO\DGMXVWHGDQGWKHDXWRPDWHGDQJOHFRUUHFWLRQ7KHPHDQ GLVFUHSDQF\ RI 'RSSOHU DQJOHV ZDV GHJUHHV 6' GHJUHHV FRUUHOD WLRQFRHIÀFLHQW 7KHPHDQGLVFUHSDQF\RISHDNYHORFLWLHVZDVFPV 6' FPVFRUUHODWLRQFRHIÀFLHQW &DXVHVIRUGLVFUHSDQWDQJOHVDERYH GHJUHHVLQFOXGHGFXUYHGDQGELIXUFDWLQJYHVVHOVORZHFFHQWULFLW\PHUJHGYHV VHOVXVHUҋVSUHIHUHQFHRI'RSSOHUJDWHSODFHPHQWDQGRWKHU'LVFUHSDQFLHVZHUH GHHPHGFOLQLFDOO\QRQVLJQLÀFDQW &RQFOXVLRQ$XWRPDWLRQRI'RSSOHUDQJOHFRUUHFWLRQLVFOLQLFDOO\IHDVLEOHLQWKH HYDOXDWLRQRIKHSDWLFYDVFXODWXUH,WPD\HQKDQFHVWDQGDUGLVDWLRQDQGUHSURGXF LELOLW\RI'RSSOHUPHDVXUHPHQWV 6FLHQWLILF6HVVLRQ 6 &$' ( ) *+% (XURSHDQ&RQJUHVVRI 5DGLRORJ\ 5HVXOWV 2YHUDOO RI WKH WRWDO UDGLDWLRQ GRVH ZDV GXH WR WKH DFTXLVLWLRQ RI UDGLRJUDSKLFIUDPHVOHDYLQJRQO\RIWKHWRWDOGRVHEHLQJDSSOLHGE\ÁXRURVFRS\ S7KHLQYHVWLJDWRUVH[SHULHQFHKDGQRVLJQLÀFDQWLPSDFWRQWKHWRWDO GRVHDSSOLHGPRVWOLNHO\VLQFHWKHUHZDVQRVWUDWLÀFDWLRQWRLQWHUYHQWLRQFRPSOH[LW\ &RQFOXVLRQ,PDJHJUDEELQJRIÁXRURVFRS\VKRXOGEHXVHGIRUGRFXPHQWDWLRQ ZKHQHYHU SRVVLEOH ,QWHUYHQWLRQDO UDGLRORJLVWV VKRXOG EH DZDUHRI WKH UDGLDWLRQ H[SRVXUHRIGLIIHUHQWSURFHGXUHW\SHV$UHJLVWU\RIUDGLDWLRQH[SRVXUHVKRXOGQRW RQO\ FRPSULVH D VXIÀFLHQWO\ ODUJH QXPEHU RI LQWHUYHQWLRQV EXW DOVR WKH GLIIHUHQW LQWHUYHQWLRQW\SHVLQRUGHUWRGHYHORSUHIHUHQFHOHYHOV % $QHZPHWKRGRIUHDOWLPHVNLQGRVHYLVXDOLVDWLRQFOLQLFDO HYDOXDWLRQRIÁXRURVFRS\JXLGHGLQWHUYHQWLRQV ) %RXMDQ1&ODXVV&-DKQ0+DEDVK\00DQLVRU+%HQMDPHO 90DUGDNKD\HYD/0HUW]5%HDXMHX[6WUDVERXUJ)5 ID]HOERXMDQ#FKUXVWUDVERXUJIU 3XUSRVH7KHUDGLDWLRQH[SRVXUHLQÁXRURVFRS\JXLGHGLQWHUYHQWLRQV)*,LVD PDMRU LVVXH IRU WKH 3XEOLF +HDOWK 7KH LQFUHDVLQJ FRPSOH[LW\ RI )*, HQKDQFHV WKHULVNRIFUHDWLQJVLGHHIIHFWVIRUSDWLHQWVXFKDUDGLDWLRQLQGXFHGVNLQLQMXULHV &XUUHQWO\ GRVH DUHD SURGXFW '$3 HVWLPDWH WKH SDWLHQW VNLQ GRVH 7KLV VWXG\ HYDOXDWHVDQLQQRYDWLYHDZDUHQHVVWRROWKDWGLVSOD\VGLUHFWO\WKHUHDOWLPHSHDN VNLQGRVHLQIRUPDWLRQ 0HWKRGV DQG 0DWHULDOV :H KDYH WHVWHG GXULQJ PRQWKV D QHZ PDFKLQH SDUDPHWHUEDVHGGRVHFDOFXODWLRQVPHWKRG0$3'2&RQSDWLHQWVSRSXODWLRQ VFKHGXOHGIRUKHDGDQGQHFNWKRUDFLFDQGDEGRPLQDO)*,&XUUHQWO\DQJLRJUDSKLF V\VWHPSURYLGHVDEDVLFFXPXODWLYHDLUNHUPDYDOXH0$3'2&PHWKRGSURYLGHV DUHDOWLPHDLUNHUPDPDSSLQJRQDVSKHUHSDWLHQWPRGHO,WWDNHVLQWRDFFRXQWDOO UHOHYDQWDFTXLVLWLRQSDUDPHWHUVWDEOHKHLJKWDQJXODWLRQFROOLPDWLRQ7KLVPHWKRG LVSURVSHFWLYHO\FRPSDUHGWRUDGLRFKURPLFÀOPVIRUHYHU\SDWLHQWIRUPRQRSODQH DQGELSODQHDQJLRJUDSKLFV\VWHPV 5HVXOWV)LQGLQJVEHWZHHQ0$3'2&DQGUDGLRFKURPLFÀOPVDUHFORVHO\FRUUHODWHG ZLWKDFRQVWDQWFRUUHFWLRQIDFWRUGHSHQGLQJRQSURFHGXUHW\SHDYHUDJHUDWLR IRUPRQRSODQHWKRUDFLFDQGDEGRPLQDOSURFHGXUHVIRUPRQRSODQHFHUHEUDO SURFHGXUHVDQGIRUELSODQHFHUHEUDOSURFHGXUHVDQGSURFHGXUHSDUDPHWHUV SDWLHQWZHLJKW&DUPDQJXODWLRQVFROOLPDWLRQ«0DSSLQJRQDVSKHUHSDWLHQW PRGHOLVFORVHO\FRUUHODWHGWRUDGLRFKURPLFÀOPVGRVHPDSSLQJDQGDOORZWRRSWLPLVH VNLQGRVHUHSDUWLWLRQGXULQJ)*, &RQFOXVLRQ0$3'2&SURYLGHVDUHOLDEOHUHDOWLPHIHHGEDFNRQSDWLHQWVNLQGRVH DQG PDSSLQJ GXULQJ )*,7KLV LQQRYDWLYH WRRO DOORZV SK\VLFLDQ WR RSWLPLVH )*, SURFHGXUHVDQGSUHYHQWVVNLQLQMXULHV % 6WXG\RIDUHDOWLPHGRVLPHWU\V\VWHPDQGLWVLPSDFWRQFXUUHQW SUDFWLFHVLQDQDQJLRJUDSK\URRP ) %RXMDQ 1&ODXVV$+RUQEHFN&-DKQ/0HUW]5%HDXMHX[ 6WUDVERXUJ)57 RXORXVH)5ID]HOERXMDQ#FKUXVWUDVERXUJIU 3XUSRVH7KHUDGLDWLRQH[SRVXUHLQÁXRURVFRS\JXLGHGLQWHUYHQWLRQV)*,LVD PDMRULVVXHIRUWKH3XEOLF+HDOWK,QRXULQVWLWXWLRQZHVWXGLHGWKHLPSDFWRIDQHZ UHDOWLPHGRVLPHWU\V\VWHP3KLOLSV'RVH$ZDUHRQRSHUDWRUVҋH[SRVXUH 0HWKRGVDQG0DWHULDOV7KH'RVH$ZDUH6\VWHPDOORZVRSHUDWRUVWRVHHWKHLU SHUVRQDOGRVHUDWHDWDJODQFHGXULQJDSURFHGXUH(DFK3HUVRQDO'RVH0HWHU 3'0 PHDVXUHV +S ZKLFK LV VHQG ZLUHOHVVO\ WR D %DVH 6WDWLRQ D VFUHHQ PRXQWHGQH[WWRWKHUDGLRORJ\PRQLWRUV7KHVWXG\FRQVLVWHGRQWKHFRPSDULVRQRI WZRPHDVXUHPHQWVSHULRGV)LUVWWKHEOLQGHGVWDJHFRQVLVWLQJUDGLDWLRQPHDVXUH PHQWVE\FRUHODEZLWKWKHVFUHHQRIIIRURSHUDWRUV7KHQDUHJXODUVWDJHFRQVLVWLQJ PHDVXUHPHQWVZLWKWKHVFUHHQRQ 5HVXOWV0RUHWKDQHOHPHQWVRILQIRUPDWLRQKDYHEHHQWUHDWHGGXULQJ PRQWKV7KHLQWHUSUHWDWLRQRQFHUHEUDODQJLRJUDSK\SURFHGXUHVVKRZHGDGRVHUH GXFWLRQIRUDOORSHUDWRUVIRUSK\VLFLDQVIRUWHFKQLFLDQVDQGIRUQXUVHV &RQFOXVLRQ 7KH 3KLOLSV 'RVH$ZDUH LV DQ LQWHUHVWLQJ RSWLPLVDWLRQ WRRO IRUWKH RSHUDWRUVҋH[SRVXUHGXULQJFHUHEUDODQJLRJUDSK\SURFHGXUHV:HLQWHQGWRVWXG\ WKLVV\VWHPRQRWKHUV)*,SURFHGXUHV+RZHYHUWKLVV\VWHPFRXOGEHXVHGDOVR WRHVWLPDWHRSHUDWRUVH\HOHQVH[SRVXUHHVSHFLDOO\LQWKHFRQWH[WRIQHZUHFRP PHQGDWLRQV SURMHFW RI ,QWHUQDWLRQDO &RPPLVVLRQ RI WKH 5DGLRORJLFDO 3URWHFWLRQ ,&53WRUHGXFHWKHH\HOHQVҋH[SRVXUHOLPLWWRP6YSHU\HDU % 'LQWHUYHQWLRQJXLGDQFHDWHFKQLFDOIHDVLELOLW\FRQVLGHUDWLRQ -.XQW]66DZDOO:6HPPOHU0.DFKHOULHVV6%DUWOLQJ +HLGHOEHUJ'((UODQJHQ'(MNXQW]#GNI]GH 3XUSRVH7 RLQYHVWLJDWHWKHRYHUDOOIHDVLELOLW\RI'LQWHUYHQWLRQDOJXLGDQFHXVLQJ FXUUHQWÁDWSDQHO&7WHFKQRORJ\ 0HWKRGVDQG0DWHULDOV5HFHQWUHVHDUFKVXJJHVWVWKDW'LQWHUYHQWLRQDOJXLGDQFH PD\EHFRPHIHDVLEOHE\WKHXVHRIQRYHOUHFRQVWUXFWLRQDOJRULWKPVDQGSULRULQIRU PDWLRQ7 RWKLVHQGFRQWLQXRXV'GDWDDFTXLVLWLRQXVLQJFLUFXODUWUDMHFWRULHVPLJKW EHWKHPRVWVWUDLJKWIRUZDUGVROXWLRQ7 RWDOGRVHRIXSGDWHVFDQVFDQEHGLVWULEXWHG DPRQJYDULRXVDPRXQWVRISURMHFWLRQV0DWKHPDWLFDOVLPXODWLRQVDVZHOODVUHDO SKDQWRPVFDQVZHUHSHUIRUPHG)'.UHFRQVWUXFWLRQVZHUHXVHGIRUKLJKUHVROXWLRQ SULRU LPDJHV WHPSRUDO XSGDWHV ZHUH UHFRQVWUXFWHG XVLQJ FRPSUHVVHG VHQVLQJ DOJRULWKPVLQFOXGLQJ3,&&6DQG$6'32&6)RUWHPSRUDOXSGDWHUHFRQVWUXF WLRQVYDULRXVQRLVHOHYHOVSHUSURMHFWLRQDQGGLIIHUHQWXQGHUVDPSOLQJUDWLRVZHUH XVHGZKLOHWKHRYHUDOOGRVHIRUHYHU\UHFRQVWUXFWLRQZDVNHSWFRQVWDQW(OHFWURQLF GHWHFWRU QRLVH ZDV QRW LQFOXGHG LQWR VLPXODWLRQV ,PDJH TXDOLW\ ZDV HYDOXDWHG DXWRPDWLFDOO\HJE\DPRGLÀHGXQLYHUVDOTXDOLW\LQGH[DQGE\YLVXDOLQVSHFWLRQ 5HVXOWV,PDJHTXDOLW\YDULHGODUJHO\EHWZHHQDOJRULWKPVDQGUHFRQVWUXFWLRQSD UDPHWHUV)RUWKHGLVWULEXWLRQRIWKHWRWDOGRVHWRYDULRXVDPRXQWVRISURMHFWLRQVD PD[LPXPLPDJHTXDOLW\ZDVIRXQGWREHUHDFKHGDWWKHRUGHURIWRSURMHF WLRQVSHUXSGDWHUHFRQVWUXFWLRQLQVLPXODWLRQVRIW\SLFDOLQWHUYHQWLRQDOVLWXDWLRQV HJVWHQWSODFHPHQW $6'32&6LWHUDWLRQV%RWKPRUHDQGOHVVSURMHFWLRQV VXIIHUHGIURPODUJHUQRLVHDQGXQGHUVDPSOLQJHIIHFWV &RQFOXVLRQ7KHVHGDWDVXJJHVWWKDWZLWKFXUUHQWÁDWSDQHOWHFKQRORJ\UHDGRXW UDWHVWRISVDQGJDQWULHVURWDWLQJDWDERXWRQHWRWZRURWDWLRQVSHUVHFRQG DVXIÀFLHQW'LQWHUYHQWLRQJXLGDQFHZLWKXSWRWKUHHXSGDWHVSHUVHFRQGFDQEH UHDOLVHG % 'FXUYHOHWVSDWLRWHPSRUDOÀOWHULQJDSSOLHGWR[UD\GLJLWDOÁDWSDQHO GHWHFWRULPDJLQJ -3HVFDWRUH&$PLRW0RLUDQV)5MHUHPLHSHVFDWRUH#WKDOHVJURXSFRP 3XUSRVH[UD\LQWHUYHQWLRQDOLPDJLQJLVSDUWLFXODUO\FKDOOHQJLQJLQWHUPVRIGRVH UHGXFWLRQDQGGHQRLVLQJ,QGHHGFDUGLDFDQGUHVSLUDWRU\PRWLRQFRXSOHGZLWKGHQVH DQDWRPLHVDUHDPRQJWKHPDMRUUHDVRQVIRUORZVLJQDOWRQRLVHUDWLRLQÁXRURVFRSLF LPDJLQJQ*\IUDPHGHWHFWRUHQWUDQFHGRVH2XUZRUNFRQVLVWVLQGHYHORSLQJ DQRYHOPHWKRGWRHQKDQFHLQWHUYHQWLRQDOGHYLFHVQHHGOHVDQGFDWKHWHUVZKLOH SUHVHUYLQJWKHDQDWRPLFDOERXQGDULHV)RUWKLVZHGHYHORSHGDVSDWLRWHPSRUDO ÀOWHUEDVHGRQWKH'FXUYHOHWWUDQVIRUP 0HWKRGVDQG0DWHULDOV7KHSURSRVHGPHWKRGFRQVLVWVRIWZRVWHSVDWHPSRUDO DQGDVSDWLDOÀOWHULQJ7KHWHPSRUDOÀOWHULVEDVHGRQWKHWLPHHYROXWLRQRISL[HOҋV YDOXH7KLVÀOWHUKDVDOLPLWHGGHQRLVLQJSRZHUWHQGVWRHUDVHWKHREMHFWVRILQWHU HVWDQGLQWURGXFHVVSLNHQRLVHLQWKHLPDJH7KHUHIRUHRXUDSSURDFKFRPELQHV D'FXUYHOHWVSDWLDOÀOWHUWRWKHWHPSRUDOÀOWHU7KLVVSDWLDOÀOWHULVEDVHGRQWKH ZUDSSLQJGLVFUHWHFXUYHOHWLPSOHPHQWDWLRQ7KHFXUYHOHWFRHIÀFLHQWVVKULQNDJHLV SHUIRUPHGDFFRUGLQJWRDVFDOHGHSHQGHQWKDUGWKUHVKROGLQJVFKHPH 5HVXOWV7KH'FXUYHOHWVSDWLRWHPSRUDOÀOWHULQJLVDSSOLHGRQ[UD\LPDJHVUHS UHVHQWLQJJXLGHZLUHVDQGVWHQWV,QSXWFRQWUDVWWRQRLVHUDWLRLVEHWZHHQDQG :HGHPRQVWUDWHWKDWRXUPHWKRGRXWSHUIRUPVZDYHOHWEDVHGVSDWLRWHPSRUDO ÀOWHU7KHSURSRVHGPHWKRGUHPRYHVPRVWRIWKHJDXVVLDQQRLVHDQGOHDYHVVRPH PLQRUVSLNHQRLVHLQGXFHGE\WKHWHPSRUDOÀOWHULQJ &RQFOXVLRQ2XUZRUNGHPRQVWUDWHVWKDWFRPELQHGFXUYHOHWDQGWHPSRUDOÀOWHULQJ LPSURYHVVLJQLÀFDQWO\ORZGRVHÁXRURVFRSLFLPDJHTXDOLW\,QWHUYHQWLRQDOGHYLFHV DQGERQHYLVLELOLW\LVLQFUHDVHGZKLOHWKHLPDJHEDFNJURXQGQRLVHLVGHFUHDVHG % 5DGLDWLRQH[SRVXUHLQYDVFXODUDQJLRJUDSKLFSURFHGXUHV 5.ORHFNQHU&'XHEHU-6FKQHLGHU$%HUVFK&5XFNHV0%3LWWRQ 0DLQ]'(URPDQNORHFNQHU#JRRJOHPDLOFRP 3XUSRVH7 RLQYHVWLJDWHWKHUDGLDWLRQH[SRVXUHLQYDVFXODUDQJLRJUDSKLFSURFHGXUHV DQGWRVHDUFKVWUDWHJLHVIRUGRVHUHGXFWLRQ 0HWKRGV DQG 0DWHULDOV FRQVHFXWLYH YDVFXODU LQWHUYHQWLRQDO SURFHGXUHV SHUIRUPHG RYHU \HDU ZHUH DQDO\VHG LQFOXGLQJ GLDJQRVWLF '6$ UHFDQDOLVDWLRQ DQG37$VWHQWLQWKHSHOYLVDQGOHJ(9$5HPEROLVDWLRQRIOXPEDUDUWHULHV37$ VWHQWRIUHQDODUWHULHVHPEROLVDWLRQRIGLYHUVHEOHHGLQJVDQGRWKHUUDUHO\SHUIRUPHG LQWHUYHQWLRQV7KH\ZHUHDQDO\VHGZLWKUHVSHFWWRWKHÁXRURVFRS\WLPHDQGWKH UHVXOWLQJÁXRURVFRS\UDGLDWLRQGRVHWKHUDGLDWLRQGRVHRIWKHUDGLRJUDSKLFIUDPHV DQGWKHRYHUDOOGRVH$GGLWLRQDOO\WKHLQYHVWLJDWRUVH[SHULHQFHRQWKHWRWDOGRVH ZDVLQYHVWLJDWHG 6FLHQWLILF6HVVLRQ $ 6&'()*+%(XURSHDQ&RQJUHVVRI 5DGLRORJ\ )ULGD\ RI DUWHIDFWV $6) UHFRQVWUXFWHG VOLFH WKLFNQHVV DQG JHRPHWULFDO GLVWRUWLRQ$ VHPLFOLQLFDOHYDOXDWLRQRQ&,56SKDQWRP0RGHO%5'ZDVDOVRSHUIRUPHG 5HVXOWV7KHGRVHGHOLYHUHGE\WKHWZRV\VWHPVGRHVQRWVKRZUHPDUNDEOHGLI IHUHQFHVQHLWKHULQLWVDEVROXWHYDOXHQRULQUHODWLRQWRWKHGRVHGHOLYHUHGE\D VWDQGDUGPDPPRJUDSKLFSURMHFWLRQ7KHUDWLREHWZHHQWRPRV\QWKHVLVDQGVWDQGDUG PDPPRJUDSK\KDVDPHDQYDOXHRI:LWKUHVSHFWWRSURMHFWLRQPDPPRJUDSK\ LQWRPRV\QWKHVLVZHIRXQGDVWURQJORVVLQVSDWLDOUHVROXWLRQD&15LPSURYHPHQW DVWURQJSUHVHQFHRIDUWHIDFWVHVSHFLDOO\DORQJYHUWLFDOGLUHFWLRQDJHRPHWULFGLV WRUWLRQDWGHWHFWRUHGJHV)LQDOO\MXVWVPDOOGLIIHUHQFHVEHWZHHQWKHWZRV\VWHPV KDYHHPHUJHGIURPWKHVHPLFOLQLFDOHYDOXDWLRQ &RQFOXVLRQ$YHUDJHJODQGXODUGRVHGHOLYHUHGLQWRPRV\QWKHVLVLVVPDOOHUWKDQ GRVH GHOLYHUHG E\ WZR VWDQGDUG SURMHFWLRQV IRU ERWK V\VWHPV 7RPRV\QWKHVLV DGYDQWDJHZLWKUHVSHFWWRVWDQGDUGPDPPRJUDSK\OLHVLQWKHWRPRJUDSKLFUHSUH VHQWDWLRQZKLFKHQWDLOVD&15LPSURYHPHQWSDUWLFXODUO\IRUVPDOOREMHFWVZKHUHDV WKHGLVDGYDQWDJHLVDGHFUHDVHLQKLJKFRQWUDVWUHVROXWLRQFRUUHODWHGZLWKDUWHIDFWV SURSDJDWLRQSDUWLFXODUO\DORQJYHUWLFDOGLUHFWLRQ 5RRP4 &DUGLDF 66 &7FRURQDU\DQJLRJUDSK\VWHQRVLVDVVHVVPHQW 0RGHUDWRUV *)HXFKWQHU,QQVEUXFN$7 1(.ORZ2VOR12 % 7KHDUHDVWHQRVLVPHDVXUHPHQWRIVLJQLÀFDQWFRURQDU\DUWHU\ OHVLRQVE\TXDQWLWDWLYHFRPSXWHGWRPRJUDSK\FRURQDU\DQJLRJUDSK\ 4&7$FRUUHODWHVEHWWHUZLWKTXDQWLWDWLYHLQYDVLYHFRURQDU\ DQJLRJUDSK\4&$WKDQGLDPHWHUVWHQRVLVPHDVXUHPHQW %/DVNRZLF]%.UXSLQVNL7 0LV]DOVNL-DPND%*X]LN0$QGUHV5%DQ\V 08UEDQF]\N=DZDG]ND0.RVWNLHZLF].UDNRZ3/ 3XUSRVH7 RGDWHPRVWVWXGLHVHYDOXDWHGWKHGLDJQRVWLFYDOXHRIFRPSXWHGWR PRJUDSK\FRURQDU\DQJLRJUDSK\&7&$WRGHWHFWVLJQLÀFDQWGLDPHWHUFRURQDU\ DUWHU\VWHQRVHVEXWWKHUHLVSDXFLW\RIGDWDFRPSDULQJ&7&$WRLQYDVLYHFRURQDU\ DQJLRJUDSK\IRUDUHDVWHQRVLVDVVHVVPHQW7KHDLPRIWKLVVWXG\ZDVWRFRPSDUHWKH YDULDQFHRITXDQWLWDWLYHDUHDDQGGLDPHWHUVWHQRVLVPHDVXUHPHQWLQVLJQLÀFDQWRE VWUXFWLYHFRURQDU\DUWHU\OHVLRQVEHWZHHQ&7&$DQGLQYDVLYHFRURQDU\DQJLRJUDSK\ 0HWKRGVDQG0DWHULDOV)LIW\SDWLHQWVZLWKVLJQLÀFDQWFRURQDU\DUWHU\VWHQRVHV "DUHDVWHQRVLVLQGXDOVRXUFH&7&$6RPDWRP'HÀQLWLRQZHUHLQFOXGHG DQGXQGHUZHQWLQYDVLYHFRURQDU\DQJLRJUDSK\,&$ZLWKLQPRQWKVDIWHU&7&$ $UHDDQGGLDPHWHUVWHQRVLVPLQLPDOOXPHQDUHD0/$DQGGLDPHWHU0/'UHIHU HQFHOXPHQDUHD5/$DQGGLDPHWHU5/'ZHUHHYDOXDWHGLQTXDQWLWDWLYH&7&$ 4&7$DQGTXDQWLWDWLYHLQYDVLYHFRURQDU\DQJLRJUDSK\4&$ 5HVXOWV2ITXDQWLWDWLYHO\HYDOXDWHGVLJQLÀFDQWVWHQRWLFOHVLRQVZHUHFDOFL ÀHGZHUHPL[HGDQGZHUHQRQFDOFLÀHG7KH6SHDUPDQҋVUDQNFRUUHODWLRQ EHWZHHQ4&7$DQG4&$DUHDDQGGLDPHWHUVWHQRVLVPHDVXUHPHQWVZDVDJRRG U SDQGPRGHUDWHU SIRUDOOOHVLRQVEYHU\JRRG U SDQGJRRGU SIRUQRQFDOFLÀHGSODTXHVF YHU\ JRRG U S DQG JRRG U S IRU PL[HG OHVLRQV DQGGQRQHIRUFDOFLÀHGSODTXHVU S 16DQGU S 16UHVSHFWLYHO\ &RQFOXVLRQ7KHDUHDVWHQRVLVPHDVXUHPHQWRIVLJQLÀFDQWFRURQDU\DUWHU\OHVLRQV SURYLGHGE\TXDQWLWDWLYH&7&$FORVHO\FRUUHODWHVZLWK4&$DQG\LHOGVKLJKHUFRU UHODWLRQWKDQGLDPHWHUVWHQRVLVPHDVXUHPHQW7KLVFRUUHODWLRQGHSHQGVRQSODTXH FRPSRVLWLRQDQGLVKLJKHVWIRUQRQFDOFLÀHGDQGPL[HGOHVLRQV % ,VWKHUHDUROHIRUURZ0'&7LQWKHIROORZXSRIKHDUWWUDQVSODQWHG SDWLHQWV"$FRPSDULVRQVWXG\ZLWKHFKRFDUGLRJUDSK\DQG05 SHUIRUPHGRQWKHVDPHGD\ 96LOYHVWUL50DUDQR*6DYLQR%0HUOLQR*9HUULOOR$0HGXUL/1DWDOH /%RQRPR5RPH,7YDOHQWLQDBVLOYHVWUL#KRWPDLOLW 3XUSRVH7 RHYDOXDWHWKHDFFXUDF\RI0'&7LQWKH)8RIKHDUWWUDQVSODQWHG SDWLHQWVDVVHVVLQJWKH/9)LQFRPSDULVRQZLWKHFKRFDUGLRJUDSK\DQG05SHU IRUPHGRQWKHVDPHGD\ 0HWKRGVDQG0DWHULDOV6L[WHHQSDWLHQWVZLWKWUDQVSODQWHGKHDUWVZHUHLQYHVWL JDWHGE\HFKRFDUGLRJUDSK\05DQG0'&7 7ZRLQGHSHQGHQWUHDGHUVEOLQG HYDOXDWHG() ('9(6969&2DQG0DVVRIWKH/9RQ0'&7XVLQJDGHGLFDWHG % 4XDQWUD%,5$'6VFDOHDQGEUHDVWGHQVLW\FRUUHODWLRQSUHOLPLQDU\UHVXOWV ) &DYDJQHWWR55RVDVFR0&DODEUHVH$7 DJOLDÀFR*7 DFFLQL %0RQJHUR*0DVVDUL*HQRD,77XULQ,7IUDQFHVFDFDYDJQHWWR#LVWJHLW 3XUSRVH0DQ\VWXGLHVSURYHGWKDWUDGLRORJLFDOEUHDVWGHQVLW\FDQEHDSUHGLFWLYH HOHPHQW RI FDQFHU ULVN 5DGLRORJLVWV HYDOXDWH EUHDVW GHQVLW\ DFFRUGLQJ D YLVXDO DQDO\VLVRIWKHLPDJHVXVLQJ%,5$'6FODVVLÀFDWLRQ $GHGLFDWHGVRIWZDUH4XDQWUD FDQUHGXFHHUURUVDVVRFLDWHGZLWKWKLVTXDOLWDWLYHPHWKRG7KHVRIWZDUHPDNHV DQXPHULFPHDVXUHRQPDPPRJUDSK\YLHZVRIEUHDVWDQGÀEURJODQGXODUWLVVXHYRO XPHWKHQLWFDOFXODWHVWKHYROXPHWULFSHUFHQWDJHRIÀEURJODQGXODUWLVVXHRIEUHDVW 7KHDLPRIWKLVZRUNLVWRSURYLGHDFDOLEUDWLRQLQRUGHUWRFRUUHODWHWKHQXPHULFDO UHVXOWRI4XDQWUDZLWKWKH%,5$'6VFDOHDQGWKHQZLWKWKHUHDOEUHDVWGHQVLW\ 0HWKRGV DQG 0DWHULDOV )RXU FRPSUHVVLEOH SKDQWRPV ZHUH PDGH ÀOOHG ZLWK VXEVWDQFHV RI NQRZQ GHQVLW\ EHWZHHQ DQG JFP WR VLPXODWH W\SLFDO GHQVLWLHVRIUHDOEUHDVWV0DPPRJUDSKLFLPDJHVRISKDQWRPVZHUHSURFHVVHGE\ WKHVRIWZDUH)LQDOO\GLJLWDOPDPPRJUDPVRISDWLHQWVZDVVXEPLWWHGWR4XDQWUD DQGWKHQWRUDGLRORJLVWVLQRUGHUWRGHULYHHVWLPDWLRQVRIEUHDVWGHQVLW\DFFRUGLQJ WR%,5$'V\VWHP 5HVXOWV7KHQXPHULFDOHYDOXDWLRQSURYLGHGE\4XDQWUDRQSKDQWRPEUHDVWVKDV EHHQUHODWHGZLWKNQRZQGHQVLWLHV5 8VLQJWKLVFDOLEUDWLRQWKHEUHDVWGHQVL WLHVRIZHUHFDOFXODWHG7KHVHYDOXHVVKRZDFRUUHODWLRQZLWKWKHUDGLRORJLVWV HYDOXDWLRQVEDVHGRQ%,5$'6VFDOH5 &RQFOXVLRQ4XDQWUDKHOSUDGLRORJLVWVWRHVWLPDWHYROXPHWULFSHUFHQWDJHRIWKH ÀEURJODQGXODUWLVVXHRIEUHDVWEXWLWLVQHFHVVDU\DSURSHUFDOLEUDWLRQRIWKLVVRIWZDUH WRREWDLQWKHFRUUHFWUHODWLRQEHWZHHQ4XDQWUDUHVXOWVDQGUHDOEUHDVWGHQVLWLHV 7KLVPHWKRGHQDEOHVWRUHODWH4XDQWUDQXPEHUVZLWKTXDQWLWDWLYHHYDOXDWLRQVZLWK %,5$'6VFDOH % 3K\VLFDOFKDUDFWHULVWLFVDQGLPDJHTXDOLW\RIUHFRQVWUXFWHGSODQHV LQGLJLWDOEUHDVWWRPRV\QWKHVLV'%7DV\VWHPFRPSDULVRQ 12EHUKRIHU%RO]DQR,7QDGLDREHUKRIHU#DVE]LW 3XUSRVH,Q(XURSHWKHUHDUHWKUHHFRPPHUFLDOV\VWHPVIRUGLJLWDOEUHDVWWRPR V\QWKHVLV '%7 ZKLFK GLIIHU E\ DFTXLVLWLRQ WHFKQLTXH DQJXODUUDQJH QXPEHU DQGVSDFLQJRISURMHFWLRQVDQGUHFRQVWUXFWLRQDOJRULWKP7KLVZRUNFRPSDUHVWKH V\VWHPVE\FKDUDFWHULVDWLRQRIWKHSK\VLFDOSURSHUWLHVDQGWKHLPDJHTXDOLW\RI WKHUHFRQVWUXFWHG'SODQHV 0HWKRGVDQG0DWHULDOV7KHVWXGLHGXQLWVDUH+RORJLF6HOHQLD'LPHQVLRQV6LH PHQV0DPPRPDW,QVSLUDWLRQDQG,06*LRWWR%HVLGHV'07) 136DQG'4( WKHV\VWHPVKDYHEHHQFKDUDFWHULVHGLQWHUPVRIKRPRJHQHLW\VLJQDOGLIIHUHQFH WRQRLVHUDWLR6'15EHKDYLRXUWKURXJKRXWWKHYROXPHLQSODQHUHVROXWLRQDQG] UHVROXWLRQ,PDJHTXDOLW\KDVEHHQDVVHVVHGE\PHDQVRIFRQWUDVWGHWDLOHYDOXDWLRQ ZLWKWKHSKDQWRP&'0$0DQGWKHVRIWZDUH&'0$0 $QDO\VHU $YHUDJHJODQGXODU GRVH$*'ZDVFDOFXODWHGDFFRUGLQJWR'DQFH3HUIRUPDQFHVKDYHEHHQHYDOXDWHG IRUYDULRXV300$SKDQWRPWKLFNQHVVHVLQFOLQLFDOVHWXSXVLQJDXWRPDWLFH[SRVXUH FRQWUROPRGDOLW\$(& 5HVXOWV,QDOOV\VWHPVWKH$*'IRUDWRPRVFDQZDVFOHDUO\LQIHULRUWRWZLFHWKH $*'IRUDVWDQGDUG'SURMHFWLRQWKHUDWLRUDQNLQJIURPWRGHSHQGLQJ RQWKHFRPSUHVVHGEUHDVWWKLFNQHVV$OWKRXJKWKHVLQJOHWRPRSURMHFWLRQVZHUH FKDUDFWHULVHGE\ORZHULPDJHTXDOLW\ZLWKUHVSHFWWRVWDQGDUG'LPDJHVDQGLQ RQHV\VWHPE\ORZHUVSDWLDOUHVROXWLRQWRRWKHUHFRQVWUXFWHGLPDJHLQWKHFHQWUDO SODQHZDVQHYHULQIHULRUWR'LPDJHV &RQFOXVLRQ7KHPHWKRGRORJ\IRU'%7SHUIRUPDQFHDVVHVVPHQWLVQRWZHOOHVWDE OLVKHGUHFRQVWUXFWLRQDOJRULWKPVVHDPWRSOD\DGRPLQDQWUROHLQWKHLPDJHTXDOLW\ RIUHFRQVWUXFWHGSODQHV)XUWKHULQYHVWLJDWLRQDQGLQWHUQDWLRQDOKDUPRQLVDWLRQRQ SURWRFRODQGSKDQWRPDUHGHVLUDEOH % %UHDVWWRPRV\QWKHVLVSK\VLFDOFKDUDFWHULVDWLRQDQGFRPSDULVRQ EHWZHHQWZRV\VWHPV 63DVHWWR3 &RORPER$7 RUUHVLQ07 DJOLDEXH0LODQ,7 VWHIDQRSDVH#JPDLOFRP 3XUSRVH,QRXUZRUNVRPHLPDJHTXDOLW\SDUDPHWHUVKDYHEHHQSURSRVHGDV D ZD\ WR FKDUDFWHULVH D WRPRV\QWKHVLV V\VWHP FRQFHUQLQJ LPDJHTXDOLW\ DQG GRVH7KLVSURWRFROZDVDSSOLHGWRWZRGLIIHUHQWV\VWHPV0DPPRPDW,QVSLUDWLRQ 6LHPHQVH6HOHQLD'LPHQVLRQV+RORJLF 0HWKRGVDQG0DWHULDOV'RVHPHDVXUHPHQWVZHUHSHUIRUPHGLQDJUHHPHQWWR DYHUDJHJODQGXODUGRVHIRUPXODWLRQSURSRVHGE\'DQFHHWDO3K\V0HG%LRO ,PDJHTXDOLW\HYDOXDWLRQZDVFDUULHGRXWFRQVLGHULQJWKHIROORZLQJSDUDP HWHUV VLJQDO DQG QRLVH XQLIRUPLW\ 07) 136 &15 SUHVHQFH DQG SURSDJDWLRQ 6FLHQWLILF6HVVLRQ 6 &$' ( ) *+% (XURSHDQ&RQJUHVVRI 5DGLRORJ\ DQGUHVSHF WLYHO\6SHFLÀFLW\RIF&7 DZDVVLJQLÀFDQWO\ORZHUIRU&6GXHWRODFNRI SDWLHQWVZLWKRXWVLJQLÀFDQWVWHQRVLV6HQVLWLYLW\DQGVSHFLÀFLW\RI0'&7ZDV VLJQLÀFDQWO\ORZHUFRPSDUHGWRQHZHU&7JHQHUDWLRQV &RQFOXVLRQ(YHQLQFDVHRIVHYHUHFRURQDU\FDOFLÀFDWLRQVHQVLWLYLW\DQGVSHFLÀFLW\ RIF&7 DIRUVLJQLÀFDQWVWHQRVLVLVKLJK:LWK0'&7DQGQHZHUVFDQQHUJHQHUD WLRQVD&6FXWRIIIRUSHUIRUPLQJF&7 DVHHPVQRORQJHULQGLFDWHG % (YDOXDWLRQRIOHIWPDLQFRURQDU\LQVWHQWUHVWHQRVLVE\GXDOVRXUFH &7 FRPSDULVRQZLWKLQYDVLYHDQJLRJUDSK\DQGLQWUDYDVFXODUXOWUDVRXQG 7 $GOD-9HVHOND'=HPDQHN3 &DGRYD96XFKDQHN/0LNVLN05RFHN 3UDJXH&=WKHRGRUDGOD#OIPRWROFXQLF] 3XUSRVH7 RHYDOXDWHWKHGLDJQRVWLFDFFXUDF\RIGXDOVRXUFHFRPSXWHGWRPRJUDSK\ FRURQDU\DQJLRJUDSK\&7&$FRPSDUHGWRLQYDVLYHFRURQDU\DQJLRJUDSK\,&$ DQG LQWUDYDVFXODU XOWUDVRXQG ,986 IRU GHWHFWLRQ DQG TXDQWLÀFDWLRQ RI LQVWHQW UHVWHQRVLV 0HWKRGVDQG0DWHULDOV)LIW\RQHSDWLHQWVZLWKSHUFXWDQHRXVFRURQDU\LQWHUYHQ WLRQ RI WKH /0 ZHUH SURVSHFWLYHO\ HYDOXDWHG 7KLUW\IRXU RI WKHP XQGHUZHQW FRPSOHWHIROORZXSH[DPLQDWLRQVPHGLDQPRQWKVDIWHULQWHUYHQWLRQ&7&$,&$ DQG,986DVJROGVWDQGDUGH[DPLQDWLRQWKDWIRFXVHGRQGHWHFWLRQDQGTXDQWLÀFD WLRQRIUHVWHQRVLV 5HVXOWV6HQVLWLYLW\VSHFLÀFLW\SRVLWLYHDQGQHJDWLYHSUHGLFWLYHYDOXHVRI,&$DQG &7&$ZHUHDQGUHVSHFWLYHO\ 7KHUHZDVDPRGHUDWHFRUUHODWLRQEHWZHHQWKHPLQLPDOOXPLQDODUHDV0/$PHDV XUHGE\&7&$DQG,986U S $%ODQG$OWPDQDQDO\VLVVKRZHGWKDWWKH 0/$PHDVXUHGE\&7&$ZDVXQGHUHVWLPDWHGPHDQGLIIHUHQFHPP &RQFOXVLRQ7KHVHUHVXOWVVXJJHVWHGWKDWGXDOVRXUFH&7&$KDVDKLJKQHJD WLYHSUHGLFWLYHYDOXHDQGPLJKWEHFRQVLGHUHGDOHVVLQYDVLYHDOWHUQDWLYHWR,&$IRU H[FOXVLRQRI/0LQVWHQWUHVWHQRVLV+RZHYHUWKHUHZDVRQO\DPRGHUDWHFRUUHOD WLRQEHWZHHQWKHPHDVXUHPHQWVRI0/$VE\,986DQG&7&$LQWKHVWHQWHG/0V 7KHUHIRUHÀQGLQJRIDQ\UHVWHQRVLVDFFRUGLQJWR&7&$VKRXOGEHUHHYDOXDWHGE\ ,&$RUEHWWHUE\VXEVHTXHQW,986 % &RURQDU\FRPSXWHGWRPRJUDSK\DQJLRJUDSK\IRUGHWHFWLRQRIRFFXOW FRURQDU\DUWHU\GLVHDVHLQDV\PSWRPDWLFSDWLHQWV $+LGDOJR0'HVFDO]R5/HWD3HWUDFFD/6HJXUD63XMDGDV) &DUUHUDV *3RQV/ODGR%DUFHORQD(6DOKLGDOJRS#JPDLOFRP 3XUSRVH7KHSXUSRVHRIWKLVVWXG\LVWRDVVHVVWKHDFFXUDF\RIFRURQDU\FRPSXWHG WRPRJUDSK\DQJLRJUDSK\&7$IRUGHWHFWLQJVLJQLÀFDQWFRURQDU\DUWHU\GLVHDVH &$'OXPHQUHGXFWLRQDQGHYDOXDWHWKHLPSDFWLQWKHULVNVWUDWLÀFDWLRQRI PLGGOHDJHGDV\PSWRPDWLFSDWLHQWV 0HWKRGVDQG0DWHULDOV$WRWDORIFRQVHFXWLYHPLGGOHDJHGDV\PSWRPDWLF LQGLYLGXDOVPHQPHDQDJH\HDUVXQGHUZHQW&7$VOLFHPXOWLGHWHFWRU URZFRPSXWHGWRPRJUDSK\DVSDUWRIDJHQHUDOKHDOWKVFUHHQLQJ0HGLXPIROORZXS ZDV\HDUV\HDUV 5HVXOWV $WKHURVFOHURWLFSODTXHV$3ZHUHLGHQWLÀHGLQLQGLYLGXDOV LQGLYLGXDOVOXPLQDOVWHQRVLVZDVVLJQLÀFDQW$JHGGHFDGHPDOH JHQGHUS GLDEHWHVS VHUXPFKROHVWHUROVPRNLQJDQGK\SHUWHQ VLRQ S ZHUH UHODWHG ZLWK WKH SUHVHQFH RI DWKHURVFOHURVLV7KH SDWLHQW JURXSZLWK$3KDGDPHGLXPRIFDUGLRYDVFXODUULVNVJUHDWHUYV S ,QWKHPLGWHUPIROORZXSSDWLHQWGLHGEHFDXVHRIDFDUGLRYDVFXODU FDXVHSDWLHQWKDGP\RFDUGLDODFXWHLQIDUFWDQGUHTXLUHGVWHQWLPSODQWDWLRQ%RWK KDGQRQREVWUXFWLYH$3DW&7$SDWLHQWVKDGDW\SLFDOFKHVWSDLQ &RQFOXVLRQ 7KH SUHYDOHQFH RI VXEFOLQLFDO DWKHURVFOHURVLV VKRZHG E\ &7$ LQ DQDV\PSWRPDWLFSRSXODWLRQLVKLJKDQGLWZDVUHODWHGZLWKDKLJKHUQXPEHURI FDUGLRYDVFXODU ULVNV 1HYHUWKHOHVV WKH QXPEHU RI PDMRU HYHQWVLQ WKH PLGWHUP IROORZXSZDVORZ % 8WLOLW\RIFRPSXWHGWRPRJUDSK\FRURQDU\DQJLRJUDSK\&7&$LQ GLDJQRVLVRIFDUGLDFDOORJUDIWYDVFXORSDWK\&$9 .(7ZHHG&/HZLV-3DUDPHVKZDU'*RSDODQ&DPEULGJH8. NDWKDULQHWZHHG#GRFWRUVRUJXN 3XUSRVH(YDOXDWHFDUGLDFDOORJUDIWFRURQDU\DUWHU\YDVFXORSDWK\XVLQJ&7&$ &RPSDUH&7&$WRFDWKHWHUDQJLRJUDSK\ 0HWKRGVDQG0DWHULDOV5HWURVSHFWLYHDQDO\VLVRIFDUGLDFWUDQVSODQWSDWLHQWV VHOHFWHG RQ WKH EDVLV RI &7&$ SHUIRUPHG RQ VOLFH GXDO VRXUFH& 7 R Y H U D IRXU\HDUSHULRGLQDWHUWLDU\FDUGLRWKRUDFLFFHQWUH&7&$DQGPDWFKHGFDWKHWHU VRIWZDUH7 HUD5HFRQ&$86$LQFRPSDULVRQZLWK05DQG(FKRERWKSHUIRUPHG RQ WKH VDPH GD\ 'XULQJ DOO WKH H[DPLQDWLRQV +5 KDV EHHQ UHFRUGHG 0'&7 LQWHUREVHUYHUDJUHHPHQWZDVDOVRDVVHVVHG 5HVXOWV+5UHFRUGHGGXULQJWKHH[DPLQDWLRQVUHVXOWHGORZHUIRU0'&7 S () UHVXOWHG ORZHU IRU 0'&7 0'&7 05 (FKR16,QFRPSDULVRQZLWK05IRUWKHDVVHVVPHQWRI/9YROXPHV 0'&7VKRZHGKLJKHU('90'&7 P/05P/S(69 0'&7 P/05P/SDQG690'&7 P/50 P/SEXWZLWKPRGHUDWHWRJRRGFRUUHODWLRQU U U UHVSHFWLYHO\ S WR 6OLJKWO\ KLJKHU &2 IRU 0'&7 ZDV IRXQG 0'&7 /05/SZLWKDKLJKFRUUHODWLRQFRHIÀFLHQWYDOXH S0'&7VKRZHGVOLJKWO\KLJKHUYDOXHVRI0DVV0'&7 J P05JPSEXWZLWKDKLJKFRUUHODWLRQU S ([FHOOHQWZDVWKH0'&7LQWHUREVHUYHUDJUHHPHQW&&&!H &RQFOXVLRQ0'&7DOORZVWKHHYDOXDWLRQRIKHDUWWUDQVSODQWHGSDWLHQWVREWDLQ LQJGLDJQRVWLFLPDJHVZLWKDUHODWLYHO\JRRGDJUHHPHQWDQGFRUUHODWLRQZLWK05 IRU/9)DVVHVVPHQW,WVHHPVVXIÀFLHQWO\UHSURGXFLEOHWRFRQVLGHULWVDSSOLFDWLRQ LQWKH)8DQGWRVXSSRUWWKHUDSHXWLFVWUDWHJLHVZLWKWKHDGYDQWDJHWRSHUIRUP /9)DVVHVVPHQWZLWKLQDJOREDOGLDJQRVWLFDSSURDFKLQFOXGLQJFRURQDU\DUWHULHV HYDOXDWLRQLQRQHVLQJOHYHU\IDVWDFTXLVLWLRQ % &DQVHJPHQWHG'LPDJHVEHXVHGIRUVWHQRVLVHYDOXDWLRQLQ FRURQDU\&7DQJLRJUDSK\" &:DQJ$3HUVVRQ-(QJYDOO-'H*HHU:&]HNLHUGD$%MRUNKROP 6*)UDQVVRQg6PHGE\/LQN|SLQJ6( 3XUSRVH7 RUHWURVSHFWLYHO\HYDOXDWHWKHGLDJQRVWLFDFFXUDF\RIFRURQDU\&7DQJL RJUDSK\&&7$XVLQJVHJPHQWHG'GDWDIRUWKHGHWHFWLRQRIVLJQLÀFDQWVWHQRVHV 0HWKRGVDQG0DWHULDOV&&7$GDWDVHWVIURPSDWLHQWVZHUHDFTXLUHGZLWKD VOLFH&7VFDQQHUDQGVHJPHQWHGXVLQJWKHUHJLRQJURZLQJ5*PHWKRGDQG WKH´YLUWXDOFRQWUDVWLQMHFWLRQµ9&PHWKRG7KUHHW\SHVRILPDJHVRIHDFKSDWLHQW ZHUHUHYLHZHGE\GLIIHUHQWUHYLHZHUVIRUWKHSUHVHQFHRIVWHQRVHVZLWKGLDPHWHU UHGXFWLRQ RI RU PRUH )RU WKH RULJLQDO VHULHV WKH UHYLHZHU ZDV DOORZHG WR XVH DOO WKH ' DQG ' YLVXDOLVDWLRQ WRROV DYDLODEOH FRQYHQWLRQDO PHWKRG )RU WKHVHJPHQWHGUHVXOWVIURP5*DQG9&RQO\PD[LPXPLQWHQVLW\SURMHFWLRQZDV XVHG(YDOXDWLRQUHVXOWVZHUHFRPSDUHGZLWKFDWKHWHUDQJLRJUDSK\&$IRUHDFK DUWHU\LQDEOLQGHGIDVKLRQ 5HVXOWV7KLUW\IRXUDUWHULHVZLWKVLJQLÀFDQWVWHQRVLVZHUHLGHQWLÀHGE\&$7KH SHUFHQWDJH RI HYDOXDEOH DUWHULHV DFFXUDF\ DQG QHJDWLYH SUHGLFWLYH YDOXH IRU GHWHFWLQJ VWHQRVLV ZHUH UHVSHFWLYHO\ DQG IRU WKH FRQYHQWLRQDO PHWKRGDQGIRU9&DQGDQGIRU5*$FFXUDF\ ZDVVLJQLÀFDQWO\ORZHUIRUWKH5*PHWKRGWKDQIRUWKHRWKHUWZRPHWKRGVS ZKHUHDVWKHUHZDVQRVLJQLÀFDQWGLIIHUHQFHLQDFFXUDF\EHWZHHQWKH9&PHWKRG DQGWKHFRQYHQWLRQDOPHWKRGS &RQFOXVLRQ'LDJQRVWLFDFFXUDF\IRU5*VHJPHQWHG'GDWDZDVORZHUWKDQZLWK DFFHVVWR'LPDJHV+RZHYHUDVDVFUHHQLQJVWHS'PHWKRGVPD\EHDXVHIXO FRPSOHPHQWWR'UHYLHZLQJ7KH9&EDVHGPHWKRGLVPRUHSURPLVLQJIRUWKLV SXUSRVHWKDQWKH5*EDVHGPHWKRG % 'LDJQRVWLFDFFXUDF\RIFRURQDU\&7DQJLRJUDSK\IRUVWHQRVLV GHWHFWLRQDFFRUGLQJWRFDOFLXPVFRUHV\VWHPDWLFUHYLHZDQGPHWD DQDO\VLV 0$0GHQ'HNNHU .GH6PHW*+GH%RFN5$7LR02XGNHUN 59OLHJHQWKDUW*URQLQJHQ1/%UXVVHOV%(PDP'HNNHU#XPFJQO 3XUSRVH7KHSUHVHQFHRIFRURQDU\FDOFLÀFDWLRQLVFRQVLGHUHGWRQHJDWLYHO\LQÁX HQFHGLDJQRVWLFDFFXUDF\RIFRURQDU\&7DQJLRJUDSK\F&7 D1RFRQVHQVXVH[LVWV RQZKHWKHUF&7 DFDQDFFXUDWHO\GLDJQRVHFRURQDU\DUWHU\GLVHDVHLQFDVHRIDQ HOHYDWHGFDOFLXPVFRUH&6 0HWKRGVDQG0DWHULDOV:HSHUIRUPHGDV\VWHPDWLFUHYLHZDQGPHWDDQDO\VLV WR DVVHVV VHQVLWLYLW\ DQG VSHFLÀFLW\ RI F&7 D IRU VLJQLÀFDQW VWHQRVLV DW GLIIHUHQW GHJUHHVRIFRURQDU\FDOFLÀFDWLRQ$OLWHUDWXUHVHDUFKZDVSHUIRUPHGZLWKLQFOXVLRQ RIVWXGLHVGHVFULELQJWHVWFKDUDFWHULVWLFVRIF&7 DIRUVLJQLÀFDQWVWHQRVLVSHUIRUPHG ZLWKPLQLPDOO\0'&7 E\&6,QYDVLYHFRURQDU\DQJLRJUDSK\ZDVWKHUHIHUHQFH VWDQGDUG3RROHGVHQVLWLYLW\DQGVSHFLÀFLW\RIF&7 DE\GLIIHUHQW&6FDWHJRULHVDQG VFDQQHUJHQHUDWLRQVZHUHFDOFXODWHG 5HVXOWV2IDUWLFOHVRQF&7$VWXGLHVUHSRUWHGRQWKHLPSDFWRIFDOFLXP VFRULQJRQGLDJQRVWLFDFFXUDF\RIF&7 DDQGFRXOGEHLQFOXGHGLQWKHV\VWHPDWLF UHYLHZRIWKHVHVWXGLHVSDUWLFLSDQWVZHUHVXLWDEOHIRUPHWDDQDO\VLV ,QSDWLHQWEDVHGDQDO\VLVVHQVLWLYLW\RIF&7 DIRUVLJQLÀFDQWVWHQRVLVZDV &,DQG IRU&6DQG!UHVSHFWLYHO\6SHFLÀFLW\ZDV 6FLHQWLILF6HVVLRQ $ 6&'()*+%(XURSHDQ&RQJUHVVRI 5DGLRORJ\ )ULGD\ &RQFOXVLRQ+LJKHULQWUDFRURQDU\DWWHQXDWLRQUHVXOWVLQKLJKHULPDJHTXDOLW\DQG GLDJQRVWLFDFFXUDF\IRUGHWHFWLRQRIFRURQDU\DUWHU\VWHQRVLVXVLQJVHFRQGJHQHUD WLRQGXDOVRXUFHFRPSXWHGWRPRJUDSK\FRURQDU\DQJLRJUDSK\ % 5ROHRI&7FRURQDU\DQJLRJUDSK\LQVXVSHFWHGDEH[WULQVHFR FRURQDU\FRPSUHVVLRQLQSDWLHQWVZLWKSXOPRQDU\K\SHUWHQVLRQ 95XVVR(*REEL*5LQDOGL*0LQHR) %XLD//RYDWR1*DOLH 0=RPSDWRUL%RORJQD,7YLUXV#IDVWZHEQHWLW 3XUSRVH 3XOPRQDU\ DUWHU\ K\SHUWHQVLRQ 3$+ LV D UDUH GLVHDVH LQ ZKLFK WKH LQFUHDVHGEORRGSUHVVXUHFDXVHWKLFNHQLQJVWLIIHQLQJDQGWKXVWKHHQODUJHPHQW RIWKHSXOPRQDU\DUWHU\6XFKJURZWKRIWKHSXOPRQDU\DUWHU\FRXOGUDUHO\FDXVH ´DEH[WULVHFRµFRPSUHVVLRQRIWKHFRURQDU\DUWHU\LQPRVWRIWKHFDVHVWKHOHIWPDLQ 7KHDLPRIWKLVVWXG\LVWRHYDOXDWHWKHUROHRIFRURQDU\&7DQJLRJUDSK\&&7$ LQWKHGLDJQRVLVRIVXFKFRPSOLFDWLRQ 0HWKRGVDQG0DWHULDOVIURP-DQXDU\WR-XQHSWV0DQG) PHDQDJHDDZLWK3$+DQGDQJLQDXQGHUZHQW&&7$ 5HVXOWVLQSWVFRURQDU\DUWHU\FRPSUHVVLRQQ RUFRURQDU\DUWHU\ GLVSODFHPHQWZLWKRXWVLJQLÀFDQWFRPSUHVVLRQQ KDYHEHHQREVHUYHG,QSWV RWKHUSRWHQWLDOFDXVHVRIDQJLQDKDYHEHHQGLVFRYHUHGVXFKDVFRURQDU\ DQRPDOLHV FRURQDU\ VWHQRVHV P\RFDUGLDO EULGJHV$OO RI SWV ZLWK FRURQDU\ FRPSUHVVLRQDW&&7$DQGZLWKVLJQLÀFDQWGLVSODFHPHQWZHUHIXUWKHUH[DPLQHG ZLWKFRQYHQWLRQDOFRURQDU\DQJLRJUDSK\ZKLFKFRQÀUPHGUHVXOWVLQSWV KDYHEHHQWUHDWHGZLWKFRURQDU\VWHQWLQJZLWKKHDUWWUDQVSODQWDQGZLWKUHPRG HOOLQJRIWKHSXOPRQDU\DUWHU\SWVDUHZDLWLQJIRUWUHDWPHQWDQGLWLVGHFHDVHG &RQFOXVLRQ,QSWVZLWK3$+DQGVXVSHFWHGDEH[WULQVHFRFRURQDU\DUWHU\FRP SUHVVLRQ&&7$LVDEOHWRLGHQWLI\WKRVHZKLFKQHHGDWUHDWPHQW 5RRP= &RPSXWHU$SSOLFDWLRQV 66 ,PDJHSURFHVVLQJSDUW 0RGHUDWRUV /)LVFKHU9LHQQD$7 (1HUL3LVD,7 % 6HPLDXWRPDWHGVHJPHQWDWLRQDQGFKDUDFWHULVDWLRQRIOLYHUDQGOLYHU OHVLRQVLQFRQWUDVWHQKDQFHG&7LPDJHV &2UVLQL''HOOD/DWWD,%HUQDUGHVFKL*'L*LURODPR03DWURQHOOL 0*XDGDJQL93RVLWDQR'&KLDSSLQR$0RQWHOHRQH0DVVD,7 RUVLQLFKLDUD#JPDLOFRP 3XUSRVH&RPSXWHGWRPRJUDSK\LVWKHPRVWFRPPRQO\XVHGLPDJLQJWHFKQLTXH IRUWKHLQVSHFWLRQRIOLYHUOHVLRQV,WVVSDWLDOUHVROXWLRQDOORZVDUHOLDEOHH[WUDFWLRQ RIOLYHUDQGOHVLRQVIHDWXUHVVXFKDVWKHLUERXQGDULHVVL]HDQGGHQVLW\7KHKLJK YDULDELOLW\RIWKHVHSDUDPHWHUVUHQGHUVWKHVHJPHQWDWLRQWDVNHVSHFLDOO\FKDOOHQJLQJ $PXOWLVWDJHVHPLDXWRPDWLFKHSDWLFWXPRXUVHJPHQWDWLRQPHWKRGLVLQWURGXFHG 0HWKRGVDQG0DWHULDOV$EGRPLQDO&7LPDJHVZLWKWKHXVHRIYHQRXVFRQWUDVW DJHQWZHUHDFTXLUHGIURPSDWLHQWV%RWKOLYHUVHJPHQWDWLRQDQGOLYHUOHVLRQV VHJPHQWDWLRQZHUHUHDOLVHGXVLQJLQIRUPDWLRQIURPSRUWDODQGDUWHULDOSKDVHDQG DSSO\LQJWKUHVKROGLQJDOJRULWKPUHJLRQJURZLQJDOJRULWKPDQGPRUSKRORJLFDORSHUD WRUV $PLQLPDOXVHULQYROYHPHQWLVUHTXLUHGWRJXLGHOLYHUVHJPHQWDWLRQDQGOHVLRQV LGHQWLÀFDWLRQ7KHVRIWZDUHIUDPHZRUNZDVLPSOHPHQWHGLQ-DYDRQ1HW%HDQV,'( 5HVXOWV7KHVRIWZDUHGHWHFWVDOOOLYHUOHVLRQVGLDJQRVHGE\3K\VLFLDQOHVLRQV DQGWKHLUOLQHDUVL]HPP/HVLRQVVHJPHQWDWLRQDOORZVWKHH[WUDFWLRQRI REMHFWLYHSDUDPHWHUVPHDQ&7QXPEHUVWDQGDUGGHYLDWLRQQRUPDOLVHGFRQWUDVW DQG&15LQWKHGLIIHUHQWFRQWUDVWSKDVHV,QDGGLWLRQWRWKHHYDOXDWLRQRI5HFLVW SURWRFROVWDQGDUGGLPHQVLRQVOHVLRQZDVKRXWFXUYHVZHUHFRQVLGHUHG7KURXJK OHVLRQVGHQVLW\DQG&15LVSRVVLEOHWRGLVFULPLQDWHGLIIHUHQWNLQGRIOHVLRQDQG GHÀQHDUHFRJQLVLQJGHFLVLRQDODOJRULWKP &RQFOXVLRQ7KHGHYHORSHGPHWKRGLVDEOHWRLGHQWLI\DOOOLYHUOHVLRQV/HVLRQV ZDVKRXW FXUYHV DOORZ WR REWDLQ DQ DWWHQXDWLRQ SURÀOH LQ WKH WKUHH DFTXLVLWLRQ SKDVHVVRWKDWZHFDQKDYHDUHVSRQVHWRWKHUDS\QRWRQO\LQYROXPHWHUPVEXW DOVRLQWHUPVRIOHVLRQVGHQVLW\YDULDWLRQ DQJLRJUDSK\LQSDWLHQWVZHUHH[DPLQHGXVLQJ,QWHUQDWLRQDO6RFLHW\RI+HDUWDQG /XQJ7UDQVSODQWDWLRQ,6+/7FULWHULDVHJPHQWDODQDO\VLV&$9JUDGLQJRIHDFK SDWLHQWZDVFRPSOHWHGXVLQJ,6+/7FULWHULDLQERWKPRGDOLWLHV 5HVXOWV3DWLHQWFRKRUWPHDQDJHLV\HDUVDQGDVVHVVHGDWDPHDQRI \HDUVSRVWWUDQVSODQW7KHPHDQFRURQDU\DUWHU\FDOFLXPVFRUH$JDWVWRQZDV H[FOXGLQJDFRQIRXQGLQJSDWLHQWZLWKFDOFLXPVFRUHRIRISDWLHQWVKDG &$9RQ&7&$DQGRIWKHVHKDGJUDGH&$9WKHUHPDLQGHUJUDGH&$9&$9 ZDVGHPRQVWUDWHGXVLQJ&7&$ZLWKVHQVLWLYLW\RIDQGVSHFLÀFLW\RIRQ ,6+/7VHJPHQWDODQDO\VLVFRPSDUHGZLWKFDWKHWHUDQJLRJUDSK\7KHUHZDV FRQFRUGDQFHRISDWLHQW&$9JUDGLQJEHWZHHQ&7&$DQGFDWKHWHUDQJLRJUDSK\ &RQFOXVLRQ&DUGLDFDOORJUDIWYDVFXORSDWK\LVUHOLDEO\GHPRQVWUDWHGXVLQJ&7&$ FRPSDUHGZLWKFDWKHWHUDQJLRJUDSK\&RURQDU\DUWHU\YDVFXORSDWK\LVGLIIHUHQWLDWHG IURPDWKHURVFOHURWLFGLVHDVH5RXWLQHXVHRIOHVVLQYDVLYH&7&$IRUVXUYHLOODQFH SRVWKHDUWWUDQVSODQWPD\EHIHDVLEOHEXWQHHGVIXUWKHUVWXG\ % ,PSDFWRIGLIIHUHQWOHYHOVRIFRURQDU\FDOFLXPVFRUHRQWKH SUHYDOHQFHRIFRURQDU\DUWHU\VWHQRVLVLQSDWLHQWVZLWKDQ LQWHUPHGLDWHSUHWHVWOLNHOLKRRGRIFRURQDU\DUWHU\GLVHDVH 7 +HQ]OHU19RJOHU00H\HU3 $SIDOWUHU66XGDUVNL626FKRHQEHUJ F)LQN0DQQKHLP'(WKRPDVKHQ]OHU#PHGPDXQLKHLGHOEHUJGH 3XUSRVH 7 R LQYHVWLJDWH WKH SUHYDOHQFH RI VLJQLÀFDQW FRURQDU\ DUWHU\ VWHQRVLV RQ FRURQDU\ FDWKHWHUL]DWLRQ LQ SDWLHQWV ZLWK DQ LQWHUPHGLDWH SUHWHVW OLNHOLKRRG RIFRURQDU\DUWHU\GLVHDVHDWGLIIHUHQWOHYHOVRIFRURQDU\FDOFLXPVFRUH&&6 0HWKRGVDQG0DWHULDOVSDWLHQWVIHPDOHV\HDUVZLWKDQLQWHU PHGLDWHSUHWHVWOLNHOLKRRGRIFRURQDU\DUWHU\GLVHDVHXQGHUZHQW&&6&7SULRUWR FRURQDU\FDWKHWHUL]DWLRQ7KHSUHYDOHQFHRIVLJQLÀFDQWFRURQDU\DUWHU\VWHQRVLV !RQFRURQDU\FDWKHWHUL]DWLRQZDVFRUUHODWHGWRGLIIHUHQW&&6OHYHOVXV LQJWKH$JDWVWRQVFRUH$6$6!$6!$6!$6!$6! 5HVXOWV 0HDQ$6 ZDV &RURQDU\ FDWKHWHUL]DWLRQ UHYHDOHG VWHQRVLV !LQRISDWLHQWV0HDQ$6RISDWLHQWVZLWKFRQÀUPHGVWHQRVLV! ZDV UDQJH 7KH VHQVLWLYLW\ VSHFLÀFLW\ SRVLWLYH SUHGLFWLYH YDOXH339DQGQHJDWLYHSUHGLFWLYHYDOXH139WRSUHGLFWVLJQLÀFDQWVWHQRVLVRQ FRURQDU\FDWKHWHUL]DWLRQZDVDQGXVLQJDQ$6FXWRII YDOXH!XVLQJDQ $6FXWRIIYDOXH! XVLQJDQ$6FXWRIIYDOXH!XVLQJDQ$6 FXWRIIYDOXH!DQGDQGXVLQJDQ$6FXWRIIYDOXH !UHVSHFWLYHO\ &RQFOXVLRQ ,Q SDWLHQWV ZLWK DQ LQWHUPHGLDWH SUHWHVW OLNHOLKRRG RI FRURQDU\ DUWHU\GLVHDVHDQ$6EHWZHHQPDNHVDVLJQLÀFDQWFRURQDU\DUWHU\VWHQRVLV YHU\XQOLNHO\7KXV&&6&7SURYLGHVDGGLWLRQDOLQIRUPDWLRQLQFRPELQDWLRQZLWK WUDGLWLRQDOFOLQLFDOULVNIDFWRUVHJ)UDPLQJKDPVFRUHWRDFFXUDWHO\SUHGLFWWKHULVN RIWKRVHSDWLHQWV % ,QÁXHQFHRILQWUDFRURQDU\HQKDQFHPHQWRQSHUIRUPDQFHRIVHFRQG JHQHUDWLRQGXDOVRXUFH&7FRURQDU\DQJLRJUDSK\ (0DIIHL &0DUWLQL66HLWXQ) &DGHPDUWLUL0RQDVWLHUGL7UHYLVR,7 *HQRD,7 3XUSRVH 7 R DVVHVV WKH HIIHFW RI LQWUDFRURQDU\ DWWHQXDWLRQ RQ GLDJQRVWLF DF FXUDF\ XVLQJ VHFRQG JHQHUDWLRQ GXDO VRXUFH FRPSXWHG WRPRJUDSK\FRURQDU\ DQJLRJUDSK\&&7 0HWKRGV DQG 0DWHULDOV SDWLHQWV ZLWK VXVSHFWHG FRURQDU\ DUWHU\ GLVHDVH ZKR XQGHUZHQW FRQYHQWLRQDO FRURQDU\ DQJLRJUDSK\ &$ DQG &&7 ZHUH HYDOX DWHG&&7ZDVSHUIRUPHGZLWKFROOLPDWLRQ[[PPDQGURWDWLRQWLPHPV XVLQJPORIKLJKFRQFHQWUDWLRQFRQWUDVWPDWHULDO,RPHSUROPJ,PO DGPLQLVWHUHGDWPOV7KHVWXG\SRSXODWLRQZDVGLYLGHGLQWRWZRJURXSVRI SDWLHQWVEDVHGRQPHGLDQ+8YDVFXODUDWWHQXDWLRQPHDVXUHGDWWKHRULJLQRI WKHFRURQDU\DUWHULHVJURXS PHQDWWHQXDWLRQPHGLDQYDOXHJURXS DWWHQX DWLRQ!PHGLDQYDOXH,PDJHTXDOLW\DQGGLDJQRVWLFDFFXUDF\IRUWKHGHWHFWLRQRI VLJQLÀFDQWFRURQDU\DUWHU\VWHQRVLVZDVGHWHUPLQHGDQGFRPSDUHGIRUERWKJURXSV 5HVXOWV1RVLJQLÀFDQWGLIIHUHQFHVEHWZHHQJURXSVDQGZHUHQRWHGLQWHUPV RIDJHJHQGHUKHDUWUDWHFRURQDU\FDOFLXPVFRUHDQGERG\PDVVLQGH[2YHUDOO VLJQLÀFDQWVWHQRVLVLQJURXSDQGLQJURXSZHUHGHWHFWHGLQ DVVHVVDEOH FRURQDU\ DUWHU\ VHJPHQWV 7KH DYHUDJH LQWUDFRURQDU\ DWWHQXDWLRQ ZDVVLJQLÀFDQWO\SKLJKHUIRUJURXS+8FRPSDUHGWRJURXS +8,PDJHTXDOLW\DQGFRUUHVSRQGLQJVHQVLWLYLW\VSHFLÀFLW\YDOXHVZHUH KLJKHUIRUJURXSDQGUHVSHFWLYHO\WKDQIRUJURXSDQG UHVSHFWLYHO\ 6FLHQWLILF6HVVLRQ 6 &$' ( ) *+% (XURSHDQ&RQJUHVVRI 5DGLRORJ\ OLQHÀQGLQJVORFDWLRQVUHOHYDQWUHSRUWHGÀQGLQJVHJO\PSKQRGHVRUYHVVHO MXQFWLRQVZHUHHYDOXDWHG0DQXDOQDYLJDWLRQE\WZRH[SHULHQFHGUDGLRORJLVWVWR FRUUHVSRQGLQJÀQGLQJVLQIROORZXSGDWDZDVWDNHQDVJROGVWDQGDUGDQGFRPSDUHG WRV\VWHPEDVHGQDYLJDWLRQ(UURULQPPEHWZHHQPDQXDODQGDXWRPDWLFQDYLJDWLRQ ZDVGRFXPHQWHGDVFUDQLRFDXGDOYHQWURGRUVDOODWHUDOOHIWRUODWHUDOULJKWGHYLD WLRQ0HDQGHYLDWLRQVDQGLQWUDFODVVFRUUHODWLRQFRHIÀFLHQW,&&ZHUHHYDOXDWHG 5HVXOWV7KHPHDQGHYLDWLRQRIWKHUHSRUWHGOHVLRQVIRUUHDGHUZDVPP ZLWKVLPLODUGHYLDWLRQVLQDOOGLUHFWLRQVPPFUDQLDOPPFDXGDOPP YHQWUDOPPGRUVDOPPODWHUDOOHIWPPODWHUDOULJKWDQGPPIRU UHDGHUPPFUDQLDOPPFDXGDOPPYHQWUDOPPGRUVDOPP ODWHUDOOHIW PP ODWHUDOULJKW ,&& ZDV )RU ERWK UHDGHUV WKHUH ZDV QR GHYLDWLRQELDVLQWRDSDUWLFXODUGLUHFWLRQ &RQFOXVLRQ $XWRPDWHGVHPDQWLFQDYLJDWLRQLQ&7IROORZXSGDWDSURYLGHVFOLQLFDOO\ VXIÀFLHQWDFFXUDF\DQGUHSURGXFLELOLW\DOORZLQJDXWRPDWHGVLGHE\VLGHYLHZLQJRI FRUUHVSRQGLQJORFDWLRQVLQEDVHOLQHDQGIROORZXSGDWD,WVKRXOGLPSURYHKDQGOLQJ ODUJHGDWDVHWVDQGVSHHGXSUDGLRORJLFDOUHDGLQJ % $QDXWRPDWHGPHWKRGIRUYLVXDOLVLQJFKDQJHVLQYHVVHOZDOOG\QDPLFV (6FKZDUW]*/DQJV-+ROIHOG0&]HUQ\9LHQQD$7,QQVEUXFN$7 %HUQH&+(UQVW6FKZDUW]#PHGXQLZLHQDFDW 3XUSRVH7KH VWXG\ RI HIIHFWV RI YDVFXODU LQWHUYHQWLRQV LV WRGD\ PRVWO\ OLPLWHG WRVWDWLFYHVVHOPRGHOV7KLVUHSUHVHQWVDQRYHUVLPSOLÀFDWLRQLQWKHFDVHRIWKH WKRUDFLFDRUWDZKLFKLVVWURQJO\LQÁXHQFHGE\WKHPRWLRQRIWKHP\RFDUGLXP 0HWKRGV DQG 0DWHULDOV ,Q WKLV SDSHU ZH SURSRVH D IUDPHZRUN HQDEOLQJ WKH TXDQWLÀFDWLRQDQGYLVXDOLVDWLRQRIWKHPRWLRQRIWKHWKRUDFLFDRUWDIURP(&*JDWHG &7$VHTXHQFHVGXULQJWKHFDUGLDFF\FOH7KHYHVVHOLVVHJPHQWHGDQGWUDFNHG DXWRPDWLFDOO\WKURXJKDKHDUWEHDW7KHH[WUDFWHGPRWLRQRIWKHDRUWDLVGHFRPSRVHG LQPHDVXUHVRISXOVDWLRQEHQGLQJDQGVWUHWFKLQJ:HIXUWKHUJHQHUDWHDQRYHO' UHSUHVHQWDWLRQRIWKHYHVVHOG\QDPLFVIRUTXLFNYLVXDODVVHVVPHQW 5HVXOWV:HXVHGWKHSURSRVHGPHWKRGWRHYDOXDWHWKHHIIHFWVRIVWHQWJUDIWLQJLQ WKHDRUWLFDUFKDIWHUVXSUDDRUWLFUHURXWLQJLQFDVHV7KHREWDLQHGPHDVXUHPHQWV DQGWKHLUYLVXDOUHSUHVHQWDWLRQJLYHGHWDLOHGLQVLJKWLQWRRISDWWHUQVRIPRYHPHQWLQ WKHWKRUDFLFDRUWDDVZHOODVFKDQJHVLQGXFHGE\VWHQWJUDIWLQJRIWKHDRUWLFDUFK (OHYDWHGVWUDLQGXHWRGLIIXVHPRWLRQDWWKHEHJLQQLQJRIWKHSURVWKHVLVFRXOGEH REVHUYHGLQDOOFDVHV7KHLQÁXHQFHRIVWHQWOHQJWKDQGSODFHPHQWFRXOGDOVREH TXDQWLÀHGXVLQJWKHSURSRVHGPHWKRG &RQFOXVLRQ:HGHYHORSHGDQDXWRPDWHGPHWKRGWRDLGWKHYLVXDOLQVSHFWLRQRI WKHHIIHFWVRIYDVFXODULQWHUYHQWLRQVLQWKHDRUWLFDUFK$VDÀUVWH[DPSOHRIWKH DSSOLFDWLRQRIWKHSURSRVHGPHWKRGZHFRXOGGHVFULEHWKHLQÁXHQFHVRIWKHOHQJWK DQGORFDWLRQRIDVWHQWJUDIWLQWKHDRUWLFDUFKLQFDVHV % 7RZDUGVHIÀFLHQWVLPXOWDQHRXVPXOWLSDWLHQWDQQRWDWLRQRI' LPDJLQJGDWD :/DQJ5'RQQHU9LHQQD$7H #VWXGHQWWXZLHQDFDW 3XUSRVH0DQXDOVHJPHQWDWLRQVRIPHGLFDOGDWDDUHWHGLRXVDQGWLPHLQWHQVLYH PXOWLSOHVHJPHQWDWLRQVTXLFNO\EHFRPHSURKLELWLYHO\H[SHQVLYHHVSHFLDOO\RQ' GDWD 2EVHUYLQJ WKLV ZH GHYHORSHG DQ LQWHUDFWLYH LQFUHPHQWDO DQQRWDWLRQ WRRO IRU JHQHULF PHGLFDO LPDJH GDWD IRFXVLQJ RQ VLPXOWDQHRXV ZHDNO\ VXSHUYLVHG FODVVLÀFDWLRQEDVHGPXOWLSDWLHQWVHJPHQWDWLRQV 0HWKRGVDQG0DWHULDOV:HXVHDQLQLWLDORYHUVHJPHQWDWLRQPHWKRGVVXFKDV 6XSHUSL[HOVWRFOXVWHUVSDWLDOO\FRKHUHQWKRPRJHQHRXVVWUXFWXUHVZKLOHUHWDLQLQJ HGJHLQIRUPDWLRQ8VHUJXLGHGEUXVKVWURNHVPDUNUHSUHVHQWDWLYHVIRUHDFKODEHO FODVVZLWKLQWKHLPDJHZKLFKDUHSDVVHGWRDUDQGRPIRUHVWOHDUQLQJLPSOHPHQ WDWLRQ5HVXOWLQJSULRUVFRPELQHGZLWKORFDOGHVFULSWRUVDQGRSWLPLVHGE\D05) VROYHUJLYHDÀUVWHVWLPDWLRQRIGHVLUHGDSSHDUDQFHVLQDOOPXOWLSDWLHQWYLHZV6XF FHVVLYHLQWHUDFWLRQVUHÀQHWKHDQQRWDWLRQPDNLQJPD[LPDOXVHRIHDFKXVHULQSXW 5HVXOWV7KHUHVXOWLQJIUDPHZRUNSURYLGHVDPXOWLSDWLHQWYLHZDOORZLQJWRLQWHUDFW ZLWKDOOLQGLYLGXDODQQRWDWLRQVLPXOWDQHRXVO\:HHYDOXDWHWKHVHJPHQWDWLRQUHVXOWV RQOHIWKDQG&7 VZHFDOFXODWHWKH'LFHFRHIÀFLHQWEHWZHHQRXUJURXQGWUXWK DQGVHJPHQWDWLRQUHVXOWV:HUHDFKDQRYHUODSRILQPHWDFDUSDOV LQ SUR[LPDO SKDODQJHV DQG LQ LQWHUPHGLDWH SKDODQJHV RQ [ SL[HO VL]HGLPDJHVZLWKDSSUR[LPDWHO\RYHUVHJPHQWDWLRQSULPLWLYHV6XSHUSL[HOV &RQFOXVLRQ 8VLQJ RYHUVHJPHQWDWLRQ WURXJK 6XSHUSL[HOV FRPELQHG ZLWK ORFDO GHVFULSWRUVPDNHVWKHODEHOOLQJSUREOHPLQPXOWLSDWLHQWVHJPHQWDWLRQVWUDFWDEOH &RQVLVWHQW ZLWK RXU JRDO RI SURYLGLQJ ZKROH LPDJH ODEHOOLQJ DQQRWDWLRQV QRW LQGLYLGXDOREMHFWGHOLQHDWLRQVE\ORZHULQJDFFXUDF\GXHWRWKH6XSHUSL[HOVWKH DQQRWDWLRQWLPHIRUDZKROHVHWRISDWLHQWGDWDHJKDQG&7 VLVDIUDFWLRQRIWKH WLPHUHTXLUHGXVLQJFXUUHQWDQQRWDWLRQWRROV % $XWRPDWHGGHWHFWLRQDQGPHDVXUHPHQWRIXWHULQHSHULVWDOVLVLQFLQH 05LPDJHV .<DQR .:DWDQDEH0< .DWDRND$.LGR.7 RJDVKL2VDND-3 .\RWR-3N\DQR#LVRLWDFMS 3XUSRVH&KDQJHVLQGLUHFWLRQDQGLQFLGHQFHRIXWHULQHSHULVWDOVLVQDPHO\ZDY\ FRQGXFWLRQ RI VXEHQGRPHWULDO P\RPHWULXP MXQFWLRQDO ]RQH DUHVXSSRVHG WR VWURQJO\DIIHFWFRQGLWLRQVVXFKDVLQIHUWLOLW\DQGG\VPHQRUUKRHD,QWKLVVWXG\ZH KDYHGHYHORSHGDQGHYDOXDWHGVRIWZDUHWRGHWHFWDQGTXDQWLI\WKHSHULVWDOVLVLQ FLQH05LPDJHV 0HWKRGVDQG0DWHULDOV $WRWDORIVHULDO+$67(LPDJHVLQDPLGVDJLWWDOSODQHRI WKHXWHUXVRIKHDOWK\IHPDOHVZHUHREWDLQHGHYHU\VHFRQGV8WHULQHSHULVWDOVLV ZDVGHÀQHGDVUK\WKPLFFKDQJHVRIVLJQDOLQWHQVLWLHVDQGWKHLUSURSDJDWLRQVLQ MXQFWLRQDO]RQH2XUVRIWZDUHÀUVWFDOFXODWHGFURVVFRUUHODWLRQEHWZHHQWLPHFRXUVHV RISL[HOLQWHQVLWLHVLQDVHFWLRQRIMXQFWLRQDO]RQHDQGWKRVHRIQHLJKERXULQJVHFWLRQV 7KHFURVVFRUUHODWLRQZDVKLJKZLWKDSSURSULDWHWLPHODJZKHQWUDYHOOLQJZDYHZDV SUHVHQW)RUWKHVHFWLRQVZKHUHWKHWUDYHOOLQJZDYHVZHUHGHWHFWHGWKHVRIWZDUH FDOFXODWHGDXWRFRUUHODWLRQRIWLPHFRXUVHRIWKHVLJQDOLQWHQVLWLHVDQGREWDLQHGZDYH SHULRGVIURPSHDNLQWHUYDOVRIWKHDXWRFRUUHODWLRQ7ZRUDGLRORJLVWVPHDQZKLOH YLVXDOO\DVVHVVHGXWHULQHSHULVWDOVLVXVLQJWKHVDPHLPDJHVHULHV 5HVXOWV7KHUHVXOWVIURPWKHDXWRPDWHGPHWKRGZHUHFRQVLVWHQWZLWKWKRVHRI YLVXDODVVHVVPHQWVDQGKDGOHVVYDULDQFHPHDQFRXQWVE\VRIWZDUHREVHUYHUV $ DQG%ZHUH6'6'DQG6'UHVSHFWLYHO\:HLJKWHGNDSSD EHWZHHQVRIWZDUHDQGREVHUYHU$VRIWZDUHDQGREVHUYHU%DQGREVHUYHUV$DQG %ZHUHDQGUHVSHFWLYHO\LQGLFDWLQJYDULDWLRQVEHWZHHQVRIWZDUH DQGKXPDQVZHUHVPDOOHUWKDQWKDWEHWZHHQKXPDQV &RQFOXVLRQ8WHULQHSHULVWDOVLVFDQEHGHWHFWHGDQGFRXQWHGE\DXWRPDWHGHYDOX DWLRQV2XUPHWKRGPD\EHXVHGIRUDURXWLQHIXQFWLRQDODVVHVVPHQWRIXWHUXV % 'LJLWDOSHUIXVLRQSKDQWRPVDQGWKHLUXVHLQSHUIXVLRQYDOLGDWLRQ 263LDQ\NK1HZWRQ+LJKODQGV0$86RSLDQ\NK#ELGPFKDUYDUGHGX 3XUSRVH 'HVSLWH WKH LQFUHDVLQJO\ EURDG XVH RI SHUIXVLRQ DSSOLFDWLRQVZH VWLOO KDYH QR JHQHUDOO\ DFFHVVLEOH PHDQV IRU WKHLU REMHFWLYH YDOLGDWLRQ7 R VROYH WKLV SUREOHPZHLQWURGXFHGLJLWDOSHUIXVLRQSKDQWRPV'33VLPXODWHG',&20LP DJHVVHTXHQFHVVSHFLÀFDOO\GHVLJQHGWRKDYHNQRZQSHUIXVLRQPDSVZLWKVLPSOH YLVXDOSDWWHUQV 0HWKRGVDQG0DWHULDOV/HW6EHDWHPSRUDOSHUIXVLRQLPDJHVHTXHQFH6 ^, ,õ,Qõ,1`:HGHÀQHGLJLWDOSHUIXVLRQSKDQWRP'33DVDFRPSXWHUVLPXODWHG LPDJHVHTXHQFH6ZKHUHHDFKWHPSRUDOSL[HOYDOXH,Q[\ ,Q[\WQLVJHQHUDWHG WRKDYHSUHGHÀQHGYLVXDOSHUIXVLRQPDSSDWWHUQV7KDWLVJLYHQEORRGÁRZ)% EORRGYROXPH9%DQGPHDQWUDQVLWWLPH70PDSVZHEXLOG'33LPDJHVHTXHQFH 6WRSURGXFHWKHVHPDSV:KLOHDQ\SHUIXVLRQDOJRULWKPZRUNVDQXPHULFDOVROYHU IRUSHUIXVLRQFRQYROXWLRQHTXDWLRQ'33EHFRPHVDNQRZQVROXWLRQWRLWZKLFK FDQEHXVHGWRYHULI\WKHDOJRULWKPFRUUHFWQHVV 5HVXOWV:HGHYHORSHGDLPDJH'33ZKHUH)%9%DQG70PDSVFRQVLVWRI VLPSOHOLQHDUSDWWHUQV:HWKHQSURFHVVHGRXU'33ZLWKVHYHUDOSHUIXVLRQSDFN DJHVFRPSDULQJWKHUHVXOWLQJPDSVWRWKHH[SHFWHG7KLVFRPSDULVRQSURYLGHGDQ LQVWDQWDQHRXVDQGREMHFWLYHYLVXDOLVDWLRQRISHUIXVLRQDOJRULWKPVҋGHÀFLHQFLHVDV ZHOODVWKHLUVHQVLWLYLW\WRQRLVHDQGVPDOOGHWDLOV'33 XVHGZLWKGLIIHUHQWSHUIXVLRQ VRIWZDUHDQGSURWRFROVFDQFOHDUO\YLVXDOLVHSURFHVVLQJHUURUVDQGGLVFUHSDQFLHV &RQFOXVLRQ3URFHVVLQJ'33SHUIXVLRQVHTXHQFHZLWKDQ\SHUIXVLRQDOJRULWKP VRIWZDUHRIFKRLFHDQGFRPSDULQJWKHUHVXOWVWRWKHH[SHFWHG'33SDWWHUQVSUR YLGHVDUREXVWDQGVWUDLJKWIRUZDUGZD\WRFRQWUROWKHTXDOLW\RISHUIXVLRQDQDO\VLV VRIWZDUHDQGSURWRFROV % $XWRPDWHGVHPDQWLFQDYLJDWLRQDQGV\QFKURQLVHGDOLJQPHQWLQ EDVHOLQHDQGIROORZXSIXOOERG\&7VFDQVFOLQLFDOIHDVLELOLW\DQGDFFXUDF\ 3 'DQNHUO0+DPPRQ06XHKOLQJ$7 V\PEDO08GHU$&DYDOODUR (UODQJHQ'(SHWHUGDQNHUO#XNHUODQJHQGH 3XUSRVH&RPSDULQJÀQGLQJVIURPLQLWLDODQGIROORZXSH[DPLQDWLRQVLQLQFUHDVLQJ IXOOERG\&7GDWDLVDFKDOOHQJLQJDQGWLPHFRQVXPLQJWDVNIRUUDGLRORJLVWV:H HYDOXDWHGSUDFWLFDELOLW\DQGSHUIRUPDQFHRIDXWRPDWHGVHPDQWLFQDYLJDWLRQDQG V\QFKURQLVHGDOLJQPHQWLQURXWLQHFOLQLFDOIROORZXS&7GDWD 0HWKRGV DQG 0DWHULDOV ,QLWLDO DQG IROORZXS &7 VWXGLHV IURP RQFRORJLFDO SDWLHQWV XQGHUJRLQJ URXWLQH &7 VWDJLQJ ZHUH UHWURVSHFWLYHO\ LQFRUSRUDWHG LQWR 7+(6(860(',&2VRIWZDUH *HUPDQ IHGHUDO SURMHFWQXPEHU 04 ZKLFKDXWRPDWLFDOO\GHWHFWVRUJDQVDQGDQDWRPLFDOODQGPDUNVXVHGIRUDXWRPDWLF VHPDQWLFDOLJQPHQWDQGSUHGLFWLRQRIÀQGLQJVORFDWLRQVLQIROORZXSGDWDIURPEDVH 6FLHQWLILF6HVVLRQ $ 6&'()*+%(XURSHDQ&RQJUHVVRI 5DGLRORJ\ )ULGD\ VLRQFRPSXWHGWRPRJUDSK\63(&7WKLVSURMHFWSURSRVHVWKHLPSOHPHQWDWLRQRI DK\EULGURXWLQHXVLQJWKHFRPELQDWLRQRIWKH6KDQQRQDQGWKH7VDOOLVHQWURSLHVLQ WKH6WDWLVWLFDO3DUDPHWULF0DSSLQJFRUHJLVWUDWLRQ 0HWKRGVDQG0DWHULDOV05,DQG63(&7RIPRUSKRORJLFDOO\QRUPDOSDWLHQWZHUH XVHGIRUWKHFRQVWUXFWLRQRIVLPXODWRUVZKLFKZHUHFRUHJLVWHUHGZLWKWKHRULJLQDO LPDJHVXVLQJWKHSURSRVHGK\EULGURXWLQHDQGWKHLQGLYLGXDORQHV7KHFRPSDUDWLYH DQDO\VLVEHWZHHQWKHURXWLQHVUHOLDELOLW\ZDVSHUIRUPHGEDVHGRQWKHURRWPHDQ VTXDUH506HUURURIWKHURWDWLRQDQGWUDQVODWLRQSDUDPHWHUV 5HVXOWV3UHOLPLQDU\UHVXOWVVKRZHGWKDWWKHK\EULGURXWLQHOHDGHGWRDPRUHUHOLDEOH LQWHUPRGDOLW\FRUHJLVWUDWLRQIRUVLPXODWRUVZLWKVPDOOWUDQVIRUPDWLRQVEDVHGRQ WKH506HUURUDVH[SHFWHG0RUHFRUHJLVWUDWLRQVDUHEHLQJSHUIRUPHGWRFRQÀUP WKHVHUHVXOWVIRUWKHVLPXODWRUVZLWKODUJHUWUDQVIRUPDWLRQV &RQFOXVLRQ7KHLQLWLDOUHVXOWVVKRZHGVWURQJHYLGHQFHVWKDWWKHK\EULGURXWLQH XVLQJ6KDQQRQDQG7 VDOOLVHQWURSLHVMRLQWO\SHUIRUPHGPRVWUHOLDEOHLQWHUPRGDOLW\ FRUHJLVWUDWLRQXVLQJVWDWLVWLFDOSDUDPHWULFPDSSLQJDQGWKHUHIRUHFRXOGEHDQHZ DYDLODEOHFRVWIXQFWLRQDSSURDFKLQWKHLPDJHSURFHVVLQJWRROV % ,QWHJUDWLRQRIGLIIXVLRQDQGSHUIXVLRQLPDJHVRIKXPDQEUHDVW FDQFHUE\UHJLVWUDWLRQDQGGLVVLPLODULW\EDVHGFOXVWHULQJ &$0pQGH] ) 3L]]RUQL)HUUDUHVH3 6XPPHUV*3HWUDOLD*0HQHJD] 9HURQD,70LODQ,7DQGUHVPHQGH]J#JPDLOFRP 3XUSRVH7 RLQWURGXFHDQHZSDWLHQWVSHFLÀFSLSHOLQHIRUWKHLQWHJUDWLRQRIEUHDVW GLIIXVLRQDQGSHUIXVLRQ05,IRUVXUJLFDOSODQQLQJ 0HWKRGVDQG0DWHULDOV:HSURSRVHDWZRVWHSSURFHVVIRUWKHLQWHJUDWLRQRI LQIRUPDWLRQGHULYHGIURP'&(05,DQG':05,PRGDOLWLHV)LUVWYR[HOZLVHGLV VLPLODULW\EDVHGFOXVWHULQJLVSHUIRUPHGRQ'&(LPDJHVWRLGHQWLI\GLIIHUHQWWXPRUDO VXEUHJLRQVZKLFKDUHWKHQSURMHFWHGWRWKH':05,IROORZLQJDSDWLHQWVSHFLÀF UHJLVWUDWLRQSURWRFROFRQVLVWLQJRIDSUHOLPLQDU\PXOWLUHVROXWLRQULJLGWUDQVIRUPDWLRQ IROORZHGE\DQHODVWLF%6SOLQHGHIRUPDWLRQIRFXVHGRQWKHOHVLRQDUHD7KHSURE DELOLW\GHQVLW\IXQFWLRQVLQWKH$'&PDSRIWKHVXEUHJLRQVDUHWKHQH[WUDFWHGDQG FRPSDUHGWKURXJKQRQSDUDPHWULFWHVWLQJ:LOFR[RQVLJQHGUDQNWHVWS 7KH SLSHOLQHZDVGHPRQVWUDWHGXVLQJ'&(05,DQG':05,DFTXLUHGIURPSDWLHQWV UDQJHGLQDJHPHGLDQ\HDUVDIIHFWHGE\SULPDU\GXFWDOFDUFLQRPD 5HVXOWV 1RQSDUDPHWULF WHVWV VKRZ WKDW$'& YDOXHV IURP WKH VXEUHJLRQVFRU UHVSRQGLQJ WR GLIIHUHQW FOXVWHUV LQ WKH '&( YROXPH KDYH VWDWLVWLFDOO\ GLIIHUHQW FKDUDFWHULVWLFVZKLFKLQGLFDWHVWKHFRQVLVWHQF\RIWKHLQIRUPDWLRQREWDLQHGIURP WKHWZRPRGDOLWLHVZKLOHSURYLGLQJDSRVWHULRUYDOLGDWLRQRIWKHUHJLVWUDWLRQPHWKRG &RQFOXVLRQ,QWKLVZRUNZHKDYHHPSOR\HGGLVVLPLODULW\EDVHGUHSUHVHQWDWLRQV LQVWHDGRIFODVVLFIHDWXUHVWRLQWHJUDWHWKHLQIRUPDWLRQSURYLGHGE\ERWKGLIIXVLRQ DQGSHUIXVLRQ05,LPDJHVRIWKHEUHDVW3UHOLPLQDU\UHVXOWVDUHTXLWHSURPLVLQJ DQGVXJJHVWWKHH[SORLWDWLRQLQIXWXUHZRUNVRIWKLVFRPELQHGLQIRUPDWLRQLQWKH UHJLVWUDWLRQSURFHVVWKURXJKWKHGHÀQLWLRQRIDQDGKRFREMHFWLYHIXQFWLRQ0RUHR YHUDIWHUVSDWLDOUHJLVWUDWLRQWKHGLIIXVLRQLQIRUPDWLRQFDQEHLQFRUSRUDWHGLQWRWKH FODVVLÀFDWLRQSURFHVV\LHOGLQJDWUXO\PXOWLPRGDOLW\LQWHJUDWLRQRILPDJLQJGDWD 5RRP$ 1HXUR 66D ,QWHUYHQWLRQDOQHXURUDGLRORJ\ 0RGHUDWRUV %*yPH]$QVyQ%DUFHORQD(6 63XFKQHU9LHQQD$7 % 6LQJOHFHQWUHH[SHULHQFHRILQWUDFHUHEUDODUWHU\WKURPEHFWRP\XVLQJ 75(92GHYLFHLQSDWLHQWVZLWKDFXWHLVFKDHPLFVWURNH /6DQ5RPDQ92EDFK-0DFKR-%ODVFR$/RSH] $7 RPDVHOOR-3HUDQGUHX-%UDQHUD$&KDPRUUR%DUFHORQD(6 OVUPDQ]DQHUD#JPDLOFRP 3XUSRVH7 RGHVFULEHWKHHIIHFWLYHQHVVDQGVDIHW\DQGRIDPHFKDQLFDOVWHQWOLNH GHYLFH75(92LQWKHHQGRYDVFXODUWUHDWPHQWRIDFXWHLVFKDHPLFVWURNH 0HWKRGVDQG0DWHULDOV3URVSHFWLYHVLQJOHFHQWUHVWXG\RISDWLHQWVZLWKDQ DFXWHLVFKDHPLFVWURNHDWWULEXWDEOHWRDODUJHFHUHEUDODUWHU\RFFOXVLRQ0HGLDQ 1DWLRQDO,QVWLWXWHVRI+HDOWK6WURNH6FDOH$UWHULDORFFOXVLRQZDVLQWKHDQWH ULRUFLUFXODWLRQLQRIFDVHVDQGLQYHUWHEUREDVLODUWHUULWRU\0HDQWLPH IURPV\PSWRPRQVHWWRHQGRYDVFXODUWUHDWPHQWZDVPLQXWHV(QGRYDVFXODU WUHDWPHQW ZDV UXOHG RXW ZKHQ HVWDEOLVKHG LVFKDHPLF OHVLRQV ZHUH JUHDWHU WKDQ % 5HWULHYLQJSRVLWLYHÀQGLQJVLQUDGLRORJLFDOLPDJHVZLWKWKHDLGRI WH[WXDOKLQWVLQUHSRUWV 3 'DXPNH.6LPRQ&6LPRQ(.RWWHU$*HUVWPDLU )UHLEXUJ'(GDXPNH#DYHUELVGH 3XUSRVH7 REXLOGDQGHYDOXDWHDUHWULHYDOV\VWHPIRU*HUPDQUDGLRORJ\UHSRUWV HQDEOLQJLPSURYHGDFFHVVWRUDGLRORJLFDOLPDJHDQGIUHHWH[WGDWD 0HWKRGVDQG0DWHULDOV $VFDODEOHWH[WDQDO\VLVSODWIRUPLVXVHGWRH[WUDFWUHOHYDQW LQIRUPDWLRQIURP*HUPDQUDGLRORJ\UHSRUWVDQGWRFUHDWHVHPDQWLFOLQNVEHWZHHQ LPDJHVDQGWH[WXDOGHVFULSWLRQV7KHSODWIRUPFRQVLVWVRIGRPDLQVSHFLÀFDQDO\VLV FRPSRQHQWVGHDOLQJZLWKGLIIHUHQWDVSHFWVRIPHGLFDOODQJXDJHVXFKDVQHJDWLRQV DEEUHYLDWLRQVGLPHQVLRQVSURSHUQDPHVDQGWKHPRUSKRORJLFDODQDO\VLVRIZRUG FRPSRXQGV$GGLWLRQDOO\LWFRQWDLQVDQLPDJHUHIHUHQFHDQGFRQWH[WUHFRJQLWLRQ FRPSRQHQWDOORZLQJWKHFUHDWLRQRIVHPDQWLFOLQNVEHWZHHQWH[WDQGLPDJHGDWD *LYHQDQH[SOLFLWSLFWXUHUHIHUHQFHPHQWLRQHGLQDUHSRUWHJҊ,0$ҋDQGLWV VXUURXQGLQJGHVFULSWLRQWKLVFRPSRQHQWWULHVWRGHGXFHWKHFRUUHVSRQGLQJ',&20 VHULHV ,' EDVHG RQ H[SOLFLW RU LPSOLFLW KLQWV DQG ORDGV WKH UHIHUHQFHG LPDJH V IURPWKHORFDO3$&6VHUYHU)LQDOO\NH\LPDJHVDQGUHOHYDQWWH[WSDVVDJHVDUH VXEVHTXHQWO\PDGHDYDLODEOHWRUDGLRORJLVWVLQDVHDUFKHQJLQHIRUDGKRFTXHU\LQJ 5HVXOWV2QDFRUSXVRIUDGLRORJ\UHSRUWVWKHV\VWHPZDVDEOHWRLGHQWLI\ LPDJHUHIHUHQFHVDQGVXFFHVVIXOO\UHWULHYHLPDJHVIURPWKHORFDO 3$&6 VHUYHU 5DQGRPLVHG YDOLGDWLRQV RI LGHQWLÀHG LPDJH UHIHUHQFHV VKRZHG WKDWWKHH[WUDFWLRQFRPSRQHQWLVDEOHWRUHVROYHWKHFRUUHFWUHIHUHQFHZLWKPHDQ DYHUDJHSUHFLVLRQRI3 &RQFOXVLRQ2XUDQDO\VLVVKRZVWKDWFRPSUHKHQVLYHV\QWDFWLFDQGVHPDQWLFWH[W DQDO\VLVLVUHTXLUHGWRDFKLHYHKLJKTXDOLW\LQIRUPDWLRQH[WUDFWLRQIURPUDGLRORJ\ UHSRUWV,WLVWKHEDVLVIRUDQXPEHURIYDOXHDGGHGDSSOLFDWLRQVVXFKDVLPDJH VHDUFKGDWDPLQLQJDQGGHFLVLRQVXSSRUW % 5DSLGVHPLDXWRPDWLFOLYHUVHJPHQWDWLRQXVLQJDQHZXVHUIULHQGO\ SURWRW\SLFVRIWZDUHWRROLQLWLDOH[SHULHQFH ) ,0DUWLQH]*DPEDUR ) 2+HQHV+'1DJHO*$GDP05HJLHU 6DQWLDJR&/+DPEXUJ'(IHPDUWLQH]J#JPDLOFRP 3XUSRVH7 RHYDOXDWHWKHDFFXUDF\RIDQHZVRIWZDUHWRROIRUVHPLDXWRPDWLFOLYHU VHJPHQWDWLRQLQWKHDQDO\VLVRIOLYHUVHJPHQWVYHVVHOVDQGWXPRXUOHVLRQVDQGWR DVVHVVLWVWKHXVHUIULHQGOLQHVV 0HWKRGVDQG0DWHULDOV,QKHDOWK\OLYHUGRQRUVDQGSDWLHQWVVXIIHULQJIURP KHSDWLFWXPRXUVWKLQVOLFHG0'&7 VL&7 3KLOLSVPPVOLFHWKLFNQHVVZHUH DFTXLUHG %DVHG RQ D OHYHO VHW PHWKRG IRU DXWRPDWLF FRQWRXU LGHQWLÀFDWLRQ WKH VHJPHQWDWLRQZDVSHUIRUPHGIROORZLQJ&RXLQDXGVDQDWRPLFDOFODVVLÀFDWLRQ7KH YROXPHWU\RIVHJPHQWVYHVVHOVDQGOHVLRQVZDVDVVHVVHGDXWRPDWLFDOO\XVLQJD 'EDVHGYR[HOFODVVLÀFDWLRQDOJRULWKPZLWKSURSDJDWLRQDOOHDUQLQJDQGDIWHUZDUGV PDQXDOFRUUHFWLRQZDVSHUIRUPHG7KHWLPHQHFHVVLWDWHGIRUVHJPHQWDWLRQDQG PDQXDOFRUUHFWLRQZDVUHFRUGHG7KHWLPHWRH[HFXWHDOOPHDVXUHPHQWVDQGFRU UHFWLRQVZDVTXDQWLÀHG 5HVXOWV7KHVHPLDXWRPDWLFVHJPHQWDWLRQUDSLGO\SHUIRUPHGSUHFLVHGHWHUPLQD WLRQ RI DOO VHJPHQWV ZLWK DYHUDJLQJ FRUUHFWQHVV RI LQ KHDOWK\ GRQRUV ,Q WXPRXU SDWLHQWV WKH FRUUHFWQHVV IRU DOO VHJPHQWV ZDV 7KH PHDQ WLPH IRU VHPLDXWRPDWLF OLYHU VHJPHQWDWLRQ DQG PDQXDO FRUUHFWLRQ ZDV PLQ DQG PLQUHVSHFWLYHO\5DSLGDVVHVVPHQWRIWXPRXUYROXPHZDVDFKLHYHGZLWK FRUUHFWQHVVRI7KHDFFXUDF\ZDVOLPLWHGLISULRUUHVHFWLRQRUODUJHQHFURWLF DUHDVZHUHSUHVHQW7KHUHFRJQLWLRQRIOLYHUYHVVHOVZDVKLJKO\SUHFLVH! XVLQJDVWDQGDUGFRQWUDVWLQMHFWLRQSURWRFRO &RQFOXVLRQ7KHQHZVHPLDXWRPDWLFVRIWZDUHWRROHYDOXDWHGDOORZVIRUWKHVHJ PHQWDWLRQRIWKHOLYHUYHVVHOVDQGWXPRXUOHVLRQVZLWKUHPDUNDEO\KLJKSUHFLVLRQ DQG HIÀFLHQF\ )XUWKHUPRUH GXH WR LWV HDV\WRKDQGOH DSSURDFKDQG WKH UDWKHU VKRUWWLPHIRUPDQXDOFRUUHFWLRQWKLVWRROPLJKWPHHWWKHEURDGGHPDQGVRIPRGHUQ FURVVVHFWLRQDOLPDJLQJRIWKHOLYHULQGDLO\FOLQLFDOURXWLQH % ,PDJHUHJLVWUDWLRQLQDK\EULGURXWLQHXVLQJ6KDQQRQ7VDOOLVHQWURS\ IRUWKHVWDWLVWLFDOSDUDPHWULFPDSSLQJ630 +7 $6$PDUDO/20XUWD-U/:LFKHUW$QD$&6DNDPRWR 3 0$]HYHGR0DUTXHV5LEHLUmR3UHWR%5KHQULTXHWRPD]#XROFRPEU 3XUSRVH 7KH DXWRPDWLF FRUHJLVWUDWLRQ RI PHGLFDO LPDJHV EDVHG RQ VLPLODULW\ PHDVXUHV KDYH EHHQ VXJJHVWHG LQ VHYHUDO VWXGLHV XVLQJ GLIIHUHQW FRVW IXQFWLRQ DSSURDFKHVZKLFKKDYHSUHVHQWHGUHOHYDQWUHVXOWVIRUPDQ\NLQGRIELRPHGLFDO LPDJHV%DVHGRQSUHYLRXVUHVXOWVVKRZLQJWKHFRQWULEXWLRQRIWKH7 VDOOLVHQWURS\ RQWKHDOLJQPHQWRIPDJQHWLFUHVRQDQFHLPDJLQJ05,DQGVLQJOHSKRWRQHPLV 6FLHQWLILF6HVVLRQ 6 &$' ( ) *+% (XURSHDQ&RQJUHVVRI 5DGLRORJ\ VWDWLVWLFDOO\VLJQLÀFDQWS!+RZHYHUJURXS,,,KDVWHQGHQF\WKDWV\PSWRPDWLF KDHPRUUKDJHDQGPRUWDOLW\DUHORZ &RQFOXVLRQ0HFKDQLFDOWKURPERO\VLVKDVKLJKHUUDWHRIUHFDQDOLVDWLRQDQGJRRG FOLQLFDO RXWFRPH WKDQ 8. WKURPERO\VLV )URP DPRQJ WZR GLIIHUHQW PHFKDQLFDO WKURPERO\WLFWKHUDSLHVXVLQJPHFKDQLFDOGHYLFHVKDYHORZHUUDWHRIKDHPRUUKDJH DQGPRUWDOLW\WKDQXVLQJPLFURZLUHDQGPLFURFDWKHWHU % 0HFKDQLFDOWKURPEHFWRP\ZLWKWKHWUHYRVWHQWGHYLFHLQSUR[LPDO LQWUDFUDQLDODUWHULDORFFOXVLRQV 00$&9DQ6DQWHQ9DQ'RRUQ 59DQ'HQ%HUJ%9DQ'HU.DOOHQ */$1LMHKROW:9DQ=ZDP59DQ2RVWHQEUXJJH$9DQ'HU/XJW < 5RRV&%/00DMRLH$PVWHUGDP1/'HQ+DDJ1/0DDVWULFKW1/ 5RWWHUGDP1/ 3XUSRVH7 RHYDOXDWHWKHVDIHW\DQGHIIHFWLYHQHVVRIDVHOIH[SDQGLQJDQGIXOO\ UHWULHYDEOH VWHQW 7UHYR &RQFHQWULF 0HGLFDO ,QF 0RXQWDLQ 9LHZ &$ 86$ LQ UHYDVFXODULVDWLRQRISDWLHQWVZLWKDFXWHLVFKDHPLFVWURNH 0HWKRGVDQG0DWHULDOV3URVSHFWLYHPXOWLFHQWUHFDVHVHULHVRISDWLHQWVPHDQ DJH<0) ZLWKDQDFXWHLVFKDHPLFVWURNHFDXVHGE\SUR[LPDOLQWUDFUDQLDO DUWHULDORFFOXVLRQWUHDWHGZLWKDIXOO\UHWULHYDEOHVWHQWZLWKLQWKHÀUVWKRXUVIURP V\PSWRPRQVHWPHGLDQ1DWLRQDO,QVWLWXWHVRI+HDOWK6WURNH6FDOH>UDQJH @7KURPEHFWRP\ZDVXVHGDVUHVFXHWKHUDS\LQSDWLHQWVZKRZHUHUHIUDFWRU\ WRKDGFRQWUDLQGLFDWLRQVIRURUZHUHWRRODWHIRU,9UW3$7KHRFFOXVLRQVLWHZDVWKH 0&$LQWHUPLQXV,&$LQFHUYLFDO,&$0&$LQDQGEDVLODUDUWHU\LQSDWLHQWV &RPSOLFDWLRQVUHODWHGWRWKHSURFHGXUHDQGRXWFRPHDWPRQWKVZHUHDVVHVVHG 5HVXOWV 6WHQW SODFHPHQW ZDV IHDVLEOH LQ DOO SURFHGXUHV DQG VXFFHVVIXOUHFD QDOLVDWLRQGHÀQHGDVWKURPERVLVLQFHUHEUDOLVFKDHPLD7,&,JUDGHERUZDV DFKLHYHG LQ RI WUHDWHG YHVVHOV 7KH PHDQ QXPEHU RISDVVHV IRU PD[LPDOUHFDQDOLVDWLRQZDVUDQJH7KHPHGLDQWLPHIURPJURLQSXQFWXUHWR UHFDQDOLVDWLRQZDVUDQJHPLQXWHV2QHVLJQLÀFDQWSURFHGXUDOHYHQW RFFXUUHGFDURWLGDUWHU\RFFOXVLRQDIWHUVWHQWUHPRYDO)RUW\RQHRIDOOSDWLHQWV KDGDJRRGRXWFRPHP56WRDPRGHUDWHRXWFRPHP56DQGD SRRURXWFRPHP56WR &RQFOXVLRQ 7KHVH UHVXOWV VXJJHVW WKDW ZLWK WKH 7UHYR GHYLFH FORWV FDQ EH VDIHO\DQGHIIHFWLYHO\UHPRYHGIURPLQWUDFUDQLDOODUJHYHVVHORFFOXVLRQVLQDFXWH LVFKDHPLFVWURNH % &HUHEUDOYDVRVSDVP&9DIWHUDQHXU\VPDOVXEDUDFKQRLG KDHPRUUKDJH$6$+LQWUDDUWHULDOPDQDJHPHQW (3XJOLHOOL0%DÀOH0)XVFKL9'L(JLGLR00RQLQD7 HUDPR,7 HGRSXJ#KRWPDLOFRP 3XUSRVH7KHSXUSRVHRIWKLVZRUNLVWRHYDOXDWHSUHGLFWRUVRIUHFDQDOLVDWLRQDQG DIDYRXUDEOHQHXURORJLFDORXWFRPHLQSDWLHQWVZLWK&9DIWHUDFXWH$6$+ 0HWKRGVDQG0DWHULDOV)URP0D\WR6HSWHPEHUZHHPEROLVHG DQHXU\VPLQSDWLHQWVDJHUDQJHGIURPWR\HDUVPHDQDJHZLWK $6$+XVLQJPHWDOGHWDFKDEOHFRLOVVWHQWLQJLQRIWKHVHSDWLHQWVZH UHSRUWFOLQLFDODQGRUDQJLRJUDSKLFVLJQVRI&905$&7DQG'6$KDYHEHHQXVHGWR HYDOXDWH6$+:HGLVFXVVWKHXVHRIQHXURHQGRYDVFXODUWHFKQLTXHVDQGWKHUHFHQW DGYDQFHVLQWKHORFDOWKHUDS\RI&9IROORZLQJ$6$+3DWLHQWҋVDJHVH[DHWLRO RJ\SHUIXVLRQUHFDQDOLVDWLRQDQGV\PSWRPSUHDQGSRVWWUHDWPHQWZLWKPRGLÀHG 5DQNLQ6FDOHP56ZHUHDQDO\VHGXVLQJDPXOWLSOHORJLVWLFUHJUHVVLRQDQDO\VLV 5HVXOWV,QRIWKHSDWLHQWVZHKDYHREVHUYHGUHJXODULVDWLRQRIWKH QDUURZHGYHVVHOXVLQJORFDOLDLQIXVLRQRISDSDYHULQHFDVHVRUQLPRGLSLQH FDVHVDWWKHZHHNVFRQWURO,QSDWLHQWVZHUHSRUWWKHXVHRIORFDO LDQLPRGLSLQHEHIRUHDQGDIWHUODUJHYHVVHOSHUFXWDQHRXVWUDQVOXPLQDOEDOORRQ DQJLRSODVW\37$ZLWKUHFDQDOLVDWLRQDIWHUSURFHGXUHDQGLPSURYHPHQWRIFOLQLFDO FRQGLWLRQDWWKHPRQWKVRIIROORZXS5HFDQDOLVDWLRQIDYRXUHGDEHWWHURXWFRPH ZLWK D SUH DQG SRVWWUHDWPHQW P56 LPSURYHPHQW DW WR PRQWK IROORZXS S HVSHFLDOO\LQWKRVHZKRUHFHLYHGHDUO\WUHDWPHQW &RQFOXVLRQ(DUOLHUWUHDWPHQWLVXVXDOO\DVVRFLDWHGZLWKEHWWHUSDWLHQWVXUYLYDODQG RXWFRPHEXWFRQWLQXHGHIIRUWVDUHQHFHVVDU\WRLPSURYHDQGUHÀQHHQGRYDVFXODU VWUDWHJLHVDVZHOODVGHYHORSQHZWUHDWPHQWPRGDOLWLHV % $QJLRJUDSKLFRXWFRPHDIWHUHQGRYDVFXODUWUHDWPHQWRILQWUDFUDQLDO DQHXU\VPVZLWKWKHVLONÁRZGLYHUWHU $5LQJHOVWHLQ06FKODPDQQ6*ULFNH&0RHQQLQJKRII,6DQGDOFLRJOX 0)RUVWLQJ,:DQNH(VVHQ'(DGULDQULQJHOVWHLQ#XNHVVHQGH 3XUSRVH :LGHQHFNHG DQG IXVLIRUP DQHXU\VPV DUH WHFKQLFDOO\ FKDOOHQJLQJI R U (97 )'PD\RFFOXGHWKHDQHXU\VPVE\HQGROXPLQDOUHFRQVWUXFWLRQRIWKHSDUHQW RQHWKLUGRIWKHPLGGOHFHUHEUDODUWHU\WHUULWRU\PHDVXUHGE\PXOWLPRGDOFRPSXWHG WRPRJUDSK\&7RUPDJQHWLFUHVRQDQFH05, 5HVXOWVRISDWLHQWVZHUHGHHPHGWRVKRZJRRGRXWFRPHPRGLÀHG5DQNLQ 6FDOHVFRUHDWGD\V2IWKHSDWLHQWVWUHDWHGXVLQJ7UHYRDVWKHVROH WUHDWPHQW WHFKQLTXH VKRZHG FRPSOHWH WKURPERO\VLV LQ FHUHEUDO LQIDUFWLRQ VFRUH7,&,JUDGHRUSDUWLDO7,&,EUHSHUIXVLRQDQGWKLVLQFUHDVHGWRLI DGGLWLRQDOWUHDWPHQWVZHUHXVHG7KHPHDQWLPHIURPJURLQSXQFWXUHWRUHFDQDOL VDWLRQZDVPLQ6\PSWRPDWLFLQWUDFUDQLDOKDHPRUUKDJHZDVIRXQGLQ SDWLHQWVDQGSDWLHQWVGLHGZLWKLQWKHGD\IROORZXSSHULRG7KHUHZHUH GLVWDOHPEROLVDWLRQVRIDSUHYLRXVXQLQYROYHGWHUULWRU\1RDUWHULDOUXSWXUHRURWKHU PDMRUFRPSOLFDWLRQVRFFXUUHG &RQFOXVLRQ2XUÀQGLQJVLQGLFDWHWKDWPHFKDQLFDOLQWUDFUDQLDOWKURPEXVH[WUDFWLRQ XVLQJ75(92LVHIIHFWLYHDQGKDVDUHDVRQDEOHPRUELGLW\DQGPRUWDOLW\UDWHLQWKH WUHDWPHQWRIDFXWHLVFKDHPLFVWURNH % (QGRYDVFXODUUHSHUIXVLRQIRUDFXWHLVFKDHPLFVWURNH$,6 3UHOLPLQDU\UHVXOWVRIDVLQJOHFHQWUHUHWURVSHFWLYHVWXG\ (3XJOLHOOL0)XVFKL9'L(JLGLR7 HUDPR,7HGRSXJ#KRWPDLOFRP 3XUSRVH$LPRIWKLVSUHOLPLQDU\VWXG\ZDVWRDVVHVVWKHVDIHW\HIÀFDF\RIWKH PXOWLSOHHQGRYDVFXODUPRGDOLWLHVSKDUPDFRORJLFPHFKDQLFDOWKDWFDQEHXVHGLQ WKHUHSHUIXVLRQWKHUDS\IRU$,6WRLPSURYHWKHUDWHVRIUHFDQDOLVDWLRQ 0HWKRGVDQG0DWHULDOVFRQVHFXWLYHSDWLHQWVZLWK$,6PHDQDJH\IURP $SULOWR6HSWHPEHURQVHWOHVVWKDQKRXUVIRUWKHDQWHULRUFLUFXODWLRQ DQGIRUWKHYHUWHEUREDVLODURQHXQGHUZHQWWRLQWUDDUWHULDOSKDUPDFRORJLFRU PHFKDQLFDOWKHUDS\ZLWKUHFDQDOLVDWLRQ&7&7SHUIXVLRQ05,'6$ZHUHXVHGIRU WKHDVVHVVPHQWRILVFKDHPLFDUHDDQGFDXVHV3DWLHQWҋVDJHVH[DHWLRORJ\RI RFFOXVLRQV\PSWRPEHIRUHDIWHUPHFKDQLFDOSKDUPDFRORJLFWUHDWPHQWVZLWKPRGL ÀHG5DQNLQ6FDOHP56UHFDQDOLVDWLRQUDWHVHYDOXDWHGZLWK7,&,WKURPERO\VLVLQ FHUHEUDOLVFKDHPLDJUDGHQRÁRZJUDGHQRUPDOÁRZDQGKDHPRUUKDJLF WUDQVIRUPDWLRQV +7 ZHUH UHFRUGHG DQG FRUUHODWHG XVLQJ D PXOWLSOH ORJLVWLF UH JUHVVLRQDQDO\VLV 5HVXOWV7KH VLWHV RI DUWHULDO RFFOXVLRQ EHIRUH WUHDWPHQW ZHUH 0 SDWLHQWV LQWUDFUDQLDO FDURWLG 0 WDQGHP RFFOXVLRQ H[WUDFUDQLDO LQWHUQDO FDURWLG LVRODWHG RFFOXVLRQ 3 EDVLODUWUXQN 7KHUDSHXWLFLQWHUYHQWLRQVLQFOXGHGPXOWLPRGDO WKHUDS\ SKDUPDFRORJLF FKHDS ZLWK WLVVXHSODVPLQRJHQ DFWLYDWRU W3$ PHFKDQLFDOWKHUDS\ZLWKHPEROHFWRP\XVLQJVROLWDLUHHY 70 7KHUHFDQDOLVDWLRQUDWHZLWKPXOWLPRGDOWKHUDS\ZDVVLJQLÀFDQWO\ KLJKHU7,&,UHFDQDOLVDWLRQUDWHSDWLHQWV>@FRPSDUHGWRSKDUPDFR ORJLFWKHUDS\RQO\SDWLHQWV>@RUPHFKDQLFDORQHSDWLHQWV>@ S+DHPRUUKDJLFSHUIXVLRQRFFXUUHGLQRQHSDWLHQWZLWK0RFFOXVLRQWKDW VSRQWDQHRXVO\UHVROYHG &RQFOXVLRQ0XOWLPRGDOWKHUDS\VKRZHGVLJQLÀFDQWO\KLJKHUUHFDQDOLVDWLRQUDWHV YVSKDUPDFRORJLFRUPHFKDQLFDORQHVZKLOHWKHSUHYDOHQFHRIKHPRUUKDJHGRHV QRWH[FHHGWKDWZKLFKRFFXUVLQWKHQDWXUDOKLVWRU\7KHVHSUHOLPLQDU\UHVXOWVVKRZ SRWHQWLDOIRUWKHHQGRYDVFXODUPDQDJHPHQWRI$,6 % 5HVXOWVRIPHFKDQLFDOWKURPERO\VLVIRUDFXWHLVFKDHPLFVWURNH FRPSDULVRQZLWKLQWUDDUWHULDOXURNLQDVHLQIXVLRQ $,P6-HRQ6&KRL,NVDQ.5 3XUSRVH 7 R HYDOXDWH WKH HIÀFDF\ DQG VDIHW\ RI PHFKDQLFDO WKURPERO\VLVLQ DFXWHLVFKDHPLFVWURNHFRPSDUHGZLWKUHVXOWVRILQWUDDUWHULDO,$SKDUPDFRORJLF WKURPERO\VLV 0HWKRGVDQG0DWHULDOV:HUHWURVSHFWLYHO\UHYLHZHGSDWLHQWVZKRZHUHSHUIRUPHG ,$WKURPERO\VLVIRUDFXWHWKURPERHPEROLFRFFOXVLRQRIPDMRUYHVVHOV7 RWDOSDWLHQWV ZHUHDQGGLYLGHGLQWRJURXSVJURXSSXUHXURNLQDVH>8.@LQIXVLRQQ JURXSPHFKDQLFDOWKURPERO\VLV>FORWGLVUXSWLRQ@XVLQJPLFURZLUHDQGPLFURFDWK HWHUQ JURXSPHFKDQLFDOWKURPERO\VLVXVLQJDQJLRSODVW\EDOORRQUHWULHYDEOH VHOIH[SDQGDEOHVWHQWRUDVSLUDWLRQWKURPEHFWRP\FDWKHWHUQ :HDVVHVVHG WUHDWPHQWUHVXOWVZKLFKZHUHFRPSDUHGE\UHFDQDOLVDWLRQUDWHFOLQLFDORXWFRPH PRUWDOLW\DQGV\PSWRPDWLFKDHPRUUKDJHUDWH 5HVXOWV 7KH UHFDQDOLVDWLRQ UDWH ZDV LQ JURXS , LQ JURXS ,,D Q G LQ JURXS ,,, 0HFKDQLFDO WKURPERO\VLV JURXSV KDG KLJKHU UHFDQDOLVDWLRQ UDWHDQGJURXS,,,KDGWKHEHVWUHVXOWRIUHFDQDOLVDWLRQUDWHS:HDVVHVVHG FOLQLFDORXWFRPHXVLQJPRGLÀHG5DQNLQ6FDOHP56DIWHUPRQWKVDQGIDYRXU DEOHRXWFRPHZDVWKHEHVWLQJURXS,,,IROORZHGE\JURXSV,,DQG,S7KH V\PSWRPDWLFKDHPRUUKDJHUDWHDQGPRUWDOLW\ZDVLQJURXS, LQJURXS,,DQGLQJURXS,,,UHVSHFWLYHO\7KLVGLIIHUHQFHZDVQRW 6FLHQWLILF6HVVLRQ $ 6&'()*+%(XURSHDQ&RQJUHVVRI 5DGLRORJ\ )ULGD\ &RQFOXVLRQ 6LOHQW HPEROLF HYHQWV DUH PXFK PRUH IUHTXHQW WKDQ WKH DSSDUHQW QHXURORJLFDO FRPSOLFDWLRQ UDWH DIWHU VWHQWDVVLVWHG FRLOLQJ +RZHYHU LQGLYLGXDO DQGDQHXU\VPVSHFLÀFSDUDPHWHUVPD\SUHGLFWWKHVDIHW\RIWKHLQWHUYHQWLRQDQG SUHVXPDEO\WKHVXEVHTXHQWUDWHRIQHXURORJLFDOFRPSOLFDWLRQV % 1HZLVFKDHPLFEUDLQOHVLRQVRQGLIIXVLRQZHLJKWHG05,DIWHUFDURWLG DUWHU\VWHQWLQJZLWKSURWHFWLRQDVLQJOHFHQWUHVWXG\ '$6WRMDQRY0,OLF3 %RVQMDNRYLF1LV56GUVWRMDQRY#JPDLOFRP 3XUSRVH&DURWLGDUWHU\VWHQWLQJ&$6ZLWKGLVWDOSURWHFWLRQLVQRZFRQVLGHUHG DQDOWHUQDWLYHWRFDURWLGHQGDUWHUHFWRP\'HVSLWHFHUHEUDOSURWHFWLRQWKHULVNRI FHUHEUDOHPEROLVDWLRQVWLOOSHUVLVWGXULQJWKHSURFHGXUH'LIIXVLRQZHLJKWHGLPDJLQJ ':,LVFRQVLGHUHGWKHPRVWVHQVLWLYHWRROIRUHDUO\GHWHFWLRQRIFHUHEUDOLVFKDH PLD7KHSXUSRVHRIWKLVVWXG\ZDVWRHYDOXDWHWKHDSSHDUDQFHRIQHZLVFKDHPLF FHUHEUDOOHVLRQVE\':,DIWHUSURWHFWHG&$6LQSDWLHQWVZLWKVHYHUHLQWHUQDOFDURWLG DUWHU\,&$VWHQRVLV 0HWKRGVDQG0DWHULDOV)LIW\&$6VZHUHSHUIRUPHGZLWKWKHXVHRIGLVWDOSURWHF WLRQ0HDQDJHRIWKHSDWLHQWVZDV\HDUVDQGZHUHV\PSWRPDWLF ,QSDWLHQWVSURFHGXUHZDVGRQHRQDQHPHUJHQF\EDVLV$OOSDWLHQWVZHUH XQVXLWDEOHIRU&$(':,ZDVSHUIRUPHGLPPHGLDWHO\EHIRUH&$6DQGZLWKLQ KRXUVDIWHUWKHSURFHGXUH 5HVXOWV 7KHUH ZHUH QHZ OHVLRQV LQ SDWLHQWV PHDQ SHUSDWLHQW,QRIWKHPWKHUHZHUHVLQJOHOHVLRQVDQGLQ SDWLHQWV PXOWLSOH OHVLRQV )RXU SDWLHQWV GHYHORSHG LSVLODWHUDO QHZ OH VLRQVWZRSDWLHQWVGHYHORSHGFRQWUDODWHUDOQHZOHVLRQVDQGRQHSDWLHQW GHYHORSHGELODWHUDOQHZOHVLRQV3DWLHQWVZLWKÀEUROLSLGSODTXHVKDGD VLJQLÀFDQWO\KLJKHUQXPEHURIQHZOHVLRQVFRPSDUHGWRSDWLHQWVZLWKÀEURFDOFLÀHG SODTXHVS &RQFOXVLRQ1HZLVFKDHPLFOHVLRQVZHUHREVHUYHGLQRIRXUSDWLHQWV7KHUH ZDVDVLJQLÀFDQWUHODWLRQVKLSEHWZHHQSODTXHFKDUDFWHULVWLFVDQGWKHDSSHDUDQFHRI QHZOHVLRQV7KHORZSHUFHQWDJHRIQHZOHVLRQVXJJHVWVWKDW&$6ZLWKSURWHFWLRQ LVVDIHDQGHIIHFWLYHLQSDWLHQWVZLWKVHYHUH,&$VWHQRVLV 5RRP% &DUGLDF 66 &7DQG05,UHFRQVWUXFWLRQDOJRU\WKPVDQGGRVH UHGXFWLRQ 0RGHUDWRUV .1LNRODRX0XQLFK'( 3.9DQKRHQDFNHU$DOVW%( % 5HFRQVWUXFWLRQVZLWKLGHQWLFDOÀOOLQJ5,)RIWKHKHDUWD SK\VLRORJLFDODSSURDFKWRLPDJHUHFRQVWUXFWLRQLQFRURQDU\&7 DQJLRJUDSK\ 6'5HLQDUW] %6'LHIHQEDFK7 $OOPHQGLQJHU&..XKO$+0DKQNHQ $DFKHQ'((UODQJHQ'(VUHLQDUW]#XNDDFKHQGH 3XUSRVH7KHDLPRIWKHVWXG\ZDVWKHFRPSDULVRQRILPDJHTXDOLW\LQFRURQDU\ &7DQJLRJUDSK\F&7$EHWZHHQURXWLQHUHFRQVWUXFWLRQVZLWKDXWRPDWHGSKDVH GHWHFWLRQDQG5HFRQVWUXFWLRQVFRPSXWHGZLWK,GHQWLFDO)LOOLQJRIWKHKHDUW5,) 7KHWLPLQJLVSURYLGHG5,)IRUPXODZKLFKLVGHGXFWHGIURPFDUGLDFSK\VLRORJ\ 0HWKRGVDQG0DWHULDOV)URP1RYHPEHUXQWLO-XO\SDWLHQWVXQGHU JRLQJ(&*JDWHG'6&7ZHUHLQFOXGHGLQWKHVWXG\IRUVXVSHFWHGFRURQDU\KHDUW GLVHDVHQ RUSODQQLQJRILQWHUYHQWLRQDODRUWLFYDOYHUHSODFHPHQWQ 5,) IRUPXODDQGWKHPDQXIDFWXUHUVVRIWZDUH%HVW'LDVWROHZHUHXVHGIRUFDOFXODWLQJ WKHGDWDVHWV7ZRUDGLRORJLVWVDVVHVVHGLQFRQVHQVXVFRURQDU\DUWHU\VHJPHQWV DFFRUGLQJWRWKHVHJPHQWV$+$PRGHO,PDJHTXDOLW\ZDVVWUDWLÀHGXVLQJD JUDGH/LNHUWVFDOH&RQWLQXRXVYDULDEOHVZHUHH[SUHVVHGDVPHDQVWDQGDUGGHYLD WLRQFDWHJRULFDOYDULDEOHVDGGLWLRQDOO\DVIUHTXHQFLHVRUSHUFHQWDJHV'LIIHUHQFHV LQFDWHJRUFLDOGDWDZHUHDQDO\VHGXVLQJWKH:LOFR[RQWHVWIRUSDLUHGYDULDEOHV 5HVXOWVPHQDQGZRPHQZLWKDQDYHUDJHDJHRI\HDUVDQG ZLWKDPHDQKHDUWUDWHRIZHUHH[DPLQHG,QWKH%HVW'LDVWROHJURXS VHJPHQWVDFKLHYHGGLDJQRVWLFTXDOLW\FRPSDUHGWRVHJPHQWVLQWKH5,) JURXS,QFRUUHVSRQGLQJ $+$VHJPHQWV5,)ZDVVXSHULRULQVHJPHQWV %HVW'LDVWROHVFRUHGKLJKHULQFDVHV,QWKHDUUK\WKPLFVXEJURXSWKH PHDQ5,)LPDJHVVFRUHGLQFRPSDULVRQWR%HVW'LDVWROHZLWK DUWHU\DQGUHGXFLQJWKHEORRGÁRZLQWRWKHDQHXU\VPV7KHSXUSRVHRIWKLVVWXG\ ZDVWRDVVHVVWKHUDWHRILQWHUYHQWLRQDVVRFLDWHGFRPSOLFDWLRQVDQGWKHPLGWHUP RXWFRPHDIWHU6LONVWHQWLPSODQWDWLRQ 0HWKRGVDQG0DWHULDOV:HUHWURVSHFWLYHO\DQDO\VHGSDWLHQWVZLWKXQUXSWXUHG DQHXU\VPVWUHDWHGZLWK6LON)'EHWZHHQDQG7UHDWPHQWLQGLFD WLRQVZHUHIXVLIRUPDQHXU\VPVFLUFXPIHUHQWLDODQHXU\VPVDQGJLDQWDQHXU\VPV SUHVHQWHGZLWKHPEROLFHYHQWVRUDSURJUHVVLYHPDVVHIIHFW 5HVXOWV7 HFKQLFDOVXFFHVVZDVUHDFKHGLQSDWLHQWV7KUHHDQHXU\VPVZHUH LPPHGLDWHO\RFFOXGHGRQHRIWKHVHZLWKDGGLWLRQDOFRLOLQJ$OODQHXU\VPVVKRZHG LPPHGLDWHO\LQÁRZUHGXFWLRQ$IWHUWKUHHPRQWKVRFFOXVLRQZDVREVHUYHGLQDOO FDVHVH[FHSWRQHDQHXU\VPRIWKH,&$7KHRYHUDOOFRPSOLFDWLRQUDWHLQFOXGLQJWHFK QLFDOWKURPERHPEROLFFRPSOLFDWLRQRULQVWHQWWKURPERVLVZDVRI)' &OLQLFDORXWFRPHLQSDWLHQWVLQFOXGHGRQHZLWKQRWVHYHUHDQGZLWKVHYHUH QHXURORJLFDOGHÀFLWV\HDUIROORZXSGLGQRWVKRZDQ\UHSHUIXVLRQRIWKHDQHXU\VP &RQFOXVLRQ 'HVSLWH D QRW ORZ FRPSOLFDWLRQ UDWH WKH )' WUHDWPHQW RI FRPSOH[ DQHXU\VPVLVHIIHFWLYHZLWKDKLJKRFFOXVLRQUDWHRIWKHDQHXU\VPDOVRLQWKHPLG WHUPIROORZXS7KHRYHUDOOFRPSOLFDWLRQUDWHPD\EHKLJKHUWKDQLQFRQYHQWLRQDO VWHQWDVVLVWHGFRLOLQJEXWZHKDYHWRFRQVLGHUWKDWWKHDQHXU\VPVZHUHGLIÀFXOWWR WUHDWZLWKFRQYHQWLRQDOHQGRYDVFXODUPHWKRGVKDGUHFXUUHGDIWHUSUHYLRXVWUHDW PHQWVRUVKRZHGDGLVHDVHSURJUHVVLRQ % &RPSXWDWLRQDOÁXLGG\QDPLFVLQSDWLHQWVWUHDWHGZLWKÁRZGLYHUWHU GHYLFHV 7 %DSWLVWD 3 :DWWRQ(+ROODQG-3HQURVH$&KLDULQL$-%\UQH -5HLV/LVERQ372[IRUG8.$ELQJGRQ8.&DVDOHFFKLRGL5HQR,7 MWEDSWLVWD#JPDLOFRP 3XUSRVH)ORZGLYHUWHUGHYLFHVKDYHEHHQGHPRQVWUDWHGWREHRIKLJKHIÀFDF\ LQ WUHDWPHQW RI LQWUDFUDQLDO DQHXU\VPV HVSHFLDOO\ WKRVH ZLWKZLGH QHFNV 7KLV SURMHFWDWWHPSWVWRLGHQWLI\LISUHWUHDWPHQWÁRZFKDUDFWHULVWLFVDUHRIDVVLVWDQFHLQ SUHGLFWLQJZKHWKHUDVSHFLÀFDQHXU\VPLVPRUHSURQHWRWKURPERVHDQGLIDUHWKHUH DQ\KDHPRG\QDPLFLQGLFHVWKDWFRUUHODWHZLWKWKHUHJLRQVZKLFKWKURPERVHÀUVW 0HWKRGVDQG0DWHULDOV7ZRFDYHUQRXVDQHXU\VPVZHUHPRGHOOHGIURP'SUH WUHDWPHQWDQJLRJUDSKLFVWXGLHV3DWLHQWVZHUHWUHDWHGXVLQJÁRZGLYHUWHUGHYLFHV DQGZHUHIROORZHGRYHUWKHVXEVHTXHQWWRPRQWKVZLWKFRQWUDVWHQKDQFHG 'WLPHRIÁLJKWPDJQHWLFUHVRQDQFHDQJLRJUDSK\,PDJHVZHUHVHJPHQWHGXV LQJ#QHX)XVH76VRIWZDUH#QHX)XVHZDVDOVRXVHGWRYLUWXDOO\GHSOR\D ÁRZGLYHUWHULQERWKDQHXU\VPV)ORZZLWKZLWKRXWWKHÁRZGLYHUWHUZDVVLPXODWHG XVLQJ$16<6&);VRIWZDUH 5HVXOWV&RPSXWDWLRQDOÁXLGG\QDPLF&)'DQDO\VLVDQG'DQJLRJUDSKLFIRO ORZXSVWXGLHVHQDEOHGXVWRREVHUYHWKDWWKURPEXVIRUPDWLRQZLWKLQWKHDQHXU\VP VDFVLQLWLDWHGLQUHJLRQVRIVLJQLÀFDQWÁRZUHYHUVDOLQGLFDWHGE\KLJK2VFLOODWRU\ 6KHDU,QGH[UHDFKLQJYDOXHVQHDUDQGQHJDWLYHYDOXHVRIPLQLPXPDQHXU\VP IRUPDWLRQLQGH[FORVHWR &RQFOXVLRQ,QWKLVVWXG\&)'DQDO\VLVZDVSHUIRUPHGRQSUHWUHDWPHQWDQHX U\VPVJHRPHWULHVEHIRUHDQGDIWHUWKHYLUWXDOGHSOR\PHQWRIDÁRZGLYHUWHUGHYLFH ,WZDVREVHUYHGWKDWWKURPERVLVLVPRUHSURQHWRRFFXULQUHJLRQVRIVLJQLÀFDQW ÁRZUHYHUVDO:HFRQFOXGHWKDW&)'PD\SURYHXVHIXOLQSUHGLFWLQJZKLFKUHJLRQV RIDQDQHXU\VPWUHDWHGZLWKDÁRZGLYHUWHUZLOOWKURPERVHÀUVW % 6LOHQWLVFKDHPLFOHVLRQVDIWHUVWHQWDVVLVWHGFRLOLQJ 0/+DKQHPDQQ0+R06FKODPDQQ6*RHULFNH,:DQNH&0RHQLQJKRII 0)RUVWLQJ$5LQJHOVWHLQ(VVHQ'(PDULDKDKQHPDQQ#JP[GH 3XUSRVH 6WHQWDVVLVWHG FRLOLQJ KDV LPSURYHG WKH DELOLW\ WR WUHDW GLIÀFXOW DQG FRPSOLFDWHGDQHXU\VPV7KHSUHVHQWVWXG\DLPVWRLQYHVWLJDWHWKHUDWHRIVLOHQW HPEROLFOHVLRQVDIWHUVWHQWDVVLVWHGFRLOLQJDQGWRGHÀQHDVVRFLDWHGSUHGLFWRUV 0HWKRGV DQG 0DWHULDOV7KH VWXG\ LQFOXGHV D WRWDO RI SDWLHQWV WUHDWHG ZLWK VWHQWDVVLVWHG FRLOLQJV ':, 05 LPDJLQJ RI WKH EUDLQ ZDV SHUIRUPHG DIWHU VWHQWDVVLVWHG FRLOLQJ WR GHWHFW LQWHUYHQWLRQDVVRFLDWHG VLOHQW LVFKDHPLF OHVLRQV 'HPRJUDSKLFGDWDDQHXU\VPFKDUDFWHULVWLFVDQGDQJLRJUDSKLFSDUDPHWHUVZHUH FRUUHODWHGZLWKWKHIUHTXHQF\WKHGLVWULEXWLRQDQGWKHVL]HRIWKHLVFKDHPLFOHVLRQV 5HVXOWV$IWHUVWHQWDVVLVWHGFRLOLQJV':,05,DQDO\VHVDIWHULQWHUYHQWLRQ UHYHDOHGEULJKWOHVLRQVLQDSDWWHUQFRQVLVWHQWZLWKHPEROLFHYHQWVOHVLRQV ZHUHVPDOOHUWKDQPPLQGLDPHWHUZKHUHDVOHVLRQVZHUHODUJHUWKDQPP 0RUHWKDQWKHKDOIRIWKHWUHDWHGSDWLHQWVGLVSOD\HGHPEROLFHYHQWVZLWKRXW QHZQHXURORJLFDOGHÀFLW:HSUHVXPHDFRUUHODWLRQRIWKHVHLVFKDHPLFOHVLRQVZLWK WKHGXUDWLRQRIWKHSURFHGXUHDQGZLWKWKHSDWLHQWVDJH)XUWKHUPRUHKLJKHU':, UDWHVWHQGWRDSSHDULQWKHDQWHULRUEUDLQFLUFXODWLRQ 6FLHQWLILF6HVVLRQ 6 &$' ( ) *+% (XURSHDQ&RQJUHVVRI 5DGLRORJ\ % ,WHUDWLYHUHFRQVWUXFWLRQ,5LPSURYHVLPDJHTXDOLW\DQGGLDJQRVWLF FRQÀGHQFHRI&7GHOD\HGHQKDQFHPHQWLPDJLQJIRUWKHGHWHFWLRQRI P\RFDUGLDOLQIDUFWLRQSUHOLPLQDU\UHVXOWV $5RVVL0YDQ6WUDWHQ$'KDUDPSDO5%RRLM%5XVVR 7 6SULQJHOLQJ5-YDQ*HXQV$:HXVWLQN*3 .UHVWLQ5RWWHUGDP1/ DURVVL#HUDVPXVPFQO 3XUSRVH 7 R GHWHUPLQH WKH HIIHFW RI LWHUDWLYH UHFRQVWUXFWLRQ ,5 RQ &7 LPDJH TXDOLW\DQGGLDJQRVWLFFRQÀGHQFHRIP\RFDUGLDOLQIDUFWLRQGHWHFWLRQRQGHOD\HG HQKDQFHPHQWVFDQV 0HWKRGVDQG0DWHULDOV1LQHWHHQSDWLHQWVZLWKSULRUKLVWRU\RIP\RFDUGLDOLQIDUF WLRQZHUHHQUROOHGLQWKHVWXG\3URVSHFWLYHO\WULJJHUHG&7GHOD\HGHQKDQFHPHQW LPDJLQJZDVSHUIRUPHGHLJKWPLQXWHVDIWHU&7FRURQD\DQJLRJUDSK\XVLQJGXDO VRXUFH &7 VFDQQHU 6FDQV ZHUH UHFRQVWUXFWHG XVLQJ ÀOWHUHG EDFNSURMHFWLRQ )%3ZLWKDVPRRWKPHGLXPNHUQHO%DQG6LQRJUDP$IÀUPHG,56$),5( 6LHPHQV+HDOWKFDUHDWVWUHQJWKDQGZLWKNHUQHO,DQG,6LJQDO DQGQRLVHZHUHPHDVXUHGLQWKHGHVFHQGLQJDRUWD $WWHQXDWLRQZLWKLQWKHLQIDUFWHG P\RFDUGLXPZDVPHDVXUHGDQGWKHFRQWUDVWWRQRLVHUDWLR&15ZDVFDOFXODWHG 7ZREOLQGHGUHDGHUVJUDGHGWKHLPDJHVLQWHUPVRILPDJHTXDOLW\DQGGLDJQRVWLF FRQÀGHQFHLQLQIDUFWLRQGHWHFWLRQXVLQJDIRXUSRLQWVFDOHSRRUDQGH[FHOOHQW 05GHOD\HGHQKDQFHPHQWZDVXVHGIRUFRPSDULVRQ 5HVXOWV,QFRPSDULVRQZLWK)%3 WKHXVHRI,5VWUHQJWKUHVXOWHGLQDVLJ QLÀFDQWUHGXFWLRQRILPDJHQRLVHRIIRU,DQGIRU,S ,QFUHDVLQJWKHVWUHQJWKWRDIXUWKHUGHFUHDVHRIQRLVHZDVREVHUYHG IRU , DQG IRU , S $Q HTXLYDOHQW LQFUHDVHRI &15 IURP %WR,DQG,ZDVDOVRREVHUYHG S7KHRYHUDOOLPDJHTXDOLW\DQGWKHGLDJQRVWLFFRQÀGHQFHVLJQLÀFDQWO\ LPSURYHGXVLQJ,5 &RQFOXVLRQ7KHXVHRI,5UHGXFHVLPDJHQRLVHLPSURYLQJ&15RIWKHLQIDUFWHG P\RFDUGLXPWKXVSURYLGLQJEHWWHULPDJHTXDOLW\DQGKDYLQJWKHSRWHQWLDOWRGH FUHDVHUDGLDWLRQGRVH % 7KHHIIHFWRILWHUDWLYHUHFRQVWUXFWLRQRQFRPSXWHGWRPRJUDSK\ FRURQDU\DUWHU\FDOFLXPVFRUH 0&:LOOLDPV1::HLU18UHQ*0F.LOORS'(1HZE\-+5HLG (GLQEXUJK8.PLFKHOOHZLOOLDPV#HGDFXN 3XUSRVH ,WHUDWLYH UHFRQVWUXFWLRQ HQDEOHV WKH UHGXFWLRQ RI UDGLDWLRQ GRVH ZLWK PDLQWDLQHG LPDJH TXDOLW\ LQ FRPSXWHG WRPRJUDSK\ &7 :H DLPHGWR DVVHVV WKHHIIHFWRILWHUDWLYHUHFRQVWUXFWLRQRQWKHFDOFXODWLRQRIFRURQDU\DUWHU\FDOFLXP VFRUH&$&6 0HWKRGVDQG0DWHULDOV2QHKXQGUHGSDWLHQWVXQGHUZHQWHOHFWURFDUGLRJUDPJDWHG &7FRURQDU\FDOFLXPVFDQVDVSDUWRIWKH6&27+($57VWXG\XVLQJDPXOWL GHWHFWRUVFDQQHU7XEHYROWDJHZDVN9DQGWXEHFXUUHQWZDVVHOHFWHGEDVHG RQERG\PDVVLQGH[,PDJHVZHUHUHFRQVWUXFWHGXVLQJVWDQGDUGUHFRQVWUXFWLRQ DQGDQLWHUDWLYHUHFRQVWUXFWLRQDOJRULWKP$,'5%RWK $JDWVWRQVFRUHDQGFDOFLXP YROXPHZHUHFDOFXODWHG7KHHVWLPDWHGSHUFHQWLOHIRUDSDUWLFXODU&$&6EDVHGRQ DJHVH[DQGHWKQLFLW\ZDVFDOFXODWHGXVLQJWKH0(6$&$&6UHIHUHQFHYDOXHV 5HVXOWV7KLUW\VHYHQSDWLHQWVKDGDFDOFLXPVFRUHRI]HURDQGZHUHH[FOXGHGIURP IXUWKHUDQDO\VLV7KHUHZDVDVPDOOEXWVLJQLÀFDQWGLIIHUHQFHLQPHGLDQ$JDWVWRQ VFRUHDQGFDOFLXPYROXPHEHWZHHQVWDQGDUGDQGLWHUDWLYHUHFRQVWUXFWLRQVYV SDQGYVSUHVSHFWLYHO\,PDJHQRLVHZDVVLJQLÀFDQWO\ UHGXFHGZLWKLWHUDWLYHUHFRQVWUXFWLRQ+8&,WRYV+8WR S7KHUHZDVQRVLJQLÀFDQWGLIIHUHQFHLQHVWLPDWHGSHUFHQWLOHZLWK LWHUDWLYHUHFRQVWUXFWLRQYVS &RQFOXVLRQ,WHUDWLYHUHFRQVWUXFWLRQUHGXFHVLPDJHQRLVHLQ&7FRURQDU\FDOFLXP VFDQV 7KH DSSOLFDWLRQ RI$,'5 FRXOG OHDG WR VLJQLÀFDQW UHGXFWLRQ LQ UDGLDWLRQ GRVH7KHDEVROXWHYDOXHVRIERWK$JDWVWRQVFRUHDQGFDOFLXPYROXPHDUHVOLJKWO\ UHGXFHGXVLQJLWHUDWLYHUHFRQVWUXFWLRQ+RZHYHUWKHHVWLPDWHGSHUFHQWLOHIRUWKH LQGLYLGXDOSDWLHQWLVQRWDOWHUHG % &RURQDU\&7DQJLRJUDSK\FRPSDULVRQRIDQRYHOLWHUDWLYH UHFRQVWUXFWLRQZLWKÀOWHUHGEDFNSURMHFWLRQIRUUHFRQVWUXFWLRQRI ORZGRVH&7 5$3 7 DN[ 86FKRHSI-:1DQFH$0RVFDULHOOR0'DV &)LQN7 +HQ]OHU0DDVWULFKW1/&KDUOHVWRQ6&865RPH,7 0DQQKHLP'(UWDN[#VWXGHQWPDDVWULFKWXQLYHUVLW\QO 3XUSRVH7 RFRPSDUHLPDJHQRLVHEHWZHHQDQRYHOLWHUDWLYHUHFRQVWUXFWLRQDOJR ULWKP6$),5(DQGWUDGLWLRQDOÀOWHUHGEDFNSURMHFWLRQ)%3 &RQFOXVLRQ5,)UHFRQVWUXFWLRQLVVXSHULRUWRVWDQGDUGUHFRQVWUXFWLRQHVSHFLDOO\ LQSDWLHQWVZLWKDWULDOÀEULOODWLRQ)XUWKHUPRUH5,)SURYLGHVDWKHRU\IRUWKHRSWLPDO LPDJHUHFRQVWUXFWLRQSRLQW % &7FRURQDU\DUWHU\FDOFLXPVFRULQJDQGLWHUDWLYHLPDJH UHFRQVWUXFWLRQWHFKQLTXHVUHSURGXFLELOLW\DFFXUDF\DQGSRWHQWLDO IRUUDGLDWLRQGRVHUHGXFWLRQ $6FKLQGOHU 3 $SIDOWUHU59OLHJHQWKDUW7 $OOPHQGLQJHU 69RJW55DXSDFK) %DPEHUJ.1LNRODRX86FKRHSI &KDUOHVWRQ6&86)RUFKKHLP'(0DOYHUQ3$86 0XQLFK'(DQGUHDVVFKLQGOHU#PHGXQLPXHQFKHQGH 3XUSRVH7KHHIIHFWRILWHUDWLYHUHFRQVWUXFWLRQRQ&7FRURQDU\FDOFLXPVFRULQJ &&6 KDV QRW EHHQ LQYHVWLJDWHG :H HYDOXDWHG LQYLYR DQG LQYLWUR WKH UHSUR GXFLELOLW\ RI &&6 DFURVV GLIIHUHQW UHFRQVWUXFWLRQ PHWKRGV DQG WKH SRWHQWLDO IRU UDGLDWLRQGRVHUHGXFWLRQ 0HWKRGVDQG0DWHULDOVFRQVHFXWLYHSDWLHQWVPHQ\UVXQGHU ZHQW&&6VWXGLHVRQDQGJHQHUDWLRQGXDOVRXUFH&7'6&7V\VWHP,QYLWUR GDWDZHUHREWDLQHGXVLQJDPRYLQJDQWKURSRPRUSKLFFDUGLDFSKDQWRPFRQWDLQ LQJ FDOFLXP LQVHUWV RI GLIIHUHQW VL]HV )XOOGRVH UHFRQVWUXFWLRQV ZHUH EDVHG RQ SURMHFWLRQV IURP ERWK '6&7 WXEHGHWHFWRU FRQÀJXUDWLRQV +DOIGRVH DFTXLVLWLRQ ZDV VLPXODWHG E\ GLVFDUGLQJ UDZ GDWD IURP RQH WXEH )XOOGRVH DQG KDOIGRVH VHULHVZHUHUHFRQVWUXFWHGZLWKLWHUDWLYHUHFRQVWUXFWLRQLQLPDJHVSDFH,5,6DQG VLQRJUDPDIÀUPHGLWHUDWLYHUHFRQVWUXFWLRQ6$),5(XVLQJGHGLFDWHG&&6NHUQHOV &DOFLXPZDVPHDVXUHGXVLQJDFRQYHQWLRQDO&&6DSSOLFDWLRQDQGFRPSDUHGZLWK WUDGLWLRQDOÀOWHUHGEDFNSURMHFWLRQ)%3VHULHVE\:LOFR[RQ0DQQ:KLWQH\WHVWLQJ 5HVXOWV1RVLJQLÀFDQWGLIIHUHQFHVLQRYHUDOO&&6ZHUHIRXQGEHWZHHQIXOOGRVH )%3 ,5,6DQG6$),5(PHDQ&&6WKWKSHUFHQWLOH>@YV>@ DQG>@S!7KHPHDQHIIHFWLYHGRVHZDVP6Y'LIIHUHQFHV LQRYHUDOO&&6EHWZHHQIXOOGRVH)%3 KDOIGRVH,5,6>@DQGKDOIGRVH 6$),5( >@ ZHUH DOVR QRW VLJQLÀFDQW S! ,Q WZR SDWLHQWV ZLWK D &&6RI]HUREDVHGRQ)%3 WKH&&6EHFDPHSRVLWLYHRQLWHUDWLYHUHFRQVWUXFWLRQ /LNHZLVHLQYLWURWKHVPDOOHVWPPLQVHUWZDVUHFRJQL]HGDVFDOFLXPRQO\RQ LWHUDWLYHUHFRQVWUXFWLRQEXWQRWRQ)%3 &RQFOXVLRQ 2YHUDOO &&6 REWDLQHG E\ )%3 DQG LWHUDWLYHUHFRQVWUXFWLRQ DUH FRPSDUDEOHHYHQLIWKHUDGLDWLRQGRVHLVUHGXFHGE\/LNHO\WKURXJKQRLVH VXSSUHVVLRQ LWHUDWLYHUHFRQVWUXFWLRQ PD\ HQDEOH GHWHFWLRQ RI VPDOOHU FDOFLXP GHSRVLWVDQGWKXVRIHDUOLHUFRURQDU\DWKHURVFOHURVLV % +RZGLIIHUHQWOHYHOVRIWKJHQHUDWLRQLWHUDWLYHUHFRQVWUXFWLRQ LQÁXHQFHLPDJHTXDOLW\LQORZGRVHFDUGLDF&7 3 .URHSLO +'1DJHO$+%LJGHOL3 +HXVFK56/DQ]PDQ *3HQWDQJ*$QWRFK0&RKQHQ'VVHOGRUI'(%XFKKRO]'( 1HXVV'(3DWULF.URHSLO#PHGXQLGXHVVHOGRUIGH 3XUSRVH7 R LQYHVWLJDWH HIIHFWV RI DQ DGYDQFHG WK JHQHUDWLRQ LWHUDWLYHU H F R Q VWUXFWLRQ,5WHFKQLTXHRQVXEMHFWLYHDQGREMHFWLYHLPDJHTXDOLW\,4LQORZGRVH FDUGLDF&7$ 0HWKRGVDQG0DWHULDOV)LYHGDWDVHWVRISURVSHFWLYHO\WULJJHUHGFRURQDU\&7$LQ ´VWHSDQGVKRRWµPRGHZHUHDFTXLUHGRQDVOLFH&7VFDQQHUZLWKRSWLPLVHG H[SRVXUHVHWWLQJV(DFKGDWDVHWZDVSURFHVVHGWLPHVUHVXOWLQJLQQ LPDJH VWDFNV'DWDZHUHSURFHVVHGRQDSURWRW\SH,5V\VWHPXVLQJÀOWHUHGEDFNSURMHF WLRQ)%3DQGOHYHOVRIDQDGYDQFHG,5WHFKQLTXH,'RVH3KLOLSVSURYLGLQJ LQFUHPHQWDOUDWHRI,5OHYHOLQYROYLQJERWKUDZDQGLPDJHGDWDVSDFH,PDJH QRLVHZDVPHDVXUHGLQWKHFRQWUDVWHQKDQFHGDVFHQGLQJDRUWD&RQWUDVWWRQRLVH DQGVLJQDOWRQRLVHUDWLRV&15615ZHUHFRPSDUHGDWFRURQDU\ORFDWLRQVLQ DOOLPDJHVWDFNV6XEMHFWLYH,4ZDVUDWHGRQDSRLQWVFDOHZLWK´QDWXUDOµLPDJH DSSHDUDQFHDQGQRLVHUHODWHGDUWHIDFWVDVPDLQFULWHULD 5HVXOWV0HDQHIIHFWLYHGRVHRIFDUGLDF&7$ZDVP6Y0HDQ&15DQG615 ZHUHVLJQLÀFDQWO\LPSURYHGZLWK,5ZKHQFRPSDUHGWR)%3DQGZLWKHYHU\LQFUHDV LQJOHYHORI,5UDQJH&15UDQJH615SZLWKEHVW REMHFWLYH,4DWKLJKHVWOHYHORI,5,'RVHOHYHO6XEMHFWLYH,4KRZHYHUZDVUDWHG EHVWDWPHGLXPOHYHORI,5,'RVHOHYHOZLWKIHZHUDUWHIDFWVZKHQFRPSDUHG WR)%3DQGPRUHQDWXUDOLPDJHDSSHDUDQFHFRPSDUHGWRKLJKHUOHYHOVRI,5 &RQFOXVLRQ2EMHFWLYH,4&15615LPSURYHVZLWKLQFUHDVLQJOHYHORI,5LQORZ GRVHFDUGLDF&7$%HVWVXEMHFWLYH,4KRZHYHULVUHDFKHGDWPHGLXPOHYHOVRI,5 ZLWKPLQLPDODUWHIDFWVDQG´QDWXUDOµLPDJHDSSHDUDQFH 6FLHQWLILF6HVVLRQ $ 6&'()*+%(XURSHDQ&RQJUHVVRI 5DGLRORJ\ )ULGD\ VLJQLÀFDQWO\GLIIHUHQWXVLQJD6$6RU56SURWRFRO7KHHVWLPDWHGUDGLDWLRQGRVH ZDV VLJQLÀFDQWO\ ORZHU ZLWK WKH 6$6 WKDQ ZLWK WKH 56 SURWRFRO YV P6YS &RQFOXVLRQ$ VWHSDQGVKRRW &7&$ VFDQ SURWRFRO LV WKH SUHIHUUHG SURWRFROLQ SDWLHQWVZLWKUHJXODUKHDUWUDWHVXVLQJVOLFHGXDOVRXUFH&7 SURYLGLQJRSWLPDO GLDJQRVWLFDFFXUDF\ZLWKDQ´DVORZDVUHDVRQDEO\DFKLHYDEOHµUDGLDWLRQGRVH % &RPSXWHGWRPRJUDSK\FRURQDU\DQJLRJUDSK\&7&$UDGLDWLRQ GRVHDV\VWHPDWLFUHYLHZRIWKHDSSOLFDWLRQRIFRQYHUVLRQIDFWRUV 0&:LOOLDPV'60DFODFKODQ60LUVDGUDHH'(1HZE\1::HLU (GLQEXUJK8.PLFKHOOHZLOOLDPV#HGDFXN 3XUSRVH7LVVXHZHLJKWLQJIDFWRUVXVHGWRFDOFXODWHHIIHFWLYHGRVH(ZHUHXS GDWHGE\,&53LQ5HFHQWZRUNVXJJHVWVWKDWGXHWRWKHLQFUHDVHGZHLJKWLQJ IDFWRUIRUEUHDVWWLVVXHFRQYHUVLRQIDFWRUVVKRXOGEHLQFUHDVHGZKHQFDOFXODWLQJ (IURPGRVHOHQJWKSURGXFW'/3LQ&7&$:HDLPHGWRDVVHVVWKHDSSOLFDWLRQ RIFRQYHUVLRQIDFWRUVLQ&7&$OLWHUDWXUH 0HWKRGVDQG0DWHULDOV3HHUUHYLHZHGDUWLFOHVRQ&7&$LQ(QJOLVKRUZLWKDQ DYDLODEOH WUDQVODWLRQ ZHUH LGHQWLÀHG RQ 0('/,1( XVLQJ DQ RQOLQHV H D U F K W R R O 3XE0HG$UWLFOHV ZHUH LQFOXGHG LI WKH\ FRPPHQWHG RQ UDGLDWLRQ GRVH LQ WLWOH RUDEVWUDFW5HYLHZVHGLWRULDOVSKDQWRPDQGSDHGLDWULFVWXGLHVZHUHH[FOXGHG %HWZHHQDQG6HSWHPEHUWKHUHZHUHVXLWDEOHSDSHUV 5HVXOWV&RQYHUVLRQIDFWRUZDVQRWVWDWHGLQSDSHUVZLWKRIWKHVH EHLQJSXEOLVKHGLQWKHÀUVWKDOIRI7KHUHLVDQRQVLJQLÀFDQWWUHQGWRZDUGV SUHVHQWLQJ '/3 DQG FRQYHUVLRQ IDFWRUV LQ DEVWUDFWV YV S DQG YV S UHVSHFWLYHO\7KH PRVW IUHTXHQW FRQYHUVLRQIDFWRUVDUHDQG+RZHYHUWKHXVHRI LV GHFUHDVLQJ YV DQG LV LQFUHDVLQJ YV S7KHXVHRIVFDQQHUVSHFLÀFFRQYHUVLRQIDFWRUVKDVUHFHQWO\ HPHUJHGEXWFXUUHQWO\DFFRXQWVIRURQO\RISDSHUV &RQFOXVLRQ7KHXVHRIWKHORZHUFRQYHUVLRQIDFWRULVLQFUHDVLQJGHVSLWH WKHFKDQJHLQ,&53UHFRPPHQGDWLRQV $VLJQLÀFDQWSURSRUWLRQRIFXUUHQWOLWHUDWXUH GRHVQRWUHSRUWWKHFRQYHUVLRQIDFWRUPDNLQJLWLPSRVVLEOHWRFRPSDUHUDGLDWLRQ GRVHVEHWZHHQVWXGLHV 5RRP& 1HXUR 66E )XQFWLRQDO05,UHVWLQJVWDWHDQG'7, 0RGHUDWRUV 1%DUJDOOy%DUFHORQD(6 06PLWV5RWWHUGDP1/ % 7DUJHWPDSLQGLYLGXDOLVDWLRQIRUWKDODPXVQHXURVXUJHU\SRVVLEOH DSSOLFDWLRQVRIGLIIXVLRQWHQVRUWUDFWRJUDSK\DQGVWDWLVWLFDOVKDSHPRGHOV $-DNDE5%ODQF$0RUHO(/%HUHQ\L*6]HNHO\=XULFK&+ 'HEUHFHQ+8MDNDED#PHGXQLGHEKX 3XUSRVH1HXURVXUJLFDOLQWHUYHQWLRQVRIWKHWKDODPXVUHO\RQWUDQVIHUULQJVWHUH RWDFWLF'FRRUGLQDWHVIURPDQDQDWRPLFDODWODVRQWRWKHSDWLHQWҋV05EUDLQLPDJHV :HDLPHGWRGHYHORSDVRIWZDUHDSSOLFDWLRQIRUWKDODPXVWDUJHWPDSLQGLYLGXDOLVD WLRQWKDWIXVHVLQIRUPDWLRQIURPSDWLHQWVSHFLÀFWKDODPXVJHRPHWU\DQGGLIIXVLRQ WHQVRUWUDFWRJUDSK\ 0HWKRGVDQG0DWHULDOV3UHYLRXVO\RXUZRUNJURXSGHYHORSHGDWKDODPXVDWODV E\IXVLQJDQDWRPLFDOLQIRUPDWLRQIURPKLVWRORJLFDOO\SURFHVVHGWKDODPL7KHDWODV ZDVWUDQVIHUUHGWRDVWDQGDUGQHXURLPDJLQJVSDFHDQG'7,VFDQVRIKHDOWK\ VXEMHFWVZHUHDFFHVVHGWKDODPRFRUWLFDOFRQQHFWLYLW\PDSVZHUHJHQHUDWHGXVLQJ DSUHYLRXVO\GHVFULEHGSURFHGXUH9LVLEOHRXWOLQHVDQGFRQQHFWLYLW\EDVHGLQWHUQDO ODQGPDUNVZHUHLQFRUSRUDWHGLQDVWDWLVWLFDOVKDSHPRGHOUHVSHFWLQJWKHLQKHUHQW YDULDELOLW\RIWKHLQGLYLGXDOH[DPSOHV7KLVLQIRUPDWLRQZDVXVHGWRGHIRUPWKHDWODV WRLQGLYLGXDOLPDJHV3RVWPRUWHP05,VFDQVZHUHXVHGWRTXDQWLI\WKHJHRPHWULF DFFXUDF\RIQXFOHLSUHGLFWLRQV 5HVXOWV5HOLDEOHWUDFWRJUDSK\EDVHGPDUNHUVZHUHORFDWHGLQWKHYHQWURODWHUDO WKDODPXVZLWKWKHVRPDWRVHQVRU\FRQQHFWLRQVFRLQFLGLQJZLWKWKH93/DDQG93/S QXFOHLDQGPRWRUSUHPRWRUFRQQHFWLRQVZLWK9/SDQG9/DQXFOHLWKHXQFHUWDLQLW\ RIORFDOLVDWLRQZDVOHVVWKDQPP7KHHUURURISUHGLFWLQJJHRPHWU\H[SUHVVHGLQ VXUIDFHWRVXUIDFHGLVWDQFHVZDVPPIRUWKHYLVLEOHWKDODPXVRXWOLQHVDQG 0HWKRGV DQG 0DWHULDOV 7ZHQW\ FRQVHFXWLYH SDWLHQWV XQGHUZHQW FRURQDU\ &7 DQJLRJUDPVF&7$XVLQJS(&*GXDOBVWHSVFDQSURWRFRODVFDQPRGHWKDWDSSOLHV IXOOUDGLDWLRQDWDQDGMXVWDEOHOLPLWHGSKDVHRIWKHFDUGLDFF\FOHZKLOHORZUDGLDWLRQ WXEHFXUUHQWLVSHUIRUPHGRYHURIWKHFDUGLDFF\FOH7KHLPDJHVZHUH UHFRQVWUXFWHGZLWKUHJXODU)%3DWIXOOGRVH*URXSDDQGORZGRVH*URXSE DQGZLWK6$),5(ZLWKLWHUDWLRQVDWORZGRVH*URXS7KUHHUHJLRQVRILQWHUHVW 52,ZHUHHYDOXDWHGIRUVLJQDOLQWHQVLW\LPDJHQRLVHVLJQDOWRQRLVHUDWLR615 DQGFRQWUDVWWRQRLVHUDWLR&156XEMHFWLYHLPDJHTXDOLW\ZDVDVVHVVHGRQD SRLQWVFDOHEDVHGXSRQLPDJHVKDUSQHVVDQGQRLVH 5HVXOWV2EMHFWLYHLPDJHQRLVHZDVUHGXFHGE\3RQDYHUDJH LQ*URXSFRPSDUHGWR*URXSE7KHUHZDVDOVRDVLJQLÀFDQW3 LP SURYHPHQWLQRYHUDOOVXEMHFWLYHLPDJHTXDOLW\LQ*URXSFRPSDUHGWR*URXSD &RQFOXVLRQ,WHUDWLYHUHFRQVWUXFWLRQHQDEOHGVLJQLÀFDQWUHGXFWLRQLQLPDJHQRLVH ZLWKRXWORVVLQVXEMHFWLYHLPDJHTXDOLW\DQGKROGVSRWHQWLDOWRLPSURYHLPDJHTXDO LW\LQORZGRVHIXQFWLRQDOF&7$DQGSRVVLEO\UHGXFHUDGLDWLRQGRVHHYHQIXUWKHU % 6WHQRVLVTXDQWLÀFDWLRQXVLQJGLIIHUHQWN9DSKDQWRPVWXG\ FRPSDULQJYROXPH&7WRPLFUR&7 $8UVDQL +0HKUH]-%OREHO+.DVKDQL163DXO7 RURQWR21&$ 0DUNKDP21&$1HXVV'(DOLXUVDQL#XKQRQFD 3XUSRVH 7 R GHWHUPLQH WKH LPSDFW RI LQVWHQRVLV FRQWUDVW RQ DFFXUDWH OXPHQ DVVHVVPHQW LQ FDOFLÀHG FRURQDU\ SODTXHV FRPSDULQJ WZR KLJKUHVROXWLRQ &7 D SKDQWRPVWXG\ 0HWKRGV DQG 0DWHULDOV$ [ FP VWDWLF FRURQDU\ DUWHU\ SKDQWRP ZLWK WLV VXHHTXLYDOHQW+8PDWHULDOFRQWDLQHGYHVVHOVRIPP*DQGPP *GLDPHWHUHDFK&LUFXPIHUHQWLDOOXPHQVWHQRVLVDQG ZHUHFUHDWHGXVLQJPJFF+\GUR[\DSDWLWH+$7KHOXPHQFRQWDLQHGGLOXWHG LRGLQDWHGFRQWUDVWPJPO9LVLSDTXHUHDFKLQJ+8&7VFDQVSHUIRUPHG XVLQJP0LFUR&7 P&7DQGP9ROXPH&7 Y&7VSDWLDOUHVROXWLRQZLWK PPVOLFHUHFRQVWUXFWLRQDWDQGN9S9DULHGWXEHFXUUHQWPDLQWDLQHG LPDJHQRLVHRI+87KHPD[LPXP+8YDOXHRIWKHSODTXHDQGWKHPLQLPXP YDOXHRIWKHYHVVHOOXPHQZHUHPHDVXUHGE\LQOLQHKLVWRJUDP+8DQGFRQWUDVW &>+8@ZDVFDOFXODWHG 5HVXOWV &RQWUDVW +8 IRU Y&7P&7 DW N9 LQ * & & &&DQG*&& && &RQWUDVW +8 IRU Y&7P&7 DW N9 LQ * & & &&DQG*&&& & Y&7VKRZHGKLJKHUPHDQFRQWUDVWFRPSDUHGZLWKP&7IRUVWHQRVLV SDLUHGWWHVWS ( &RQFOXVLRQ Y&7 UHOLDEO\ YLVXDOLVHV OXPHQ VWHQRVLV LQ DQG PP DUWHULHVDQGVWHQRVLVLQPPDUWHULHVP&7YLVXDOLVHVOXPHQVWHQRVLV LQPPYHVVHOV)RUOXPHQVWHQRVLVY&7FRQWUDVWLVKLJKHUWKDQ P&7 WKLVFDSDELOLW\SURPLVHVVXSHULRUSRWHQWLDOIRUGHWHFWLRQRIFRURQDU\SODTXH FRPSRVLWLRQLQFOXGLQJGXDOHQHUJ\WHFKQLTXHV % $UDQGRPLVHGVWXG\WRWHVWWKHGLDJQRVWLFSHUIRUPDQFHRIVOLFH GXDOVRXUFH&7FRURQDU\DQJLRJUDSK\LQSDWLHQWVZLWKYDULRXVKHDUW UDWHVXVLQJORZGRVHVFDQSURWRFROV $5RVVL/$1HHIMHV$6'KDUDPSDO$&:HXVWLQN*3 .UHVWLQ.1LHPDQ 3 -GH)H\WHU150ROOHW5RWWHUGDP1/DOH[LDURVVL #DOLFHSRVWDLW 3XUSRVH7 RFRPSDUHUDGLDWLRQGRVHDQGGLDJQRVWLFSHUIRUPDQFHRI&7FRURQDU\ DQJLRJUDSK\&7&$SURWRFROVXVLQJDVOLFHGXDOVRXUFH&7VFDQQHU6LHPHQV DSURVSHFWLYHKLJKSLWFKVSLUDO+36DSURVSHFWLYHVWHSDQGVKRRW6$6DQGD UHWURVSHFWLYH56VFDQSURWRFRO 0HWKRGV DQG 0DWHULDOV :H SURVSHFWLYHO\ LQFOXGHG V\PSWRPDWLF SDWLHQWV ZLWKDUHJXODUKHDUWUDWH+53DWLHQWVZLWKDSUHVFDQ+5ESPJURXS$ SDWLHQWVPHQPHDQ+5ESPZHUHUDQGRPLVHGWRKDYHD+36RU 6$6VFDQZLQGRZRIWKH55LQWHUYDOVFDQ3DWLHQWVZLWKDSUHVFDQ+5 ESPJURXS%SDWLHQWVPHQPHDQ+5ESPZHUHUDQGRPLVHG WRKDYHD6$6VFDQZLQGRZRU56VFDQSXOVLQJZLQGRZ7KH SUHVHQFHRIDVLJQLÀFDQWVWHQRVLVZDVDVVHVVHGVHJPHQWOHYHODQGFRPSDUHG ZLWKTXDQWLWDWLYHFRURQDU\DQJLRJUDSK\ 5HVXOWV *URXS$ VHQVLWLYLW\ ZDV VLJQLÀFDQWO\ ORZHU XVLQJ +36 WKDQ XVLQJ WKH 6$6SURWRFROYVS6SHFLÀFLW\SRVLWLYHSUHGLFWLYHYDOXH339 DQGQHJDWLYHSUHGLFWLYHYDOXH139ZHUHVLPLODU7KHHVWLPDWHGUDGLDWLRQGRVH ZDVVLJQLÀFDQWO\ORZHUZLWKWKH+36WKDQZLWKWKH6$6SURWRFROYV P6YS*URXS%VHQVLWLYLW\VSHFLÀFLW\339DQG139ZHUHQRW 6FLHQWLILF6HVVLRQ 6 &$' ( ) *+% (XURSHDQ&RQJUHVVRI 5DGLRORJ\ % $VVHVVPHQWRIWKHGHJUDGDWLRQRIWKHVHOHFWHGSURMHFWLOH FRPPLVVXUDODQGDVVRFLDWLRQZKLWHPDWWHUWUDFWVLQDV\PSWRPDWLF +,9SRVLWLYHQRQWUHDWHG+,9SRVLWLYH+$$57WUHDWHGDQG+,9+&9 SRVLWLYHSDWLHQWVXVLQJGLIIXVLRQWHQVRU05LPDJLQJ -%ODGRZVND$.ROWRZVND3 6]HZF]\N$=LPQ\%+HQGULFK%.Q\V] 06DVLDGHN:URFODZ3/PEODGRZ#ZSSO 3XUSRVH+,9LQIHFWLRQPD\DIIHFWFHUHEUDOZKLWHPDWWHU7KHDLPRIWKHVWXG\ZDV WRHYDOXDWHWKHVHOHFWHGZKLWHPDWWHUWUDFWVLQDV\PSWRPDWLF+,9SRVLWLYHSDWLHQWV XVLQJGLIIXVLRQWHQVRULPDJLQJ'7, 0HWKRGVDQG0DWHULDOV)RUW\HLJKW+,9SRVLWLYHDV\PSWRPDWLFSDWLHQWV+,9 SRVLWLYH QRQWUHDWHG PHDQ DJH \UV +,9SRVLWLYH +$$57WUHDWHG PHDQ DJH \UV +,9+&9SRVLWLYH PHDQ DJH \UV DQG QRUPDO FRQWURO VXEMHFWPHDQDJH\UVZHUHHQUROOHGLQWKHVWXG\'7,H[DPLQDWLRQVZHUH SHUIRUPHGRQ705VFDQQHU)UDFWLRQDODQLVRWURS\)$DQGDYHUDJHGLIIXVLRQ FRHIÀFLHQWDYHUDJH'&YDOXHVZHUHREWDLQHGZLWKDVPDOO52,PHWKRGLQPLGGOH FHUHEHOODUSHGXQFOHV0&3LQIHULRUORQJLWXGLQDOIDVFLFXOL,/)LQIHULRUIURQWRRF FLSLWDOIDVFLFXOL,)2)JHQX*&&DQGVSOHQLXP6&&RIWKHFRUSXVFDOORVXP SRVWHULRUOLPEVRIWKHLQWHUQDOFDSVXOHV3/,&VXSHULRUORQJLWXGLQDOIDVFLFXOL6/) DQGSRVWHULRUFLQJXOD&* 5HVXOWV6LJQLÀFDQWGHFUHDVHRI)$SFRPSDUHGWRWKHQRUPDOVXEMHFWV ZDVIRXQGLQDOO+,9SRVLWLYHSDWLHQWVLQWKHOHIW0&3 ERWK,/) ERWK,)2) *&& 6&&DQGERWK6/) ZKLOHWKHUHZHUHQRVXFKGLIIHUHQFHVLQWKHULJKW0&3DQG ERWK &* 6LJQLÀFDQW UHGXFWLRQV RI )$ LQ ERWK 3/,& ZHUH REVHUYHG RQO\ LQ +,9 SRVLWLYH +$$57WUHDWHG SDWLHQWV S 6LJQLÀFDQW LQFUHDVHRI DYHUDJH '& SZDVIRXQGRQO\LQ*&&DQGULJKW6/)LQ+,9SRVLWLYHQRQWUHDWHGDQG +,9+&9SRVLWLYHVXEMHFWV &RQFOXVLRQ7KH)$YDOXHFRXOGEHDQRQLQYDVLYHQHXURLPDJLQJELRPDUNHUIRUDV VHVVLQJWKHPLFURVWUXFWXUDOFKDQJHVZLWKLQWKHZKLWHPDWWHUWUDFWVLQDV\PSWRPDWLF +,9SRVLWLYHSDWLHQWV+,9SRVLWLYH+$$57WUHDWHGSDWLHQWVVHHPWRSUHVHQWWKH PRVWVLJQLÀFDQWFKDQJHV % 3DVVLYHUDQJHRIPRWLRQIXQFWLRQDO05,SDUDGLJPVDUHXVHIXOLQWKH SUHVXUJLFDOZRUNXSRIFKLOGKRRGHSLOHSVLHV /5.R]DN0+HJ\L3 %DUVL*5XGDV%XGDSHVW+8ONR]DN#PUNNVRWHKX 3XUSRVH3HUIRUPLQJSUHVXUJLFDOIXQFWLRQDO05,I05,LQHSLOHSWLFFKLOGUHQSRVHV FKDOOHQJHVGXHWRWKHUHODWLYHO\\RXQJDJHRIWKHSDWLHQWVDQGRUWKHLUSRVVLEOH PHQWDO UHWDUGDWLRQ RU SDUHVLV 3DVVLYH UDQJHRIPRWLRQ 5R0 SDUDGLJPV ZHUH VXJJHVWHGIRUVHQVRU\PRWRUFRUWH[PDSSLQJLQWKLVSRSXODWLRQDVWKHVHSDUDGLJPV GR QRW UHTXLUH SDWLHQW FRRSHUDWLRQ 5HWURVSHFWLYH DQDO\VLV RI RXU SDVVLYH 5R0 H[DPLQDWLRQVLVSUHVHQWHGWRHYDOXDWHWKHXWLOLW\RIWKHPHWKRGLQWKHSDHGLDWULF HSLOHSV\SRSXODWLRQ 0HWKRGVDQG0DWHULDOV1LQHI05,H[DPLQDWLRQVRIVHYHQFKLOGUHQPHDQDJH \UVUDQJHER\VFDVHVRIFRUWLFDOG\VJHQHVLVRIWXPRXUDQG RISRUHQFHSKDOLFF\VWVSHUIRUPHGDW73KLOLSV$FKLHYD7 3KLOLSV+HDOWKFDUH %HVW7KH1HWKHUODQGVLQRXULQVWLWXWHLVUHYLHZHG)RXUSDWLHQWVZHUHVFDQQHG LQLQWUDYHQRXVSURSRIROVHGDWLRQXVLQJSDVVLYH5R0RQHRIWKHPZDVVFDQQHG ZLWKRXW VHGDWLRQ DV ZHOO7KH UHPDLQLQJ WKUHH SDWLHQWV ZHUH H[DPLQHG ZLWKRXW VHGDWLRQERWKZLWKDFWLYHDQGSDVVLYH5R0SDUDGLJPV 5HVXOWV:HZHUHDEOHWRFOHDUO\LGHQWLI\WKHPDLQVHQVRU\PRWRUIRFLLQDOOFDVHV 0RUHRYHUZHFRXOGVKRZYDULDEOHDPRXQWRIIXQFWLRQDOUHRUJDQL]DWLRQWRWKHKHDOWK\ KHPLVSKHUHLQWKUHHFDVHV1HYHUWKHOHVVWKHGLVWULEXWLRQRIDFWLYDWLRQVREWDLQHG ZLWKDQGZLWKRXWVHGDWLRQDQGZLWKSDVVLYHDQGDFWLYH5R0GLIIHUHGWRVRPHH[WHQW DQGLQRQHFDVHRQJRLQJHSLOHSWLFDFWLYLW\LQWHUIHUHGZLWKI05, &RQFOXVLRQ 3DVVLYH 5R0 I05, SDUDGLJPV DUH XVHIXO IRU WKH HYDOXDWLRQ RI VHQVRU\PRWRUFRUWH[LQSDHGLDWULFHSLOHSV\SDWLHQWV0RUHRYHURXUUHVXOWVVKRZ WKDWWKHVHSDUDGLJPVDUHDEOHWRGHVFULEHFRUWLFDOUHRUJDQLVDWLRQWKXVWKH\KDYH FOHDUSURJQRVWLFYDOXHLQDSUHRSHUDWLYHVHWWLQJ % )05,VWXG\RIVPHOOSHUFHSWXDOFRJQLWLYHDQGVHPDQWLFFRPSRQHQW RIFRUWLFDOHODERUDWLRQRIIRXUIDPLOLDUDURPDV /5RPROL08NPDU) &DVDJUDQGH01DFFDUDWR3 %DWWDJOLQL0&RYD 7ULHVWH,7PDMDXNPDU#DOLFHLW 3XUSRVH7 RLQYHVWLJDWHWKHFKDQJHVLQFRUWLFDODFWLYDWLRQGXULQJWKHDGPLQLVWUDWLRQ RIIRXUIDPLOLDUDURPDV 0HWKRGVDQG0DWHULDOVYROXQWHHUVKDYHEHHQHQUROOHGLQWKHVWXG\$OOWKH H[DPLQDWLRQVKDYHEHHQSHUIRUPHGRQD7PDJQHWXVLQJDQI05,(3,VHTXHQFH 757( VOLFHV G\QDPLFV VHVVLRQ GXUDWLRQ PLQ )RXU YDULHGIURPWRPPGHSHQGLQJRQWKHLQIRUPDWLRQXWLOLVHGGXULQJSUHGLFWLRQV HJFRQQHFWLYLW\EDVHGODQGPDUNVRUWKDODPXVRXWOLQHV &RQFOXVLRQ3UHYLRXVVWXGLHVKDYHDOUHDG\DSSOLHG'7,WRWKHWKDODPXV $VDIXU WKHUVWHSLQWKLVGLUHFWLRQZHGHPRQVWUDWHDK\EULGDSSURDFKXVLQJVWDWLVWLFDOVKDSH PRGHOVWKDWKDVWKHSRWHQWLDOWRFRSHZLWKYDULDWLRQVLQLQGLYLGXDOWKDODPXVJHRPHWU\ % '7,WUDFWVSHFLÀFHYDOXDWLRQRIWKHFRUSXVFDOORVXPLQSDWLHQWVZLWK GLDJQRVHGV\VWHPLFOXSXVHU\WKHPDWRVXV 3 3RGJRUVNL$=LPQ\3 6]HZF]\N-%ODGRZVND06]P\UND.DF]PDUHN 06DVLDGHN:URFODZ3/SSRGJRUVNL#RQHWSO 3XUSRVH$VVHVVPHQWRIWKHSRWHQWLDOZKLWHPDWWHUGDPDJHLQSDWLHQWVZLWKGLDJ QRVHGV\VWHPLFOXSXVHU\WKHPDWRVXV6/(XVLQJGLIIXVLRQWHQVRULPDJLQJ'7, DQGWUDFWVSHFLÀFPRUSKRPHWU\ 0HWKRGVDQG0DWHULDOV7KLUW\RQHSDWLHQWVPHDQDJH\UVZLWKGLDJQRVHG 6/(DQGQRUPDODSSHDULQJEUDLQLQFRQYHQWLRQDO05,ZHUHLQFOXGHGLQWKLVVWXG\ 7KHVWXG\DOVRLQFOXGHGDFRQWUROJURXSFRPSRVHGRIDJHDQGVH[PDWFKHG KHDOWK\ YROXQWHHUV$OO VXEMHFWV XQGHUZHQW FRQYHQWLRQDO EUDLQ 05, ZLWK W\SLFDO SURWRFROFRQVLVWLQJRI77)/$,5DQG':,LPDJHVSHUIRUPHGRQD705 VFDQQHU $OOVXEMHFWVDOVRXQGHUZHQW'7,H[DPLQDWLRQZLWKWKHIROORZLQJSDUDPHWHUV GLIIXVLRQGLUHFWLRQVE VPPVOLFHWKLFNQHVVPPQRJDS2EWDLQHG '7,LPDJHVZHUHSUHSURFHVVHGE\DSSO\LQJSDUDPHWHUDIÀQHWUDQVIRUPDWLRQ XVLQJ$L5 KWWSELVKRSZORQLXFODHGX DQG WKHQ DQDO\VHG LQ 'WL6WXGLR KWWSV ZZZPULVWXGLRRUJ0XOWLSOH52,DSSURDFKZDVDSSOLHGWRVHOHFWJHQXVSOHQLXP DQGHQWLUHFRUSXVFDOORVXPWUDFWV2EWDLQHGPLQLPDOPD[LPDODQGPHDQYDOXHV RIIUDFWLRQDODQLVRWURS\)$ZHUHWKHQFRPSDUHGLQSDWLHQWVDQGFRQWUROVE\XVLQJ 0DQQ:KLWQH\8DQGWWHVW 5HVXOWV&RPSDUHGWRFRQWUROV6/(SDWLHQWVVKRZHGVLJQLÀFDQWO\SORZHU PHDQ)$YDOXHVZLWKLQJHQXDQGVSOHQLXPWUDFWVRIWKHFRUSXVFDOORVXP)$PHDQ YDOXHVZLWKLQHQWLUHFRUSXVFDOORVXPVKRZHGORZHUYDOXHVLQ6/(SDWLHQWVFRPSDUHG WRWKHFRQWUROJURXSEXWGLGQRWUHDFKWKHVWDWLVWLFDOVLJQLÀFDQFH &RQFOXVLRQ7UDFWVSHFLÀF'7,VWXG\VKRZHGVWDWLVWLFDOO\VLJQLÀFDQWUHGXFWLRQRI)$ YDOXHLQWKHFRUSXVFDOORVXPVXJJHVWLQJZKLWHPDWWHUGDPDJHLQSDWLHQWVZLWK6/( % 1HZQRQOLQHDUFRORXUORRNXSWDEOHWRYLVXDOLVHIUDFWLRQDO DQLVRWURS\FKDQJHVGHPRQVWUDWHGRQPXOWLSOHV\VWHPDWURSK\ -.HOOHU$05XOVHK$.RPDUHN,/DWQHURYD55XVLQD.=DUXERYD +%UR]RYD-9\PD]DO3UDJXH&=MLULNHOOHU#KRPRONDF] 3XUSRVH7 RIDFLOLWDWHWKHDVVHVVPHQWRIIUDFWLRQDODQLVRWURS\)$LQGDLO\FOLQLFDO SUDFWLFHE\GHÀQLQJDQHZQRQOLQHDUFRORUORRNXSWDEOH/87 0HWKRGVDQG0DWHULDOV)$ZDVFDOFXODWHGIRUKHDOWK\YROXQWHHUVDJH \HDUV6'UDQJH7 PPLVRWURSLFYR[HOPRWLRQSURELQJJUDGLHQWV 03*$VXEVHWRIVXEMHFWVZDVDGGLWLRQDOO\VFDQQHGXVLQJ03*)$LQ WKHFRUSXVFDOORVXPIURQWDOJUH\PDWWHUWKDODPXVDQGLQWKHEDVDOJDQJOLDZDV PHDVXUHGDQGDQDO\VHGXVLQJWKHUDQGRPLQWHUFHSWOLQHDUPL[HGPRGHOWRFDOFXODWH WKH SRSXODWLRQ PHDQV DQG SUHGLFWLRQ LQWHUYDOV ZKLFK ZHUH XVHG WR FUHDWH D QRQOLQHDU FRORXU /87 8QLTXH FRORXUV ZHUH DVVLJQHG WR LQÁHFWLRQ SRLQWV DQG FRQWLQXRXVUDPSVZHUHJHQHUDWHGWRFUHDWHDFRORXUWUDQVLWLRQEHWZHHQWKHP7KH /87ZDVDSSOLHGWRJURXSVRISDWLHQWVZLWKPXOWLSOHV\VWHPDWURSK\06$DQG PDWFKLQJYROXQWHHUV)RXUEOLQGHGUDGLRORJLVWVFODVVLÀHGVXEMHFWVDVQRUPV06$ 7KLUWHHQSDWLHQWVZLWK3DUNLQVRQGLVHDVHZHUHWKHQDGGHGWRDQRQ\PLVHGFRKRUW 5HVXOWV7KH/87JHQHUDWHGIURP03*GDWDLVFRPSDUDEOHZLWKWKDWIURP 03*DQGSURYLGHVVHQVLWLYLW\DQGVSHFLÀFLW\LQGLIIHUHQWLDWLQJ06$VXEMHFWV IURPKHDOWK\YROXQWHHUV06$SDWLHQWVFDQEHVHSDUDWHGIURPSDUNLQVRQLDQVDQG QRUPVZLWKVHQVLWLYLW\DQGVSHFLÀFLW\ &RQFOXVLRQ2XU/87 EDVHGRQWKHQRUPDWLYHGDWDFDQDFFHQWXDWHDEQRUPDO)$ YDOXHVDVZHOODVDQDWRP\7KHUDGLRORJLVWFDQGLIIHUHQWLDWHEHWZHHQ06$DQGQRUPV MXVWXVLQJ/87LQIRUPDWLRQ7KHQHZ/87FDQEHSRWHQWLDOO\XVHIXODVDVFUHHQLQJ PHWKRGIRURWKHUQHXURORJLFDOGLVRUGHUV6XSSRUWHGE\JUDQWV,*$17 16060DQG060 6FLHQWLILF6HVVLRQ $ 6&'()*+%(XURSHDQ&RQJUHVVRI 5DGLRORJ\ )ULGD\ UREXVW IXQFWLRQDO DFWLYDWLRQV LQ WKH ELODWHUDO 07/ DW ERWK ÀHOG VWUHQJWKV DQG D VLJQLÀFDQWO\KLJKHUKLSSRFDPSDO%2/'VHQVLWLYLW\DW7 &RQFOXVLRQ7KHDVVRFLDWLYHPHPRU\HQFRGLQJWDVNUHVXOWHGLQUREXVWIXQFWLRQDO DFWLYLW\LQWKH07/DWERWKÀHOGVWUHQJWKVDQGKLJKHU%2/'VHQVLWLYLW\LQKLSSRFDPSDO VWUXFWXUHVDW7 7KHVHSUHOLPLQDU\UHVXOWVZLOOEHXVHGIRUIXUWKHUKLJKUHVROXWLRQ UHJLRQRILQWHUHVWDQDO\VLVFRQFHQWUDWLQJRQWKHKLSSRFDPSDOVXEVWUXFWXUHVLWVUROH LQPHPRU\HQFRGLQJDQGLQ07/GLVRUGHUV % $FXWHHIIHFWVRIPRGDÀQLORQFRJQLWLRQDQGEUDLQUHVWLQJVWDWH QHWZRUNDFWLYLW\LQ\RXQJKHDOWK\VXEMHFWV 5(VSRVLWR) &LOOL93LHUDPLFR$)HUUHWWL$0DFFKLD$6DJJLQR$7 DUWDUR *5RPDQL6/6HQVL&KLHWL,7UHVSRVLWR #VLUPRUJ 3XUSRVH 7KHUH LV JURZLQJ GHEDWH RQ WKH XVH RI GUXJV WKDW SURPRWH FRJQLWLYH HQKDQFHPHQW0RVWRIWKHFRJQLWLYHHQKDQFLQJGUXJVLQFOXGLQJDPSKHWDPLQHOLNH GUXJVKDYHLPSRUWDQWVLGHHIIHFWVDQGVKRZWKHULVNRIDGGLFWLRQ:HLQYHVWLJDWHG WKHXVHRIPRGDÀQLODGUXJDSSURYHGIRUWKHWUHDWPHQWRIQDUFROHSV\WKDWPD\DOVR DFWDVDFRJQLWLYHHQKDQFHUDQGDSSHDUVWRKDYHIHZHUVLGHHIIHFWVFRPSDUHGWR RWKHUSV\FKRVWLPXODQWV7KHDLPRIWKLVVWXG\ZDVWRHYDOXDWHZKHWKHUPRGDÀQLO FDQLQÁXHQFHWKHFRJQLWLYHSHUIRUPDQFHDVZHOODVWKHEUDLQUHVWLQJVWDWHQHWZRUN DFWLYLW\RIKHDOWK\\RXQJVXEMHFWV 0HWKRGVDQG0DWHULDOVVXEMHFWVZHUHLQFOXGHGLQDGRXEOHEOLQGSODFHER FRQWUROOHGVWXG\LQZKLFKDVLQJOHGRVHPJRI0RGDÀQLOZDVDGPLQLVWHUHG %RWKJURXSVZHUHWHVWHGEHIRUHDQGWKUHHKRXUVDIWHUWKHDGPLQLVWUDWLRQRIPRGDÀQLO RUSODFHERIRUWKHLUQHXURSV\FKRORJLFDOSHUIRUPDQFHVE\HPSOR\LQJWKH5DYHQҋV SURJUHVVLYHPDWULFHVDQGWKH7ULDOPDNLQJWHVW:LWKI05,DOVRDIWHUWKUHHKRXUVZH VWXGLHGWKHDFWLYLW\RIUHVWLQJVWDWHEUDLQQHWZRUNV)LQDOO\GLIIXVLRQWHQVRULPDJLQJ '7,ZDVDOVRSHUIRUPHGYLDWUDFWEDVHGVSDWLDOVWDWLVWLFV7%66 5HVXOWV2XUUHVXOWVLQGLFDWHWKDWDVLQJOHDFXWHGRVHRIPRGDÀQLOLPSURYHVÁXLG LQWHOOLJHQFHZKLOH%2/'I05,GDWDVKRZWKDWWKHGUXJLQFUHDVHVWKHDFWLYDWLRQRI WKHIURQWDOSDULHWDOFRQWURO)3&V\VWHPDQGRIH[WUDVWULDWHYLVXDOQHWZRUNV1R FKDQJHVZHUHREVHUYHGDVIDUDVDQDWRPLFDOFRQQHFWLYLW\ &RQFOXVLRQ 7 DNHQ WRJHWKHU RXU ÀQGLQJV VXSSRUW WKH LGHD WKDW PRGDÀQLO FDQ LQFUHDVHFRJQLWLYHSHUIRUPDQFHPRGXODWHWKHDFWLYLW\RIUHVWLQJVWDWHQHWZRUNV DQGEHDQHIIHFWLYHFRJQLWLYHHQKDQFHU 5RRP' &KHVW 66 $LUZD\GLVHDVHV 0RGHUDWRUV ,+DUWPDQQ5RWWHUGDP1/ 1-6FUHDWRQ&DPEULGJH8. % &DQ&7KHOSUHFRJQLVHDOLQNEHWZHHQOHIWDWULDOYROXPHLPSDFWLQJ OHIWYHQWULFXODUSUHORDGDQGWKHVHYHULW\RIHPSK\VHPD" /&DVVDJQHV($OJHUL-%)DLYUH7 6DQWDQJHOR-5HP\05pP\-DUGLQ /LOOH)5OXFLHFDVVDJQHV#DOLFHDGVOIU 3XUSRVH7 RHYDOXDWHOHIWDWULDO/$YROXPHLQVPRNHUVDFFRUGLQJWRWKHVHYHULW\ RIHPSK\VHPDDQGWRWDOOXQJYROXPH7/9 0HWKRGVDQG0DWHULDOVFRQVHFXWLYHVPRNHUVIUHHRIFOLQLFDOFDUGLRYDVFXODU GLVHDVH XQGHUZHQW D KLJKSLWFK DQG KLJKWHPSRUDO UHVROXWLRQ &7 DQJLRJUDSKLF H[DPLQDWLRQRIWKHFKHVWZLWKGXDOVRXUFHVLQJOHHQHUJ\&7HQDEOLQJTXDQWLÀFD WLRQRIHPSK\VHPDOXQJYROXPHVDQG/$YROXPHPHDVXUHPHQWVQRUPDOLVHGWR ERG\VXUIDFHDUHD 5HVXOWV7KH&7SKHQRW\SHVRIWKHVWXGLHGSRSXODWLRQZHUHDVIROORZVHPSK\VH PDSUHGRPLQDQW*URXSQ DLUZD\SUHGRPLQDQW*URXSQ DPL[HG SDWWHUQRIHPSK\VHPDDQGDLUZD\VGLVHDVHJURXSQ DQGDEVHQFHRI&7 DEQRUPDOLWLHVJURXSQ $QHJDWLYHFRUUHODWLRQZDVIRXQGEHWZHHQWKHLQ GH[HG/$YROXPHDQGWKHSHUFHQWDJHRIHPSK\VHPDDLQWKHRYHUDOOVWXG\JURXS S U ELQJURXSS U DQGFLQJURXSVDQG ZKHQDQDO\VHGWRJHWKHUS U ,QJURXSZHIRXQGDQHJDWLYH FRUUHODWLRQEHWZHHQWKHLQGH[HG/$YROXPHDQGWKHSHUFHQWDJHRIHPSK\VHPD LQWKHULJKWXSSHUDQGULJKWPLGGOHOREHVS U $QHJDWLYHFRUUHOD WLRQZDVDOVRIRXQGEHWZHHQWKHLQGH[HG/$YROXPHDQG7/9LQWKHRYHUDOOVWXG\ JURXSS U DQGLQJURXSS U ZKLOHQRFRUUHODWLRQV VWLPXOLZHUHFKRVHQFLWUXVIUXLWFKRFRODWHFRIIHHÁRZHUSOXVQHXWUDORQHDLU 7KHH[SHULPHQWFRQVLVWHGRIVHVVLRQVDQGHDFKVHVVLRQFRQVLVWHGRIWULDOV VWLPXODWLRQVIRUHDFKDURPDDQGIRUSXUHDLU7LPLQJDPRXQWDQGRUGHURI SUHVHQWDWLRQ ZHUH FRQWUROOHG E\ DQ 05, FRPSDWLEOH ROIDFWRPHU 7KH GDWD ZHUH DQDO\VHG XVLQJ 630 SDFNDJH 7KH DQDO\VLV ZHUH FRQGXFWHG IRU HDFK DURPD FRPSDUHGWRWKHQHXWUDOGXULQJWKHWLPLQJLQZKLFKWKHVXEMHFWVUHFHLYHGWKHDURPD DQGWKHIHZVHFRQGVLPPHGLDWHO\DIWHU 5HVXOWV(DFKDURPDVHHPVWRVWLPXODWHGLIIHUHQWFHUHEUDOUHJLRQV,QSDUWLFXODU FLWUXVLVFKDUDFWHULVHGE\WKHSHUFHSWXDODVSHFWHVSHFLDOO\YLVXDO%$ELODWHU DOO\FKRFRODWHLQYROYHVPDLQO\WKHFLQJXODWHDQGIURQWDOFRUWH[FRIIHHVHHPVWR EHWKHPRVWUHFRJQLVDEOHRGRURUELWDOJ\UXVPHGLDOFLQJXODWHGFRUWH[OHIWLQIHULRU IURQWDOJ\UXVÁRZHUVHHPVWREHWKHPRVWGLIÀFXOWVWLPXOXVWRUHFRJQLVHDQGGH VFULEHLQYROYLQJDUHDVLPSOLFDWHGLQWKHUHFROOHFWLRQRIDXWRELRJUDSKLFDOPHPRU\ &RQFOXVLRQ7KLVVWXG\VKRZVWKDWRGRXUVFDQDIIHFWDYDULHW\RISHUFHSWXDOPRWRU DQGFRJQLWLYHIXQFWLRQV7KHHYDOXDWLRQRIROIDFWRU\V\VWHPLQRUGHUWRGHPRQVWUDWH ROIDFWRU\G\VIXQFWLRQFRXOGEHXVHWRDVVHVVWKHSRVVLEOHULVNRIGHYHORSLQJQHX URGHJHQHUDWLYHGLVRUGHUVLQKHDOWK\LQGLYLGXDOV % )XQFWLRQDO05,IRUQHXURVXUJLFDOLQWHUYHQWLRQSODQQLQJ UHWURVSHFWLYHDQDO\VLVRIH[DPLQDWLRQVSHUIRUPHGZLWKRXU VWDQGDUGLVHGODQJXDJHWDVNSDQHO /5.R]DN$6]DER97 RWK&%RUEHO\3 %DUVL*5XGDV%XGDSHVW+8 ONR]DN#PUNNVRWHKX 3XUSRVH)XQFWLRQDO05,I05,JDLQHGLPSRUWDQFHLQWKHQHXURVXUJLFDODVVHVV PHQWRIEUDLQWXPRXUDQGHSLOHSV\SDWLHQWVGHVSLWHWKHRQJRLQJGHEDWHUHJDUGLQJLWV FOLQLFDOXVHIXOQHVV$UHWURVSHFWLYHDQDO\VLVRIRXUSUHVXUJLFDOODQJXDJHPDSSLQJ SURWRFROLVSUHVHQWHG 0HWKRGV DQG 0DWHULDOV %ORRGR[\JHQDWLRQ OHYHOGHSHQGHQW I05, ZLWK SLFWXUH QDPLQJV\QRQ\PGHFLVLRQVSHHFKFRPSUHKHQVLRQDQGDXGLWRU\ZRUGQRQZRUG GHFLVLRQWDVNVZDVDQDO\VHGIURPVHVVLRQVRIHSLOHSV\DQGEUDLQWXPRXU SDWLHQWVIHPDOHVOHVLRQVQHDUHORTXHQWDUHDVXVLQJ6306SDWLDOQRU PDOLVDWLRQZDVSHUIRUPHGZLWKWKHOHVLRQVPDVNHGIRUDQDO\VLQJDOOSDWLHQWVLQD FRPPRQIUDPHZRUN)LUVWDQGVHFRQGOHYHOUHVXOWVDQGSUREDELOLVWLFPDSVZHUH FDOFXODWHGIURPJHQHUDOOLQHDUPRGHOÀWV/DWHUDOLVDWLRQLQGLFHVZHUHFDOFXODWHGIRU %URFD:HUQLFNHDQGZKROHKHPLVSKHUHUHJLRQVRILQWHUHVW52,VLQWKUHVKROG LQGHSHQGHQWDQGWKUHVKROGHGPDQQHUV 5HVXOWV7KHSDUDGLJPVSUREHGGLIIHUHQWDVSHFWVRIODQJXDJHSURFHVVLQJWKHUH IRUHWKHLUSHUFHLYHGGLIÀFXOW\DQGPDSSLQJSHUIRUPDQFHYDULHGDFURVVVXEMHFWV *HQHUDOO\SLFWXUHQDPLQJUHVXOWHGLQZLGHVSUHDGELODWHUDODFWLYDWLRQVQRWUHVWULFWHG WRFRUHODQJXDJHDUHDVZKLOHV\QRQ\PWDVNZDVWKHPRVWODWHUDOLVHGLQWKH%URFD DQG:HUQLFNHUHJLRQV $XGLWRU\WDVNVVKRZHGWKHH[SHFWHGSUHIHUHQFHIRUWHPSRUDO VWUXFWXUHVDQGWKH:HUQLFNHDUHD/DWHUDOLVDWLRQGLIIHUHQFHVZHUHVLJQLÀFDQWDWWKH JURXSOHYHOS $129$IRUIDFWRUVSDUDGLJPDQG52,EXWODWHUDOLVDWLRQLQ GLFHVZHUHKLJKO\U SFRUUHODWHGUHJDUGOHVVRI52,DQGSDUDGLJP &RQFOXVLRQ'XHWRLQGLYLGXDOGLIIHUHQFHVWKHUHLVQRVLQJOH´EHVWµSDUDGLJPIRU ODQJXDJHPDSSLQJWKXVSHUIRUPLQJPRUHWDVNVHQKDQFHVDFFXUDF\1HYHUWKHOHVV SHUIRUPLQJWKHV\QRQ\PDQGWKHZRUGQRQZRUGWDVNVHHPVVXIÀFLHQWIRUGHWHUPLQ LQJODQJXDJHODWHUDOLVDWLRQLQPRVWFDVHVLIWLPHDYDLODELOLW\LVOLPLWHG % 9LVXDOLVLQJKLSSRFDPSDO%2/'DFWLYLW\LQKXPDQVDWDQG7HVOD 17KH\VRKQ64LQ60DGHUZDOG%$3RVHU-07KH\VRKQ0(/DGG (5*L]HZVNL*)HUQDQGH],7 HQGRONDU(VVHQ'(1LMPHJHQ1/ *LHVVHQ'(QLQDWKH\VRKQ#XNHVVHQGH 3XUSRVH+LJKÀHOGVWUHQJWKIXQFWLRQDO05,KDVGHYHORSHGUDSLGO\GXHWRLWVDG YDQWDJHVVXFKDVLQFUHDVLQJ615DQG%2/'FRQWUDVW1HYHUWKHOHVVLWVXIIHUVIURP DUWHIDFWVLQEUDLQUHJLRQVFORVHWRWLVVXHDLUERXQGDULHVVXFKDVWKHPHGLRWHPSRUDO OREH07/7KHVHGHÀFLWVKDYHFKDOOHQJHGIXQFWLRQDOLPDJLQJRIWKHKLSSRFDPSXV WKRXJKRSWLPLVHGKLJKUHVROXWLRQLPDJLQJLVSDUWLFXODUO\XVHIXOIRUWKLVUHJLRQERWK IURPDFOLQLFDODQGFRJQLWLYHQHXURVFLHQFHSHUVSHFWLYH7KHUHIRUHZHVHWRXWWR YLVXDOLVH07/DFWLYLW\GXULQJDQDVVRFLDWLYHPHPRU\HQFRGLQJWDVNDWDQGWHVOD 0HWKRGVDQG0DWHULDOVKHDOWK\YROXQWHHUVZHUHH[DPLQHGHLWKHUZLWK7RU ZLWK 7 ZKLOH SHUIRUPLQJ D EORFNHGGHVLJQ IDFHSURIHVVLRQDO QDPH DVVRFLDWLYH PHPRU\HQFRGLQJWDVNDQGDYLVXDOPRWRUMXGJPHQWDVFRQWUROFRQGLWLRQ:KROH EUDLQ(3,LPDJHVZHUHDFTXLUHG7DQG7GDWDZHUHFRPSDUHGDQGDQDO\VHG ZLWK630 5HVXOWV(3,LPDJHVDW7ZHUHRIKLJKTXDOLW\VKRZLQJDJRRGZKLWHJUH\PDWWHU FRQWUDVW6LJQDOGURSRXWVDQGDUWHIDFWVDWWKHORZHU07/ZHUHDFFHSWDEOHDW7 $VVHVVLQJWKHPHPRU\UHODWHGQHXUDODFWLYLW\LQERWKJURXSVWKHUHVXOWVUHYHDOHG 6FLHQWLILF6HVVLRQ 6 &$' ( ) *+% (XURSHDQ&RQJUHVVRI 5DGLRORJ\ 0HWKRGVDQG0DWHULDOV:HUHWURVSHFWLYHO\DVVHVVHGSDLUHGH[SLUDWRU\LQVSLUDWRU\ +5&7VFDQVRISDWLHQWVPHQDQGZRPHQPHDQDJH6' \HDUVKDYLQJ$)2IURPSXOPRQDU\IXQFWLRQWHVWLQJDWWKHVL[FKRVHQOHYHOVLH ÀYHYHVVHOVDRUWLFDUFKWUDFKHDOFDULQDFPEHORZWKHULJKWEURQFKXVLQWHUPHGLXV RULJLQULJKWLQIHULRUSXOPRQDU\YHLQDQGFPEHORZWKHULJKWKHPLGLDSKUDJPGRPH 7KHVHYHULW\JUDGLQJRIH[SLUDWRU\DLUWUDSSLQJ$7 EURQFKLDOZDOOWKLFNHQLQJ DQG EURQFKLDO GLODWDWLRQ PXOWLSOLHG E\ LWV H[WHQW , ,, ,,,DQG,9RILQYROYHPHQWZHUHFRQVLGHUHGDV$7 EURQFKLDOZDOO WKLFNHQLQJDQGEURQFKLDOGLODWDWLRQVFRUHVUHVSHFWLYHO\7KHVXPVRIDOOVFRUHV ZHUHFRQVLGHUHGDV $7%UVFRUHV5HFHLYHURSHUDWLQJFKDUDFWHULVWLF52&DQDO\VLV ZDVDSSOLHGWRDVVHVVWKHSHUIRUPDQFHRI$7DQG$7%UVFRUHVLQGLVFULPLQDWLQJ SDWLHQWVZLWKPLOG $)2)(9SUHGLFWHGIURPWKRVHZLWKPRGHUDWHWRVHYHUH $)2)(9SUHGLFWHG 5HVXOWV7KHDUHDVXQGHU52&FXUYHVRI $7DQG $7%UVFRUHVZHUH&, DQG&,UHVSHFWLYHO\7KHFXWRIIYDOXHVRI $7DQG $7%UVFRUHVRIDQGKDGDSRZHUWRGLVFULPLQDWHSDWLHQWVZLWKPLOG$)2 IURPWKRVHZLWKPRGHUDWHWRVHYHUH$)2ZLWKDVHQVLWLYLW\RIDQG DQGVSHFLÀFLW\RIDQGUHVSHFWLYHO\ &RQFOXVLRQ7KH$7DQG$7%UVFRUHVGHWHUPLQHGE\RXUPHWKRGVKDGWKHDELOLW\ WRSUHGLFWWKHVHYHULW\RI$)2LQPRVWFDVHV % 5HSURGXFLELOLW\RIDXWRPDWLFDLUZD\PHDVXUHPHQWVZLWK PXOWLGHWHFWRUFRPSXWHGWRPRJUDSK\0'&7LQLQVSLUDWRU\DQG H[SLUDWRU\VFDQV 0$PDWR$/DULFL$GHO&LHOOR('HYLFLHQWL*&RUER69DOHQWH/%RQRPR 5RPH,7PLFKHOHDPDWR #JPDLOFRP 3XUSRVH6RIWZDUHIRUSRVWSURFHVVLQJ0'&7LPDJHVDOORZWRREWDLQDXWRPDWLF PHDVXUHPHQWRIDLUZD\SDUDPHWHUVXQWLOWKHÀIWKEURQFKLDOJHQHUDWLRQ$LPRIWKH VWXG\ZDVWRDVVHVVWKHLQWHUDQGLQWUDREVHUYHUUHSURGXFLELOLW\RIDLUZD\PHDVXUH PHQWVXVLQJDQDXWRPDWHGFRPPHUFLDOVRIWZDUH 0HWKRGVDQG0DWHULDOV)RUW\SDWLHQWVZLWKIXQFWLRQDOGLDJQRVLVRIFKURQLFREVWUXF WLYHGLVHDVHPDOHVIHPDOHVDJHUDQJH\HDUVZHUHSURVSHFWLYHO\ LQFOXGHG$OO WKH SDWLHQWV XQGHUZHQW WZR FRQVHFXWLYH URZV &7 VFDQV RI WKH FKHVWVOLFHWKLFNQHVVLQWHUYDOPPSLWFKDWIXOOLQVSLUDWLRQDQGDWWKH HQGRIIRUFHGH[SLUDWLRQUHVSHFWLYHO\'DWDVHWVZHUHLQGHSHQGHQWO\DQDO\VHGE\ WZRFKHVWUDGLRORJLVWVLQWZRGLVWLQFWVHVVLRQVGD\VDSDUWXVLQJDQDXWRPDWHG FRPPHUFLDOVRIWZDUHIRUWKHDLUZD\VDQDO\VLV/XQJ9&$5*(+HDOWKFDUH2S HUDWRUVUHSRUWHGIRUERWKDFTXLVLWLRQVWKHYDOXHVRIOXPHQDUHD/$DXWRPDWLFDOO\ FDOFXODWHGRQD[LDOLPDJHVUHIRUPDWWHGDORQJWKHSHUSHQGLFXODUD[LVRIWKHDLUZD\ IURPWKHOREDUVHFRQGJHQHUDWLRQWRWKHVXEVHJPHQWDOEURQFKLÀIWKJHQHUDWLRQ 7KH LQWHU DQG LQWUDRSHUDWRU GLIIHUHQFHV ZHUH H[SUHVVHG DV SHUFHQWDJHV RYHU PHDQV%ODQG$OWPDQ0HDQYDOXHVRIGLIIHUHQFHVуDQGVWDQGDUGGHYLDWLRQV 6'ZHUHDVVHVVHG 5HVXOWV$XWRPDWLF PHDVXUHPHQWV RI /$ KDV VKRZQ KLJK UHSURGXFLELOLW\ PHDQ6' RQ ERWK LQVSLUDWRU\ DQG H[SLUDWRU\ VFDQV )RU /$ ZHREVHUYHG уLQWHULQVS6'уLQWHULQVS уLQWUDLQVS6'уLQWUDLQVS уLQWHUH[S6'уLQWHUH[S уLQWUD H[S6'уLQWUDH[S &RQFOXVLRQ $XWRPDWLFPHDVXUHPHQWRIOXPHQDUHDRQ0'&7GHPRQVWUDWHGKLJK LQWHUDQGLQWUDRSHUDWRUUHSURGXFLELOLW\LQERWKLQVSLUDWRU\DQGH[SLUDWRU\VFDQV 7KXVLWKDVWKHSRWHQWLDORIEHLQJXVHGDVDFRPSOHPHQWDU\WRROLQWKHDVVHVVPHQW RIREVWUXFWLYHDLUZD\VGLVHDVH % $XWRPDWLFDLUZD\DQDO\VLVRQ0'&7LQF\VWLFÀEURVLVFRUUHODWLRQ ZLWKSXOPRQDU\IXQFWLRQWHVWLQJ 02:LHOSXHW] 03XGHUEDFK0(LFKLQJHU2:HLQKHLPHU6/H\ 0$0DOO$%LVFKRII+8.DXF]RU&3 +HXVVHO+HLGHOEHUJ'( 0DLQ]'(PDUNZLHOSXHW]#ZHEGH 3XUSRVH6RIWZDUHWRROVDOORZIRUTXDQWLWDWLYHDLUZD\DQDO\VLVRQPXOWLGHWHFWRU FRPSXWHG WRPRJUDSK\ 0'&7 RI WKH FKHVW$LP RI WKLV VWXG\ ZDVWR HYDOXDWH JHQHUDWLRQEDVHGDLUZD\SDUDPHWHUVLQSDWLHQWVVXIIHULQJIURPF\VWLFÀEURVLV&) OXQJGLVHDVHLQFRUUHODWLRQZLWKSUHGLFWHGIRUFHGH[SLUDWRU\FDSDFLW\LQV)(9 0HWKRGVDQG0DWHULDOV0'&7DFTXLUHGLQSDUDOOHOWR)(9PHGLDQJDSG UDQJHGIURPQ LQIDQW&)LQIDQWDQGQ DGXOW&)DGXOW&)SDWLHQWV ZHUHVXEMHFWHGWRIXOO\DXWRPDWLFDLUZD\DQDO\VLV1 LQIDQWVDQGQ DGXOWVZLWK QRUPDODLUZD\VDQG)(9VHUYHGDVFRQWUROV1250$/LQIDQW1250$/DGXOW 7 RWDOGLDPHWHU7'OXPHQDUHD/$DQGZDOOWKLFNQHVV:7RISUR[LPDOWRGLVWDO DLUZD\VZHUHVHSDUDWHO\FRUUHODWHGZLWK)(9 ZHUHIRXQGLQ*URXSS U DQGJURXSS U QRUZKHQ JDWKHULQJSDWLHQWVIURPJURXSVDQGS U &RQFOXVLRQ 7KH /$ YROXPH LPSDFWLQJ OHIW YHQWULFXODU SUHORDG LV VLJQLÀFDQWO\ UHGXFHGLQSDWLHQWVZLWKVHYHUHHPSK\VHPD % .U\SWRQYHQWLODWLRQLPDJLQJXVLQJGXDOHQHUJ\&7LQ&23'SDWLHQWV LQLWLDOH[SHULHQFH $/+DFKXOOD6.KXQJ/:HPHDX-) &D]DXERQ-5HP\ 05pP\-DUGLQ/LOOH)5DQQHOLVHKDFKXOOD#FKUXOLOOHIU 3XUSRVH7 RHYDOXDWHWKHOHYHORIOXQJHQKDQFHPHQWDFKLHYDEOHDIWHULQKDODWLRQRI VWDEOHNU\SWRQZKRVHDWRPLFQXPEHUDQGODFNRIDQDHVWKHWLFSURSHUWLHVPDNH LWHOLJLEOHIRUYHQWLODWLRQLPDJLQJXVLQJGXDOHQHUJ\&7 0HWKRGVDQG0DWHULDOVSDWLHQWVZLWKVHYHUHHPSK\VHPDWRXVOHVLRQVZHUH LQFOXGHGLQWKLVVWXG\DLPHGDWFRPSDULQJWKHOHYHORIDWWHQXDWLRQZLWKLQQRUPDO OXQJSUHVXPHGWREHQRUPDOO\YHQWLODWHGZLWKWKDWRIHPSK\VHPDSUHVXPHGWREH SRRUO\RUQRWYHQWLODWHGDIWHULQKDODWLRQRIDPL[WXUHRINU\SWRQDQGR[\JHQ 7KH\XQGHUZHQWDGXDOVRXUFHGXDOHQHUJ\FKHVW&7H[DPLQDWLRQZLWKUHFRQ VWUXFWLRQRIGLDJQRVWLFDQGYHQWLODWLRQLPDJHV7KHVWDWLVWLFDODQDO\VLVZDVGHÀQHG RQWKHIROORZLQJDVVXPSWLRQWKHOHYHORIDWWHQXDWLRQZLWKLQWKHHPSK\VHPDWRXV OXQJZDVH[SHFWHGWREHUHGXFHGLQFRPSDULVRQWRWKHOHYHORIDWWHQXDWLRQZLWKLQ WKHQRUPDOOXQJZKHQSUHVHQWWKLVUHVXOWZDVGHÀQHGDVD´VXFFHVVµ 5HVXOWV$OOVWXGLHVZHUHVXFFHVVIXOO\SHUIRUPHGZLWKRXWDGYHUVHHIIHFWV$QDO\ VLVRIYHQWLODWLRQLPDJHVVKRZHGGLIIHUHQFHVLQOXQJDWWHQXDWLRQEHWZHHQQRUPDO OXQJDQGHPSK\VHPDWRXVDUHDVLQSDWLHQWV&, >@ WKXV GHPRQVWUDWLQJ WKH IHDVLELOLW\ RI OXQJ YHQWLODWLRQ ZLWK NU\SWRQ 7KH PD[LPDO OHYHORIDWWHQXDWLRQZLWKLQQRUPDOOXQJZDV+8.U\SWRQDWWHQXDWLRQGLIIHU HQFHEHWZHHQQRUPDODQGHPSK\VHPDWRXVOXQJZDVVWDWLVWLFDOO\VLJQLÀFDQWZLWK DPHGLDQYDOXHRIS7KHPHDQ6''/3YDOXHRIWKLVSURWRFRO ZDVP*\FP &RQFOXVLRQ'XDOHQHUJ\&7RIWKHOXQJVDIWHULQKDODWLRQRIVWDEOHNU\SWRQZDV IRXQGWREHWHFKQLFDOO\IHDVLEOHDQGZHOOWROHUDWHGE\DOOSDWLHQWV % $JHQRPHZLGHDVVRFLDWLRQVWXG\RI&23'ZLWKOXQJYROXPHWU\DQG DLUZD\PHDVXUHPHQWXVLQJ0'&7 /.< /HH ..LP-/HH(.DQJ< 2K%-H-&KRR$QVDQ.5 *XUR.5$QDP.5P\QHWP\QHW#GDXPQHW 3XUSRVH 7KH UDWLR RI IRUFHG H[SLUDWRU\ YROXPH LQ RQH VHFRQG WR IRUFHGYLWDO FDSDFLW\ )(9)9& LV D PHDVXUH XVHG WR GLDJQRVH DLUÁRZ REVWUXFWLRQ DQG LV KLJKO\KHULWDEOH7KHDLPRIWKLVVWXG\LVWRLQYHVWLJDWHJHQHWLFDVVRFLDWLRQRI613V VLQJOHQXFOHRWLGHSRO\PRUSKLVPLQ&23'JHQHVIRUDVVRFLDWLRQZLWK'&7OXQJ YROXPHDQGDLUZD\PHDVXUHPHQW 0HWKRGV DQG 0DWHULDOV :H KDYH WKH *:$6 UHVXOWV IRU SDUWLFLSDQWV IRU OXQJ IXQFWLRQUHODWHG JHQHV )$0$ 613V VLQJOH QXFOHRWLGH SRO\PRUSKLVP RQFKURPRVRPHLQFOXGLQJUVZHUHDVVRFLDWHGZLWK)(9)9&YDOXH 2QWKH'0'&7LPDJHVWKHVRIWZDUHVHPLDXWRPDWLFDOO\FDOFXODWHVWRWDOOXQJ YROXPH7/9DQGHPSK\VHPDYROXPH(9HPSK\VHPDSHUFHQWDJH(3PHDQ OXQJGHQVLW\0/'LQFOXGLQJEURQFKLDOZDOODUHD:$:HZLOOFRPSDUHWKH&7 SDUDPHWHUVEHWZHHQPLQRU77&$DQGPDMRU&&7*DOOHOHV:HGLG&7VFDQV WDUJHWLQJDGXOWVDJHG\HDUVUHSUHVHQWDWLYHRI7DQG&DOOHOHVIRUWKH DFTXLVLWLRQRI7/9(90/'DQGEURQFKLDO:$ 5HVXOWV7KHVXEMHFWVZLWK7DOOHOHKDGVLJQLÀFDQWO\VPDOOHUHPSK\VHPDYROXPH DQGHPSK\VHPDYROXPHWKDQWKRVHZLWK&DOOHOH+RZHYHUWRWDOOXQJYROXPH PHDQOXQJGHQVLW\DQGEURQFKLDO:$VKRZHGQRVLJQLÀFDQWGLIIHUHQFHEHWZHHQ VXEMHFWVZLWK7DQG&DOOHOH &RQFOXVLRQ7KHVXEMHFWVZLWK7DOOHOHZHUHDVVRFLDWHGZLWKHPSK\VHPDYROXPH DQGHPSK\VHPDYROXPH7KLVPLJKWEHLPSRUWDQWLPSOLFDWLRQFRQFHUQLQJWKH SUHYHQWLRQRIFKURQLFOXQJIXQFWLRQLPSDLUPHQWFDXVHGE\LQWHUYHQWLRQVGLUHFWHGDW ULVNIDFWRUVVXFKDVRQJRLQJ&23'VPRNLQJLQIHFWLRQDQGVRFLRHFRQRPLFIDFWRUV % 7KHSHUIRUPDQFHRI&7VHYHULW\VFRUHVGHWHUPLQHGIURPSDLUHG H[SLUDWRU\LQVSLUDWRU\KLJKUHVROXWLRQ&7LQSUHGLFWLQJWKHVHYHULW\RI DLUÁRZREVWUXFWLRQ 7 6XZDWDQDSRQJFKHG3 3RUQVXUL\DVDN:6XNNDVHP65DWWDQDVLUL %DQJNRN7+UDWUVSRRP#\DKRRFRP 3XUSRVH7 RDVVHVVWKHSHUIRUPDQFHRI&7VHYHULW\VFRUHVIURPSDLUHGH[SLUDWRU\ LQVSLUDWRU\KLJKUHVROXWLRQ&7+5&7LQSUHGLFWLQJWKHVHYHULW\RIDLUÁRZREVWUXF WLRQ$)2 6FLHQWLILF6HVVLRQ $ 6&'()*+%(XURSHDQ&RQJUHVVRI 5DGLRORJ\ )ULGD\ % 6PDOODLUZD\DQGLQWHUVWLWLDOOXQJLQYROYHPHQWLQDV\PSWRPDWLF SDWLHQWVZLWKDQWLSKRVSKROLSLGV\QGURPH $2LNRQRPRX$7]RXYHOHNLV3 6NHQGURV,0LWURXOLV($SRVWROLGRX $7KRPDLGL.5LWLV'%RXURV3 3UDVVRSRXORV$OH[DQGURXSROLV*5 DRLNRQRP#PHGGXWKJU 3XUSRVH$QWLSKRVSKROLSLGV\QGURPH$36LVDV\VWHPLFDXWRLPPXQHGLVRUGHU FKDUDFWHULVHG E\ YDVFXODU WKURPERVLV$FWLYDWLRQ RI WKH FRDJXODWLRQ FDVFDGH LV WKRXJKWWREHDVVRFLDWHGZLWKLQGXFWLRQDQGPDLQWHQDQFHRILQÁDPPDWLRQZKLFK OHDGV WR WLVVXH LQMXU\ DQG ÀEURVLV 2XU DLP ZDV WR GHWHUPLQH WKH SUHYDOHQFH RI QRQWKURPERWLFOXQJPDQLIHVWDWLRQVLQDV\PSWRPDWLFSDWLHQWVZLWK$36 0HWKRGVDQG0DWHULDOV7 HQSDWLHQWVIUHHRIUHVSLUDWRU\V\PSWRPVZKRPHWWKH FULWHULDIRU $36SULPDU\ $36DQGVHFRQGDU\WRV\VWHPLFOXSXVHU\WKHPDWRVXV 6/(ZHUHSURVSHFWLYHO\LGHQWLÀHG $OOSDWLHQWVXQGHUZHQWKLJKUHVROXWLRQFRPSXWHG WRPRJUDSK\+5&7RIWKHFKHVWDQGIXQFWLRQDODVVHVVPHQW+5&7VFDQVZHUH HYDOXDWHGIRUWKHSUHVHQFHRIDLUWUDSSLQJÀEURVLVPLFURQRGXODUSDWWHUQF\VWV HPSK\VHPD DWHOHFWDVLV FRQVROLGDWLRQ DQG SOHXUDO HIIXVLRQ7KH WRWDO H[WHQW RI DLUWUDSSLQJZDVHVWLPDWHGEDVHGRQDVXEMHFWLYHVHPLDXWRPDWHG+5&7VFRULQJ V\VWHP)XQFWLRQDODVVHVVPHQWLQFOXGHG)9&7/&00()'/&2PLQXWH ZDONLQJGLVWDQFHDQGV\VWROLFSXOPRQDU\DUWHU\SUHVVXUH 5HVXOWV $OOSDWLHQWVH[KLELWHGERWKDUDGLRORJLFDODQGIXQFWLRQDOSDWWHUQFRPSDWLEOH ZLWKVPDOODLUZD\GLVHDVHLUUHVSHFWLYHRIVPRNLQJ0HDQVFRUHRIDLUWUDSSLQJZDV UDQJH+5&7ÀQGLQJVDQGUHGXFHGOHYHOVRI00()SUHG ZHUHQHJDWLYHO\FRUUHODWHGU S6XESOHXUDOEDVDOUHWLFXODUSDWWHUQ FRQVLVWHQWZLWKÀEURVLVZDVVHHQLQSDWLHQWV7KLQZDOOHGF\VWVZHUHVHHQLQ SDWLHQWVZKLOHXSSHUOREHKD]\PLFURQRGXODUSDWWHUQZDVGHWHFWHGLQSDWLHQWV &RQFOXVLRQ$V\PSWRPDWLFSDWLHQWVZLWK$36PD\SUHVHQWZLWKVPDOODLUZD\DQG LQWHUVWLWLDOOXQJLQYROYHPHQWLUUHVSHFWLYHRIVPRNLQJKLVWRU\DQG6/(FRH[LVWHQFH &KHVW+5&7DQGURXWLQHIXQFWLRQDOWHVWVPD\EHYDOXDEOHWRROVIRUSK\VLFLDQVZKHQ HYDOXDWLQJSDWLHQWVZLWK$36 % 0'&7HYDOXDWLRQRIWKHWUDFKHREURQFKLDOWUHHDQRPDOLHVLQFKLOGUHQ ZLWKFRQJHQLWDOKHDUWGLVHDVH $*6KLQ=$9DNKLGRYD1,6DIRQRYD7 6KLQNDUHYD90DNDUHQNR 0RVFRZ58 3XUSRVH7 RDVVHVVWKHYDOXHRIPXOWLGHWHFWRUFRPSXWHUWRPRJUDSK\0'&7LQ GLDJQRVWLFVRIDQRPDOLHVRIWKHWUDFKHREURQFKLDOWUHHLQFKLOGUHQZLWKFRQJHQLWDO KHDUWGLVHDVH&+' 0HWKRGVDQG0DWHULDOVFKLOGUHQZLWK&+'UHIHUUHGIRU0'&7HYDOXDWLRQZHUH H[DPLQHG PHDQ DJH PRQWKV UDQJH GD\V WR PRQWKV 3DWLHQWV ZHUH H[DPLQHGXVLQJ(&*JDWHG0'&7DQJLRJUDSK\:HHPSOR\HGGLPHQVLRQDO 'LPDJHUHFRQVWUXFWLRQLQSDWLHQWVZKRZHUHVXVSHFWHGRIKDYLQJFRPSOLFDWLQJ H[WHUQDOYDVFXODUFRPSUHVVLRQDVDFDXVHRIUHVSLUDWRU\V\PSWRPV7 RDOOSDWLHQWV [UD\VWXG\RIWKHFKHVWZDVSHUIRUPHG 5HVXOWV/XQJDQRPDOLHVFDXVHGE\SXOPRQDU\XQGHUGHYHORSPHQWZHUHUHFRJQLVHG LQFDVHVZKLFKKDGQRWEHHQGLDJQRVHGE\PHDQVRI[UD\H[DPLQDWLRQ7KH OREDU HPSK\VHPD ZDV LGHQWLÀHG LQ SDWLHQWV DQG LW ZDV WKH UHVXOW RI D FKHFN YDOYHPHFKDQLVPDWWKHEURQFKLDOOHYHOFDXVHGE\H[WHUQDOYDVFXODUFRPSUHVVLRQ &ULWLFDOWUDFKHDOVWHQRVLVLQRQHSDWLHQWZDVFDXVHGE\SXOPRQDU\DUWHU\VOLQJ,Q FDVHVEURQFKLDOVWHQRVLVZDVGXHWRFRPSUHVVLRQE\WKHULJKWDRUWLFDUFKDQG .RPPHUHOOCVGLYHUWLFXOXP7KHVWHQRVLVRIWKHOHIWPDLQEURQFKXVZDVREVHUYHG LQFDVHVGXHWRFRPSUHVVLRQEHWZHHQWKHGHVFHQGLQJDRUWDDQGWKHOHIWXSSHU SXOPRQDU\YHLQ$UWHULRYHQRXVPDOIRUPDWLRQVZHUHGLDJQRVHGLQSDWLHQWVRQH RIZKLFKOHGWRFRPSUHVVLRQRIVHJPHQWDOEURQFKXVRIORZHUOREHRIWKHULJKWOXQJ &RQFOXVLRQ 0'&7 HYDOXDWLRQ RI DQRPDOLHV RI WKH WUDFKHREURQFKLDO WUHH LQ FKLOGUHQZLWKFRQJHQLWDOKHDUWGLVHDVH&+'LGHQWLÀHVWKHFDXVHVRIUHVSLUDWRU\ GLVRUGHUV DQG DOORZV SUHGLFWLQJ SRVVLEOH UHVSLUDWRU\ FRPSOLFDWLRQV LQ WKH HDUO\ SRVWRSHUDWLYHSHULRG 5HVXOWV1RVLJQLÀFDQWFRUUHODWLRQVZLWK)(9H[LVWHGIRU7'DQG:7RISUR[LPDO DQGGLVWDODLUZD\VLQERWK1250$/5UDQJLQJIURPWREXWIRU/$RI WKHQGJHQHUDWLRQLQ1250$/DGXOW5 ,Q&)LQIDQWPRGHUDWHLQYHUVHFRU UHODWLRQVZHUHIRXQGIRU7'DQG/$RIQGJHQHUDWLRQDLUZD\V5 DQG UHVSHFWLYHO\ EXW QRW IRU :7 ,Q &)DGXOW7' DQG :7 RI WK JHQHUDWLRQ DLUZD\V LQYHUVHO\ FRUUHODWHG ZLWK )(9 5 DQG UHVSHFWLYHO\ E X W Q R W R I WKHQGJHQHUDWLRQ5 DQGUHVSHFWLYHO\/$FRUUHODWHGEHVWIRUWK JHQHUDWLRQDLUZD\V5 &RQFOXVLRQ7' /$ DQG :7 RI GLVWDO DLUZD\V VKRZHG VWURQJ FRUUHODWLRQV ZLWK )(9LQDGXOW&)SDWLHQWVLQGLFDWLQJDVKLIWRIPDMRUDLUZD\UHVLVWDQFHWRGLVWDO EURQFKLLQFKURQLF&) )XOO\DXWRPDWLFVRIWZDUHWRROVFRXOGLQWURGXFHXVHULQGH SHQGHQWTXDQWLWDWLYHSDUDPHWHUVLQWRWKHDVVHVVPHQWRIREVWUXFWLYHOXQJGLVHDVH % &RQWUDVWHQKDQFHG05,&(05,LVPRUHVHQVLWLYHWRGHWHFWVPDOO DLUZD\VGLVHDVHWKDQSURWRQ05,05,DFRPSDUDWLYHVWXG\LQ F\VWLFÀEURVLV&)OXQJGLVHDVH 3 &LHW 3 :LHORSROVNL(YDQGHU:LHO*3 .UHVWLQ0+/HTXLQ *0RUDQD+$0:7LGGHQV5RWWHUGDP1/7UHYLVR,7 SFLHW#HUDVPXVPFQO 3XUSRVH &KHVW&7 LV WKH PRVW VHQVLWLYH WHFKQLTXH WR PRQLWRU SURJUHVVLRQ RI &)UHODWHGEURQFKLHFWDVLVDQGWUDSSHGDLU7$UHÁHFWLQJVPDOODLUZD\VGLVHDVH &KHVW05,LVDUDGLDWLRQIUHHDOWHUQDWLYHIRU&7 EXWLWVVHQVLWLYLW\IRU7$LVSRRU +\SRSHUIXVLRQ+3RIWHQFRLQFLGHVZLWK7$DQGWKXV&(05,PLJKWEHPRUHVHQVL WLYHWRLGHQWLI\7$ $LPVWRFRPSDUHYROXPHRI+3RQ&(05,ZLWKYROXPHRI $7 RQ05,WRFRPSDUHYROXPHRI+3DQG7$WRVSLURPHWU\SDUDPHWHUVVHQVLWLYH WRVPDOODLUZD\GLVHDVH 0HWKRGVDQG0DWHULDOVVWDEOH&)SDWLHQWV0PHDQDJH\UVUDQJH \UV6SLURPHWU\DQG&(05,ZHUHGRQHRQWKHVDPHGD\76FDQQHU 6LJQD *( 3URWRFRO 66)3' 3'Z D[LDO FRURQDO DQG VDJLWWDO 757(6/ PP*5('D[LDODQGFRURQDO757(6/ PPPPRONJ,P DJHVZHUHDQRQ\PLVHGDQGVFRUHGLQUDQGRPRUGHUZLWK&)05,VFRUHH[SUHVVHG DVRIPD['HVFULSWLYHVWDWLVWLFV7WHVWDQG6SHDUPDQFRUUHODWLRQUZHUHXVHG 5HVXOWV0HDQ6'+3DQG7$VFRUHVZHUHUHVSHFWLYHO\DQG &RUUHODWLRQV7$YV+3U S +3YV)()U S +3 YV )() U S +3 YV )(9)9& U S 7$ YV )() U S 7$YV)()QVRU)(9)9&QV &RQFOXVLRQ+3EXWQRW7$VKRZHGKLJKO\VLJQLÀFDQWQHJDWLYHFRUUHODWLRQVZLWK VSLURPHWU\SDUDPHWHUVVHQVLWLYHIRUVPDOODLUZD\GLVHDVH+3DUHDVGLGQRWDOZD\V PDWFK7$DUHDV&(05,VHHPVWRLPSURYHWKHGLDJQRVWLFYDOXHRI05,WRGHWHFW VPDOODLUZD\VGLVHDVH % $VFRULQJV\VWHPIRUWRPRV\QWKHVLVLQSXOPRQDU\F\VWLFÀEURVLV .9XOWYRQ6WH\HUQ,%MRUNPDQ%XUWVFKHU3 +RJOXQG*%R]RYLF0:LNOXQG 0*HLMHU/XQG6(NULVWLQDYXOWBYRQBVWH\HUQ#PHGOXVH 3XUSRVH1RVFRULQJV\VWHPIRUWRPRV\QWKHVLVGLJLWDOWRPRJUDSK\LQSXOPRQDU\ F\VWLFÀEURVLV&)KDVEHHQSXEOLVKHG7KHSXUSRVHZDVWRLQWURGXFHDQGYDOLGDWH VXFKDV\VWHP 0HWKRGVDQG0DWHULDOVSDLUHGFKHVWUDGLRJUDSK\DQGWRPRV\QWKHVLVH[DPLQD WLRQVRQSDWLHQWVZLWK&)FKLOGUHQDQGDGXOWVDQGSDHGLDWULFRQFRORJ\ SDWLHQWVZHUHVFRUHGLQGHSHQGHQWO\E\WKUHHUDGLRORJLVWV7 RPRV\QWKHVLVVWXGLHV ZHUHVFRUHGIRURYHULQÁDWLRQEURQFKLDOZDOOWKLFNHQLQJDWHOHFWDVLVRUFRQVROLGDWLRQ QXPEHUDQGVHYHULW\RIEURQFKLHFWDVHVDQGODUJHDQGVPDOOPXFXVSOXJVZLWKD PD[LPXPVFRUHRI7KH%UDVÀHOGVFRULQJV\VWHPZDVXVHGIRUUDGLRJUDSKV 5HVXOWV&RUUHODWLRQEHWZHHQWKHVFRUHIRUWRPRV\QWKHVLVDQG%UDVÀHOGVFRUHIRU UDGLRJUDSK\ZDVJRRG.HQGDOOҋVUDQNFRUUHODWLRQWDXDQGIRUWKH WKUHHUDWHUV7 RPRV\QWKHVLVZDVJHQHUDOO\VFRUHGKLJKHULQSHUFHQWDJHRIPD[LPXP VFRUH2EVHUYHUDJUHHPHQWVIRUWRWDOVFRUHVZHUHKLJKLQERWKV\VWHPVZHLJKWHG NDSSD!IRUWKHWKUHHSDLUVRIUDGLRORJLVWUDWHUVIRUWKHWRPRV\QWKHVLVVFRUH DQGDQGIRUWKH%UDVÀHOGVFRUHSDWLHQWVZHUHVFRUHG QRUPDO IRU QRGXODUF\VWLF OHVLRQV RQ UDGLRJUDSKV E\ DOO UDWHUV EXW ZHUH VFRUHG SRVLWLYHIRUEURQFKLHFWDVHVRUPXFXVSOXJJLQJZLWKWRPRV\QWKHVLV &RQFOXVLRQ7KHSURSRVHGWRPRV\QWKHVLVVFRUHFRUUHODWHVZHOOZLWKWKH%UDVÀHOG VFRULQJV\VWHPZLWKJRRGREVHUYHUDJUHHPHQWVIRUWKHWRWDOVFRUH7 RPRV\QWKHVLV LVPRUHVHQVLWLYHWR&)FKDQJHVLQSDUWLFXODUEURQFKLHFWDVHVDQGPXFXVSOXJ JLQJDQGVKRZVWKHPLQPRUHGHWDLOWKDQUDGLRJUDSK\7KHUHIRUHWKHQHZVFRULQJ V\VWHPKDYLQJDKLJKHUPD[LPXPVFRUHRIIHUVWKHSRVVLELOLW\IRUDPRUHDFFXUDWH VFRULQJRIGLVHDVHVHYHULW\ 6FLHQWLILF6HVVLRQ 6 &$' ( ) *+% (XURSHDQ&RQJUHVVRI 5DGLRORJ\ % '(%YV37$IRUPXOWLOHYHOORZHUOLPEUHYDVFXODULVDWLRQPRQWK UHVXOWVIURPDUDQGRPLVHGWULDO $&DQQDYDOH) )DQHOOL$%UXQL0$OOHJULWWL(%RDWWD53DVVDULHOOR 5RPH,7DOHVVDQGURFDQQDYDOH#KRWPDLOFRP 3XUSRVH 'UXJHOXWLQJ EDOORRQV KDYH VKRZQ SURPLVLQJ UHVXOWV LQ UHFHQW WULDOV LPSURYLQJ WKH SDWHQF\ UDWH LQ VWHQRREVWUXFWLYH GLVHDVH RI WKHIHPRURSRSOLWHDO UHJLRQ:HZRXOGOLNHWRHYDOXDWHPLGWHUPSDWHQF\RISHULSKHUDODQJLRSODVW\ZLWK SDFOLWD[HOFRDWHGEDOORRQV'(%LQFRPSDULVRQZLWKFRQYHQWLRQDOEDOORRQV37$ 0HWKRGVDQG0DWHULDOV)LIW\FRQVHFXWLYHSDWLHQWVPHDQDJH\HDUVZLWK VWHQRVLV RU RFFOXVLRQ RI D IHPRURSRSOLWHDO DUWHU\ ZHUH HQUROOHG DQG UDQGRPO\ DVVLJQHGWRWUHDWPHQWZLWK'(%SWV,13$&7$PSKLULRQ,QYDWHF,WDO\ DQGWRWUHDWPHQWZLWKXQFRDWHGEDOORRQVSWVFRQWUROJURXS3DWLHQWV FKDUDFWHULVWLFVZHUHVLPLODULQERWKJURXSVVPRNHUVGLDEHWHVDQG K\SHUFKROHVWHUROHPLD7KLUW\HLJKWZHUH7$6&%ZKLOHZHUH&DQG' 7KHSULPDU\HQGSRLQWZDVODWHOXPHQORVVDWPRQWKV 5HVXOWV7ZHQW\WZRSHUFHQWRIWKHOHVLRQVZHUHWRWDORFFOXVLRQVDQGZHUH VWHQRWLFOHVLRQV7KHPHDQOHVLRQOHQJWKZDVFP7KHUHZHUHQRDGYHUVH HYHQWVFRUUHODWHGZLWKWKHSDFOLWD[HOFRDWHGEDOORRQV $WPRQWKV86&'IROORZXS VKRZHGQHRLQWLPDOWKLFNQHVVRIPPLQWKHFRQWUROJURXSDVFRPSDUHGZLWK PP3 LQWKHJURXSWUHDWHGZLWK'(%7KHUDWHRIUHYDVFXODULVDWLRQ RIWDUJHWOHVLRQVDWPRQWKVZDVRILQWKHFRQWUROJURXSRI LQWKH'(%JURXS3 YVFRQWUROJURXS7KURPERVLVUDWHZDV37$YV '(%S$PSXWDWLRQUDWHZDV37$YV'(%S &RQFOXVLRQ8VHRI'(%LQIHPRURSRSOLWHDOGLVHDVHLVDVVRFLDWHGZLWKVLJQLÀFDQW UHGXFWLRQVLQODWHOXPHQORVVDQGWDUJHWOHVLRQUHYDVFXODULVDWLRQ % &RQFRPLWDQWXVHRIHQGRYHQRXVODVHUDQGIRDPHGVFOHURVDQWLQ WUHDWPHQWRIORZHUOLPEYDULFRVLWLHV\HDUIROORZXSUHVXOWV 0%KDOOD 1%KDOOD+9DVDYDGD$KPHGDEDG,1-DPQDJDU,1 3XUSRVH 7 R UHSRUW PLGWHUP UHVXOWV XSWR \HDUV RI FRQFRPLWDQW XVH RI WZR PRGHVRIWUHDWLQJYDULFRVHYHLQVHQGRYHQRXVODVHUWUHDWPHQWIRUJUHDWVDSKHQRXV YHLQ*69UHÁX[DQGVFOHURWKHUDS\IRULQFRPSHWHQWSHUIRUDWRUVDQGDFFHVVRU\ YHQRXVFKDQQHOV 0HWKRGVDQG0DWHULDOVORZHUOLPEVOHIWULJKWELODWHUDORI SDWLHQWVZRPHQPHQPHDQDJH\UVZHUHWUHDWHGZLWKFRQFRPLWDQW XVHRIHQGRYHQRXVODVHUDQGVFOHURWKHUDS\SDWLHQWVOHJVKDGXOFHUV *69 ZDV PDSSHG XVLQJ 0+= OLQHDU 8OWUDVRXQG 86 SUREH )ROORZLQJ ORFDO DQDHVWKHVLDLQFK-*XLGHZLUHZDVLQWURGXFHGLQ*69IURPORZHVWSRLQWRI UHÁX[$)VKHDWKDQGPODVHUÀEUHZDVXVHG/DVHUHQHUJ\ZDVGHOLYHUHG LQWUDOXPLQDOO\DW:FRQWLQXRXVPRGH)LEUHZDVXQLIRUPO\ZLWKGUDZQ6FOHURVDQW PL[HGZLWKDLUWRSURGXFHIRDPZDVLQWURGXFHGWKURXJKQHHGOHLQSHUIRUDWRUVDQG DGGLWLRQDOYHQRXVFKDQQHOVXQGHU86JXLGDQFH $OOSDWLHQWVZHUHDGYLVHGLEXSURIHQ DQGFODVV,,VWRFNLQJV)ROORZXSZDVGRQHDWZHHNDQGPRQWKV 5HVXOWVODVHUWUHDWHG*69UHPDLQHGDEODWHGDW\HDUIROORZXSOLPEV LQÀUVW\HDUDQGDGGLWLRQDOOLPEVLQQH[W\HDUVLHOLPEVLQ\HDUV UHTXLUHG RQH PRUH VFOHURWKHUDS\ VHVVLRQ IRU QHZ LQFRPSHWHQW SHUIRUDWRUV 1R FRPSOLFDWLRQVZHUHQRWHGSDWLHQWVFRPSODLQHGRIWLJKWQHVVDORQJWKHFRXUVH RIWUHDWHG*693DWLHQWVUHVXPHGURXWLQHDFWLYLWLHVLPPHGLDWHO\ &RQFOXVLRQ/DVHUKDVDOUHDG\SURYHQLWVXVHLQWUHDWLQJ*696FOHURWKHUDS\LV HIIHFWLYHLQGHDOLQJZLWKSHUIRUDWRUVDQGSURYLGHVUDSLGKHDOLQJRIFKURQLFYHQRXV XOFHUV&RQFRPLWDQWXVHRIERWKPRGHVOLPLWVWKHQHHGRIVXEVHTXHQWSURFHGXUH % 37$WKHRWKHUZD\86JXLGHG6$)$5,WHFKQLTXH ,.RJDQ0/HLGHUPDQ55R]HQEHUJ$(QJHO$2IHU+DLID,/ UDGXURVHQEHUJ#\DKRRFRP 3XUSRVH7 RGHVFULEHWKHEHQHÀWVRIXOWUDVRXQG86JXLGHGVXELQWLPDODUWHULDO ÁRVVLQJDQWHJUDGHUHWURJUDGHLQWHUYHQWLRQ6$)$5, 0HWKRGVDQG0DWHULDOV:HUHWURVSHFWLYHO\DQDO\VHGSDWLHQWVZKRZHUHWUHDWHG ZLWKWKH6$)$5,WHFKQLTXHGXHWRIDLOXUHRIFODVVLFDODQWHJUDGH37$WRUHFDQDOLVHRF FOXGHGIHPRUDODQGWLELDODUWHULHV%HWZHHQDQGSDWLHQWVXQGHUZHQW 37$SURFHGXUHVLQRXUKRVSLWDOIRUWUHDWPHQWRIOLPELVFKDHPLD:HXVHGWKH 6$)$5,WHFKQLTXHRQSDWLHQWVLQZKRPDQWHJUDGH37$IDLOHGWRSURYLGHGLUHFW ÁRZWRWKHLVFKDHPLFVLWH,QDOOSDWLHQWVWKHUHWURJUDGHSXQFWXUHZDVSHUIRUPHG XQGHU 86 JXLGDQFH ,Q RI SDWLHQWV WKH HQVXLQJ SXQFWXUH VLWH ZDV LQ WKH GRUVDOLVSHGLVDUWHU\DQGLQRQHSDWLHQWZHSXQFWXUHGWKHWLELDOLVDQWHULRUDUWHU\ 7KHJXLGHZLUHZDVSXVKHGLQDUHWURJUDGHPDQQHUWKURXJKWKHSUHYLRXVO\LQVHUWHG DQWHJUDGHFDWKHWHU7KHEDOORRQGLODWDWLRQZDVSHUIRUPHGXVLQJERWKSXQFWXUHVLWHV 5RRP' ,QWHUYHQWLRQDO5DGLRORJ\ 66 9DVFXODULQWHUYHQWLRQV 0RGHUDWRUV /0DLOOL$WKHQV*5 50RUJDQ/RQGRQ8. % 'LUHFWLRQDODWKHUHFWRP\RIFDOFLÀHGVWHQRWLFOHVLRQVRIWKHORZHU OLPELQVHJPHQWVZLWKKLJKELRPHFKDQLFDOVWUHVV\HDUUHVXOWV 3 0LQNR6-DHJHU$%XHFNHU0.DWRK +RPEXUJDG6DDU'(SHWHUPLQNR#\DKRRFRP 3XUSRVH7 RHYDOXDWHWKHORQJWHUPRXWFRPHV\HDURISDWLHQWVZLWKSHULSKHUDO RFFOXVLYH GLVHDVH 32' DQG FDOFLÀHG VWHQRWLF OHVLRQV LQ VHJPHQWV ZLWK KLJK ELRPHFKDQLFDOVWUHVVDIWHUDWKHUHFWRP\ 0HWKRGVDQG0DWHULDOV3DWLHQWVVXIIHULQJIURP32'5XWKHUIRUGWRZHUH WUHDWHGZLWKWKH6LOYHUKDZNDWKHUHFWRP\GHYLFHHY(QGRYDVFXODU0186$LI FDOFLÀHGVWHQRWLFOHVLRQVLQWKHPRVWSUR[LPDORUGLVWDOFPRIWKHVXSHUÀFLDOIHPRUDO DUWHU\DQGRUSRSOLWHDODUWHU\ZHUHSUHVHQW2YHUDOOSDWLHQWVZLWKOHVLRQV IHPDOHVPDOHVPHDQDJHZHUHLQFOXGHGLQWRWKLVSURVSHFWLYHVWXG\ 3DWLHQWVXQGHUZHQWFOLQLFDOUHHYDOXDWLRQHYHU\PRQWKVIRUPRQWKVLQFOXGLQJ WKHPHDVXUHPHQWRIWKHPD[LPXPZDONLQJGLVWDQFHDQGWKHDQNOHEUDFKLDOLQGH[ $%,,QDGGLWLRQGXSOH[VRQRJUDSK\ZDVSHUIRUPHG 5HVXOWV 7KH SULPDU\ VXFFHVV UDWH RI WKH SURFHGXUH ZDV ,Q ÀYH FDVHV DGGLWLRQDO37$DQGRUVWHQWLQJZDVQHFHVVDU\3URFHGXUHUHODWHGFRPSOLFDWLRQV QDPHO\SHULSKHUDOHPEROLVPRFFXUUHGLQFDVHV7KHPHDQ5XWKHUIRUGVFRUH GHFUHDVHGVLJQLÀFDQWO\IURPWRZKLOHWKHPHDQ $%,LQFUHDVHGIURPWR DIWHUPRQWKV7KHSULPDU\DQGDVVLVWHGSULPDU\SDWHQF\UDWHZDVDQG UHVSHFWLYHO\7 DUJHWOHVLRQUHYDVFXODULVDWLRQZDVSHUIRUPHGLQÀYHSDWLHQWV &RQFOXVLRQ'LUHFWLRQDODWKHUHFWRP\VKRXOGEHFRQVLGHUHGDVDQDOWHUQDWLYHIRU WUHDWPHQWRIFDOFLÀHGVWHQRWLFOHVLRQVLQVHJPHQWVZLWKKLJKELRPHFKDQLFDOVWUHVV DVLQPRVWFDVHVVWHQWLQJFDQEHDYRLGHG5HVXOWVDIWHUWKUHH\HDUVGHPRQVWUDWHG DVLJQLÀFDQWGHFUHDVHRIWKH5XWKHUIRUGVFRUHDQGDQLQFUHDVHRIWKH$%,DQGD UHDVRQDEOHSDWHQF\UDWH % ,QWUDDUWHULDOLQIXVLRQRIDOORJHQLFPHVHQFK\PDOVWHPFHOOVIRU FULWLFDOOLPELVFKDHPLDDQGIRRWXOFHUVVDIHW\DQGHIÀFDF\ %--$EGXOODK66'KLOORQ$'DV$&5RVODQL.XDOD/XPSXU0< EDVULM#XPPFHGXP\ 3XUSRVH7 RGHWHUPLQHVDIHW\WHFKQLFDOIHDVLELOLW\DQGFOLQLFDOHIÀFDF\RILQWUD DUWHULDO DOORJHQLF PHVHQFK\PDO VWHP FHOOV $06& IRU FULWLFDO OLPE LVFKDHPLD &/,DQGIRRWXOFHUV 0HWKRGVDQG0DWHULDOV $SURVSHFWLYHVLQJOHDUP3KDVH,,QRQUDQGRPLVHGVWXG\ ZDVFDUULHGRXWLQSDWLHQWVZLWKXQWUHDWDEOHORZHUOLPESHULSKHUDODUWHULDOGLVHDVH VXUJLFDOE\SDVVRUDQJLRSODVW\GLDJQRVHGE\&(05,8QFRQWUROOHG'0UHQDO KHSDWLFIDLOXUHRUDQ\SUHYLRXVPDOLJQDQF\ZDVFDXVHIRUH[FOXVLRQ2QO\VLQJOH LQMHFWLRQRIPLOOLRQFHOOVLQWRWKHFRPPRQIHPRUDODUWHU\XQGHU86JXLGDQFH1R UHSHDWLQMHFWLRQVDOORZHG$06&LVRODWHGIURPXQUHODWHGKHDOWK\GRQRUVDQDO\VHG XVLQJÁRZF\WRPHWU\$06&XSVFDOHGDFFRUGLQJWRF*03 7KHW\SHRIDGYHUVH HYHQWV$(VQXPEHURI$(VDQGSHUFHQWDJH$(VZHUHQRWHG3ULPDU\HQGSRLQWV ZHUH UHVW SDLQ DQG XOFHU KHDOLQJ DW HQG PRQWKV ZKLOH VHFRQGDU\ HQGSRLQWV ZHUHLQFUHDVHGWUDQVFXWDQHRXVSDUWLDOR[\JHQVDWXUDWLRQ7 F32DQNOHEUDFKLDO SUHVVXUHLQGH[$%3,YDVFXORJHQHVLV&(05,DQGOLPESUHVHUYDWLRQ$SSURYDO REWDLQHGIURPKRVSLWDOHWKLFDOUHYLHZERDUG 5HVXOWV7 RGDWHDWRWDORIOLPEVWUHDWHGSDWLHQWHDFKOLPEGLGQRWUHVSRQG WRWUHDWPHQWSDLQSHUVLVWHQWZLWKSDWLHQWKDYLQJ%.$SDWLHQWVGLHGIURPXQ UHODWHGFDXVHVOLPEDWPRQWKVOLPEVDWPRQWKV$WPRQWKVSDWLHQWV OLPEVKDYHOLPESUHVHUYDWLRQLPSURYHG7 F32DQG$%3,ZLWKLQPRQWKDQG SHDNLQJ DW PRQWKV 1R LQFUHDVHG YDVFXORJHQHVLV VHHQ RQ &( 05, 1R$(V GRFXPHQWHGGXULQJWKH)8SHULRG &RQFOXVLRQ7KHVHSUHOLPLQDU\GDWDVKRZLQWUDDUWHULDO $06&LVDVDIHWHFKQLFDOO\ IHDVLEOHDQGHIÀFDFLRXVLQXQWUHDWDEOH&/, 6FLHQWLILF6HVVLRQ $ 6&'()*+%(XURSHDQ&RQJUHVVRI 5DGLRORJ\ )ULGD\ % 7\SH,,HQGROHDNVDIWHUHQGRYDVFXODUDEGRPLQDODRUWLFDQHXU\VP UHSDLUIDWHRIWKHDQHXU\VPVDFGXULQJORQJWHUPIROORZXS 51RO]+7 HXIHOVEDXHU'%HLW]NH0)XQRYLFV8$VHQEDXP$:LEPHU &3ODQN-/DPPHU06FKRGHU9LHQQD$7ULFKDUGQRO]#PHGXQLZLHQDFDW 3XUSRVH7 RHYDOXDWHIUHTXHQF\RIW\SH,,HQGROHDNVDIWHUHQGRYDVFXODU$$$UHSDLU DQGWRFRPSDUHVDFGLDPHWHUFKDQJHVWRHQGROHDNIUHH$$$VLQSDWLHQWVZLWKDW OHDVWWKUHH\HDUV&7IROORZXS 0HWKRGVDQG0DWHULDOV7KHVWXG\FRKRUWVFRQVLVWRIDQR(/Q(/JURXSQ DQGDW\SH,,(/JURXSQ $FFRUGLQJWRWKHLUFRXUVHDQGYHVVHORULJLQW\SH,, (/VZHUHVSOLWWHGLQVXEJURXSV0D[LPXPVDFGLDPHWHUFKDQJHVZHUHPHDVXUHG LQGHÀQHGJURXSVDQGDOVRDFFRUGLQJWRGLIIHUHQWVWHQWJUDIWGHYLFHV$GGLWLRQDOO\ UHLQWHUYHQWLRQDQGGHDWKUDWHVZHUHHYDOXDWHG 5HVXOWV0HDQIROORZXSZDVPRQWKV,QWKHW\SH,,(/JURXSVDFGLDP HWHUVLQFUHDVHGVLJQLÀFDQWO\LQFRPSDULVRQWRWKHÀUVWSRVWRSHUDWLYH&7 ,QWKHQ(/ WKHUHZDVDQRWVLJQLÀFDQWWHQGHQF\WRGHFUHDVLQJVDFGLDPHWHUV,QSURJUDGLHQWDQG HTXDOW\SH,,(/VWKHPHDQGLIIHUHQFHRIVDFGLDPHWHULQFUHDVHZDVVLJQLÀFDQWLQ FRPSDULVRQWRWKHQ(/S%\PHDQVRIWKHRYHUDOOW\SH,,(/JURXSWKHUH ZDVQRVLJQLÀFDQWGLDPHWHUFKDQJHLQFRPSDULVRQWRWKHQ(/ $OVRWKHGLIIHUHQFHRI GLDPHWHUFKDQJHZDVQRWVLJQLÀFDQWFRPSDULQJWKH(/VXEJURXSVDFFRUGLQJWRWKHLU YHVVHORULJLQ5HJDUGLQJGLIIHUHQWVWHQWJUDIWGHYLFHVWKH([FOXGHUHQGRSURVWKHVLV VKRZHGDVLJQLÀFDQWPHDQGLIIHUHQFHRIVDFGLDPHWHULQFUHDVHLQFRPSDULVRQWR WKH7 DOHQWDQG=HQLWKHQGRSURVWKHVLVS5HLQWHUYHQWLRQVZHUHSHUIRUPHG LQQ RISDWLHQWVDQGWKHUHZHUHQ DQHXU\VPUHODWHGGHDWKV &RQFOXVLRQ3URJUDGLHQWDQGHTXDOW\SH,,(/VUHVXOWLQVLJQLÀFDQWDQHXU\VPVDF HQODUJHPHQWGXULQJORQJWHUPIROORZXS%DVHGRQRXUUHVXOWVURXWLQHO\IROORZXS RISDWLHQWVZLWKW\SH,,(/VUHPDLQVPDQGDWRU\ % ([FLPHUODVHUDWKHUHFWRP\LQDUWHULHVRIWKHORZHUOLPEZLWK7$6&& DQG'OHVLRQV &:LVVJRWW3 .DPXVHOOD&/XHGWNH5$QGUHVHQ +HLGH'(FZLVVJRWW#JP[GH 3XUSRVH7KH VWXG\ REMHFWLYH ZDV WR H[DPLQH WKH DSSOLFDWLRQ RI H[FLPHUODVHU DWKHUHFWRP\(/$LQSDWLHQWVZLWKUHIUDFWRU\RFFOXVLRQVLQIHPRURSRSOLWHDODUWHU LHV ZKHUH SUHYLRXV FRQYHQWLRQDO UHFDQDOLVDWLRQ DWWHPSWV XVLQJ SHUFXWDQHRXV WUDQVOXPLQDODQJLRSODVW\37$ZHUHXQVXFFHVVIXO 0HWKRGVDQG0DWHULDOV7KHDYHUDJHDJHRIWKHSDWLHQWVPHQZRPHQ LQFOXGHGLQWKLVVWXG\ZDV\HDUV7KHDYHUDJHRFFOXVLRQOHQJWKZDVFP UDQJH FP 7KH LQLWLDO UHFDQDOLVDWLRQ DWWHPSWV ZHUH SHUIRUPHG ZLWK VWLII 7 HUXPRJXLGHZLUHVFXUYHGRUVWUDLJKWVXSSRUWHGE\YDULRXVFDWKHWHUVVWUDLJKW PXOWLSXUSRVH&REUD$IWHU WKH XQVXFFHVVIXO DWWHPSW DQ H[FLPHU ODVHU FDWKHWHU FDWKHWHU GLDPHWHUV IURP WR PP ZDV XVHG IRU UHFDQDOLVDWLRQ XVLQJ WKH VWHSE\VWHSPHWKRGRIFURVVLQJ$IWHUVXFFHVVIXOFURVVLQJEDOORRQGLODWDWLRQZDV SHUIRUPHGLQDOOFDVHV6WHQWLPSODQWZDVUHTXLUHGLQRISURFHGXUHV 3DWLHQWVZHUHIROORZHGIRUPRQWKVZLWK&&'6 5HVXOWV 7KH LQLWLDO WHFKQLFDO VXFFHVV UDWH RI UHVXOWHG LQSULPDU\ SULPDU\DVVLVWHG DQG VHFRQGDU\DVVLVWHG SDWHQF\ UDWHV RI DQG UHVSHFWLYHO\DIWHUPRQWKV1RVHULRXVFRPSOLFDWLRQVRFFXUUHGWKDWZHUH DWWULEXWDEOHWRWKHLQWHUYHQWLRQ &RQFOXVLRQ$FFRUGLQJWRWKHVHUHVXOWV(/$UHFDQDOLVDWLRQSURYLGHVDORZVWHQW UDWHDOWHUQDWLYHWRVXUJLFDOSURFHGXUHVIRUUHIUDFWRU\RFFOXVLRQV7KLVZRXOGRIIHU SDWLHQWVZLWKLQFUHDVHGRSHUDWLYHULVNVDSURPLVLQJDQGORZULVNWKHUDSHXWLFSUR FHGXUH7KHRSWLRQRIDVXEVHTXHQWYDVFXODURSHUDWLRQZRXOGQRWEHFRPSURPLVHG % /RQJWHUPYROXPHWULFIROORZXSRIDEGRPLQDODRUWLFDQHXU\VPVDIWHU HQGRYDVFXODUDQHXU\VPUHSDLUWRGHWHUPLQHWKHHIIHFWRIHQGROHDNV RQDQHXU\VPYROXPH :+6RPPHU0+DDFN5:HLGHQKDJHQ) 0HLQHO0) 5HLVHU 0XQLFK'(ZLHODQGVRPPHU#PHGXQLPXHQFKHQGH 3XUSRVH 7 R GHWHUPLQH WKH HIIHFW RI GLIIHUHQW W\SHV RI HQGROHDNV RQ ORQJWHUP FKDQJHVRIDQHXU\VPYROXPHLQSDWLHQWVDIWHUDEGRPLQDOHQGRYDVFXODUDQHXU\VP UHSDLU(9$5 0HWKRGVDQG0DWHULDOV:HGHWHUPLQHGWKHYROXPHRIWKHDEGRPLQDODQHXU\VP VL]H LQ SDWLHQWV ZKR XQGHUZHQW (9$5 EHWZHHQ DQG LQ DOO SUH WKHUDSHXWLFDQGIROORZXS&7 VXVLQJWKHVRIWZDUH2VLUL[0HDQLQFUHDVHRIWKH DQHXU\VPYROXPHZDVGHWHUPLQHGIRUSDWLHQWVZLWKRXWHQGROHDNVDQGZLWKGLIIHU HQWW\SHVRIHQGROHDNVDWGLIIHUHQWWLPHSRLQWVPRQWKV00DQG0DIWHU 5HVXOWV,QDOOSDWLHQWVWKH86JXLGHGSXQFWXUHRIDGLVWDODUWHU\ZDVVXFFHVVIXO &RPELQHGDQWHJUDGHDQGUHWURJUDGH6$)$5,WHFKQLTXH37$ZDVVXFFHVVIXOLQ RIWKHSDWLHQWVLQZKLFKWKHDQWHJUDGH37$DORQHGLGQRWSURYLGHVDWLVIDFWRU\ UHFDQDOLVDWLRQDQGZDVFRQVLGHUHGIDLOHG$VDPLQRUFRPSOLFDWLRQWHPSRUDU\'3 DUWHU\VSDVPZDVVHHQLQRIWKHFDVHV &RQFOXVLRQ 6$)$5, WHFKQLTXH LV XVXDOO\ XVHG ZKHQ WKH FODVVLF DQWHJUDGH 37$IDLOV7KLVSURFHGXUHQHFHVVLWDWHVDKROORZGLVWDODUWHU\DQJLRJUDSKLVWVZLWK XOWUDVRQRJUDSKLFVNLOOVDQGLWLVWLPHFRQVXPLQJ+RZHYHULWSURYLGHVDJRRGODVW DOWHUQDWLYHLQSDWLHQWVLQZKLFKWKHDQWHJUDGH37$KDVIDLOHG % 6LOYHUKDZNGLUHFWLRQDODWKHUHFWRP\LQWKHWUHDWPHQWRIGHQRYR IHPRURSRSOLWHDODWKHURVFOHURWLFVWHQRREVWUXFWLYHGLVHDVHVLQJOH FHQWUHH[SHULHQFH 0&LWRQH05RVVL/*UHFR*09DUDQR$=RORYNLQV9'DYLG5RPH,7 PLFLWRQH#LQZLQGLW 3XUSRVH7 RHYDOXDWHWKHUROHRISHUFXWDQHRXVGLUHFWLRQDODWKHUHFWRP\'$LQWKH WUHDWPHQWRIIHPRURSRSOLWHDODWKHURPDVLFOHVLRQVLQV\PSWRPDWLF3$'SDWLHQWV 0HWKRGVDQG0DWHULDOV%HWZHHQDQGSDWLHQWVPDOHVPD ZLWK V\PSWRPDWLF 3$' LQWHUPLWWHQW FODXGLFDWLRQ FDVHV UHVWSDLQ WLVVXH ORVVXQGHUZHQW'$ZLWK6LOYHU+DZNFDWKHWHUIRUDWKHURPDVLFOHVLRQV REVWUXFWLRQV6)$SRSOLWHDODUWHU\ VWHQRVHV&)$6)$DQGSRSOLWHDODUWHU\$YHUDJHDQJLRJUDSKLFOHVLRQ OHQJWKZDVFPRFFOXVLRQDQGFPVWHQRVHV3UHSURFHGXUDO HYDOXDWLRQ FRQVLVWHG RI &'XOWUDVRXQG DQG LQ VHOHFWHG FDVHV &7DQJLRJUDSK\ WREHWWHUFKDUDFWHULVHOHVLRQVOOOHVLRQVZHUHORZFDOFLÀHG,QFDVHVHPEROLF SURWHFWLRQGHYLFHZDVHPSOR\HG 5HVXOWV7 HFKQLFDOVXFFHVVZDVSWV $GMXQFWLYHSWDZDVSHUIRUPHGLQ FDVHV,QSWVDVVRFLDWHGWLELDOYHVVHOWUHDWPHQWZDVSHUIRUPHG1RSHULRSHUD WLYHPRUWDOLW\ZDVREVHUYHG2QHFRPSOLFDWLRQGLVWDOHPEROLVDWLRQRFFXUUHG $YHUDJH $%,LQFUHDVHGIURPWR $WGD\VFOLQLFDOVWDWXVHYDOXDWLRQ ZDVLPSURYHPHQWLQYDULDWHDQGZRUVW$WPWVPHDQ)8UDQJH .DSODQ0HLHUDQDO\VLVVKRZHGSULPDU\SDWHQF\RIWUHDWHGYHVVHOVDWDQG PRQWKVRIDQG$VVLVWHGSDWHQF\ZDVDQGUHVSHFWLYHO\ &RQFOXVLRQ3HUFXWDQHRXVGLUHFWLRQDODWKHUHFWRP\LVDVDIHDQGHIIHFWLYHWHFK QLTXHLQORZHUOLPEUHYDVFXODULVDWLRQ3UHOLPLQDU\UHVXOWVVXSSRUWHGE\VKRUWPLG WHUPGDWDHQFRXUDJHXVHRI'$ZLWK6LOYHU+DZNFDWKHWHULQWKHIHPRURSRSOLWHDO VWHQRREVWUXFWLYHOHVLRQVDOVRLQWUDGLWLRQDOO\´IRUELGGHQGLVWULFWVµ/RQJWHUPGDWD DUHPLVVLQJ % (QGRYDVFXODUWUHDWPHQWRIH[WUDFUDQLDOFDURWLGDUWHU\DQHXU\VPV .'0DWKLDV$5DQIW'RUWPXQG'(NODXVPDWKLDV#NOLQLNXPGRGH 3XUSRVH(IÀFDF\DQGGXUDELOLW\RIHQGRYDVFXODUWUHDWPHQWRIFDURWLGDUWHU\DQ HXU\VPVZLWKFRYHUHGVWHQWVZHUHLQYHVWLJDWHG 0HWKRGVDQG0DWHULDOVSDWLHQWVZLWKH[WUDFUDQLDODQHXU\VPVRIWKHLQWHUQDODQG FRPPRQFDURWLGDUWHU\ZHUHWUHDWHGZLWKFRYHUHGVWHQWVPHQZRPHQPHDQ DJH\HDUV7KHSDWLHQWVVXIIHUHGIURPÀEURPXVFXODUG\VSODVLDWUDXPDWLF DQG VSRQWDQHRXV GLVVHFWLRQ ZKLSODVK LQMXU\ WXPRXU LQYDVLRQ DWKHURVFOHURVLV DQGGLUHFWWUDXPD7KHGLDPHWHURIWKHVPDOOHVWDQHXU\VPPHDVXUHGPPWKH ODUJHVWPPRQDQDYHUDJHPP6HOIH[SDQGDEOHFRYHUHGVWHQWZHUHXVHG LQDOOFDVHV7KUHHSDWLHQWVUHFHLYHGVWHQWV3ODWHOHWLQKLELWRUVZHUHDGPLQLVWHUHG GXULQJDQGDIWHUWKHSURFHGXUH)ROORZXSH[DPLQDWLRQVDUHDYDLODEOHXSWR\HDUV 5HVXOWV,QRIWKHSDWLHQWVWKHVWHQWVVHDOHGWKHDQHXU\VPV,QRQHSDWLHQW D JLDQW DQHXU\VP FRXOG QRW EH FURVVHG 2QH SDWLHQW GHYHORSHG DPDMRU VWURNH LPPHGLDWHO\DIWHUWUHDWPHQW2QHSDWLHQWQHHGHGDVHFRQGLQWHUYHQWLRQGXHWRDQ HQGROHDNPRQWKVODWHU,QWZRWXPRXUSDWLHQWVWKHFDURWLGDUWHU\RFFOXGHGZLWKLQ \HDUVDIWHUWKHLQWHUYHQWLRQZLWKRXWDVWURNHEXWZLWKPLJUDWLRQRIWKHHQGRJUDIW RIWKHSDWLHQWVKDGDJRRGORQJWHUPRXWFRPHZLWKRXWDGYHUVHHYHQWV &RQFOXVLRQ(QGRYDVFXODUWUHDWPHQWRIFDURWLGDUWHU\DQHXU\VPVLVKLJKO\HIIHFWLYH DQGUHSODFHVRSHQVXUJLFDOUHSDLULQQHDUO\DOOFDVHVZLWKDORQJWHUPFXUHUDWHRI DQGZLWKRXWWKHFUDQLDOQHUYHSDOVLHVVHHQDIWHUVXUJHU\ 6FLHQWLILF6HVVLRQ 6 &$' ( ) *+% (XURSHDQ&RQJUHVVRI 5DGLRORJ\ IHPRURWLELDODQJOH)7$ZDVGHÀQHGDVWKHIHPRUDODQJOHPLQXVWKHWLELDODQJOH $OOSDWLHQWV DJHVZHUHUHFRUGHG 5HVXOWV 7KHUH ZDV VLJQLÀFDQW GLIIHUHQFH UHJDUGLQJ WKH )7$ EHWZHHQ JURXSL DQGJURXSV,,D,,EDQG,,,LQGHSHQGHQWVDPSOHVWWHVWSDQG RIWKHSDWLHQWVLQJURXSLDQG,,DUHVSHFWLYHO\KDGDQ)7$R1RVLJQLÀFDQW FRUUHODWLRQEHWZHHQWKH)7$DQGSDWLHQWV DJHZDVREVHUYHGLQDQ\RIWKHJURXSV &RQFOXVLRQ $&/LQMXU\DQGVHYHUH2$LQGXFHDOWHUDWLRQLQWKHIHPRURWLELDODQDWRPL FDOUHODWLRQVKLSE\PHDQVRIURWDWLRQRIWKHIHPXULQUHODWLRQWRWKHWLELD7KHDERYH ÀQGLQJFRXOGEHRIYDOXHLQDVVHVVLQJ $&/WHDUVZLWKHTXLYRFDOGLUHFWVLJQVRQ05, % 0XOWLSDUDPHWULF05,RIWDODUDQGWLELDOFDUWLODJHLQFDGDYHUDQNOHVDW 7 FRUUHODWLRQZLWKLPPXQRKLVWRORJLFDOÀQGLQJV 6=E\Q6$SSULFK9-XUDV3 6]RPRODQ\L6'RPD\HU67UDWWQLJ9LHQQD$7 VWHIDQ]E\Q#PHGXQLZLHQDFDW 3XUSRVH7 R HYDOXDWH ELRFKHPLFDO 05, WHFKQLTXHV DW 7 HVOD VXFK DV VRGLXP LPDJLQJ DQG 7 PDSSLQJ DV SRWHQWLDO PDUNHUV IRU ELRFKHPLFDO FRPSRVLWLRQ RI WDODUDQGWLELDOFDUWLODJHLQXSSHUDQNOHMRLQWE\FRUUHODWLQJ05,SDUDPHWHUVZLWK LPPXQRKLVWRORJLFDOO\DVVHVVHGJO\FRVDPLQRJO\FDQDQGZDWHUFRQWHQWRIFDUWLODJH LQFDGDYHUDQNOHV 0HWKRGVDQG0DWHULDOV6HYHQIUHVKFDGDYHUDQNOHVIURPDORFDODQDWRP\GH SDUWPHQWZHUHXVHGLQWKLVVWXG\6RGLXP05,ZDVSHUIRUPHGZLWKJUDGLHQWHFKR VHTXHQFHRSWLPLVHGIRUDUWLFXODUFDUWLODJHXVLQJVRGLXPRQO\FKDQQHOWUDQVPLW UHFHLYHNQHHFRLO7KH7UHOD[DWLRQWLPHVZHUHREWDLQHGXVLQJDPXOWLHFKRVSLQ HFKRWHFKQLTXHZLWKFKDQQHOWUDQVPLWUHFHLYHNQHHFRLO7 DODUDQGWLELDOFDUWLODJH RIHDFKFDGDYHUDQNOHZDVGLYLGHGLQWRODWHUDOFHQWUDODQGPHGLDOSDUWDQGUHJLRQ RILQWHUHVW DQDO\VHV ZHUH SHUIRUPHG RQ FRUUHVSRQGLQJ 05 LPDJHV 5HVXOWDQW VRGLXPVLJQDOWRQRLVHUDWLR615DQG7UHOD[DWLRQWLPHVZHUHFRUUHODWHGZLWK HDFK RWKHU DV ZHOO DV ZLWK LPPXQRKLVWRORJLFDOO\ DVVHVVHG JO\FRVDPLQRJO\FDQ DQGZDWHUFRQWHQWRIWDODUDQGWLELDOFDUWLODJH 5HVXOWV6WURQJ3HDUVRQFRUUHODWLRQFRHIÀFLHQWZDVIRXQGEHWZHHQVRGLXP615 DQGJO\FRVDPLQRJO\FDQFRQWHQWLQWDODUU DQGWLELDOU FDUWLODJHDV ZHOODVEHWZHHQ7UHOD[DWLRQWLPHVDQGZDWHUFRQWHQWLQWLELDOFDUWLODJHU /RZFRUUHODWLRQZDVREVHUYHGEHWZHHQ7UHOD[DWLRQWLPHVDQGZDWHUFRQWHQWLQ WDODUFDUWLODJHU &RQFOXVLRQ 2EWDLQHG KLJK FRUUHODWLRQ EHWZHHQ 05, SDUDPHWHUV DQG LPPXQR KLVWRORJLFDO UHVXOWV YDOLGDWHV WKH ÀQGLQJV RI SURJUHVVLYH 05, PHWKRGV DW 7 $ FRQWUDVWIUHHJO\FRVDPLQRJO\FDQVSHFLÀFVRGLXPLPDJLQJDVZHOODVZDWHUDQG FROODJHQVHQVLWLYH7PDSSLQJDUHIHDVLEOHIRUWKHQRQLQYDVLYHELRFKHPLFDOHYDOX DWLRQRIWKHWDODUDQGWLELDOFDUWLODJHLQUHDVRQDEOHVFDQWLPHV % 8&6)VFRUHDQRYHOTXDQWLWDWLYHDVVHVVPHQWVFRUHIRUFDUWLODJH OHVLRQVLQHDUO\RVWHRDUWKULWLVGDWDIURPWKHRVWHRDUWKULWLVLQLWLDWLYH +$OL]DL:9LUD\DYDQLFK*%-RVHSK/1DUGR+/LHEO3 -XQJPDQQ 0&1HYLWW&(0F&XOORFK7 0/LQN6DQ)UDQFLVFR&$86 KDP]DDOL]DL#JPDLOFRP 3XUSRVH ,Q WKLV VWXG\ ZH GHVFULEH D TXDQWLWDWLYH VFRULQJ V\VWHP IRU FDUWLODJH OHVLRQVWHVWLWVUHOLDELOLW\DQGYDOLGLW\DQGFRPSDUHLWZLWKHVWDEOLVKHGVHPLTXDQ WLWDWLYHVFRULQJV\VWHPV 0HWKRGVDQG0DWHULDOV)RUW\VHYHQLQGLYLGXDOVZLWKDQGZLWKRXWULVNIDFWRUVIRU NQHH2$ZHUHUDQGRPO\VHOHFWHGIURPWKHRVWHRDUWKULWLVLQLWLDWLYHFRKRUW,QFOXVLRQ FULWHULDZHUHDJH%0,NJPòQRNQHHSDLQDQGQRUDGLRJUDSKLF2$DW EDVHOLQH%DVHOLQHDQGPRQWKIROORZXSULJKWNQHH705LPDJHVZHUHDQDO\VHG XVLQJ:2506%/2.6DQG8&6)6FRUHZLWKDQLQWHUYDORIZHHNVEHWZHHQHDFK DQDO\VLV3URJUHVVLRQRIFDUWLODJHOHVLRQVXVLQJHDFKVFRULQJV\VWHPZDVFDOFXODWHG DQGFRPSDUHGXVLQJPXOWLOHYHOPL[HGHIIHFWOLQHDUUHJUHVVLRQPRGHOV:HLJKWHG .DSSDYDOXHVZHUHFDOFXODWHGWRGHWHUPLQHUHOLDELOLW\ 5HVXOWV 7KH 8&6)6FRUH DVVHVVHV IHDWXUHV RI FDUWLODJH GHIHFWV GLDPHWHU QXPEHURIVHFWLRQVVHFWLRQWKLFNQHVVGHSWKDQGVKDSHLQNQHHFRPSDUWPHQWV 7KHLQWHUDQGLQWUDREVHUYHUUHOLDELOLW\IRUWKHWRWDO8&6)6FRUHZHUHFDOFXODWHG DVDQG,QWHUREVHUYHU.DSSDIRULQGLYLGXDOIHDWXUHVUDQJHGIURP WR8&6)6FRUHKDGDVLJQLÀFDQWO\KLJKHUUDWHIRUGHWHFWLQJFDUWLODJHOHVLRQ SURJUHVVLRQWKDQ:2506DQG%/2.6SDQGRIWKH OHVLRQVSURJUHVVHGZKHQDQDO\VHGZLWK8&6)6FRUH:2506DQG%/2.6UH VSHFWLYHO\8VLQJ8&6)6FRUHWKHVXEMHFWVZLWK2$ULVNIDFWRUVKDGKLJKHURGGV RISURJUHVVLRQWKDQVXEMHFWVZLWKRXWULVNIDFWRUV25S &RQFOXVLRQ7KH8&6)6FRUHLVDQRYHOUHSURGXFLEOHDQGYDOLGTXDQWLWDWLYHVFRULQJ V\VWHPIRUFDUWLODJHOHVLRQVZKLFKSURYLGHVDQLPSURYHGGHWHFWLRQUDWHIRUPRQLWRU LQJHDUO\2$SURJUHVVLRQFRPSDUHGWRWKHVHPLTXDQWLWDWLYH:2506DQG%/2.6 (9$53DWLHQWVZLWKORZÁRZW\SH,,DQGZLWKKLJKÁRZW\SH,,,,,HQGROHDNV ZHUHDQDO\VHGVHSDUDWHO\WRGHWHUPLQHWKHHIIHFWRIHQGROHDNRQDQHXU\VPYROXPH 5HVXOWV2YHUDOO&7GDWDVHWVZHUHHYDOXDWHGE\YROXPHWU\SDWLHQWDJH \QRRIIROORZXS&7 VPHDQIROORZXSWLPHPRQWKV $PRQJWKHVH SDWLHQWVWKHUHZHUHW\SH,W\SH,,DQGW\SH,,,HQGROHDNV7KHDQHXU\VP YROXPHLQSDWLHQWVZLWKRXWHQGROHDNVDIWHU00DQG0ZDV DQGRIWKHLQLWLDODQHXU\VPYROXPHUHVSHFWLYHO\/RZÁRZW\SH,,HQGROHDNV VKRZHGWKHIROORZLQJYROXPHV00DQG0 +LJKÁRZW\SH,,,,HQGROHDNVVKRZHGWKHIROORZLQJYROXPHWULHVFRPSDUHGWRWKH LQLWLDOYROXPHWU\00DQG0S &RQFOXVLRQ %RWK ORZ DQG KLJKÁRZ HQGROHDNV KDYH D VLJQLÀFDQW LPSDFW RQ UHJUHVVLRQRIDQHXU\VPYROXPHLQSDWLHQWVDIWHU(9$57\SH,,HQGROHDNVUDWKHU OHDGWRVWDEOHYROXPHVRYHU\HDUVW\SH,DQG,,,HQGROHDNFRQWLQXRXVO\LQFUHDVH DQHXU\VPVL]H 5RRP( 0XVFXORVNHOHWDO 66 &DUWLODJHDQGRVWHRDUWKULWLV 0RGHUDWRUV $3ODWNDMLV5LJD/9 *6FKHXUHFNHU/LQ]$7 % %LRPHFKDQLFVRIKXPDQNQHHFDUWLODJHORDGLQJRINQHHGXULQJ705, 7 6KLRPL3 6]RPRODQ\L9-XUDV6=E\Q67UDWWQLJ9LHQQD$7 WVKLRPL#NDVRQHWQHMS 3XUSRVH $VUHSRUWHGSUHYLRXVO\05,PHDVXUHPHQWVRINQHHFDUWLODJHPRUSKRORJ\ DUHQRWVHQVLWLYHWRFKDQJHVDVVRFLDWHGZLWKHDUO\VWDJHRIRVWHRDUWKULWLVGHYHORS PHQW%LRFKHPLFDO05,SURYLGHVLQIRUPDWLRQRQFDUWLODJHFRPSRVLWLRQGRPLQDQWO\ RQSURWHRJO\FDQFRQWHQWDQGFRODJHQPDWUL[:HK\SRWKHVLVHWKDWFKDQJHVLQ7 YDOXHVRIKXPDQNQHHFDUWLODJHREVHUYHGGXULQJELRPHFKDQLFDO05,FRUUHODWHZLWK FDUWLODJHIXQFWLRQDOLW\ 0HWKRGVDQG0DWHULDOV0XOWLVOLFHPXOWLHFKRZDVSHUIRUPHGRQYROXQWHHUV $IWHUORDGIUHHPHDVXUHPHQWVORDGRIKDOIERG\ZHLJKWZDVDSSOLHGZLWKWKH05 FRPSDWLEOHFXVWRPPDGHSQHXPDWLFFRQWUROOHGFRPSUHVVLRQGHYLFHIRU7 $WWKH HQGORDGIUHHPHDVXUHPHQWZDVUHSHDWHG2IÁLQHSRVWSURFHVVLQJZDVXVHGWR HYDOXDWH7PDSV52,VZHUHGUDZQPDQXDOO\E\H[SHULHQFHGUDGLRORJLVWLQGHHS DQG VXSHUÀFLDO ]RQH RI WKH ZHLJKWEHDULQJ DUHD 0HDQ VWDQGDUGGHYLDWLRQ DQG SL[HOFRXQWZHUHUHFRUGHGDQGVWDWLVWLFDOO\DQDO\VHGE\7WHVW 5HVXOWV7YDOXHVRIKXPDQNQHHFDUWLODJHH[KLELWVLJQLÀFDQWGHFUHDVHLQORDGLQJ SKDVHPV!PVS DQGVLJQLÀFDQWLQFUHDVHLQXQORDGLQJ SKDVHPV!PVS 7YDOXHVH[KLELWQRQOLQHDUG\QDPLF FKDQJHRYHUWLPHDQGUHDFKHGVWDEOHYDOXHVDIWHUPLQXWHVRIORDGLQJXQORDGLQJ &KDQJHVRI7YDOXHVZHUHPRUHREYLRXVLQVXSHUÀFLDOOD\HU &RQFOXVLRQ/RDGLQJRINQHHGXULQJ05,FDQSURYLGHELRPHFKDQLFDOFKDUDFWHU LVWLFVRIKXPDQNQHHFDUWLODJH6WDWLVWLFDOO\VLJQLÀFDQWFKDQJHRIFDUWLODJH7LQ ORDGLQJDQGXQORDGLQJSKDVHSURYLGHVLQVLJKWLQWRFDUWLODJHIXQFWLRQ7KLVFDQKHOS LQGLDJQRVWLFVRIHDUO\VWDJHVRIRVWHRDUWKULWLVGHYHORSPHQWZKHQPRUSKRORJLFDO FKDQJHVDQGGHJHQHUDWLRQVDUHQRWYLVLEOH1H[WVWHSZLOOEHDSSOLFDWLRQRIORDGLQJ 05,WRWKHSDWLHQWVDIWHUFDUWLODJHVXUJHU\ % .QHHMRLQWFRQÀJXUDWLRQWKHLPSOLFDWLRQRIVHYHUHRVWHRDUWKULWLVDQG $&/LQMXU\ (9DVVDORX3 0DWDOOLRWDNL.6SDQDNLV3 0DLGDV(0DJNDQDV $.DUDQWDQDV,UDNOLRQ*5YDVVDORXH#KRWPDLOFRP 3XUSRVH7 RDVVHVVWKHHIIHFWRIVHYHUHRVWHRDUWKULWLV2$DQG$&/LQMXU\RQWKH NQHHMRLQWFRQÀJXUDWLRQ 0HWKRGV DQG 0DWHULDOV 05 LPDJHV IRU SDWLHQWV ZHUH UHYLHZHG *URXSL FRQVLVWHG RI SDWLHQWV \ ZLWK 05, GLDJQRVLV RWKHU WKDQ VHYHUH 2$ FKRQGUDOGHIHFWVVWDJH,,DQG$&/LQMXU\*URXS,,DLQFOXGHGSDWLHQWV \ZLWKFRPSOHWHFKURQLFRUUHFHQW$&/WHDUDQG,,ESDWLHQWV\ZLWK SDUWLDOFKURQLFRUUHFHQW$&/WHDU*URXS,,,HQFRPSDVVHGSDWLHQWV\ ZLWKVHYHUH2$FKRQGUDOGHIHFWV!VWDJH,,7KHIHPRUDODQJOHZDVGHÀQHGLQWKH D[LDOSODQHE\GUDZLQJDKRUL]RQWDOOLQHDQGDOLQHWDQJHQWWRWKHSRVWHULRUDVSHFW RIWKHFRUWH[RIWKHIHPRUDOFRQG\OHVDWWKHLUPD[LPXPDQWHURSRVWHULRUGLDPHWHU 7KHWLELDODQJOHZDVPHDVXUHGVLPLODUO\RQHVOLFHDERYHWKHKHDGRIWKHÀEXOD7KH 6FLHQWLILF6HVVLRQ $ 6&'()*+%(XURSHDQ&RQJUHVVRI 5DGLRORJ\ )ULGD\ 0HWKRGV 4XDQWLWDWLYH DQDO\VLV RI FDUWLODJH ZDV SHUIRUPHG XVLQJ 7 05, ZLWK ERWK7PDSSLQJWHFKQLTXHVLQLQGLYLGXDOVZLWKPLOG2$.HOOHJUHQ/DZUHQFH >./@VFRUHRIGLYLGHGLQWRWZRJURXSVRISURJUHVVRUVVXEMHFWVDQGQRQ SURJUHVVRUV VXEMHFWV 0RUSKRORJLFDO DEQRUPDOLWLHV RI FDUWLODJH PHQLVFL OLJDPHQWVDQGERQHPDUURZZHUHDQDO\VHGRQVDJLWWDOIDWVDWXUDWHG7ZHLJKWHG IDVW VSLQ HFKR )6( VHTXHQFHV DQG SURJUHVVLRQ RI GHJHQHUDWLYHGLVHDVH ZDV DVVHVVHGRYHUDSHULRGRIWZR\HDUV'LIIHUHQFHVEHWZHHQ7UHOD[DWLRQWLPHLQ SURJUHVVLRQDQGQRQSURJUHVVLRQFRKRUWVZHUHFRPSDUHGXVLQJRQHZD\DQDO\VLV RIYDULDQFH$129$DQGWWHVWV 5HVXOWV6LJQLÀFDQWGLIIHUHQFHVLQEDVHOLQH7YDOXHVZHUHIRXQGEHWZHHQSURJUHV VLRQDQGQRQSURJUHVVLRQFRKRUWVLQDOOFRPSDUWPHQWVSH[FHSWWKHODWHUDO WLELDPHGLDOIHPXUS PHGLDOWLELDS ODWHUDOIHPXUS DQGSDWHOODS &RQFOXVLRQ7 PDSSLQJ WHFKQLTXHV GLIIHUHQWLDWHG LQGLYLGXDOV ZLWK DQG ZLWKRXW SURJUHVVLRQRIGHJHQHUDWLYHDEQRUPDOLWLHVDQGPD\WKHUHIRUHEHXVHGDVSUHGLF WRUVIRUSURJUHVVLRQRINQHH2$ % 05,EDVHGDQGFOLQLFDOORQJWHUPUHVXOWVRILVRODWHGRVWHRFKRQGUDO WUDQVSODQWDWLRQ2$76RIWKHNQHHMRLQW -6%DXHU/.RKQ-3HQ]HO3 8%UXFNHU$,PKRII(5XPPHQ\ .:RHUWOHU06DXHUVFKQLJ0XQLFK'(MVE#URHPHGWXPGH 3XUSRVH2$76LVDQHVWDEOLVKHGWKHUDS\IRURVWHRFKRQGUDOOHVLRQVDWWKHNQHH MRLQW+RZHYHUORQJWHUPUHVXOWVUHJDUGLQJFOLQLFDODQGPRUSKRORJLFDORXWFRPHGR QRWH[LVWLQDXQLIRUPSDWLHQWVHWVRIDU 0HWKRGV DQG 0DWHULDOV :H IROORZHG XS SDWLHQWV P I ¡ DJH \ LQDYHUDJH\HDUVDIWHULVRODWHG2$76WKHUDS\RIWKHPHGDORUODWHUDO IHPRUDOFRQG\OH&OLQLFDOVFRUHV:20$&/\VKROP,.'&7 HJQHUVFRUH9$6 ZHUHREWDLQHGDQG05LPDJLQJZDVSHUIRUPHGDW7SUHVXUJHU\DQGDW7 DWIROORZXSXVLQJVWDQGDUGPRUSKRORJLFDOVHTXHQFHVWULSODQDUIDWVDWXUDWHGLQ WHUPHGLDWHZHLJKWHGIDVWVSLQHFKRVDJLWWDO7ZHLJKWHGIDVWVSLQHFKRVHTXHQFH VSDWLDO UHVROXWLRQ [[ PP DQG 7PDSSLQJ PXOWLHFKRVSLQ HFKR 7( PV75 PVUHVROXWLRQ[[PP([FOXVLRQ FULWHULDZHUHOLJDPHQWUHFRQVWUXFWLRQVZHGJHRVWHRWRPLHVPHQLVFDOUHVHFWLRQVDQG NLVVLQJOHVLRQV3URJUHVVLRQRIRVWHRDUWKULWLVZDVTXDQWLÀHGLQ05LPDJHVXVLQJ WKH%/2.VFRUH7UDQVSODQWLQWHJUDWLRQZDVHYDOXDWHGXVLQJWKH02&$57VFRUH &DUWLODJHTXDOLW\ZDVDVVHVVHGXVLQJ7UHOD[DWLRQWLPHV 5HVXOWV&RPSDULQJSUHVXUJHU\ZLWKIROORZXSVLJQLÀFDQWLPSURYHPHQWZDVIRXQG LQFDVHRI9$6:20$&DQG/\VKROPVFRUH7KH7 HJQHUVFRUHGLGQRWVKRZGLI IHUHQFHVS!%/2.6LQFUHDVHGLQ2$DVVRFLDWHGÀQGLQJVOLNHRVWHRSK\WHV $YHUDJH7UHOD[DWLRQWLPHVRIWKH2$76F\OLQGHUVGLGQRWVKRZVLJQLÀ FDQWGLIIHUHQFHVWRQRUPDOFDUWLODJH+RZHYHUWKHDGMDFHQWFDUWLODJHQH[W WRWKHF\OLQGHUGHPRQVWUDWHGVLJQLÀFDQWO\KLJKHU7YDOXHVS &RQFOXVLRQ,VRODWHG2$76WKHUDS\VKRZVJRRGORQJWHUPUHVXOWVERWKFOLQLFDOO\ DQGPRUSKRORJLFDOO\7KH7HOHYDWLRQRIWKHVXUURXQGLQJFDUWLODJHPD\VXJJHVW DSUHH[LVWLQJGHIHFWLQFDUWLODJHXOWUDVWUXFWXUHODUJHUWKDQWKHUHSODFHGDUHDQRW YLVLEOHIRUWKHVXUJHRQ % /RQJWHUPUHVXOWV\HDUVDIWHUDXWRORJRXVRVWHRFKRQGUDO WUDQVSODQWDWLRQ7JDJ&(67DQGVRGLXPPDJQHWLFUHVRQDQFH LPDJLQJZLWKPRUSKRORJLFDODQGFOLQLFDOFRUUHODWLRQ %6FKPLWW,.UXVFKH0DQGO6$SSULFK9-XUDV67UDWWQLJ9LHQQD$7 EHQMDPLQVFKPLWW#PHGXQLZLHQDFDW 3XUSRVH 7KH DLP RI WKH VWXG\ ZDV WR FRPSDUH PRUSKRORJLFDO 02&$57 ELRFKHPLFDO7PDSSLQJJDJ&(67DQGVRGLXPLPDJLQJDQGFOLQLFDOORQJWHUP UHVXOWVDIWHUDXWRORJRXVRVWHRFKRQGUDOWUDQVSODQWDWLRQ$27 0HWKRGVDQG0DWHULDOV1LQHSDWLHQWVWUHDWHGZLWK$27DWWKHLUNQHHMRLQWVFRQ VHQWHGWRSDUWLFLSDWHLQFOLQLFDO,.'&PRGLÀHG/\VKROPDQG9$6DQGUDGLRORJLFDO ORQJWHUPIROORZXSDWDPHGLDQRI\HDUV,450RUSKRORJLFDO05, ZDVSHUIRUPHGRQD705XQLWDQGLQFOXGHG3'ZLPDJLQJZLWKDQGZLWKRXWIDW VXSSUHVVLRQ7ZDQG7ZLPDJLQJIURPZKLFKWKH02&$57VFRUHZDVGHULYHG 7PDSSLQJZDVSHUIRUPHGDW7XVLQJDPXOWLHFKRVSLQHFKRDSSURDFK6RGLXP DQG&(6705,ZHUHSHUIRUPHGRQD7ZKROHERG\05VFDQQHU 5HVXOWV 7KH GLIIHUHQFH EHWZHHQ QDWLYH DQG UHSDLU FDUWLODJH ZDV VWDWLVWLFDOO\ VLJQLÀFDQW UHJDUGLQJ PHGLDQ 7 YDOXHV PHGLDQ &(67 DV\PPHWU\ DQG PHGLDQ VRGLXP6157KHPHGLDQ02&$57VFRUHUHYHDOHGSRLQWVWKHPHGLDQPRGLÀHG /\VKROPVFRUHDQGWKHPHGLDQ9$6ZDV7KHVWURQJHVWFRUUHODWLRQEHWZHHQ 05,SDUDPHWHUVZDVIRXQGEHWZHHQVRGLXP615UDWLRVDQG&(67DV\PPHWU\ UDWLRVѩ SVKRZLQJFRQVLVWHQWSURWHRJO\FDQDVVHVVPHQWDW7 % 7UHOD[DWLRQWLPHPHDVXUHPHQWVDUHOLPLWHGLQPRQLWRULQJDGYDQFHG FDUWLODJHGHJHQHUDWLRQRIWKHNQHHORQJLWXGLQDOGDWDIURPWKH RVWHRDUWKULWLVLQLWLDWLYH 3 0-XQJPDQQ+/LHEO+$OL]DL/1DUGR*-RVHSK-/\QFK &(0F&XOORFK0&1HYLWW7 0/LQN6DQ)UDQFLVFR&$86 KDQVOLHEO#XFVIHGX 3XUSRVH 7 R DQDO\VH WKH QDWXUDO WZR\HDU GHYHORSPHQW RI NQHH FDUWLODJH7 UHOD[DWLRQWLPHPHDVXUHPHQWVLQUHODWLRQWRWKHH[WHQWRIPRUSKRORJLFDOFDUWLODJH DEQRUPDOLWLHVDVVHVVHGZLWK7 HVOD05LPDJHVIURPWKHRVWHRDUWKULWLVLQLWLDWLYH LQFLGHQFHFRKRUW 0HWKRGVDQG0DWHULDOV5LJKWNQHH05,VRI\HDUROGLQGLYLGXDOV PDOHVIHPDOHVZLWKULVNIDFWRUVIRURVWHRDUWKULWLV2$EXWZLWKRXWUDGLRJUDSKLF 2$RUNQHHSDLQDWEDVHOLQHZHUHLQFOXGHGLQWKLVVWXG\&DUWLODJHZDVVHJPHQWHG DQG7 PDSV ZHUH JHQHUDWHG LQ ÀYH FRPSDUWPHQWV SDWHOOD PHGLDO DQG ODWHUDO IHPRUDOFRQG\OHPHGLDODQGODWHUDOWLELDSODWHDXDWEDVHOLQHDQGWZR\HDUIROORZXS 7FKDQJHVRYHU\HDUVZHUHFRUUHODWHGZLWKEDVHOLQH7YDOXHVDVZHOODVFDUWLODJH GHJHQHUDWLYHFKDQJHVDVVHVVHGZLWKZKROHRUJDQ05LPDJLQJVFRUHV:2506 6WDWLVWLFDODQDO\VLVZDVSHUIRUPHGZLWK$129$DQGWZRVLGHG6WXGHQWVWWHVWV 5HVXOWV /RQJLWXGLQDO 7 FKDQJHV ZHUH VLJQLÀFDQWO\ QHJDWLYHO\ FRUUHODWHG ZLWK ERWKEDVHOLQH3 DQGIROORZXS3 FDUWLODJH:25063DWLHQWVWKDW GHYHORSHGQHZFDUWLODJHGHIHFWVKDGVLJQLÀFDQWO\VPDOOHULQFUHDVHLQ7YDOXHVWKDQ SDWLHQWVZLWKRXWQHZOHVLRQVPVYHUVXVPV3 )XUWKHULQGLYLGXDOVZLWKKLJKHUEDVHOLQH7VKRZHGVPDOOHU7LQFUHDVHVRYHUWLPH LQDOOFRPSDUWPHQWV3 &RQFOXVLRQ$Q LQYHUVH FRUUHODWLRQ RI ORQJLWXGLQDO 7 UHOD[DWLRQ WLPH FKDQJHV YHUVXVEDVHOLQH7YDOXHVDQGPRUSKRORJLFDOFDUWLODJHDEQRUPDOLWLHVZDVIRXQG VXJJHVWLQJWKDW7YDOXHVPD\QRWEHZHOOVXLWHGIRUPRQLWRULQJDGYDQFHGGHJHQHUD WLYHGLVHDVH7KLVPD\EHGXHWRDWUXHQHJDWLYHFRUUHODWLRQLQ7PHDVXUHPHQWV FHLOLQJHIIHFWVRUUHJUHVVLRQWRWKHPHDQ % %DVHOLQHPHDQDQGKHWHURJHQHLW\RI05NQHHFDUWLODJH7DUH DVVRFLDWHGZLWKPRUSKRORJLFGHJHQHUDWLRQRIFDUWLODJHPHQLVFXV DQGERQHPDUURZRYHUWKUHH\HDUVGDWDIURPWKHRVWHRDUWKULWLVLQLWLDWLYH 7 %DXP*%-RVHSK+$OL]DL-&DUEDOOLGR*DPLR/1DUGR:9LUD\DYDQLFK &(0F&XOORFK60DMXPGDU7 0/LQN6DQ)UDQFLVFR&$86 WKEDXP#JP[GH 3XUSRVH L 7 R VWXG\ WKH QDWXUDO SURJUHVVLRQ RI PRUSKRORJLF FKDQJHV RIW K H FDUWLODJHPHQLVFXVDQGERQHPDUURZXVLQJDVHPLTXDQWLWDWLYHVFRUHDQGLLWR GHWHUPLQHZKHWKHUWKHPHDQDQGKHWHURJHQHLW\RI05NQHHFDUWLODJH7DWEDVHOLQH DUHDVVRFLDWHGZLWKPRUSKRORJLFGHJHQHUDWLRQRIWKHVHWLVVXHVRYHUWKUHH\HDUVLQ VXEMHFWVZLWKULVNIDFWRUVIRUNQHHRVWHRDUWKULWLV2$ 0HWKRGVDQG0DWHULDOV6XEMHFWVZLWKULVNIDFWRUVIRUNQHH2$Q ZLWKDQ DJH UDQJH RI \HDUV ZHUH VHOHFWHG IURP WKH RVWHRDUWKULWLVLQLWLDWLYH 2$, GDWDEDVH7 HVOD05LPDJHVRIWKHULJKWNQHHDWEDVHOLQHDQG\HDUIROORZXS ZHUH DQDO\VHG XVLQJ PRUSKRORJLFDO JUDGLQJV RI FDUWLODJH PHQLVFXV DQG ERQH PDUURZ:2506VFRULQJ$7PDSSLQJVHTXHQFHZDVXVHGWRDVVHVVEDVHOLQH PHDQDQGKHWHURJHQHLW\RIFDUWLODJH7JUH\OHYHOFRRFFXUUHQFHPDWUL[*/&0 WH[WXUHDQDO\VLV5HJUHVVLRQPRGHOVZHUHXVHGWRDVVHVVWKHUHODWLRQVKLSEHWZHHQ EDVHOLQH7SDUDPHWHUVDQGFKDQJHVLQPRUSKRORJLFNQHH:2506VFRUHVRYHU WKUHH\HDUV 5HVXOWV7KH SUHYDOHQFH RI NQHH DEQRUPDOLWLHV LQ WKH FDUWLODJH PHQLVFXV DQG ERQH PDUURZ VLJQLÀFDQWO\ S LQFUHDVHG IURP EDVHOLQH WR \HDUV LQ DOO FRPSDUWPHQWVFRPELQHG7KHPHDQDQGKHWHURJHQHLW\RIEDVHOLQHFDUWLODJH7 ZDVVLJQLÀFDQWO\SHOHYDWHGLQVXEMHFWVZKRVHFDUWLODJHPHQLVFXVDQG ERQHPDUURZ:2506VFRUHVLQFUHDVHGRYHUWKUHH\HDUVFRPSDUHGWRVXEMHFWV ZKRVHVFRUHVGLGQRWFKDQJH &RQFOXVLRQ7KHSUHYDOHQFHRINQHHDEQRUPDOLWLHVVLJQLÀFDQWO\LQFUHDVHGRYHU WKUHH \HDUV LQFUHDVHG FDUWLODJH 7 DW EDVHOLQH LV DVVRFLDWHG ZLWK ORQJLWXGLQDO PRUSKRORJLFGHJHQHUDWLRQLQWKHFDUWLODJHPHQLVFXVDQGERQHPDUURZRYHUWKUHH \HDUVLQVXEMHFWVZLWKULVNIDFWRUVIRU2$ % 05EDVHGEDVHOLQH7UHOD[DWLRQWLPHSUHGLFWVSURJUHVVLRQRINQHH RVWHRDUWKULWLV /1DUGR$3UDVDG-6FKRROHU+/LHEO7 0/LQN6DQ)UDQFLVFR&$86 3XUSRVH7 RHYDOXDWHZKHWKHU7UHOD[DWLRQWLPHVRINQHHFDUWLODJHGHWHUPLQHG ZLWK705,DWEDVHOLQHSUHGLFWHGORQJLWXGLQDOSURJUHVVLRQRIFDUWLODJHGHJHQHUD WLYHFKDQJHV 6FLHQWLILF6HVVLRQ 6 &$' ( ) *+% (XURSHDQ&RQJUHVVRI 5DGLRORJ\ WKDQLQFRQÁXHQWÀEURVLV[PPVDQG[PPV S &RPSDUHGZLWK7ZHLJKWHGLPDJHKHSDWRELOLDU\SKDVHVKRZHGPRUH GLVFUHWHPDUJLQDQGQRGXODUFRQÀJXUDWLRQLQLQÀOWUDWLYH+&&DQGPRUHLQGLVWLQFW DQGZHGJHVKDSHLQFRQÁXHQWÀEURVLV &RQFOXVLRQ3UHVHUYDWLRQRIOLYHUFRQWRXURUFRQWRXUEXOJLQJSRUWDOYHLQWKURP ERVLVDQGORZ$'&YDOXHZHUHIRXQGWREHKLJKO\VXJJHVWLYH05ÀQGLQJVIRUGLI IHUHQWLDWLRQRILQÀOWUDWLYH+&&IURPFRQÁXHQWÀEURVLVLQOLYHUFLUUKRVLV+HSDWRELOLDU\ SKDVHLPSURYHVFKDUDFWHULVDWLRQDQGGHWHUPLQDWLRQRIH[WHQWDQGPDUJLQRIWKH OHVLRQWRGLVWLQJXLVKWKHVHWZRHQWLWLHV % *G(2%'73$HQKDQFHG705,IRUWKHHYDOXDWLRQRIKHSDWLF PHWDVWDVLVIURPFRORUHFWDOFDQFHULVPHWDVWDVLVDOZD\VVHHQDVD ´GHIHFWµRQWKHKHSDWRELOLDU\SKDVH" $.LP&/HH..LP-&KRL-/HH< 3DUN&3DUN6HRXO.5 DUNLPUDG#JPDLOFRP 3XUSRVH 7 R GHWHUPLQH VSHFLÀF LPDJLQJ IHDWXUHV RI KHSDWLF PHWDVWDVLV IURP FRORUHFWDOFDQFHUIRFXVLQJRQWKHKHSDWRELOLDU\SKDVH+%3RI*G(2%'73$ HQKDQFHG05, 0HWKRGVDQG0DWHULDOV2YHUD\HDUSHULRGKHSDWLFPHWDVWDWLFOHVLRQVZHUH LGHQWLÀHGIURPSDWLHQWVPHQDQGZRPHQZKRSURYHQFRORUHFWDOFDQFHU DQG XQGHUZHQW *G(2%'73$HQKDQFHG 7 05, +HSDWLF PHWDVWDVHV ZHUH SURYHQSDWKRORJLFDOO\LQSDWLHQWVE\VXUJLFDOOLYHUUHVHFWLRQQ DQGE\86 JXLGHGELRSV\Q 7KHUHPDLQLQJSDWLHQWVZHUHFRQVLGHUHGWRKDYHKHSDWLF PHWDVWDVLV EDVHG RQ LPDJLQJ VWXGLHV DQG FOLQLFDO LQIRUPDWLRQ 7ZR UDGLRORJLVWV HYDOXDWHGWKHLPDJLQJIHDWXUHVRIHDFK05,VHTXHQFHLQFOXGLQJKLJKUHVROXWLRQ 7:,G\QDPLFFRQWUDVWHQKDQFHPHQWVWXG\ZLWKKHSDWRELOLDU\SKDVHDQGGLIIXVLRQ ZHLJKWHGLPDJH:HDOVRFRPSDUHG6,RIWKHOHVLRQVRQ7:,DQG+%3 5HVXOWV7:,VKRZHGKRPRJHQHRXVKLJK6,Q WDUJHWDSSHDUDQFH Q UHYHUVHGWDUJHWDSSHDUDQFHQ DQGKHWHURJHQHRXVO\KLJK 6,Q 2Q+%3 KRPRJHQHRXVGHIHFWZDVVHHQLQOHVLRQV WDUJHWDSSHDUDQFHLQÀYHOHVLRQVUHYHUVHGWDUJHWDSSHDUDQFHLQWZROH VLRQVDQGKHWHURJHQHRXVGHIHFWLQOHVLRQVLQFOXGLQJUHWLFXODU SDUWLDOO\JOREXODUDQGGLIIXVH**2OLNHSDWWHUQV$FFRUGLQJWR WKHLPDJLQJIHDWXUHVRQ+%3 WKHKRPRJHQHRXVGHIHFWDQGKHWHURJHQHRXVGHIHFW JURXSVKDGDPHDQ $'&YDOXHRI[DQG[PPVHFUHVSHFWLYHO\ ZLWKRXWVWDWLVWLFDOO\VLJQLÀFDQWGLIIHUHQFH &RQFOXVLRQ +HSDWLF PHWDVWDVLV IURP FRORUHFWDO FDQFHU XVXDOO\ VKRZHG DV D KHWHURJHQHRXVGHIHFWRQ+%3DQGDKHWHURJHQHRXVKLJK6,RQ7:,7KHJHQHU DOO\DFFHSWHG´WUXHGHIHFWµZDVQRWDFRPPRQÀQGLQJLQKHSDWLFPHWDVWDVLVIURP FRORUHFWDOFDQFHU % 4XDQWLÀFDWLRQRIOLYHUIDWFRQWHQWE\7HVODVSHFWURVFRS\PDJQHWLF UHVRQDQFH7650LQQRQDOFRKROLFIDWW\OLYHUGLVHDVHFRUUHODWLRQ ZLWKVHUXPOHYHOVRIDODQLQHDPLQRWUDQVIHUDVH$/7 -/0DUWLQ5RGULJXH]---LPHQH]0ROHRQ-0DFKDGR*DOODV 051DYDUUR/DEUDW09HODVFR7 RUUHV-6DQFKH]*RQ]DOH] -/*RQ]DOH]&DOYLQ*UDQDGD(6MRVHOXLVPDUWLQU[#KRWPDLOFRP 6HUXPOHYHOVRI$/7LVDELRPDUNHUQRQDOFRKROLFIDWW\OLYHUGLVHDVH1$)/'2QO\ DSURSRUWLRQRISDWLHQWVZLWK1$)/'KDYHHOHYDWHGVHUXP$/7OHYHOV 3XUSRVH7 RNQRZLIWKHUHLVDUHODWLRQVKLSEHWZHHQOLYHUIDWFRQWHQWDQGVHUXP OHYHOVRI$/7 DVZHOODVWRVWXG\LIWKHUHLVDWKUHVKROGZLWKLQGHFXUUHQWQRUPDO $/7YDOXHVIURPZKLFKZHFRXOGVXJJHVWWKHSUHVHQFHRI1$)/' 0HWKRGV DQG 0DWHULDOV 7KLV LV D FRPPXQLW\ SURVSHFWLYH FURVVVHFWLRQDO UDQGRPVWXG\*URXS$VXEMHFWVZLWKHOHYDWHGVHUXP$/7OHYHOV!8/ ZLWKRXWDQ\NQRZQFDXVHDOFRKROYLUDOKHSDWLWLVDXWRLPPXQHGUXJVDQGRWKHUV ZHUHH[FOXGHG*URXS%VXEMHFWVZLWKVHUXP$/7OHYHOVEHWZHHQDQG 8/*URXS&VXEMHFWVZLWKVHUXP$/78/4XDQWLÀFDWLRQRIOLYHUIDWE\ VSHFWURVFRS\+057 :HXVHGDFXWRIIYDOXH!RIOLYHUIDWFRQWHQWIRUWKH GLDJQRVLVRIKHSDWLFVWHDWRVLV 5HVXOWV7KHSURSRUWLRQZLWKKHSDWLFVWHDWRVLVZDVJURXS$JURXS% *URXS&SIRUJURXS%RU&YVJURXS$$VLJQLÀFDQWSRVLWLYHFRU UHODWLRQZDVREVHUYHGEHWZHHQOLYHUIDWFRQWHQWDQG$/7VHUXPOHYHOVU S &RQFOXVLRQ2XUVWXG\VKRZVWKDWWKHUHLVDSRVLWLYHVLJQLÀFDQWFRUUHODWLRQEHWZHHQ OLYHUIDWFRQWHQWDQGVHUXP$/7OHYHOVLQVXEMHFWVZLWK1$)/'RIVXEMHFWV ZLWK´QRUPDOµ $/7OHYHOV8/KDGKHSDWLFVWHDWRVLV:HVXJJHVWWKDWVHUXP $/7FRXOGEHDXVHIXOELRPDUNHURI1$)/'LIWKHQRUPDOWKUHVKROGLVHVWDEOLVKHG DW$/7OHYHOV8/ $FRUUHODWLRQEHWZHHQ05,SDUDPHWHUVDQGFOLQLFDOVFRUHVZDVRQO\IRXQGEHWZHHQ 7UDWLRVDQGPRGLÀHG/\VKROPѩ S &RQFOXVLRQ2XUUHVXOWVLPSO\WKDWWKHK\DOLQHFKDUDFWHURI$27JUDIWVVHHPVWR GHJHQHUDWHLQWKHORQJWHUP$27FDQVWLOOEHUHFRPPHQGHGDVDQRSWLRQIRUWKH WUHDWPHQWRIOLPLWHGVL]HGFDUWLODJHGHIHFWVGXHWRIHZFRUUHODWLRQVIRXQGEHWZHHQ 05,DQGFOLQLFDOVFRUHV 5RRP) $EGRPLQDO9LVFHUD 66 05,KLJKÀHOG 0RGHUDWRUV .+RO]DSIHO0XQLFK'( 2/XFLGDUPH3DULV)5 % 2SWLPLVDWLRQRIOLYHULQWUDYR[HOLQFRKHUHQWPRWLRQLPDJLQJSURWRFRO DW7IRUFKURQLFOLYHUGLVHDVHVDVVHVVPHQW %/HSRUT) 3LOOHXO2%HXI9LOOHXUEDQQH)5 EHQMDPLQOHSRUT#FUHDWLVLQVDO\RQIU 3XUSRVH7 RRSWLPLVHD7DFTXLVLWLRQSURWRFROIRUOLYHULQWUDYR[HOLQFRKHUHQW PRWLRQ,9,0LPDJLQJWREHLQFOXGHGLQDFOLQLFDOVWXG\IRFXVHGRQFKURQLFOLYHU GLVHDVHV)RXUVHWRISDUDPHWHUVZHUHHYDOXDWHGRQÀIWHHQKHDOWK\YROXQWHHUV 0HWKRGV,QYDULDQWSDUDPHWHUVZHUHH':,VHTXHQFHZLWKEYDOXHV VPPPV75D[LDOVOLFHVðPPò )29ðPDWUL[PPVOLFHWKLFNQHVV.+]EDQGZLGWK9DULDEOHSDUDPHWHUV DFFRUGLQJWRWKHIRXUVHWWLQJVZHUHDUHVSLUDWRU\WULJJHULQJ1(;PV7( SHUSHQGLFXODUGLIIXVLRQJUDGLHQWVDSSOLHGVLPXOWDQHRXVO\RSWLRQ´LQµDQGҋ DYHUDJH VFDQ GXUDWLRQ E )UHHEUHDWKLQJ 1(; PV 7( LQ RSWLRQ DQG ҋµVFDQGXUDWLRQF)UHHEUHDWKLQJ1(;PV7(SHUSHQGLFXODUGLIIXVLRQ JUDGLHQWVDSSOLHGVHTXHQWLDOO\´DOOµRSWLRQDQGҋµVFDQGXUDWLRQG9DULDEOH1(; DFFRUGLQJWREYDOXHV1(;IURPWRVPPDGGLWLRQDO VPPEYDOXHPV7(´DOOµGLIIXVLRQRSWLRQDQGҋµVFDQGXUDWLRQ3XUH PROHFXODU GLIIXVLRQ FRHIÀFLHQW 'VORZ SHUIXVLRQUHODWHG FRHIÀFLHQW 'IDVW DQG SHUIXVLRQIUDFWLRQIZHUHREWDLQHGE\DQRQOLQHDUOHDVWVTXDUHÀWWRWKH,9,0PRGHO 5HVXOWV 0HDQ ,9,0 SDUDPHWHUV ZHUH I DQG '6ORZ ð PP VHF ')DVW ð PPVHF IRU SURWRFRODEFGUHVSHFWLYHO\%ODQG$OWPDQSORWVZHUHQRWVKRZQVLJQLÀFDQW GLIIHUHQFHVEHWZHHQVHWWLQJV &RQFOXVLRQ +LJK VLJQDO DYHUDJLQJ UHVWULFWHG PRWLRQ DUWHIDFWV FDXVHG E\ IUHH EUHDWKLQJ LPDJLQJ DQG DOORZHG IUHHEUHDWKLQJ WHFKQLTXH 7KH VPDUWDYHUDJLQJ SURFHGXUHUHGXFHVVLJQLÀFDQWO\WKHVFDQGXUDWLRQZLWKVLPLODU615IRUWKHKLJKHVW QXPEHUVRIEYDOXHVDQGWKUHHSHUSHQGLFXODUGLIIXVLRQJUDGLHQWVVHTXHQWLDOO\DS SOLHG7KLVVHWWLQJLVDVXLWDEOHFRPSURPLVHWREHDGGHGLQDFOLQLFDOSURWRFROEH WZHHQDFTXLVLWLRQWLPHPRGHOOLQJUHOLDELOLW\UHSURGXFLELOLW\DQGSDWLHQWDFFHSWDQFH % &DQZHGLIIHUHQWLDWHLQÀOWUDWLYHKHSDWRFHOOXDUFDUFLQRPDDQG FRQÁXHQWÀEURVLVLQEDFNJURXQGOLYHUFLUUKRVLVZLWK*G(2%'73$ HQKDQFHG705," < 3DUN&/HH..LP-&KRL-/HH&3DUN6HRXO.5 S\V #QDYHUFRP 3XUSRVH 7 R UHWURVSHFWLYHO\ GHWHUPLQH WKH VLJQLÀFDQW 05, IHDWXUHV IRU WKH GLI IHUHQWLDWLRQRILQÀOWUDWLYHKHSDWRFHOOXODUFDUFLQRPD+&&IURPFRQÁXHQWÀEURVLV LQOLYHUFLUUKRVLV 0HWKRGVDQG0DWHULDOV $IWHUVHDUFKRISDWKRORJLFDQGUDGLRORJLFGDWDEDVHVRI LQÀOWUDWLYH+&&DQGRIFRQÁXHQWÀEURVLVHYDOXDWHGZLWK*G(2%'73$HQKDQFHG 705,IURPWRZHUHUHYLHZHG7ZRUDGLRORJLVWVUHWURVSHFWLYHO\UHYLHZHG 05LPDJHVLQFRQVHQVXVIRUPRUSKRORJLFFKDQJHVLJQDOLQWHQVLW\HQKDQFHPHQW SDWWHUQDSSDUHQWGLIIXVLRQFRHIÀFLHQW$'&YDOXHDQGSUHVHQFHRISRUWDOYHLQ WKURPERVLVGXFWGLODWDWLRQDQGPHWDVWDWLFO\PSKQRGH&OLQLFDOÀQGLQJVVXFKDV WXPRXUPDUNHUDQGV\PSWRPDOVRZHUHUHFRUGHG8QLYDULDWHDQDO\VHVZHUHXVHG WRGLIIHUHQWLDWHWKHVHHQWLWLHV 5HVXOWV $OOLQÀOWUDWLYH+&&VKRZHGSUHVHUYDWLRQRIFRQWRXURUFRQWRXUEXOJLQJDQG DOOFRQÁXHQWÀEURVLVVKRZHGFDSVXODUUHWUDFWLRQ,QÀOWUDWLYH+&&PDQLIHVWHGDUWHULDO HQKDQFHPHQW DQG SRUWDO YHLQ WKURPERVLV &RQÁXHQW ÀEURVLV DS SHDUHGGHOD\HGHQKDQFHPHQW $'&ZDVVLJQLÀFDQWO\ORZHULQLQÀOWUDWLYH+&& 6FLHQWLILF6HVVLRQ $ 6&'()*+%(XURSHDQ&RQJUHVVRI 5DGLRORJ\ )ULGD\ IV9,%(7Z')/$6+7Z'LQDQGRSSRVHGSKDVH7UXH),63DQG 7Z76(4XDOLWDWLYHLPDJHDQDO\VLVZDVSHUIRUPHGXVLQJDIRXUSRLQWVFDOH QRQGLDJQRVWLFWR H[FHOOHQWLPDJHTXDOLW\UHJDUGLQJRYHUDOOLPDJHTXDOLW\ GHOLQHDWLRQRIDEGRPLQDOYDVFXODWXUHGHOLQHDWLRQRIWKHELOLDU\GXFWV\VWHPDV ZHOODVLPDJHLPSDLUPHQWGXHWRDUWHIDFWV)RUFRUUHODWLRQRIVLJQDOLQWHQVLWLHV UHJLRQVRILQWHUHVWZHUHSODFHGLQSDUHQFK\PDWRXVRUJDQV)RUVWDWLVWLFDODQDO\VLV D:LOFR[RQUDQNWHVWZDVXVHG 5HVXOWV:LWKLQFUHDVLQJPDJQHWLFÀHOGVWUHQJWKDOOVHTXHQFHVFRXOGEHREWDLQHG DW KLJKHU VSDWLDO UHVROXWLRQ DW HTXLYDOHQW DFTXLVLWLRQ WLPHV :KLOH RYHUDOO LPDJH TXDOLW\ZDVUDWHGFRPSDUDEO\KLJKIRU7ZLPDJLQJLQDOOWKUHHÀHOGVWUHQJWKV7 7Z05,VKRZHGLWVVXSHULRULW\LQWKHDVVHVVPHQWRIQRQHQKDQFHGDEGRPLQDO YDVFXODWXUH PHDQ 7 PHDQ 7 PHDQ7 4XDQWLWDWLYH DQDO\VLV UHYHDOHGDQDYHUDJHLQFUHDVHRIWKHPHDQRUJDQVLJQDOIURP7WR7RI DQGIURP7WR7 &RQFOXVLRQ2XUUHVXOWVGHPRQVWUDWHWKHEHQHÀWVDQGWKHOLPLWDWLRQVRIDQLQFUHDVH RIWKHPDJQHWLFÀHOGVWUHQJWKRIIHULQJLPSURYHGDQGKLJKO\GHWDLOHGGHOLQHDWLRQRI DQDWRPLFDODQGYDVFXODUVWUXFWXUHVLQ7ZLPDJLQJ % ,PSOHPHQWDWLRQRIGXDOVRXUFH5)H[FLWDWLRQWHFKQLTXHVZLWK 7LPDJLQJV\VWHPVDOORZVIRUQHDUO\LGHQWLFDO$'&YDOXHVLQ FRPSDULVRQWR705VFDQQHUVZKHQLPDJLQJWKHDEGRPHQ 3 5LIIHO 55DR00H\HU3 .HWWQDFNHU$/HPNH6+DQHGHU 626FK|QEHUJ+-0LFKDHO\0DQQKHLP'(*DOYHVWRQ7;86 3XUSRVH7 RUHWURVSHFWLYHO\DQGSURVSHFWLYHO\FRPSDUHDSSDUHQWGLIIXVLRQFRHI ÀFLHQW$'&YDOXHVREWDLQHGZLWKLQFOLQLFDOO\UHOHYDQWDEGRPLQDOUHJLRQVLQD 7 V\VWHP DQG 7 V\VWHPV ZLWK DQG ZLWKRXW GXDO VRXUFH SDUDOOHO5) H[FLWDWLRQ WHFKQLTXHV 0HWKRGVDQG0DWHULDOV'LIIXVLRQZHLJKWHGLPDJHVRIWKHDEGRPHQZHUHREWDLQHG RQWKUHHGLIIHUHQW05V\VWHPV7 ÀUVWJHQHUDWLRQ7 DQGVHFRQGJHQHUDWLRQ 7ZKLFKLQFRUSRUDWHVGXDOVRXUFHSDUDOOHO5)H[FLWDWLRQRQSDWLHQWVUHWUR VSHFWLYHO\DQGYROXQWHHUVSURVSHFWLYHO\6HYHQUHJLRQVRILQWHUHVW52,ZHUH VHOHFWHGWRUHSUHVHQWDUHDVRIFOLQLFDOVLJQLÀFDQFH 5HVXOWV,QWKHSDWLHQWSRSXODWLRQWKHGLIIHUHQFHVLQPHDQ$'&YDOXHVEHWZHHQ ÀUVWJHQHUDWLRQ7DQGWKHRWKHUWZR05VFDQQHUVUDQJHGIURPNLGQH\VXS WRLQWKHOHIWOREHRIWKHOLYHU7 [VPPÀUVWJHQHUDWLRQ7 [VPPVHFRQGJHQHUDWLRQ7 [VPP7KH$'&YDOXHV PHDVXUHG EHWZHHQ WKH 7 DQG VHFRQG JHQHUDWLRQ 7 V\VWHPV ZHUH QHDUO\ LGHQWLFDOZLWKQRVLJQLÀFDQWGLIIHUHQFHVEHWZHHQWKHWZRV\VWHPV,QWKHYROXQWHHU SRSXODWLRQFRUUHODWLRQEHWZHHQ7DQGVHFRQGJHQHUDWLRQ7V\VWHPVLQWKH NLGQH\VUDQJHGIURPU DQGLQWKHUHPDLQLQJUHJLRQVEHVLGHVWKHVSOHHQ U!7KHPHDQ$'&YDOXHVIURPPRVWDQDWRPLFDOGLVWULEXWLRQVREWDLQHGZLWK WKHÀUVWJHQHUDWLRQ7VFDQQHUGLVDJUHHGZLWKWKHRWKHUWZRVFDQQHUV &RQFOXVLRQ$VHFRQGJHQHUDWLRQ7VFDQQHUZKLFKLQFRUSRUDWHVGXDOVRXUFH SDUDOOHO5)H[FLWDWLRQSURYLGHVQHDUO\LGHQWLFDO$'&YDOXHVFRPSDUHGZLWKWKH 7LPDJLQJV\VWHPLQDEGRPLQDOLPDJLQJ % (YDOXDWLRQRI77 DQG7UHOD[DWLRQWLPHVLQ\RXQJDQGDJLQJUDW OLYHUDW7 56HLGHO.0DWWKHV$0XHOOHU$%XHFNHU3 )ULHV +RPEXUJ'(GUURODQGVHLGHO#VFKODXFRP 3XUSRVH7 R DVVHVV77 DQG7 UHOD[DWLRQ WLPHV LQ KHDOWK\ UDW OLYHU DW 7LQYLYRDQGWRFRUUHODWHWKHLQÁXHQFLQJHIIHFWRIDJLQJIRUGHWHUPLQDWLRQRIDQ H[SHULPHQWDOVWDQGDUG 0HWKRGVDQG0DWHULDOV,Q:$*5LMUDWVRIGLIIHUHQWDJHJURXSVJURXS 1 DJHRIZHHNVJURXS1 DJHRI\HDUVOLYHU05,ZDVSHUIRUPHGRQ D705DQLPDOVFDQQHU%UXNHU%LR6SHF*HUPDQ\XVLQJFKDQQHOYROXPH FRLO$5$5(VHTXHQFHZLWKIRXUGLIIHUHQWUHSHWLWLRQDQGHFKRWLPHVZDVDFTXLUHG IRU7UHOD[DWLRQWLPHPHDVXUHPHQW7 UHOD[DWLRQWLPHZDVPHDVXUHGE\DPXOWL JUDGLHQWHFKR0*(VHTXHQFH $PXOWLVOLFHPXOWLSOHHFKRVHTXHQFH060(ZDV XVHGIRU7UHOD[DWLRQWLPHPHDVXUHPHQW7DQG7PDSSLQJZDVSHUIRUPHGZLWK DQLPDJHVHTXHQFHDQDO\VLVWRRO$VWXGHQWWWHVWDQG0DQQ:KLWQH\UDQNVXP WHVWZHUHSHUIRUPHGIRUVWDWLVWLFDODQDO\VLVS 5HVXOWV7KHDQLPDOJURXSVGLIIHUHGVWDWLVWLFDOO\VLJQLÀFDQWUHJDUGLQJDOOLQYHVWLJDWHG UHOD[DWLRQFKDUDFWHULVWLFV0HDQ7UHOD[DWLRQWLPHIRUJURXSZDVPV6' DQGIRUJURXSPV6'S 0HDQ7 UHOD[DWLRQWLPH IRUJURXSZDVPV6'DQGJURXSPV6'S 0HDQ7UHOD[DWLRQWLPHIRUJURXSZDVPV6'DQGJURXSPV 6'S % /LYHULQWUDYR[HOLQFRKHUHQWPRWLRQLPDJLQJDW7 FRPSDULVRQZLWK FRQYHQWLRQDOGXDOEYDOXHVPHWKRG %/HSRUT) 3LOOHXO2%HXI9LOOHXUEDQQH)5 EHQMDPLQOHSRUT#FUHDWLVLQVDO\RQIU 3XUSRVH 7 R UHSRUW RXU H[SHULHQFH DERXW LQWUDYR[HO LQFRKHUHQW PRWLRQ ,9,0 LPDJLQJRQKXPDQOLYHUDQGSKDQWRPWRFRPSDUHWKHELH[SRQHQWLDOGLIIXVLRQSDW WHUQZLWKWKHFRQYHQWLRQDOGXDOEYDOXHV$'&PHWKRG 0HWKRGVDQG0DWHULDOV$FTXLVLWLRQVZHUHSHUIRUPHGDW7 LQIUHHEUHDWKLQJ RQÀIWHHQKHDOWK\YROXQWHHUVWKHQRQDGRSHGDJDUJHOSKDQWRPXVLQJH':, VHTXHQFH*(+&3DUDPHWHUVZHUHEYDOXHV VPPPV75PV7(D[LDOVOLFHVðPPò)29 ðPDWUL[PPVOLFHWKLFNQHVV1(;N+]EDQGZLGWK7KUHHSHUSHQ GLFXODUGLIIXVLRQJUDGLHQWVZHUHDSSOLHGVLPXOWDQHRXVO\3XUHPROHFXODUGLIIXVLRQ FRHIÀFLHQW'VORZSHUIXVLRQUHODWHGFRHIÀFLHQW'IDVWDQGSHUIXVLRQIUDFWLRQI ZHUHREWDLQHGE\DQRQOLQHDUOHDVWVTXDUHÀWWRWKHELH[SRQHQWLDO,9,0PRGHO $'&ZDVFRPSXWHGXVLQJFRQYHQWLRQDOPRQRH[SRQHQWLDOPHWKRGZLWKWZRSDLU RIEYDOXHVDQG 5HVXOWV 0HDQ ,9,0 SDUDPHWHUV ZHUH '6ORZ ð PPVò ')DVW ðPPVòI PHDQ $'&ZDV' ð PPVò$VWURQJFRUUHODWLRQZDVIRXQGEHWZHHQDEVROXWH''6ORZYDOXHDQG SHUIXVLRQ IUDFWLRQ 3HDUVRQ V FRHIÀFLHQW S %LDV EHWZHHQ ' DQG '6ORZLQFUHDVHGZKHQ]HUREYDOXHZDVXVHGIRU$'&TXDQWLÀFDWLRQDQG IRU VPP DQG VPP UHVSHFWLYHO\ 4XDQWLÀFDWLRQ IURP SKDQWRPDFTXLVLWLRQJDYHWKHVDPHYDOXHVIRU'DQG'6ORZðPPV DQGGLIIXVLRQIROORZHGDVLPSOHPRQRH[SRQHQWLDOSDWWHUQ &RQFOXVLRQ7KHELH[SRQHQWLDOSDWWHUQRIGLIIXVLRQHQFRXQWHUHGLQOLYHUZDVOLQNHG WRSHUIXVLRQUHODWHGGLIIXVLRQDQGH[SODLQHGWKHELDVEHWZHHQ $'&PHDVXUHGZLWK PRQRH[SRQHQWLDO DSSURDFK DQG SXUH PROHFXODU GLIIXVLRQ FRHIÀFLHQW H[WUDFWHG IURP ,9,0 PRGHOLQJ 'XDO EYDOXHV PHWKRG IRU$'& PHDVXUHPHQW FRXOG EH DQ DOWHUQDWLYHPHWKRGWRDVVHVVWKH'6ORZFRPSRQHQWFKRRVLQJDSSURSULDWHSDLURI EYDOXHV! % $SSDUHQWGLIIXVLRQFRHIÀFLHQWYDOXHVRIKHDOWK\SDQFUHDVIURP GLIIXVLRQZHLJKWHGLPDJLQJRIXSSHUDEGRPHQDW7 &0D&3DQ+=KDQJ+:DQJ-:DQJ6&KHQ-/X6KDQJKDL&1 PHQJTLKL#JPDLOFRP 3XUSRVH 7 R FODULI\ WKH DSSDUHQW GLIIXVLRQ FRHIÀFLHQW $'& YDOXHV LQ GLIIHUHQW DQDWRPLFDOUHJLRQVKHDGQHFNERG\DQGWDLORIQRUPDOSDQFUHDV 0HWKRGV DQG 0DWHULDOV7KH VWXG\ VXEMHFWV FRPSULVHG SDWLHQWV ZLWK FRQ ÀUPHGKHDOWK\SDQFUHDV(FKRSODQDUGLIIXVLRQZHLJKWHGLPDJLQJ':,RIXSSHU DEGRPHQZDVSHUIRUPHGE\DSSO\LQJWZREYDOXHVRIDQGVPPDWD7 PDJQHWLFUHVRQDQFHLPDJLQJ05,V\VWHP$'&YDOXHVZHUHREWDLQHGLQ YDULRXVUHJLRQVRISDQFUHDV'HSHQGHQF\RI$'&RQWKHDQDWRPLFDOUHJLRQVZDV DQDO\VHGXVLQJ.UXVNDO:DOOLVWHVWDQG:LOFR[RQVLJQUDQNWHVW 5HVXOWV7KHPHDQ$'&YDOXHRIWKHZKROHKHDOWK\SDQFUHDVLVð PPV7KHUHVXOWVRI.UXVNDO:DOOLVWHVWVKRZHGDVLJQLÀFDQWGLIIHUHQFHRIWKH $'&YDOXHVDPRQJWKHDQDWRPLFDOUHJLRQVDQGWKHORZHVWYDOXHVZHUHREWDLQHG LQWKHSDQFUHDWLFKHDGKHDGQHFNERG\DQGWDLO ðPPV&KLVTXDUH 'I 37KHUHVXOWVRI :LOFR[RQVLJQUDQNWHVWVKRZHGWKHPHDQ $'&VGLIIHUHGUHPDUNDEO\EHWZHHQKHDG DQGQHFN3KHDGDQGERG\3KHDGDQGWDLO3 QHFNDQGWDLO3 ERG\DQGWDLO3UHVSHFWLYHO\EXWWKH PHDQ$'&VRIQHFNDQGERG\3 !VKRZHGQRVLJQLÀFDQWGLIIHUHQFH &RQFOXVLRQ7KHPHDQ $'&YDOXHVRIQRUPDOSDQFUHDVYDULHGVLJQLÀFDQWO\ZLWKLQ WKHGLIIHUHQWDQDWRPLFDOUHJLRQV7KHUHIRUHLWLVQHFHVVDU\WRXWLOLVHWKHVHUHVXOWV LQUHODWHGVWXGLHVRUFOLQLFDODSSOLFDWLRQVIRUGLIIHUHQWLDWLQJEHWZHHQGLIIHUHQWSDQ FUHDWLFGLVHDVHV % 7HVODYV7HVODYHUVXV7HVODDEGRPLQDO05,WKHPRUH7HVOD WKHEHWWHU" /8PXWOX2.UDII$)LVFKHU0)RUVWLQJ0(/DGG60DGHUZDOG 7 &/DXHQVWHLQ(VVHQ'(/DOH8PXWOX#XNHVVHQGH 3XUSRVH7KH DLP RI RXU VWXG\ ZDV WR LQYHVWLJDWH DQG FRPSDUH WKH GLDJQRVWLF DELOLW\RIDQG7 HVODDEGRPLQDO05, 0HWKRGVDQG0DWHULDOVKHDOWK\YROXQWHHUVZHUHHDFKH[DPLQHGRQD7 0DJQHWRP$HUDD70DJQHWRP6N\UDDQGD705V\VWHP0DJQHWRP7 6LHPHQV7KHIROORZLQJVHTXHQFHVZHUHREWDLQHG7ZIV')/$6+7Z 6FLHQWLILF6HVVLRQ 6 &$' ( ) *+% (XURSHDQ&RQJUHVVRI 5DGLRORJ\ LQDQGS2YHUDOOSDWKRORJLFFRQÀUPDWLRQRI PDOLJQDQF\ZDVUHVSHFWLYHO\DQGLQVXUJLFDOVSHFLPHQV &RQFOXVLRQ '%7 FRPELQHG ZLWK '0 DQG 86 LPSURYHG FRQYHQWLRQDO LPDJLQJ DFFXUDF\ EXW 05, VWLOO VKRZHG WKH KLJKHVW VHQVLWLYLW\ LQ GHWHFWLQJ DQG VWDJLQJ EUHDVWFDQFHU % 7KHUROHRIEUHDVWWRPRV\QWKHVLVFRPELQHGZLWKGLJLWDOPDPPRJUDSK\ 3 0DUWtQH]$*DUFLD/DOODQD56DLQ]0HQGLJXUHQ&0LQJXLOORQ/3LQD =DUDJR]D(63DPSORQD(6SDXODPDUWLQH]PLUDYHWH#\DKRRHV 3XUSRVH7 RHYDOXDWHWKHGHWHFWLRQUDWHRIEUHDVWFDQFHUXVLQJGLJLWDOWRPRV\QWKHVLV DVDQDGGLWLRQDOWRROFRPELQHGZLWKGLJLWDOPDPPRJUDSK\LQ $&5GHQVLW\SDWWHUQV DQGLQDFOLQLFDOVHWWLQJ 0HWKRGVDQG0DWHULDOV5HWURVSHFWLYHVWXG\)URP'HFHPEHUWR$XJXVW &RPERVWXGLHV'GLJLWDOPDPPRJUDSK\SOXVWRPRV\QWKHVLVZHUH SHUIRUPHGLQ$&5GHQVLW\SDWWHUQVDQGWRHYDOXDWHWKHUROHRIWKHWRPRV\Q WKHVLVLQWKHGHWHFWLRQRIDGGLWLRQDOFDQFHUV6WDWLVWLFDODQDO\VLVZDVSHUIRUPHG FDOFXODWLQJWKH3HDUVRQ&KLVTXDUHWHVWDQGXVLQJWKH6366VRIWZDUH 5HVXOWVEUHDVWWXPRXUVZHUHGHWHFWHGRQFRQYHQWLRQDOGLJLWDOPDPPRJUDSK\ GHWHFWLRQUDWH7KLUW\RQHDGGLWLRQDOFDQFHUVZHUHGHWHFWHGRQWRPRV\Q WKHVLVDQGQRWVHHQRQVWDQGDUGPDPPRJUDPVFDVHVRQ$&5WKHGHWHFWLRQ UDWHZDVLQFUHDVHGFDVHVLQ$&5DQGFDVHVLQ$&5 1RVWDWLVWLFDOGLIIHUHQFHVZHUHIRXQGLQWKHGHWHFWLRQUDWHDPRQJWKH WKUHHSDWWHUQVS 7 RPRV\QWKHVLVLQFUHDVHGWKHGHWHFWLRQUDWHVR WKHWRWDOGHWHFWLRQUDWHXVLQJWKHFRPERVWXGLHVZDV &RQFOXVLRQ7KH DGGLWLRQ RI GLJLWDO WRPRV\QWKHVLV LQFUHDVHV WKH GHWHFWLRQUDWH IURPWR7KHUHDUHQRWVLJQLÀFDQWGLIIHUHQFHVDPRQJWKHWKUHH$&5 GHQVLW\SDWWHUQVVRWRPRV\QWKHVLVFDQEHXVHIXOQRWRQO\LQGHQVHSDWWHUQVEXW DOVRLQSDWWHUQ % 5ROHRIEUHDVWWRPRV\QWKHVLVLQWKHPRUSKRORJLFDODQDO\VLVRI EUHDVWOHVLRQV %5DJKDYDQ05DMPRKDQ*6LYDUDPDOLQJDP&KHQQDL,1 GUEDJ\DP#JPDLOFRP 3XUSRVH7 RDVVHVVWKHUROHRIEUHDVWWRPRV\QWKHVLVE\'FRPERYLHZYHUVXV 'IXOOÀHOGGLJLWDOPDPPRJUDPDORQHLQWKHPRUSKRORJLFDODQDO\VLVRIEUHDVWOH VLRQV7 RHYDOXDWHWKHSRWHQWLDOUROHRIWRPRV\QWKHVLVLQ%,5$'6FDWHJRULVDWLRQ DQGÀQDOKLVWRSDWKRORJ\ 0HWKRGVDQG0DWHULDOV3DWLHQWVZKRZHUHUHIHUUHGWRRXUGHSDUWPHQWIRUPDP PRJUDPIURP0D\SDWLHQWVXQGHUZHQWIXOOÀHOGGLJLWDOPDPPRJUDPDQG 'WRPRV\QWKHVLVFRPELQHGYLHZ&UDQLRFDXGDODQGPHGLRODWHUDOREOLTXHYLHZVRI ERWKEUHDVWVZHUHDFTXLUHGIRUDOOSDWLHQWV2IWKHVHRXUVWXG\SRSXODWLRQLQFOXGHV SDWLHQWVZLWKDEQRUPDO'GLJLWDOPDPPRJUDP'GLJLWDOPDPPRJUDPDQG 'WRPRV\QWKHVLVZHUHDQDO\VHGIRUWKHIROORZLQJIHDWXUHVPDVVPDUJLQVFDOFLÀ FDWLRQDV\PPHWULFGHQVLW\IRFDODV\PPHWU\DQGDUFKLWHFWXUDOGLVWRUWLRQ)ROORZLQJ WKHPDPPRJUDPDOOSDWLHQWVZHUHVXEMHFWHGWRXOWUDVRXQGDQGLPDJHJXLGHGIQDF RUWUXFXWFRUHWLVVXHELRSV\IRUFRUUHODWLRQ6WDWLVWLFDODQDO\VLVZDVGRQHWRHYDOX DWHWKHSHUIRUPDQFHRIWRPRV\QWKHVLVYHUVXV'GLJLWDOPDPPRJUDPLQWHUPVRI PRUSKRORJ\%,5$'6FDWHJRULVDWLRQDQGKLVWRSDWKRORJ\ 5HVXOWV7KHUHZDVVLJQLÀFDQWGLIIHUHQFHEHWZHHQ'DQGWRPRIRUIHDWXUHDQDO\VLV SDQGIRU%,5$'6VLJQLÀFDQWGLIIHUHQFHSZDVIRXQGEHWZHHQ 'DQG86*ÀQDODQGQRVLJQLÀFDQWGLIIHUHQFHSZDVIRXQGEHWZHHQ' DQG86*ÀQDO &RQFOXVLRQ7 RPRV\QWKHVLVZDVXVHIXOLQPDMRULW\RISDWLHQWVLQWHUPVRIOHVLRQ FRQVSLFXLW\DQGIHDWXUHDQDO\VLV,WDSSUR[LPDWHGWKHÀQDO%,5$'6DIWHUXOWUDVRXQG DQG+3(EHWWHUWKDQ'GLJLWDOPDPPRJUDPDORQH % 'RHVFRPELQLQJ'EUHDVWWRPRV\QWKHVLVZLWKGLJLWDO PDPPRJUDSK\LPSURYHGLDJQRVWLFDFFXUDF\" 1+6DLG+$ERO0DJG00RNKWDU/%DVVDP6:DKHHG'6DOHP $6HOLP&DLUR(*QRUUDQKXVVHLQ#\DKRRFRP 3XUSRVH7 RDVVHVVWKHYDOXHRIDGGLQJ'EUHDVWWRPRV\QWKHVLV%7WRIXOOÀHOG GLJLWDOPDPPRJUDSK\'0IRULPSURYLQJOHVLRQYLVLELOLW\DQG%,5$'6DVVHVVPHQW LQUHODWLRQWRSDWKRORJLFDORXWFRPHV 0HWKRGVDQG0DWHULDOVFDVHVZHUHHYDOXDWHGZLWK'0DQG%7LQDGHGLFDWHG EUHDVWLPDJLQJXQLWZLWKGLDJQRVWLFDQGVFUHHQLQJVHUYLFHV%RWK'0DQG%7ZHUH SHUIRUPHGLQFUDQLRFDXGDODQGPHGLRODWHUDOREOLTXHYLHZVLQGLIIHUHQWH[SRVXUHV XVLQJDVLHPHQVPDPPRPDWLQVSLUDWLRQXQLW(YDOXDWLRQDQG%,5$'6VFRULQJZDV &RQFOXVLRQ $W7OLYHUUHOD[DWLRQFKDUDFWHULVWLFVLQUDWOLYHUYDU\ZLWKWKHDJHRI WKHDQLPDODVDFRQVHTXHQFHRIWLVVXHWUDQVIRUPDWLRQDQGKDYHWREHFRQVLGHUHG LQH[SHULPHQWDOVHWWLQJV 5RRP) %UHDVW 66 7RPRV\QWKHVLVDQG))'0 0RGHUDWRUV 00LFKHOO/RQGRQ8. (6LRSLV%RORJQD,7 % 6SHFLÀFLW\GLJLWDOEUHDVWWRPRV\QWKHVLVYHUVXVPDPPRJUDSK\ **HQQDUR(%H]]RQ(%DOGDQ5&KHUVHYDQL&GL0DJJLR 0/D*UDVVD/3HVFDULQL,3ROLFR$3URLHWWL3DGXD,7*RUL]LD,7 $YLDQR,7JLVHOODJHQQDUR#LRYHQHWRLW 3XUSRVH 7 R DQDO\VH WKH LPSDFW RI EUHDVW WRPRV\QWKHVLV '%7 RQ VSHFLÀFLW\ FRPSDUHGWRVWDQGDUGGLJLWDOPDPPRJUDSK\0; 0HWKRGVDQG0DWHULDOV7KHVWXG\LQFOXGHGFRQVHQWLQJZRPHQZLWKEUHDVW OHVLRQVFODVVLÀHGDVVXVSLFLRXVDWPDPPRJUDSK\DQGRUXOWUDVRXQG $UHDGHUVWXG\ FRPSDULQJWZRYLHZ&&0/2PDPPRJUDSK\RQHYLHZ0/2WRPRV\QWKHVLV DQGWKHFRPELQDWLRQRI'%7DQG0;&&YLHZ'%70;&&ZDVFRQGXFWHGZLWK VL[EUHDVWUDGLRORJLVWVDQGDVDPSOHRIEUHDVWV0HDQDUHDXQGHUWKHUHFHLYHU RSHUDWLQJFKDUDFWHULVWLFVFXUYHVVHQVLWLYLW\DQGVSHFLÀFLW\ZHUHFDOFXODWHGIRUHDFK PRGDOLW\E\DYHUDJLQJUHVXOWVDFURVVWKHUHDGHUV6SHFLÀFLW\DQDO\VLVLVSUHVHQWHG KHUHUHÀQHGVHSDUDWHO\IRUWKHWZRVXEVHWVRIQRUPDOEUHDVWVDQGEUHDVWV ZLWKEHQLJQOHVLRQV 5HVXOWV2YHUDOOPHDQVSHFLÀFLW\ZDVVLJQLÀFDQWO\KLJKHUZLWK'%7WKDQ0; YVS ZKLOHWKHFRPELQHGSURWRFROOHGWRKLJKHUVSHFLÀFLW\QRWVLJ QLÀFDQWO\WKDQ0;EXWVOLJKWO\ORZHUWKDQ'%7DORQH'%70;&&7KH SURSRUWLRQRIEHQLJQOHVLRQVFRUUHFWO\VFRUHGZLWKWRPRV\QWKHVLVHLWKHURQHYLHZ RUZLWKWKHDGGLWLRQRI0;&&ZDVVLJQLÀFDQWO\KLJKHUWKDQVWDQGDUGPDPPRJUD SK\0;'%7 '%70;&&SYDOXH'%7YV0; SYDOXH'%70;FFYV0; 7KHSURSRUWLRQRIQRUPDOEUHDVWVFRUUHFWO\ DVVHVVHGZDVVLPLODUZLWK0;DQG'%7YVSYDOXH ZLWK DVPDOOGHFUHDVHZLWKWKHFRPELQHGSURWRFRO &RQFOXVLRQ7 RPRV\QWKHVLVVLJQLÀFDQWO\LQFUHDVHGVSHFLÀFLW\FRPSDUHGWRGLJLWDO PDPPRJUDSK\0RUHLQGHWDLO'%7VLJQLÀFDQWO\LPSURYHGFDSDELOLW\LQFKDUDFWHULV LQJEHQLJQOHVLRQVUHGXFLQJWKHQXPEHURIIDOVHSRVLWLYHV % 05,LQWKHSUHRSHUDWLYHEUHDVWFDQFHUVWDJLQJEHIRUHDQGDIWHUWKH LQWURGXFWLRQRIGLJLWDOEUHDVWWRPRV\QWKHVLV'%7KDVDQ\WKLQJFKDQJHG" -*LJOLR**KLRQH(5HJLQL0'XUDQGR$/XSDULD0&(DQGL 3 3 &DPSDQLQR*0DULVFRWWL**DQGLQL7XULQ,7MDFRSRJLJOLR#JPDLOFRP 3XUSRVH7 RFRPSDUHWKHGLDJQRVWLFDFFXUDF\RI05,DQGFRQYHQWLRQDOLPDJLQJ WHFKQLTXHV GLJLWDO PDPPRJUDSK\ >'0@ DQG XOWUDVRXQG >86@ FRPELQHG RU QRW ZLWK'%7LQSUHRSHUDWLYHEUHDVWFDQFHUDVVHVVPHQWDQGWRGHWHUPLQHWKHHIIHFWV RQVXUJLFDOWUHDWPHQW 0HWKRGV DQG 0DWHULDOV :H UHWURVSHFWLYHO\ UHYLHZHG QHZO\ GLDJQRVHG EUHDVW FDQFHU SDWLHQWV RSHUDWHG EUHDVWV ZKR XQGHUZHQW SUHRSHUDWLYH FRQYHQWLRQDOLPDJLQJPRGDOLWLHVDQG05,EHWZHHQ-DQXDU\DQG-XQH 7KHSDWLHQWVZHUHGLYLGHGLQWRWZRJURXSVWKRVHZKRKDG'%7LQDGGLWLRQWR'0 DQG 86 JURXS RSHUDWHG EUHDVWV DQG WKRVH ZKR GLGQRW XQGHUJR '%7JURXSRSHUDWHGEUHDVWV6WDWLVWLFDODQDO\VHVZHUHSHUIRUPHG WRFRPSDUHWKHGLDJQRVWLFDFFXUDF\RILPDJLQJWHFKQLTXHVDQGWRHYDOXDWH05, LPSDFWRQVXUJLFDOPDQDJHPHQWLQWKHWZRJURXSV 5HVXOWV ,Q JURXS 05, RYHUDOO VHQVLWLYLW\ ZDV '0'%7 '0'%786SDQGLQJURXS'0'086 SIRUPXOWLIRFDOPXOWLFHQWULFOHVLRQVZDVUHVSHFWLYHO\'0'%7 '0'%786S!DQG'0'086S IRU FRQWURODWHUDO OHVLRQV ZDV LQ ERWK JURXSV JURXS'0'%7 '0'%786S*URXS'0'086S,QJURXS 05,VSHFLÀFLW\ZDV'0'%7 '0'%786S!DQGLQ JURXS'0'086S!3UHRSHUDWLYH05,FKDQJHG VXUJLFDOWUHDWPHQWLQLQJURXSDQGLQLQJURXS ZLWKDFRQYHUVLRQIURPEUHDVWFRQVHUYDWLYHVXUJHU\LQWRPDVWHFWRP\UHVSHFWLYHO\ 6FLHQWLILF6HVVLRQ $ 6&'()*+%(XURSHDQ&RQJUHVVRI 5DGLRORJ\ )ULGD\ &RQFOXVLRQ&RQYHUVLRQIURPDQDORJXHWRGLJLWDOVFUHHQLQJPDPPRJUDSK\UHVXOWHG LQDGUDPDWLFDOO\LQFUHDVHG6&1%UDWHZLWKDFRQFRPLWDQWLQFUHDVHG'&,6GHWHF WLRQ2YHUGLDJQRVLVRIEUHDVWFDQFHULVPRUHSURIRXQGDWGLJLWDOWKDQDWDQDORJXH VFUHHQLQJPDPPRJUDSK\ % &RQYHUVLRQIURPDQDORJXHWRGLJLWDOVFUHHQLQJPDPPRJUDSK\ UHVXOWVLQDPRUHIDYRUDEOHWXPRXUVWDJHDQGWXPRXUELRORJ\RI VFUHHQGHWHFWHGFDQFHUV -1HGHUHQG 0:-/RXZPDQ-+*URHQHZRXG$&9RRJG/(0'XLMP (LQGKRYHQ1/5RWWHUGDP1/0DDVWULFKW1/MRRVWQHGHUHQG#JPDLOFRP 3XUSRVH7 RGHWHUPLQHWKHLPSDFWRIFRQYHUVLRQIURPDQDORJXHWRGLJLWDOVFUHHQLQJ PDPPRJUDSK\RQWXPRXUVWDJHDQGWXPRXUELRORJ\RIVFUHHQGHWHFWHGFDQFHUV 0HWKRGV DQG 0DWHULDOV :H LQFOXGHG D FRQVHFXWLYH VHULHV RI DQDORJXH DQGGLJLWDOVFUHHQLQJPDPPRJUDPVREWDLQHGDWD'XWFKEUHDVWVFUHHQLQJ UHJLRQEHWZHHQUHVSHFWLYHO\-DQXDU\-XO\DQG-XO\-DQXDU\ 7XPRXU VWDJH DQG ELRORJ\ FKDUDFWHULVWLFV ZHUH GHWHUPLQHG IRU VFUHHQGHWHFWHG FDQFHUV 5HVXOWV7KHRYHUDOOFDQFHUGHWHFWLRQUDWHZDVSHUVFUHHQHG ZRPHQDWGLJLWDOVFUHHQLQJLQYDVLYHFDQFHUVDQGGXFWDOFDUFLQRPDVLQVLWX '&,6FRPSDUHGWRDWDQDORJXHVFUHHQLQJLQYDVLYHFDQFHUV DQG'&,6S7KHSURSRUWLRQRIDGYDQFHGFDQFHUVGHÀQHGDV7DQG RUO\PSKQRGHSRVLWLYHFDQFHUVZDVVLJQLÀFDQWO\ORZHUDWGLJLWDOVFUHHQLQJ YHUVXVSEXWWXPRXUVL]HHLWKHU7DFRU7RILQYDVLYHFDQFHUV ZDVFRPSDUDEOHWRWKRVHGHWHFWHGDWDQDORJXHVFUHHQLQJS $WGLJLWDOVFUHHQ LQJVLJQLÀFDQWO\IHZHULQYDVLYHFDQFHUVVKRZHGO\PSKQRGHPHWDVWDVLV YHUVXVS 7XPRXUKLVWRORJ\RILQYDVLYHFDQFHUV HLWKHU GXFWDO RU OREXODU FDQFHU ZDV FRPSDUDEOH S EXW LQYDVLYH FDQFHUV GHWHFWHG DW GLJLWDO VFUHHQLQJ VKRZHG D PRUH IDYRXUDEOH 1RWWLQJKDP JUDGDWLRQ S 3URSRUWLRQVRIHVWURJHQUHFHSWRUSRVLWLYHRU+HU1HXUHFHSWRUSRVLWLYH LQYDVLYHFDQFHUVZHUHVLPLODUS DQGS UHVSHFWLYHO\EXWWKHSURSRUWLRQ RISURJHVWHURQUHFHSWRUSRVLWLYHLQYDVLYHFDQFHUVZDVODUJHUDWGLJLWDOVFUHHQLQJ YHUVXVS &RQFOXVLRQ5HSODFHPHQWRIDQDORJXHVFUHHQLQJPDPPRJUDSK\E\GLJLWDOVFUHHQ LQJ PDPPRJUDSK\ KDG D IDYRXUDEOH LPSDFW RQ ERWK WXPRXU VWDJH DQG WXPRXU ELRORJ\RIVFUHHQGHWHFWHGFDQFHUV % :KDWGRZHJDLQE\FKDQJLQJIURPVFUHHQÀOPWRIXOOÀHOGGLJLWDO PDPPRJUDSKLFVFUHHQLQJ" 6+RIYLQG &,/HH-*(OPRUH2VOR12/RV$QJHOHV&$86 6HDWWOH:$86VROYHLJKRIYLQG#NUHIWUHJLVWHUHWQR 3XUSRVH7 RDQDO\VHWKHHIIHFWRISULRUDQGFXUUHQWXVHRIVFUHHQÀOPPDPPRJUDSK\ 6)0DQGIXOOÀHOGGLJLWDOPDPPRJUDSK\))'0RQHDUO\RXWFRPHPHDVXUHVLQ VFUHHQLQJPDPPRJUDSK\ 0HWKRGV DQG 0DWHULDOV 'DWD IURP ZRPHQ DJHG \HDUV VFUHHQHG LQ WKH 1RUZHJLDQ%UHDVW&DQFHU6FUHHQLQJ3URJUDPPHEHWZHHQDQGZHUH LQFOXGHG LQ WKH VWXG\ 5HFDOO DQG GHWHFWLRQ UDWH DQG SRVLWLYHSUHGLFWLYH YDOXH IURPLQLWLDO6)0LQLWLDO))'06)0DIWHUDSULRU6)0 ))'0DIWHUDSULRU6)0DQG))'0DIWHUDSULRU))'0ZHUH DQDO\VHGXVLQJWZRVLGHG&KLVTXDUHWHVWV 5HVXOWV7KHUHFDOOUDWHZDVIRULQLWLDO))'0SDQGIRULQLWLDO 6)0S(LWKHUWKHGHWHFWLRQUDWHRI'&,6RU'&,6DQGLQYDVLYHGLIIHU VWDWLVWLFDOO\ VLJQLÀFDQW E\ LQLWLDO VFUHHQLQJ WHFKQLTXH ,Q VXEVHTXHQWO\ VFUHHQHG ZRPHQWKHUHFDOOUDWHZDVIRU6)0DIWHU6)0DQGIRU))'0DIWHU6)0 DQGIRU))'0SHUIRUPHGDIWHUDSULRU))'0S7KHGHWHFWLRQUDWH RI'&,6ZDVIRU6)0DIWHU6)0IRU))'0DIWHU6)0S DQG IRU ))'0 DIWHU ))'0 S 7KH UDWH RI LQYDVLYH FDQFHU ZDV IRU6)0DIWHU6)0IRU))'0DIWHU6)0S DQGIRU))'0 DIWHU))'0S7KHLQWHUYDOFDQFHUUDWHZDVIRU6)0DIWHU6)0 IRU))'0DIWHU6)0DQG))'0DIWHU))'0SIRUERWK &RQFOXVLRQ(DUO\RXWFRPHPHDVXUHVLQPDPPRJUDSKLFVFUHHQLQJVHHPWREH LQÁXHQFHGE\WKHSULRUDQGFXUUHQWVFUHHQLQJWHFKQLTXH JLYHQWR'0IROORZHGE\%7 $ÀQDO%,5$'6VFRUHFRQVLGHULQJERWKLQWHUSUHWDWLRQV DQGDQ\DGGLWLRQDOLQIRUPDWLRQE\XOWUDVRXQGZDVODWHUGHFLGHG 5HVXOWVRIFDVHVZHUHVFUHHQLQJDQGZHUHGLDJQRVWLF$FFRUGLQJ WRWKHÀQDODVVHVVPHQWFDWHJRULHVRIFDVHV ZHUHJLYHQD%,5$'6VFRUHRIUHVSHFWLYHO\$FFXUDF\33DQG33 RI'0DORQHZHUH2QDGGLQJ%7UHVXOWVZHUH UHVSHFWLYHO\$JUHHPHQWEHWZHHQ%7%,5$'6DQG)LQDO%,5$'6VFRUH ZDVNDSSD%HWZHHQ'0DQG)LQDO%,5$'6ZDV.DSSD %HWZHHQ%7DQG'0%,5$'6ZDV.DSSD5HJDUGLQJWKH FDQFHUVGHWHFWHGLQYHU\GHQVHEUHDVWVPRUHWKDQJODQGXODUWLVVXH'%7 FRXOGGLDJQRVHZKLOHRQO\ZHUHGLDJQRVHGE\'0%7DGGHGQHZ LQIRUPDWLRQLQRIFDVHVE\YLVXDOLVDWLRQRIPDUJLQVDQDO\VLVRIIRFDODV\PPHWU\ DQGGHWHFWLQJPXOWLIRFDOLW\PXOWLFHQWULFLW\RIFDQFHUV &RQFOXVLRQ$GGLQJ%7WR'0LPSURYHVDFFXUDF\RI%,5$'6FDWHJRULVDWLRQDQG UDGLRORJLFSDWKRORJLFFRUUHODWLRQ % 'XWFKGLJLWDOEUHDVWFDQFHUVFUHHQLQJLPSOLFDWLRQVIRUEUHDVWFDQFHUFDUH -7LPPHUV*GHQ+HHWHQ(0$GDQJ-'2WWHQ$/09HUEHHN 0-0%URHGHUV1LMPHJHQ1/$PVWHUGDP1/MWLPPHUV#OUFEQO 3XUSRVH ,Q FRPSDULVRQ WR RWKHU (XURSHDQ SRSXODWLRQEDVHG EUHDVW FDQFHU VFUHHQLQJSURJUDPPHVWKH'XWFKSURJUDPPHKDVDORZUHIHUUDOUDWHVLPLODUEUHDVW FDQFHUGHWHFWLRQDQGDKLJKEUHDVWFDQFHUPRUWDOLW\UHGXFWLRQ7KHUHIHUUDOUDWHLQ WKH1HWKHUODQGVKDVLQFUHDVHGRYHUWLPHDQGLVH[SHFWHGWRULVHIXUWKHUPDLQO\ IROORZLQJQDWLRQZLGHLQWURGXFWLRQRIGLJLWDOPDPPRJUDSK\7KLVVWXG\H[SORUHVWKH FRQVHTXHQFHVRIWKHLQWURGXFWLRQRIGLJLWDOPDPPRJUDSK\RQWKHEDODQFHEHWZHHQ UHIHUUDOUDWHGHWHFWLRQRIEUHDVWFDQFHUGLDJQRVWLFZRUNXSDQGDVVRFLDWHGFRVWV 0HWKRGVDQG0DWHULDOV'HWDLOHGLQIRUPDWLRQRQGLDJQRVWLFZRUNXSFKDUWUHYLHZ ZDVREWDLQHGIURPUHIHUUHGZRPHQQ LQDQDORJXHPDP PRJUDSK\DQGGLJLWDOPDPPRJUDSK\LQ1LMPHJHQWKH1HWKHUODQGV 5HVXOWV7KHDYHUDJHUHIHUUDOUDWHLQFUHDVHGIURPWRSHU ZRPHQVFUHHQHG7KHQXPEHURIEUHDVWFDQFHUVGHWHFWHGLQFUHDVHGIURP WRSHUVFUHHQVZKHUHDVWKHSRVLWLYHSUHGLFWLYHYDOXHIHOOIURP WR$VKDUSULVHLQGLDJQRVWLFZRUNXSSURFHGXUHVDQGWRWDOGLDJQRVWLFFRVWV ZDVVHHQ2QWKHRWKHUKDQGFRVWVRIDVLQJOHZRUNXSVOLJKWO\GHFUHDVHGDVOHVV VXUJLFDOELRSVLHVZHUHSHUIRUPHG &RQFOXVLRQ 2XU VWXG\ VKRZV WKDW D ORZ UHIHUUDO UDWH LQ FRPELQDWLRQ ZLWK WKH LQWURGXFWLRQRIGLJLWDOPDPPRJUDSK\DIIHFWVWKHEDODQFHEHWZHHQUHIHUUDOUDWHDQG GHWHFWLRQUDWHDQGFDQVXEVWDQWLDOO\LQÁXHQFHEUHDVWFDQFHUFDUHDQGDVVRFLDWHG FRVWV5HIHUUDOUDWHVLQWKH1HWKHUODQGVDUHQRZPRUHFRPSDUDEOHWRRWKHUFRXQWULHV 7KLVHIIHFWLVWKHUHIRUHRIYDOXHLQFRXQWULHVZKHUHLPSOHPHQWDWLRQRIGLJLWDOEUHDVW FDQFHUVFUHHQLQJKDVMXVWVWDUWHGRULVVWLOOXQGHUGLVFXVVLRQ % 'UDPDWLFLQFUHDVHLQVWHUHRWDFWLFFRUHQHHGOHELRSV\UDWHDQGGXFWDO FDUFLQRPDLQVLWXGHWHFWLRQDIWHUFRQYHUVLRQIURPDQDORJXHWRGLJLWDO VFUHHQLQJPDPPRJUDSK\ -1HGHUHQG $&9RRJG-+*URHQHZRXG0:-/RXZPDQ/(0'XLMP (LQGKRYHQ1/0DDVWULFKW1/5RWWHUGDP1/MRRVWQHGHUHQG#JPDLOFRP 3XUSRVH7 RGHWHUPLQHWKHLPSDFWRILPSOHPHQWDWLRQRIGLJLWDOVFUHHQLQJPDP PRJUDSK\RQVWHUHRWDFWLFFRUHQHHGOHELRSV\6&1%UDWHDQGGXFWDOFDUFLQRPD LQVLWX'&,6GHWHFWLRQ 0HWKRGVDQG0DWHULDOV:HLQFOXGHGDFRQVHFXWLYHVHULHVRIDQDORJXH DQGGLJLWDOVFUHHQLQJPDPPRJUDPVREWDLQHGDWD'XWFKEUHDVWVFUHHQLQJ UHJLRQEHWZHHQUHVSHFWLYHO\-DQXDU\-XO\DQG-XO\-DQXDU\ 6&1%UDWHDQG'&,6GHWHFWLRQZHUHGHWHUPLQHGIRUERWKSRSXODWLRQV 5HVXOWV5HIHUUDOUDWHDQGRYHUDOOFDQFHUGHWHFWLRQUDWHDWGLJLWDOVFUHHQLQJZHUH DQGSHUVFUHHQHGZRPHQFRPSDUHGWR SDQGSDWDQDORJXHVFUHHQ LQJ$WGLJLWDOVFUHHQLQJPDPPRJUDSK\6&1%SURFHGXUHVSHU VFUHHQHGZRPHQKDGEHHQSHUIRUPHGFRPSDUHGWR6&1%SURFHGXUHV SHUDQDORJXHVFUHHQVS3RVLWLYHSUHGLFWLYHYDOXHRI 6&1%IRUEUHDVWFDQFHUZDVDQGUHVSHFWLYHO\IRU GLJLWDODQGDQDORJXHVFUHHQLQJPDPPRJUDSK\S '&,6ZDVGLDJQRVHGLQ ZRPHQSHUGLJLWDOVFUHHQVFRPSDUHGWRSHU DQDORJXHVFUHHQVSDQG'&,6FRPSULVHGRIFDQFHUV GHWHFWHGDWGLJLWDOVFUHHQLQJDQGRIEUHDVWFDQFHUVGHWHFWHGDW DQDORJXHVFUHHQLQJS &RPSDUHGWR'&,6DWDQDORJXHVFUHHQLQJ'&,6 DWGLJLWDOVFUHHQLQJWHQGHGWREHPRUHIUHTXHQWO\ORZJUDGH'&,6RULQWHUPHGLDWH JUDGH'&,6YVS 6FLHQWLILF6HVVLRQ 6 &$' ( ) *+% (XURSHDQ&RQJUHVVRI 5DGLRORJ\ % 63(&7&7IRUWKHGHSLFWLRQRIVHQWLQHOO\PSKQRGHVLQFXWDQHRXV KHDGDQGQHFNWXPRXUV 7 &/DXHQVWHLQ&%R\7 3RHSSHO,6WRIIHOV'6FKDGHQGRUI$%RFNLVFK -.ORGH(VVHQ'(WKRPDVODXHQVWHLQ#XQLGXHGH 3XUSRVH7KHYDOXHRIVHQWLQHOO\PSKQRGHH[FLVLRQ6/1(LQSDWLHQWVZLWKFXWDQH RXVKHDGDQGQHFNPDOLJQDQFLHVKDVEHHQFRQWURYHUVLDOO\GLVFXVVHG:HDLPHG WRDVVHVVWKHGLDJQRVWLFLPSDFWRISUHRSHUDWLYH63(&7&7LQGLUHFWFRPSDULVRQ WRVWDQGDUG6/1(ZLWKRXW63(&7&7 0HWKRGVDQG0DWHULDOV'DWDRIFOLQLFDOO\O\PSKQRGHQHJDWLYHSDWLHQWVDJH UDQJH\HDUVZHUHDQDO\VHG3ULPDU\WXPRXUVLQFOXGHGPDOLJQDQWPHODQRPD Q DQGKLJKULVNFXWDQHRXVVTXDPRXVFHOOFDUFLQRPDQ ,QJURXS $Q DO\PSKRVFLQWLJUDSK\ZDVSHUIRUPHGZLWKHLWKHU0%TRU0%TRI7 FP QDQRFROORLGGHSHQGLQJRQWKHVFKHGXOHRIWKHVXUJLFDOSURFHGXUH,QJURXS%Q DQDGGLWLRQDO63(&7&7VFDQPDWUL[[IUDPHVVSHUIUDPHRIWKH KHDGDQGQHFNUHJLRQZDVREWDLQHGLPPHGLDWHO\DIWHUO\PSKRVFLQWLJUDSK\6/1( ZDVSHUIRUPHGGXULQJVXUJHU\DFFRUGLQJWRWKHSUHYLRXVLPDJLQJUHVXOWV2SHUDWLQJ WLPHVIRUERWKJURXSVZHUHFRPSDUHG 5HVXOWV6/1ZHUHUHPRYHGLQSDWLHQWV7KHRSHUDWLQJWLPHLQJURXS%ZDV VLJQLÀFDQWO\VKRUWHUPHGLDQPLQWKDQLQJURXS $PHGLDQPLQ3 'XHWRWKHH[DFWDQDWRPLFDOORFDOLVDWLRQRIWKH6/1GHWHUPLQHGE\63(&7&7 WKH VXUJLFDODSSURDFKZDVFKDQJHGLQRISDWLHQWV &RQFOXVLRQ63(&7&7LVDQLQQRYDWLYHLPDJLQJWHFKQLTXHSURYLGLQJDGGLWLRQDO LQIRUPDWLRQWRGHWHFWDQGWRH[FLVH6/1LQSDWLHQWVZLWKKHDGDQGQHFNPDOLJQDQFLHV % 'RVHDQGLPDJHTXDOLW\RIKLJKSLWFKGXDOVRXUFH&7IRUWKH HYDOXDWLRQRIFHUYLFDOO\PSKQRGHVWDWXVFRPSDULVRQWRUHJXODU VOLFHVLQJOHVRXUFH&7 5:%DXHU/+ROWKDXV%6FKHOO0%HHUHV) $O%XWPHK7 -9RJO-0.HUO )UDQNIXUWD0DLQ'(UDOIZEDXHU#DROFRP 3XUSRVH3DWLHQWVZLWKPDOLJQDQWO\PSKRPDUHJXODUO\XQGHUJR&7RIWKHQHFNIRU WKHHYDOXDWLRQRIO\PSKQRGHVWDWXVZLWKUHOHYDQWGRVHH[SRVXUH:HFRPSDUHGD QRYHOKLJKSLWFKGXDOVRXUFH&7'6&7SURWRFROZLWKRXUVWDQGDUGVLQJOHVRXUFH &7SURWRFROLQWHUPVRIGRVHDQGFRQVSLFXLW\RIFHUYLFDOO\PSKQRGHOHYHOV 0HWKRGVDQG0DWHULDOV(DFKSDWLHQWVXQGHUZHQWHLWKHUFRQWUDVWHQKDQFHG KLJKSLWFK'6&7JURXSSLWFKRUUHJXODUVLQJOHVRXUFH&7JURXSSLWFK RIWKHQHFNRQWKHVDPH&7GHYLFH'HÀQLWLRQ)ODVK6LHPHQVDWN9P$V $XWRPDWHGH[SRVXUHFRQWUROZDVXVHGLQERWKJURXSV,PDJHVZHUHUHFRQVWUXFWHG DWPPWKLFNQHVVZLWKDPHGLXPVRIWNHUQHO%I&7',YRO'/3DQGEDFNJURXQG QRLVH%1ZHUHFRPSDUHG7ZRUDGLRORJLVWVUDWHGGLDJQRVWLFLPDJHTXDOLW\DQG DUWHIDFWEXUGHQ H[FHOOHQWLPDJHTXDOLW\QRDUWHIDFWV QRUHOLDEOHGLDJQRVLV SRVVLEOHKHDY\DUWHIDFWV 5HVXOWV 0HDQ &7',YRO YV P*\ DQG '/3 YV P*\FP ZHUH VLJQLÀFDQWO\ S ORZHU LQ JURXS ZKLOH %1 ZDV VLJQLÀFDQWO\KLJKHUYV+8S 7KLVGLGQRWDIIHFWGLDJQRVWLF LPDJH TXDOLW\ VLQFH VXEMHFWLYH LPDJH TXDOLW\ YV DQG DUWHIDFW EXUGHQYVZHUHQRWUDWHGVLJQLÀFDQWO\GLIIHUHQWEHWZHHQERWK JURXSVS DQG &RQFOXVLRQ +LJKSLWFK '6&7 RI WKH QHFN DOORZV IRU D VLJQLÀFDQW UHGXFWLRQRI GRVHZKLOHGLDJQRVWLFLPDJHTXDOLW\LVSUHVHUYHGLQSDWLHQWVXQGHUJRLQJFHUYLFDO O\PSKQRGHVWDJLQJIRUPDOLJQDQWO\PSKRPD(VSHFLDOO\LQ\RXQJDGXOWVUDGLDWLRQ GHOLYHUHGWRWKHWK\URLGJODQGDQGH\HOHQVLVRILPSRUWDQWPDWWHU % 0DQDJHPHQWRIKHDGDQGQHFNFDUFLQRPDRIXQNQRZQSULPDU\ WKHGLDJQRVWLFDFFXUDF\RI))'*3(7&7LQGHWHFWLRQRIWKH FOLQLFDOO\RFFXOWWXPRXU -%6WUDLWRQ6%HWKDSXGL$0F&DOOXP6+DQ*ODVJRZ8. MDFNVWUDLWRQ#QKVQHW 3XUSRVH &DUFLQRPD RI XQNQRZQ SULPDU\ &83 UHSUHVHQWV RI DOO KHDG DQG QHFN PDOLJQDQFLHV DQG SRVHV VLJQLÀFDQW GHPDQGV RQ RWRUKLQRODU\QJRO RJ\ GHSDUWPHQWV 6TXDPRXV FHOO FDUFLQRPDV DFFRXQW IRU 7UDGLWLRQDO HYDOXDWLRQRIPHWDVWDWLFFHUYLFDOO\PSKDGHQRSDWK\LQFOXGHVFOLQLFDOH[DPLQDWLRQ ÀEUHRSWLFODU\QJRVFRS\QDVRSKDU\QJRVFRS\ FURVVVHFWLRQDO LPDJLQJ &705, DQGSDQHQGRVFRS\ZLWKGLUHFWHGELRSVLHVWRQVLOOHFWRP\7KHGLVHDVHIROORZVDQ DJJUHVVLYHFRXUVHZLWKPHGLDQVXUYLYDORIPRQWKV2XUDLPZDVWRUHYLHZ WKHGLDJQRVWLFDFFXUDF\RI)'*3(7&7LQFDVHVRI&83LQWKH:HVWRI6FRWODQG 0HWKRGVDQG0DWHULDOV&OLQLFDOUHFRUGVDQGLPDJLQJUHSRUWVRIFRQVHFXWLYH SDWLHQWV ZLWK PHWDVWDWLF FHUYLFDO O\PSKDGHQRSDWK\ DQG RFFXOW SULPDU\ WXPRXU % ,PSURYLQJGHWHFWLRQUDWHVRI'&,6ZLWKGLJLWDO'5PDPPRJUDSK\ &60DPHUL-0DPHUL)LOKR$&3 1D]DULR9LWRULD(6%56DR3DXOR%5 FODXGLDPDPHUL#KRWPDLOFRP 3XUSRVH7 RHYDOXDWHGHWHFWLRQUDWHVRISXUHGXFWDOFDUFLQRPDLQVLWX'&,6E\ÀOP VFUHHQPDPPRJUDSK\DQGE\GLJLWDOUDGLRJUDSKLF'5PDPPRJUDSK\LQZRPHQ VXEPLWWHGWRDQQXDOVFUHHQLQJIRUEUHDVWFDQFHU 0HWKRGVDQG0DWHULDOV3URVSHFWLYHVWXG\RIDV\PSWRPDWLFZRPHQVXEPLW WHGWRDQQXDOPDPPRJUDSKLFVFUHHQLQJLQWZRFHQWUHV7 HQWKRXVDQGWZRKXQGUHG DQGQLQHW\IRXUZRPHQLQWKHÀUVWJURXSKDGÀOPVFUHHQPDPPRJUDPVDQG ZRPHQLQWKHVHFRQGJURXSKDGGLJLWDO'5PDPPRJUDPV$OOH[DPVZHUHUHDG E\WKHVDPHUDGLRORJLVWV $OOZRPHQRQÀUVWVFUHHQLQJH[DPLQDWLRQZHUHH[FOXGHG %LRSV\ZDVUHFRPPHQGHGIRUOHVLRQVVXVSLFLRXVIRUPDOLJQDQF\LQDFFRUGDQFH ZLWK%,5$'6FDWHJRULVDWLRQDQGZDVVXEPLWWHGWRSDWKRORJLFDOH[DPLQDWLRQ 5HVXOWV0HDQDJHZDV\HDUVLQWKHÀUVWJURXSDQG\HDUVLQWKHVHFRQG JURXS'HQVHEUHDVWVZHUHSUHVHQWLQRIZRPHQLQWKHÀUVWJURXSDQGLQ RIWKRVHLQWKHVHFRQGJURXS,QWKHÀOPVFUHHQJURXSRIZRPHQ UHFRPPHQGHGIRUELRSV\ZHUHGLDJQRVHGZLWKEUHDVWFDQFHUSRVLWLYHSUHGLFWYDOXH >339@ RIZLWKSXUH'&,6,QWKHGLJLWDOJURXSRIZRPHQ UHFRPPHQGHGIRUELRSV\ZHUHGLDJQRVHGZLWKEUHDVWFDQFHU339 RI KDGSXUH'&,6ZKLFKZDVVLJQLÀFDQWO\KLJKHUWKDQZLWKÀOPVFUHHQ PDPPRJUDSK\ &RQFOXVLRQ,QZRPHQXQGHUJRLQJDQQXDOVFUHHQLQJIRUEUHDVWFDQFHUGLJLWDO'5 PDPPRJUDSK\LPSURYHVGHWHFWLRQUDWHVRISUHLQYDVLYHVWDJHFRPSDUHGWRWKDW DFKLHYHGE\ÀOPVFUHHQPDPPRJUDSK\ 5RRP*+ +HDGDQG1HFN 66 2QFRORJ\ 0RGHUDWRUV &=.DUDPDQ$\GLQ75 5.RKOHU*HQHYD&+ % ,QFLGHQWDO))'*SRVLWLYHIRFDOWK\URLGQRGXOHVRQ3(7&7 HYDOXDWLRQDQGRXWFRPH -%6WUDLWRQ6%HWKDSXGL) :3RRQ*ODVJRZ8.MDFNVWUDLWRQ#QKVQHW 3XUSRVH)ÁXURGHR[\JOXFRVH)'*DFFXPXODWLRQZLWKLQQRUPDOWK\URLGWLVVXH LVORZRUDEVHQWRQZKROHERG\)'*3(7&7 $VDUHVXOWRILQFUHDVLQJXVHRIWKLV K\EULGLPDJLQJPRGDOLW\LQFLGHQWDOWK\URLG)'*XSWDNHLVLQFUHDVLQJO\LGHQWLÀHG 0HWKRGVDQG0DWHULDOVFDVHVRI)'*3(7&7SHUIRUPHGDWRXULQVWLWXWLRQ EHWZHHQ-DQXDU\DQG0D\ZHUHUHWURVSHFWLYHO\UHYLHZHGE\VHDUFKLQJ IRU NH\ZRUG ҊWK\URLGҋ ZLWKLQ WKH FOLQLFDO LQIRUPDWLRQERG\ RI UHSRUW7KHVH FDVHV ZHUHUHYLHZHGE\WZRLQGHSHQGHQWREVHUYHUV3DWLHQWVZLWKHVWDEOLVKHGVXVSHFWHG WK\URLGPDOLJQDQF\RUSUHYLRXVWK\URLGVXUJHU\ZHUHGLVFDUGHG&DVHVZLWKIRFDORU GLIIXVHWK\URLG)'*XSWDNHZHUHFRUUHODWHGZLWKFOLQLFDOELRFKHPLFDODQGF\WRSD WKRORJ\KLVWRSDWKRORJ\UHFRUGV8OWUDVRXQGLPDJHVIRUDOOFDVHVZLWKIRFDOXSWDNH DQGDSDWKRORJLFDOGLDJQRVLVZHUHUHUHYLHZHGE\DQLQGHSHQGHQWKHDGDQGQHFN UDGLRORJLVW,QWHUREVHUYHUYDULDELOLW\ZDVUHVROYHGE\LQGHSHQGHQWO\UHUHYLHZLQJ LPDJHVDQGDUULYLQJDWFRQVHQVXV 5HVXOWV7KHSUHYDOHQFHRILQFLGHQWDOWK\URLG)'*XSWDNHZDVRI RQ)'*3(7&7 2IWKHVHGHPRQVWUDWHGIRFDOXSWDNHDQG ZHUHGLIIXVHRIFDVHVZLWKIRFDOXSWDNHKDGXOWUDVRXQGJXLGHGÀQH QHHGOHDVSLUDWLRQ)1$FRUHELRSV\RUSRVWVXUJLFDOSDWKRORJLFDOGLDJQRVLV ZHUHEHQLJQQRGXOHVZHUHPDOLJQDQWVL[SDSLOODU\FDUFLQRPDV RQHDQDSODVWLFFDUFLQRPDRQHVTXDPRXVFHOOPHWDVWDVLVZHUHSR WHQWLDOO\PDOLJQDQWRQ)1$ZHUHLQGHWHUPLQDWH &RQFOXVLRQ7KHSUHYDOHQFHRILQFLGHQWDOWK\URLG)'*XSWDNHRQ)'*3(7&7 ZDV7KHRYHUDOOLQFLGHQFHRIPDOLJQDQF\IRUIRFDOO\)'*DYLGWK\URLGQRGXOHV ZDV7KLVVWXG\UHLWHUDWHVWKHLPSRUWDQFHRIREWDLQLQJDWLVVXHGLDJQRVLVLQ VXFKSDWLHQWVWRH[FOXGHV\QFKURQRXVRUFOLQLFDOO\RFFXOWPDOLJQDQF\ 6FLHQWLILF6HVVLRQ $ 6&'()*+%(XURSHDQ&RQJUHVVRI 5DGLRORJ\ )ULGD\ 9&7 DQGKLVWRSDWKRORJLFPHWKRGVUHVXOWVZHUHDSSUR[LPDWHO\HTXDOLQFDVHV DOWKRXJK9&7EHVWYLVXDOLVHGWKHH[WHQWRIERQHGHVWUXFWLRQ,QFDVHVWKH&7 UHVXOWVGLIIHUHGIURPWKRVHGHWHUPLQHGE\9&7DQGKLVWRORJ\ &RQFOXVLRQ&RPSXWHGWRPRJUDSK\LVDVRXQGPHWKRGIRUGHWHUPLQLQJWXPRXU H[WHQW9&7FDQDFFXUDWHO\GHWHUPLQHERQ\LQÀOWUDWLRQ,WLVWKXVDYDOLGLQWUDRSHUDWLYH VXSSOHPHQWWRIUR]HQVHFWLRQDQDO\VLVDQGFDQDLGWKHUHVHFWLRQDQGUHFRQVWUXFWLRQ VWUDWHJ\ 6HFRQGDU\ UHFRQVWUXFWLYH VXUJHU\ FDQ EH DYRLGHG WKHUHE\ LQFUHDVLQJ SDWLHQWVҋOLIHTXDOLW\DQGGHFUHDVLQJWRWDOWKHUDS\FRVWV % 5DGLRFKHPRWKHUDS\LQGXFHGFKDQJHVRIORFDOWXPRXUEORRGVXSSO\ HVWLPDWHGE\'&(&7LQKHDGDQGQHFNWXPRXUV $$EUDP\XN9+LHWVFKROG.=RHSKHO6$SSROG5YRQ.XPPHU 1$EROPDDOL'UHVGHQ'($QGULM$EUDP\XN#8QLNOLQLNXP'UHVGHQGH 3XUSRVH5DGLRFKHPRWKHUDS\5&K7LVFRQVLGHUHGVWDQGDUGWUHDWPHQWIRUQRQ RSHUDEOHKHDGDQGQHFNWXPRXUV+173ULPDU\DLPRIRXUVWXG\ZDVWRLQYHVWLJDWH 5&K7LQGXFHGFKDQJHVRIORFDOWXPRXUEORRGVXSSO\SDUDPHWHUVUHODWLYHWXPRXU EORRGYROXPHU7%9DQGWUDQVIHUFRHIÀFLHQW.WUDQVGHULYHGIURP'&(&7LQ+17 0HWKRGV DQG 0DWHULDOV SDWLHQWV ZLWK QRQRSHUDEOH +17 6WDJHV ,,,,9 VFKHGXOHGIRU5&K7ZHUHLQFOXGHG&KHPRWKHUDS\FRQVLVWHGRIFLVSODWLQGXULQJ DOOZHHNVRIUDGLRWKHUDS\DQGÁXRURXUDFLOGXULQJÀUVWZHHNRQO\'&(&7ZDV SHUIRUPHGEHIRUH5&K7 LQWZRZHHNV*\DQGÀYHZHHNV*\XVLQJ%LRJUDSK 6LHPHQVU7%9XQG.WUDQVZHUHGHWHUPLQHGE\PRGLÀHG3DWODNDQDO\VLVXV LQJSL[HOEDVHGVRIWZDUH93&7 6LHPHQV'\QDPLFVRIU7%9DQG.WUDQVZHUH DQDO\VHGGXULQJ5&K7DQGLQPRQWKVIROORZXS 5HVXOWV,QSDWLHQWVDQLQFUHDVHRIU7%9DQGRU.WUDQVDIWHU*\IROORZHGE\ DGHFUHDVHRIERWKSDUDPHWHUVDIWHU*\ZDVQRWHG([FHSWIRURQHSDWLHQWZLWK ORFDOUHFXUUHQFHFRPSOHWHWXPRXUUHVSRQVHGXULQJIROORZXSZDVGLDJQRVHGLQ SDWLHQWV,QSDWLHQWVDQLQFUHDVHRIU7%9ZLWKFRQFRPLWDQWGURSRI.WUDQVXQGHU 5&K7ZDVGHWHFWHG0RUSKRORJLFDOO\LQDOOSDWLHQWVDSDUWLDOWXPRXUUHVSRQVH ZDVHVWDEOLVKHG,QSDWLHQWVKRZLQJDQHOHYDWLRQRIERWKU7%9DQG.WUDQVGXULQJ 5&K7ORFDOWXPRXUSURJUHVVZDVGHWHFWHGGXULQJIROORZXS &RQFOXVLRQ(VWLPDWHGE\'&(&7UDGLRFKHPRWKHUDS\LQGXFHGFKDQJHVRIU7%9 XQG.WUDQVPD\UHSUHVHQWDPRGLÀFDWLRQRIORFDOWXPRXUEORRGVXSSO\DVDIXQFWLRQ RILQWUDWXPRUDOR[\JHQGLVWULEXWLRQDQGFRQVHTXHQWO\UHYHDOFOLQLFDOLPSDFWDOORZLQJ LQGLYLGXDOLVDWLRQRI5&K7VWUDWHJ\LQSDWLHQWVZLWK+17 % '\QDPLFFRQWUDVWHQKDQFHG7ZHLJKWHG05LPDJLQJWRGLVWLQJXLVK WXPRXUUHFXUUHQFHIURPVFDUDIWHUWUHDWPHQWLQSDWLHQWVZLWKKHDG DQGQHFNQHRSODVPVDSLORWVWXG\ &*DXGLQR5&VHUQXV6+HLODQG0%HQGV]XV65RKGH +HLGHOEHUJ'(FKLDUDJDXGLQR#PHGXQLKHLGHOEHUJGH 3XUSRVH,QIROORZXSLPDJLQJRISDWLHQWVZLWKKHDGDQGQHFNQHRSODVPVLWLVRIWHQ GLIÀFXOWWRGLVWLQJXLVKWXPRXUUHFXUUHQFHIURPVFDUDIWHUWUHDWPHQW $LPRIWKLVVWXG\ LVWRDQDO\VHLISHUIXVLRQFXUYHSDWWHUQVKHOSWRGLIIHUHQWLDWHWXPRXUIURPVFDU 0HWKRGVDQG0DWHULDOV05,SHUIXVLRQGDWDRISDWLHQWVPHQPHDQDJH \HDUVZLWKVXVSLFLRXVHQKDQFLQJOHVLRQVRIWKHRURSKDU\Q[RUWKHRUDOFDYLW\ ZHUHDQDO\VHG,QSDWLHQWVSULPDU\RUUHFXUUHQWVTXDPRXVFHOOFDUFLQRPDZDV GLDJQRVHGKLVWRORJLFDOO\LQSDWLHQWVVFDUZDVGLDJQRVHGKLVWRORJLFDOO\Q RU E\ORQJWHUPUDGLRORJLFDOIROORZXS!PRQWKV'\QDPLFFRQWUDVWHQKDQFHG05, ZHUHSHUIRUPHGRQD7 HVODVFDQQHU7LP7ULR6LHPHQV(UODQJHQ*HUPDQ\XVLQJ DYROXPHWULFLQWHUSRODWHGEUHDWKKROGH[DPLQDWLRQ9,%(7ZHLJKWHGVHTXHQFH 757(PVHFVOLFHPP)29PPPHDVXUHPHQWVRIVÁRZ POV3HUIXVLRQGDWDZHUHSRVWSURFHVVHGRQDUHJLRQRILQWHUHVW52,EDVLV XVLQJ WKH PHDQFXUYH VRIWZDUH 6LHPHQV (UODQJHQ*HUPDQ\ REWDLQLQJ VLJQDO LQWHQVLW\WLPH6WFXUYHV,QHDFKVXVSHFWOHVLRQIRXU52,VZHUHSRVLWLRQHGLQ FRQVHQVXVRIWZRUDGLRORJLVWV)RUHDFK6WFXUYHPD[LPDOLQWHQVLW\YDOXH 3PD[DQGWLPHWRSHDN773ZHUHDQDO\VHG 5HVXOWV0HDQ6WFXUYHVRIWKHWZRJURXSVZHUHVLJQLÀFDQWO\GLIIHUHQW7XPRXU VKRZHGDIDVWZDVKLQ773 VZLWKDKLJK3PD[UDQJH VFDUKDGDVORZHUZDVKLQ773 VSZLWKDORZHU3PD[ UDQJHS &RQFOXVLRQ3HUIXVLRQ6WFXUYHSDWWHUQRIKHDGDQGQHFNVTXDPRXVFHOOFDU FLQRPDVLVVLJQLÀFDQWGLIIHUHQWWRSHUIXVLRQ6WFXUYHSDWWHUQRIVFDUIROORZLQJ WUHDWPHQW'\QDPLFFRQWUDVWHQKDQFHG05,FRXOGEHKHOSIXOLQIROORZXSRISDWLHQWV ZLWKKHDGDQGQHFNWXPRXUV GHVSLWHFOLQLFDOUDGLRORJLFDOZRUNXSSUHVHQWLQJWRRXULQVWLWXWLRQIRU)'*3(7&7 ZHUHUHWURVSHFWLYHO\UHYLHZHG7KHUHZHUHPDOHVDQGIHPDOHVZLWKDPHDQ DJHRI\HDUVUDQJH )'*3(7&7LPDJHVUHSRUWVZHUHLQGHSHQG HQWO\UHYLHZHGE\WZRREVHUYHUVDQGFRPSDUHGZLWKJROGVWDQGDUGKLVWRSDWKRORJ\ 5HVXOWV)'*3(7&7FRUUHFWO\GHWHFWHGRFFXOWSULPDU\WXPRXUVLQSDWLHQWV GHWHFWLRQUDWH7KHUHZHUHWUXHQHJDWLYHVLQZKLFKQRH[WUDQRGDOPD OLJQDQF\ZDVSURYHQ7KHUHZHUHIDOVHQHJDWLYHVLQZKLFKDQXQGHUO\LQJSULPDU\ WXPRXUZDVHVWDEOLVKHGE\RWKHUPHWKRGVGHVSLWHQHJDWLYH3(7&77KHUHZHUH IDOVHSRVLWLYHVLQZKLFKGLUHFWHGVHDUFKHVWDEOLVKHGQRKLVWRORJLFDOGLDJQRVLVDW WKHVLWHRIFRQFHUQRQ)'*3(7&7 6HQVLWLYLW\DQGVSHFLÀFLW\ZHUHDQG UHVSHFWLYHO\3RVLWLYHSUHGLFWLYHYDOXHDQGQHJDWLYHSUHGLFWLYHYDOXH 2YHUDOODFFXUDF\ &RQFOXVLRQ)RUDPDMRULW\LQWKLVFKDOOHQJLQJVXEJURXSRISDWLHQWV)'*3(7 &7FRQWULEXWHVSRVLWLYHO\ZKHQFRQYHQWLRQDOGLDJQRVWLFSDWKZD\VKDYHIDLOHGWR HVWDEOLVKDSULPDU\WXPRXU % &RPSDULVRQRIFRQWUDVWHQKDQFHG3(7&7DQG05,LQSDWLHQWVZLWK KHDGDQGQHFNFDQFHU 7 -9RJO15RGH7 6WRHYHU56DGHU,%XUFN0+DUWK)*UXHQZDOG )UDQNIXUW'(WYRJO#HPXQLIUDQNIXUWGH 3XUSRVH7 RUHWURVSHFWLYHO\FRPSDUHFRPELQHG)ÁXRURGHR[\JOXFRVHSRVLWURQ HPLVVLRQWRPRJUDSK\FRPSXWHGWRPRJUDSK\ ))'* 3(7&7 WR FRQWUDVW HQKDQFHGPDJQHWLFUHVRQDQFHLPDJLQJ05,LQWKHGLDJQRVLVRIKHDGDQGQHFN FDQFHUUHJDUGLQJGLDJQRVWLFDFFXUDF\DQGWXPRXUYROXPHWU\ 0HWKRGVDQG0DWHULDOV:LWKLQGD\V))'*3(7&7DQG05,ZHUHSHU IRUPHGLQRUDOFDYLW\6&&Q SULPDULHVUHFXUUHQWWXPRXUVDQGZLWKLQ GD\VLQ+RGJNLQO\PSKRPDQ SULPDULHVUHFXUUHQWWXPRXUV(YDOXDWHG SDUDPHWHUV ZHUH WXPRXU ORFDOLVDWLRQ WXPRXU GLDPHWHU WXPRXU YROXPH O\PSK QRGHVGLVWDQWPHWDVWDVHV 5HVXOWV ,Q RUDO FDYLW\ 6&& GLDJQRVWLF DFFXUDF\ ZDV DV IROORZV DFFRUGDQFH RI 05, 3(7&7 05,SRVLWLYH3(7&7QHJDWLYH 05,QHJDWLYH 3(7&7SRVLWLYH 05,SRVLWLYH3(7&7XQFOHDU 05,QHJDWLYH3(7 &7XQFOHDU 3(7&7SRVLWLYH05,XQFOHDU 3(7&7QHJDWLYH05, XQFOHDU $YHUDJHPD[LPXPVWDQGDUGLVHGXSWDNHYDOXHV689PD[LQ3(7&7 ÀQGLQJVZHUHPHDVXUHGWREH,QWXPRXUYROXPHDQGH[SDQVLRQ3(7&7YV 05,VKRZHGODUJHUYROXPHLQ05,YV3(7&7ODUJHUYROXPHLQ3(7 &7HTXDOHG05,LQ,QQRHYDOXDWLRQZDVSRVVLEOH5HJDUGLQJO\PSK QRGHHYDOXDWLRQ05,HTXDOHG3(7&7 ,QGLVWDQWPHWDVWDVHVZHUHGHWHFWHG YLD))'*3(7&7 ,Q+RGJNLQO\PSKRPDWKHUHZDVQRVWDWLVWLFDOO\VLJQLÀFDQW GLIIHUHQFHEHWZHHQWKHWZRPRGDOLWLHVUHJDUGLQJSDWKRORJLFDOÀQGLQJV&RQFHUQLQJ O\PSKRPDH[SDQVLRQ3(7&7ZDVVXSHULRUWR05,LQ05,ZDVVXSHULRUWR 3(7&7LQDQGLQRWKHUSDWLHQWV05,HTXDOHG3(7&7 &RQFHUQLQJO\PSK QRGH QXPEHUV 05, HTXDOHG 3(7&7 LQ VL]H DQG PRUSKRORJ\ ,Q VXVSHFW H[WUDFHUYLFDOÀQGLQJVZHUHUHYHDOHGE\))'*3(7&7 &RQFOXVLRQ,QVXPPDU\05,ZDVHTXDOWR3(7&7UHJDUGLQJDFFXUDF\&RQFHUQ LQJYROXPHWU\05,KDGVRPHDGYDQWDJHVYV3(7&7 ))'*3(7&7HDVLO\ LGHQWLÀHGGLVWDQWO\PSKQRGHPHWDVWDVHV0D[LPXPVWDQGDUGLVHGXSWDNHYDOXHV 689PD[!LQ3(7&7LVUHOLDEOHIRUHYDOXDWLQJO\PSKQRGHPHWDVWDVHV % 3UHDQGLQWUDRSHUDWLYHGHWHUPLQDWLRQRIWXPRXUH[WHQWDQGERQH LQÀOWUDWLRQLQWKHKHDGDQGQHFNUHJLRQDFRPSDULVRQRIPXOWLVOLFH FRPSXWHGWRPRJUDSK\06&7KLJKUHVROXWLRQÁDWSDQHOYROXPHWULF &79&7DQGKLVWRSDWKRORJLFPHWKRGV ($OHMDQGUH/DIRQW+6FKDDI7 0XHOOHU02EHUW+3 +RZDOGW *.URPEDFK(*L]HZVNL*LHVVHQ'( 3XUSRVH7 RDVVHVVLI9&7 DVDKLJKUHVROXWLRQERQHLPDJLQJPRGDOLW\FDQLQ WUDRSHUDWLYHO\VXSSOHPHQWIUR]HQVHFWLRQDQDO\VLVWRHVWDEOLVKWKHGHSWKRIWXPRXU LQÀOWUDWLRQ7 RYDOLGDWHWKH9&7DSSURDFKZHFRPSDUHG&7 9&7 DQGKLVWRSDWKROJ\ UHVXOWVIRUWXPRXUH[WHQW 0HWKRGVDQG0DWHULDOV+HDGDQGQHFNWXPRXUVRISDWLHQWVZHUHSUHRSHUD WLYHO\VWDJHGZLWK&7 3HULRSHUDWLYH9&7RIWKHUHVHFWHGVSHFLPHQZDVXVHGWR VXSSOHPHQWIUR]HQVHFWLRQDQDO\VLV%RQHGHVWUXFWLRQZDVFRPSDUHGIRUWKH9&7 &7 DQGIUR]HQVHFWLRQPHWKRGVEHIRUHWKHUHVXOWVZHUHUHOD\HGWRWKHVXUJHRQ ZKRDGMXVWHGWKHUHVHFWLRQSURFHGXUHDVQHFHVVDU\6WDJLQJ&7DQGÀQDOKLVWRSD WKRORJ\UHVXOWVZHUHFRPSDUHGSRVWRSHUDWLYHO\SDWLHQWVZHUHQRWLQFOXGHGLQ WKHÀQDOHYDOXDWLRQEHFDXVHHLWKHUKLVWRSDWKRORJ\RU&7UHVXOWVZHUHLQFRPSOHWH 5HVXOWV&7GHWHUPLQHGDODUJHUWXPRXUVL]HWKDQKLVWRORJ\LQFDVHVPHDQ GLIIHUHQFHPPDVPDOOHUVL]HLQFDVHVPHDQGLIIHUHQFHPPDQGDS SUR[LPDWHO\HTXDOVL]HVLQFDVHV,QDFRPSDULVRQRIWXPRXUH[WHQWZLWK&7 6FLHQWLILF6HVVLRQ 6 &$' ( ) *+% (XURSHDQ&RQJUHVVRI 5DGLRORJ\ 5RRP/0 0ROHFXODU,PDJLQJ 66 +\EULGLPDJLQJ3(7&7DQG053(7 0RGHUDWRUV .cKOVWU|P5LNOXQG8PHn6( /63ROLWL0LODQ,7 % 5ROHRI)'*3(7&7LQWKHIROORZXSRISDHGLDWULFSDWLHQWVZLWK (ZLQJVDUFRPDDQGSULPLWLYHQHXURHFWRGHUPDOWXPRXU ($$ODODZL$$OVXJDLU$-DYHG$$O*DIUL$,$OPXKDLGHE$)DWKDOD 07XOL00$ERX]LHG5L\DGK6$]LHG#EXIIDORHGX 3XUSRVH :H DUH DLPLQJ WR HYDOXDWH WKH GLDJQRVWLF SHUIRUPDQFH RI ) )'* 3(7&7LQWKHIROORZXSRISDHGLDWULFSDWLHQWVZLWK(ZLQJ6DUFRPDDQGSULPLWLYH QHXURHFWRGHUPDOWXPRXU31(7 0HWKRGVDQG0DWHULDOV(LJKW\WZRFRQVHFXWLYH3(7&7VFDQVZHUHSHUIRUPHG LQWKLUW\QLQHSDHGLDUWULFSDWLHQWVZLWKKLVWRSDWKRORJLFDOSURRIRI(ZLQJҋVVDUFRPD LQSDWLHQWVDQG31(7LQWKUHHSDWLHQWVPDOHVIHPDOHVDYHUDJHDJHRI \HDUVUDQJH\HDUV)'*3(7&7ZDVSHUIRUPHGWRHYDOXDWHDVXVSHFWHG ORFDOUHFXUUHQFHDQGWRUXOHRXWGLVWDQWPHWDVWDVHV+LVWRORJ\Q RUIROORZXS FOLQLFDOO\DQGUDGLRORJLFDOO\Q IRUDWOHDVWPRQWKVUDQJHPRQWKVZHUH HPSOR\HGDVWKHVWDQGDUGRIUHIHUHQFHIRULPDJLQJÀQGLQJV 5HVXOWV3(7&7ZDVWUXHQHJDWLYHLQSDWLHQWVLQH[FOXGLQJORFDOUHFXUUHQFH 2QO\RQHIDOVHQHJDWLYHVWXG\LQDSDWLHQWGHYHORSHGORFDOUHFXUUHQFHDWIRXUPRQWKV SRVWVFDQQLQJZLWKDQRYHUDOOQHJDWLYHSUHGLFWLYHYDOXHRI2QWKHRWKHUKDQG 3(7&7ZDVWUXHSRVLWLYHLQÀYHSDWLHQWVDQGIDOVHSRVLWLYHLQRQHSDWLHQWLQZKRP WKHKLVWRSDWKRORJLFDOH[DPLQDWLRQUHYHDOHGÀEUREODVWLFSUROLIHUDWLRQJLDQWFHOOUHDF WLRQDQGQRYLDEOHWXPRXUZLWKDQRYHUDOOSRVLWLYHSUHGLFWLYHYDOXHRI2YHUDOO 3(7&7KDGDQDFFXUDF\RI3(7&7GHSLFWHGGLVWDQWOXQJPHWDVWDWLFGLVHDVH LQWHQSDWLHQWDQGERQHPHWDVWDVHVLQWZRSDWLHQWVUHTXLULQJIXUWKHUFKHPRWKHUDS\ &RQFOXVLRQ3(7&7LVDXVHIXOGLDJQRVWLFWRROLQWKHIROORZXSRISDWLHQWVZLWK(Z LQJVDUFRPDSDUWLFXODUO\LQH[FOXGLQJORFDODQGGLVWDQWGLVHDVHZLWKKLJKGLDJQRVWLF DFFXUDF\)DOVHSRVLWLYHÀQGLQJVPLJKWEHUHODWHGWRWKHUDS\LQGXFHGLQÁDPPDWLRQ % /RZGRVHQRQHQKDQFHG&7YHUVXVIXOOGRVHFRQWUDVWHQKDQFHG &7LQLQWHJUDWHG)'*3(7&7VWXGLHVIRUWKHGLDJQRVLVRIRYDULDQ FDQFHUUHFXUUHQFH ..LWDMLPD< 8HQR.6X]XNL< 2QLVKL0.LWD7 <RVKLNDZD< 2KQR 06HQGD.6XJLPXUD.REH-3NLWDMLPD#PHGNREHXDFMS 3XUSRVH7 RHYDOXDWHORZGRVHQRQHQKDQFHG&7OG&7DQGIXOOGRVHFRQWUDVW HQKDQFHG&7FH&7LQ)'*3(7&7VWXGLHVIRUUHVWDJLQJRIRYDULDQFDQFHU 0HWKRGV2QHKXQGUHGZRPHQZKRKDGXQGHUJRQHWUHDWPHQWIRURYDULDQFDQFHU XQGHUZHQWDFRQYHQWLRQDO3(7&7VFDQVZLWKOG&7 DQGWKHQFH&7 7ZRREVHUYHUV LQWHUSUHWHGDQGGHFLGHGLQFRQVHQVXVRQWKH3(7OG&7DQG3(7FH&7LPDJHVE\ DSRLQWVFDOH1QHJDWLYH(HTXLYRFDO3SRVLWLYHSHUSDWLHQWDQGOHVLRQ)LQDO GLDJQRVHVZHUHREWDLQHGE\KLVWRSDWKRORJLFDOH[DPLQDWLRQVRUFOLQLFDOIROORZXS IRUDWOHDVWVL[PRQWKV 5HVXOWV3DWLHQWEDVHGDQDO\VLVVKRZHGWKDWWKHVHQVLWLYLW\VSHFLÀFLW\DQGDF FXUDF\ RI 3(7FH&7 ZHUH DQG UHVSHFWLYHO\ZKHUHDVWKRVHRI3(7OG&7ZHUHDQG UHVSHFWLYHO\6HQVLWLYLW\VSHFLÀFLW\DQGDFFXUDF\GLGQRWVLJQLÀ FDQWO\GLIIHUEHWZHHQWZRPHWKRGV0F1HPDUWHVWS S DQGS UHVSHFWLYHO\7KHUHZHUHVLWHVRIOHVLRQUHFXUUHQFHSHULWRQHXPSHOYLF O\PSKQRGH/1SDUDDRUWLF/1ORFDOUHFXUUHQFHOLYHUVXSUDFODYLFXODU /1PHGLDVWLQDOKLODU/1DQGOXQJ7KHVFDOHVRIGHWHFWLQJUHFXUUHQWUHJLRQV ZHUH1(3IRU3(7FH&7 DQG1(3IRU3(7OG&7 UHVSHF WLYHO\1LQHHTXLYRFDOUHJLRQVORFDOSHULWRQHXPSHOYLF/1SDUDDRUWLF/1 VXSUDFODYLFXODU/1DQGOLYHUDQGRQHQHJDWLYHUHJLRQVOLYHUE\3(7OG&7ZHUH FRUUHFWO\LQWHUSUHWHGDVSRVLWLYHE\3(7FH&7 &RQFOXVLRQ3(7FH&7LVDQDFFXUDWHLPDJLQJPRGDOLW\IRUWKHDVVHVVPHQWRI RYDULDQ FDQFHU UHFXUUHQFH ZLWK FHUWDLQW\ UHGXFLQJ WKH IUHTXHQF\ RI HTXLYRFDO LQWHUSUHWDWLRQV % 'RDSSDUHQWGLIIXVLRQFRHIÀFLHQWDQGKLVWRORJLFDOFKDUDFWHULVWLFVRI VTXDPRXVFHOOFDUFLQRPDRIWKHRUDOFDYLW\FRUUHODWH" /%RQHOOR/3UHGD*3HWUDOLD3 6XPPHUV&*LDQQLWWR0%HOORPL0LODQ,7 OXNHERQHOOR#LHRLW 3XUSRVH7 RFRUUHODWHDSSDUHQWGLIIXVLRQFRHIÀFLHQW$'&ZLWKKLVWRORJLFDOFKDU DFWHULVWLFVRIVTXDPRXVFHOOFDUFLQRPDRIWKHRUDOFDYLW\ 0HWKRGVDQG0DWHULDOVSDWLHQWVZLWKXQWUHDWHGKLVWRORJLFDOO\SURYHQVTXDPRXV FHOOFDUFLQRPDXQGHUZHQWFRQYHQWLRQDOLQFOXGLQJ7ZHLJKWHGDQG7SUHDQG SRVWFRQWUDVWDQGGLIIXVLRQZHLJKWHG05,EYDOXHVDQGVPP 7KH$'&IRURUDOFDYLW\WXPRXUVZHUHFDOFXODWHGIURPUHJLRQVRILQWHUHVWGUDZQ PDQXDOO\RQWKHKLJKHVWEYDOXHLPDJHVXVLQJWKH,PDJH-,PDJH-1,+DQGIVO IVO8QLYHUVLW\RI2[IRUGLPDJHSURFHVVLQJSDFNDJHV7KH$'&IRUWKHWXPRXU YROXPHREWDLQHGZDVFRUUHODWHGZLWKKLVWRORJLFDOFKDUDFWHULVWLFV710*UDGLQJ 5HVXOWV2IWKHHOLJLEOHSDWLHQWVPDOHVIHPDOHVPHDQDJHUDQJH \HDUVZHUHVXLWDEOHIRU$'&FDOFXODWLRQ1LQHSDWLHQWVZHUHH[FOXGHGGXH WRWKHSUHVHQFHRIDUWHIDFWVDQGGXHWRLQDELOLW\WRYLVXDOLVHWKHWXPRXURQWKH GLIIXVLRQZHLJKWHGVHTXHQFHV7KHPHDQ$'&YDOXHZDVPPVDQG PHDQVL]HPP $'&GLGQRWFRUUHODWHZLWKWXPRXUVWDJHRUJUDGH $'& ZDVVLJQLÀFDQWO\ORZHUS IRU1Q VWDJHWXPRXUVZKHQFRPSDUHGWR 1Q VWDJH1RRWKHUGLIIHUHQFHVZHUHREVHUYHGEHWZHHQ7VWDJHV1VWDJHV RUWXPRXU*UDGLQJ &RQFOXVLRQ,QRXUFRKRUWZHGLGQRWREVHUYHFOLQLFDOO\UHOHYDQWGLIIHUHQFHVLQ $'& YDOXHVLQVTXDPRXVFHOOFDUFLQRPDRIWKHRUDOFDYLW\ % 0DFURELRSVLHVIRUKHDGDQGQHFNFDQFHUV --DQVVHQV 0'HOHX+DVVHOW%(7LHQHQ%( MDDNMDQVVHQV#LQWHUYHQWLRQDORQFRORJ\VRFLHW\RUJ 3XUSRVH&RQWHPSRUDU\PHGLFDOWUHDWPHQWVIRUKHDGDQGQHFN+ 1FDQFHUV LQFUHDVLQJO\ XVH WDUJHWHG WKHUDSLHV WKDW DUH VHOHFWHG E\ PROHFXODU ELRPDUNHUV 7 RDOORZWKHVHSHUVRQDOLVHGGLDJQRVWLFVPDFURELRSVLHVDUHSUHIHUUHG7KLVVWXG\ HYDOXDWHVWKHXVHRIWKH6SLURWRPHPDFURELRSV\V\VWHPLQ+ 1FDQFHUVIRUSURYLG LQJKLJKTXDOLW\WLVVXHVSHFLPHQ 0HWKRGVDQG0DWHULDOVSDWLHQWVZLWKDPDVVLQWKH+ 1UHJLRQZHUHVHOHFWHG IRUELRSV\LQUHJLRQDOKRVSLWDOV0LOGDQWLFRDJXODWLRQZDVDOORZHG7KHELRSV\ VLWHZDVVWXGLHGZLWKUHJDUGWRDFFHVVURXWHDQGFULWLFDORUJDQVE\XOWUDVRXQG&7 DQGRU05,7KH6SLURWRPH0HG,QYHQWV19%HOJLXPZDVXVHGDVPDFURELRSV\ V\VWHP 6DPSOH TXDOLW\ ZDV HYDOXDWHG ZLWK UHJDUG WR YROXPH OHQJWK GLDPHWHU DQG KLVWRORJLFDOLPPXQRKLVWRFKHPLFDO GLDJQRVLV DQG PROHFXODU ELRORJ\ 3DWLHQW WROHUDQFHDQGERWKHDUO\DQGODWHFRPSOLFDWLRQVZHUHUHFRUGHG 5HVXOWV,QDOOSDWLHQWVWKHDQWLFLSDWHGSURFHGXUHFRXOGEHSHUIRUPHGZLWKRXW FRPSOLFDWLRQVRUPDMRUVLGHHIIHFWV7 ROHUDQFHZDVJRRGZLWKRQO\PLQLPDOSDLQLQ SDWLHQWV,QDOOFDVHVPLQLPDOEOHHGLQJFRXOGEHVWRSSHGGXULQJWKHSURFHGXUH 1RKRVSLWDOLVDWLRQRUSURORQJHGVWD\ZDVQHFHVVDU\:KHUHDSSURSULDWHQ FRPSOHWHKLVWRORJLFDOLPPXQRKLVWRFKHPLFDODQGPROHFXODUELRORJ\FRXOGEHSHU IRUPHG,QSDWLHQWVRQO\EHQLJQUHDFWLYHO\PSKQRGHWLVVXHFRXOGEHKDUYHVWHG ,QSDWLHQWDQDEVFHVVZDVUHFRUGHG,QSDWLHQWVDQLQFRPSOHWHSDWKRORJLFDO SURWRFROZDVJLYHQGXHWRUHLPEXUVHPHQWUHVWULFWLRQV &RQFOXVLRQ 7KH 6SLURWRPH PDFURELRSV\ SURYLGHV VXIÀFLHQW DQG KLJKTXDOLW\ WLVVXHYROXPHLQ+ 1FDQFHUVWRDOORZDOOPROHFXODUELRORJ\DQGKLVWRORJLFDOWHVWV IRURSWLPDOGLDJQRVLVZLWKRXWKRVSLWDOLVDWLRQRUPDMRUVLGHHIIHFWV 6FLHQWLILF6HVVLRQ $ 6&'()*+%(XURSHDQ&RQJUHVVRI 5DGLRORJ\ )ULGD\ DWLRQVHPLTXDQWLWDWLYHFULWHULDXVHGZHUHVWDQGDUGLVHGXSWDNHYDOXHRIHDUO\DQG GHOD\HGLPDJHVDQGUHWHQWLRQLQGH[RIWKHOHVLRQV 5HVXOWV3HUSDWLHQWDQDO\VLVSDWLHQWVZHUHFRQÀUPHGWRKDYHUHFXUUHQFH DQG WR KDYH EHQLJQ OHVLRQV 6WDQGDUG 3(7&7 GHWHFWHG UHFXUUHQW WXPRXU LQ SDWLHQWVZKHUHDVGHOD\HGVFDQZDVWUXHSRVLWLYHLQ 6WDQGDUG3(7&7FRUUHFWO\H[FOXGHGPDOLJQDQF\LQSDWLHQWVDQGZDV IDOVH SRVLWLYH LQ ZKHUHDV GHOD\HG VFDQ ZDV WUXH QHJDWLYH LQ DQGIDOVHSRVLWLYHLQ3HUOHVLRQDQDO\VLVOHVLRQVZHUHFRQ ÀUPHGWREHPDOLJQDQWDQGEHQLJQ6WDQGDUG3(7&7FRUUHFWO\LGHQWLÀHG WXPRXUOHVLRQVZKHUHDVDWGHOD\HGVFDQDOOOHVLRQVZHUHWUXHSRVLWLYH 6WDQGDUG3(7&7FRUUHFWO\H[FOXGHGPDOLJQDQF\LQDQGZDV IDOVHSRVLWLYHLQZKHUHDVGHOD\HGVFDQZDVWUXHQHJDWLYHLQ OHVLRQVDQGIDOVHSRVLWLYHLQ0HDQ5,ZDVUDQJH LQPDOLJQDQWOHVLRQVDQGUDQJHLQEHQLJQOHVLRQV &RQFOXVLRQ 'XDO SKDVH 3(7&7 LV D YDOXDEOH WRRO LQ SDWLHQWV ZLWK VXVSHFWHG UHFXUUHQFHRIJ\QDHFRORJLFDOFDQFHUDQGPD\LPSDFWRQSDWLHQWPDQDJHPHQW % :KROHERG\3(7&7FRPSDUHGWRZKROHERG\05,LQWKHGLDJQRVLVRI VFOHURWLFERQHPHWDVWDVHV 606KDLNK+\GHUDEDG,1 3XUSRVH$LP RI WKH VWXG\ ZDV WR HYDOXDWH WKH GLDJQRVWLF YDOXH RI FRQWUDVW HQKDQFHG3(7&7XVLQJ))'*FRPSDUHGWRZKROHERG\05,:%05,LQ WKHGLDJQRVLVRIVFOHURWLFERQHPHWDVWDVHV 0HWKRGVDQG0DWHULDOV,QDUHWURVSHFWLYHEOLQGHGVWXG\SDWLHQWVZLWKVXVSHFWHG VFOHURWLF VNHOHWDO PHWDVWDVHV XQGHUZHQW 3(7&7 DV ZHOO DV :%05, ZLWK WKH XVHRISDUDOOHOLPDJLQJ3(7&7ZDVDFTXLUHGDIWHUDGPLQLVWUDWLRQRI))'* ZKLFKIROORZHGE\ZLWKD05E\705,V\VWHPFRURQDO7ZHLJKWHGDQG67,5 VHTXHQFHVRIWKHHQWLUHERG\DQGVDJLWWDOLPDJLQJRIWKHVSLQHZHUHSHUIRUPHG 5HVXOWV6FOHURWLFERQHPHWDVWDVHVZHUHFRQÀUPHGLQSDWLHQWV:%05,EXW ZDVPLVVHGLQSDWLHQWGXULQJLQLWLDO3(7&7UHDGLQJ:%05,UDWHGOHVLRQV DVVXVSLFLRXVIRUPDOLJQDQF\RXWRIWKHPOHVLRQVWXUQHGRXWWREHPHWDVWDWLF 3(7&7 GHVFULEHG D QXPEHU RI OHVLRQV DV PHWDVWDWLF ZKLFK ZDV ORZHU DV FRPSDUHGWR:%05,0RVWPDOLJQDQWOHVLRQVPLVVHGE\3(7&7ZHUHORFDWHGLQ WKHH[WUHPLWLHV3(7&7ZDVPRUHVHQVLWLYHLQGHWHFWLQJPDOLJQDQWOHVLRQVRIWKH OXPEDU VSLQH :%05, Q YV 3(7&7 Q 7KH OHVLRQV PLVVHG E\ :%05, ZHUHORFDWHGLQWKHVSLQHQ DQGULEFDJHQ OHVLRQVZHUHLGHQWLÀHGDV EHQLJQGXULQJIROORZXS3(7&7UDWHGRIWKHVHOHVLRQVFRUUHFWO\DVSUREDEO\ EHQLJQ:%05,RQO\:%05,IDOVHO\GLDJQRVHGPHWDVWDWLFERQHGLVHDVHLQ RQHKHDOWK\SDWLHQW &RQFOXVLRQ:%05,GHOLQHDWHVPRUHVFOHURWLFERQHPHWDVWDVHVFRPSDUHGWR 3(7&7 % 'LDJQRVWLFDFFXUDF\RIYLUWXDO)'*3(7&7EURQFKRVFRS\IRUWKH GHWHFWLRQRIO\PSKQRGHPHWDVWDVHVLQQRQVPDOOFHOOOXQJFDQFHUSDWLHQWV 7 $+HXVQHU -7UHIIHUW%*HLJHU9+DUWXQJ0+HUEULN0)RUVWLQJ *$QWRFK'VVHOGRUI'(.QR[YLOOH71863ULQFHWRQ1-86 (VVHQ'(KHXVQHU#PHGXQLGXHVVHOGRUIGH 3XUSRVH 7KH DLP ZDV WR GHWHUPLQH D WKH GLDJQRVWLF DFFXUDF\ RI WKH )'* 3(7&7EURQFKRVFRS\IRUWKHGHWHFWLRQRIPHGLDVWLQDOKLODULQWHUOREDUDQGOREDU O\PSKQRGHPHWDVWDVHVLQQRQVPDOOFHOOOXQJFDQFHU16&/&SDWLHQWVEWKH VPDOOHVWEURQFKXVGLDPHWHUDFFHVVLEOHE\YLUWXDO)'*3(7&7EURQFKRVFRS\F WKHWLPHGXUDWLRQIURPVWDUWLQJWKHYLHZLQJWRROXQWLOYLUWXDO)'*3(7&7LPDJHV ZHUHGLVSOD\HG 0HWKRGV DQG 0DWHULDOV 16&/& SDWLHQWV XQGHUZHQW )'*3(7&7 )URP WKHVHVRXUFHGDWDYLUWXDO)'*3(7&7EURQFKRVFRSLHVZHUHUHFRQVWUXFWHG7KH WLPHGXUDWLRQIURPVWDUWLQJWKHWRROWLOOWKHGLVSOD\RIYLUWXDOEURQFKRVFRS\LPDJHV ZDVGHWHUPLQHG7KHGLDJQRVWLFDFFXUDF\RI)'*3(7&7EURQFKRVFRS\IRUWKH GHWHFWLRQRIUHJLRQDOO\PSKQRGHPHWDVWDVHVZDVHYDOXDWHGRQDOHVLRQEDVLV $[LDO )'*3(7&7VFDQVVHUYHGDVWKHVWDQGDUGRIUHIHUHQFH7KHVPDOOHVWEURQFKXV GLDPHWHUDFFHVVLEOHE\)'*3(7&7EURQFKRVFRS\ZDVPHDVXUHG 5HVXOWV 7KH VHQVLWLYLW\ VSHFLÀFLW\ SRVLWLYH SUHGLFWLYH YDOXH 339QHJDWLYH SUHGLFWLYH YDOXH 139 DQG DFFXUDF\ RI YLUWXDO )'*3(7&7 EURQFKRVFRS\ IRU WKHGHWHFWLRQRIO\PSKQRGHPHWDVWDVHVZDVDQG7KH PHDQVPDOOHVWGLDPHWHURIDFFHVVLEOHEURQFKLE\)'*3(7&7EURQFKRVFRS\ZDV PP7KHPHDQWLPHGXUDWLRQIURPVWDUWLQJWKHYLUWXDO)'*3(7&7EURQFKRVFRS\ WRROWLOOWKHGLVSOD\RIWKHLPDJHVZDVVHFRQGV &RQFOXVLRQ9LUWXDO´Á\WKURXJKµ')'*3(7&7EURQFKRVFRS\LVIHDVLEOHLQFOLQL FDOURXWLQH\LHOGVDUHODWLYHO\KLJKGLDJQRVWLFDFFXUDF\IRUWKHGHWHFWLRQRIUHJLRQDO O\PSKQRGHPHWDVWDVHVDQGKDVDFFHVVWREURQFKLHYHQLQWKHSHULSKHU\RIWKHOXQJ % (DUO\ERQHPDUURZ%0PHWDVWDVHVPHWDEROLFGDWDXVLQJ )ÁXRURGHR[\JOXFRVH)'*3(7&7YHUVXV&7LPDJLQJ $3DQXQ]LR/(YDQJHOLVWD$5&HUYLQR0*UHJLDQLQ*6DODGLQL 3 &0X]]LR53ROYHURVL3DGXD,7DQQDORULSDQXQ]LR#OLEHURLW 3XUSRVH7 RDVVHVVWKHGLDJQRVWLFUROHRI)'*3(7&7YV&7LQHDUO\PHWDVWDWLF GHSRVLWLQ%0 0HWKRGV DQG 0DWHULDOV SDWLHQWV ZLWK OXQJ FDQFHU ZLWK EUHDVW FDQFHUZLWKO\PSKRPDDQGZLWKPXOWLSOHP\HORPDZHUHUHWURVSHFWLYHO\ H[DPLQHG$OOSDWLHQWVXQGHUZHQW)'*3(7&7DQG&7IRUGLVHDVHHYDOXDWLRQ$W WKHWLPHRI3(7&7QRQHRIWKHSDWLHQWVZHUHUHFHLYLQJF\WRNLQHWKHUDS\ $OOVFDQV ZHUHUHYLHZHGE\DUDGLRORJLVWDQGDQXFOHDUPHGLFLQHSK\VLFLDQ%0PHWDVWDVHV ZHUHFRQÀUPHGE\VHTXHQWLDO3(7&7RU05,ZKHQDYDLODEOH7KHLPDJHVRI3(7 &7DQG&7ZHUHFRPSDUHG$SDWLHQWEDVHGDQDO\VLVZDVSHUIRUPHG 5HVXOWVSDWLHQWVKDGSRVLWLYHDQGQHJDWLYH&7VFDQZKHUHDV KDGSRVLWLYHDQGQHJDWLYH3(7&7IRUERQHOHVLRQV7KHLPDJ LQJÀQGLQJVZHUHFRQFRUGDQWLQSDWLHQWVZKLOHKDG GLVFRUGDQWLPDJLQJUHVXOWV&KLVTXDUHWHVWSFRQFRUGDQW SDWLHQWVKDG%0OHVLRQVDW3(7&7 ZKHUHDVRXWRISDWLHQWVKDG%0 LQYROYHPHQW7KHUHIRUH3(7&7ZDVDEOHWRLGHQWLI\SDWLHQWVZLWK FRQÀUPHG%0OHVLRQV,QWKHVHODWWHUSDWLHQWVWKHVWDQGDUGLVHGXSWDNHYDOXHIRU %0PHWDVWDVHVZDVUDQJHUHVXOWLQJZHDNO\KLJKHULQSDWLHQWV ZLWKQHJDWLYHWKDQSRVLWLYH&7VFDQYVUHVSHFWLYHO\WVWXGHQW WHVWS &RQFOXVLRQ3(7&7LVPRUHDFFXUDWHWKDQ&7LQGHWHFWLRQRI%0PHWDVWDVHVLWV LQFOXVLRQLQGLDJQRVWLFDOJRULWKPVFKDQJHGWKHVWDJLQJLQDERXWRISDWLHQWV 3(7&7GHWHFWV%0OHVLRQVGLUHFWO\EDVHGRQWKHLUGHJUHHRQPHWDEROLFDFWLYLW\ HLWKHUWKDQE\DOWHUHGDQDWRP\ % &7SURWRFROVLQ>)@)'*3(7&7H[DPLQDWLRQVLVWKHUHDQ DGGLWLRQDOEHQHÀWRIFRQWUDVWHQKDQFHG&7LQWKHGLIIHUHQWLDWLRQRI LQFLGHQWDOJDVWURLQWHVWLQDO)'*XSWDNH" &%UHQGOH&6FKUDPO7 .UDWW05HLPROG&3IDQQHQEHUJ 7ELQJHQ'(FRUQHOLDEUHQGOH#PHGXQLWXHELQJHQGH 3XUSRVH (YDOXDWLRQ RI WKH SRVVLEOH EHQHÀW RI FRQWUDVWHQKDQFHG &( &7L Q FRPSDULVRQWRORZGRVH,'&7LQ>)@)'*3(7&7IRUWKHIXUWKHUHYDOXDWLRQ RILQFLGHQWDOJDVWURLQWHVWLQDO)'*XSWDNH 0HWKRGVDQG0DWHULDOV)URPDGDWDEDVHRISDWLHQWVZLWK)'*3(7&7 DVXEJURXSRISDWLHQWVZLWKLQFLGHQWDOO\GHWHFWHGJDVWURLQWHVWLQDO3(7OHVLRQV DQG D 3(7&7 VFDQ LQFOXGLQJ D PXOWLSKDVH OG IRU$& &( &7 SURWRFRO ZDV UHWURVSHFWLYHO\DQDO\VHG7KH3(7OHVLRQVZHUHFDWHJRULVHGFRQFHUQLQJWKHLU&7 SDWWHUQVPDVVLQÁDPPDWLRQXQVSHFLÀFQRUPDOVHSDUDWHO\IRUERWK&7SURWRFROV 7KHLPDJLQJÀQGLQJVZHUHFRUUHODWHGZLWKWKHUHVXOWVRIHQGRVFRS\RUVXUJHU\ 5HVXOWVLQFLGHQWDOJDVWURLQWHVWLQDO3(7OHVLRQVZHUHIRXQGLQWKHJURXSRI SDWLHQWV7KH339IRUDFRUUHVSRQGLQJHQGRVFRSLFSDWKRORJ\LQWKHVHOHVLRQVZDV IRU&(&7DQG,'&7 $OOPDOLJQDQFLHVZHUHFRUUHFWO\GHWHFWHGE\&(&7 VHQVLWLYLW\LQFRPSDULVRQWRRQO\GHWHFWHGPDOLJQDQFLHVE\,'&7VHQVLWLYLW\ 3UHPDOLJQDQWOHVLRQVLQHQGRVFRS\ZHUHGHWHFWHGLQE\&(&7 DQGE\,'&7 WKHEHQLJQÀQGLQJVLQÁDPPDWLRQVDQGEHQLJQPDVVHVLQ E\&(&7DQGE\,'&7 7KHIDOVHQHJDWLYHUDWHLQ,'&7ZDVKLJKHUWKDQLQ &(&7YHUVXV)DOVHSRVLWLYHUHVXOWVGXHWRSK\VLRORJLFDO)'*XSWDNH OHVLRQVFRXOGEHH[FOXGHGQHLWKHUE\&(&7QRUE\,'&7 &RQFOXVLRQ&(&7SURYLGHVDGGLWLRQDOEHQHÀWLQGHWHFWLQJLQFLGHQWDOJDVWURLQWHV WLQDOPDOLJQDQFLHV+RZHYHUHQGRVFRS\RILQFLGHQWDOJDVWURLQWHVWLQDO3(7OHVLRQV FDQQRWEHVSDUHGGXHWRDVXEVWDQWLDOSHUFHQWDJHRIIDOVHQHJDWLYHUHVXOWVLQERWK &7SURWRFROVUHJDUGLQJSUHPDOLJQDQWDQGEHQLJQOHVLRQV % $GGLWLRQDOYDOXHRI´GXDOSKDVHµ))'*3(7&7LQUHFXUUHQW J\QDHFRORJLFDOPDOLJQDQFLHV *'ҋ$QJHOR3 0LUN95XÀQL0&DOFDJQL$'L/HJJH$7 HVWD*6FDPELD $*LRUGDQR/%RQRPR5RPH,7SPLUN#UPXQLFDWWLW 3XUSRVH 7 R SURVSHFWLYHO\ HYDOXDWH WKH XVHIXOQHVV RI ´GXDO SKDVHµ 3(7&7 LQ VXVSHFWHGUHFXUUHQFHVIURPJ\QDHFRORJLFDOPDOLJQDQFLHV 0HWKRGVDQG0DWHULDOVSDWLHQWVZLWKVXVSHFWHGUHFXUUHQFHVIURPSUHYLRXVO\ WUHDWHGJ\QDHFRORJLFDOFDQFHUXQGHUZHQWERWKZKROHERG\3(7&7DWKUDIWHU ))'*LQMHFWLRQVWDQGDUG3(7&7DQGGHOD\HG3(7&7RIWKHDEQRUPDODUHD DWKUVSRVW))'*LQMHFWLRQGXDOSKDVH3(7&7%HVLGHVTXDOLWDWLYHHYDOX 6FLHQWLILF6HVVLRQ 6 &$' ( ) *+% (XURSHDQ&RQJUHVVRI 5DGLRORJ\ YDOXHV!+8UHSUHVHQWLQJPRVWO\ERQHVWUXFWXUHVE\WLVVXHZLWKDFRQVWDQW YDOXHRI+8FRUUHVSRQGLQJWRVRIWWLVVXHWKHUHE\VLPXODWLQJFXUUHQW05GHULYHG $&PDSV7KHHUURURIPHDQVWDQGDUGLVHGXSWDNHYDOXH689PHDQRIRVVHRXV OHVLRQVDQGVRIWWLVVXHOHVLRQVDGMDFHQWWRERQHVIRUPRGLÀHG3(7LPDJHVZDV FDOFXODWHGXVLQJVWDQGDUG3(7LPDJHDVUHIHUHQFH 5HVXOWV 6XEVWLWXWLRQ RI ERQH E\ VRIW WLVVXH YDOXHV LQ$& PDSV UHVXOWHG LQ DQ XQGHUHVWLPDWLRQ RI 689PHDQ LQ RVVHRXV DQG VRIW WLVVXH OHVLRQV DGMDFHQW WR ERQHVRIPLQPD[DQGPLQPD[ UHVSHFWLYHO\$QDO\VLV RI WKH VSLQH DQG SHOYLF RVVHRXV OHVLRQV UHYHDOHG D VXEVWDQWLDO GHSHQGHQFH RI WKH HUURU RQ OHVLRQ FRPSRVLWLRQ )RUSUHGRPLQDQWO\ VFOHURWLFDQGRVWHRO\WLFVSLQHOHVLRQVWKHDYHUDJHXQGHUHVWLPDWLRQZDV DQGUHVSHFWLYHO\ &RQFOXVLRQ&7VLPXODWLRQRIWUHDWLQJERQHDVVRIWWLVVXHLQ05$&PDSVIRU3(7 OHDGVWRDVXEVWDQWLDOXQGHUHVWLPDWLRQRIWUDFHUXSWDNHLQERQHOHVLRQVDQGGHSHQGV RQOHVLRQFRPSRVLWLRQWKHODUJHVWHUURUEHLQJVHHQLQVFOHURWLFOHVLRQV7KHUHIRUH GHSLFWLRQRIFRUWLFDOERQHDQGFDOFLÀHGDUHDVLQ05$&PDSVLVQHFHVVDU\IRUDF FXUDWHTXDQWLÀFDWLRQRIWUDFHUXSWDNHYDOXHVLQ053(7LPDJLQJ 5RRP12 (PHUJHQF\5DGLRORJ\ 66 7UDXPDDQGFKHVWSDLQ 0RGHUDWRUV 53ROYHURVL3DGXD,7 +5LQJO9LHQQD$7 % :KROHERG\&7IRUWUDXPDVWUDWHJLHVWRMXVWLI\UDGLDWLRQGRVHXVLQJ WKHLQMXU\VHYHULW\VFRUH $$/HPRV5%UDPELOOD0)LUHWWR3 %LRQGHWWL0LODQ,7 DOHVVDQGUROHPRV#KRWPDLOFRP 3XUSRVH3DWLHQWVZKRKDYHVXVWDLQHGPXOWLSOHWUDXPDDUHRIWHQ\RXQJDQGWKH UDGLDWLRQ GRVHV FRQIHU D OLIHWLPH FDQFHU ULVN RI XS WR 7KHVH VFDQV KDYH WR EH IXOO\ MXVWLÀHG HLWKHU LQ WHUPV RI LPDJLQJ ÀQGLQJV RU LQ SRWHQWLDO FKDQJH LQ PDQDJHPHQW7KHSXUSRVHRIRXUVWXG\ZDVWRHYDOXDWHZKHWKHUWDUJHWHGUHJLRQ VSHFLÀF &7 IRFXVHG &7 FDQ UHSODFH ZKROH ERG\ &7 :%&7 XVLQJWKH ,QMXU\ 6HYHULW\6FRUH,66 0HWKRGVDQG0DWHULDOV$VHULHVRISDWLHQWVPHDQDJH\HDUVZHUH LQFOXGHG$OOSDWLHQWVXQGHUZHQW:%&7ZLWKDVOLFHVFDQQHUHTXLSSHGZLWKDQ DXWRPDWLFWXEHFXUUHQWPRGXODWLRQV\VWHP&DUH'RVH'7KH,66RIHDFKSDWLHQW ZDVUHWURVSHFWLYHO\HYDOXDWHGDQGFRPSDUHGWRWKHGLVFKDUJHGLDJQRVLV5DGLDWLRQ GRVHZDVFDOFXODWHGXVLQJDPDWKHPDWLFDOSKDQWRP,P3$&7&73DWLHQW'RVLPHWU\ &DOFXODWRUYHUVLRQ[ 5HVXOWV7KHHIIHFWLYHGRVHDVVRFLDWHGZLWK:%&7UDQJHGIURPWRP6Y GHSHQGLQJXSRQKRZPDQ\SKDVHVDUHLQFRUSRUDWHG7KHHIIHFWLYHGRVHIRUIRFXVHG &7UDQJHGIURPWRP6YGHSHQGLQJXSRQKRZH[WHQGHGLVWKH)29RI WKH:%&7VFDQVKDGDQ,66 DQGUHYHDOHGQRWUDXPDUHODWHGSDWKRORJ\ $QDO\VLVRIRXUGDWDFRQÀUPVWKDWPDQ\RIWKHVHQHJDWLYHVVFDQVZHUHFOLQLFDOO\ LQGLFDWHGEXWLQDSURSRUWLRQDPRUHIRFXVVHGVFDQDLPHGDWVSHFLÀFDUHDVRI FOLQLFDOFRQFHUQVZRXOGKDYHEHHQPRUHDSSURSULDWH &RQFOXVLRQ7KHDVVRFLDWHGUDGLDWLRQGRVHZLWK:%&7LVKLJKDQGSDWLHQWVVKRXOG EHFDUHIXOO\VHOHFWHGXVLQJWKH,66:KHQWKH,66LV DPRUHWDUJHWHGUHJLRQ VSHFLÀF&7LVUHFRPPHQGHG % 3URVSHFWLYHVWXG\RQLPPHGLDWHWRWDOERG\&7LQVHYHUHWUDXPDSDWLHQWV /) 0%HHQHQ-&6LHULQN7 3 6DOW]KHUU0-$05XVVFKHQ-6./XLWVH -&*RVOLQJV$PVWHUGDP1/OIEHHQHQ#DPFXYDQO 3XUSRVH,QSRO\WUDXPDSDWLHQWVUDSLGDQGDGHTXDWHHYDOXDWLRQRILQMXULHVLVHVVHQ WLDO,QUHFHQW\HDUVDWHQGHQF\WRXVHWRWDOERG\&77%&7LQWUDXPDKDVEHFRPH DSSDUHQW $QLQWHUQDWLRQDOPXOWLFHQWHUUDQGRPLVHGWULDO5($&7KDVEHHQLQLWLDWHG WRGHWHUPLQHWKHHIIHFWRILPPHGLDWH7%&7LQVHYHUHWUDXPDSDWLHQWV7KHDLPRI RXUSLORWVWXG\ZDVWRHYDOXDWHWKHZRUNXSRILPPHGLDWH7%&7LQWUDXPDSDWLHQWV 0HWKRGV DQG 0DWHULDOV$OO WUDXPD SDWLHQWV PHHWLQJ WKH LQFOXVLRQ FULWHULD DQG DGPLWWHGWRRXUKRVSLWDOLQWKHSHULRG-DQXDU\$SULOZHUHHYDOXDWHG ,QFOXVLRQFULWHULDZHUHVXVSLFLRQRIVHYHUHLQMXU\EDVHGRQSUHGHÀQHGYLWDOSDUDP HWHUVRUFOLQLFDOO\ VXVSLFLRXV GLDJQRVLV ([FOXVLRQ FULWHULD ZHUH DJH \HDUV NQRZQSUHJQDQF\UHIHUUDOIURPRWKHUKRVSLWDOVRU&35UHTXLUHG,QFOXGHGSDWLHQWV % 'RHVVLPXOWDQHRXVLPDJHDFTXLVLWLRQE\DK\EULG053(7V\VWHP UHVXOWLQDEHWWHUUHJLVWUDWLRQTXDOLW\RI3(7DQGPRUSKRORJLFGDWD FRPSDUHGWRVHTXHQWLDOLPDJHDFTXLVLWLRQE\3(7&7" &%UHQGOH&3IDQQHQEHUJ+6FKPLGW&:XHUVOLQ16FKZHQ]HU 7ELQJHQ'(FRUQHOLDEUHQGOH#PHGXQLWXHELQJHQGH 3XUSRVH5HFHQWO\HVWDEOLVKHGK\EULG053(7DOORZVIRUVLPXOWDQHRXVDFTXLVLWLRQ RI3(7DQG05GDWDLQFRQWUDVWWRFRQYHQWLRQDOVHTXHQWLDO3(7&7 7KHSXUSRVH RIWKLVVWXG\ZDVWRHYDOXDWHWKHUHJLVWUDWLRQTXDOLW\RI053(7FRPSDUHGWR3(7 &7LQDEGRPLQDORUJDQV 0HWKRGVDQG0DWHULDOV7KHGDWDVHWVRISDWLHQWVZLWK05>)@)'*3(7 DQG>)@)'*3(7&7H[DPLQDWLRQVDWWKHVDPHGD\ZHUHVHSDUDWHO\IXVHGE\ DXWRPDWLFULJLGUHJLVWUDWLRQDQGWKHQGLVSOD\HGRQDYLHZLQJVWDWLRQ7UXH'6LH PHQV+HDOWKFDUH(UODQJHQ*HUPDQ\7KHH[WHULRUVOLFHSRVLWLRQVRIOLYHUVSOHHQ NLGQH\VDQGXULQDU\EODGGHUZHUHDVVLJQHGEOLQGHGIRUWKHWZR3(7DQGWKHWZR PRUSKRORJLFGDWDVHWVLQ[\DQG]GLUHFWLRQ&XPXODWLYHGHYLDWLRQYHFWRUVRIWKH DOLJQPHQWZHUHFDOFXODWHGIRUHDFKRUJDQDQGERWKPRGDOLWLHV6LJQLÀFDQFHZDV WHVWHGZLWK:LOFR[RQWHVW 5HVXOWV7KHDOLJQPHQWLQ053(7DVZHOODV3(7&7LPDJHVZDVYHU\H[DFW 7KHPHDQFXPXODWLYHGHYLDWLRQPPRI053(73(7&7ZDVIRUOLYHUS IRUVSOHHQS IRUULJKWNLGQH\S IRU OHIWNLGQH\S DQGIRUXULQDU\EODGGHUS 3(7&7VKRZHG GLVWLQFWO\ZRUVHDOLJQPHQWRIWKHGDWDIRURQHSDWLHQWLQWKHXSSHUDEGRPLQDORUJDQV DQGIRUDQRWKHUSDWLHQWLQWKHXULQDU\EODGGHU &RQFOXVLRQ,QVLQJOHFDVHV3(7&7VKRZVODUJHGHYLDWLRQVRIWKHZKROHGDWD VHW7KHVLPXOWDQHRXVGDWDDFTXLVLWLRQRIK\EULG053(7OHDGVWRDVLJQLÀFDQWO\ LPSURYHGDOLJQPHQWRIPHWDEROLFDQGPRUSKRORJLFGDWDVHWVLQWKHOLYHUDQGXULQDU\ EODGGHUDQGFDQUHGXFHDQDWRPLFDOGHYLDWLRQVGXHWREUHDWKLQJDQGSDWLHQWPRYH PHQWDVZHOODVGLIIHUHQWÀOOLQJVWDWHVRIWKHXULQDU\EODGGHU % 0ROHFXODULPDJLQJRIEUHDVWWXPRXUVZLWK053(7 .3LQNHU'RPHQLJ+%LFNHO:%RJQHU6*UXEHU+0DJRPHWVFKQLJJ %%UXHFN06FKHUQWKDQHU7 ++HOELFK9LHQQD$7 NDWMDSLQNHU#PHGXQLZLHQDFDW 3XUSRVH7 RSURYHWKDWWKDWPROHFXODULPDJLQJRIEUHDVWWXPRXUVZLWKSURWRQ05 VSHFWURVFRS\GLIIXVLRQZHLJKWHGLPDJLQJFRQWUDVWHQKDQFHG05,DQGSRVLWURQ HPLVVLRQWRPRJUDSK\LPSURYHVGLDJQRVWLFDFFXUDF\VHQVLWLYLW\DQGVSHFLÀFLW\LQ FDQFHUGLDJQRVLV 0HWKRGVDQG0DWHULDOVSDWLHQWVZLWKDVXVSLFLRXVEUHDVWZHUHLQFOXGHGLQ WKLV,5%DSSURYHGSURVSHFWLYHVWXG\$OOSDWLHQWVZHUHH[DPLQHGZLWKGHGLFDWHG )'*3(7&7DQG7PXOWLSDUDPHWULF05,RIWKHEUHDVW05,SURWRFROLQFOXGHG DGLIIXVLRQZHLJKWHGVHTXHQFH':,D7ZVHTXHQFHDQGDFRQWUDVWHQKDQFHG '7ZVHTXHQFH&(05,EHIRUHDQGDIWHUDSSOLFDWLRQRIDVWDQGDUGGRVH*G '27$$IWHULQMHFWLRQRIDSSUR[0%T))'*EDVHGRQWKHSDWLHQWVZHLJKW 3(7&7ZDVDFTXLUHGLQWKHSURQHSRVLWLRQDOORZLQJWKHVDPHSDWLHQWJHRPHWU\ LQ EUHDVW 05, &7 GDWD ZHUH XVHG IRU DWWHQXDWLRQ FRUUHFWLRQ &RUHJLVWUDWLRQ RI LPDJLQJGDWDDQGLPDJHIXVLRQZHUHSHUIRUPHG053(7ZDVDVVHVVHGIRUOHVLRQ PRUSKRORJ\DQG(+NLQHWLFVDFFRUGLQJWR%,5$'6UHVWULFWHGGLIIXVLYLW\LQFUHDVHG &KROLQH&KROHYHOVDQG)'*DYLGLW\ $Q $'&WKUHVKROG[PPVDQG DVLJQDOWRQRLVHUDWLRRIWKH&KRUHVRQDQFHSHDN!ZHUHGHÀQHGDVDPDUNHU RIPDOLJQDQF\/HVLRQVFODVVLÀHGDVSRVLWLYHZKHQ))'*XSWDNHZDVJUHDWHU WKDQEORRGSRRODFWLYLW\$OOOHVLRQVZHUHKLVWRSDWKRORJLFDOO\YHULÀHG 5HVXOWV0XOWLPRGDOPXOWLSDUDPHWULF053(7DFKLHYHGDQH[FHOOHQWVHQVLWLYLW\RI DQGJRRGVSHFLÀFLW\RILQWKHGLDJQRVLVRIEUHDVWFDQFHU'LDJQRVWLF DFFXUDF\ZDV053(7LQFUHDVHGVHQVLWLYLW\LQWKHGLDJQRVLVRIO\PSKQRGH PHWDVWDVHVIURPWRFRPSDUHGWR05,DORQH &RQFOXVLRQ 0ROHFXODU LPDJLQJ RI EUHDVW OHVLRQV ZLWK 053(7 LQFUHDVHV VHQ VLWLYLW\VSHFLÀFLW\DQGGLDJQRVWLFDFFXUDF\LQWKHGLDJQRVLVRIEUHDVWFDQFHUDQG O\PSKQRGHPHWDVWDVHV % %RQHWLVVXHDQGERG\UHJLRQVSHFLÀFYDULDELOLW\RIHUURUVLQ689 YDOXHVLPSOLFDWLRQVRQDWWHQXDWLRQFRUUHFWLRQPHWKRGVLQ053(7 $6DPDULQ&%XUJHU':&URRN,$%XUJHU'7 6FKPLG *.YRQ6FKXOWKHVV) 3 .XKQ=XULFK&+DQGUHLVDPDULQ#UHJLRQDDOKDLJODHH 3XUSRVH7KHSXUSRVHRIWKLVVWXG\ZDVWRHYDOXDWHWKHQHHGIRUDFFXUDWHERQH VHJPHQWDWLRQLQ05EDVHG$&IRUZKROHERG\053(7LPDJLQJ 0HWKRGVDQG0DWHULDOV,QSDWLHQWVZKRXQGHUZHQWLQWHJUDWHGVHTXHQWLDO3(7 &7705LPDJLQJPRGLÀHG&7 $&PDSVZHUHSURGXFHGE\UHSODFLQJSL[HOVZLWK 6FLHQWLILF6HVVLRQ $ 6&'()*+%(XURSHDQ&RQJUHVVRI 5DGLRORJ\ )ULGD\ % 7KHYROXPHRIIUHHLQWUDSHULWRQHDOÁXLGLQÁXHQFHVWKHVHQVLWLYLW\ RISULPDU\IRFXVHGDVVHVVPHQWZLWKVRQRJUDSK\LQWUDXPD)$67 ZKHUHDVUDGLRORJLVWҋVH[SHULHQFHGRHVQRW 5-9/RHNNH$6FKXO]6*URYHQ&*DDUGHU3 $1DHVV-%'RUPDJHQ 2VOR12 3XUSRVH)RFXVHGDVVHVVPHQWZLWKVRQRJUDSK\LQWUDXPD)$67LVDUDSLGQRQ LQYDVLYHPHWKRGGHVLJQHGWRGHWHFWIUHHLQWUDSHULWRQHDOÁXLGLQWUDXPDSDWLHQWV +RZHYHULQUHFHQW\HDUVVRPHVWXGLHVRQWKHVHQVLWLYLW\RI)$67UHSRUWYDOXHV EHORZ7KHDLPRIWKLVVWXG\ZDVWRHYDOXDWHKRZWKHYROXPHRILQWUDSHULWR QHDOIUHHÁXLGDQGWKHUDGLRORJLVWҋVH[SHULHQFHLQÁXHQFHWKHVHQVLWLYLW\RI)$67 0HWKRGVDQG0DWHULDOV2YHUDWZR\HDUSHULRGWUDXPDSDWLHQWVXQGHUZHQW )$67 SHUIRUPHG E\ UDGLRORJLVWV ZLWK GLIIHUHQW OHYHOV RI H[SHULHQFH WR PRQWKVSHUIRUPLQJWRH[DPVHDFK&7YROXPHWU\GLDJQRVWLFSHULWRQHDOODY DJHODSDURWRP\DQGFOLQLFDOREVHUYDWLRQZHUHFRQVLGHUHGWKHUHIHUHQFHVWDQGDUGLQ DQGSDWLHQWVUHVSHFWLYHO\)$67UHVXOWVZHUHFRUUHODWHGZLWKIRXU GLIIHUHQWOHYHOVRIEORRGYROXPHQHJOLJLEOHDQGPODQGZLWKWKUHH GLIIHUHQWOHYHOVRIH[SHULHQFHZLWK)$67OHVVWKDQPRQWKVWRPRQWKV DQGPRUHWKDQPRQWKV 5HVXOWV)$67VHQVLWLYLW\ZDVVSHFLÀFLW\ZDVSRVLWLYHDQGQHJDWLYH SUHGLFWLYHYDOXHVZHUHDQGDQGDFFXUDF\ZDVIRUWKHZKROHVWXG\ SRSXODWLRQ :LWK LQFUHDVLQJ YROXPHV RI LQWUDSHULWRQHDO ÁXLG )$67 VHQVLWLYLW\ LQ FUHDVHGVXFFHVVLYHO\WRDWPO,QWKHVXEJURXSRISDWLHQWVZLWKDYROXPH RI PO DW &7 YROXPHWU\ VHQVLWLYLW\ ZDV DQG UHDFKHG IRU YROXPHV RYHUPO7KHUDGLRORJLVWҋVH[SHULHQFHGLGQRWLQÁXHQFHWKHVHQVLWLYLW\RI)$67 VLJQLÀFDQWO\LUUHVSHFWLYHO\RIWKHPHDVXUHGYROXPH &RQFOXVLRQ7KHYROXPHRIIUHHLQWUDSHULWRQHDOÁXLGLQÁXHQFHVDFFXUDF\RI)$67 ZKHUHDVWKHUDGLRORJLVWҋVH[SHULHQFHGRHVQRW % &RURQDU\DWKHURVFOHURVLVLQFRFDLQHDEXVHUVSUHVHQWLQJZLWKDFXWH FKHVWSDLQFKDUDFWHULVDWLRQZLWKFRURQDU\&7DQJLRJUDSK\ +(EHUVEHUJHU 66XGDUVNL8-6FKRHSI) 7ULFDULFR59OLHJHQWKDUW *) +HDGGHQ$/HEHU(+RIIPDQQ3 $SIDOWUHU&KDUOHVWRQ6&86 0XQLFK'(HEHUVEHUJHU#JP[QHW 3XUSRVH&RFDLQHDVVRFLDWHGFKHVWSDLQDFFRXQWVIRUDVXEVWDQWLDOSURSRUWLRQRI HPHUJHQF\GHSDUWPHQW('YLVLWV6XFKSDWLHQWVDUHNQRZQWREHDWLQFUHDVHGULVN IRUDFXWHFRURQDU\V\QGURPH$&6:HDLPHGWRXVHFRURQDU\&7DQJLRJUDSK\ WRHYDOXDWHWKHSUHYDOHQFHH[WHQWDQGFRPSRVLWLRQRIDWKHURVFOHURWLFOHVLRQVLQ SDWLHQWVZLWKDFXWHFKHVWSDLQDQGKLVWRU\RIFRFDLQHDEXVH 0HWKRGVDQG0DWHULDOVSDWLHQWVPHQ\UVZLWKDKLVWRU\RIFRFDLQH DEXVHXQGHUDFXWHLQÁXHQFHZKRKDGXQGHUJRQHFRURQDU\&7DQJLRJUDSK\ IRUDFXWHFKHVWSDLQZHUHLQFOXGHG(DFKFRURQDU\DUWHU\VHJPHQWZDVHYDOXDWHG IRUWKHSUHVHQFHRIDWKHURVFOHURWLFSODTXHFRPSRVLWLRQFDOFLÀHGQRQFDOFLÀHG PL[HGDQGWKHSUHVHQFHDQGGHJUHHRIVWHQRVLV)LQGLQJVZHUHFRPSDUHGZLWKD PDWFKHGFRQWUROFRKRUWPHQ\UVZLWKRXWDKLVWRU\RIGUXJDEXVHXVLQJ 7DQG&KLVTXDUHWHVWLQJ 5HVXOWV7KHUHZDVQRVLJQLÀFDQWGLIIHUHQFHEHWZHHQSDWLHQWVZLWKDQGZLWKRXWKLV WRU\RIFRFDLQHDEXVHZLWKUHVSHFWWRWKHSUHVHQFHRIVLJQLÀFDQWVWHQRVLV YVS!+LVWRU\RIFRFDLQHXVHZDVQRWDVVRFLDWHGZLWKDKLJKHU SUHYDOHQFHRIRYHUDOOSODTXHYVS!FDOFLÀHGSODTXH YVS!RUQRQFDOFLÀHGSODTXHYV S!+RZHYHUSDWLHQWVZLWKKLVWRU\RIFRFDLQHDEXVHKDGDKLJKHUSUHYDOHQFH RIPL[HGSODTXHYVS &RQFOXVLRQ+LJKHUULVNIRU$&6LQSDWLHQWVZLWKDKLVWRU\RIFRFDLQHDEXVHPLJKW EHDVVRFLDWHGZLWKDKLJKHUSUHYDOHQFHRIPL[HGFRURQDU\DWKHURVFOHURWLFSODTXH 7KLVDVVRFLDWLRQPD\EHH[SODLQHGE\WKHPHFKDQLFDOSURSHUWLHVRIPL[HGSODTXH ZKLFKPD\SUHGLVSRVHWRUXSWXUHGXULQJFRFDLQHLQGXFHGYDVRVSDVP % 6WDQGDUGYVKLJKSLWFK&7RIWKHFKHVWLQYHQWLODWHGSDWLHQWV FRPSDULVRQRIPRWLRQDUWHIDFWVLPDJHQRLVHDQGHIIHFWLYHGRVH ) 6FKZDU]7 *RHO]$$UQROGL.1LNRODRX0) 5HLVHU&+%HFNHU 0XQLFK'(ÁRULDQVFKZDU]#PHGOPXGH 3XUSRVH7 RFRPSDUHPRWLRQDUWHIDFWVLPDJHQRLVHDQGHIIHFWLYHGRVHEHWZHHQ DKLJKSLWFKDQGDURXWLQHFKHVW&7SURWRFROLQYHQWLODWHGSDWLHQWV 0HWKRGV DQG 0DWHULDOV$OO DQDO\VHG VWXGLHV ZHUH SHUIRUPHG RQ D VOLFH &7V\VWHP FRQVHFXWLYH YHQWLODWHG SDWLHQWV ZKR XQGHUZHQW KLJKSLWFK FKHVW &7S ZHUHLQFOXGHGLQWKLVDQDO\VLV$VFRQWUROJURXSYHQWLODWHGSDWLHQWV PDWFKHGIRUVH[DQGERG\PDVVLQGH[%0,ZKRKDGXQGHUJRQHURXWLQHFKHVW&7 XQGHUZHQWDQLPPHGLDWH7%&7IURPYHUWH[WRSXELFV\PSK\VLV)RUWKHÀUVW SDWLHQWVGXULQJGD\WLPHVHYHUDOFOLQLFDOLPSRUWDQWWLPHSRLQWVZHUHUHJLVWHUHG 5HVXOWV,QWRWDOSDWLHQWVZHUHLQFOXGHGRIZKLFKZHUHPDOHVKDG EOXQWWUDXPD0HGLDQDJHZDV\HDUVPHGLDQ,QMXU\6HYHULW\6FRUHZDV $IWHU7%&7SDWLHQWVUHFHLYHGDGGLWLRQDOLPDJLQJDQGXQGHUZHQWUDGLRORJLFDO RU VXUJLFDO LQWHUYHQWLRQ 0HGLDQ WLPH WR LPDJLQJ ZDV PLQ DFTXLVLWLRQ WLPH PLQDOOGLDJQRVHVZHUHNQRZQPLQDIWHUDGPLVVLRQ0RUWDOLW\LQWKH SDWLHQWVZDV &RQFOXVLRQ:LWKWKHXVHRILPPHGLDWH7%&7LQVHYHUHWUDXPDSDWLHQWVFRPSOHWH GLDJQRVHVFDQEHDFKLHYHGZLWKLQPLQXWHV % 8OWUDVRXQGIROORZXSRISRO\WUDXPDSDWLHQWVDIWHULQLWLDOFRPSXWHG WRPRJUDSK\DQDQDO\VLVRIUROHDQGFRVWV 0+0DXUHU$:LQNOHU03RZHUVNL) (OJHWL%+DPP55RHWWJHQ 7 0DUQLW]%HUOLQ'(PDUWLQPDXUHU#FKDULWHGH 3XUSRVH7 RDVVHVVWKHFRVWVDQGGLDJQRVWLFJDLQRIDEGRPLQDOXOWUDVRXQGIROORZXS RISRO\WUDXPDSDWLHQWVLQLWLDOO\H[DPLQHGE\ZKROHERG\FRPSXWHGWRPRJUDSK\&7 0HWKRGVDQG0DWHULDOV $WRWDORISRO\WUDXPDSDWLHQWVPHQZRPHQ DJH\HDUVZHUHUHWURVSHFWLYHO\DQDO\VHGZLWKUHJDUGWRVXSSOHPHQWDU\ DQGQHZÀQGLQJVREWDLQHGE\XOWUDVRXQGIROORZXSFRPSDUHGZLWKWKHUHVXOWVRI H[SORUDWRU\)$67IRFXVHGDVVHVVPHQWZLWKVRQRJUDSK\IRUWUDXPDRQDGPLVVLRQ DQGWKHÀQGLQJVRIZKROHERG\&7 $SURFHVVPRGHOZDVXVHGWRGRFXPHQWWKH VWDIIPDWHULDODQGWRWDOFRVWVRIWKHXOWUDVRXQGIROORZXSH[DPLQDWLRQV 5HVXOWV )$67 \LHOGHG DEGRPLQDO ÀQGLQJV RUJDQ LQMXU\ DQGRU IUHH LQWUD DEGRPLQDOÁXLGLQSDWLHQWVZKLOHWKHDEGRPLQDOVFDQRIZKROHERG\&7UH YHDOHGÀQGLQJVLQSDWLHQWV)$67KDGVHQVLWLYLW\DQGVSHFLÀFLW\ )ROORZXSXOWUDVRXQGH[DPLQDWLRQVUHYHDOHGQHZÀQGLQJVLQWZRRIWKHSDWLHQWV ZLWKDEGRPLQDOLQMXULHVGHWHFWHGDWLQLWLDO&7 ,QWKHSDWLHQWVZLWKRXWDEGRPLQDO LQMXULHVRQWKHLQLWLDO&7VFDQXOWUDVRXQGIROORZXS\LHOGHGQRVXSSOHPHQWDU\RU QHZÀQGLQJV7KHWRWDOFRVWVRIDQXOWUDVRXQGIROORZXSH[DPLQDWLRQZHUH(85 7KHWRWDOFRVWVRIDOOIROORZXSXOWUDVRXQGH[DPLQDWLRQVSHUIRUPHGLQWKH VWXG\SRSXODWLRQZHUH(85 &RQFOXVLRQ)ROORZXSDEGRPLQDOXOWUDVRXQGVKRZVDYHU\ORZRYHUDOOGLDJQRVWLF JDLQLQSRO\WUDXPDSDWLHQWVLQZKRPLQLWLDO&7IDLOVWRGHWHFWDQ\DEGRPLQDOLQMX ULHVEXWFDXVHVKLJKSHUVRQQHOH[SHQVHVIRUUDGLRORJLFGHSDUWPHQWV,QFRQWUDVW VRQRJUDSKLFIROORZXSDSSHDUVWREHLQGLVSHQVDEOHLQSDWLHQWVGLDJQRVHGZLWKDQ DEGRPLQDOLQMXU\RQDGPLVVLRQ % 7KHYDOXHRIFRQWUDVWHQKDQFHGXOWUDVRXQG&(86LQWKHIROORZXS RISRVWWUDXPDWLFDEGRPLQDOLQMXULHVVXEPLWWHGWRQRQRSHUDWLYH PDQDJHPHQW ) 3LQWR5)DULQD$3LQWR&$FDPSRUD/5RPDQR1DSOHV,7 ISLQWR #OLEHURLW 3XUSRVH 7 R HYDOXDWH WKH UROH RI FRQWUDVWHQKDQFHG XOWUDVRXQG &(86 LQW K H IROORZXSRISRVWWUDXPDWLFDEGRPLQDOLQMXULHVQRQRSHUDWLYHO\PDQDJHG 0HWKRGVDQG0DWHULDOV2QHKXQGUHGDQGIRUW\WZRSDWLHQWVPDOHVDQG IHPDOHVDJHUDQJH\HDUVROGZLWKSRVWWUDXPDWLFLQMXULHVRIVROLGDEGRPLQDO RUJDQVZHUHIROORZHGXSE\PHDQVRI&(86$OOWKHGLDJQRVWLFH[DPVZHUHSHU IRUPHGDWYDULDEOHWLPHLQWHUYDOVLQWKHUDQJHEHWZHHQDQGGD\VIURPSDWLHQWV KRVSLWDOLVDWLRQGHSHQGLQJRQWKHFOLQLFDOQHHGVDQGXQWLOFRPSOHWHFOLQLFDOUHVROX WLRQZDVUHDFKHG/RZPHFKDQLFDOLQGH[WHFKQLTXHVDQGDVXOSKXUKH[DÁXRULGH ÀOOHGPLFUREXEEOHVFRQWUDVWDJHQWZHUHXVHG$IWHUGD\VDIWHUWUDXPDDOOWKH HQUROOHGSDWLHQWVDOVRXQGHUZHQWDPXOWLGHWHFWRUFRPSXWHGWRPRJUDSK\0'&7 DEGRPLQDOH[DP 5HVXOWV$W &(86 WKH DEVHQFH RI YDVFXODU FRPSOLFDWLRQ ZDV VHHQ LQ FDVHV XQWLO FRPSOHWH FOLQLFDO UHVROXWLRQ LQ WKHVH SDWLHQWV QRQRSHUDWLYH PDQDJHPHQWZDVIDYRXUDEOH,QFDVHVDQKHSDWLFSVHXGRDQHXU\VP ZDVGHWHFWHGDW&(86VXEVHTXHQWDQJLRJUDSKLFHPEROLVDWLRQZDVVXFFHVVIXOO\ SHUIRUPHG,QFDVHV&(86GHSLFWHGZLGHFRQWUDVWDJHQWH[WUDYD VDWLRQ RU SRROLQJ ERWK LQ WKH VSOHQLF RUJDQ DQG RXW WKH FDSVXOH DOO RI WKHVH SDWLHQWVXQGHUZHQWVXEVHTXHQWHPHUJHQWVSOHQHFWRP\)LQDOO\LQ FDVHVDVSOHQLFDUWHURYHQRXVÀVWXODZDVVHHQDW&(86VXEVHTXHQWDQJLRJUDSKLF HPEROLVDWLRQZDVSHUIRUPHG &RQFOXVLRQ&(86UHSUHVHQWVDQDFFXUDWHWHFKQLTXHLQWKHHYDOXDWLRQRISRVW WUDXPDWLF LQMXULHV RI VROLG DEGRPLQDO RUJDQV 7KH WHFKQLTXH LVQRW RQO\ DEOH WR GHWHFW DFWLYH EOHHGLQJ DQG YDVFXODU OHVLRQV DYRLGLQJ RYHUH[SRVXUH WR LRQLVLQJ UDGLDWLRQ EXW DOVR SURYHV SDUWLFXODUO\ XVHIXO IRU PRQLWRULQJ SDWLHQWV XQGHUJRLQJ QRQRSHUDWLYHPDQDJHPHQW 6FLHQWLILF6HVVLRQ 6 &$' ( ) *+% (XURSHDQ&RQJUHVVRI 5DGLRORJ\ &RQFOXVLRQ0'&7GHSLFWVDQH[FHOOHQWLPDJLQJPHWKRGWRHYDOXDWHDFXWHDRUWLF GLVHDVHV DQG UHSUHVHQWV D IXQGDPHQWDO WRRO WR SURSHUO\ VWUDWLI\ SDWLHQWV LQ WKLV FULWLFDOVLWXDWLRQ % (PHUJHQF\&73$SHUIRUPHGLQRQH\HDUFOLQLFDOUHVXOWV &0DUWLQR*$=DPERQL*6DOYDJQR53R]]L0XFHOOL9HURQD,7 J]DPERQL#KRWPDLOFRP 3XUSRVH7 RUHYLHZWKH&73$VFDQVSHUIRUPHGRQSDWLHQWVZLWKFOLQLFDOVXVSLFLRQ RIDFXWH3(LQRQH\HDUDQGDVVHVVÀQDOGLDJQRVLVDQGSUHVHQFHRIXQH[SHFWHG ÀQGLQJV 0HWKRGVDQG0DWHULDOV$OOWKHHPHUJHQF\&73$VFDQVSHUIRUPHGLQPRQWKV -DQXDU\'HFHPEHUZHUHUHYLHZHGDQGHYDOXDWHGIRUWKHSUHVHQFHRISXOPR QDU\HPEROLVPDQGRURWKHUWKRUDFLFÀQGLQJV7KHSUHVHQFHRI3(ZDVFRUUHODWHG WR''LPHUOHYHOV:KHQWKHDEGRPHQZDVVFDQQHGWRVHDUFKIRUWKURPERVLVWKH SUHVHQFHRIWKURPERVLVDQGRURWKHUDEGRPLQDOÀQGLQJVZDVDVVHVVHG 5HVXOWV 2YHU PRQWKV HPHUJHQF\ &73$ VFDQV ZHUH SHUIRUPHG )0PHDQDJH\HDUVSDWLHQWVKDG''LPHU!QJGO SDWLHQWVZHUHGLDJQRVHGZLWK3(LQYROYLQJWKHSXOPRQDU\WUXQNWKH PDLQSXOPRQDU\DUWHULHVRUOREDUDUWHULHVSDWLHQWVKDG''LPHU!QJ GO,QSDWLHQWVWKHDEGRPHQZDVVFDQQHGFDVHVRI'97ZHUHREVHUYHG &ROODWHUDOÀQGLQJVLQWKHVHSDWLHQWVZLWK3(LQFOXGHGSOHXUDOHIIXVLRQ SDUHQFK\PDOFRQVROLGDWLRQDQGWXPRXUVVFDQVZHUHQHJDWLYH IRU3(SDWLHQWVKDGQRVLJQLÀFDQWÀQGLQJVDW&7 ZKLOHKDGSOHXUDOHI IXVLRQDQGRUSDUHQFK\PDOFRQVROLGDWLRQDQGRUWXPRXUV SDWLHQWVKDG''LPHU!QJGO,QWKHDEGRPHQZDVVFDQQHGFDVHV RI'97ZHUHREVHUYHG &RQFOXVLRQ(YHQLQDSRSXODWLRQZLWKDUHODWLYHO\KLJKSUHYDOHQFHRI3(PRVW RIWKHSDWLHQWVZKRXQGHUJR&73$IRUFOLQLFDOO\VXVSHFWHG3(ZLOOQRWKDYH3( 6FDQQLQJWKHDEGRPHQWRVHDUFKIRU'97VKRZVD'97SUHYDOHQFHDURXQG ERWKLQSDWLHQWVZLWKDQGZLWKRXW3( 5RRP3 5DGLRJUDSKHUV 66 ([SHULHQFLQJWKHFRPSOH[LW\RIWKHUDGLRJUDSKHUVҋ UROH 0RGHUDWRUV :+HLQGHO0QVWHU'( .1pPHWK%XGDSHVW+8 % (GXFDWLRQDOSURJUDPPHIRUUDGLRJUDSK\VWXGHQWVDW&7 .+HJJHQ(-RKDQVHQ56LONRVHW2VOR12NBOLYHOWHQ#KRWPDLOFRP 3XUSRVH $QHGXFDWLRQDOSURJUDPZDVGHVLJQHGWRLPSURYHUHOHYDQWFRPSHWHQFHLQ EUDLQDQDWRP\SDWKRORJ\&7WHFKQLTXHDQGSK\VLFVDPRQJUDGLRJUDSK\VWXGHQWV WUDLQLQJDW2VOR8QLYHUVLW\+RVSLWDO8OOHYnO 0HWKRGVDQG0DWHULDOV7KHHGXFDWLRQDOSURJUDPFRQVLVWHGRIOHFWXUHVDFRP SHQGLXPSUDFWLFDOOHVVRQVDQGFRPSHWHQFHWHVWLQJ7KHOHFWXUHVDQGFRPSHQGLXP IRFXVHGRQEUDLQDQDWRP\SDWKRORJ\&7WHFKQLTXHDQGSK\VLFV$OOVHFRQG\HDU UDGLRJUDSK\VWXGHQWVDWWKH8QLYHUVLW\&ROOHJHLQ2VORFRPSOHWHGWKHVDPHFRP SHWHQFHWHVWVEHIRUHDQGDIWHUWKHLUKRVSLWDOWUDLQLQJ7KLVDOORZVDFRPSDULVRQRI WKHFRPSHWHQFHLPSURYHPHQWDPRQJVWXGHQWVZKRIROORZHGWKHHGXFDWLRQDOSUR JUDPZLWKVWXGHQWVWUDLQLQJHOVHZKHUHWKHFRQWUROJURXS7KHVHFRQG\HDUFODVV FRPSULVHVVWXGHQWVWRRNWKHLQLWLDOWHVW2XWRIWKLVQXPEHUSDUWLFLSDWHG LQWKHSURMHFWZKLOHWKHUHPDLQLQJWKHFRQWUROJURXSGLGQRWVWXGHQWVWRRN WKHÀQDOWHVWVWXGHQWVZKRDFWXDOO\WRRNSDUWLQWKHSURMHFWRSWHGRXWRIWKHÀQDO WHVWUHGXFLQJWKHQXPEHUWRZKLOHWKHQXPEHURIVWXGHQWVLQWKHFRQWUROJURXS ZDVLQFUHDVHGWREHFDXVHVWXGHQWVZKRGLGQRWWDNHWKHLQLWLDOWHVWMRLQHGWKH FRQWUROJURXSDWWKHÀQDOWHVW 5HVXOWV 5DGLRJUDSK\ VWXGHQWV ZKR SDUWLFLSDWHG LQ WKH HGXFDWLRQDO SURJUDP LPSURYHGWKHLUWHVWVFRUHIURPWRZKLOHWKHFRQWUROJURXSLPSURYHGWKHLU VFRUHIURPWR &RQFOXVLRQ 7KLV VWXG\ GHPRQVWUDWHV D SURQRXQFHG LPSURYHPHQW LQ OHYHO RI FRPSHWHQFHDPRQJVWXGHQWVZKRIROORZHGWKHHGXFDWLRQDOSURJUDP S ZHUHLGHQWLÀHG7ZREOLQGHGUHDGHUVDVVHVVHGDOOGDWDVHWVIRUWKHH[WHQW RI PRWLRQ DUWHIDFWV RQ PP D[LDO OXQJ UHFRQVWUXFWLRQV$ FRPSRXQGPRWLRQ VFRUHUDQJHZDVFDOFXODWHGEDVHGRQVLJQVRIPRWLRQDWIRXUVWDQGDUGLVHG SRVLWLRQV)RULPDJHQRLVHWKHDYHUDJHVWDQGDUGGHYLDWLRQZLWKLQ52,ҋVLQDLUZDV FDOFXODWHG7KHGRVHOHQJWKSURGXFW'/3ZDVXVHGWRHVWLPDWHDSSOLHGGRVH 5HVXOWV$OOKLJKSLWFKDFTXLVLWLRQVKDGEHHQSHUIRUPHGZLWKRXWFRPSOLFDWLRQV DQGQRGDWDVHWKDGWREHH[FOXGHG7KHUHZHUHQRVLJQLÀFDQWGLIIHUHQFHVLQ%0,RU YHQWLODWLRQIUHTXHQF\EHWZHHQERWKJURXSV,QWHUREVHUYHUDJUHHPHQWIRUFRPSRXQG PRWLRQVFRUHVZDVH[FHOOHQWѣ &RPSRXQGPRWLRQVFRUHZDVVLJQLÀFDQWO\ ORZHULQWKHKLJKSLWFKJURXSYVS 7KHKLJKHVWPRWLRQVFRUHV REVHUYHGLQWKHKLJKSLWFKJURXSDQGFRQWUROJURXSZHUHDQGUHVSHFWLYHO\ +LJKSLWFKGDWDVHWVKDGDWHQGHQF\WRZDUGVKLJKHULPDJHQRLVH+8YV+8 S DQGORZHU'/3YVP*\FPS &RQFOXVLRQ)RU&7VFDQVRIWKHFKHVWLQYHQWLODWHGSDWLHQWVDKLJKSLWFKDFTXL VLWLRQ WHFKQLTXH VLJQLÀFDQWO\ UHGXFHV PRWLRQ DUWHIDFWV ZKLOH PDLQWDLQLQJ VLPLODU GHJUHHVRILPDJHQRLVH7KLVKDVFRQVLGHUDEOHSRWHQWLDOWRLPSURYHGHWHFWLRQRI SXOPRQDU\LQÀOWUDWHVZLWKRXWLQFUHDVHVLQDSSOLHGGRVH % +LJKSLWFKGXDOVRXUFH&7SXOPRQDU\DQJLRJUDSK\ZLWKFFRI FRQWUDVWPDWHULDO -0.HUO%6FKHOO0/DUVVRQ7 /HKQHUW7 -9RJO5:%DXHU )UDQNIXUWD0DLQ'(PDWWKLDVNHUO#NJXGH 3XUSRVH 7 R FRPSDUH GLIIHUHQW ORZ FRQWUDVW PDWHULDO LQMHFWLRQ SURWRFROV XVLQJ KLJKSLWFK GXDO VRXUFH &7 SXOPRQDU\ DQJLRJUDSK\ LQ SDWLHQWV ZLWK VXVSHFWHG SXOPRQDU\HPEROLVP 0HWKRGVDQG0DWHULDOV'DWDRIFRQVHFXWLYHSDWLHQWVUHIHUUHGIRU&73$IRU H[FOXVLRQRI3(ZHUHHYDOXDWHG$OOVFDQVZHUHSHUIRUPHGRQDFKDQQHOGXDO VRXUFH&7VFDQQHUZLWKDKLJKSLWFKSURWRFROSLWFKN9P$V,QJURXS Q FRQWUDVWHQKDQFHPHQWZDVDFKLHYHGE\LQMHFWLQJFF&0IROORZHGE\D VDOLQHFKDVHURIFFLQJURXSQ FRQWUDVWHQKDQFHPHQWZDVDFKLHYHGE\ FFRI&0IROORZHGE\DVDOLQHFKDVHURIFFDQGLQJURXSQ FRQWUDVW HQKDQFHPHQWZDVDFKLHYHGE\FFRI&0IROORZHGE\DVDOLQHFKDVHURIFF,Q DOOVWXGLHVLRPHSUROPJ,FFZDVXVHGLQMHFWHGDWDUDWHRIFFV$WWHQXDWLRQ SURÀOHVLQWKHSXOPRQDU\WUXQNDQGRQVHJPHQWDOOHYHOZHUHPHDVXUHGWRHYDOXDWH WKHHQKDQFHPHQWZLWKLQWKHSXOPRQDU\DUWHULHV 5HVXOWV,QDOOSDWLHQWVDQDGHTXDWHDQGKRPRJHQHRXVFRQWUDVWHQKDQFHPHQWRI PRUHWKDQ+8ZDVDFKLHYHGLQWKHSXOPRQDU\DUWHULHV+RZHYHUDVLJQLÀFDQW GLIIHUHQWOHYHORIHQKDQFHPHQWZLWKLQWKHSXOPRQDU\V\VWHPEHWZHHQJURXSDQG JURXSYHUVXVJURXSZDVREVHUYHGS1RVWDWLVWLFDOO\VLJQLÀFDQWGLIIHUHQFH EHWZHHQJURXSVDQGZDVIRXQGUHJDUGLQJDWWHQXDWLRQRIWKHSXOPRQDU\DUWHULHV &RQFOXVLRQ $KRPRJHQHRXVRSDFLÀFDWLRQRIWKHSXOPRQDU\DUWHULHVDQGVXIÀFLHQW LPDJHTXDOLW\FDQEHDFKLHYHGZLWKFFRIFRQWUDVWPDWHULDOLQKLJKSLWFK'6&7 SXOPRQDU\DQJLRJUDSK\ % $FFXUDF\RIPXOWLGHWHFWRUFRPSXWHGWRPRJUDSK\WRHYDOXDWHDFXWH DRUWLFV\QGURPHV\HDUH[SHULHQFHLQDFDUGLRYDVFXODUFHQWHU $50DUWLQH]+3DODGLQL0-0HOD) 03HUHD0&HUGD**DQXP 0&DVWLJQROD('XOEHFR'+DEHUPDQ&DED$5DUPDUWLQH]#IIDYDORURRUJ 3XUSRVH7 RDVVHVWKHDFFXUDF\RIPXOWLGHWHFWRUFRPSXWHGWRPRJUDSK\0'&7 SHUIRUPHGLQDFXWHSDWLHQWVZLWKFOLQLFDOGLDJQRVLVRIDRUWLFV\QGURPH 0HWKRGVDQG0DWHULDOV(PHUJHQF\0'&7ZDVSHUIRUPHGLQSDWLHQWVVXV SHFWHG RI KDYLQJ DFXWH DRUWLF V\QGURPH )URP WKHVH SDWLHQWV PHW LQFOXVLRQ FULWHULDDQGZHUHHQUROOHGIRUWKLVVWXG\)URPUHIXVHGSDWLHQWVKDGSUHYLRXVO\ NQRZQ DQG WUHDWHG DRUWLF GLVRUGHUV DQG GLG QRW XQGHUJR VXUJHU\ RU VHFRQG FRPSDUDWLYHPHWKRG0'&7ZDVFRPSDUHGZLWKVXUJHU\Q ,QSDWLHQWVZLWKRXW VXUJHU\VHFRQGPHWKRGZDVXOWUDVRXQGQ GLJLWDODQJLRJUDSK\Q ERWK Q ,QDOOSDWLHQWVQRWRQO\VHFRQGFRPSDULVRQPHWKRGEXWDOVRFOLQLFDOIROORZXS ZDVFRQVLGHUHG 5HVXOWV0'&7ZDVSRVLWLYHIRUDFXWHDRUWLFV\QGURPHLQRISDWLHQWV'L DJQRVLVLQFOXGHGW\SH$GLVVHFWLRQQ W\SH%GLVVHFWLRQQ DRUWLFUXSWXUH Q W\SH$ LQWUDPXUDO KDHPDWRPD Q XOFHU Q W\SH$ GLVVHFWLRQ DQG LQWUDPXUDOKDHPDWRPDQ W\SH%GLVVHFWLRQDQGUXSWXUHQ W\SH%LQWUDPXUDO KDHPDWRPDDQGXOFHUQ 0'&7ZDVQHJDWLYHIRUDFXWHDRUWLFV\QGURPHLQ SDWLHQWVSDWLHQWVZLWKQRUPDODRUWDSDWLHQWVKDGXQNQRZQDQHXU\VPZLWKRXW FRPSOLFDWLRQ6HQVLWLYLW\VSHFLÀFLW\SRVLWLYHSUHGLFWLYHYDOXHDQGQHJDWLYHSUHGLF WLYHYDOXHIRUGHWHFWLRQRIDFXWHDRUWLFV\QGURPHDQGFRUUHFWFKDUDFWHULVDWLRQIRU HDFKVXEW\SHZDVLQDOOFDVHV 6FLHQWLILF6HVVLRQ $ 6&'()*+%(XURSHDQ&RQJUHVVRI 5DGLRORJ\ )ULGD\ H[SHULPHQWDOJURXSEHIRUHDQGDIWHUUDQJHGIURPDQG7KHYDOXH RIWKH6WXGHQWҋVWWHVWZDVGI DQGWDLOVLJ 8VLQJ6SHDUPDQҋV 5R WKHUH DUH VRPH FRUUHODWLRQV EHWZHHQ WKH VRFLRGHPRJUDSKLF YDULDEOHV DQG WKHLUOHYHOVRIDQ[LHW\7KHOHYHORIDQ[LHW\FDQEHFKDQJHGE\PDQ\UHDVRQVRQH DQGWKHPRVWLPSRUWDQWLVZKHQWKHSDWLHQWKDVDOUHDG\SHUIRUPHGD05,VFDQ &RQFOXVLRQ 7KH PDLQ UHVXOWV VXJJHVW D VLJQLÀFDQW GLIIHUHQFH LQ ERWK JURXSV DPRQJWKHVXEJURXSEHIRUHDQGDIWHUWKDWOHWXVFRQFOXGHGWKDWDIWHUWKH05,H[DP SDWLHQWVDUHOHVVDQ[LRXV:HDOVRFRQFOXGHWKDWZKRKDVSUHYLRXVO\SHUIRUPHGDQ 05,VFDQKDVVPDOOHUYDOXHVRIDQ[LHW\ % &KLOGUHQҋVDQGSDUHQWVҋSHUFHSWLRQRID05,H[DPLQDWLRQ -*DDUGOLQJ0(GZLQVRQ0DDQVVRQ/XQG6(MHQQ\JDUGOLQJ#PHGOXVH 3XUSRVH7 RGHVFULEHFKLOGUHQҋVDQGSDUHQWVҋSHUFHSWLRQRID05,H[DPLQDWLRQ 0HWKRGVDQG0DWHULDOV&KLOGUHQDQGSDUHQWVZHUHVHOHFWHGFRQVHFXWLYHO\,Q FOXVLRQFULWHULDZHUHWKDWWKH\FRXOGXQGHUVWDQGDQGVSHDN6ZHGLVK7KHFKLOGUHQ VKRXOGEHRIERWKJHQGHUVDQGDJHG\HDUV,WVKRXOGEHFKLOGUHQZKRGLGD 05,H[DPLQDWLRQIRUWKHÀUVWWLPHDQGWKH\ZRXOGEHDEOHWRFDUU\RXWDQLQWHUYLHZ RIPLQXWHV7KHSDUHQWVZKRIROORZHGZHUHDOVRLQWHUYLHZHG6HPLVWUXFWXUHG LQWHUYLHZVZLWKFKLOGUHQJLUOVDQGER\VDQGWKHLUSDUHQWVZHUHFDUULHGRXW 7KHLQWHUYLHZVZHUHDQDO\VHGXVLQJDSKHQRPHQRJUDSKLFDODSSURDFK 5HVXOWV7KHFKLOGUHQSHUFHLYHGVHFXULW\WKURXJKSUHSDUDWLRQLQIRUPDWLRQSDUHQWDO SUHVHQFHDQGWKDWLWZDVDOLJKWLQVLGHWKH05,7KHSDUHQWVSHUFHLYHGVHFXULW\ WKURXJKLQIRUPDWLRQDERXWWKHSURFHGXUHDQGEHLQJSUHVHQWZKLOHWKHLUFKLOGZDV H[DPLQHG%RWKFKLOGUHQDQGSDUHQWVIHOWDVHQVHRIVHFXULW\E\WKHSRVLWLYHEH KDYLRXUIURPKHDOWKSURIHVVLRQDOV7KHFKLOGUHQSHUFHLYHGDQ[LHW\ZKHQWRROLWWOH SUHSDUDWLRQLQIRUPDWLRQKDGEHHQJLYHQWKHGHVLJQRIWKH05,WKHVRXQGDQGWR REWDLQDSHULSKHUDOYHQRXVFDWKHWHU7KHSDUHQWVSHUFHLYHGDQ[LHW\IURPWKHVRXQG DIDLOHGH[DPLQDWLRQDQGWKHLQVHUWLRQRIDSHULSKHUDOYHQRXVFDWKHWHU7KHFKLOGUHQ WDONHGPXFKDERXWWKHGLIÀFXOW\WROLHVWLOO3DUHQWVZDQWHGPRUHLQIRUPDWLRQVRWKDW WKH\FRXOGSUHSDUHWKHLUFKLOGUHQDQGWKHPVHOYHV &RQFOXVLRQ $QLQIRUPDWLRQOHDÁHWEHIRUHDQ05,H[DPLQDWLRQWKDWLVSURGXFHGIRU FKLOGUHQFRXOGFRQWULEXWHWRUHGXFHGDQ[LHW\JUHDWHUXQGHUVWDQGLQJRIZKDWWKH\ DUHJRLQJWKURXJKDQGOHDGWRLPSURYHGTXDOLW\RIWKHH[DPLQDWLRQ % ,QIRUPDWLRQWRWKHSDUHQWVLQFRQQHFWLRQZLWKWKHLUFKLOGҋVGLDJQRVWLF H[DPLQDWLRQ 20XKDUHPRYLF+YLGRYUH'.RPDUUDGLRJUDI#KRWPDLOFRP 3XUSRVH7 RLGHQWLI\SDUHQWVҋQHHGIRULQIRUPDWLRQLQFRQQHFWLRQZLWKWKHLUFKLOGҋV GLDJQRVWLFH[DPLQDWLRQDQGWRSUHSDUHUDGLRJUDSKHUVEHWWHUWRFRPPXQLFDWHWR VDWLVI\WKRVHQHHGV 0HWKRGVDQG0DWHULDOV$TXDOLWDWLYHDSSURDFKZDVDSSOLHGDQGWKHGDWDZHUH FROOHFWHGIURPWZHQW\SDUHQWVZKRSDUWLFLSDWHGLQWKHVHPLVWUXFWXUHGIDFHWRIDFH RUIRFXVJURXSLQWHUYLHZV&RQVWDQWFRPSDUDWLYHWHFKQLTXHZDVXWLOLVHGWRDQDO\VH WKHGDWDZKHUHDQVZHUVDQGFRQFOXVLRQVZHUHFDWHJRULVHGDQGWKHQFRPSDUHG DQGUHODWHGWRRQHDQRWKHU7KHFDWHJRULHVZHUHFULWLFDOO\UHYLHZHGDQGUHYLVHG WRLPSURYHWKHUHOLDELOLW\RIWKHDQDO\VLV$IROORZXSIRFXVJURXSZDVFUHDWHGWR YDOLGDWHFODULI\DQGUHÀQHWKHFROOHFWHGGDWD 5HVXOWV3DUHQWVҋNQRZOHGJHDERXWGLDJQRVWLFH[DPLQDWLRQVDQGWKHULVNFRQQHFWHG WRWKHPDUHYHU\OLPLWHG0RVWRIWKHPKDYHSUHMXGLFHVDQGWKHLUWKRXJKWVDERXW UDGLDWLRQDUHYHU\FRQIXVHG,QIRUPDWLRQDERXWWKHULVNWKHLUFKLOGUHQDUHH[SRVHG WRLVKLJKOLJKWHGDVWKHPRVWLPSRUWDQWQHHGSDUHQWVKDYH7KH\KDYHDQHHGWREH LQYROYHGYHUEDOO\DQGSUDFWLFDOO\LQH[DPLQDWLRQRIWKHLUFKLOGUHQ3DUWLFLSDQWVZKR GLGQRWUHFHLYHGDGHTXDWHLQIRUPDWLRQVKRZHGVLJQVRIVWUHVV &RQFOXVLRQ5DGLRJUDSKHUVKRXOGLQYROYHWKHSDUHQWVLQH[DPLQDWLRQXVLQJFOHDU LQVWUXFWLYH LQIRUPDWLRQ DV WKHLU UHVRXUFHV FDQ EH YHU\ XVHIXODV SV\FKRORJLFDO VXSSRUWWRWKHFKLOGDQGSUDFWLFDOKHOS7KHULVNRIUDGLDWLRQVKRXOGEHH[SODLQHG LQDZD\SDUHQWVFDQUHODWHWR0RUHGHWDLOHGLQIRUPDWLRQZLOOFRQWULEXWHWREHWWHU SURFHGXUHXQGHUVWDQGLQJDQGFRQFHUQVZLOOEHHOLPLQDWHG%\GHÀQLQJDQGVWDQG DUGLVLQJLQIRUPDWLRQVRPHPLQLPXPTXDOLW\VKRXOGEHJXDUDQWHHGWRWKHSDUHQWV % +\SQRVLVLQWKHPDQDJHPHQWRIFODXVWURSKRELF05,SDWLHQWV 1$OH[DQGUH0$)RQWDLQH%6XDUH]'0RPSRLQW-%HFFKLR 7KLDLV)5*DUFKHV)59LOOHMXLI)5QDFKZDQDOH[DQGUH#JPDLOFRP 3XUSRVH&ODXVWURSKRELDLVUHVSRQVLEOHIRUWKHFDQFHOODWLRQRIDVLJQLÀFDQWQXPEHU RI05,H[DPLQDWLRQV:HSURVSHFWLYHO\HYDOXDWHGWKHXVHIXOQHVVRIK\SQRVLVLQWKH PDQDJHPHQWRIFODXVWURSKRELFSDWLHQWVVFKHGXOHGIRUDQ05, % ,PSDFWRIDUDGLRJUDSKLFSRVLWLRQLQJGROORQGHYHORSLQJVNLOOVLQ VNHOHWDOUDGLRORJ\DVWXG\RQUDGLRJUDSK\VWXGHQWV 5*LURPHWWL&=XLDQL6'D'DOW$0RUHWWL5)D]]LQ0%D]]RFFKL8GLQH,7 UJLURPHWWL#VLUPRUJ 3XUSRVH7 RLQYHVWLJDWHWKHVXEMHFWLYHLPSDFWRIDUDGLRJUDSKLFSRVLWLRQLQJGROO 53'LQGHYHORSLQJPDLQVNHOHWDOUDGLRORJ\65VNLOOVLQUDGLRJUDSK\VWXGHQWV 0HWKRGVDQG0DWHULDOV%HIRUHVWDUWLQJWKHFOLQLFDOLQWHUQVKLSLQVNHOHWDOUDGLRORJ\ UDGLRJUDSK\VWXGHQWVZHUHLQYROYHGLQDSUHOLPLQDU\KRXUVWUDLQLQJSURJUDP XVLQJDQDQWKURSRPRUSKLF53'7KHWUDLQLQJZDVVXSHUYLVHGE\WZRH[SHUWUDGL RJUDSKHUVLQRUGHUWRGHYHORSPDLQVNLOOVLQSHUIRUPLQJD6.H[DPLQDWLRQ$IWHU FRPSOHWLQJ WKH FOLQLFDO LQWHUQVKLS VWXGHQWV ZHUH DVNHG WR VXEMHFWLYHO\ TXDQWLI\ KRZWKHXVHRI53'LPSDFWHGRQGHYHORSLQJHDFKRIWKHHVWDEOLVKHGVNLOOVXVLQJ DWRVFRUH QRLPSDFW PRGHUDWHLPSDFW KLJKLPSDFW:HFDOFXODWHG WKHSURSRUWLRQRIVFRUHVIRUHDFKVNLOOE\WHVWLQJVWDWLVWLFDOVLJQLÀFDQFHZLWK WKH&KLVTXDUHWHVW 5HVXOWV5HJDUGOHVVRIWKHVSHFLÀFVNLOOWKHODUJHPDMRULW\RIWKHVWXGHQWVVXEMHF WLYHO\DWWULEXWHGDLPSDFWVFRUHWRWKHXVHRIWKH53'S53'ZDV IRXQG PRUH LPSDFWLQJ LQ GHYHORSLQJ FDSDELOLWLHV LQ SRVWSURFHVVLQJ SURFHGXUHV &, SDWLHQW SRVLWLRQLQJ &, DQG LQGLYLGXDWLRQRIUDGLRJUDSKLFUHIHUHQFHSRLQWV&,53'ZDV IRXQGOHVVXVHIXOLQWUDLQLQJWRSHUIRUPUDGLRJUDSKLFSURMHFWLRQV&, SDWLHQWSUHSDUDWLRQ&,DQGH[SRVXUHUHJXODWLRQ &,+LJKSURSRUWLRQRIVWXGHQWVIRXQGWKHXVHRI53'RI YDOXHLQSUHSDULQJIRUFOLQLFDOSUDFWLFH&, &RQFOXVLRQ$WUDLQLQJZLWKD53'LVVXEMHFWLYHO\RIYDOXHLQGHYHORSLQJPDLQ6. VNLOOVRIUDGLRJUDSK\VWXGHQWVEHIRUHWKHFOLQLFDOLQWHUQVKLS % ,PDJHTXDOLW\V\VWHPIRUUDGLRJUDSKHUV 6*HHUVYDQ*HPHUHQ8WUHFKW1/VJHHUV#QYPEUQO 3XUSRVH7KH'XWFK6RFLHW\RI0HGLFDO,PDJLQJDQG5DGLRWKHUDS\KDVGHYHORSHG LQ FRRSHUDWLRQ ZLWK 5RJDQ 'HOIW D V\VWHP WR DQDO\VH UHMHFWHG LPDJHV UHWDNHV LPDJHTXDOLW\DQGUDGLDWLRQGRVH7KHDLPRIWKH,PDJH4XDOLW\6\VWHP,46LVWR HYDOXDWHLPSURYHDQGDXGLWSDWLHQWSRVLWLRQLQJDQGUDGLRJUDSKLFH[SRVXUHFRQGL WLRQVLQDGLJLWDOUDGLRORJ\GHSDUWPHQW 0HWKRGVDQG0DWHULDOV,QDLQVWUXPHQWLVLPSOHPHQWHGIRUUDGLRJUDSKHUV WRDQDO\VHDQGHYDOXDWHUHWDNHVLQWKHGHSDUWPHQW,QDÀUVWVWHSZDVPDGH WRLQYHVWLJDWHWKHSRVVLELOLWLHVWRFKDQJHWKHLQVWUXPHQWIURPFRQYHQWLRQDOLPDJHV WRGLJLWDOLPDJHV,QWKH'XWFK6RFLHW\VWDUWHGZLWKDLQYHQWRU\RIWKHUHTXLUH PHQWVIRUWKH,PDJH4XDOLW\6\VWHP$TXHVWLRQQDLUHZDVFRQVWUXFWHGDQGVHQW RXWWRDOOWKHUDGLRORJ\GHSDUWPHQWVLQWKH1HWKHUODQGV 5HVXOWV:LWKWKHRXWFRPHRIWKHVXUYH\WKH'XWFK6RFLHW\GHYHORSHGUHTXLUHPHQWV IRUWKH,PDJH4XDOLW\7 RRO7KH,46LVWHVWHGLQGLIIHUHQWKRVSLWDOVDQGLVDYDLODEOH RQDOLFHQF\EDVHDJUHHPHQWEHWZHHQWKHGHSDUWPHQWDQGWKH'XWFK6RFLHW\ &RQFOXVLRQ,WLVSRVVLEOHLQDIXOOGLJLWDOHQYLURQPHQWWRXVHWKH,46WRHYDOX DWHLPSURYHDQGDXGLWSDWLHQWSRVLWLRQLQJDQGUDGLRJUDSKLFH[SRVXUHFRQGLWLRQV ,QWHUQDWLRQDODJUHHPHQWVVKRXOGEHPDGHIRUVWDQGDUGLVDWLRQRIWKHLQIRUPDWLRQ LQWKH',&20KHDGHUWRDVVXUHDKLJKTXDOLW\VHUYLFH7KH,46FDQEHXVHGLQ TXDOLW\DVVXUDQFHSURJUDPPHLQWKHGHSDUWPHQWDVDEHQFKPDUNWRROEHWZHHQ GHSDUWPHQWVDQGIRUFOLQLFDODXGLWVSHUIRUPHGE\WKHUDGLRJUDSKHUVRFLHW\ % 7KHHYDOXDWLRQRISDWLHQWҋVDQ[LHW\OHYHOVXQGHUJRLQJPDJQHWLF UHVRQDQFHLPDJLQJH[DPLQDWLRQ ) ') 50HGHLURV.%$]HYHGR/3 95LEHLUR$) &/$EUDQWHV 65RGULJXHV&$6LOYD53 3 $OPHLGD)DUR37 ÀOLSDBPHGHLURV #KRWPDLOFRP 3XUSRVH7 RDQDO\VHSRVVLEOHGLIIHUHQFHVEHWZHHQWKHDQ[LHW\OHYHOVRISDWLHQWV ZKRUHFHLYHDGGLWLRQDOLQIRUPDWLRQDERXWWKH05,VFDQDQGSDWLHQWVZKRUHFHLYH RQO\EDVLFLQVWUXFWLRQVIURPWKHKRVSLWDODQGWRYHULI\LIWKHUHLVYDULDWLRQLQDQ[LHW\ OHYHOVRISDWLHQWVEHIRUHDQGDIWHUWKHH[DPLQDWLRQDQGUHODWHWKHPWRJHQGHUDJH HGXFDWLRQOHYHODQGSUHYLRXV05,H[DPLQDWLRQV 0HWKRGVDQG0DWHULDOV7KHWRWDOVDPSOHRISDWLHQWVZDVGLYLGHGLQWRDFRQ WUROJURXSDQGDQH[SHULPHQWDOJURXSDQGHDFKRQHGLYLGHGLQWRWZRVXEJURXSV EHIRUHDQGDIWHUWKHH[DPDQGWKHQLWZDVDSSOLHG67$,IRUP<WRERWKDIWHUWKH VRFLRGHPRJUDSKLFTXHVWLRQV 5HVXOWV$WDFRQÀGHQFHLQWHUYDOWKHPHDQGLIIHUHQFHEHWZHHQWKHFRQWURO JURXSEHIRUHDQGDIWHUUDQJHGIURPDQG7KHYDOXHRIWKH6WXGHQWҋV WWHVWZDVGI DQGWDLOVLJ 7KHPHDQGLIIHUHQFHEHWZHHQWKH 6FLHQWLILF6HVVLRQ 6 &$' ( ) *+% (XURSHDQ&RQJUHVVRI 5DGLRORJ\ % 5DGLRJUDSKHUҋVUROHLQWHOHUDGLRORJ\ (0HWVDOD$+HQQHU+HOVLQNL),2XOX),DQMDKHQQHU#RDPNÀ 3XUSRVH7 HOHUDGLRORJ\LVRQHRIWKHPRVWLPSRUWDQWDUHDVRIWHOHPHGLFLQH&KDQJH IURPFRQYHQWLRQDOÀOPVFUHHQLPDJLQJV\VWHPVWRWKHGLJLWDORQHVKDVFKDQJHG UDGLRJUDSKHUVҋ MRE GHVFULSWLRQ D ORW 6RPH WDVNV VXFK DV GHYHORSLQJ LPDJHV RU DUFKLHYLQJWKHÀOPVKDYHGLVDSSHDUHGDQGQHZZRUNDUHDVVXFKDV3$&VZRUN KDVHPHUJHG 0HWKRGVDQG0DWHULDOV6\VWHPDWLFOLWHUDWXUHUHYLHZZDVPDGHIURP)LQQLVKDQG (QJOLVKODQJXDJHHOHFWURQLFKHDOWKFDUHGDWDEDVHVDQG7KHVLVGDWDEDVHRIXQLYHUVL WLHVRIDSSOLHGVFLHQFHV9ROXPHVRI-RXUQDORI'LJLWDO,PDJLQJZHUHUHYLHZHG1R WLPHOLPLWZDVVHWEHFDXVHSKHQRPHQRQRQWKHIRFXVRIVHDUFKLVUHODWLYHO\QHZ ,QFOXVLRQFULWHULRQZDVWKDWVHOHFWHGVWXGLHVGHVFULEHGUDGLRJUDSKHUVҋUROHDVDQ DFWLYH DFWRU RU EHQHÀFLDU\ 6WXGLHV GHVFULELQJ UDGLRJUDSKHUVҋ UROH LQ GLDJQRVWLF RU WKHUDSHXWLF WHOHUDGLRORJ\ ZHUH VHDUFKHG 6WXGLHV FRPSULVLQJÀQDO GDWD ZHUH DQDO\VHGE\LQGXFWLYHFRQWHQWDQDO\VLV 5HVXOWV0RVWFHQWUDODUHDVIRUPLQJUDGLRJUDSKHUVҋMREGHVFULSWLRQLQWHOHUDGLRO RJ\ZHUHSDWLHQWGDWDPDQDJHPHQWDQGFRPELQLQJSDWLHQWGDWDWRLPDJLQJGDWD UDGLRWKHUDS\DQGRULPDJHSURGXFWLRQSURFHVVLQJDQGVDYLQJLPDJHVWDNLQJFDUH RIVDIHW\TXDOLW\DVVXUDQFHDQGGRVHRSWLPLVDWLRQOLIHORQJHGXFDWLRQGHYHORSLQJ RQHVHOIDQGRQHVҋZRUNPXOWLSURIHVVLRQDOWHDPZRUNFOLHQWFHQWUHGSDWLHQWHGXFD WLRQDQGQXUVLQJGDWDVDIHW\DQGVHFXULW\DQGSODQQLQJDQGPDQDJLQJHFRQRP\ ZHUHSDUWRI3$&6DGPLQLVWUDWRUVZRUN &RQFOXVLRQ5DGLRJUDSKHUVҋMREGHVFULSWLRQLQWHOHUDGLRORJ\VKRXOGEHWDNHQLQWR DFFRXQWZKHQUDGLRJUDSKHUVҋHGXFDWLRQLVSODQQHGRQWKHÀUVWDQGVHFRQGF\FOHDQG LQOLIHORQJHGXFDWLRQ&RPSHWHQFHVVKRXOGEHUHFRJQLVHGZKHQSODQQLQJLPDJLQJ XQLWVҋMREGHVFULSWLRQVHYDOXDWLQJZRUNGHPDQGVDQGUHZDUGLQJ 0HWKRGVDQG0DWHULDOV7ZR05,WHFKQLFLDQVDQGDUDGLRORJLVWOHDUQHGHULNVRQLDQ K\SQRVLV2YHUDSHULRGRIWZHQW\PRQWKVSDWLHQWVZHUHH[SORUHGE\05, )LIW\WZRSDWLHQWVZHUHLGHQWLÀHGDVFODXVWURSKRELFUHIXVLQJWKHVFKHGXOHG05, 6HYHQ SDWLHQWV H[SHULHQFHG D SDQLF DWWDFN$ EULHI VLQJOH VHVVLRQ RI K\SQRVLV ZDVSURSRVHG 5HVXOWV$PRQJWKHLGHQWLÀHGFODXVWURSKRELFSDWLHQWVDFFHSWHGK\SQRVLV DQGXQGHUZHQW05,)RXUSDWLHQWVGHFOLQHGWKHSURSRVHGWUHDWPHQWDQGZHUHXQ DEOHWRZLWKVWDQGWKH05,SURFHGXUH &RQFOXVLRQ+\SQRVLVDSSHDUVWREHDVXLWDEOHHIÀFLHQWUDSLGDQGLQH[SHQVLYHWRRO IRUWKHFDUHRISDWLHQWVVXIIHULQJIURPFODXVWURSKRELDGXULQJ05,:LWKWKLVGUXJIUHH PHWKRG05,RIFODXVWURSKRELFSDWLHQWVFDQEHSHUIRUPHGLQWKHEHVWFRQGLWLRQV % 3UDFWLFHVWRFRQWUROLQIHFWLRQUHODWHGWRFKHVWUDGLRJUDSK\LQ LQWHQVLYHFDUHXQLW 00&3 5LEHLUR $/5HVHQGHV) 3 5RGULJXHV-(*2ҋ1HLOO -&0DXULFLR/LVERQ377 RPDU37PDUJDULGDULEHLUR#HVWHVOLSOSW 3XUSRVH7 RDQDO\VHWKHSURFHVVRIFDUU\LQJRXWFKHVWUDGLRJUDSK\DWWKHLQWHQVLYH FDUHXQLW,&8UHJDUGLQJWKHFRQWUROLQIHFWLRQSUDFWLFHVDSSOLHGE\UDGLRJUDSKHUV 0HWKRGVDQG0DWHULDOV7KHVWXG\WRRNSODFHLQDSXEOLFKRVSLWDOZKLFKFDUULHVRXW FKHVWUDGLRJUDSK\LQEHGULGGHQLQWKH,&8)LIWHHQUDGLRJUDSKHUVZHUHREVHUYHG REVHUYDWLRQDOHPSLULFDOFRPSRQHQWDQGÀOOHGE\WKHUHVHDUFKHUVRQHFKHFNOLVW ZLWK HOHYHQ LWHPV 7KLUWHHQ GLIIHUHQW UDGLRJUDSKHUV ÀOOHG RQH VXUYH\ ZLWK HLJKW TXHVWLRQVH[SORUDWRU\HPSLULFDOFRPSRQHQW 5HVXOWV 0RVW RI UDGLRJUDSKHUV JDYH RQO\ WKUHH FRUUHFW DQVZHUV RI WKH UDGLRJUDSKHUVSUHVHQWHGSUDFWLFHVVXVSLFLRXVWRFRQGXFWWRDQLQIHFWLRQSURFHVV OHG WR SUDFWLFHV RI DQ HIIHFWLYH LQIHFWLRQ ZKLOH WKH UHPDLQLQJ GLG QRW SUHVHQW DQ\ ULVN EHKDYLRXU UHODWHG WR WKH GHYHORSPHQW RI LQIHFWLRQ 0RVW RI UDGLRJUDSKHUVKDGPRUHWKDQ\HDUVRIZRUNH[SHULHQFHDQG\HDUV 'LVLQIHFWLRQSURFHGXUHVZHUHQRWFDUULHGRXWRQWKHLPDJHSODWHV,SҋVRUSRUWDEOH HTXLSPHQWLQWKH,PDJLQJ'HSDUWPHQWEHIRUHWRDUULYHRQWKH,&80RVWRIWKH UDGLRJUDSKHUVXVHGJORYHVGLGQRWXVHDQ\SHUVRQDOXWHQVLOVRU GLGQRWFRPHLQWRFRQWDFWZLWKWKHSDWLHQWRUWKHEHGZLWKRXWGLVLQIHFWÀUVW GXULQJWKHSURFHGXUHVWKH,SҋVSURWHFWLRQZDVXVHGLQRIWKHFDVHV7KH IROORZLQJSURFHGXUHVQHYHUZHUHDSSOLHGE\KDOIVDPSOHZHDULQJRIDZKLWHFRDW LPSHUPHDEOHDSURQRUPDVNDQGGLVLQIHFWLRQRIWKH,SҋVDWWKHHQG &RQFOXVLRQ7KHUHVXOWVIDUIURPIROORZLQJWKHUHFRPPHQGDWLRQVRUJXLGHOLQHV VXJJHVWHGWKDWWKHPDWWHUDERXWSUHYHQWLRQDQGFRQWUROLQIHFWLRQDPRQJUDGLRJUD SKHUVVKRXOGEHLPSURYHGWKURXJKWKHRUHWLFDODQGWUDLQLQJLQLWLDWLYHV % $UH8.UDGLRJUDSKHUVPRUHHPRWLRQDOO\LQWHOOLJHQWWKDQDQRUPDWLYH FRPSDULVRQJURXS"$QDJHDQGJHQGHUPDWFKHGDQDO\VLV 6-0DFND\ 3 +RJJ*7 &RRNH5'%DNHU7 'DZNHV6DOIRUG8. &KHVWHU8.VPDFND\#VDOIRUGDFXN 3XUSRVH (PRWLRQDO LQWHOOLJHQFH (, KDV EHHQ LGHQWLÀHG DV D EHQHÀFLDOSKH QRPHQRQLQPHGLFLQHQXUVLQJUDGLRJUDSK\DQGKDVEHHQVKRZQWREHSRVLWLYHO\ DVVRFLDWHGZLWKDJUHDWHUDPRXQWRIFRPSDVVLRQDWHDQGHPSDWKLFSDWLHQWFDUH 7KLVSDSHUZLOOFRPSDUH(,GDWDIURPD8.ZLGHVXUYH\RIUDGLRJUDSKHUVZLWKD QRUPDWLYHVDPSOHJURXSWRGHWHUPLQHZKHWKHUUDGLRJUDSKHUVKDYHKLJKHUHPRWLRQDO LQWHOOLJHQFHWKDQDQRUPDWLYHJURXS 0HWKRGVDQG0DWHULDOV,QD8.ZLGHVXUYH\RIUDGLRJUDSKHUWUDLWHPRWLRQDO LQWHOOLJHQFHQ ZDVXQGHUWDNHQWRGHWHUPLQHWKHJOREDODQGIRXUIDFWRU(, OHYHOVRIUDGLRJUDSKHUV7KLVGDWDZHUHFRPSDUHGZLWKDQRUPDWLYHJURXSQ IURPWKHQDWLRQDO7UDLW(,GDWDEDVH7KHPHDQDJHUDQJHDQGJHQGHUSURSRUWLRQRI WKHVHWZRGDWDVHWVGLIIHUHGVRDJHDQGJHQGHUPDWFKLQJE\JURXSZDVXQGHUWDNHQ IROORZHGE\$129$ZLWKSRVWKRF7XNH\WHVWV 5HVXOWV6WDWLVWLFDOO\VLJQLÀFDQWGLIIHUHQFHZDVREVHUYHGIRUDJHJURXSEHWZHHQ GDWDVHWVRQJOREDOWUDLW(,DQGDOOIDFWRUV3RVWKRFWHVWVLQGLFDWHGGLIIHUHQFHVOD\ PDLQO\ZLWKDJHJURXS5DGLRJUDSKHUVVFRUHGPRUHKLJKO\WKDQQRUPDWLYH JURXSIRUDOOEXWWKHHPRWLRQDOLW\IDFWRU+LJKO\VWDWLVWLFDOO\VLJQLÀFDQWGLIIHUHQFHV ZHUHREVHUYHGLQJHQGHUEHWZHHQGDWDVHWVIRUJOREDODQGDOOIDFWRUV3RVWKRF WHVWVLQGLFDWHGGLIIHUHQFHVEHWZHHQIHPDOHVDFURVVJOREDODQGDOOIDFWRUVEXWIRU PDOHVWKLVZDVOLPLWHGWRJOREDOWUDLW(,ZHOOEHLQJDQGVHOIFRQWURO &RQFOXVLRQ7KH8.UDGLRJUDSKHUVDPSOHVFRUHGPRUHKLJKO\LQHPRWLRQDOLQWHO OLJHQFHWKDQDQRUPDWLYHVDPSOHJURXS 6FLHQWLILF6HVVLRQ $ 6&'()*+%(XURSHDQ&RQJUHVVRI 5DGLRORJ\ 6DWXUGD\0DUFK 6FLHQWLILF6HVVLRQ 6 &$' ( ) *+% (XURSHDQ&RQJUHVVRI 5DGLRORJ\ % &7DQJLRJUDSK\´6SRW6LJQµSUHGLFWVKDHPDWRPDH[SDQVLRQLQ SDWLHQWVZLWKDFXWHVSRQWDQHRXV,&+ ,+DYVWHHQ/&KULVWHQVHQ$&KULVWHQVHQ-1LHOVHQ'.ULHJHU +&KULVWHQVHQ&RSHQKDJHQ'.DQGHUVFKULVWHQVHQHPDLO#KRWPDLOFRP 3XUSRVH6SRQWDQHRXVLQWUDFHUHEUDOKDHPRUUKDJH3,&+H[SDQGVLQXSWR RI FDVHV DQG VSRW VLJQ GHWHFWLRQ RQ &7DQJLRJUDSK\ &7$ HQDEOHV SUHGLFWLRQ RIKDHPDWRPDH[SDQVLRQZKLFKKDVEHHQOLQNHGWRGHDWKDQGEDGRXWFRPH7KH DLPLVWRLQYHVWLJDWHWKHVWUHQJWKLQWKHFRUUHODWLRQEHWZHHQSUHVHQFHRIVSRWVLJQ DQGKDHPDWRPDH[SDQVLRQ 0HWKRGVDQG0DWHULDOV6L[KXQGUHGDQGWZHOYHSDWLHQWVXQGHUZHQWVWDQGDUGLVHG ZRUNXSIRULYWKURPERO\VLVDW%LVSHEMHUJ8QLYHUVLW\KRVSLWDO&RSHQKDJHQIURP $SULOWR0D\ZLWKLQKRXUVDIWHUVWURNHV\PSWRPRQVHW $QRQFRQWUDVW &7 VFDQ 1&&7 DQG &7$ ZDV SHUIRUPHG URXWLQHO\ LQ SDWLHQWV ZLWK ,&+ DQG 1&&7ZDVFRQWUROSODQQHGQH[WGD\ZKHQSRVVLEOH2QHUDGLRORJLVWUHYLHZHGDOO GDWDIRUVSRWVLJQDQGHVWLPDWHGWKHKDHPDWRPDYROXPHLQWKHDFXWHDQGIROORZXS 1&&7 VZLWKWKH$%&PHWKRGRIPHDVXUHPHQW6DPSOHVZHUHDVVHVVHGZLWK WKH0DQQ:KLWQH\WHVW7KHVWXG\ZDVDSSURYHGE\WKH'DQLVK'DWD3URWHFWLRQ $JHQF\ÀOHQR 5HVXOWV&7$ZDVREWDLQHGLQSDWLHQWVDQGQH[WGD\1&&7ZDVREWDLQHGLQ SDWLHQWVPDLQO\GXHWRHDUO\WUDQVIHUUDORIVWDEOHSDWLHQWV,QRISDWLHQWV VSRWVLJQZDVREVHUYHG7KHUHZDVVLJQLÀFDQWGLIIHUHQFHLQKDHPDWRPDH[SDQVLRQ LQJURXSVZLWKDQGZLWKRXWVSRWVLJQS 0HDQDFXWHYROXPHZDVPO UDQJHPOLQSDWLHQWVZLWKVSRWVLJQYVPOUDQJHPO &RQFOXVLRQ6SRWVLJQLGHQWLÀHVSDWLHQWVZLWKODWHUKDHPDWRPDH[SDQVLRQDQGPD\ EHXVHIXOLQLGHQWLI\LQJSDWLHQWVIRUSURRIRISULQFLSOHWULDOVLQDFXWHVSRQWDQHRXV ,&+DLPLQJDWSUHYHQWLQJRUVWRSSLQJHDUO\KDHPDWRPDH[SDQVLRQ % 'XDOHQHUJ\&7IRUGHWHFWLRQRIFRQWUDVWOHDNDJHZLWKLQKLJKGHQVLW\ KDHPDWRPDLQSDWLHQWVZLWKLQWUDFUDQLDOKDHPRUUKDJHLRGLQHLPDJHV YHUVXVFRPELQHGLPDJHV < :DWDQDEH+7 DQDND01LVKL]DZD< .XQLWRPL$7 VXNDEH17 RPL\DPD 6XLWD-3ZDWDQDEH#UDGLROPHGRVDNDXDFMS 3XUSRVH7 RHOXFLGDWHWKHGHWHFWDELOLW\RIFRQWUDVWOHDNDJHLQKLJKGHQVLW\KDH PDWRPD RQ HDUO\ SKDVH GXDO HQHUJ\ &7$ DQG FRPSDUH WKH UHVXOWV ZLWK WKRVH REWDLQHGRQGHOD\HG&7UHIHUHQFHVWDQGDUG 0HWKRGVDQG0DWHULDOV7ZHQW\VL[SDWLHQWVZLWKLQWUDFUDQLDOKDHPRUUKDJHZHUH UHWURVSHFWLYHO\LQFOXGHGLQWKLVVWXG\$OOSDWLHQWVKDGXQGHUJRQHGXDOVRXUFHGXDO HQHUJ\&7$N9DQGN9DQGGHOD\HGSKDVHHQKDQFHG&7PLQXWHVDIWHU FRQWUDVWLQMHFWLRQEHWZHHQ $SULODQG-XO\'XDOHQHUJ\&7LPDJHVZHUH SRVWSURFHVVHGZLWKFRPPHUFLDOVRIWZDUHDSSO\LQJDWKUHHPDWHULDOGHFRPSRVLWLRQ DOJRULWKPWRFDOFXODWHLRGLQHLPDJHVDQGYLUWXDOXQHQKDQFHGLPDJHVDQGDOVRWR JHQHUDWHFRPELQHG&7LPDJHVWKDWFUHDWHWKHLPSUHVVLRQRIN9&7LPDJHV 2QHQHXURUDGLRORJLVWEOLQGHGWRWKHSDWLHQWҋVGDWDUHYLHZHGWKHLRGLQHLPDJHV DQGFRPELQHGLPDJHVWRGHWHFWFRQWUDVWHQKDQFHPHQWRUFRQWUDVWOHDNDJHLQWKH KDHPDWRPD 5HVXOWV7KHSDWLHQWVҋGLDJQRVLVZDVDVIROORZVLGLRSDWKLFLQWUDFHUHEUDOKDHP RUUKDJHWUDXPDWLFKDHPRUUKDJHVXEDUDFKQRLGKDHPRUUKDJHDQGEUDLQ WXPRXUZLWKKDHPRUUKDJH&RQWUDVWOHDNDJHRUHQKDQFHPHQWZDVGHWHFWHGLQ RISDWLHQWVRQGHOD\HG&7 $PRQJWKHVHSDWLHQWVSDWLHQWVVKRZHG DQHTXLYRFDOOHDNDJHRQFRPELQHGLPDJHVEXWWKHLRGLQHLPDJHVUHYHDOHGFOHDU FRQWUDVWOHDNDJHLQWKHKDHPDWRPD,QSDWLHQWVLRGLQHOHDNDJHFRXOGEHGHWHFWHG RQERWKLRGLQHDQGFRPELQHGLPDJHVEXWLRGLQHLPDJHZDVVXSHULRULQGHSLFWLQJ WKHOHDNDJH(LJKWSDWLHQWVZHUHHTXDOWRGHSLFWWKHFRQWUDVWOHDNDJHLQERWKLRGLQH DQGFRPELQHGLPDJHV &RQFOXVLRQ'XDOHQHUJ\&7LVDEOHWRGLIIHUHQWLDWHLRGLQHFRQWUDVWPHGLXPIURP KDHPDWRPDDQGIDFLOLWDWHVWKHGHWHFWLRQRIFRQWUDVWOHDNDJHHVSHFLDOO\LQSDWLHQWV ZLWKIDLQWLRGLQHHQKDQFHPHQW % &HUHEUDOSHUIXVLRQ&7ITXDQWLI\LQJUHJLRQDOIXQFWLRQDOSDUDPHWHUV DWWKHRQVHWRIWKHVWURNHDQGKVDIWHULQWUDYHQRXVWKURPERO\WLFWKHUDS\ =00HWDIUDW]L($OH[LRX0)DQDULRWLV3 $UJLUL$&KRYDV$.RPQRV /DULVD*5 3XUSRVH7 RDVVHVVWKHFKDQJHVLQUHJLRQDOIXQFWLRQDOSDUDPHWHUVU)3VRILVFKDH PLFDQGQRUPDOEUDLQDWWKHRQVHWRIDFXWHVWURNH$6DQGKVDIWHUWKURPERO\WLF WKHUDS\FRUUHODWHU)3VWR1,+66LQERWKWLPHIUDPHVDQGWRHYDOXDWHXWLOLW\RIWKH LQLWLDOU)3VWRSUHGLFWWKHFOLQLFDORXWFRPHDWKV 5RRP$ 1HXUR 66 6WURNHGLDJQRVLV 0RGHUDWRUV '5+DGL]DGHK%RQQ'( 00HFKO%UQR&= % 'LVWLQFWLRQRIDQWHJUDGHÁRZDFURVVLQWUDYDVFXODUWKURPEXVIURP UHWURJUDGHFROODWHUDOÁRZLQRFFOXGHGFHUHEUDODUWHULHVLQLWLDO H[SHULHQFHXVLQJWLPHUHVROYHG&7DQJLRJUDSK\ $0-)U|OLFK 56FKUDPP(.ORW]0.QDXWK3 6FKUDPP *|WWLQJHQ'()RUFKKHLP'( 3XUSRVH $FXWHVWURNHSDWLHQWVZLWKLQWUDFUDQLDOYHVVHORFFOXVLRQPD\GHPRQVWUDWH VXERFFOXVLYHWKURPEXVW\SLFDOO\FKDUDFWHULVHGE\DQWHJUDGHRSDFLÀFDWLRQGLVWDOWR DQRFFOXVLRQRQFDWKHWHUDQJLRJUDSK\7KLVÀQGLQJKDVEHHQDVVRFLDWHGZLWKKLJKHU UDWHVRIYHVVHOUHFDQDOLVDWLRQ:HVRXJKWWRGHWHUPLQHZKHWKHUDQWHJUDGHÁRZFDQ EHGHPRQVWUDWHGRQQHDUZKROHEUDLQWLPHUHVROYHGIRXUGLPHQVLRQDO&7DQJLRJUD SK\'&7$DQGZKHWKHULWFDQEHGLVWLQJXLVKHGIURPUHWURJUDGHFROODWHUDOÁRZ 0HWKRGVDQG0DWHULDOV7KLQVHFWLRQ'&7$GDWDIURPFRQVHFXWLYHVWURNH SDWLHQWV ZLWK DFXWH WHUPLQDO LQWHUQDO FDURWLG RU PLGGOH FHUHEUDO DUWHU\ RFFOXVLRQ ZHUHDVVHVVHGIRUSUHWUHDWPHQWWKURPERO\VLVLQFHUHEUDOLQIDUFWLRQ7,&,JUDGH DQGWKHSUHVHQFHRIDQWHJUDGHRUUHWURJUDGHFRQWUDVWRSDFLÀFDWLRQDWWKHGLVWDO WKURPEXV HQG 'LJLWDO VXEWUDFWLRQ DQJLRJUDPV ZHUH UHYLHZHG IRUSUHWUHDWPHQW 7,&,JUDGHSUHVHQFHRIDQWHJUDGHRSDFLÀFDWLRQGLVWDOWRWKHWKURPEXVDVZHOODV SRVWLQWHUYHQWLRQ7,&,JUDGH 5HVXOWV 2Q '&7$ WKHUH ZDV HYLGHQFH RI DQWHJUDGH ÁRZ LQ RI FDVHV &RPSDUHGWRDQJLRJUDSK\'&7$FRUUHFWO\FODVVLÀHGDQWHJUDGHÁRZLQ FDVHVWKHUHZDVIDOVHSRVLWLYHDQGQRIDOVHQHJDWLYHV5HFDQDOLVDWLRQ 7,&,DRUJUHDWHUZDVDFKLHYHGLQDOOFDVHVZLWKHYLGHQFHRIDQWHJUDGHÁRZRQ '&7$YHUVXVRXWRIWKHFDVHVZLWKRXWHYLGHQFHRIDQWHJUDGHÁRZ &RQFOXVLRQ '&7$ FDQ GLVWLQJXLVK DQWHJUDGH ÁRZ DFURVV D FHUHEUDO DUWHU\ RFFOXVLRQIURPUHWURJUDGHFROODWHUDOÁRZ)XUWKHUVWXGLHVSUHIHUDEO\ZLWKDODUJHU VDPSOHVL]HDUHQHHGHGWRFRQÀUPRXUÀQGLQJVDQGDVVHVVZKHWKHU'&7$FDQ EHXVHGWRSUHGLFWVXFFHVVRIUHFDQDOLVDWLRQSURFHGXUHVLQVHOHFWFDVHV % 3RRUFROODWHUDOVWDWXVRQWLPLQJLQYDULDQW&7$LVDVWURQJSUHGLFWRU RISRRUFOLQLFDORXWFRPHLQDFXWHVWURNHSDWLHQWVZLWKODUJHYHVVHO RFFOXVLRQ (-6PLW (M9RQNHQ7 YDQ6HHWHUV-:'DQNEDDU,&YDQGHU6FKDDI %.9HOWKXLV%YDQ*LQQHNHQ03URNRS8WUHFKW1/1LMPHJHQ1/ HZRXGVPLW#JPDLOFRP 3XUSRVH7 RDVVHVVZKHWKHUFROODWHUDOVWDWXVLQDFXWHVWURNHSDWLHQWVZLWKODUJH YHVVHORFFOXVLRQSUHGLFWVFOLQLFDORXWFRPHDQGWRFRPSDUHVWDQGDUG&7DQJLRJUDSK\ &7$WRDWLPLQJLQYDULDQW&7$IRUWKLVSXUSRVH 0HWKRGVDQG0DWHULDOV:HVHOHFWHGFRQVHFXWLYHLVFKDHPLFVWURNHSDWLHQWV ZLWK,&$DQGRU0&$RFFOXVLRQIURPRXUFOLQLFDOGDWDEDVH&7$DQG&7SHUIXVLRQ &73DWDGPLVVLRQDQGFOLQLFDORXWFRPHGDWDPRGLÀHG5DQNLQ6FDOHP56DIWHU WKUHHPRQWKVZHUHDYDLODEOH&73VRXUFHLPDJHVZHUHXVHGWRUHFRQVWUXFWWLPLQJ LQYDULDQW&7$7,&7$DWHFKQLTXHWKDWLVLQVHQVLWLYHWRGHOD\HGFRQWUDVWDUULYDO )RXUH[SHULHQFHGREVHUYHUVDVVHVVHGFROODWHUDOVWDWXVRQ&7$DQG7,&7$LQDQ LQGHSHQGHQW EOLQGHG UDQGRPLVHG PDQQHU &ROODWHUDO VWDWXV ZDVUDWHG JRRG LI RIFROODWHUDOVZHUHSUHVHQWRUSRRULIZHUHSUHVHQW&OLQLFDORXWFRPH ZDVGHÀQHGDVJRRGIRUP56RUSRRUIRUP56! 5HVXOWV&ROODWHUDOVWDWXVZDVUDWHGVLJQLÀFDQWO\PRUHRIWHQDVJRRGRQ7,&7 $ WKDQRQ&7$S,QWHUDQGLQWUDREVHUYHUDJUHHPHQWZHUHJRRG IRUDVVHVVLQJFROODWHUDOVWDWXVRQ&7$DQG7,&7$PHDQNDSSD DQG UHVSHFWLYHO\3RRUFROODWHUDOVWDWXVRQ7,&7$KDGDSUHGLFWLYHYDOXHRIIRU SRRURXWFRPH7KLVQXPEHUZDVRQO\IRU&7$*RRGFROODWHUDOVWDWXVRQ&7$ RU7,&7$SUHGLFWHGJRRGRXWFRPHLQRQO\DQGUHVSHFWLYHO\ &RQFOXVLRQ3RRUFROODWHUDOVVWDWXVRQWLPLQJLQYDULDQW&7$LVDVWURQJSUHGLFWRU RISRRUFOLQLFDORXWFRPHLQDFXWHVWURNHSDWLHQWVZLWKODUJHYHVVHORFFOXVLRQ7, &7$GHWHFWVPRUHFROODWHUDOVWKDQVWDQGDUG&7$GXHWRLWVLQVHQVLWLYLW\WRGHOD\HG FRQWUDVWDUULYDO 6FLHQWLILF6HVVLRQ $ 6&'()*+%(XURSHDQ&RQJUHVVRI 5DGLRORJ\ 6DWXUGD\ &RQFOXVLRQ,Q173WKHÀQDO,&$FDQEHSUHGLFWHGE\FKDQJHVRQ&%9EXWDPRQJ )73LWYDULHVVLJQLÀFDQWO\(YLGHQWDQGPRGHUDWH&$VHHPWREHDJRRGSURJQRVLV IDFWRUUHGXFLQJWKH,&$ % $XWRPDWHGDVVHVVPHQWRIUHJLRQDO&7SHUIXVLRQLQDFXWHLVFKDHPLFVWURNH $.HPPOLQJ5.UXPP/)H\HQ7 1LHGHUVWDGW:/+HLQGHO 0QVWHU'(DNHPPOLQJ#ZHEGH 3XUSRVH7 RSUHVHQWDQRYHODOJRULWKPIRUIXOO\DXWRPDWHGXVHULQGHSHQGHQWDV VHVVPHQW RI UHJLRQDO UHODWLYH FHUHEUDO &7 SHUIXVLRQ &73 SDUDPHWHUV LQ DFXWH LVFKDHPLFVWURNH 0HWKRGVDQG0DWHULDOV $FXWHVWURNHLPDJLQJQDWLYH&7DQGG\QDPLF&73ZDV SHUIRUPHGLQFRQVHFXWLYHDFXWHPLGGOHFHUHEUDODUWHULDOVWURNHVRQDVOLFH &7VFDQQHU6RPDWRP'HÀQLWLRQ $66LHPHQV0HGLFDO6ROXWLRQV5HJLRQDO&73 YDOXHVZHUHREWDLQHGE\DIXOO\DXWRPDWHGURXWLQHUREXVWQRQOLQHDUUHJLVWUDWLRQ RI&73PDSVWR01,VSDFHUHJDUGOHVVRIEUDLQFRYHUDJHZDVDFFRPSOLVKHG E\ULJLGERG\WUDQVIRUPDWLRQRIQDWLYH&7WRWKHDQDWRPLFDODYHUDJH&7SHUIXVLRQ LPDJHIROORZHGE\LQYHUVLRQRIWKHWUDQVIRUPDWLRQPDWUL[&73WR&77KHPDWUL[ &73WR&7DQGWKHQRQOLQHDUZDUSÀOHG&7WR01,ZHUHFRQFDWHQDWHG&73WR01, 7KHZDUSÀHOG&73WR01,ZDVDSSOLHGWRSHUIXVLRQPDSV$SUREDELOLVWLFDWODV FRYHULQJVWUXFWXUHV+DUYDUG2[IRUGVWUXFWXUDODWODVZDVXVHGWRFDOFXODWHEUDLQ SHUIXVLRQSDUDPHWHUVZHLJKWHGE\WKHDQDWRPLFDOSUREDELOLW\RIDUHJLRQ$Q HUURUFRUUHFWLRQWHUPH[FOXGHGQRQVLJQLÀFDQWYR[HOVGHÀQHGE\FHUHEURVSLQDOÁXLG DQGYHVVHOV5HODWLYH&7SHUIXVLRQYDOXHVZHUHFDOFXODWHGUHJLRQDOSHUIXVLRQ RILVFKDHPLFKHPLVSKHUHGLYLGHGE\WKHFRQWUDODWHUDOVLGH$XWRPDWHGSHUIXVLRQ YDOXHVZHUHFRPSDUHGZLWKVHOHFWHGPDQXDOO\WUDFHGSHUIXVLRQYDOXHVIRUUHIHUHQFH 5HVXOWV5HJLVWUDWLRQRISHUIXVLRQPDSVWR01,VSDFHZDVUREXVWDQGUHOL DEOH$XWRPDWHGDQGPDQXDOO\REWDLQHGUHJLRQDOEUDLQSHUIXVLRQYDOXHVZHUHQRW VLJQLÀFDQWO\GLIIHUHQWS7KHDYHUDJHGLIIHUHQFHEHWZHHQDXWRPDWHGDQG PDQXDOUHJLRQDOSHUIXVLRQSDUDPHWHUVZDVOHVVWKDQ6' &RQFOXVLRQ7KHSUHVHQWHGDOJRULWKPLVUREXVWDQGUHOLDEOHIRUDXWRPDWHGFDOFXOD WLRQRIUHJLRQDOSHUIXVLRQSDUDPHWHUV % 5HFRPPHQGDWLRQVIRUVHOHFWLQJWKHYDVFXODULQSXWIXQFWLRQVWR RSWLPLVHWKHYDOLGLW\LQ&7SHUIXVLRQLPDJLQJLQRUPRUHVOLFH VFDQQHUV -1LHVWHQ,9DQ'HU6FKDDI$5LRUGDQ+'H-RQJ:0DOL%9HOWKXLV 8WUHFKW1/MQLHVWHQ#KRWPDLOFRP 3XUSRVH7 RLPSURYHDFFXUDF\RITXDQWLWDWLYHSHUIXVLRQPHDVXUHPHQWVDQGUHGXFH RSHUDWRUGHSHQGHQWSRVWSURFHVVLQJVWHSVE\RSWLPLVLQJWKHVHOHFWLRQRIWKHDUWHULDO LQSXWIXQFWLRQ$,)DQGWKHYHQRXVRXWSXWIXQFWLRQ92)LQ&7SHUIXVLRQ&73 0HWKRGVDQG0DWHULDOV)RUW\IRXUSDWLHQWVZLWKDFXWHPLGGOHFHUHEUDODUWHU\0&$ LVFKDHPLFVWURNHXQGHUZHQWQRQFRQWUDVW&7 &73DQG&7DQJLRJUDSK\RQDGPLV VLRQZLWKDVOLFH&7VFDQQHU,Q&73PHDVXUHPHQWVGLIIHUHQWDUWHULHVZHUH VHOHFWHGDVWKH$,)DQGWKHDUHDXQGHUWKH$,)FXUYH$8&$,)ZDVFDOFXODWHG 7 RLQYHVWLJDWHWKH $,)DFFXUDF\ZHFRPSDUHGWKHTXDQWLWDWLYHSHUIXVLRQPHDVXUH PHQWVLQERWKV\PSWRPDWLFDQGDV\PSWRPDWLFKHPLVSKHUHUHSHDWHG0HDVXUHVҋ WHVWIRUHDFK$,)ORFDWLRQ7 RUHGXFHRSHUDWRUVWHSVDQGLPSURYHUHSURGXFLELOLW\ ZHH[DPLQHGLIVHOHFWLRQRIWKH92)FRXOGEHUHSODFHGE\WKH$,) 7KHUHVXOWLQJ TXDQWLWDWLYHPHDVXUHPHQWVRIERWK$,)DQG92)ZHUHFRPSDUHGSDLUHGWWHVW 5HVXOWV7KH LQWHUQDO FDURWLG DUWHU\ ,&$ KDG VLJQLÀFDQWO\ WKH ODUJHVW$8&$,) IROORZHG E\ WKH EDVLODU DUWHU\ $EDV WKH 0&$ DQG WKH DQWHULRU FHUHEUDO DUWHU\ EHWZHHQDOOJURXSVS6HOHFWLQJWKH,&$DQG$EDVDV$,)UHVXOWHGLQ WKHPRVWDFFXUDWHYDOXHVZLWKORZHVWTXDQWLWDWLYHPHDQ&%9DQG&%)DQGDF FRUGLQJO\KLJKHVWTXDQWLWDWLYH077DOOS5HSODFHPHQWRI92)E\$,) VKRZHGVLJQLÀFDQWO\KLJKHUPHDQ&%9LHRYHUHVWLPDWLRQRQERWKWKHKHPLVSKHUH LSVLDQGFRQWUDODWHUDOWRWKHWKURPEXVS DQGS UHVSHFWLYHO\DQGD VLJQLÀFDQWO\KLJKHU&%)S RQWKHLSVLODWHUDOKHPLVSKHUH &RQFOXVLRQ7 RLPSURYHYDOLGLW\RITXDQWLWDWLYHSHUIXVLRQYDOXHVZHUHFRPPHQG WRVHOHFWWKH,&$DVWKH$,)DQGDODUJHYHLQDVWKH92) 0HWKRGVDQG0DWHULDOV6HYHQWHHQ $6SDWLHQWVZKRWKURPEROLVHGXQGHUZHQWEUDLQ XQHQKDQFHG&7DQG&7SHUIXVLRQ&73DWDGPLVVLRQDQGKVDIWHUWKURPERO\VLV $OO&7VWXGLHVZHUHUHYLHZHGDQGU)3V&%) &690,77RILVFKDHPLFDQGQRUPDO EUDLQDWERWKWLPHIUDPHVZHUHFDOFXODWHGU)3VZHUHFRUUHODWHGZLWKEDVHOLQHDQG KV1,+66UHVSHFWLYHO\$PXOWLYDULDWHOLQHDUUHJUHVVLRQDQDO\VLVZDVXVHGWR LQYHVWLJDWHWKHHIIHFWRIWKHLQLWLDOU)3VRQWKHFOLQLFDORXWFRPH 5HVXOWV1RUPDOEUDLQU)3VDWKVZHUHQRWVLJQLÀFDQWO\GLIIHUHQWFRPSDUHGWR LQLWLDOU)3V&%)DQG077RIGLVHDVHGEUDLQZHUHVLJQLÀFDQWO\UHGXFHGS DQGLQFUHDVHGSUHVSHFWLYHO\FRPSDUHGWRWKHFRQWUDODWHUDOKHDOWK\VLGH U)3VRIWKHGLVHDVHGEUDLQZHUHVLJQLÀFDQWO\LPSURYHGDWKV077 S &%) S &%9 S 1,+66 ZDV VLJQLÀFDQWO\ LPSURYHG DW KV S&%9ZDVWKHVWURQJHVWSUHGLFWRURILPSURYHPHQWRI1,+66IROORZHG E\0775A S &RQFOXVLRQU)3VDQG1,+66DUHVLJQLÀFDQWO\LPSURYHGKVDIWHUWKURPERO\VLV DWWKHVHWWLQJVRI$67KHFOLQLFDOVHYHULW\H[SUHVVHGE\1,+66LVVWURQJO\FRUUH ODWHGWR&%9RIWKHGLVHDVHGEUDLQDWSUHVHQWDWLRQRIWKHVWURNHDQGDWKVODWHU )XUWKHUPRUHSDWLHQWVZLWKWKHORZHU&%9YDOXHVDWDGPLVVLRQKDGDSRRUHUFOLQLFDO RXWFRPHDVLWLVH[SUHVVHGE\KLJKHU1,+66 % '\QDPLFSHUIXVLRQ&73&7LPDJLQJDQGDOWHUDWLRQRIEORRGEUDLQ EDUULHUSHUPHDELOLW\%%%3DIWHUDFXWHLVFKDHPLFVWURNH$,6 SURJQRVWLFVLJQLÀFDQFH (3XJOLHOOL0%DÀOH0)XVFKL9'L(JLGLR00RQLQD7 HUDPR,7 HGRSXJ#KRWPDLOFRP 3XUSRVH $LPRIWKHVWXG\ZDVWRDVVHVVWKHFRUUHODWLRQEHWZHHQ%%%SHUPHDELOLW\ DOWHUDWLRQDQGWKHÀQDORXWFRPHLQ$,6 0HWKRGV DQG 0DWHULDOV )URP -DQXDU\ VL[W\ SDWLHQWV ZLWK$,6 OHVV WKDQ K IRU DQWHULRU RU K IRU YHUWHEUREDVLODU FLUFXODWLRQ PHDQ DJH \ HYDOXDWHG E\3&7ZHUHLQFOXGHG,QFUHDVHRQPLFURYDVFXODUSHUPHDELOLW\03RIWKH%%% ZDVGHWHFWHGDQG03FRORXUPDSVZHUHUHWURVSHFWLYHO\JHQHUDWHG7ZRH[SHUWLVH UHDGHUVDQDO\VHGHDFKPDSE\GUDZLQJFLUFXODUPPUHJLRQVRILQWHUHVWRQ WKH IRFDO DEQRUPDOLW\7KH PHDQ RI WKHVH UHJLRQV RI LQWHUHVWUHSUHVHQWHG WKH 03RIWKHLQIDUFW03,DQGRQWKHQRQLVFKDHPLFKHPLVSKHUH03&FRQWURO7KH PRGLÀHG5DQNLQVFRUHP56WHVWZDVSHUIRUPHG03,DQG03&ZHUHFRPSDUHG H[DFW:LOFR[RQWHVW03,WKDWGHYHORSHG+7RQIROORZXS03+7ZDVFRPSDUHG ZLWKDOORIWKHRWKHUV031R+7H[DFW0DQQ:KLWQH\WHVW 5HVXOWV)LIW\IRXULQIDUFWVVKRZHGIRFDO03HOHYDWLRQLQWKHUHJLRQRILQIDUFW &HUHEUDOEORRGÁRZ&%)POJPLQ03,UDQJHGIURPWRPHDQ YHUVXV03&RIPHDQ36L[LQIDUFWVGHYHORSHG +7 DOORIZKLFKZHUHZLWKLQWKHDUHDVRI03HOHYDWLRQ03+7UDQJHGIURPWR PHDQYHUVXV031R+7RIPHDQ3)RUW\ LQIDUFWVZHUHWUHDWHGZLWKHPEROHFWRP\DQGORFDOUW3$$VLJQLÀFDQWGLIIHU HQFHEHWZHHQ03+7DQG031R+7SHUVLVWHGZLWKUHVSHFWWRORFDOWUHDWPHQW &RQFOXVLRQ3&7KDVDQLQYHUVHFRUUHODWLRQZLWKWKHP56ZKLOHHOHYDWHG%%%3 ZDVGLUHFWO\FRUUHODWHGZLWKWKHRXWFRPHDQG3&7FDQSUHGLFW+7 % &7SHUIXVLRQDQG&7DQJLRJUDSK\FDQWKH\EHWWHUSUHGLFWWKHÀQDOLQIDUFW" 0)HUQiQGH]7 DUDQLOOD&5&DUDFHOD=HEDOORV,+HUUHUD(%DUFHQD -0*DUFLD%HQDVVL5*RQ]DOH]*XWLHUUH]7 ROHGR(6 3XUSRVH7 RHYDOXDWHFHUHEUDO&7SHUIXVLRQLPDJLQJ&&73SUHGLFWLQJÀQDOLQI DUFWHGFHUHEUDODUHDV,&$7 RUHYLHZFRUUHODWLRQRIWKHLPDJLQJÀQGLQJVEHWZHHQ QRQHQKDQFHG&71(&7DQGFHUHEUDOEORRGYROXPH&%9PDSVLGHQWLI\LQJWKH ,&$7 RDVVHVVWKHLPSDFWRIFROODWHUDODUWHULHV&$LQWKHGHYHORSPHQWRIWKHÀQDO LQIDUFW7 RDQDO\VHWKHRXWFRPHRIWKHFHUHEUDODUHDVDWULVNLQÀEULQRO\VLVWUHDWHG SDWLHQWV)73YHUVXVQRQWUHDWHGSDWLHQWV173 0HWKRGVDQG0DWHULDOV:HUHYLHZHGUHWURVSHFWLYHO\LPDJLQJÀQGLQJVRIVWURNH LQSDWLHQWVZKRXQGHUZHQW1(&7 &&73DQGIROORZXS1(&7DIWHUKRXUV XVLQJWKH$OEHUWD6WURNH3URJUDP(DUO\&76FRUH$63(&76DVDPHDVXUHRI FHUHEUDODUHDV&7DQJLRJUDSK\ZDVSHUIRUPHGWRHYDOXDWHWKH&$LQWKHPLGGOH FHUHEUDODUWHU\WHUULWRU\DEVHQWPRGHUDWHDQGHYLGHQW:HSHUIRUPHGFRUUHOD WLRQDQGOLQHDUUHJUHVVLRQDQDO\VLVEHWZHHQ$63(&76RQ1(&7 &%9&%) DQG IROORZXS&7)&7LQ)73DQG173 5HVXOWV7KHUHLVDVWURQJSRVLWLYHFRUUHODWLRQEHWZHHQ$63(&7RQ&%9PDSV DQG$63(&7RQ)&75 DQG$63(&7RQ1(&7DQG$63(&7RQ)&7 5 ERWKLQ173 ,Q)73ZHREVHUYHGDVWURQJSRVLWLYHFRUUHODWLRQ5 EHWZHHQFHUHEUDODUHDVDWULVNLQ&&73DQGWKRVHWKDWZHUHQRWLQIDUFWHGLQWKH)&7 /HVVLQIDUFWHGDUHDVZHUHVHHQLQ)73YHUVXV173YHUVXV&RPSDUHG ZLWKPRGHUDWHRUHYLGHQW&$DEVHQFHRI&$LQFUHPHQWVPRUHWKDQWKH,&$ 6FLHQWLILF6HVVLRQ 6 &$' ( ) *+% (XURSHDQ&RQJUHVVRI 5DGLRORJ\ % 'LJLWDOFKHVWWRPRV\QWKHVLVLPSDFWRQSDWLHQWPDQDJHPHQW (4XDLD(%DUDWHOOD$/RUXVVR) &DVDJUDQGH98OFLJUDL0&RYD 7ULHVWH,7TXDLD#XQLWVLW 3XUSRVH 7 R DVVHVV WKH FOLQLFDO LPSDFW RI GLJLWDO WRPRV\QWKHVLV '76 LQ WKH PDQDJHPHQWRISDWLHQWVZLWKVXVSHFWHGSXOPRQDU\OHVLRQVRQFKHVWUDGLRJUDSKLF H[DPLQDWLRQ&5( 0HWKRGVDQG0DWHULDOV7KUHHKXQGUHGDQGWKLUW\QLQHSDWLHQWVPDOHV IHPDOHVDJH\HDUVZLWKVXVSHFWHGSXOPRQDU\OHVLRQVRQ&5(XQ GHUZHQW'767ZRUHDGHUVH[SHULHQFHDQG\HDUVSURVSHFWLYHO\DQDO\VHG &5(DQG'76LPDJHVDQGSURSRVHGDGLDJQRVLVDFFRUGLQJWRDFRQÀGHQFHVFRUH RU GHÀQLWHRUSUREDEOHEHQLJQSXOPRQDU\RUH[WUDSXOPRQDU\OHVLRQRUSXOPR QDU\SVHXGROHVLRQGHVHUYLQJQRIXUWKHUGLDJQRVWLFZRUNXS LQGHWHUPLQDWHRU SUREDEOHRUGHÀQLWHSXOPRQDU\OHVLRQGHVHUYLQJIXUWKHUGLDJQRVWLFZRUNXSE\&7 0HDQLQWHUSUHWDWLRQWLPHDQGHIIHFWLYHGRVHZHUHPHDVXUHGERWKIRU&5(DQG'76 5HVXOWV)LQDOGLDJQRVHVLQFOXGHGSXOPRQDU\DQGSOHXUDOOHVLRQVLQ SDWLHQWVDQGSXOPRQDU\SVHXGROHVLRQVLQWKHUHPDLQLQJSDWLHQWV'76 UHVROYHGWKH&5(GRXEWIXOÀQGLQJZLWKRXWUHTXLULQJIXUWKHUGLDJQRVWLFZRUNXSLQ SDWLHQWV ZKLOH SDWLHQWV XQGHUZHQW FKHVW &7 7KH PHDQLQWHUSUHWDWLRQWLPHIRU'76PHDQ6'VHFVZDVKLJKHU3 :LOFR[RQWHVWWKDQIRU&5(VHFV0HDQHIIHFWLYHGRVHZDVP6Y UDQJHP6YIRU&5(DQGP6YUDQJHP6YIRU'76 &RQFOXVLRQ'76DYRLGHGWKHQHHGIRUFKHVW&7LQDERXWWKUHHIRXUWKRISDWLHQWV ZLWKVXVSHFWHGSXOPRQDU\OHVLRQVRQ&5(ZLWKDVOLJKWLQFUHDVHLQWKHLQWHUSUHWD WLRQWLPHDQGHIIHFWLYHGRVHFRPSDUHGWR&5( % 8OWUDORZGRVH&7IRUWKHGHWHFWLRQDQGFKDUDFWHULVDWLRQRIWKHPRVW FRPPRQ&7SDWWHUQVRISXOPRQDU\GLVHDVH $&KULVWH -&KDULPR7 RUUHQWH3 9RFN-(5RRV%HUQH&+ :LQWHUWKXU&+DQGUHDVFKULVWH#LQVHOFK 3XUSRVH7 RDVVHVVWKHDFFXUDF\RIXOWUDORZGRVH&7IRUWKHGHWHFWLRQDQGFKDU DFWHULVDWLRQRIWKHPRVWFRPPRQ&7SDWWHUQVRISXOPRQDU\GLVHDVHFRPSDUHGWR PLGGOHGRVH&7VFDQVRIWKHFKHVW 0HWKRGVDQG0DWHULDOV7 HQSDWLHQWVZLWKSXOPRQDU\LQIHFWLRQVZLWKLQWHUVWLWLDO OXQJGLVHDVHVDQGZLWKOXQJQRGXOHVZHUHVFDQQHGDFFRUGLQJWRDQXOWUDORZ GRVH[PPUHIHUHQFHP$VN9SDQGDPLGGOHGRVHUHIHUHQFH P$VN9SFRQWUDVWHQKDQFHGFKHVW&7SURWRFRO;HQHWL[7ZRUDGLRORJLVWV ZLWKDQG\HDUVRIWKRUDFLFLPDJLQJH[SHULHQFHVHDUFKHGLQGLYLGXDOO\ERWKGRVH LPDJHVIRUWKHPRVWFRPPRQ&7SDWWHUQVFRQVLVWLQJRIGLIIHUHQWVXEJURXSVRI JURXQGJODVVRSDFLWLHVQRGXOHVLQWHUVWLWLDODQGDLUVSDFHGLVHDVHV7KHVWDQGDUG RIUHIHUHQFHZDVHVWDEOLVKHGE\WZRGLIIHUHQWH[SHUWUDGLRORJLVWVLQFRQVHQVXV 5HVXOWV 7KH OXQJ VHJPHQWV VKRZHG QRGXOHV JURXQG JODVV RSDFLWLHVDLUVSDFHDQGLQWHUVWLWLDOGLVHDVHVDQGQRUPDOVHJPHQWV%RWK UHDGHUVҋ VHQVLWLYLWLHV VSHFLÀFLWLHV DQG DFFXUDFLHV RI XOWUDORZGRVH &7 GLG QRW GURSVLJQLÀFDQWO\0F1HPDUIRURIWKHSDWWHUQV7KHVHQVLWLYLW\RIRQO\RQH UHDGHUGURSSHGIRUVPDOOJURXQGJODVVQRGXOHVPPIURPWRSYDOXH DQGVHQVLWLYLW\IRUDOOLQWHUVWLWLDOOXQJGLVHDVHVWRJHWKHUZDVVLJQLÀFDQWO\ ORZHUIRUERWKUHDGHUVZLWKDQDYHUDJHORVVRIVHQVLWLYLW\RIIURPWR 5HDGHUDQGIURPWR5HDGHUUHVSHFWLYHO\ &RQFOXVLRQ([FHSWIRUVPDOOJURXQGJODVVQRGXOHVDQGLQWHUVWLWLDOOXQJGLVHDVH WKHSDWWHUQGHWHFWDELOLW\LVQRWVLJQLÀFDQWO\LPSDLUHGDWXOWUDORZGRVH&7 ,WLVDS SOLFDEOHIRUOXQJQRGXOHRUFRQVROLGDWLRQIROORZXSH[DPLQDWLRQV % ,PSDFWRIWKJHQHUDWLRQLWHUDWLYHUHFRQVWUXFWLRQWHFKQLTXHRQLPDJH TXDOLW\LQXOWUDORZGRVHFRPSXWHGWRPRJUDSK\RIWKHOXQJV $/DTPDQL) +HQHV-+%XKN+&YRQ6FKXOW]HQGRUII'+DPPHUOH +1DJHO*$GDP05HJLHU+DPEXUJ'(D]LHQODTPDQL#JP[GH 3XUSRVH7 RLQWUDLQGLYLGXDOO\FRPSDUHDQGHYDOXDWHWKHLQÁXHQFHRIWKHWKJHQ HUDWLRQLWHUDWLYHUHFRQVWUXFWLRQ ,5WHFKQLTXH L'RVHRQXOWUDORZGRVH 0'&7 RIWKHOXQJVZLWKUHJDUGWRDQDWRPLFDOGHOLQHDWLRQOHVLRQFRQVSLFXLW\DQGDUWHIDFW UHGXFWLRQ 0HWKRGV DQG 0DWHULDOV ,Q LPPXQRFRPSURPLVHG SDWLHQWV ZLWK VXVSHFWHG SXOPRQDU\ LQIHFWLRQ WKH UDZ GDWD RI XQHQKDQFHG 0'&7 VFDQV N9 PHDQ &7',YROP*\PHDQ'/3P*\;FPZHUHUHFRQVWUXFWHGXVLQJDSURWR W\SLFUHFRQVWUXFWLRQSURFHVVRUIHDWXULQJL'RVH3KLOLSV%HVWWKH1HWKHUODQGV L'RVHOHYHOVHWWLQJVYDULHGEHWZHHQDQG,PDJHVZHUHUHFRQVWUXFWHG ZLWKDVOLFHWKLFNQHVVRI PP7KUHHUDGLRORJLVWVEOLQGHGWRWKHUHFRQVWUXFWLRQ WHFKQLTXHLQGHSHQGHQWO\SHUIRUPHGLPDJHDQDO\VLV$SRLQWJUDGLQJVFDOHZDV % (IIHFWRIUDGLDWLRQH[SRVXUHRQTXDQWLWDWLYHHYDOXDWLRQRIFHUHEUDO &7SHUIXVLRQPDSVUHVXOWVIURPDK\EULGGLJLWDOSKDQWRP 5YDQGHQ%RRP07 +2HL/-2RVWYHHQ(-6PLW6-/DIHEUH %YDQ*LQQHNHQ50DQQLHVLQJ03URNRS1LMPHJHQ1/8WUHFKW1/ 5YDQGHQ%RRP#UDGXPFQQO 3XUSRVH7 RXVHDK\EULGGLJLWDOSKDQWRPWRVWXG\WKHHIIHFWRIP$VRQTXDQWLWDWLYH HYDOXDWLRQRIFHUHEUDO&7SHUIXVLRQVFDQV 0HWKRGVDQG0DWHULDO7KHK\EULGGLJLWDOSKDQWRPFRQVLVWVRIVFDQVRIDKRPR JHQHRXVVNXOOSKDQWRPRQZKLFKFLUFXODUREMHFWVPPDUHGLJLWDOO\VX SHULPSRVHG7LVVXHSHUIXVLRQFXUYHVGHULYHGIURPSDWLHQWGDWDZHUHVXSHULPSRVHG RQWKHEDFNJURXQGZKLWHPDWWHUDQGRQWKHREMHFWVJUH\PDWWHU:HWHVWHGD &73VHTXHQFHXVLQJVFDQVHYHU\VRYHUVN9PPWKLFNQHVVGHULYHG IURPDURZ&7VFDQQHU7KHP$VYDOXHVSHU&73VHTXHQFHZHUHYDULHGSHU VFDQP$V$V\QWKHWLFGDWDVHWZLWKRXWQRLVHZDVWKHJROGVWDQGDUG&%) PDSVIRUHDFKP$VVHWWLQJDQGIRUWKHV\QWKHWLFGDWDVHWZHUHFDOFXODWHGXVLQJWKH $6,67&7SURJUDP1RLVHLQ&%)PDSVZDVPHDVXUHGLQWKHEDFNJURXQGFRQWUDVW EHWZHHQEDFNJURXQGDQGREMHFWVZDVPHDVXUHGLQFLUFXODU52,VZLWKDGLDPHWHU RIKDOIWKHREMHFWGLDPHWHU6L]HDQGGRVHGHSHQGHQFHRIDEVROXWHYDOXHVDQG &15LQ&%)PDSVZDVFDOFXODWHG 5HVXOWV$ERYHP$VSHUVFDQWKH&%)YDOXHVIRUWKHPPREMHFWVZHUH ZLWKLQRIWKHJROGVWDQGDUG$WP$V&%)ZDVRYHUHVWLPDWHGE\! :LWKVPDOOHUREMHFWVWKHHVWLPDWLRQRI&%)EHFDPHOHVVSUHFLVH&15IRU&%) LQPPGHFUHDVHGUDSLGO\&15DWP$VZDVDQGGHFUHDVHGWRDW P$VDQGDWP$V &RQFOXVLRQ$EVROXWH&%)YDOXHVUHTXLUHVXIÀFLHQWGRVHWREHFRUUHFWYDOXHVDW ORZGRVHDUHRYHUHVWLPDWHG,QDGGLWLRQ&15UDSLGO\GHFUHDVHVZLWKORZHUGRVH 5RRP' &KHVW 66 ,PDJHTXDOLW\DQGGRVHUHGXFWLRQ 0RGHUDWRUV 0%ULQN1LMPHJHQ1/ 035HYHO3DULV)5 % ,PSURYLQJEUHDWKKROGGXULQJPRELOHUDGLRJUDSK\ 1+RXVVHLQ'$OD]DZL0) 0F(QWHH'XEOLQ,(6\GQH\$8 PDUNPFHQWHH#V\GQH\HGXDX 3XUSRVH7KHGHJUHHRILQÁDWLRQRIWKHOXQJVHHQRQDFKHVW[UD\&;5LVGHSHQG HQWRQZKHQWKHUDGLRJUDSKHUH[SRVHVWKHLPDJHUHFHSWRUGXULQJWKHUHVSLUDWRU\ F\FOH([SRVLQJWKHUDGLRJUDSK\LPDJHUHFHSWRUDWWKHH[DFWSHDNRILQÁDWLRQPD\ EH TXLWH GLIÀFXOW EHFDXVH WKH LQVSLUDWRU\ SDXVH PD\ EH H[FHHGLQJO\ EULHI :H DLPHGWRWHVWZKHWKHULPDJHVWDNHQZLWKDQGZLWKRXWDQLQFHQWLYHVSLURPHWHUVKRZ GLIIHUHQWOHYHOVRILPDJHTXDOLW\ 0HWKRGVDQG0DWHULDOV7KLVLVDSDLUHGSURVSHFWLYHVLQJOHEOLQGHGVWXG\RI SDWLHQWVXQGHUJRLQJDPRELOH&;57KHUDGLRJUDSKVZHUHWDNHQZLWKDQGZLWKRXW WKHXVHRIWKHLQFHQWLYHVSLURPHWHU,6,PDJHVZHUHVFRUHGXVLQJWKH(XURSHDQ *XLGHOLQHVRQ4XDOLW\FULWHULDIRUGLDJQRVWLFUDGLRJUDSKLFLPDJHV 5HVXOWV7KH PHDQ SDWLHQWVҋ DJH ZDV \HDUV 6L[W\ LPDJHV ZHUH WDNHQKDOI ZLWKWKHXVHRI,6DQGKDOIZLWKRXWWKHXVHRIWKH,63RVWOXQJOREHFWRP\ZDVWKH PDLQLQGLFDWLRQIRUWKHPRELOH&;56FRULQJWKHYLVXDOLVDWLRQRIWKHVL[WKULEVSLQH WUDFKHDDQGWKHFDUGLDFERUGHUZDVQRWDIIHFWHGVLJQLÀFDQWO\E\WKHXVHRIWKH,6 :KLOHLPSURYHGYLVXDOLVDWLRQRIWKHWHQWKULEWKHYDVFXODUSDWWHUQWKHUHWURFDUGLDF OXQJDQGWKHFRVWRSKUHQLFDQJOHVZDVVLJQLÀFDQWO\DVVRFLDWHGZLWKWKHXVHRIWKH ,6S S S DQGS UHVSHFWLYHO\ &RQFOXVLRQ7KLVVWXG\SURYLGHVDQRYHOWHFKQLTXHWRLPSURYHWKHTXDOLW\RIPRELOH &;5 LPDJHV7KH XVH RI WKH ,6 KDV LPSURYHG WKH LQVSLUDWRU\ GHSWK DQG LPDJH TXDOLW\ZKHQXVHGLQSDWLHQWVUHTXLULQJLQZDUGPRELOH&;5 6FLHQWLILF6HVVLRQ $ 6&'()*+%(XURSHDQ&RQJUHVVRI 5DGLRORJ\ 6DWXUGD\ HYHQHQDEOHGWKHVDPHLPDJHTXDOLW\DVEUHDWKKROGLPDJLQJ3HUIRUPLQJLPDJH DFTXLVLWLRQ GXULQJ IUHH EUHDWKLQJ OHDG WR D PLQRU LPDJH TXDOLW\ FRPSDUHG WR DOO RWKHUWHFKQLTXHVDSSOLHG &RQFOXVLRQ,QDQH[SHULPHQWDOVHWWLQJUHWURVSHFWLYHJDWLQJLVVXSHULRUWRSURVSHF WLYHJDWLQJDQGFDQHYHQEHRIHTXLYDOHQWLPDJHTXDOLW\DVVWDQGDUGEUHDWKKROG LPDJLQJZKHQVHWWRORZHUUHVSLUDWRU\IUHTXHQFLHVDQGWDEOHVSHHG % $GDSWLYHLWHUDWLYHGRVHUHGXFWLRQXVLQJWKUHHGLPHQVLRQDO SURFHVVLQJ$,'5'IRUUHGXFHGDQGORZGRVH&7H[DPLQDWLRQ FRPSDULVRQZLWKVWDQGDUGGRVH&7RILPDJHTXDOLW\DQGUDGLRORJLFDO ÀQGLQJDVVHVVPHQWIRUSDWLHQWVZLWKYDULRXVSXOPRQDU\GLVHDVHV < 2KQR 01LVKLR+.R\DPD'7 DNHQDND7 <RVKLNDZD60DWVXPRWR 16XJLKDUD+,QRNDZD.6XJLPXUD.REH-32KWDZDUD-3 \RVLUDG#NREHXDFMS 3XUSRVH7 RFRPSDUHWKHLPDJHQRLVHUHGXFWLRQFDSDELOLWLHVDQGUDGLRORJLFDOÀQG LQJVDVVHVVPHQWVIRUUHGXFHGDQGORZGRVHFKHVW&7ZLWKRXWDQGZLWKDGDSWLYH LWHUDWLYHGRVHUHGXFWLRQXVLQJWKUHHGLPHQVLRQDOSURFHVVLQJ$,'5'ZLWKWKRVH IRUVWDQGDUGGRVH&7IRUSDWLHQWVZLWKYDULRXVSXOPRQDU\GLVHDVHV 0HWKRGVDQG0DWHULDOV&KHVW&7H[DPLQDWLRQVZLWKWKUHHGLIIHUHQWWXEHFXUUHQWV DQGXVLQJDQGGHWHFWRUURZ&7ZHUHDGPLQLVWHUHGWRSDWLHQWVP$V VWDQGDUGGRVH GDWD ZDV UHFRQVWUXFWHG DV WKLQVHFWLRQ &7 ZLWKRXW$,'5 ' DQG&7GDWDDWP$VORZGRVHDQGP$VUHGXFHGGRVHDVWKLQVHFWLRQ &7ZLWKRXWDQGZLWK$,'5'7 RFRPSDUHLPDJHTXDOLW\LPDJHQRLVHRIDOO&7 V ZDVTXDQWLWDWLYHO\DVVHVVHGE\PHDQVRI52,PHDVXUHPHQWV)RUFRPSDULVRQRI UDGLRORJLFDOÀQGLQJDVVHVVPHQWVSUREDELOLWLHVRIHPSK\VHPDJURXQGJODVVRSDF LW\UHWLFXODURSDFLW\EURQFKLHFWDVLVKRQH\FRPEDQGQRGXOHVZHUHHYDOXDWHGRQD SRLQWVFDOH7KHQLPDJHQRLVHDQGDJUHHPHQWVRIUDGLRORJLFDOÀQGLQJVEHWZHHQ VWDQGDUGGRVH&7DQGRWKHUVZHUHVWDWLVWLFDOO\HYDOXDWHG 5HVXOWV ,PDJH TXDOLWLHV RI UHGXFHG DQG ORZGRVH &7 V ZLWKRXW$,'5 ' ZHUH VLJQLÀFDQWO\ORZHUWKDQWKDWRIRWKHUVS$OOLQWUDPHWKRGDJUHHPHQWVIRU HPSK\VHPD**2EURQFKLHFWDVLVKRQH\FRPESDWWHUQDQGQRGXOHVH[FHSWIRU WKRVHREVHUYHGRQORZGRVH&7ZLWKRXW$,'5'ZHUHDOPRVWSHUIHFWѣ! $JUHHPHQWV IRU UHWLFXODU RSDFLW\ RI UHGXFHGGRVH &7 ZHUH DOVR DOPRVW SHUIHFW ZKLOHWKHUHVSHFWLYHDJUHHPHQWVRIORZGRVH&7ZLWKRXWDQGZLWK$,'5'ZHUH PRGHUDWHѣ DQGVXEVWDQWLDOѣ &RQFOXVLRQ$,'5'LVXVHIXOIRULPDJHQRLVHUHGXFWLRQDQGUDGLRORJLFDOÀQGLQJ DVVHVVPHQWVREWDLQHGZLWKUHGXFHGDQGORZGRVH&7 VIRUSDWLHQWVZLWKYDULRXV SXOPRQDU\GLVHDVHV % 0RGHOEDVHGLWHUDWLYHUHFRQVWUXFWLRQWHFKQLTXHIRUUDGLDWLRQGRVH UHGXFWLRQLQFKHVW&7 0.DWVXUD,0DWVXGD0$NDKDQH-6DWR+$NDL$.XQLPDWVX.<DVDND .2KWRPR7 RN\R-3 3XUSRVH7 RLQWUDLQGLYLGXDOO\FRPSDUHLPDJHTXDOLW\FKDUDFWHULVWLFVRIORZGRVH FKHVW &7 UHFRQVWUXFWHG ZLWK PRGHOEDVHG LWHUDWLYH UHFRQVWUXFWLRQ 0%,5 DQG DGDSWLYHVWDWLVWLFDOLWHUDWLYHUHFRQVWUXFWLRQ$6,5DQGVWDQGDUGGRVH&7UHFRQ VWUXFWHGZLWK$6,5 0HWKRGV DQG 0DWHULDOV ,Q WKLV SURVSHFWLYH VWXG\ SDWLHQWV PDOHIHPDOH DJH\HDUVXQGHUZHQWXQHQKDQFHGFKHVW&7VFDQDWVWDQGDUG GRVHDQGORZGRVHZLWKDURZPXOWLGHWHFWRU&7VFDQQHUZKLFKLQYROYHGWKH XVHRIDXWRPDWLFWXEHFXUUHQWPRGXODWLRQZLWKÀ[HGQRLVHLQGH[HVRI PPIRUVWDQGDUGGRVHORZGRVH&7,PDJHVZHUHUHFRQVWUXFWHGEOHQGLQJRI ÀOWHUHGEDFNSURMHFWLRQDQG$6,5LPDJHGDWD$6,5IRUVWDQGDUGGRVH DQGDW$6,5DQG0%,5IRUORZGRVH&7 7ZRUDGLRORJLVWVDVVHVVHGWKHLPDJHV LQDEOLQGHGDQGUDQGRPLVHGPDQQHUIRUVXEMHFWLYHLPDJHQRLVHDUWHIDFWVFULWLFDO UHSURGXFWLRQRIYLVXDOO\VKDUSFKHVWVWUXFWXUHVDQGGLDJQRVWLFDFFHSWDELOLW\2EMHF WLYHLPDJHQRLVHZDVPHDVXUHGLQWKHOXQJSDUHQFK\PD'DWDZHUHDQDO\VHGE\ XVLQJWKHVLJQWHVWDQGWKHSDLUZLVHGVWXGHQWWWHVW 5HVXOWV7KHUHZDVDGHFUHDVHIRUGRVHOHQJWKSURGXFWZLWKORZGRVH&7 FRPSDUHGWRVWDQGDUGGRVH&7 /RZGRVH0%,5LPDJHVKDGVLJQLÀFDQWO\ORZHU REMHFWLYHLPDJHQRLVHLQWKHOXQJSDUHQFK\PDFRPSDUHGZLWKORZ GRVH$6,53DQGVWDQGDUGGRVH$6,5LPDJHV 3'LDJQRVWLFDFFHSWDEOHLPDJHVZHUHREWDLQHGZLWKDOOORZGRVH0%,5 LPDJHV DOWKRXJK WKH\ WHQGHG WR KDYH PRWLRQ DUWHIDFWV DQG SL[LODWHG EORWFK\ DSSHDUDQFHV &RQFOXVLRQ,QFKHVW&7LPDJHVDFTXLUHGZLWKQHDUO\UDGLDWLRQGRVHUHGXFWLRQ 0%,5VLJQLÀFDQWO\LPSURYHVLPDJHTXDOLW\FRPSDUHGWR$6,5DQGSURYLGHVGLDJ QRVWLF DFFHSWDEOH LPDJHV KRZHYHU LPDJH TXDOLWLHV RI ORZGRVH0%,5 DUH QRW FRPSOHWHO\HTXLYDOHQWWRWKRVHRIVWDQGDUGGRVH$6,5 DSSOLHGUHJDUGLQJWKHGHSLFWLRQRIDQDWRPLFDOGHWDLOVDQGWKHGHJUHHRIDUWHIDFWV REVHUYHGZRUVWH[FHOOHQW7KHVLJQDOWRQRLVHUDWLR615ZDVDVVHVVHG IRUHDFKGDWDVHW6WDWLVWLFDOHYDOXDWLRQLQFOXGHGNDSSDDQDO\VLVDQG:LOFR[RQWHVW 5HVXOWV %HVW LPDJH TXDOLW\ ZDV DVVHVVHG ZLWK L'RVH OHYHO &RPSDUHGWR ÀOWHUHGEDFNSURMHFWLRQWKHKLJKL'RVHOHYHORILPSURYHGWKHFRQVSLFXLW\RI VXEWOHLQÀOWUDWLRQVJURXQGJODVVRSDFLWLHVDQGPRVDLFSHUIXVLRQ(YHQDWWKHORZHU L'RVHOHYHORILPDJHUDWLQJVVFRUHGVXSHULRUWRÀOWHUHGEDFNSURMHFWLRQ:LWK LQFUHDVLQJL'RVHOHYHOVUHGXFWLRQRIVWUHDNDUWHIDFWVZDVVXFFHVVIXOO\TXDQWL ÀHGE\DGHFUHDVHRIWKHVWDQGDUGGHYLDWLRQDWFRQVWDQWPHDQDWWHQXDWLRQYDOXHV &RQFOXVLRQ,WHUDWLYHUHFRQVWUXFWLRQVREWDLQHGLQXOWUDORZGRVH0'&7VXEVWDQ WLDOO\ LPSURYH LPDJH TXDOLW\ FRQVSLFXLW\ RI VXEWOH OHVLRQV DQG GHFUHDVH LPDJH QRLVHHYHQDWORZHUL'RVH70OHYHOV7KXVWKHLPSOHPHQWDWLRQRIWKLVWHFKQLTXH LQWRFOLQLFDOURXWLQHLPDJLQJVHHPVWREHGHVLUDEOHHJIRULPPXQRFRPSURPLVHG SDWLHQWVLQZKRPWKHLGHQWLÀFDWLRQRIVXEWOHFKDQJHVFDQEHFUXFLDO % 8SJUDGLQJWRDGDSWLYHVWDWLVWLFDOLWHUDWLYHUHFRQVWUXFWLRQ$6,5LQ URZFRPSXWHGWRPRJUDSK\&7RIWKHFKHVWGHWDLOHGDQDO\VLV RIWKHSHUIRUPDQFHRIGLIIHUHQW$6,5PRGHVDQGOHYHOVE\LQWUD LQGLYLGXDOFRPSDULVRQRIGRVHUHGXFHG$6,5VFDQVWRIXOOGRVH ÀOWHUHGEDFNSURMHFWLRQVHULHV 6:LUWK/0LFKDHO'0D[LHQ='HDN06FKHUU8/LQVHQPDLHU05HLVHU 0.|UQHU0XQLFK'(VWHIDQZLUWK#PHGXQLPXHQFKHQGH 3XUSRVH7 RFRPSDUHLPDJHTXDOLW\LQGRVHUHGXFHGURZ&7RIWKHFKHVWDW GLIIHUHQWOHYHOVRIDGDSWLYHVWDWLVWLFDOLWHUDWLYHUHFRQVWUXFWLRQ$6,5WRIXOOGRVH EDVHOLQHH[DPLQDWLRQVUHFRQVWUXFWHGVROHO\ZLWKÀOWHUHGEDFNSURMHFWLRQ)%3LQ DUHDOLVWLFXSJUDGHVFHQDULR 0HWKRGVDQG0DWHULDOV$ZDLYHURIFRQVHQWZDVJUDQWHGE\WKH,5%%DVHOLQH H[DPLQDWLRQV RI WKH FKHVW QRLVH LQGH[ 1, /LJKW6SHHG 9&7 ;7 *( ZHUH LQWUDLQGLYLGXDOO\FRPSDUHGWRIROORZXSVWXGLHVRQD&7ZLWK$6,5RSWLRQ1, RWKHUVFDQYDULDEOHVFRQVWDQWDQGDVSURYLGHGE\WKHYHQGRU'LVFRYHU\+' *(Q )RUWKLVLPDJHVZHUHFDOFXODWHGLQ$6,5VOLFHDQGYROXPHPRGHZLWK $6,5EOHQGLQJVRIWRLQVWDQGDUGDQGOXQJNHUQHO7KUHHH[SHULHQFHG UDGLRORJLVWVLQGHSHQGHQWO\FRPSDUHGLPDJHTXDOLW\RIWKHVHVHULHVWRWKHFRU UHVSRQGLQJIXOOGRVHEDVHOLQHH[DPLQDWLRQVGLDJQRVWLFDOO\LQIHULRULQIHULRU HTXDOVXSHULRUGLDJQRVWLFDOO\VXSHULRU6WDWLVWLFDODQDO\VLVXVHGWKH:LO FR[RQWKH0DQQ:KLWQH\8WHVWDQGWKHLQWUDFODVVFRUUHODWLRQFRHIÀFLHQW,&& 5HVXOWV:LWKVWDQGDUGNHUQHOLPDJHTXDOLW\LQGRVHUHGXFHGVWXGLHVZDVFRPSDUD EOHWRWKHEDVHOLQHDW $6,5LQYROXPHPRGHS 9ROXPHPRGH ZDVVXSHULRUWRVOLFHPRGHVLJQLÀFDQWIRU $6,5S)RUOXQJNHUQHO HYHU\$6,5OHYHORXWSHUIRUPHGWKHEDVHOLQHLPDJHTXDOLW\SZLWK$6,5 UDWHGEHVWVOLFHYROXPH0HDQ&7',YROGHFUHDVHGIURP )%3EDVHOLQHWRP*\$6,5IROORZXSS,&&ZDV &RQFOXVLRQ9HQGRUVUHFRPPHQGDWLRQRI$6,5LVIDLU%XWIRUVWDQGDUG NHUQHO$6,5LQYROXPHPRGHDQGIRUOXQJNHUQHO$6,5SHUIRUPHGEHVW DOORZLQJIRUGRVHUHGXFWLRQ % ,QWUDLQGLYLGXDOFRPSDULVRQRILPDJHTXDOLW\XVLQJUHWURVSHFWLYHDQG SURVSHFWLYHUHVSLUDWRU\JDWLQJIRUWKHDFTXLVLWLRQRIWKLQVOLFHG' 0'&7RIWKHWKRUD[ 05HJLHU ) 2+HQHV'6FKZDU]0*URWK*5LHVHQEHUJ*$GDP 3 *&%HJHPDQQ+DPEXUJ'('VVHOGRUI'(PUHJLHU#XNHGH 3XUSRVH7 RLQWUDLQGLYLGXDOO\FRPSDUHLPDJHTXDOLW\DQGDQDWRPLFDOGHSLFWLRQRI WKHOXQJDQGPHGLDVWLQXPXVLQJUHWURVSHFWLYHDVZHOODVSURVSHFWLYHUHVSLUDWRU\ JDWLQJIRUWKHDFTXLVLWLRQRI'0'&7LQDSRUFLQHPRGHO 0HWKRGVDQG0DWHULDOV)LYHWUDFKHDO\LQWXEDWHGSLJVXQGHUZHQWURZ0'&7 RIWKHWKRUD[)RUUHWURVSHFWLYHDQGSURVSHFWLYHJDWLQJWKHIUHTXHQF\RIWKHUHV SLUDWRUZDVDGMXVWHGWRDQGUHVSLUDWRU\F\FOHVPLQ7KHWDEOHVSHHG YDULHGEHWZHHQDQGPPVHF)UHHEUHDWKLQJVFDQVRIWKHOXQJVZHUH SHUIRUPHGZLWKWKHVDPHUHVSLUDWRU\IUHTXHQFLHV$IWHUUHVSLUDWRU\FXWRIIDQDG GLWLRQDOVFDQLQEUHDWKKROGWHFKQLTXHZDVDFTXLUHGZKLFKVHUYHGDVWKHUHIHUHQFH 7KUHHUHYLHZHUVLQGHSHQGHQWO\DQDO\VHGWKH&7GDWDDSSO\LQJDSRLQWJUDGLQJ VFDOHUHJDUGLQJWKHGHJUHHRIDUWHIDFWVREVHUYHGDQGWKHDQDWRPLFDOGHSLFWLRQ H[FHOOHQWQRQGLDJQRVWLF&RPSDULVRQRIGLIIHUHQWWHFKQLTXHVZDVSHUIRUPHG XVLQJ:LOFR[RQPDWFKHGSDLUHGWHVW 5HVXOWV%UHDWKKROGLPDJLQJDOORZHGIRUWKHKLJKHVWLPDJHTXDOLW\PHDQYDOXHV WUDFKHDEURQFKLOXQJSDUHQFK\PDGLDSKUDJPSHULFDUGLXP 5HWURVSHFWLYHJDWLQJSURYHGWREHRIVXSHULRULPDJHTXDOLW\FRPSDUHGWR SURVSHFWLYHJDWLQJIRUDOOUHVSLUDWRU\IUHTXHQFLHVS!:LWKWKHUHVSLUDWRU\ IUHTXHQF\ VHW WR PLQ DQG D WDEOH VSHHG RI PPVHF UHWURVSHFWLYH JDWLQJ 6FLHQWLILF6HVVLRQ 6 &$' ( ) *+% (XURSHDQ&RQJUHVVRI 5DGLRORJ\ 5RRP' ,QWHUYHQWLRQDO5DGLRORJ\ 66 +HSDWRFHOOXODUFDUFLQRPDHQGRYDVFXODU 0RGHUDWRUV *$QWRFK'VVHOGRUI'( 5*ROÀHUL%RORJQD,7 % 3UHGLFWLYHIDFWRUVRIGRZQVWDJLQJRIKHSDWRFHOOXODUFDUFLQRPD+&& EH\RQGWKH0LODQFULWHULDWUHDWHGZLWKLQWUDDUWHULDOFKHPRHPEROLVDWLRQ 9%RYD/0DUX]]HOOL50LUDJOLD*%9L]]LQL) 7X]]ROLQR$/XFD 3DOHUPR,7YDOHQWLQDERYD#LQZLQGLW 3XUSRVH7KHSUHVHQWVWXG\ZDVXQGHUWDNHQWRUHWURVSHFWLYHO\DQDO\VHWKHORQJ WHUPFOLQLFDOUHVXOWVLQSDWLHQWVVXLWDEOHIRUOLYHUWUDQVSODQWDWLRQZKRXQGHUZHQW WUDQVDUWHULDO FKHPRHPEROLVDWLRQ 7$&( ZLWK KHSDWRFHOOXODU FDUFLQRPD +&& ZKR H[FHHGHG WKH 0LODQ FULWHULD WR GHWHUPLQH SUHGLFWLYH IDFWRUV RI VXFFHVVIXO GRZQVWDJLQJ 0HWKRGVDQG0DWHULDOV%HWZHHQ-DQXDU\DQG'HFHPEHUFRQ VHFXWLYHSDWLHQWVZLWK+&&ZHUHWUHDWHGE\UHSHDWHGO\SHUIRUPHG7$&(RIWKHP H[FHHGLQJWKH0LODQFULWHULD3DWLHQWVZLWKLQÀOWUDWLYH+&&K\SRYDVFXODU+&&SRUWDO YHLQWKURPERVLVZHUHH[FOXGHGZLWKDÀQDOVWXG\SRSXODWLRQRISDWLHQWV7XPRXU UHVSRQVHWR7$&(ZDVHYDOXDWHGDWPRQWKZLWK&705DFFRUGLQJWRDPHQGHG 5HVSRQVH(YDOXDWLRQ&ULWHULDLQ6ROLG7XPRXUV5(&,67JXLGHOLQHV6XFFHVVIXO GRZQVWDJLQJZDVGHÀQHGDVDUHGXFWLRQLQWKHQXPEHUDQGVL]HRIYLDEOHWXPRXUV WRZLWKLQWKH0LODQFULWHULDDQG$)3QJPOIRUDWOHDVWPRQWKV 5HVXOWV $IWHU7$&(SDWLHQWVKDGWKHLUWXPRXUVVXFFHVVIXOO\GRZQVWDJHG SDWLHQWVGLGQRW1RLQWHUJURXSGLIIHUHQFHVH[LVWHGZLWKUHVSHFWWRSDWLHQW FKDUDFWHULVWLFVRUW\SHVDQGQXPEHURIWUHDWPHQWV+RZHYHUDWPXOWLYDULDWHDQDO\ VLVDOSKDIHWRSURWHLQOHYHOVQJPODQG\HDUV0HWURWLFNHWZHUHVLJQLÀFDQW LQGHSHQGHQWSURJQRVWLFYDULDEOHVRIVXFFHVVIXOGRZQVWDJLQJSS UHVSHFWLYHO\ .DSODQ 0H\HU SDWLHQW VXUYLYDO UDWH ZDV VLJQLÀFDQWO\ KLJKHU LQ WKH GRZQVWDJHGJURXSWKDQLQWKHQRWGRZQVWDJHGJURXSS &RQFOXVLRQ ,Q SDWLHQWV ZLWK +&& EH\RQG WKH 0LODQ FULWHULD ELRORJLFDO FKDUDF WHULVWLFVRIWKHWXPRXUPD\SUHGLFWDJRRGUHVSRQVHWRGRZQVWDJHDIWHU7$&( % %DOORRQRFFOXGHGSHUFXWDQHRXVUDGLRIUHTXHQF\WKHUPDODEODWLRQ 5)$SOXVWUDQVFDWKHWHUDUWHULDOFKHPRHPEROLVDWLRQ7$&(D QHZFRPELQHGVLQJOHVWHSWKHUDS\IRUWUHDWPHQWRIVLQJOHODUJH KHSDWRFHOOXODUFDUFLQRPD 01HVWROD5,H]]L06DQWRUR5'DWWHVL0/D7 RUUH/%RQRPR5RPH,7 3XUSRVH7 RHYDOXDWHWKHIHDVLELOLW\DQGVDIHW\RIFRPELQHGVLQJOHVWHSWKHUDS\ ZLWKEDOORRQRFFOXGHG5)$IROORZHGE\VXSHUVHOHFWLYH7$&(LQSDWLHQWVZLWKVLQJOH XQUHVHFWDEOHKHSDWRFHOOXODUFDUFLQRPDODUJHUWKDQFP 0HWKRGVDQG0DWHULDOVFRQVHFXWLYHSDWLHQWVZLWKVLQJOHXQUHVHFWDEOHODUJH +&&PHDQGLDPHWHUFPUDQJHFPQRWVXLWDEOHWRWKHUPDO DEODWLRQDORQHIRUVL]HDQGVLWHRIWKHOHVLRQZHUHHQUROOHGLQRXUVLQJOHFHQWUH PXOWLGLVFLSOLQDU\SLORWVWXG\7KHVFKHGXOHRIWUHDWPHQWFRQVLVWHGRISHUFXWDQHRXV 5)$VLQJOHFPPRQRSRODUQHHGOHLQVHUWLRQRIWKHWDUJHWOHVLRQGXULQJRFFOXVLRQ RIWKHKHSDWLFDUWHU\VXSSO\LQJWKHWXPRXUIROORZHGE\VXSHUVHOHFWLYH7$&(ZLWK HSLUXELFLQ)DUPRUXELFLQPJ3RZGHUORDGHG'&%HDGPLFURQ$G YHUVHHYHQWVDVZHOODVLQWUDSHULSURFHGXUDOFRPSOLFDWLRQVZHUHFOLQLFDOO\DVVHVVHG (DUO\ORFDOHIÀFDF\LQWDUJHWOHVLRQVLQWHUPVRISHUVLVWHQFHRIFRQWUDVWHQKDQFHPHQW DQGSUHVHQFHRIQHFURWLFGLDPHWHUZDVHYDOXDWHGRQPRQWKIROORZXSPXOWLSKDVLF &7EDVLQJRQP5(&,67FULWHULD 5HVXOWV7 HFKQLFDOVXFFHVVZDVDFKLHYHGLQDOOSDWLHQWV1RPDMRUFRPSOLFDWLRQV RFFXUUHG2YHUDOOWHFKQLFDOVXFFHVVGHÀQHGDVFRPSOHWHGHYDVFXODULVDWLRQGXULQJ WKHDUWHULDOSKDVHRIWKHWDUJHWOHVLRQZDVDFKLHYHGLQSDWLHQWVZLWKSDUWLDO UHVSRQVHSHUVLVWHQFHRIYLWDOWLVVXHOHVVWKDQZLWKDQRQHQKDQFLQJDUHD FRUUHVSRQGLQJLQVKDSHWRWKHSUHYLRXVO\LGHQWLÀHG+&&PHDQQHFURWLFGLDPHWHU FPUDQJHFP &RQFOXVLRQ%DOORRQRFFOXGHG5)$SOXV7$&(VHHPVWREHDVDIHDQGHIIHFWLYH FRPELQHGWKHUDS\IRUWKHWUHDWPHQWRIDGYDQFHGXQUHVHFWDEOHVLQJOHODUJH+&& DOORZLQJWRREWDLQDKLJKFRPSOHWHORFDOUHVSRQVHUDWHDOVRLQSDWLHQWVQRWVXLWDEOH WRWKHUPDODEODWLRQDORQH % &DQLWHUDWLYHUHFRQVWUXFWLRQUHVWRUHLPDJHTXDOLW\DWGRVH UHGXFWLRQ"&OLQLFDOH[SHULHQFHLQSDWLHQWVZLWKVLPXOWDQHRXV DYDLODELOLW\RIORZGRVHDQGVWDQGDUGGRVHLPDJHVIURPGXDOVRXUFH GDWDVHWV ) 3RQWDQD'0RXUHDX-%)DLYUH7 )ORKU05pP\-DUGLQ-5HP\ /LOOH)5IUDQFRLVSRQWDQD#FKUXOLOOHIU 3XUSRVH 7 R FRPSDUH LPDJH TXDOLW\ RI ORZGRVH LPDJHV UHFRQVWUXFWHG ZLWKD UDZGDWDEDVHGLWHUDWLYHUHFRQVWUXFWLRQWHFKQLTXH6$),5(ZLWKVWDQGDUGGRVH ÀOWHUHGEDFNSURMHFWLRQ)%3&7 0HWKRGVDQG0DWHULDOVFRQVHFXWLYHGXDOVRXUFHFKHVW&7GDWDVHWVDFTXLUHG LQ WKH FRQGLWLRQV RI URXWLQH FOLQLFDO SUDFWLFH N9S P$V ZLWK D ERWK WXEHVVHWDWVLPLODUHQHUJ\EWKHWRWDOUHIHUHQFHP$VVSOLWXSLQDZD\WKDW RIWKHUHIHUHQFHP$VZDVDSSOLHGWRWXEH$LHP$VFZKLOHRIWKH UHIHUHQFHP$VZDVDSSOLHGWRWXEH%LHP$V7ZRVHULHVRILPDJHVZHUH JHQHUDWHGDIXOOGRVHLPDJHVJHQHUDWHGIURPERWKV\VWHPVUHFRQVWUXFWHGZLWK )%3JURXSDQGEORZGRVHLPDJHVJHQHUDWHGIURPWXEH$UHFRQVWUXFWHG ZLWK6$),5(JURXS 5HVXOWV2QJURXSLPDJHVWKHUHZDVDDVLJQLÀFDQWUHGXFWLRQLQWKHREMHFWLYH LPDJHQRLVHPHDVXUHGDWWKHOHYHORIWKHWUDFKHDRQPHGLDVWLQDOYV S DQGOXQJLPDJHVYVS EDVLPLODUYLVXDOSHUFHSWLRQRIQRLVHRQPHGLDVWLQDOS DQGOXQJLPDJHVS PDLQO\UDWHGDVPLQLPDODQGGDVLPLODURYHUDOOLPDJHTXDOLW\UDWHGDVH[FHOOHQW LQRIH[DPLQDWLRQVZLWKRXWORVVRIGLDJQRVWLFLQIRUPDWLRQDVDVVHVVHG E\WKHFRPSDUDWLYHDQDO\VLVRILQGLYLGXDO&7IHDWXUHVRIOXQJLQÀOWUDWLRQ &, >@ &RQFOXVLRQ 'HVSLWH GRVH UHGXFWLRQ WKH UDZGDWDEDVHG LWHUDWLYH UHFRQ VWUXFWLRQWHFKQLTXHDOORZHGEHWWHUREMHFWLYHDQGVLPLODUVXEMHFWLYHLPDJHTXDOLW\ RIORZGRVHLPDJHVFRPSDUHGWRIXOOGRVH)%3LPDJHV % (YDOXDWLRQRIGRVHUHGXFWLRQDQGLPDJHTXDOLW\LQFKHVW&7VXVLQJ DGDSWLYHVWDWLVWLFDOLWHUDWLYHUHFRQVWUXFWLRQZLWKWKHVDPHJURXSRI SDWLHQWV /4L/7 DQJ;3 =KDQJ< /L< /L%HLMLQJ&1WDQJOHL#EMFDQFHURUJ 3XUSRVH7 RFRPSDUHWKHLPDJHTXDOLW\DQGUDGLDWLRQGRVHRIFKHVW&7LPDJHV UHFRQVWUXFWHGZLWKDEOHQGRIDGDSWLYHVWDWLVWLFDOLWHUDWLYHUHFRQVWUXFWLRQ$6,5 DQGÀOWHUHGEDFNSURMHFWLRQ)%3ZLWKLPDJHVJHQHUDWHGXVLQJFRQYHQWLRQDO)%3 0HWKRGVDQG0DWHULDOV3DWLHQWVZLWKFKHVW&7UHH[DPLQDWLRQVZHUHDOWHUQDWHO\ DVVLJQHG WR WZR VFDQQHUV ZLWK GLIIHUHQW UHFRQVWUXFWLRQ WHFKQLTXHV 7KH VWXG\ JURXSVLQFOXGHGQRLVHLQGH[1,ZLWK$6,5$1,ZLWK$6,5 $1,ZLWK$6,5$DQG1,ZLWK$6,5$VHTXHQWLDOO\ FKDQJHGHYHU\WZRPRQWKV7KHFRQWUROLPDJHVZHUHREWDLQHGXVLQJ)%3DQG1, $OODFTXLVLWLRQVZHUHSHUIRUPHGZLWKDXWRPDWLFGRVHPRGXODWLRQ3DLUHGWDQG QRQSDUDPHWHUVWHVWVZHUHDSSOLHGWRFRPSDUHWKHGLIIHUHQFH 5HVXOWV7KHUDGLDWLRQGRVHVZHUHVLJQLÀFDQWO\ORZHULQWKHH[DPLQDWLRQVXVHG $6,5S7KHPHDQGRVHUHGXFWLRQUDWHIRUHDFKJURXS$ZDV DQGUHVSHFWLYHO\7KHLPDJHTXDOLW\RIJURXSV $$ZDV QRWLQIHULRUWRWKRVHRIWKHFRQWUROH[DPLQDWLRQV7KHLPDJHQRLVHRIJURXS $ZDV JUHDWHUDQGVXEMHFWLYHLPDJHTXDOLW\ZDVLQIHULRUWRWKDWRIWKHFRQWURO &RQFOXVLRQ $6,5HQDEOHGWKHXVHRIDKLJKHU1,ZLWKDXWRPDWLFGRVHPRGXODWLRQ :LWK$6,5DQGD1,RIWKHHIIHFWLYHUDGLDWLRQGRVHZDVUHGXFHGE\ ZLWKRXWFRPSURPLVLQJLPDJHTXDOLW\ 6FLHQWLILF6HVVLRQ $ 6&'()*+%(XURSHDQ&RQJUHVVRI 5DGLRORJ\ 6DWXUGD\ $9ÀVWXODH $V\VWHPLFGUXJDSSURYHGIRUWKHWUHDWPHQWRIDGYDQFHGSULPDU\OLYHU FDQFHULVWKHSURWHLQNLQDVHLQKLELWRU6RUDIHQLE$LPRIWKLVVWXG\ZDVWRDVVHVVLI UHGXFWLRQRIWKHKHSDWRSXOPRQDU\VKXQWIUDFWLRQFDQEHDFKLHYHGE\WKHDGPLQLV WUDWLRQRI6RUDIHQLESULRUWR5( 0HWKRGVDQG0DWHULDOVSDWLHQWVVXIIHULQJIURPKHSDWRFHOOXODUFDUFLQRPDZHUH VWXGLHG3DWLHQWVFRQVHFXWLYHO\XQGHUZHQWKHSDWLFGLJLWDOVXEWUDFWLRQDQJLRJUDSK\ '6$ ZLWK WKH DGPLQLVWUDWLRQ RI 7 HFKQHFWLXPPODEHOOHG PDFURDJJUHJDWHG DOEXPLQP7 F0$$DQGD63(&7&7 IURPZKLFKGDWDWKHSXOPRQDU\VKXQW IUDFWLRQ ZDV FDOFXODWHG (LJKW SDWLHQWV ZLWK D FRQWUDLQGLFDWLRQ IRU 5( GXH WR DQ HVWLPDWHGSXOPRQDU\UDGLDWLRQGRVHRIRYHU*\UHVXOWLQJIURPKLJKVKXQWYDOXHV ZHUHHQUROOHG7KHVHSDWLHQWVUHFHLYHG6RUDIHQLE1H[DYDU%D\HUIRUZHHNVRQ DYHUDJH$IWHUZDUGV'6$DQGVKXQWIUDFWLRQFDOFXODWLRQZDVUHSHDWHG 5HVXOWV,QDOOHLJKWSDWLHQWVDUHGXFWLRQRIWKHKHSDWRSXOPRQDU\VKXQWIUDFWLRQRI 0$$ZDVDFKLHYHGDYHUDJHVKXQWUHGXFWLRQRIUDQJH)ROORZLQJ 6RUDIHQLEDGPLQLVWUDWLRQ5(WKHUDS\ZDVSRVVLEOHLQSDWLHQWV,QRQHSDWLHQW KRZHYHUUHGXFWLRQRIKHSDWRSXOPRQDU\VKXQWIUDFWLRQZDVQRWVXIÀFLHQWO\KLJKIRU VXEVHTXHQW5(WKHUDS\ &RQFOXVLRQ 5HGXFWLRQ RI KHSDWRSXOPRQDU\ VKXQW IUDFWLRQ LQ SDWLHQWV ZLWK DG YDQFHG +&& FDQ EH VXFFHVVIXOO\ LQGXFHG E\ WKH DGPLQLVWUDWLRQ RI 6RUDIHQLE (YHQSDWLHQWVZLWKKLJKKHSDWRSXOPRQDU\VKXQWIUDFWLRQVPD\EHFRPHHOLJLEOHIRU UDGLRHPEROLVDWLRQWKHUDS\ % )LYH\HDUVXUYLYDORI+&&SDWLHQWVWUHDWHGZLWKGR[RUXELFLQHOXWLQJ '&EHDG (%RXPD$&KDURNRSDNLV+0RVFKRXULV$3RPRQL.0DODJDUL -.RUQH]RV67 DQGHOHV97 VDJRXOL03RPRQL$WKHQV*5 3XUSRVH)LYH\HDUVXUYLYDORIKHSDWRFHOOXODUFDUFLQRPD+&&SDWLHQWVWUHDWHG ZLWK'&%HDGORDGHGZLWKGR[RUXELFLQ'(%'2;ZDVWKHSXUSRVHRIWKLVVWXG\ 0HWKRGV DQG 0DWHULDOV SDWLHQWV QRW VXLWDEOH IRU FXUDEOH WUHDWPHQWV KDYH EHHQ SURVSHFWLYHO\ HQUROOHG PHDQ DJH \HDUV &KLOG 3XJK FODVV ZDV $%2NXGDVWDJHZDV DQGPHDQOHVLRQGLDPHWHUZDVFP/HVLRQPRUSKRORJ\ZDVRQHGRPLQDQW FPRQHGRPLQDQW!FPPXOWLIRFDODQGPXOWLIRFDO !3DWLHQWVKDGVFKHGXOHGHPEROLVDWLRQVXQWLOVHVVLRQVDQGWKHQRQ GHPDQGVFKHGXOHGVHVVLRQVZHUHHYHU\PRQWKVLQSDWLHQWVDQGHYHU\ LQ)ROORZXSUDQJHGEHWZHHQDQGPRQWKVXQWLOWLPHRIGHDWKRUWLPHRI WKHDQDO\VLV 5HVXOWV2YHUDOOVXUYLYDODW\U\U\U\U\UVZDV DQGZLWKKLJKHUUDWHVDFKLHYHGLQWKH&KLOG $SDWLHQWVFRPSDUHGWR &KLOG%DQGYVDQG 0HDQRYHUDOOVXUYLYDOZDVPRQWKV&XPXODWLYHVXUYLYDOZDV EHWWHUIRU&KLOG$FRPSDUHGWR&KLOG%SDWLHQWVS )RUGRPLQDQWOHVLRQV FPDQG\HDUVXUYLYDOUDWHVZHUHDQG IRU&KLOG $SDWLHQWVDQGDQGIRU &KLOG%5HJDUGLQJ'(%'2;WUHDWPHQWPXOWLYDULDWHDQDO\VLVLGHQWLÀHGQXPEHURI OHVLRQVS OHVLRQYDVFXODULW\SLQLWLDOO\DFKLHYHG&5S DQG25S DVVLJQLÀFDQWDQGLQGHSHQGHQWGHWHUPLQDQWVRI\HDUVXUYLYDO &RQFOXVLRQ '(%'2; UHVXOWV ZLWK KLJK UDWHV RI \U VXUYLYDO IRU GRPLQDQW WXPRXUVFP % %ORRGÁRZUHGLVWULEXWLRQLQIXVLRQVWUDWHJ\EHIRUHUDGLRHPEROLVDWLRQ &6SUHDÀFR5/DQRFLWD&0RURVL(&LYHOOL00DFFDXUR 55RPLWR/) )ULJHULR$0DUFKLDQz90D]]DIHUUR0LODQ,7 FDUORVSUHDÀFR#LVWLWXWRWXPRULPLLW 3XUSRVH 3UREOHPV DULVH ZKHQ SHUIRUPLQJ D <SDUWLFOH LQIXVLRQDO WKHUDS\ LQ WXPRXUVZLWKPXOWLSOHDUWHULDOVXSSOLHV:HDLPDWGHPRQVWUDWLQJWKDWWXPRXUVFDQ EHWUHDWHGYLDRQHPDLQIHHGLQJDUWHU\DFKLHYLQJÁRZUHGLVWULEXWLRQE\HPEROLVLQJ DOODFFHVVRU\YHVVHOV 0HWKRGVDQG0DWHULDOV)URP-DQWR0DUFK<UDGLRHPERO LVDWLRQVZHUHFDUULHGRXWRQSDWLHQWVZLWKLQWHUPHGLDWHWRDGYDQFHG+&&XVLQJ JODVVPLFURVSKHUHV7KHUD6SKHUH,QOHVLRQVSWVPHDQGLDPHWHUPP LQWUDH[WUDKHSDWLFDFFHVVRU\EUDQFKHVZHUHIRXQGDQGHPEROLVHG:LWKLQ WKHQH[WZHHNVDOOSWVZHUHWUHDWHGE\<LQIXVLRQ7KHOHVLRQVZLWKÁRZ UHGLVWULEXWLRQZHUHFKRVHQDVWDUJHWOHVLRQVDQGWKHLUUDGLRORJLFDOUHVSRQVHZDV HYDOXDWHGDFFRUGLQJWRP5(&,67FULWHULD 5HVXOWV,QDOOSWVWKH<LQIXVLRQZDVVDWLVIDFWRU\WKHFRPSOHWHWXPRXUSHUIXVLRQ ZDVDVVHVVHGSULRUWRUDGLRHPEROLVDWLRQE\DQJLRJUDSK\LQDOOSWVDQGDIWHUWKH <LQIXVLRQH[SORLWLQJWKH%UHPVVWUDKOXQJHIIHFWE\63(&7&7LQSWV,Q % /RQJWHUPUHFXUUHQFHUDWHVRI+&&WUHDWHGZLWKGR[RUXELFLQHOXWLQJ '&EHDG (%RXPD$3RPRQL$&KDURNRSDNLV(.DUDJLDQQLV+0RVFKRXULV 03RPRQL/7KDQRV.0DODJDUL'.HOHNLV$WKHQV*5 3XUSRVH7KHREMHFWLYHZDVWRUHSRUWRQWKHORQJWHUPUHFXUUHQFHVRI+&&WKDW SUHVHQWHG FRPSOHWH UHVSRQVH DIWHU WUHDWPHQW ZLWK VFKHGXOHGVHVVLRQV RI FKHPRHPEROLVDWLRQZLWKGR[RUXELFLQORDGHG'&EHDG 0HWKRGV DQG 0DWHULDOV SDWLHQWV QRW VXLWDEOH IRU FXUDEOH WUHDWPHQWV WKDW KDGEHHQWUHDWHGZLWK'&EHDGORDGHGZLWKGR[RUXELFLQDQGDFKLHYHGFRPSOHWH UHVSRQVHZHUHLQFOXGHG'R[RUXELFLQORDGLQJZDVGRQHDWPJPORIUHFRQVWL WXWHGEHDGV&KLOG3XJKFODVVZDV$%2NXGDVWDJHZDV 5HVXOWV/RFDOUHFXUUHQFHVDQGQHZOHVLRQVFRQVLGHUHGDVUHFXUUHQWGLVHDVHZHUH VHSDUDWHO\UHFRUGHG5HFXUUHQFHUDWHVZHUHQHZOHVLRQVLQ&KLOG$SDWLHQWVZLWK GRPLQDQWOHVLRQFPRFFXUUHGLQZLWKGRPLQDQWOHVLRQ!FP RFFXUUHGLQGXULQJVWUGWK\HDUUHVSHFWLYHO\/RFDOOHVLRQVLQ &KLOG$SDWLHQWVZLWKGRPLQDQWOHVLRQFPRFFXUUHGLQZLWK GRPLQDQWOHVLRQ!FPRFFXUUHGLQGXULQJVWUGWK\HDU UHVSHFWLYHO\1HZOHVLRQVLQ&KLOG$SDWLHQWVZLWKPXOWLQRGXODUOHVLRQVRFFXUUHGLQ GXULQJVWDQGQG\HDUUHVSHFWLYHO\/RFDOOHVLRQVLQ&KLOG$SD WLHQWVZLWKPXOWLQRGXODUOHVLRQVRFFXUUHGLQGXULQJVWDQGQG\HDU UHVSHFWLYHO\1HZOHVLRQVLQ&KLOG%SDWLHQWVZLWKGRPLQDQWOHVLRQFPRFFXUUHGLQ ZLWKGRPLQDQWOHVLRQ!FPRFFXUUHGLQGXULQJ VWUGWK\HDUUHVSHFWLYHO\/RFDOOHVLRQVLQ&KLOG%SDWLHQWVZLWKGRPLQDQWOHVLRQ FPRFFXUUHGLQZLWKGRPLQDQWOHVLRQ!FPRFFXUUHGLQ GXULQJVWUGWK\HDUUHVSHFWLYHO\2YHUDOOVXUYLYDODW\U \U\U\UDQG\UVZDVDQGUHVSHFWLYHO\ &RQFOXVLRQ '(%'2; DFKLHYHV KLJK UDWHV RI \U VXUYLYDO IRU SDWLHQWV WKDW \LHOGHG &5 DIWHU LQLWLDO VFKHGXOHG WUHDWPHQWV EXW FDQQRW EH FODVVLÀHG DPRQJ FXUDWLYHWUHDWPHQWV % 6LQJOHVWHSEDOORRQRFFOXGHGSHUFXWDQHRXVUDGLRIUHTXHQF\WKHUPDO DEODWLRQ5)$SOXVWUDQVFDWKHWHUDUWHULDOFKHPRHPEROLVDWLRQ7$&( IRUWUHDWPHQWRI´FRPSOH[µXQUHVHFWDEOHKHSDWRFHOOXODUFDUFLQRPD 06DQWRUR5,H]]L5'DWWHVL0) OD7 RUUH01HVWROD/%RQRPR5RPH,7 GRWWVDQWRURPDUFR#JPDLOFRP 3XUSRVH7 RHYDOXDWHWKHIHDVLELOLW\DQGVDIHW\RIVLQJOHVWHSEDOORRQRFFOXGHG 5)$IROORZHGE\7$&(LQSDWLHQWVZLWK´FRPSOH[µXQUHVHFWDEOH+&&SUHYLRXVO\ QRWVXLWDEOHWR5)$DORQHGXHWRWKHLUORFDOLVDWLRQ 0HWKRGVDQG0DWHULDOVFRQVHFXWLYHSDWLHQWVZLWKVLQJOH+&&PHDQGLDPHWHU FPDGMDFHQWWRWKHGLDSKUDJPOHVLRQVSUR[LPDOWRWKHKHSDWLFSRUWDO *OLVVRQ VFDSVXOHRUORFDWHGRQWKHLQWUDDEGRPLQDOIUHHVXUIDFHFRQVLGHUHG DVFRPSOH[IRUWKHLUXQIDYRXUDEOHORFDWLRQDQGQRWVXLWDEOHIRU5)$DORQHZHUH HQUROOHGLQRXUVLQJOHFHQWUHPXOWLGLVFLSOLQDU\SLORWVWXG\7KHWUHDWPHQWZDVFRP SRVHGE\5)$VLQJOHFPRUFPPRQRSRODUQHHGOHLQVHUWLRQGXULQJRFFOXVLRQ RIWKHIHHGLQJDUWHU\IROORZHGE\VXSHUVHOHFWLYH7$&(FRQYHQWLRQDO7$&(RUZLWK '&%($'$GYHUVHHYHQWVDQGLQWUDSHULSURFHGXUDOFRPSOLFDWLRQVZHUHFOLQLFDOO\ DVVHVVHG7XPRXUUHVSRQVHZDVHYDOXDWHGRQPRQWKIROORZXSPXOWLSKDVLF&7 EDVHGRQP5(&,67FULWHULD 5HVXOWV7 HFKQLFDOVXFFHVVZDVDFKLHYHGLQDOOSDWLHQWV1RPDMRUFRPSOLFDWLRQV RFFXUUHG$ PHDQ WRWDO WUHDWHG GLDPHWHU QHFURWLF GLDPHWHU SOXV FLUFXPIHUHQWLDO SHULSKHUDOOLSLRGROXSWDNHIRUFRQYHQWLRQDO7$&(PHDQQHFURWLFGLDPHWHUIRU7$&( ZLWK'&%HDGRIZDVREWDLQHG%DVHGRQP5(&,67FULWHULDDWXPRXU UHVSRQVHZDVREWDLQHGLQDOOSDWLHQWVZLWKDFRPSOHWHUHVSRQVHDFKLHYHGLQ RXWRISDWLHQWVZLWKDSDUWLDOUHVSRQVHLQWKHODVWSDWLHQWVUHVLGXDO WXPRXUZLWKRXWDQ\SURJUHVVLYHGLVHDVH &RQFOXVLRQ%DOORRQRFFOXGHG5)$SOXV7$&(VHHPVWREHDVDIHDQGHIIHFWLYH WKHUDS\IRUWKHWUHDWPHQWRI´FRPSOH[µ+&&DOORZLQJWRREWDLQDKLJKFRPSOHWHORFDO UHVSRQVHUDWHZLWKRXWFRPSOLFDWLRQVDOVRLQSDWLHQWVQRWVXLWDEOHWR5)$DORQH % 5DGLRHPEROLVDWLRQRIKHSDWLFWXPRXUVKHSDWRSXOPRQDU\VKXQW UHGXFWLRQE\DGPLQLVWUDWLRQRI6RUDIHQLE -07KH\VRKQ-) 6FKODDN-(UWOH60XHOOHU$%RFNLVFK7 &/DXHQVWHLQ (VVHQ'(MHQVWKH\VRKQ#XQLGXLVEXUJHVVHQGH 3XUSRVH$Q HPHUJLQJ WKHUDS\ RSWLRQ IRU XQUHVHFWDEOH OLYHU PDOLJQDQFLHVL V UDGLRHPEROLVDWLRQ5(XVLQJWKHEHWDHPLWWHU<WWULXP&RQWUDLQGLFDWLRQVKRZ HYHUPD\UHSUHVHQWKLJKKHSDWRSXOPRQDU\VKXQWIUDFWLRQVLHGXHWRWXPRURXV 6FLHQWLILF6HVVLRQ 6 &$' ( ) *+% (XURSHDQ&RQJUHVVRI 5DGLRORJ\ % 5DGLRHPEROLVDWLRQZLWK<JODVVPLFURVSKHUHVLQKHSDWRFHOOXODU FDUFLQRPDVDIHW\DQGORQJWHUPVXUYLYDO 7 $+HXVQHU 3 +LOJDUG60XHOOHU-(UWOH$%RFNLVFK*$QWRFK 'VVHOGRUI'((VVHQ'(KHXVQHU#PHGXQLGXHVVHOGRUIGH 3XUSRVH5DGLRHPEROLVDWLRQZLWKJODVVPLFURVSKHUHVDOORZVHIIHFWLYHORFRUHJLRQDO WKHUDS\RISDWLHQWVZLWKKHSDWRFHOOXODUFDUFLQRPD+&&QRWHOLJLEOHIRUORFDOWKHUD SLHV7KHDLPRIWKLVVWXG\ZDVWRYDOLGDWHHYLGHQFHRQVDIHW\DQGHIÀFDF\RIWKLV WUHDWPHQWLQD(XURSHDQVDPSOHRISDWLHQWVZLWKDGYDQFHG+&& 0HWKRGVDQG0DWHULDOVFRQVHFXWLYHSDWLHQWVZLWKDGYDQFHG+&&ZHUHLQ FOXGHGLQWKLVSURVSHFWLYHRSHQODEHOVWXG\<PLFURVSKHUHVZHUHDGPLQLVWHUHG LQDOREDUIDVKLRQRYHUWKHULJKWRUOHIWEUDQFKRIWKHKHSDWLFDUWHU\5HVSRQVHWR WUHDWPHQWZDVHYDOXDWHGE\&7LPDJLQJDSSO\LQJ5(&,67DQG:+2FULWHULDZLWK UHFHQW ($6/1&, DPHQGPHQWV 7LPH WR SURJUHVVLRQ DQG RYHUDOO VXUYLYDO ZHUH HVWLPDWHGE\WKH.DSODQ0H\HUPHWKRG 5HVXOWVSDWLHQWVKDGXQGHUO\LQJOLYHUFLUUKRVLVZLWK&KLOG3XJKVFRUHV EHWZHHQDQGWUHDWPHQWVHVVLRQVZHUHSHUIRUPHGUDQJLQJEHWZHHQDQG WUHDWPHQWVSHUSDWLHQW7KHPHDQUDGLDWLRQGRVHSHUWUHDWPHQWZDV *\ $FFRUGLQJWR($6/FULWHULDFRPSOHWHUHVSRQVHVZHUHGHWHUPLQHGLQSDUWLDO UHVSRQVHVLQVWDEOHGLVHDVHDQGSULPDU\SURJUHVVLRQLQ7LPHWR SURJUHVVLRQ773ZDVPRQWKVWKHPHGLDQRYHUDOOVXUYLYDOZDVPRQWKV 1ROXQJRUYLVFHUDOWR[LFLW\ZDVREVHUYHG7KHPRVWIUHTXHQWDGYHUVHHYHQWZDV DWUDQVLHQWIDWLJXHV\QGURPH &RQFOXVLRQ5DGLRHPEROLVDWLRQZLWK<WWULXPJODVVPLFURVSKHUHVIRUSDWLHQWV ZLWKDGYDQFHG+&&LVDVDIHDQGHIIHFWLYHWUHDWPHQWZKLFKFDQEHXWLOLVHGHYHQ LQFDVHVZLWKFRPSURPLVHGOLYHUIXQFWLRQ 5RRP( 0XVFXORVNHOHWDO 66 6SLQHDQGSHULSKHUDOQHUYHV 0RGHUDWRUV ,:0F&DOO2VZHVWU\8. 0$:HEHU+HLGHOEHUJ'( % 7KHDVVHVVPHQWIRUWKHLQWHUYHUWHEUDOIRUDPHQLQWKHOXPEDUGLVN KHUQLDWLRQVXVLQJVOLFHG\QDPLFYROXPH&7 DSLORWVWXG\ < O6RQJ=-LD;V/L=:DQJ< 7LDQ%HLMLQJ&1\OVRQJ #VRKXFRP 3XUSRVH7 RHYDOXDWHWKHG\QDPLFFKDQJHVRILQWHUYHUWHEUDOIRUDPHQGXULQJOXPEDU H[WHQVRÁH[DOPRYHPHQWLQWKHSDWLHQWVRIOXPEDUGLVNKHUQLDWLRQV/'+XVLQJ 7 RVKLED$TXLOLRQ21(VOLFHG\QDPLFYROXPH&7$421( 0HWKRGV DQG 0DWHULDOV$421( ZDV XVHG WR SHUIRUP WKH VFDQQLQJ IRU WKH FRQWLQXRXV OXPEDU VSLQH PRYHPHQW IRU SDWLHQWV JURXS ZLWK /'+ ZKR ZHUH SRVLWLYHFDVHVIRUURXWLQH05,VWDWLFVFDQQLQJFHQWUDOW\SHRISURMHFWLQJEDFNZDUG 7KH&REEDQJOHZDVPHDVXUHGWRGHWHUPLQHWKHUHIHUHQFHLPDJHRIGHJUHHLQ WKHPRYHPHQWSURFHVV7KH/'+/6DQGIRUDPHQLQWHUYHUWHEUDOHLQWKHVWDWLF DQGG\QDPLFVLWXDWLRQVZHUHPHDVXUHGDQGFRPSDUHGWKURXJK0350,3DQG95 SURFHVVLQJLQGLIIHUHQWDQJOHV7KHHIIHFWLYHUDGLDWLRQGRVHLVaP6Y 5HVXOWV$PRQJ WKH SDWLHQWV WRWDOO\ GLVN SURWUXVLRQ ZHUH FODVVLÀHG E\ 6SDQJOHUPHWKRG$WWKHGHJUHHRIK\SHUH[WHQVLRQSRVLWLRQWKHLQWHUYHUWHEUDO GLVFLQJUDGH,,,DQG,9LQFUHDVHGWKDQVWDWLF&RPSDUHGZLWKWKHLPDJHVRI URXWLQH05,WKHGLVFVLQFUHDVHGPPSHUGHJUHHH[WHQVLRQDQGGHFUHDVHG PP SHU WHQ GHJUHHV ÁH[LRQ /'+ LQ K\SHUH[WHQVLRQ SRVLWLRQ KDG PRUH LQÁXHQFH WKDQ K\SHUÁH[LRQ RWKHUZLVH LQWHUYHUWHEUDO IRUDPHQ VKRZHG GLIIHUHQW FKDUDFWHULVWLFVLQK\SHUÁH[LRQSRVLWLRQ7KHIRUDPHQVGHFUHDVHGPPòSHU GHJUHHVGXULQJOXPEDUH[WHQVLRQ$WWKHGHJUHHK\SHUÁH[LRQSRVLWLRQ IRUDPHQVDUHUHGXFHGE\PPò1LQHW\RQHSHUFHQWIRUDPHQVRIGHJUHH K\SHUÁH[LRQDUHODUJHUPPòWKDQWKHRQHVRIGHJUHH &RQFOXVLRQ&7G\QDPLFOXPEHUVFDQFDQUHÁHFWWKHFRQWLQXRXVYDULDWLRQVRI/'+ GXULQJWKHPRYHPHQWZKLFKZLOOSURYLGHLPSRUWDQWLQIRUPDWLRQIRUWKHWUHDWPHQW WKHDVVHVVDEOHSWVWKHPHDQIROORZXSZDVPRQWKVDQGWKHUHVSRQVHUDWHLQ WKHLUOHVLRQVZDV&535DQG6' &RQFOXVLRQ$OOHPEROLVDWLRQSURFHGXUHVZHUHVXFFHVVIXOO\FDUULHGRXWZLWKQR FRPSOLFDWLRQVDQGUHVSRQVHVZHUHHQFRXUDJLQJREMHFWLYHUHVSRQVHUDWH&535 LQOHVLRQV1RFRUUHODWLRQHPHUJHGEHWZHHQWKHUHVLGXDODFWLYHOHVLRQ DQGWKHDFFHVVRU\DUWHU\WHUULWRU\2XUÀQGLQJVFRQÀUPHGWKHDFWXDOLQWUDWXPRUDO ÁRZUHGLVWULEXWLRQDIWHUHPEROLVLQJWKHDFFHVVRU\DUWHULHVZKLFKPDNHVLWSRVVLEOH WRWUHDWWKHWXPRXUWKURXJKLWVVLQJOHPDLQIHHGLQJDUWHU\ % 7UDQVDUWHULDOFKHPRHPEROLVDWLRQ7$&(ZLWKPLWRP\FLQDQG FLVSODWLQLQKHSDWRFHOOXODUFDUFLQRPDFXUDWLYHSDOOLDWLYHDQG QHRDGMXYDQWWKHUDS\SURWRFRO 7 -9RJO.$XHUEDFK.(QJHOV.2FKV6=DQJRV1111DJXLE 7 /HKQHUW1(1RXU(OGLQ)UDQNIXUW'(WYRJO#HPXQLIUDQNIXUWGH 3XUSRVH 7 R HYDOXDWH WKH HIIHFW RI WUDQVDUWHULDO FKHPRHPEROLVDWLRQ 7$&( RQ ORFDOUHVSRQVHDQGVXUYLYDORISDWLHQWVZLWKKHSDWRFHOOXODUFDUFLQRPD+&&LQD FXUDWLYHSDOOLDWLYHDQGQHRDGMXYDQWSURWRFRO 0HWKRGV DQG 0DWHULDOV ,Q D UHWURVSHFWLYH VWXG\ SDWLHQWV PDOH IHPDOH ZLWK KLVWRSDWKRORJLFDOO\ SURYHQ +&& ZHUH WUHDWHG ZLWK UHSHWLWLYH 7$&(PLWRP\FLQFLVSODWLQOLSLRGROEHWZHHQ$SULODQG)HEUXDU\7KH XQGHUO\LQJOLYHUSDWKRORJ\&KLOG3XJKVFRUHWXPRXUYROXPHQXPEHURIWXPRXUV ORFDOUHVSRQVHDQGVXUYLYDOVLQFHÀUVWGLDJQRVLVDQGÀUVW7$&(ZHUHDQDO\VHG /RFDOWXPRXUUHVSRQVHZDVHYDOXDWHGE\05,DQG&7YROXPHWULFPHDVXUHPHQWV DQG VXUYLYDO UDWHV IURP ÀUVW7$&( DQG ODVW7$&( ZHUH FDOFXODWHG DFFRUGLQJ WR WKH5(&,67FULWHULD 5HVXOWV /RFDO WXPRXU FRQWURO VKRZHG SDUWLDO UHVSRQVH 35 LQ SDWLHQW VWDEOHGLVHDVH6'LQSDWLHQWVDQGSURJUHVVLYHGLVHDVH LQSDWLHQWV/RFDOUHVSRQVHUDWHSHUSDWLHQWZDV&535 6'DQG3'7KHVXUYLYDOUDWHVRIDOOSDWLHQWVVLQFHÀUVWGLDJQRVLVDQG ÀUVW7$&(ZHUHPRQWKVPHGLDQDQGPRQWKVPHGLDQUHVSHFWLYHO\ )RUQHRDGMXYDQWLQWHUYHQWLRQDQGUHVHFWLRQVXUYLYDOUDWHVVLQFHÀUVWGLDJQRVLVDQG ÀUVW7$&(ZHUHPRQWKVDQGPRQWKVIRUQHRDGMXYDQWLQWHUYHQWLRQDQG WUDQVSODQWDWLRQPRQWKVDQGPRQWKVDQGIRUQHRDGMXYDQWLQWHUYHQWLRQ IROORZHG E\ GLIIHUHQW DEODWLRQ WHFKQLTXHV /,77 0: 5)$ PRQWKV DQG PRQWKV &RQFOXVLRQ7$&(IRUWKHWUHDWPHQWRI+&&LVDQHIIHFWLYHWKHUDS\IRUDOOWKUHH WKHUDS\SURWRFROV,QQHRDGMXYDQWWKHUDS\LWFDQEHXVHGDVDEULGJLQJWKHUDS\LQ SDOOLDWLYHWKHUDS\LWVWDELOLVHVWKHWXPRXUORDG % 3UHSURFHGXUDO'&7LPDJHEOHQGLQJZLWKÁXRURVFRS\WRJXLGH FDWKHWHULVDWLRQRISURSHUKHSDWLFDUWHU\GXULQJWUDQVDUWHULDO FKHPRHPEROLVDWLRQDIHDVLELOLW\VWXG\ ,%DUJHOOLQL(%R]]L$&LFRUHOOL$/XQDUGL) 7XULQL5&LRQL&%DUWROR]]L 3LVD,7LUHQHEDUJHOOLQL#KRWPDLOFRP 3XUSRVH7 RDVVHVVIHDVLELOLW\RISUHSURFHGXUDOFRPSXWHGWRPRJUDSK\'PRGHO IXVLRQZLWKÁXRURVFRS\WRJXLGHWKHFDWKHWHULVDWLRQRIWKHSURSHUKHSDWLFDUWHU\ GXULQJWUDQVDUWHULDOFKHPRHPEROLVDWLRQ7$&(RIKHSDWRFHOOXODUFDUFLQRPD+&& 0HWKRGVDQG0DWHULDOV7ZHQW\FRQVHFXWLYHFLUUKRWLFSDWLHQWVZLWK+&&XQGHUJR LQJ7$&(ZHUHSURVSHFWLYHO\HQUROOHGLQWKHVWXG\7KHHDUO\DUWHULDOSKDVHD[LDO LPDJHVRIWKHSUHSURFHGXUDO&7ZHUHSRVWSURFHVVHGRQDQLQGHSHQGHQWZRUNVWD WLRQFRQQHFWHGWRWKHDQJLRJUDSKLFV\VWHP,QQRYD*(+HDOWKFDUHREWDLQLQJ D'YROXPHUHQGHULQJLPDJH95WKDWLQFOXGHGDEGRPLQDODRUWDFHOLDFWUXQN FRPPRQSURSHUOHIWDQGULJKWKHSDWLFDUWHULHVVXSHULRUPHVHQWHULFDUWHU\RULJLQ RIWKHUHQDODUWHULHVÀUVWDQGVHFRQGOXPEDUYHUWHEUDH7KH95LPDJHZDVPDQX DOO\UHJLVWHUHGWRWKH'ÁXRURVFRSLFLPDJHXVLQJWKHOXPEDUVSLQHDVUHIHUHQFH 7KH95LPDJHZDVWKHQXVHGDVJXLGDQFHWRVHOHFWLYHO\FDWKHWHULVHWKHSURSHU KHSDWLFDUWHU\XVLQJDQDGHTXDWHO\VKDSHG)UK\GURSKLOLFFDWKHWHUDQGDµ K\GURSKLOLFJXLGHZLUH7KHSURFHGXUHZDVFRQVLGHUHGVXFFHVVIXOZKHQSHUIRUPHG ZLWKQRQHHGIRULQWUDDUWHULDOFRQWUDVWLQMHFWLRQVRUDQJLRJUDSKLFDFTXLVLWLRQV 5HVXOWV7KHSURFHGXUHZDVVXFFHVVIXOLQSDWLHQWV,QRQHSDWLHQW FHOLDFWUXQNDQJLRJUDSK\ZDVUHTXLUHGIRUWKHSUHVHQFHRIDVHYHUHRVWLDOVWHQRVLV WKDWZDVXQGHUHVWLPDWHGDW&7 7LPHIRULPDJHUHFRQVWUXFWLRQDQGUHJLVWUDWLRQ ZDVPLQXWHVLQDOOFDVHV &RQFOXVLRQ7KHXVHRISUHSURFHGXUDO&7LPDJHEOHQGLQJWRÁXRURVFRS\HQDEOHV FRQÀGHQWDQGGLUHFWFDWKHWHULVDWLRQRIWKHSURSHUKHSDWLFDUWHU\ZLWKQRQHHGIRU FHOLDFWUXQNDQJLRJUDSK\RURWKHUDFTXLVLWLRQVWKXVUHGXFLQJUDGLDWLRQH[SRVXUH FRQWUDVWPHGLDDGPLQLVWUDWLRQDQGSURFHGXUDOWLPH 6FLHQWLILF6HVVLRQ $ 6&'()*+%(XURSHDQ&RQJUHVVRI 5DGLRORJ\ 6DWXUGD\ 0HWKRGVDQG0DWHULDOVSDWLHQWVZRPHQ\HDUVVXIIHULQJRI/%3 XQGHUZHQWFOLQLFDOO\LQGLFDWHG05,DW7 HVODLQFOXGLQJ63*5'(DQG63*50( IRUTXDQWLÀFDWLRQRIIDWW\GHJHQHUDWLRQRIWKHHUHFWRUVSLQDHPXVFOHLQDSUHGHÀQHG UHJLRQRILQWHUHVW52,DWWKHOHYHO/)DWVLJQDOIUDFWLRQV)6)ZHUHGHWHUPLQHG IURPVLJQDOLQWHQVLWLHV6,RQDXWRPDWLFDOO\JHQHUDWHGIDWZDWHURQO\LPDJHVIURP ERWK GDWDVHWV )6)'( )6)0( DV ZHOO DV IURP 7 FRUUHFWHG IDWZDWHURQO\ LPDJHV GHULYHG IURP 63*50( )6)0( DQG FRPSDUHG WR VSHFWURVFRSLFDOO\ GHWHUPLQHGIUDFWLRQV)6)63(&6WXGHQWҋVWWHVWDQGWKHPHWKRGRI%ODQGDQG $OWPDQZHUHXVHGWRVWXG\WKHDJUHHPHQWEHWZHHQ)6)GHULYHGIURP63*5'( 63*50(DQGVSHFWURVFRS\ 5HVXOWV6SHFWURVFRSLFUHVXOWVZHUHREWDLQHGLQSDWLHQWVELODWHUDOO\0HDQ )6)63(&ZDVUDQJHQ &RUUHODWLRQEHWZHHQ)6) 63(&DQG)6)'()6)0(ZDVVLJQLÀFDQWZLWKFRUUHODWLRQFRHIÀFLHQWVRIU 0HDQ )6)'( )6)0( YDOXHV VLJQLÀFDQWO\ GLIIHUHG IURP )6)63(& ERWK SZKHUHDVPHDQ)6)0( VKRZHGQRVLJQLÀFDQWGLIIHUHQFHVS DQGD VPDOOPHDQPHDVXUHPHQWELDVRIOLPLWVRIDJUHHPHQW FRPSDUHGWR)6)63(& &RQFOXVLRQ)DWVLJQDOIUDFWLRQVDVREWDLQHGIURPERWK63*5'(DQGVWDQGDUG 63*50( ZHUH VLJQLÀFDQWO\ ODUJHU WKDQ GHWHUPLQHG E\ VSHFWURVFRSLF DQDO\VLV ZKHUHDV)6)IURP7 FRUUHFWHG63*50(LPDJHVPD\DOORZIDVWDQGDFFXUDWH TXDQWLÀFDWLRQRI0)&LQSDWLHQWVVXIIHULQJRI/%3 % ,QÁXHQFHRIZHLJKWEHDULQJDQGOXPEDUORUGRVLVRQWKHGXUDOVDFLQ SDWLHQWVZLWKVHYHUHVWHQRVLVRIWKHOXPEDUVSLQDOFDQDO 3 1LJJHPDQQ (6WRHW]HO-+RHIIHU+.%H\HU++6FKLOG%RQQ'( &RORJQH'(SDVFDOQLJJHPDQQ#XNEXQLERQQGH 3XUSRVH0RGHUDWHFRUUHODWLRQEHWZHHQFOLQLFDOFRPSODLQWVDQGLPDJLQJLQSDWLHQWV ZLWKOXPEDUVSLQDOFDQDOVWHQRVLV6&6FRXOGEHGXHWRWKHODFNRIDSSOLHGERG\ ZHLJKWGXULQJKRUL]RQWDOLPDJLQJ3RVLWLRQDO05,DOORZVYLVXDOLVLQJWKHVSLQHXQGHU ZHLJKWEHDULQJFRQGLWLRQV7KHSXUSRVHRIWKLVVWXG\LVWRDQDO\VHWKHLQÁXHQFH RIZHLJKWEHDULQJDQGORUGRVLVRQWKHGXUDOVDF'6LQSDWLHQWVZLWKVHYHUH6&6 0HWKRGV DQG 0DWHULDOV VHJPHQWV LQ SDWLHQWV ZLWK VHYHUH 6&6 ZHUH H[DPLQHG7KHVL]HRIWKH'6DQGWKHGHJUHHRIORUGRVLVZHUHPHDVXUHGLQVXSLQH H[WHQVLRQ VWDQGLQJ DQG QHXWUDO VLWWLQJ SRVLWLRQ 7KH ÀQGLQJVZHUH FRPSDUHG IRUDOOVHJPHQWVDQGIRUVHJPHQWVZLWKVWDEOHDQGXQVWDEOHVOLSV3DWLHQWVZHUH GLYLGHGLQWRWZRJURXSVRQHZLWKVHYHUHFODXGLFDWLRQDQGRQHZLWKOHVVVHYHUH RUQRFODXGLFDWLRQ7KHÀQGLQJVZHUHFRPSDUHGIRUWKHPRVWQDUURZHGVHJPHQW 5HVXOWV7KHVSLQDOFDQDOZDVPRVWQDUURZHGLQH[WHQVLRQZKHUHDVWKHORUGRVLV ZDV PRVW SURPLQHQW LQ VXSLQH SRVLWLRQ 7KH GLIIHUHQFHV EHWZHHQWKH SRVLWLRQV ZHUHVLJQLÀFDQWIRUDOOSDUDPHWHUV/RUGRVLVLVWKHPDLQIDFWRUFRQWULEXWLQJWRWKH QDUURZLQJRIWKHVSLQDOFDQDO:HLJKWEHDULQJLVDQLPSRUWDQWIDFWRUIRUVHJPHQWV ZLWKXQVWDEOHVOLSV6&6ZDVOHVVIXQFWLRQDOLQSDWLHQWVZLWKVHYHUHFODXGLFDWLRQ FRPSDUHGWRWKH6&6LQSDWLHQWVZLWKOHVVVHYHUHRUQRFODXGLFDWLRQ &RQFOXVLRQ+RUL]RQWDO05,LVUHOLDEOHWRGLDJQRVHOXPEDU6&6VLQFHQRVHJPHQW ZLWK 6&6 ZDV PLVVHG 3RVLWLRQDO 05, VHHPV XVHIXO LQ VHJPHQW ZLWK XQVWDEOH YHUWHEUDO VOLSV 7KH IXQFWLRQDOLW\ RI 6&6 VHHPV WR EHWWHU FRUUHODWH ZLWK FOLQLFDO FRPSODLQWVWKDQWKHPD[LPXP6&6 % &RUUHODWLRQEHWZHHQVWUHQJWKRISDUDVSLQDOOXPEDUPXVFOHVPXVFOH GHJHQHUDWLRQDQGGLIIXVLRQSURSHUWLHV &&0XFK-'%XVFK66FKODPSS1')RUNHUW*$GDP&5+DEHUPDQQ +DPEXUJ'(FPXFK#XNHGH 3XUSRVH7KHDLPRIWKLVVWXG\ZDVWRHYDOXDWHFRUUHODWLRQVEHWZHHQYLVLEOHGH JHQHUDWLRQGLIIXVLRQSURSHUWLHVDQGVWUHQJWKRIWKHSDUDVSLQDOPXVFOHV 0HWKRGVDQG0DWHULDOVSDWLHQWVIHPDOHVPDOHVPHDQDJH\HDUV ZHUHLPDJHGZLWKD7056FDQQHU6\PSKRQLH6LHPHQVDQGXQGHUZHQWPHDV XUHPHQWVZLWKDVSHFLÀFPDFKLQHGHYHORSHGIRULVRODWHGOXPEDUPXVFOHVWUHQJWK TXDQWLÀFDWLRQ'(/3+(;0HGLFDO/(7DQGGLIIXVLRQZHLJKWHGLPDJLQJ':, ZKHUHSHUIRUPHGDWWKH/OHYHO)DWW\DQGÀEURWLFGHJHQHUDWLRQRIWKHPXVFOH FRPSDUWPHQW DQG DSSDUHQW GLIIXVLRQ FRHIÀFLHQW $'& YDOXHV RI WKH SDUDVSLQDO PXVFOHVZHUHPHDVXUHGXVLQJDQLQKRXVHGHYHORSHGVHPLDXWRPDWLFDOO\DQDO\VLV PHWKRG 6SHDUPDQV UDQN FRUUHODWLRQ FRHIÀFLHQW 6&& ZDV XVHG WR GHWHUPLQH FRUUHODWLRQV EHWZHHQ SDWLHQW VWUHQJWK 1P PXVFOH IDWÀEURXV IUDFWLRQ DQG $'&[PPV 5HVXOWV0XVFOHVWUHQJWKVKRZHGDPRGHUDWHQHJDWLYHFRUUHODWLRQZLWKIDWIUDFWLRQ 6&&WRSDQGPRGHUDWHSRVLWLYHFRUUHODWLRQZLWK$'&YDOXHV 6&&WRS)DWÀEURXVIUDFWLRQFRUUHODWHVQHJDWLYHO\ZLWK$'& 6&&S % 6RGLXPLPDJLQJRIWKHOXPEDULQWHUYHUWHEUDOGLVFDW7HVOD FRUUHODWLRQZLWK7PDSSLQJDQGPRGLÀHG3ÀUUPDQQVFRUHDW7HVOD ,01RHEDXHU+XKPDQQ 9-XUDV&:$3ÀUUPDQQ3 6]RPRODQ\L 6=E\Q$0HVVQHU-:LPPHU.)ULHGULFK67UDWWQLJ9LHQQD$7 =XULFK&+LULVQRHEDXHU#PHGXQLZLHQDFDW 3XUSRVH7 RFRPSDUHVRGLXPLPDJLQJRIOXPEDULQWHUYHUWHEUDOGLVFVLQDV\PS WRPDWLF YROXQWHHUV DW 7 HVOD ZLWK TXDQWLWDWLYH 7 PDSSLQJ DQGPRUSKRORJLFDO VFRULQJDW7 HVOD 0HWKRGVDQG0DWHULDOV,QDV\PSWRPDWLFYROXQWHHUVPIPHDQDJH \HDUVUDQJHWKHGLVFV/WR/6ZHUHH[DPLQHG $W7 HVODQRUPDOLVHG VRGLXPVLJQDOWRQRLVHUDWLRVZHUHFDOFXODWHGXVLQJUHJLRQRILQWHUHVWDQDO\VLV $W 7 HVOD7PDSSLQJZDVSHUIRUPHGZLWKDPXOWLHFKRVSLQHFKRVHTXHQFH75 7(DQGPVHF7YDOXHVZHUHFDOFXODWHG RYHUWKHQXFOHXVZLWKDSL[HOZLVHPRQRH[SRQHQWLDOQRQQHJDWLYHOHDVWVTXDUHV ÀWDQDO\VLV0RUSKRORJLFDOJUDGLQJDFFRUGLQJWRDPRGLÀHG3ÀUUPDQQVFRUHZDV DVVHVVHGDQG3HDUVRQҋVFRUUHODWLRQDQDO\VLVRIWKHFRYDULDWHVZDVSHUIRUPHG 5HVXOWV,QWRWDOGLVFVZHUHHYDOXDWHG7KHPHDQQRUPDOLVHGVRGLXPVLJQDO LQWHQVLW\ZDV6'7KH7PDSSLQJVKRZHGDPHDQYDOXHRIPV 6'PV7KHPHGLDQPRGLÀHG3ÀUUPDQQVFRUHZDVEZLWKF 7KH3HDUVRQFRUUHODWLRQFRHIÀFLHQWVKRZHGDQHDUPRGHUDWHLQYHUVHFRUUHODWLRQ EHWZHHQVRGLXPLPDJLQJDQGWKH3ÀUUPDQQVFRUHU DPRGHUDWHLQYHUVH FRUUHODWLRQEHWZHHQ7PDSSLQJDQGWKH3ÀUUPDQQVFRUHU DQGQRFRU UHODWLRQEHWZHHQVRGLXPLPDJLQJDQG7PDSSLQJU &RQFOXVLRQ2XUUHVXOWVVXJJHVWWKDW05LPDJLQJRIWKHLQWHUYHUWHEUDOGLVFXVLQJ VRGLXPLPDJLQJDQG7PDSSLQJFKDUDFWHULVHVGLIIHUHQWPHDVXUDEOHELRFKHPLFDO FRPSRQHQWFKDQJHVDQGWKDWERWKRIWKHVHPHWKRGVDIIHFWWKH3ÀUUPDQQVFRUH % 05LPDJLQJRIWKHOXPEDUVSLQHFRPSDULVRQRI'LVRWURSLFWXUER VSLQHFKR63$&(VHTXHQFHYHUVXVFRQYHQWLRQDO'VHTXHQFHVDW7 6/HH:+-HH-< -XQJ6< /HH.< +D&.3DUN6HRXO.5 VXQJZRQOHH#JPDLOFRP 3XUSRVH7 RFRPSDUHLVRWURSLFWKUHHGLPHQVLRQDO'7ZHLJKWHGWXUERVSLQ HFKR VHTXHQFH 76(63$&( ZLWK FRQYHQWLRQDO WZRGLPHQVLRQDO '76( VHTXHQFHVIRUHYDOXDWLQJWKHQHXUDOIRUDPLQDDQGQHUYHVRIWKHOXPEDUVSLQHDW 705LPDJLQJ 0HWKRGVDQG0DWHULDOV7KHLQVWLWXWLRQDOHWKLFVFRPPLWWHHDSSURYHGWKLVUHWUR VSHFWLYHVWXG\DQGZDLYHGWKHUHTXLUHPHQWRILQIRUPHGFRQVHQWSDWLHQWVZKR KDGVSLQHVXUJHU\IRUGLVFKHUQLDWLRQDQGKDG7VSLQH05,ZHUHLQFOXGHG,Q DGGLWLRQWRFRQYHQWLRQDO'76(VHTXHQFHVVDJLWWDO'7ZHLJKWHG76(63$&( ZDVREWDLQHGWRSURGXFHPXOWLSODQDULQWHUPHGLDWHZHLJKWHGLPDJHVZLWKPP LVRWURSLFUHVROXWLRQDORQJWKHD[LDOFRURQDODQGREOLTXHFRURQDOSODQHV(DFK' DQG'76(LPDJHVZHUHLQGHSHQGHQWO\VFRUHGIRUWKHGHJUHHRIOXPEDUQHXUDO IRUDPLQDOVWHQRVLVQHUYHFRPSUHVVLRQDQGQHUYHVZHOOLQJE\WZRUHYLHZHUV7KHVH VFRUHVZHUHFRPSDUHGZLWKRSHUDWLYHÀQGLQJVDQGLQLWLDOV\PSWRPV,QWHUREVHUYHU DJUHHPHQWVZHUHFRPSDUHGZLWKNDSSDVWDWLVWLFVDQGFRUUHODWLRQZLWKWKHVXUJHU\ ZDVGRQHE\0F1HPDUWHVW 5HVXOWVQHXUDOIRUDPLQDOVWHQRVHVLQSDWLHQWVDQGQHUYHFRPSURPLVHLQ SDWLHQWVZHUHIRXQGDWVXUJHU\7KHPHDQGLDJQRVWLFVHQVLWLYLW\DQGDFFXUDF\RI '76(VHTXHQFHVYHUVXV'76(63$&(ZHUHDQGYHUVXVDQG IRUQHXUDOIRUDPLQDOVWHQRVLVDQGYHUVXVDQGIRUQHUYH FRPSUHVVLRQ&RURQDODQGREOLTXHFRURQDOUHIRUPDWWHGLPDJHVRI'76(63$&( GHPRQVWUDWHGKLJKHUFRUUHODWLRQZLWKWKHODWHUDOLW\RIWKHV\PSWRPWKDQ'76( VHTXHQFHV YHUVXV 7KH LQWHUREVHUYHU DJUHHPHQWV ZHUH VXEVWDQWLDO ѣ RQ'76(63$&(DQGPRGHUDWHѣ RQ'76(VHTXHQFHV &RQFOXVLRQ,VRWURSLF'7ZHLJKWHG76(63$&(VHTXHQFHZDVFRPSDUDEOH WRFRQYHQWLRQDO'76(VHTXHQFHVIRUGLDJQRVLQJIRUDPLQDOVWHQRVLVDQGQHUYH FRPSUHVVLRQDW7OXPEDUVSLQH05,DQGVKRZHGEHWWHUV\PSWRPDWLFFRUUHODWLRQ % 0XOWLHFKR05,IRUPXVFOHIDWTXDQWLÀFDWLRQLQSDWLHQWVZLWKORZ EDFNSDLQFRPSDULVRQWRVSHFWURVFRS\ 0$) )LVFKHU5*XJJHQEHUJHU'1DQ]*$QGUHLVHN=XULFK&+ PLFKDHODOH[DQGHUÀVFKHU#XV]FK 3XUSRVH 7 R SURVSHFWLYHO\ FRPSDUH IDWVLJQDOIUDFWLRQV GHULYHG IURP VSRLOHG JUDGLHQWGXDOHFKR63*5'(DQGPXOWLHFKR63*50(05,ZLWKDQGZLWKRXW FRUUHFWLRQRI7 ELDVIRUTXDQWLÀFDWLRQRIPXVFOHIDWFRQWHQW0)&LQSDWLHQWVZLWK ORZEDFNSDLQ/%3XVLQJVLQJOHYR[HOVSHFWURVFRS\DVWKHVWDQGDUGRIUHIHUHQFH 6FLHQWLILF6HVVLRQ 6 &$' ( ) *+% (XURSHDQ&RQJUHVVRI 5DGLRORJ\ UDSK\(0*DQGEHKDYLRXUDOPHDVXUHVUHPDLQVXQFOHDU:HK\SRWKHVLVHGWKDW '7,PHDVXUHVRIWKHPHGLDQQHUYHZRXOGFRUUHODWHZLWKVORZHGQHUYHFRQGXFWLRQ DQGLPSDLUHGJULSIRUFHFRQWUROLQSDWLHQWVZLWKSRVWRSHUDWLYHUHFXUULQJV\PSWRPV 0HWKRGVDQG0DWHULDOV&RKRUWSDWLHQWVZLWK(0*HYLGHQFHRIUHFXUUHQW&76 DIWHUVXUJLFDOUHOHDVHPHDQSRVWRSWLPH \HDUV7KHPHGLDQQHUYH'7,VHTXHQFH FRQVLVWHG RI QRQFROOLQHDU GLIIXVLRQ JUDGLHQWV E VPP$QDWRPLFDO 05 LPDJHV ZHUH DOVR FROOHFWHG )UDFWLRQDO DQLVRWURS\ )$ DQG DSSDUHQW GLIIXVLRQ FRHIÀFLHQW$'&YDOXHVZHUHH[WUDFWHG5HJLRQVRILQWHUHVWZHUHGUDZQRQWKH PHGLDQQHUYHFPSUR[LPDOWRDQGLQWKHFDUSDOWXQQHOUDWLR GLVWDOSUR[LPDO 5HVXOWV 7KH PHGLDQ QHUYH ZDV LGHQWLÀHG VXFFHVVIXOO\ WKURXJK ÀEUH WUDFNLQJ LQ DOO SDWLHQWV 'LIIXVLRQ SDUDPHWHUV IRU WKH PHGLDQ QHUYH ZHUH PHDQ6' )$ DQG $'& 0HDQGLVWDOSUR[LPDOUDWLRVZHUH)$ DQG$'& (0*UHYHDOHGUHGXFHGPRWRUFRQGXFWLRQPVLQDQG UHGXFHGVHQVRU\FRQGXFWLRQLQSDWLHQWV*ULSIRUFHWUDFNLQJHUURUZDVKLJKHU WKDQQRUPDWLYHYDOXHVLQDOOSDWLHQWV6HQVRU\QHUYHFRQGXFWLRQFRUUHODWHGZLWK )$UDWLR5 3 7UDFNLQJHUURUFRUUHODWHGZLWKPHDQ)$IRUWKHPHGLDQ QHUYH5 3 DQGZLWK)$UDWLR5 3 &RQFOXVLRQ7KHUHVXOWVVXJJHVWWKDW'7,PD\EHXVHIXOIRUWKHHYDOXDWLRQRIWKH PHGLDQQHUYHLQSDWLHQWVZLWKUHFXUUHQW&76 5RRP) 2QFRORJLF,PDJLQJ 66 1HZDSSOLFDWLRQVIRU86DQG&7LQHYDOXDWLQJ SDWLHQWVZLWKFDQFHU 0RGHUDWRUV 7%lXHUOH+HLGHOEHUJ'( 0%HOORPL0LODQ,7 % 0XOWLFHQWULFSURVSHFWLYHVWXG\RI'&(86IRUWKHHYDOXDWLRQRI DQWLDQJLRJHQLFWUHDWPHQWVGHWHUPLQDWLRQRIFULWHULDZLWKFRUUHODWLRQ WRRYHUDOOVXUYLYDO 1/DVVDX 99LOJUDLQ-/DFURL[67 DLHE$6DUUDQ5$]L]D0.LQG $/XFLDQL6.RVFLHOQ\9LOOHMXLI)5&OLFK\)5&DHQ)5/LOOHV)5 0DUVHLOOH)57 RXORXVH)5%RUGHDX[)5&UHWHLO)5ODVVDX#LJUIU 3XUSRVH $SURVSHFWLYHVWXG\RIG\QDPLFFRQWUDVWHQKDQFHGXOWUDVRXQG'&(86 ZLWKTXDQWLÀFDWLRQIRUWKHHYDOXDWLRQRIDQWLDQJLRJHQLFWUHDWPHQWVZDVODXQFKHG FHQWUHVVXSSRUWHGE\WKH)UHQFK1DWLRQDO&DQFHU,QVWLWXWH7KHREMHFWLYHVZHUH WKHGLIIXVLRQRIWKHVWDQGDUGLVHGPHWKRGDFRVWHYDOXDWLRQDQGWKHLGHQWLÀFDWLRQ RISHUIXVLRQSDUDPHWHUVSUHGLFWLQJWXPRXUUHVSRQVH 0HWKRGVDQG0DWHULDOV $OOSDWLHQWVKDG'&(86DWEDVHOLQH'''' DQGHYHU\WZRPRQWKV(DFKH[DPLQDWLRQLQFOXGHGDEROXVLQMHFWLRQRIVRQRYXH %UDFFRDQGPLQXWHVRIUDZOLQHDUGDWDZLWKDQ $SOLR7 RVKLED5DZGDWDZHUH DQDO\VHGZLWKDPDWKHPDWLFDOPRGHOSDWHQW3&7,%WRHYDOXDWH SDUDPHWHUV FKDUDFWHULVLQJ WKH WXPRXU SHUIXVLRQ FXUYH 5HVSRQVHWR WUHDWPHQW ZDVHYDOXDWHGHYHU\PRQWKVZLWK5(&,67FULWHULD,QRUGHUWRKDYHVXIÀFLHQW IROORZXSGDWDWKHVWDWLVWLFDODQDO\VLVKDVWREHSHUIRUPHGPRUHWKDQPRQWKVDIWHU WKHLQFOXVLRQRIWKHODVWDQDO\VHGSDWLHQW,QFOXVLRQVZHUHFORVHGLQ0DUFK 5HVXOWV$WRWDORISDWLHQWVKDYHEHHQLQFOXGHGPDLQO\5&&DQG+&& PRUHWKDQ'&(86DQG&7VFDQZHUHSHUIRUPHG$IROORZXS PRUHWKDQPRQWKVVKRZHGWKDWSDUDPHWHUVKDYHDVWURQJVLJQLÀFDQWGLIIHUHQFH 3DFFRUGLQJWRWKHUHVSRQVHDWPRQWKV7KHGHFUHDVHRIPRUHWKDQ RI$8&DWRQHPRQWKLVFRUUHODWHGWRWKH7733DQG263 &RQFOXVLRQ )LQDO UHVXOWV FRQÀUP WKH XVHIXOQHVV RI WKLV WRRO WR PRQLWRU DQWL DQJLRJHQLFWUHDWPHQWV7KHFULWHULDWKHGHFUHDVHRIPRUHWKDQRI$8&DW RQHPRQWKLVSUHGLFWLYHRIUHVSRQVH % 3DUDPHWULFPDSVRIWXPRUDOSHUIXVLRQZLWKG\QDPLFFRQWUDVW HQKDQFHGXOWUDVRXQGYHUVXVKLVWRORJ\PXOWLPRGDOLWLHVPHOLPDJHSURMHFW 63LWUH&KDPSDJQDW -%&DVWDLJQH/&DOPHOV$/HUR\:LOOLQJ ,/HJXHUQH\-7KDOPHQVL*%RQQLDXG1/DVVDX-&RXORW9LOOHMXLI)5 2UVD\)5VWHSKDQLHSLWUH#XSVXGIU 3XUSRVH7 RLGHQWLI\FRUUHODWLRQVEHWZHHQG\QDPLFFRQWUDVWHQKDQFHGXOWUDVRQRJ UDSK\'&(86DQGKLVWRORJ\LQWKHDVVHVVPHQWRIWKHWXPRUDOSHUIXVLRQZLWK VSHFLÀFPHWKRGRORJLFDOWRROVZHGHYHORSHG &RQFOXVLRQ2XUUHVXOWVVXJJHVWWKDWWKHSHUFHQWDJHRIGHJHQHUDWHGPXVFOHDQG GLIIXVLRQSURSHUWLHVFDQEHXVHGDVDQLQGLUHFWPDUNHUIRUPXVFOHVWUHQJWK0XVFXODU IXQFWLRQKDVLQWXUQEHHQGHPRQVWUDWHGWREHDVVRFLDWHGZLWKWKHGHYHORSPHQW DQGSHUVLVWHQFHRIORZHUEDFNSDLQ4XDQWLÀFDWLRQRIPXVFXODUGHJHQHUDWLRQDQG $'& YDOXHV PD\ RIIHU LPSRUWDQW EHQHÀWV WR 05EDVHG PRUSKRORJLFDQDO\VLV RI WKHOXPEDUVSLQH % 'LIIXVLRQZHLJKWHG05LPDJLQJRIWKHVSLQHDW7 IHDVLELOLW\ RSWLPL]DWLRQRIEYDOXHDQGXWLOLW\WRGLIIHUHQWLDWHEHQLJQIURP SDWKRORJLFDOYHUWHEUDOFRPSUHVVLRQIUDFWXUHV *)HW] 17KHXPDQQ&)HGHUDX'5LFKDUPH3 +DJPDQQ-3IHXIIHU 50HXOL) %HFFH/DXVDQQH&+(UODQJHQ'( 3XUSRVH7 RHYDOXDWHWKHIHDVLELOLW\GHWHUPLQHWKHRSWLPDOEYDOXHDQGDVVHVV WKHXWLOLW\RI7GLIIXVLRQZHLJKWHG05LPDJLQJ':,RIWKHVSLQHLQGLIIHUHQWLDWLQJ EHQLJQIURPSDWKRORJLFYHUWHEUDOFRPSUHVVLRQIUDFWXUHV 0HWKRGVDQG0DWHULDOV7ZHQW\SDWLHQWVZLWKYHUWHEUDOFRPSUHVVLRQIUDFWXUHV EHQLJQSDWKRORJLFDQGFRQWUROVWRWDOPHQZRPHQPHDQDJH \HDUVZHUHLQFOXGHGIURP'HFHPEHUWR0D\LQWKLV,5%DSSURYHG SURVSHFWLYHVWXG\05LPDJLQJRIWKHVSLQHZDVSHUIRUPHGRQD7XQLWZLWK7Z IDWVXSSUHVVHG7ZJDGROLQLXPHQKDQFHGIDWVXSSUHVVHG7ZDQG]RRPHG(3, ' 5) H[FLWDWLRQ SXOVH FRPELQHG ZLWK UHGXFHG ÀHOGRIYLHZ VLQJOHVKRW HFKR SODQDU UHDGRXW GLIIXVLRQZ EYDOXHV DQG VPP VHTXHQFHV 7ZR UDGLRORJLVWV LQGHSHQGHQWO\ DVVHVVHG ]RRPHG(3, LPDJH TXDOLW\ LQ UDQGRP RUGHUXVLQJDSRLQWVFDOH H[FHOOHQWWR SRRU7KH\VXEVHTXHQWO\PHDVXUHG DSSDUHQWGLIIXVLRQFRHIÀFLHQWV$'&VLQQRUPDOYHUWHEUDOERGLHVDQGFRPSUHVVLRQ IUDFWXUHVLQFRQVHQVXV 5HVXOWV/RZHUEYDOXHVFRUUHODWHGZLWKEHWWHULPDJHTXDOLW\VFRUHVZLWKVLJQLÀ FDQWGLIIHUHQFHVEHWZHHQE PHDQ6' E DQGE DOO S 0HDQ$'&V RI QRUPDO YHUWHEUDO ERGLHV Q ZHUH DQGðPPVZLWKE DQGVPPUHVSHFWLYHO\,Q FRQWUDVWPHDQ$'&VZHUHDQGðPPVIRUEHQLJQYHUWHEUDO FRPSUHVVLRQIUDFWXUHVDQGDQGðPPVIRUSDWKRORJLFIUDFWXUHV ZLWKE DQGVPPUHVSHFWLYHO\1RVLJQLÀFDQWGLIIHUHQFHZDVIRXQG EHWZHHQ$'&VRIEHQLJQDQGSDWKRORJLFIUDFWXUHV &RQFOXVLRQ7':,RIWKHVSLQHLVIHDVLEOHDQGORZHUEYDOXHVVPPDUH UHFRPPHQGHG +RZHYHU RXU SUHOLPLQDU\ UHVXOWV VKRZ QR DGYDQWDJH RI ':, LQ GLIIHUHQWLDWLQJEHQLJQIURPSDWKRORJLFYHUWHEUDOFRPSUHVVLRQIUDFWXUHV % +LJKUHVROXWLRQPDJQHWLFUHVRQDQFHLPDJLQJRIWKHEUDFKLDOSOH[XV XVLQJDQLVRWURSLFHQKDQFHGVFDQRI'67,5VHTXHQFH ) <DQJ'/LX< /Y;.RQJ:XKDQ&1I\DQJ#YLS FRP 3XUSRVH 7 R LQYHVWLJDWH WKH IHDVLELOLW\ RI LPDJLQJ EUDFKLDO SOH[XV LQ HQKDQFHG VFDQRI'67,5VHTXHQFHLQ05,DQGLWVGLDJQRVWLFDFFXUDF\LQWKHHYDOXDWLRQ RIEUDFKLDOSOH[RSDWKLHV 0HWKRGVDQG0DWHULDOV7KH'67,5VHTXHQFHVFDQQLQJDQG'67,5VHTXHQFH RI HQKDQFHG VFDQ ZHUH XVHG LQ SDWLHQWV LQ WKH GLDJQRVLV RI EUDFKLDO SOH[XV SDWKRORJLHVLQYROYLQJSULPDU\DQGVHFRQGDU\EUDFKLDOSOH[XVOHVLRQVDQGLQ YROXQWHHUV$OO SDWLHQWV KDG FOLQLFDO QHUYH FRQGXFWLRQ DQG HOHFWURP\RJUDSKLF ÀQGLQJVFRQVLVWHQWZLWKEUDFKLDOSOH[XVOHVLRQV 5HVXOWV '67,5 VHTXHQFH DQG HQKDQFHG VFDQ FDQ FOHDUO\ GLVSOD\ DOO WKH YROXQWHHUV IURP WKH EUDFKLDO SOH[XV FRXUVH FRQWLQXLW\ VKDSH VLJQDO DQG WKH HQKDQFHGVFDQFDQLPSURYHWKHVXSSUHVVLRQHIIHFWVRIEDFNJURXQGLWLVWKHFDVH WKDWWUDXPDDQGWXPRXUFDQEHFOHDUO\VHHQLQYROYLQJWKHEUDFKLDOSOH[XVGXHWR DYDULHW\RIVLJQV &RQFOXVLRQ:HFRQFOXGHWKDWWKHHQKDQFHGVFDQRI'67,5VHTXHQFHLVDXVHIXO WHFKQLTXHLQHYDOXDWLQJSDWLHQWVZLWKEUDFKLDOSOH[XVOHVLRQVDQGUHFHLYHDEHWWHU VXSSUHVVLRQHIIHFWVRIWKHEDFNJURXQG0DJQHWLFUHVRQDQFHLPDJLQJPD\KDYH VLJQLÀFDQWSRWHQWLDOWRSURYLGHPRUHLQIRUPDWLRQDERXWSUREOHPVVXFKDVEUDFKLDO SOH[XVLQMXULHVDQGSHULSKHUDOQHUYHFRPSUHVVLRQ % 'LIIXVLRQWHQVRULPDJLQJRIWKHPHGLDQQHUYHLQSDWLHQWVZLWK UHFXUUHQWFDUSDOWXQQHOV\QGURPHDIWHUVXUJLFDOUHOHDVH 3 /LQGEHUJ$)H\G\0$0DLHU-/'UDSH3DULV)5 SDYHOOLQGEHUJ#FFKDSKSIU 3XUSRVH3UHOLPLQDU\VWXGLHVVXJJHVWWKDWGLIIXVLRQWHQVRULPDJLQJ'7,PD\EH RIXVHIRUWKHTXDQWLÀFDWLRQRIVWUXFWXUDOLQWHJULW\RIWKHPHGLDQQHUYHLQSDWLHQWV ZLWK FDUSDO WXQQHO V\QGURPH &76 +RZHYHU KRZ '7, UHODWHV WRHOHFWURP\RJ 6FLHQWLILF6HVVLRQ $ 6&'()*+%(XURSHDQ&RQJUHVVRI 5DGLRORJ\ 6DWXUGD\ 5HVXOWVPHGLDVWLQDOO\PSKQRGHVIURPWKHSDWLHQWVZHUHDQDO\VHGZLWK SURYHGWREHPDOLJQDQWDWSDWKRORJ\H[DPLQDWLRQDQGEHQLJQ%\FRPSDULQJWKH VL]HRIO\PSKQRGHVDQGWKHZHLJKWHGLRGLQHFRQFHQWUDWLRQVVWDWLVWLFDOO\VLJQLÀFDQW GLIIHUHQFHVZDVIRXQGERWKZLWKS7KHZHLJKWHGLRGLQHFRQFHQWUDWLRQZDV PJPO IRU PDOLJQDQW O\PSK QRGHV JURXS DQG WKRVH IRU EHQLJQ JURXS ZDVPJPO &RQFOXVLRQ7KHZHLJKWHGLRGLQHFRQFHQWUDWLRQVIURP'(VFDQFRUUHODWHGZLWK SDWKRORJLFDOUHVXOWVRIO\PSKQRGHVLQSDWLHQWVZLWK16&/&7KHZHLJKWHGLRGLQH FRQFHQWUDWLRQVFRXOGEHDQHZPHWKRGWRHYDOXDWHWKHPHGLDVWLQDOO\PSKQRGH PHWDVWDVHVLQ16&/& % ,VEORRGÁRZEORRGYROXPHPLVPDWFKLQFRORUHFWDOFDQFHU DVVRFLDWHGZLWKDGYDQFHGGLVHDVH" 9-*RK .0LOHV%*DQHVKDQ05RGULJXH]-XVWR$(QJOHGRZ $*URYHV/RQGRQ8.)DOPHU8. 3XUSRVH9DVRGLODWDWLRQLQWKHSUHVHQFHRIORZEORRGÁRZUHSUHVHQWVDQDGDSWD WLRQWRK\SR[LDZKLFKLQWXPRXUPD\UHÁHFWDQDJJUHVVLYHSKHQRW\SH7KLVVWXG\ XVHVSHUIXVLRQ&7WRXQGHUWDNHDSUHOLPLQDU\DVVHVVPHQWRIZKHWKHUVXFKEORRG ÁRZEORRGYROXPH%)%9PLVPDWFKLQSULPDU\FRORUHFWDOFDQFHULVDVVRFLDWHG ZLWKWKHSUHVHQFHRIDGYDQFHGGLVHDVH 0HWKRGVDQG0DWHULDOV,5%DSSURYDODQGLQIRUPHGFRQVHQWZHUHREWDLQHG3HU IXVLRQ&7EORRGÁRZDQGEORRGYROXPHPHDVXUHPHQWVZHUHDFTXLUHGSURVSHFWLYHO\ LQSULPDU\FRORUHFWDOFDQFHUVIURPSDWLHQWV1RGDODQGPHWDVWDWLFGLVHDVHVWDWXV ZHUHGHWHUPLQHGIURPSDWKRORJLFDOH[DPLQDWLRQRIWKHUHVHFWLRQVSHFLPHQDQG) ÁXRURGHR[\JOXFRVH3(7 7XPRXUVZLWKEORRGÁRZYDOXHVEHORZWKHPHGLDQDQG EORRGYROXPHPHDVXUHPHQWVDERYHWKHPHGLDQZHUHFRQVLGHUHGWRH[KLELW%)%9 PLVPDWFK7KHIUHTXHQF\RIPLVPDWFKDPRQJVWQRGHSRVLWLYHDQG0WXPRXUVZDV FRPSDUHGWR1DQG0WXPRXUVXVLQJ)LVFKHUҋVH[DFWWHVW 5HVXOWV0HGLDQ%)DQG%9ZHUHPOPLQJDQGPOJUHVSHFWLYHO\ RIWXPRXUVGHPRQVWUDWHG%)%9PLVPDWFK0LVPDWFKZDVVLJQLÀFDQWO\PRUH FRPPRQDPRQJVW0WXPRXUVYHUVXVS EXWQRWDPRQJVWQRGH SRVLWLYHWXPRXUVYHUVXVS &RQFOXVLRQ7KLVVWXG\SURYLGHVSUHOLPLQDU\HYLGHQFHRIDQDVVRFLDWLRQEHWZHHQ %)%9PLVPDWFKDQGWKHSUHVHQFHRIGLVWDQWPHWDVWDVHVLQFRORUHFWDOFDQFHU%) %9PLVPDWFKPD\SRWHQWLDOO\SURYLGHDPDUNHURIWXPRXUDGDSWDWLRQWRK\SR[LD % 'XDOVRXUFHGXDOHQHUJ\&7IRUOXQJFDQFHUHYDOXDWLRQFRUUHODWLRQ VWXG\EHWZHHQZHLJKWHGLRGLQHFRQFHQWUDWLRQVDQGSDWKRORJLFDO UHVXOWVRIWXPRXUOHVLRQ < 5DR:<DQJ%/LX/&DR< %X:&KDL.&KHQ6KDQJKDL&1 UR\B #KRWPDLOFRP 3XUSRVH7 RHYDOXDWHWKHFRUUHODWLRQEHWZHHQSDWKRORJLFDOVXEW\SHVRIOXQJFDQFHU DQGWKHZHLJKWHGLRGLQHFRQFHQWUDWLRQLQWKHWXPRXUOHVLRQIURPVHFRQGJHQHUDWLRQ GXDOVRXUFHGXDOHQHUJ\'6'(&7VFDQ 0HWKRGVDQG0DWHULDOVSDWLHQWVZLWKOXQJFDQFHUXQGHUZHQWFRQWUDVWHQKDQFHG GXDOHQHUJ\&7VFDQZKLFKZDVSHUIRUPHGVHFRQGVDIWHUWKHFRQWUDVWLQMHFWLRQ PO&0DWPOV7KH&7YDOXHVEOHQGHGYDOXHIURPKLJKDQGORZN9LPDJHV DQGLRGLQHFRQFHQWUDWLRQVPJPOIURPWKHWXPRXUDVZHOODVWKRVHIURPSXOPRQDU\ DUWHU\DQGDRUWDRQWKHVDPHLPDJHSODQHZHUHPHDVXUHGLQD'(SRVWSURFHVVLQJ ZRUNVWDWLRQ 7KH LRGLQH FRQFHQWUDWLRQV IURP WKH OHVLRQ ZHUH QRUPDOLVHG E\ WKH LRGLQHFRQFHQWUDWLRQVRISXOPRQDU\DUWHU\DQGDRUWDGXHWRWKHGXDOEORRGVXSSO\ RIOXQJWXPRXUWRPLQLPLVHWKHSDWLHQWYDULDWLRQ6WDWLVWLFDODQDO\VLVZDVSHUIRUPHG WR LQYHVWLJDWH WKH FRUUHODWLRQ EHWZHHQ WKH ZHLJKWHG LRGLQH YDOXH RI WXPRXU DQG FRUUHVSRQGLQJSDWKRORJLFDOUHVXOWV 5HVXOWVSDWLHQWVZHUHSDWKRORJLFDOO\ SURYHGZLWKDGHQRFDUFLQRPDV DQG SDWLHQWVZLWKVTXDPRXVFHOOFDUFLQRPD7KHPHDQ&7YDOXHVSURYLGHGQRGLIIHUHQFH EHWZHHQWKHWZRJURXSVS +RZHYHUE\FRPSDULQJWKHZHLJKWHGLRGLQH FRQFHQWUDWLRQVVWDWLVWLFDOO\VLJQLÀFDQWGLIIHUHQFHVZDVIRXQGS7KHPHDQ YDOXHRIZHLJKWHGLRGLQHFRQFHQWUDWLRQZDVPJPOIRUDGHQRFDUFLQRPDV JURXSDQGWKDWIRUVTXDPRXVFHOOFDUFLQRPDZDVPJPO &RQFOXVLRQ 'XDO HQHUJ\ &7 VFDQ FRXOG EH D XVHIXO WRRO LQ GLIIHUHQWLDWLRQRI SDWKRORJLFDOOXQJFDQFHUVXEW\SHVDVWKHZHLJKWHGLRGLQHFRQFHQWUDWLRQIRUOXQJ WXPRXUOHVLRQFRUUHODWHVZLWKWKHWXPRXUSDWKRORJLFDOVXEW\SHV 0HWKRGVDQG0DWHULDOV6WXG\ZDVFRQGXFWHGRQPHODQRPDEHDULQJQXGHPLFH DQGRQSDWLHQWVZLWKPHWDVWDWLFQRGHRIPHODQRPD)RUSUHFOLQLFDOVWXG\'&( 86H[DPZDVUHDOLVHGDIWHUDPOEROXVLQMHFWLRQRI6RQR9XH%UDFFR,WDO\ )URPWKHOLQHDUUDZGDWDZHHVWDEOLVKHGSDUDPHWULFPDSVXVLQJWKHPDWKHPDWLFDO PRGHORIWKHWLPHLQWHQVLW\FXUYHRIWXPRUDOSHUIXVLRQSDWHQWHGE\WKHWHDP7 RZ SDUDPHWHUVZHUHFRQVLGHUHGDUHDXQGHUWKHFXUYH$8&DQGSHDNLQWHQVLW\3, +LVWRORJLFDOVWXG\HYDOXDWHGPLFURYHVVHOGHQVLW\09'DQGYHVVHOGLDPHWHU7KHVH GDWDZHUHREWDLQHGZLWKLQWRGLVWLQFWVHFWLRQVLQHDFKWXPRXUDQGFRQIURQWHG WRWKHSDUDPHWULFPDSVIURP'&(86)RUFOLQLFDOVWXG\'&(86ZDVSHUIRUPHG EHIRUHVXUJHU\ZLWKDPOEROXVLQMHFWLRQRI6RQR9XH 5HVXOWV$PRQJWKHVWXGLHGPLFHZHUHHYDOXDEOHZLWKDQDO\VHGVHF WLRQV 6SDWLDO GLVWULEXWLRQ RI$8& DQG 3, ZDV VLJQLÀFDQWO\ FRUUHODWHG ZLWK 09' UHVSHFWLYHO\5 SDQG5 SK\SHUYDVFXODULVHG VHFWLRQVIURP'&(86FRUUHVSRQGHGWRDZHDN09'EXWZLWKODUJHYHVVHOGLDPHWHU &RUUHODWLRQZDVDOVRVLJQLÀFDQW$895 S3,5 S )URPWKHSDWLHQWVLQFOXGHGFRXOGEHVWXGLHGZLWKDFRQWUDVWXSWDNHEHWZHHQ DQG+LVWRORJLFDODQDO\VHVDUHLQSURJUHVVDQGUHVXOWVZLOOEHSUHVHQWHG &RQFOXVLRQ 2XU VWXG\ VKRZV D FRUUHODWLRQ EHWZHHQ WKH VSDWLDO GLVWULEXWLRQR I SHUIXVLRQSDUDPHWHUV$8&DQG3,DQGWKH09'DVVRFLDWHGZLWKWKHYHVVHOVL]H % (YDOXDWLRQRIWKHUHOLDELOLW\DQGUHSHDWDELOLW\RIG\QDPLFFRQWUDVW HQKDQFHGWXPRXUSHUIXVLRQLPDJLQJSDUDPHWHUVZLWKKLJKIUHTXHQF\ XOWUDVRXQG '%+XVDULN 5&1HOVRQ'0DULQ/:+HGOXQG*$-RKQVRQ =XULFK&+'XUKDP1&86 3XUSRVH7 RHYDOXDWHWKHUHOLDELOLW\DQGUHSHDWDELOLW\RIG\QDPLFFRQWUDVWHQKDQFHG WXPRXUSHUIXVLRQLPDJLQJ ZLWK KLJKUHVROXWLRQXOWUDVRXQG LQ FRORQFDQFHU [HQRJUDIWVLQPLFH 0HWKRGV DQG 0DWHULDOV PLFH ZLWK VXEFXWDQHRXV FRORQFDQFHU[HQRJUDIW WXPRXUPRGHOVZHUHH[DPLQHGZLWKD9HYRXOWUDVRXQGV\VWHP9LVXDOVRQLFV ,QF7 RURQWR&$XVLQJD5090+]KLJKIUHTXHQF\WUDQVGXFHUDQGWKUHH GLIIHUHQWPLFUREXEEOHFRQFHQWUDWLRQV[[[PLFUREXEEOHVP/ 7KUHHVHSDUDWHѥ/EROXVLQMHFWLRQVRIHDFKPLFUREXEEOHFRQFHQWUDWLRQZHUH H[DPLQHGLQHDFKWXPRXU7KHUHFRUGLQJRIHDFKG\QDPLFVWXG\ZDVWULJJHUHG VHFRQGVSULRUWRWKHFRQWUDVWDJHQWLQMHFWLRQDQGDWRWDORILPDJHVZHUHUHFRUGHG RYHUDVHFSHULRG7KHIROORZLQJVHPLTXDQWLWDWLYHSHUIXVLRQSDUDPHWHUVZHUH H[WUDFWHG IURP WKH WLPHLQWHQVLW\ FXUYHV SHDN LQWHQVLW\ LQ DUELWUDU\ XQLWV $8 WLPHWRSHDNLQWHQVLW\LQVHFDUHDXQGHUWKHWLPHLQWHQVLW\FXUYH$8&GXULQJ ZDVKLQLQ$8DQGVORSHFRHIÀFLHQWRIWKHZDVKLQLQ$8VHF7KHFRHIÀFLHQWRI YDULDWLRQZDVFDOFXODWHGIRUHDFKG\QDPLFSDUDPHWHURIHDFKVHWRIPLFUREXEEOH FRQFHQWUDWLRQVIRUHDFKWXPRXU 5HVXOWV3HDNLQWHQVLW\WLPHWRSHDNDVZHOODV $8&YDOXHVFRUUHODWHGVLJQLÀFDQWO\ 3ZLWKPLFUREXEEOHFRQFHQWUDWLRQZKLOHVORSHFRHIÀFLHQWYDOXHVGLGQRW 3 7KHVHPLTXDQWLWDWLYHSHUIXVLRQSDUDPHWHUVIROORZLQJLQMHFWLRQVZLWK WKH VDPH PLFUREXEEOHFRQFHQWUDWLRQ ZHUH REWDLQHG ZLWK YDU\LQJ UHOLDELOLW\ ZLWK DFRHIÀFLHQWRIYDULDWLRQIRUSHDNLQWHQVLW\YDOXHVRIIRUWLPHWRSHDN YDOXHVRIIRU$8&YDOXHVRIDQGIRUVORSHFRHIÀFLHQWYDOXHV RI &RQFOXVLRQ7KHHYDOXDWHGVHPLTXDQWLWDWLYHSHUIXVLRQSDUDPHWHUVGHPRQVWUDWH DYDU\LQJUHOLDELOLW\DQGUHSHDWDELOLW\GXULQJG\QDPLFFRQWUDVWHQKDQFHGWXPRXU SHUIXVLRQLPDJLQJZLWKKLJKUHVROXWLRQXOWUDVRXQG % 'XDOVRXUFHGXDOHQHUJ\&7VFDQWRHYDOXDWHWKHPHGLDVWLQDOO\PSK QRGHPHWDVWDVHVLQQRQVPDOOFHOOOXQJFDQFHUIHDVLELOLW\VWXG\ < 5DR:<DQJ%/LX/&DR< %X:&KDL.&KHQ6KDQJKDL&1 UR\B#KRWPDLOFRP 3XUSRVH 7 R HYDOXDWH WKH DFFXUDF\ RI WKH ZHLJKWHG LRGLQH FRQFHQWUDWLRQIURP VHFRQGJHQHUDWLRQGXDOVRXUFHGXDOHQHUJ\'6'(&7VFDQLQGLDJQRVLQJPHGL DVWLQDOO\PSKQRGHPHWDVWDVHVLQSDWLHQWVZLWKQRQVPDOOFHOOOXQJFDQFHU16&/& 0HWKRGV DQG 0DWHULDOV$ FRQWUDVWHQKDQFHG GXDO HQHUJ\ &7 VFDQ ZDV SHU IRUPHGVHFRQGVDIWHUWKHFRQWUDVWLQMHFWLRQPO&0DWPOVRQSDWLHQWV ZLWKKLVWRSDWKRORJLFDOO\SURYHQ16&/&7KHVL]HRIO\PSKQRGHVDQGWKHLRGLQH FRQFHQWUDWLRQVPJPORIWKHPHGLDVWLQDOO\PSKQRGHVDVZHOODVWKHDRUWDRQ WKHVDPHLPDJHSODQHZHUHPHDVXUHGLQD'(SRVWSURFHVVLQJZRUNVWDWLRQ7KH LRGLQHFRQFHQWUDWLRQVIURPWKHO\PSKQRGHVZHUHQRUPDOLVHGE\WKHLRGLQHFRQ FHQWUDWLRQVRIDRUWDDFFRUGLQJWRWKHEORRGVXSSO\RIPHGLDVWLQXPWRPLQLPLVHWKH SDWLHQWYDULDWLRQ6WDWLVWLFDODQDO\VLVZDVSHUIRUPHGWRLQYHVWLJDWHWKHUDGLRORJLF SDWKRORJLFFRUUHODWLRQ 6FLHQWLILF6HVVLRQ 6 &$' ( ) *+% (XURSHDQ&RQJUHVVRI 5DGLRORJ\ FOXGHG7KH\XQGHUZHQWVHUXPWXPRXUPDUNHUPHDVXUHPHQWV&($&$HYHU\ PRQWKDIWHUVXUJHU\DQG0'&7IROORZXSDWDQGPRQWKVLQWHUYDO7ZRUHDGHUV LQFRQVHQVXVHYDOXDWHGD[LDODQGPXOWLSODQDUUHFRQVWUXFWHG0'&7LPDJHVRIWKH DEGRPHQREWDLQHGGXULQJWKHSRUWDOYHQRXVSKDVHRIFRQWUDVWPDWHULDOHQKDQFH PHQWZLWKDFROOLPDWLRQRI[PPDQGDVOLFHZLGWKRIPP0'&7ÀQGLQJV ZHUHFRUUHODWHGZLWKWXPRXUPDUNHUVPHDVXUHPHQWVREWDLQHGZLWKLQGD\V 5HVXOWV6HQVLWLYLW\VSHFLÀFLW\DQGGLDJQRVWLFDFFXUDF\ZHUHUHVSHFWLYHO\ DQGIRUVHUXPWXPRXUPDUNHUVDQGDQGIRU0'&7 ,Q SDWLHQWVZLWKQRUPDOWXPRXUPDUNHUV0'&7VKRZHGSHULWRQHDOQHRSODVWLF LPSODQWVFRQÀUPHGDWSDWKRORJ\DQG0'&7IROORZXS,QSDWLHQWVZLWKQRUPDO WXPRXUPDUNHUOHYHOV0'&7UHYHDOHGRQHSHULWRQHDOQRGXOHGHPRQVWUDWHGWREH QHFURWLFOHVLRQDWSDWKRORJ\ &RQFOXVLRQ0'&7LVDEOHWRHDUO\GHWHFWSHULWRQHDOUHFXUUHQFHLQSDWLHQWVWUHDWHG E\ PHDQV RI F\WRUHGXFWLYH VXUJHU\ DQG +,3(& DQG FDQ SUHGDWH ULVLQJ WXPRXU PDUNHUVOHYHOV % 0XOWLPRGDOLPDJLQJIRUWKHUDS\PRQLWRULQJRIORFRUHJLRQDODOSKD WKHUDS\%L'27$72&LQSDWLHQWVZLWKKHSDWLFPHWDVWDVHVRI QHXURHQGRFULQHWXPRXUV ) /*LHVHO &=HFKPDQQ6:XOIHUW+8.DXF]RU) %UXFKHUWVHLIHU $0RUJHQVWHUQ8+DEHUNRUQ&.UDWRZFKLO) /*LHVHO+HLGHOEHUJ'( .DUOVUXKH'(IJLHVHO#GNI]GH 3XUSRVH5DGLRODEHOOHGVRPDWRVWDWLQDQDORJVSOD\DQHPHUJLQJUROHLQWKHWKHUDS\ RISDWLHQWVZLWKQHXURHQGRFULQHFDQFHUV7KHÀUVWLQKXPDQSHSWLGUHFHSWRUDOSKD WKHUDS\ZLWK%L'27$72&ZDVDVVHVVHGZLWKPXOWLPRGDOLPDJLQJ05,3(7 &7DQG86IRULQLWLDOWKHUDS\PRQLWRULQJDQGVXUYHLOODQFHRISRVVLEOHORFDOVLGH HIIHFWVRIWKLVQHZDSSURDFK 0HWKRGV DQG 0DWHULDOV ,Q SDWLHQWV WKH UHFHQWO\ LQWURGXFHG DOSKDSDUWLFOH HPLWWLQJ%L'27$72&ZDVDGPLQLVWHUHGORFRUHJLRQDOLQWKHOLYHU0XOWLPRGDO LPDJLQJRIOLYHUPHWDVWDVHVZDVDVVHVVHGXVLQJ05,ZLWKVWDQGDUGVHTXHQFHVDQG GLIIXVLRQZHLJKWHGLPDJLQJ':05,EHIRUHDQGDIWHUWKHUDS\7KLVPRGDOLW\GHOLY HUVWKHOHVLRQGLDPHWHU/'DSSDUHQWGLIIXVLRQFRHIÀFLHQW$'&DVDVXUURJDWHRI WXPRXULQWHJULW\DVDVXUURJDWHRIWXPRXUSHUIXVLRQ,QDGGLWLRQFRQWUDVWHQKDQFHG XOWUDVRXQG&(86ZDVDFFRPSOLVKHGDVDQRQVLWHLPDJLQJPRGDOLW\WRDVVHVV WXPRXUPLFURYDVFXODULVDWLRQWLPHWRSHDN773 5HVXOWV,QWKHHDUO\05DQDO\VLVPRVWPHWDVWDVHVGHPRQVWUDWHGRQO\DPRGHU DWHGHFUHDVHLQ/'ZKHUHDVPHGLDQWXPRXU$'&DVDUHSUHVHQWDWLYHRIWXPRXU LQWHJULW\ LQFUHDVHG IURP [ PPVHF WR [ PPVHF ZHHNV DIWHUODVWORFRUHJLRQDOWKHUDS\3ULRUWRWKHUDSHXWLFLQWHUYHQWLRQ&(86SUHVHQWHG DSURQRXQFHGHQKDQFHPHQWLQWKHOLYHUPHWDVWDVHVFRPSDUHGWRWKHDGMDFHQWOLYHU SDUHQFK\PDPHGLDQ773PHWDVWDVLV VHFPHGLDQ773OLYHUSDUHQFK\PD VHFPRQWKVDIWHULQWHUYHQWLRQWKHLD%LWUHDWHGSDWLHQWVVKRZHGD GHFOLQHLQFRQWUDVWHQKDQFHPHQWLQ &RQFOXVLRQ,QWKLVRQJRLQJVWXG\&(86GLIIXVLRQZHLJKWHGDQGSHUIXVLRQ05, ZHUH DEOH WR GHPRQVWUDWH VXFK WXPRXU FKDQJHV DOVR HDUO\ DIWHU WUHDWPHQW ZLWK DOSKDWKHUDS\ 7KHUHIRUH WKLV IXQFWLRQDO WXPRXU LPDJLQJ DVVHVVPHQW VHHPV WR EH D UHOLDEOH ELRVXUURJDWH RI WUHDWPHQW UHVSRQVH DQG PLJKW SUHGLFW LQ DQ HDUO\ VWDJHOHVLRQUHVSRQVHV 5RRP) %UHDVW 66 6FUHHQLQJPDPPRJUDSK\DQG&$' 0RGHUDWRUV (0)DOOHQEHUJ%HUOLQ'( 36NDDQH2VOR12 % 9DULDWLRQVLQVFUHHQLQJRXWFRPHDPRQJSDLUVRIUDGLRORJLVWV DWLQGHSHQGHQWGRXEOHUHDGLQJRIVFUHHQLQJPDPPRJUDPVD SRSXODWLRQEDVHGVWXG\ 9YDQ%UHHVW6PDOOHQEXUJ-1HGHUHQG(*.ORPSHQKRXZHU/(0'XLMP (LQGKRYHQ1//(0'XLMP#KRWPDLOFRP 3XUSRVH7 RGHWHUPLQHYDULDWLRQVLQVFUHHQLQJRXWFRPHDPRQJXQLTXHSDLUVRI UDGLRORJLVWVDWLQGHSHQGHQWGRXEOHUHDGLQJRIVFUHHQLQJPDPPRJUDPV 0HWKRGV DQG 0DWHULDOV :H LQFOXGHG SDLUV RI VFUHHQLQJ UDGLRORJLVWV ZLWK D PLQLPXPRIVFUHHQLQJH[DPLQDWLRQVSHUSDLUREWDLQHGDWD'XWFKVFUHHQLQJ % 'HYHORSPHQWRIQRQQHFURWLFWXPRXUYROXPHWU\FULWHULDIRU HYDOXDWLRQRIWKHUDS\UHVSRQVHLQKHSDWRFHOOXODUFDUFLQRPD $.6LQJK9.XUUD:&DL*+DUULV'6DKDQL%RVWRQ0$86 9.855$#3$571(5625* 3XUSRVH7 RFRPSDUHVWDWLVWLFDOYDULDEOHVGHULYHGE\H[LVWLQJ5(&,67DQGWRWDO WXPRXU YROXPHWU\ 779 FULWHULDҋV DQG SURSRVHG QRQQHFURWLF WXPRXU YROXPHWU\ 119FULWHULDIRUDVVHVVLQJWKHUDS\UHVSRQVHLQKHSDWRFHOOXODUFDUFLQRPDҋV+&& 0HWKRGVDQG0DWHULDOV,QWKLVVWXG\SUHDQGSRVWWUHDWPHQW0'&7RISDWLHQWV ZLWKSDWKRORJLFDOO\SURYHQ+&&ZHUHXVHG,QWHUYDOFKDQJHLQ779DQG119ZDV HVWLPDWHGRQD'ZRUNVWDWLRQXVLQJ'TXDQWLÀFDWLRQWRROVRQ0'&7D[LDOVOLFHV 5(&,67PHDVXUHPHQWVZHUHFRPSDUHGWRWKHLQWHUYDOFKDQJHLQWRWDOWXPRXU YROXPH779DQGQRQQHFURWLFYROXPHFULWHULDҋV119,QWHUPHWKRG.DSSDIRU SUHGLFWLQJSDUWLDOUHJUHVVLRQVWDELOLW\DQGSURJUHVVLRQZDVGHULYHGDQGVWDWLVWLFDO HVWLPDWHV RI .DSODQ 0HLHU FXUYH VXUYLYDO FXUYHV GHULYHG E\ HDFK PHWKRG ZHUH FRPSDUHG /RJLVWLF UHJUHVVLRQ DQDO\VLV ZDV XVHG WR GHULYH WKH PRVW DFFXUDWH UHVSRQVHDVVHVVPHQWFULWHULD 5HVXOWV7KHNDSSDFRHIÀFLHQWVIRUWKHUDS\UHVSRQVHDJUHHPHQWUHPDLQHGSRRU EHWZHHQWKHVHPHWKRGVѣ7KHRYHUDOOPHGLDQVXUYLYDOZDVPRQWKV .DSODQ0HLHUFXUYHVZHUHPRUHRSWLPDOIRUSUHGLFWLQJVXUYLYDOE\SURSRVHG119 >PHGLDQVXUYLYDOPVUHVSRQVH5 PRQWKVQRUHVSRQVH15 PRQWKV S@WKDQH[LVWLQJ779PV5 P15 PS @DQG5(&,67 PV5 P15 PS FULWHULD V6WHSZLVHORJLVWLFUHJUHVVLRQDQDO\VLV UHYHDOHGRGGVUDWLR25IRU119DVWKHPRVWRSWLPDOLQWKHPRGHOFRPSDUHG WR779DQG5(&,67 &RQFOXVLRQ 4XDQWLÀFDWLRQ RI LQWHUYDO FKDQJH LQ QRQQHFURWLF WXPRXU YROXPH PD\EHDPRUHREMHFWLYHDQGUHOLDEOHPHDVXUHIRUSUHGLFWLQJWKHUDS\UHVSRQVHLQ +&&ҋVFRPSDUHGWRWKHH[LVWLQJWRWDOWXPRXUYROXPHDQG5(&,67FULWHULDҋV DQGGHVHUYHVYDOLGDWLRQRQDODUJHUFRKRUW % $QJLRJHQHVLVLQQRQVPDOOFHOOOXQJFDQFHUHDUO\DVVHVVPHQW RIWKHUDSHXWLFUHVSRQVHWRDQWLDQJLRJHQLFFKHPRWKHUDS\ZLWK SHUIXVLRQPXOWLGHWHFWRUURZ&70'&7 17 DFHOOL7 6DQWDQJHOR$6FKHUSHUHHO$/+DFKXOOD-5HP\ 05pP\-DUGLQ/LOOH)5QXQ]LDWDFHOOL#FKUXOLOOHIU 3XUSRVH7 RHYDOXDWHWHPSRUDOFKDQJHVLQ&7SHUIXVLRQSDUDPHWHUVXQGHUDQ WLDQJLRJHQLFGUXJV 0HWKRGVDQG0DWHULDOVSDWLHQWVZLWKQRQVPDOOFHOOOXQJFDUFLQRPDWUHDWHGE\ FKHPRWKHUDS\SODWLQXPEDVHGDQGWKLUGJHQHUDWLRQGUXJVDORQHJURXSQ RU FRPELQHGZLWKEHYDFL]XPDEJURXSQ XQGHUZHQWTXDQWLWDWLYH&7SHUIXVLRQ H[DPLQDWLRQVZLWKVOLFH0'&7EHIRUH7Q DQGDIWHUFKHPRWKHUDS\7 Q 7Q 7Q ZLWKDQLQWHUYDORIZHHNVEHWZHHQWKHUDSHXWLFVHV VLRQV7KH&7SDUDPHWHUVHYDOXDWHGLQFOXGHGDWXPRXUEORRGYROXPH%9DQG FDSLOODU\SHUPHDELOLW\&3LQGH[HGWRWXPRXUYROXPHE5(&,67PHDVXUHPHQWV 7KHOLQNEHWZHHQWKHUDSHXWLFUHVSRQVHDFFRUGLQJWR5(&,67FULWHULDDQGFKDQJHV LQ&7IXQFWLRQDOSDUDPHWHUVZDVLQYHVWLJDWHG 5HVXOWV&RPSDULQJ7DQG7DWKHPHGLDQYDOXHVRI%9DQG&3ZHUHVLJQLÀ FDQWO\UHGXFHGLQJURXS%9DW7YV%9DW7P/S &3 DW7YV&3DW7P/PLQS ZLWKRXWDQ\FKDQJHLQWXPRXU VL]HEIXQFWLRQDOSDUDPHWHUVGLGQRWFKDQJHLQJURXS&RPSDULQJ7DQG7 ERWKJURXSVGHPRQVWUDWHGUHGXFWLRQLQ%9JURXSS JURXSS DQG&3JURXSS JURXSS,QWKHRYHUDOOSRSXODWLRQDVLJ QLÀFDQWGHFUHDVHLQ&3DW7ZDVIRXQGWREHVWURQJO\UHODWHGWRWKHUHGXFWLRQLQ WXPRXUVL]HS DW7 &RQFOXVLRQ3HUIXVLRQ&7GHPRQVWUDWHVUHVWRUDWLRQRIWKHQHRYHVVHOZDOOVDIWHU WKHÀUVWWKHUDSHXWLFVHVVLRQRIDQWLDQJLRJHQLFFKHPRWKHUDS\HQDEOLQJDVVHVVPHQW RIWKHUDSHXWLFUHVSRQVHEHIRUHFKDQJHVLQ5(&,67FULWHULD % (DUO\GLDJQRVLVRIUHFXUUHQFHRISHULWRQHDOFDUFLQRPDWRVLV0'&7 FRUUHODWHGZLWKVHUXPWXPRXUPDUNHUV 07 0DFFDURQH5%DVLOLFR(5RGROÀQR9&DODPLWD$)HUUL0'H7XUVL $5&RWURQHR&KLHWL,7 3XUSRVH7 RDVVHVVWKHYDOXHRI0'&7LQWKHHDUO\GHWHFWLRQRISHULWRQHDOUHFXU UHQFHLQSDWLHQWVZLWKSHULWRQHDOFDUFLQRPDWRVLV3&WUHDWHGE\PHDQVRIF\WRUH GXFWLYHVXUJHU\DQG+,3(&LQFRPSDULVRQWRVHUXPWXPRXUPDUNHUV 0HWKRGVDQG0DWHULDOV7KLUW\ÀYHSDWLHQWVZLWK3&IURPRYDULDQQ FRORUHFWDO Q WXPRXUVXWHULQHVDUFRPDQ IDOORSLDQWXEHWXPRXUVQ DQGSHULWRQHDO OLSRVDUFRPDQ WUHDWHGE\PHDQVRIF\WRUHGXFWLYHVXUJHU\DQG+,3(&ZHUHLQ 6FLHQWLILF6HVVLRQ $ 6&'()*+%(XURSHDQ&RQJUHVVRI 5DGLRORJ\ 6DWXUGD\ FLUFXPVFULEHGDQGKDGLOOGHÀQHGPDUJLQVZLWKRXWPLFURFDOFLÀFDWLRQVZLWKDUHDV RIQHFURVLVDQGSRVWHULRUDFRXVWLFHQKDQFHPHQW &RQFOXVLRQ$QDO\VLV RI SURJQRVWLF IDFWRUV LQ EUHDVW FDUFLQRPDV FRQÀUPV WKDW LQWHUYDOFDVHVDUHPRUHDJJUHVVLYHWKDQWKRVHGLDJQRVHGLQVFUHHQLQJ7KHUD GLRORJLFDOSUHVHQWDWLRQPD\SUHGLFWFOLQLFDOFKDUDFWHULVWLFVDQGKLVWRORJLFDOW\SH % 6WDJHVSHFLÀFLQFLGHQFHUDWHVRIEUHDVWFDQFHULQSDUWLFLSDQWVDQG QRQSDUWLFLSDQWVRIDSRSXODWLRQEDVHGPDPPRJUDSKLFVFUHHQLQJ SURJUDPPH 6+RIYLQG &,/HH-*(OPRUH2VOR12/RV$QJHOHV&$86 6HDWWOH:$86VROYHLJKRIYLQG#NUHIWUHJLVWHUHWQR 3XUSRVH 7 R FRPSDUH VWDJHVSHFLÀF LQFLGHQFH RI EUHDVW FDQFHU LQ WKH WDUJHW SRSXODWLRQRIWKH1RUZHJLDQ%UHDVW&DQFHU6FUHHQLQJ3URJUDPPH 0HWKRGV DQG 0DWHULDOV :H FRPSDUHG WKH LQFLGHQFH DPRQJ LQYLWHG ZRPHQ DJHG \HDUV ZKR UHFHLYHG LQYLWDWLRQV DQG VWUDWLÀHG WKH DQDO\VHVE\LQYLWHGSDUWLFLSDQWVDQGLQYLWHGQRQSDUWLFLSDQWV7ZRVLGHGFKLVTXDUH WHVWVZHUHXVHGWRGHWHUPLQHVWDWLVWLFDOVLJQLÀFDQFHEHWZHHQJURXSV 5HVXOWV7KH LQFLGHQFH RI EUHDVW PDOLJQDQF\ '&,6 RU LQYDVLYH EUHDVW FDQFHU ZDVWLPHVKLJKHULQLQYLWHGSDUWLFLSDQWVFRPSDUHGZLWKLQYLWHGQRQSDUWLFLSDQWV YHUVXV S )RU LQYDVLYH EUHDVW FDQFHUV RQO\ WKH UDWH UDWLR ZDV 7KH LQFLGHQFH RI VWDJH , FDQFHU ZDV WZR WLPHV KLJKHUIRUSDUWLFLSDQWVLQYLWDWLRQVFRPSDUHGZLWKQRQSDUWLFLSDQWV LQYLWDWLRQV S ZKLOH WKH LQFLGHQFH RIVWDJH ,,, FDQFHU ZDVORZHUDQGVWDJH,9FDQFHUORZHUSIRUERWK7KHUDWHRI PDVWHFWRP\ZDVKLJKHULQSDUWLFLSDQWVWKDQLQQRQSDUWLFLSDQWVFRPSDUHGZLWK LQYLWHGQRQSDUWLFLSDQWV &RQFOXVLRQ3DUWLFLSDQWVLQDQRUJDQLVHGEUHDVWFDQFHUVFUHHQLQJSURJUDPUXQD KLJKHUULVNRIVWDJHDQG,EUHDVWFDQFHUDQGORZHUULVNRIDGYDQFHGEUHDVWFDQFHU FRPSDUHGZLWKLQYLWHGQRQSDUWLFLSDQWV(IIRUWVWRVXSSRUWHDUO\GHWHFWLRQRIEUHDVW FDQFHULQQRQSDUWLFLSDQWVLQRUJDQLVHGVFUHHQLQJDUHQHHGHG % 3URSRUWLRQDOLQFLGHQFHDQGUHYLHZRI7VFUHHQGHWHFWHG FDUFLQRPDVDQHZPHDVXUHRIGLDJQRVWLFDFFXUDF\" 6&LDWWR '%HUQDUGL03HOOHJULQL) &DXPR$)ULJHULR0*HQWLOLQL 7UHQWR,79HURQD,77XULQ,7VWHIDQRFLDWWR#JPDLOFRP 3XUSRVH/DUJHVL]H7VFUHHQGHWHFWHGWKDWFDUFLQRPDVPLJKWEHDVVXPHG DVVFUHHQLQJIDLOXUHVDQGPRQLWRUHGIRUTXDOLW\FRQWURODVLQWHUYDOFDQFHUV,& 0HWKRGVDQG0DWHULDOV%DVHG RQ7FDQFHUV VFUHHQ GHWHFWHG GXULQJ DW7UHQWRVFUHHQLQJSURJUDPPHZHDDVVHVVHGWKHSURSRUWLRQDOLQFLGHQFH DVFRPSDUHGWRSUHVFUHHQLQJLQFLGHQFHDQGEUHYLHZHGSUHYLRXV VFUHHQLQJWHVWVSUHFHGLQJGLDJQRVLV%OLQGUHYLHZRIÀOPVPL[HGWRQHJDWLYH FRQWUROVZDVSHUIRUPHGE\DSDQHORIWKUHHH[WHUQDOUHYLHZHUVVFUHHQLQJHUURUV EHLQJGHÀQHGDFFRUGLQJWRPDMRULW\FDQFHUVVHHQE\DWOHDVWWZRUHYLHZHUV$ VXEVHWRI,&GLDJQRVHGGXULQJZDVLQFOXGHGLQWKHUHYLHZVHW 5HVXOWV 3URSRUWLRQDO LQFLGHQFH ZRPHQ \HDU ZDV RE VHUYHGH[SHFWHGFRQÀGHQFHLQWHUYDOKLJKHUDVFRPSDUHGWR UHFHQWO\GHWHUPLQHGIRU,&LQWKHVDPHFHQWUH5HYLHZRI 7,&DQGFRQWUROVFODVVLÀHGVFUHHQLQJHUURUVDPRQJ,& DQGDPRQJ7S 'LIIHUHQFHVLQGHWHF WLRQDQGUHFDOOUDWHREVHUYHGDPRQJUHYLHZHUVZHUHQRWVWDWLVWLFDOO\VLJQLÀFDQW &RQFOXVLRQ$VVHVVLQJ7 SURSRUWLRQDO LQFLGHQFH DQG UHYLHZ LV IHDVLEOH DVD PRGDOLW\IRUVFUHHQLQJVXUYHLOODQFH7DVVHVVPHQWLVHDVLHUDVFRPSDUHGWR,& EXWQRUHIHUHQFHVWDQGDUGVDUHDYDLODEOH\HWSDUWLFXODUO\IRUSURSRUWLRQDOLQFLGHQFH ZKLFKZDVKLJKHUDVFRPSDUHGWR,&&RPSDUDEOHUHYLHZÀQGLQJVEHWZHHQ7 DQG,&FDVHVPLJKWVXJJHVWWRDGRSWWKH(&VWDQGDUGDOVRIRU7)XUWKHU VWXGLHVDUHQHHGHGWRFRQÀUPWKHSUHVHQWUHVXOWV % ,QFLGHQFHDQGUHYLHZRILQWHUYDOFDQFHUVLQDFRPPXQLW\ELDQQXDO PDPPRJUDSKLFVFUHHQLQJSURJUDPPH /$&DUERQDUR %%DEDHL3DVNHK*%UDPELOOD3 0DOHUED /0HQLFDJOL*9DGDODҋ/)DQWLQL6&LDWWR) 6DUGDQHOOL 6DQ'RQDWR0LODQHVH,75R]]DQR,79L]]ROR3UHGDELVVL,7/DFFKLDUHOOD,7 3DGXD,7OXFDFDUERQDUR#JPDLOFRP 3XUSRVH7 RDVVHVVWKHSHUIRUPDQFHRIDQ,WDOLDQPDPPRJUDSKLFVFUHHQLQJSUR JUDPPHLQWHUPVRILQWHUYDOFDQFHUV,&VREVHUYHGIURPWR 0HWKRGVDQG0DWHULDOV,&VZHUHLGHQWLÀHGE\PDWFKLQJWKHVFUHHQLQJDUFKLYHV ZLWK ORFDO FDQFHU UHJLVWU\ SDWKRORJ\ DUFKLYHV DQG KRVSLWDO GLVFKDUJH UHFRUGV PDPPRJUDSK\ UHJLRQ EHWZHHQ -DQXDU\ DQG$XJXVW 'XULQJ \HDU IROORZXS EUHDVW LPDJLQJ UHSRUWV VXUJLFDO UHSRUWV DQG SDWKRORJ\ UHVXOWV ZHUH FROOHFWHGRIDOOVFUHHQGHWHFWHGFDQFHUVDQGLQWHUYDOFDQFHUV6FUHHQLQJRXWFRPH SDUDPHWHUVZHUHFDOFXODWHGIRUHDFKVFUHHQLQJFRXSOH 5HVXOWV$PLQLPXPRIVFUHHQVIRUHDFKSDLURIUDGLRORJLVWVKDGEHHQUHDG E\XQLTXHFRPELQDWLRQVRIWZRVFUHHQLQJUDGLRORJLVWVWRWDOOLQJVFUHHQV 7KHQXPEHURIVFUHHQLQJPDPPRJUDPVSHUSDLURIUDGLRORJLVWVYDULHGIURP VFUHHQV WR VFUHHQV %UHDVW FDQFHU LQFLGHQFH GLG QRW GLIIHU VLJQLÀFDQWO\ DPRQJ WKHVH FRXSOHV DQG UDQJHG IURP &, WR &, SHUVFUHHQV7KHUHIHUUDOUDWHDPRQJFRXSOHVUDQJHGIURP &,WR&,ZKHUHDVWKHVHQVLWLYLW\IRUEUHDVW FDQFHUGHWHFWLRQDQGWKHSRVLWLYHSUHGLFWLYHYDOXHRIUHIHUUDOUDQJHGIURP &,WR&,DQGIURP&, WR&,UHVSHFWLYHO\ &RQFOXVLRQ 6FUHHQLQJ RXWFRPH YDULHG VLJQLÀFDQWO\ DPRQJ SDLUV RI VFUHHQLQJ UDGLRORJLVWV:HDGYLVHDFRQWLQXRXVPRQLWRULQJRIVFUHHQLQJRXWFRPHSDUDPHWHUV IRUHDFKVFUHHQLQJFRXSOHWKDWSDUWLFLSDWHVDWVFUHHQLQJPDPPRJUDSK\5HJXODU IHHGEDFNRIWKLVRXWFRPHWRHDFKFRXSOHPD\DYRLGVFUHHQLQJRIZRPHQE\SDLUV RIUDGLRORJLVWVZLWKVXERSWLPDOVFUHHQLQJSHUIRUPDQFH % 7DLORUHGEUHDVWFDQFHUVFUHHQLQJSURJUDPLQHUVUHVXOWVIURP DQ,WDOLDQVLQJOHFHQWUHSLORWVWXG\ (6FKLDQL3 3DQL]]D05RGLJKLHUR,)HGHOH(9HQWXULQL&/RVLR ) 'H&REHOOL$'HO0DVFKLR0LODQ,7VFKLDQLHOHQD#KVULW 3XUSRVH7KHDLPRIRXUVWXG\ZDVWRDVVHVVWKHIHDVLELOLW\RIDVFUHHQLQJSURJUDP RQHUVXVXDOO\HUVDUHQRWLQFOXGHGLQVFUHHQLQJSURJUDPGXHWRWKH ORZVHQVLWLYLW\DQGQHJDWLYHSUHGLFWLYHYDOXHRIPDPPRJUDSK\LQWKLVSRSXODWLRQ 2XULQQRYDWLYHVFUHHQLQJSURJUDPLVWDLORUHGRQLQGLYLGXDOULVNSURÀOHDQGEUHDVW WLVVXHGHQVLW\DQGLPSOHPHQWVPDPPRJUDSK\ZLWKIXUWKHUDVVHVVPHQW8605, XVXDOO\QRWLQFOXGHGLQHYDOXDWLRQRIÀUVWOHYHO 0HWKRGVDQG0DWHULDOV)URP6HSWHPEHUWR0D\ZHLQYLWHG ZRPHQIURPWKHWRZQRI6HJUDWH0LODQ,WDO\/RZGRVHSKRWRQFRXQWLQJGLJLWDO PDPPRJUDSK\6HFWUDZDVSHUIRUPHGLQYLHZV&&0/27KH86DQG05, ZHUHSHUIRUPHGZKHQQHHGHG 5HVXOWVZRPHQZHUHHQUROOHGSDUWLFLSDWLRQUDWH7KHDYHUDJH JODQGXODUGRVHZDVZLWKDQDYHUDJHEUHDVWWKLFNQHVVRIPP7KHUHFDOO UDWHIRU86ZDV7KHUHFDOOUDWHIRU05,ZDV7KH86 HDUO\ UHFDOO UDWH ZDV 7KH FDQFHU GHWHFWLRQ UDWH ZDV Æ FDVHV (LJKWFDQFHUVZHUHGLDJQRVHGZLWKPDPPRJUDSK\DQGWZRZHUHGHWHFWDEOHRQO\ DW8686,&'586IDOVHSRVLWLYHV &RQFOXVLRQ3UHOLPLQDU\UHVXOWVGHPRQVWUDWHGDQHOHYDWHGEUHDVWFDQFHUGHWHFWLRQ UDWHÆLQZRPHQHUVKLJKHUWKDQWKHLQFLGHQFHUHSRUWHGE\WKH,WDOLDQ &DQFHU5HJLVWU\7KH86H[DPLQDWLRQSHUIRUPHGIRUKLJKEUHDVWWLVVXH GHQVLW\DOORZVWRGHWHFWRWKHUWZRFDVHVRIFDQFHU % 3KHQRW\SLFFKDUDFWHULVWLFVRILQWHUYDOEUHDVWFDQFHUVGLDJQRVHGLQD SRSXODWLRQEDVHGVFUHHQLQJSURJUDPLQ&DWDORQLD6SDLQ&RUUHODWLRQ ZLWKUDGLRORJLFDOÀQGLQJV '/HRQ*XHYDUD $*XPD0DUWLQH]/3ULHWR$OYDUH]52UWHJD0DUWLQH] $9DOGLYLHOVR&9LGDO/DQFLV0*DUFLD0DUWLQH]%DUFHORQD(6 +RVSLWDOHWGH/OREUHJDW(6 3XUSRVH7 RDQDO\]HLIWKHUHDUHSKHQRW\SLFGLIIHUHQFHVEHWZHHQSUHYDOHQWLQFL GHQWDQGLQWHUYDOFDVHVRIEUHDVWFDQFHUVGLDJQRVHGLQDEUHDVWFDQFHUVFUHHQLQJ SURJUDPLQ&DWDORQLD6SDLQ7 R&RUUHODWHWKHGDWDZLWKWKHUDGLRJUDSKLFSUHVHQWD WLRQRIWKHVHWXPRUV 0HWKRGVDQG0DWHULDOV:HSHUIRUPHGDUHWURVSHFWLYHVWXG\RIDOOEUHDVWFDQFHUV GLDJQRVHGLQWKHVFUHHQLQJSURJUDPEHWZHHQDQDO\]LQJKLVWRORJLFDO W\SHSURJQRVWLFIDFWRUVDQGUDGLRORJLFDOÀQGLQJV6XEJURXSVZHUHPDGHRISUHYD OHQWLQFLGHQWRUHDUO\LQWHUYDOFDVHV 5HVXOWV:HKDYHVWXGLHGFDVHVLQYDVLYHFDUFLQRPDVDQGLQWUDGXFWDO FDUFLQRPDV,QWHUYDOEUHDVWFDQFHUFDVHVZHUHLQYDVLYHFDUFLQRPDVLQDQG LQVLWX$QDO\VLVRIUDGLRORJLFDOÀQGLQJVDQGSURJQRVWLFIDFWRUVZDVDFKLHYHG LQFDQFHUFDVHV7KHWULSOHQHJDWLYHSKHQRW\SHZDVPRUHIUHTXHQWLQLQWHUYDO LQYDVLYHFDUFLQRPDVFDVHVWKDQLQFDQFHUVGHWHFWHGDWVFUHHQLQJ 7KLVGLIIHUHQFHZDVVWDWLVWLFDOO\VLJQLÀFDQWS 3KHQRW\SLFW\SH+HU DQGOXPLQDO $WXPRUVZHUHPRUHIUHTXHQWLQEUHDVWFDQFHUFDVHVGHWHFWHG LQVFUHHQLQJFRPSDUHGWRLQWHUYDOFDVHVDQGUHVSHFWLYHO\DOWKRXJK QRWVWDWLVWLFDOO\VLJQLÀFDQW5DGLRORJLFDOO\WULSOHQHJDWLYHWXPRUVZHUHPRUHRIWHQ 6FLHQWLILF6HVVLRQ 6 &$' ( ) *+% (XURSHDQ&RQJUHVVRI 5DGLRORJ\ % 6WDQGDORQHFRPSXWHUDLGHGGHWHFWLRQFRPSDUHGWRKXPDQUHDGHUV IRUWKHGHWHFWLRQRIEUHDVWFDQFHULQVFUHHQLQJPDPPRJUDPV 1.DUVVHPHLMHU 5+XSVH06DPXOVNL0/REEHV$GHQ+HHWHQ 1LMPHJHQ1/0DDVWULFKW1/QNDUVVHPHLMHU#UDGXPFQQO 3XUSRVH :H GHYHORSHG D FRPSXWHUDLGHG GHWHFWLRQ &$' V\VWHP DLPHG DW GHFLVLRQVXSSRUWIRUGHWHFWLRQRIPDOLJQDQWPDVVHVLQVFUHHQLQJPDPPRJUDPV,Q FRQWUDVWWRFXUUHQW&$'V\VWHPVZKLFKKDYHPDQ\IDOVHSRVLWLYHVGXHWRWKHLUIRFXV RQKLJKVHQVLWLYLW\WKLVV\VWHPLVDLPHGWRRSHUDWHDWKLJKVSHFLÀFLW\FRPSDUDEOH WRWKDWRIUDGLRORJLVW7KHSXUSRVHRIWKLVVWXG\ZDVWRFRPSDUHWKHSHUIRUPDQFH RIWKLV&$'V\VWHPWRWKDWRIUDGLRORJLVWVDQGUHVLGHQWV 0HWKRGVDQG0DWHULDOV,QDUHWURVSHFWLYHVWXG\HLJKWFHUWLÀHGVFUHHQLQJUDGL RORJLVWVDQGWKUHHUHVLGHQWVZLWKPDPPRJUDSK\H[SHULHQFHUHDGVFUHHQLQJ PDPPRJUDPV ZLWKRXW WKH XVH RI &$' &DVHV LQFOXGHG VFUHHQGHWHFWHG FDQFHUVPLVVHGFDQFHUVIDOVHSRVLWLYHVIURPVFUHHQLQJDQGQRUPDOV 0LFURFDOFLÀFDWLRQFDVHVZHUHH[FOXGHG5HDGHUVDQG&$'ZHUHFRPSDUHGXVLQJ ORFDOLVDWLRQ52&/52&DQDO\VLVE\FRPSXWLQJWKHPHDQWUXHSRVLWLYHIUDFWLRQ 073)DWDIDOVHSRVLWLYHIUDFWLRQ)3)OHVVWKDQ 5HVXOWV &$' SHUIRUPDQFH 073) ZDV VLPLODU WR WKDW RI WKH UHVLGHQWV 073) EXW VWLOO VLJQLÀFDQWO\ EHORZ WKH SHUIRUPDQFH RI WKH UDGLRORJLVWV 073) +RZHYHUDWYHU\KLJKVSHFLÀFLW\)3)DQGIRUWKHVXEVHW RI FDVHV PLVVHG LQ VFUHHQLQJ &$' VWDQGDORQH SHUIRUPDQFH ZDV VLPLODU WR WKDW RIWKHUDGLRORJLVWV &RQFOXVLRQ7KHSHUIRUPDQFHRIDQRYHO&$'V\VWHPDLPHGDWGHFLVLRQVXSSRUW LV DSSURDFKLQJ WKH OHYHO RI SHUIRUPDQFH RI H[SHULHQFHG KXPDQ UHDGHUV7KHVH UHVXOWVVKRZWKHSRWHQWLDORI&$'WREHXVHGDVVHFRQGRUWKLUGUHDGHULQEUHDVW FDQFHUVFUHHQLQJ % 5HWURVSHFWLYHFRPSDULVRQRIWKHDFFXUDF\RIWZRGLIIHUHQWFRPSXWHU DLGHGGHWHFWLRQV\VWHPVIRUGHWHFWLQJPDOLJQDQWOHVLRQVRQPDPPRJUDSK\ 0/REEHV..H\PHXOHQ06PLGW5*%HHWV7 DQ-(:LOGEHUJHU &%RHWHV0DDVWULFKW1/ 3XUSRVH7 RUHWURVSHFWLYHO\FRPSDUHWKHDFFXUDF\RIWZRFRPSXWHUDLGHGGHWHF WLRQ&$'V\VWHPV6HFRQG/RRNYHUVXV$FFX'HWHFW*DOLOHRIRUWKHGHWHFWLRQRI PDOLJQDQWEUHDVWOHVLRQVRQIXOOÀHOGGLJLWDOPDPPRJUDPV 0HWKRGV DQG 0DWHULDOV 'LJLWDO PDPPRJUDPV RI SDWLHQWV ZHUH DQDO\VHG SDWLHQWVZLWKEUHDVWFDQFHUQHJDWLYHFDVHV3RVLWLYHFDVHVFRQVLVWHGRI PDVVHVFDOFLÀFDWLRQVDQGPDVVHVSOXVFDOFLÀFDWLRQV(DFKVHWRIFDVHV ZDVUHDGE\ERWK&$'V\VWHPVDQGWUXHSRVLWLYHIUDFWLRQ73)IRUERWKV\VWHPV DQGSHULPDJHFDVHDQGWRWDOFDQFHUVZDVDVVHVVHG2SHUDWLQJSRLQWVIRUERWK V\VWHPVZDVVHWDWFRPSDUDEOHIDOVHSRVLWLYHUDWHVSHULPDJHDQGFDVH2QHVLGHG H[DFW0F1HPDUҋVWHVWVZHUHXVHGWRDVVHVVVWDWLVWLFDOVLJQLÀFDQFHRIWKHUHVXOWV 5HVXOWV :KHQ FRPSDUHG WR 6HFRQG/RRN$FFX'HWHFW *DOLOHR VLJQLÀFDQWO\ LQ FUHDVHG73)SHULPDJHIRUPDVVHVLQFUHDVHRIWRS DQG FDOFLÀFDWLRQVLQFUHDVHRIWRS 3HUFDVH$FFX'HWHFW*DOLOHR GLGQRWVLJQLÀFDQWO\LQFUHDVH73)IRUPDVVHVDQGFDOFLÀFDWLRQV $FFX'HWHFW*DOLOHR DFKLHYHGKLJKHU73)IRUDOOFDQFHUVSHULPDJHLQFUHDVHWRWRSHU FDVHLQFUHDVHWRWR0RVWLQWHUHVWLQJO\$FFX'HWHFW*DOLOHRXVLQJD QHZYRWLQJPHWKRGRORJ\DOJRULWKPKDGDVLJQLÀFDQWSHUIRUPDQFHLPSURYHPHQWLQ GHWHFWLQJPDVVHVRQH[WUHPHO\GHQVHEUHDVWVRYHU6HFRQG/RRNLQFUHDVLQJ73) ZLWKWRS &RQFOXVLRQ$FFX'HWHFW*DOLOHRVKRZHGVLJQLÀFDQWO\EHWWHURYHUDOOSHUIRUPDQFH WKDQ6HFRQG/RRNLQGHWHFWLQJPDVVHVPLFURFDOFLÀFDWLRQVDQGDOOFDQFHUW\SHV HYHQLQH[WUHPHO\GHQVHEUHDVWV 3URSRUWLRQDOLQFLGHQFHZDVGHWHUPLQHGDFFRUGLQJWREUHDVWFDQFHUVH[SHFWHGLQ WKHDEVHQFHRIVFUHHQLQJHVWLPDWHGRQWKHEDVLVRISDWLHQWV\HDUDWULVNDQGDJH VSHFLÀFLQFLGHQFH7KUHHRIIVLWHKLJKH[SHULHQFHGUHYLHZHUVEOLQGO\HYDOXDWHGWKH VFUHHQLQJPDPPRJUDPVSULRUWRWKHGLDJQRVWLFRQHVUDQGRPO\PL[HGZLWKDJH DQGEUHDVWGHQVLW\PDWFKHGQHJDWLYHFRQWUROVZLWKDUDWLR 5HVXOWVÀUVWOHYHOPDPPRJUDPVLQFHQWHUVZHUHDFTXLUHGWKHPHDQ UHFDOOUDWHZDVDWÀUVWVFUHHQLQJDQGDWUHSHDWVFUHHQLQJ$WRWDORI VFUHHQGHWHFWHGFDQFHUVDQG,&VZHUHGLDJQRVHG7KH,&SURSRUWLRQDOLQFL GHQFHZDVIRUWKHÀUVW\HDUIRUWKHVHFRQG\HDUDQG IRUWKHWZR\HDULQWHUYDO2I&,PDPPRJUDPVDWRWDORIRI WKHPUDQGRPO\PL[HGZLWKQHJDWLYHFRQWUROVZHUHUHYLHZHG ZHUHUHFDOOHGE\RUUHYLHZHUVHUURUVZHUHUHFDOOHG E\RQO\UHYLHZHUPLQLPDOVLJQVDQGZHUHQRWUHFDOOHGRFFXOW &RQFOXVLRQ2XUVFUHHQLQJSURJUDPPHFDQEHFRQVLGHUHGZLWKLQ(&VWDQGDUGV IRUZKDWFRQFHUQV,&DQDO\VLV % 3UHVRUWLQJE\&$'DFFRUGLQJWROHVLRQW\SHLQFUHDVLQJWKHUHDGHUҋV DZDUHQHVVRIPDPPRJUDSKLFOHVLRQVLQDVFUHHQLQJHQYLURQPHQW 5/HGHUPDQ,/HLFKWHU0*UHHQEHUJ-HUXVDOHP,/L]KDN#KDGDVVDKRUJLO 3XUSRVH7 RH[SORUHWKHFDSDELOLW\RI&$'UXQLQWKHEDFNJURXQGWRDXWRPDWLFDOO\ SUHVRUWSULRULWLVHGVXEJURXSVZLWKKLJKHUSUHYDOHQFHRIHLWKHUPDOLJQDQWPDVVHV RUFOXVWHUV.QRZLQJWKDWSUHYDOHQFHLVLQFUHDVHGIRUHLWKHUOHVLRQW\SHUHDGHUV VKRXOGUHYLHZWKHWDJJHGFDVHVZLWKKLJKHUVXVSLFLRQ 0HWKRGVDQG0DWHULDOV6LQFHEUHDVWFDQFHUVDUHXVXDOO\YLVLEOHLQERWKYLHZV &$'FDQSUHVRUWFDVHVZLWKPDWFKLQJ&$'PDUNVRIWKHVDPHW\SHLQERWKYLHZV FUHDWLQJ SULRULWLVHG VXEJURXSV ZLWK LQFUHDVHG SUHYDOHQFH RI PDOLJQDQW FOXVWHUV RU PDVVHV$OWKRXJK IDOVH PDUNV WHQG WR RFFXU UDQGRPO\ WKHVH VXEJURXSV ZLOO DOVR LQFOXGH QRUPDO FDVHV VLQFH PDWFKLQJ IDOVH PDUNV PD\ DOVREH JHQHUDWHG LQERWKYLHZVFRLQFLGHQWO\))'0FDVHVFDQFHUVPDVVHVFXOOHG UHWURVSHFWLYHO\IURPIDFLOLWLHVZHUHUXQZLWKDSURWRW\SH&$'DOJRULWKP6LHPHQV DQGSUHVRUWHGE\PDWFKLQJPDUNVDFFRUGLQJWROHVLRQW\SHWRH[SORUHWKHFDQFHU SUHYDOHQFHLQWKHSULRULWLVHGVXEJURXSV 5HVXOWV2IQRUPDOFDVHVFDVHVKDGFRLQFLGHQWDOO\PDWFKLQJPDVV PDUNVDQGPDWFKLQJFOXVWHUPDUNV&RQYHUVHO\RIWKHPDOLJQDQWFDVHV KDGPDWFKLQJPDVVPDUNVDQGKDGPDWFKLQJFOXVWHUPDUNV ,QWKHVXEJURXSZLWKPDWFKLQJPDVVPDUNVFDQFHUSUHYDOHQFHWKXVLQFUHDVHG WLPHVIURPWRRIZKLOHIRUFOXVWHUVFDQFHUSUHYDOHQFH LQFUHDVHGWLPHVIURPWRRI &RQFOXVLRQ 3UHVRUWLQJ E\ PDWFKLQJ &$' PDUNV VXEVWDQWLDOO\ LQFUHDVHV WKH EUHDVWFDQFHUSUHYDOHQFHLQWKHSULRULWLVHGVXEJURXSVRIFDVHVHVSHFLDOO\LQWKH FOXVWHU VXEJURXS WKHUHE\ IRFXVLQJ WKH UHDGHUVҋ DWWHQWLRQ RQ FDVHV ZKLFK DUH PRUHVXVSLFLRXV % &DQ&$'EHXVHGDVDSUHOLPLQDU\UHDGHULQVFUHHQLQJPDPPRJUDSK\" 5/HGHUPDQ,/HLFKWHU0*UHHQEHUJ-HUXVDOHP,/L]KDN#KDGDVVDKRUJLO 3XUSRVH 7 R H[SORUH WKH SRWHQWLDO RI &$' DV D SUHOLPLQDU\ UHDGHU UXQ LQW K H EDFNJURXQGLQVFUHHQLQJPDPPRJUDSK\WRUHGXFHUHDGLQJWLPHE\FUHDWLQJIRU WKHUDGLRORJLVWVXEVHWVRIQRUPDOFDVHVDQGRIFDVHVFRQVLGHUHGVXVSLFLRXVIRUD VSHFLÀFOHVLRQW\SH 0HWKRGV DQG 0DWHULDOV ))'0 FDVHV ZHUH UXQ ZLWK D SURWRW\SH &$' GHYLFH 6LHPHQV ZLWK VHSDUDWH DOJRULWKPV IRU GHWHFWLQJ PDVVHV DQG FOXVWHUV 7KH PDOLJQDQW FDVHV LQFOXGHG PDVVHV FOXVWHUV DQG PDVVHV ZLWK PLFURFDOFLÀFDWLRQV :KHQ XVLQJ &$' DV D SUHOLPLQDU\ UHDGHU WKH DOJRULWKP LV GHVLJQHGWRFUHDWHVXEVHWVRIFDVHVVXVSLFLRXVIRUHLWKHUPDVVHVRUFOXVWHUVGL UHFWLQJUDGLRORJLVWVWRVHOHFWWKHDSSURSULDWHYLVXDOSURFHVVIRUÀQGLQJWKHVSHFLÀF OHVLRQW\SH7KHUHPDLQLQJFDVHVZLWKQRPDUNVIRUWKDWOHVLRQW\SHE\SDVVUHYLHZ 5HVXOWV&$'IRXQGRQO\RIWKHQRUPDOFDVHVWREHVXVSLFLRXVIRUFOXVWHUV DQGWREHVXVSLFLRXVIRUPDVVHV)RUPDOLJQDQWFDVHVZLWKFOXVWHUVWKH DOJRULWKPVXVSHFWHGFOXVWHUVLQIRUPDOLJQDQWFDVHVZLWKPDVVHV ZHUHVXVSLFLRXVIRUPDVVHVDQGIRUFDVHVRIPDVVHVZLWKFDOFLÀFDWLRQV ZHUHVXVSLFLRXVIRUHLWKHUOHVLRQW\SHRUERWK &RQFOXVLRQ &$' DV D SUHOLPLQDU\ UHDGHU LQ VFUHHQLQJ PDPPRJUDSK\ FRXOG VXEVWDQWLDOO\UHGXFHWKHZRUNORDGE\QHDUO\KDOIIRUHLWKHUOHVLRQW\SH8VLQJ&$' DVDSUHOLPLQDU\UHDGHUIRUFOXVWHUVPLJKWZDUUDQWFRQVLGHUDWLRQVLQFHRQO\DERXW RI PDVVHV ZLWK FDOFLÀFDWLRQV DQG RI FOXVWHUV ZRXOG EH PLVVHG 5HFHQW DOJRULWKPPRGLÀFDWLRQVWRLPSURYHGHWHFWLRQRIPDVVHVDQGFOXVWHUVVKRXOGPDNH WKLVDSSURDFKSUDFWLFDOIRUPDVVHVDVZHOO 6FLHQWLILF6HVVLRQ $ 6&'()*+%(XURSHDQ&RQJUHVVRI 5DGLRORJ\ 6DWXUGD\ % $UHSDQFUHDWLFFDOFLÀFDWLRQVSUHGLFWLYHRILPSDLUPHQWRISDQFUHDWLF H[RFULQHIXQFWLRQ"$UHWURVSHFWLYHVWXG\ZLWK605&3DQG DEGRPLQDO&7LQSDWLHQWVZLWKNQRZQRUVXVSHFWHGSDQFUHDWLFGLVHDVH *5HVWDLQR00LVVHUH''LVWHIDQR5&DVDOH$3LHUUR*6DOOXVWLR &DPSREDVVR,75RPH,7JHQQDUHV#KRWPDLOFRP 3XUSRVH7 RHVWDEOLVKFRUUHODWLRQEHWZHHQSDQFUHDWLFFDOFLÀFDWLRQVGHWHFWHGE\&7 DQGSDQFUHDWLFH[RFULQHIXQFWLRQHYDOXDWHGZLWK605&3LQVXEMHFWVZLWKNQRZQ RUVXVSHFWHGSDQFUHDWLFGLVHDVH 0HWKRGVDQG0DWHULDOVFRQVHFXWLYHSDWLHQWV0) PHDQDJH \RXQGHUZHQW605&3DQGXSSHUDEGRPLQDOKHOLFDO&7IRUVXVSHFWHGRUNQRZQ SDQFUHDWLFGLVHDVH605&3ZHUHHYDOXDWHGIRUWKHSUHVHQFHDQGJUDGHRIFKURQLF SDQFUHDWLWLVDFFRUGLQJWR&DPEULGJHFODVVLÀFDWLRQDQGIRUDVVHVVPHQWRISDQFUHDWLF H[RFULQHUHVHUYHDFFRUGLQJWR0DWRVFODVVLÀFDWLRQ&7H[DPLQDWLRQVZHUHHYDOX DWHGIRUWKHSUHVHQFHRUDEVHQFHRISDQFUHDWLFFDOFLÀFDWLRQV7KHÀQGLQJVZHUH FRPSDUHGZLWK)LVKHU VH[DFWWHVW 5HVXOWV&DPEULGJHVFRUHZDVLQSDWLHQWVLQSDWLHQWVLQLQ DQGLQSDWLHQWV0DWRVVFRUHZDVLQFDVHVLQFDVHVLQVXEMHFWV DQGLQSDWLHQW3DQFUHDWLFFDOFLÀFDWLRQVZHUHGHWHFWHGE\&7LQSDWLHQWV 7KHUHZDVDVLJQLÀFDQWFRUUHODWLRQEHWZHHQSUHYDOHQFHRIFDOFLÀFDWLRQV DQGJUDGHRIFKURQLFSDQFUHDWLWLVSDQGSDQFUHDWLFH[RFULQHUHVHUYH S&DOFLÀFDWLRQVZHUHREVHUYHGLQSDWLHQWVZLWKQRUPDO SDQFUHDWLFH[RFULQHUHVHUYH0DWRVYHUVXVSDWLHQWVZLWKLPSDLUHG UHVHUYH0DWRVZLWKVLJQLÀFDQWGLIIHUHQFHSHYHQDIWHUDGMXVWLQJ IRUVH[DQGDJH$PRQJSDWLHQWVZLWKPLOGDQGVHYHUHFKURQLFSDQFUHDWLWLV&DP EULGJHVFRUHDQGWKHSUHVHQFHRISDQFUHDWLFFDOFLÀFDWLRQVZDVDVLJQLÀFDQW LQGLFDWRURILPSDLUHGH[RFULQHIXQFWLRQS DQGUHVSHFWLYHO\S &RQFOXVLRQ8QOLNHSUHYLRXVO\SXEOLVKHGSDSHUVRXUVWXG\VKRZVWKDWSDQFUHDWLF FDOFLÀFDWLRQV DUH LQGHSHQGHQW SUHGLFWRUV RI LPSDLUPHQW RI SDQFUHDWLF H[RFULQH IXQFWLRQ % &RPSDUDWLYHSHUIRUPDQFHRI&7DQG05,LQSURJQRVWLFDWLRQRIDFXWH SDQFUHDWLWLVFRUUHODWLRQZLWKFOLQLFDORXWFRPH .5DKXO.0DQGHHS%'HHSDN.*5DMHVK.1DYHHQ%$VKLVK 66XULQGHU1.KDQGHOZDO&KDQGLJDUK,1UDKXO PRQD#UHGLIIPDLOFRP 3XUSRVH7 R FRPSDUH WKH GLDJQRVWLF DQG SURJQRVWLF SHUIRUPDQFH RI FRPSXWHG WRPRJUDSK\&7DQGPDJQHWLFUHVRQDQFHLPDJLQJ05,LQDFXWHSDQFUHDWLWLV 0HWKRGV DQG 0DWHULDOV ,Q WKLV LQVWLWXWLRQ UHYLHZ ERDUG DSSURYHG SURVSHFWLYH VWXG\ SDWLHQWV ZLWK FOLQLFDO VXVSLFLRQ RI DFXWH SDQFUHDWLWLV ZHUH HQUROOHG DIWHU WDNLQJLQIRUPHGFRQVHQW$OOSDWLHQWVXQGHUZHQWDFRQWUDVWHQKDQFHG&7&(&7 DQGFRQWUDVWHQKDQFHG05,&(05,$&7VHYHULW\LQGH[&76,DQG05VHYHU LW\LQGH[056,ZDVDVVLJQHGLQDOOFDVHVE\WZRGLIIHUHQWUDGLRORJLVWVEDVHGRQ %DOWKD]DUVFRULQJV\VWHP7KH&76,DQG056,ZHUHFRPSDUHGZLWKHDFKRWKHU DQGZLWKYDULRXVFOLQLFDORXWFRPHSDUDPHWHUV 5HVXOWV SDWLHQWV PDOHIHPDOH PHDQ DJH \HDUV DJH UDQJH \HDUVZHUHHQUROOHGIURP-DQXDU\WR$SULO7KHUHZDVH[FHO OHQWLQWHUREVHUYHUDJUHHPHQWIRUDVVHVVLQJ&76,NDSSDYDOXHDQGJRRG LQWHUREVHUYHUDJUHHPHQWIRU056,NDSSD%RWK&76,DQG056,VKRZHG VWDWLVWLFDOO\ VLJQLÀFDQW FRUUHODWLRQ ZLWK WKH QHHG IRU SHUFXWDQHRXV LQWHUYHQWLRQ GHYHORSPHQWRILQIHFWLRQRURUJDQIDLOXUHDQGGXUDWLRQRIKRVSLWDOVWD\056,DOVR VKRZHGDVWDWLVWLFDOO\VLJQLÀFDQWFRUUHODWLRQZLWKPRUWDOLW\3DWLHQWVZLWKVLJQVRI SDQFUHDWLFSHULSDQFUHDWLFKDHPRUUKDJHRQ05,VKRZHGDVWDWLVWLFDOO\VLJQLÀFDQW FRUUHODWLRQ ZLWK DOO SDUDPHWHUV RI FOLQLFDO RXWFRPH 3DQFUHDWLF GXFW GLVUXSWLRQ FRXOGRQO\EHGLDJQRVHGRQ05KRZHYHUSRRULPDJHTXDOLW\PRWLRQDUWHIDFWV ZDVVHHQPRUHRIWHQRQ05, &RQFOXVLRQ05,DQG&7DUHHTXDOO\HIÀFLHQWPRGDOLWLHVIRUDVVHVVLQJVHYHULW\ DQGSUHGLFWLQJFRPSOLFDWLRQVRIDFXWHSDQFUHDWLWLV05,LVVXSHULRULQGHPRQVWUDWLQJ GXFWDOSDWKRORJ\DQGKDHPRUUKDJH % &7DVVHVVPHQWRIVDUFRSHQLDLQSDWLHQWVZLWKSDQFUHDWLFFDQFHUDQG FKURQLFSDQFUHDWLWLV (%XODQRYD9/\DGRY(0HUVKLQD9(6LQLWV\Q0RVFRZ58 3XUSRVH$V PHWDEROLF GLVRUGHUV VXFK DV FDFKH[LD DQG VDUFRSHQLD PXVFOH ZDVWLQJDUHFRPPRQFRQGLWLRQVLQSDWLHQWVZLWKSDQFUHDWLFFDQFHUDQGFKURQLF SDQFUHDWLWLVZHVWXGLHGWKHUROHRI&7LQDVVHVVLQJVDUFRSHQLDLQWKHVHWZRJURXSV RISDWLHQWV 0HWKRGVDQG0DWHULDOV:HHYDOXDWHG&7LPDJHVRISDWLHQWVZLWKSDQFUHDWLF FDQFHUDQGFKURQLFSDQFUHDWLWLVZKLFKXQGHUZHQWRSHUDWLYHWUHDWPHQWLQ 5RRP,. $EGRPLQDO9LVFHUD 66 3DQFUHDV 0RGHUDWRUV .&RHQHJUDFKWV%UXJHV%( 53R]]L0XFHOOL9HURQD,7 % 'LIIXVLRQZHLJKWHG05,RISDQFUHDVFDQFHUFRPSDULVRQRIIUHH EUHDWKLQJUHVSLUDWRU\WULJJHUHGDQGEUHDWKKROGVHTXHQFHV 1.DUWDOLV//RL]RX1(GVERUJ56HJHUVYDUG1$OELLQ6WRFNKROP6( QLNRODRVNDUWDOLV#PHFRP 3XUSRVH7 RFRPSDUHUHVSLUDWRU\WULJJHULQJ57IUHHEUHDWKLQJ)%DQGEUHDWK KROG %+ GLIIXVLRQZHLJKWHG LPDJLQJ ':, WHFKQLTXHV UHJDUGLQJ D VXEMHFWLYH LPDJHTXDOLW\DQGEVLJQDOLQWHQVLW\6,FKDUDFWHULVWLFVDQG$'&PHDVXUHPHQWV LQSDWLHQWVZLWKSDQFUHDWLFDGHQRFDUFLQRPD 0HWKRGVDQG0DWHULDOV3URVSHFWLYHO\FRQVHFXWLYHSDWLHQWVZLWKKLVWRSDWKR ORJLFDOO\SURYHQGLVHDVHPHDQVL]HFPXQGHUZHQW':,DW7 HVODZLWK EYDOXHVDQGVPPZLWKWKHGLIIHUHQWWHFKQLTXHV7ZR UDGLRORJLVWVLQGHSHQGHQWO\DQGEOLQGO\DVVHVVHGLPDJHTXDOLW\E\DVVLJQLQJDWRWDO TXDOLW\VFRUH>VFRUHVXPRIUDWLQJGLIIXVLRQLPDJHVOHVLRQGHWHFWLRQDQDWRP\SUHV HQFHRIDUWHIDFWVDQG $'&PDSVOHVLRQFKDUDFWHULVDWLRQRYHUDOOLPDJHTXDOLW\@SHU VHTXHQFHDQGE\UDQNLQJWKHPVHTXHQFHVYLHZHGVLPXOWDQHRXVO\/HVLRQVLJQDO LQWHQVLW\6,VLJQDOWRQRLVHUDWLR615PHDQ$'&DQGFRHIÀFLHQWRIYDULDWLRQ &9ZHUHFRPSDUHG$SYDOXHZDVFRQVLGHUHGVLJQLÀFDQW 5HVXOWV7 RWDOTXDOLW\VFRUHIRU57 )%DQG%+ZDVDQGUHVSHF WLYHO\ 57 VLJQLÀFDQWO\ KLJKHU WKDQ )% EXW QRW WKDQ %+ 57 KDG D VLJQLÀFDQWO\ KLJKHUUDQNLQJFRPSDUHGWRERWK)%DQG%+6,RQDOOEYDOXHVDQG615RQE DQGEZHUHVLJQLÀFDQWO\KLJKHUIRU57FRPSDUHGWR)%DQG%+0HDQ$'&V IRU57 )%DQG%+ZHUHDQGUHVSHFWLYHO\%+VLJQLÀFDQWO\ KLJKHUWKDQ)%EXWQRWWKDQ570HDQ&9IRU57 )%DQG%+ZHUHDQG UHVSHFWLYHO\57VLJQLÀFDQWO\ORZHUWKDQ%+EXWQRWWKDQ)% &RQFOXVLRQ,QERWKDQDO\VHV57':,VKRZHGVXSHULRULW\DQGVHHPVWKHRSWLPDO WHFKQLTXHIRU':,RISDQFUHDVDGHQRFDUFLQRPD % &RPSDULVRQRIDEGRPLQDO05,LQFOXGLQJGLIIXVLRQZHLJKWHG VHTXHQFHVZLWK*D'27$7$7(3(7&7LQGHWHFWLQJ QHXURHQGRFULQHWXPRXUVRIWKHSDQFUHDV &06FKPLG7 DQQZDOG&6FKPLG7 DQQZDOG51HXPDQQ$+DXJ05HLVHU &5LVW0XQLFK'(FKULVWRSK #KRWPDLOFRP 3XUSRVH7 RFRPSDUHDEGRPLQDO05,LQFOXGLQJGLIIXVLRQZHLJKWHG05,':05, ZLWK *D'27$7$7(3(7&7 3(7&7 LQ GHWHFWLQJ QHXURHQGRFULQHWXPRXUV 1(7RIWKHSDQFUHDV 0HWKRGVDQG0DWHULDOVSDWLHQWVZHUHUHWURVSHFWLYHO\LQFOXGHGZLWKSDQFUHDWLF 1(7 ZKR XQGHUZHQW 05, LQFOXGLQJ ':05, DQG 3(7&7 ZLWKLQ ZHHNV 7ZR EOLQGHG UHDGHU FRPSDUHG 7ZHLJKWHG 7Z 7Z':05, 7ZFRQWUDVW HQKDQFHG7ZHLJKWHG&(7ZVHTXHQFHVDQG3(7&7LPDJHVIRU1(7GHWHFWLRQ DQGFRQÀGHQFHOHYHOXVLQJDSRLQWVFDOH6HQVLWLYLW\FRQÀGHQFHOHYHODQG$'& RI1(7DQGQRUPDOSDQFUHDWLFWLVVXHZDVFRPSDUHG 5HVXOWVDQG1(7ZHUHGHWHFWHGRQ7ZLPDJHVDQG 7Z':05,E\ERWKREVHUYHUVUHVSHFWLYHO\2EVHUYHUVDQGGHWHFWHG DQG1(7RQWKHLUUHYLHZRI7Z&(7ZLPDJHFRPELQDWLRQ UHVSHFWLYHO\DQGDOO1(7ZHUHGHWHFWHGRQ3(7&7E\ERWKREVHUYHUV 'HWHFWLRQUDWHDQGFRQÀGHQFHOHYHOLPSURYHGVLJQLÀFDQWO\E\FRPELQHGLQWHUSUH WDWLRQRI7ZLPDJHVDQG':05,RU&(7ZLPDJHVS7KHUHZDVQR VLJQLÀFDQWGLIIHUHQFHEHWZHHQWKH1(7GHWHFWLRQUDWHRI7Z':05,DQG7Z&( 7 LPDJH FRPELQDWLRQV S! 'HWHFWLRQ UDWH DQG FRQÀGHQFH OHYHO RI 3(7 &7ZHUHVLJQLÀFDQWO\KLJKHUWKDQ05,S 0HDQ$'&RI1(7[ PPòVZDVVLJQLÀFDQWO\ORZHUWKDQPHDQ$'&RIQRUPDOSDQFUHDWLFWLVVXH [PPòV &RQFOXVLRQ':05,LVDYDOXDEOHDGMXQFWWR7ZDQGFRPSDUDEOHWR&(7Z LPDJHVLQGHWHFWLRQRI1(7RIWKHSDQFUHDVDQG$'&PHDVXUHPHQWVSURYLGHD TXDQWLWDWLYH GLIIHUHQWLDWLRQ EHWZHHQ 1(7 DQG QRUPDO SDQFUHDWLFWLVVXH 3(7&7 VHHPVWRLPSURYHVLJQLÀFDQWO\WKHGHWHFWLRQRISDQFUHDWLF1(7FRPSDUHGWR05, 6FLHQWLILF6HVVLRQ 6 &$' ( ) *+% (XURSHDQ&RQJUHVVRI 5DGLRORJ\ &RQFOXVLRQ7LPLQJEROXV'&(05,XVLQJWKHUDGLDO.:,&VHTXHQFHIURPURXWLQH H[DPLQDWLRQVFDQEHSRVWSURFHVVHGWR\LHOGSRWHQWLDOO\XVHIXOSHUIXVLRQSDUDPHWHUV IRUFKDUDFWHULVDWLRQRISDQFUHDWLFGLVHDVHV % 6LQJOHHQHUJ\ORZYROWDJHDUWHULDOSKDVHVFDQVIRUWKHGHWHFWLRQRI DGHQRFDUFLQRPDRIWKHSDQFUHDV *$=DPERQL0$PEURVHWWL(=LYHORQJKL53R]]L0XFHOOL9HURQD,7 J]DPERQL#KRWPDLOFRP 3XUSRVH7 RWHVWDVLQJOHHQHUJ\ORZYROWDJHSURWRFROIRUGHWHFWLQJDGHQRFDUFL QRPDRIWKHSDQFUHDV 0HWKRGVDQG0DWHULDOVSDWLHQWVZLWKSDWKRORJ\SURYHQSDQFUHDWLFDGHQRFDUFL QRPDXQGHUZHQW0'&7ZLWKDUWHULDOSKDVHDWN9SJURXS $RQDURZVFDQQHU DQGZHUHFRPSDUHGWRDVLPLODUJURXSRISDWLHQWVVFDQQHGZLWKDN9SDUWHULDO SKDVHSURWRFROJURXS%([FHSWIRUWXEHYROWDJHDOORWKHUVFDQSDUDPHWHUVZHUH NHSWFRQVWDQW6FDQVZHUHFRPSDUHGIRUTXDQWLWDWLYHLPDJHSDUDPHWHUVDWWHQXDWLRQ DQGVWDQGDUGGHYLDWLRQLQWKHOLYHUSDQFUHDVDRUWDDQGWXPRXU&7',DQG'/3 XVLQJDQXQSDLUHGWWHVW,PDJHQRLVHYDOXHVIRUHDFKSURWRFRO6'RIWKH+8IURP 52,VGUDZQRXWVLGHWKHERG\ZHUHFRPSDUHGXVLQJDQXQSDLUHGWWHVW(IIHFWLYH GRVHIRUWKHWZRSURWRFROVZDVFDOFXODWHGZLWK7/'PHDVXUHPHQWV 5HVXOWV 0HDQ DWWHQXDWLRQ ZDV VLJQLÀFDQWO\ KLJKHU LQ JURXS$ LQ WKH DRUWD YV +8 OLYHU YV +8D Q G Q R U P D O SDQFUHDVYV+8DOOSZKLOHQRVLJQLÀFDQWGLI IHUHQFHZDVREVHUYHGIRUDGHQRFDUFLQRPDYV+8S QV &7', DQG '/3 ZHUH VLJQLÀFDQWO\ ORZHU LQ JURXS$ YV P*\ DQG YVP*\[FPUHVSHFWLYHO\DOOS7XPRXUFRQ VSLFXLW\+8SDQFUHDV+8WXPRXUZDVVLJQLÀFDQWO\KLJKHULQJURXS$ YV+8S0HDQLPDJHQRLVHZDVVLJQLÀFDQWO\KLJKHULQJURXS $YV+8S7/'HIIHFWLYHGRVHZDVVLJQLÀFDQWO\ORZHU IRUWKHWHVWSURWRFROYVP6YS &RQFOXVLRQ 7KH XVH RI N9S DUWHULDO SKDVH IRU DEGRPHQ &7 LQFUHDVHV WKH FRQVSLFXLW\RIDGHQRFDUFLQRPDWKXVSRWHQWLDOO\LPSURYLQJLWVLGHQWLÀFDWLRQ % 4XDQWLÀFDWLRQRISDQFUHDWLFIDWIUDFWLRQDQGFRQIRXQGLQJIDFWRUVLQ DQDGXOWSRSXODWLRQEDVHGVWXG\XVLQJPDJQHWLFUHVRQDQFHLPDJLQJ -3 .XHKQ6%DXPHLVWHU3 2%HKUQGW.+HJHQVFKHLG+9RHO]NH -0D\HUOH1+RVWHQ53XOV*UHLIVZDOG'(NXHKQ#XQLJUHLIVZDOGGH 3XUSRVH7 RHVWDEOLVKWKHSURSRUWLRQRISDQFUHDWLFIDWIUDFWLRQDQGWKHLUFRUUHODWHV LQDQRQJRLQJSRSXODWLRQEDVHGFRKRUWVWXG\XVLQJ7 FRUUHFWHG'L[RQPDJQHWLF UHVRQDQFHLPDJLQJ05, 0HWKRGVDQG0DWHULDOV05,ZDVSHUIRUPHGLQD7V\VWHP$YDQWR6LHPHQV XVLQJDZRUNLQSURJUHVV7 FRUUHFWHGWKUHHHFKR'L[RQWHFKQLTXH)DWSKDQWRP ZDVFRQVWUXFWHGXVLQJIDWIUDFWLRQVRIDQGWRWHVWWKHDFFXUDF\RI IDWTXDQWLÀFDWLRQ,QDGGLWLRQDWRWDORIKHDOWK\YROXQWHHUVPHQ ZRPHQPHDQDJH\HDUVPHDQ%0,NJPXQGHUZHQWDQ DEGRPLQDO05,LQFOXGLQJWKHVWXG\VHTXHQFH)DWIUDFWLRQVRIWKHSDQFUHDVKHDG ERG\DQGWDLOZHUHFDOFXODWHGXVLQJDUHJLRQRILQWHUHVWEDVHGLPDJHHYDOXDWLRQ 3DQFUHDWLFIDWORJWUDQVIRUPHGZDVUHJUHVVHGRQGHPRJUDSKLFEHKDYLRXUDODQG FDUGLRPHWDEROLFIDFWRUV 5HVXOWV7KHFRUUHODWLRQEHWZHHQSUHGLFWHGIDWFRQWHQWE\05,DQGWUXHIDWFRQWHQW LQSKDQWRPZDVYHU\KLJKU3HDUVRQ 7KHPHGLDQSDQFUHDWLFIDWIUDFWLRQ DPRQJ YROXQWHHUV ZDV WK SHUFHQWLOH 4 WK SHUFHQWLOH 4 7KHUHDUHQRVLJQLÀFDQWFKDQJHVLQIDWGLVWULEXWLRQEHWZHHQKHDG ERG\ DQG WDLO S ,Q PXOWLYDULDEOH OLQHDU UHJUHVVLRQ PRGHOV PDOHJHQGHUDJHREHVLW\G\VOLSLGHPLDDQGWULJO\FHULGHVZHUHDVVRFLDWHGZLWK SDQFUHDWLFIDW)RUH[DPSOHPHQKDGKLJKHUYDOXHVWKDQZRPHQWKRVHZLWK %0,ODUJHUWKDQDQGVXEMHFWVZLWKG\VOLSLGHPLDKLJKHUSDQFUHDWLFIDW &RQFOXVLRQ05,LVDXVHIXOWRROWRTXDQWLI\WKHSDQFUHDWLFIDWIUDFWLRQ6H[DJH %0,G\VOLSLGHPLDDQGWULJO\FHULGHVDUHDVVRFLDWHGZLWKSDQFUHDWLFIDWZKHUHDV VPRNLQJVWDWXVDOFRKROFRQVXPSWLRQK\SHUWHQVLRQGLDEHWHVDQGIDVWLQJJOXFRVH DUHQRW % 3UHRSHUDWLYH&7ÀQGLQJVSUHGLFWLQJWKHUHFXUUHQFHRISDQFUHDWLF FDQFHUDIWHUVXUJLFDOUHVHFWLRQ < /HH< .LP./HH6HRQJQDPVL.5\RRQMLQ #JPDLOFRP 3XUSRVH7 RGHWHUPLQHXVHIXOSUHRSHUDWLYH&7ÀQGLQJVIRUSUHGLFWLQJWKHUHFXU UHQFHRISDQFUHDWLFFDQFHUDIWHUVXUJLFDOUHVHFWLRQ 0HWKRGVDQG0DWHULDOV)URP2FWREHUWR0DUFKPXOWLSKDVLFPXOWLGH WHFWRU&7GDWDZHUHDFTXLUHGLQSDWLHQWVXQGHUJRLQJFXUDWLYHUHVHFWLRQIRUGXFWDO $QD[LDO&7LPDJHRQWKHOHYHORI/YHUWHEUDHZDVDVVHVVHGWRPHDVXUH FURVVVHFWLRQDODUHDVRIVNHOHWDOPXVFOH7KHYDOXHVZHUHQRUPDOLVHGIRUKHLJKW WRJHW/XPEDUVNHOHWDOPXVFOHLQGH[FPP6H[VSHFLÀFVDUFRSHQLDFXWRIIV ZHUHFPPIRUPHQDQGFPPIRUZRPHQ3UDGRHWDO7KHUDQJH RIERG\PDVVLQGH[%0,ZDVIURPNJPòWRNJPò09NJ PòIRUJURXSDQGNJPòIRUJURXS 5HVXOWVSDWLHQWVZLWKSDQFUHDWLFFDQFHUZHUHIRXQGVDUFRSHQLF0HDQ YDOXHRI/LQGH[ZDVFPPIRUPHQDQGFPPIRUZRPHQ 7KHUHZHUHVDUFRSHQLFSDWLHQWVZLWKFKURQLFSDQFUHDWLWLVPHDQYDOXHV RI/LQGH[IRUPHQDQGIRUZRPHQZHUHFPPDQGFP PUHVSHFWLYHO\6DUFRSHQLDZDVGLDJQRVHGQRWRQO\LQSDWLHQWVZLWKGHFUHDVHG %0,EXWDOVRZLWKQRUPDODQGLQFUHDVHG%0, &RQFOXVLRQ&7LVDXVHIXOWRROWRHYDOXDWHVDUFRSHQLDLQSDWLHQWVZLWKSDQFUHDWLF FDQFHUDQGFKURQLFSDQFUHDWLWLVXVLQJ/LQGH[7KHXVHRI&7IRUERG\FRPSRVL WLRQDQDO\VLVRSHQVXSQHZSRVVLELOLWLHVLQPHWDEROLFGLVRUGHUVUHVHDUFKLQWKHVH JURXSVRISDWLHQWV % 5HODWLRQVKLSEHWZHHQFOLQLFRSDWKRORJLFDOIDFWRUVDQGWRWDOOHVLRQ JO\FRO\VLVLQSDQFUHDWLFFDQFHU 06KLQDJDZD+.DLGD< .XQRX08FKLGD0,VKLEDVKL1+D\DEXFKL 0<DVXPRWRPD[LPXPVWDQGDUGLVHGXSWDNHYDOXH 689PD[WRWDOOHVLRQJO\FRO\VLV7/*@DQGFOLQLFRSDWKRORJLFDOIDFWRUVDVVRFLDWHG ZLWKSDQFUHDWLFFDQFHU 0HWKRGVDQG0DWHULDOV)'*SRVLWURQHPLVVLRQWRPRJUDSK\FRPSXWHGWRPRJUD SK\ZDVSHUIRUPHGRQSDWLHQWVZLWKSDQFUHDWLFFDQFHUIRULQLWLDOVWDJLQJSULRUWR VXUJHU\'LDJQRVLVZDVKLVWRSDWKRORJLFDOO\FRQÀUPHGIRUDOOFDVHV7KHUHODWLRQVKLS EHWZHHQFOLQLFRSDWKRORJLFDOIDFWRUVLHWXPRXUVL]HSDWKRORJLFDO7VWDJHO\PSK QRGH PHWDVWDVLV SDWKRORJLFDO VWDJH WXPRXU GLIIHUHQWLDWLRQ O\PSKDWLF LQYDVLRQ YHQRXVLQYDVLRQLQWUDSDQFUHDWLFQHXUDOLQYDVLRQDQGWXPRXUJURZWKSDWWHUQ,1) 7/*DQG689PD[ZDVLQYHVWLJDWHG7/*ZDVFDOFXODWHGE\PXOWLSO\LQJPHDQ689 DQGPHWDEROLFWXPRXUYROXPH 5HVXOWV7/*VLJQLÀFDQWO\FRUUHODWHGZLWKWXPRXUVL]H7/*U S 689PD[U S DQGDVVRFLDWHGZLWKWXPRXUGLIIHUHQWLDWLRQ7/* S 689PD[S ZKHUHDV689PD[GLGQRW,QFRQWUDVW689PD[ DVVRFLDWHGZLWK,1) ZKHUHDV7/*GLGQRW689PD[S 7/*S 1RVLJQLÀFDQWGLIIHUHQFHZDVREVHUYHGEHWZHHQFOLQLFRSDWKRORJLFDOIHDWXUHVDQG 689PD[RU7/* &RQFOXVLRQ7XPRXUVL]HDQGGLIIHUHQWLDWLRQZHUHPRUHKLJKO\FRUUHODWHGZLWK7/* WKDQ689PD[VXJJHVWLQJWKDW7/*LVPRUHUHÁHFWLYHRIFOLQLFRSDWKRORJLFDOIDFWRUV DQGOLNHO\WREHXVHIXOLQWKHFOLQLFDOPDQDJHPHQWRISDQFUHDWLFFDQFHU % 7LPLQJEROXVG\QDPLFFRQWUDVWHQKDQFHGPDJQHWLFUHVRQDQFHG LPDJLQJIRUFKDUDFWHUL]DWLRQRIVROLGIRFDOSDQFUHDWLFOHVLRQV -/HH -.LP-+DQ,-RR%&KRL%.HLIHU6HRXO.5 (UODQJHQ'(MPVK#VQXDFNU 3XUSRVH7 RDVVHVVWKHIHDVLELOLW\RIG\QDPLFFRQWUDVWHQKDQFHG'&(05,WLPLQJ EROXVGDWDXVLQJDWKUHHGLPHQVLRQDOUDGLDOJUDGLHQWHFKRWHFKQLTXHZLWK.VSDFH ZHLJKWHGLPDJHFRQWUDVW5DGLDO.:,&FDQEHSRVWSURFHVVHGIRUFKDUDFWHULVDWLRQ RIVROLGSDQFUHDWLFGLVHDVHV 0HWKRGVDQG0DWHULDOV $WRWDORISDWLHQWVZLWKVXVSHFWHGSDQFUHDWLFGLVHDVHV ZKRXQGHUZHQWSDQFUHDWLF05,DW7VFDQQHUZKLFKLQFOXGHGDORZGRVHP/ JDGRSHQWHWDWHWLPLQJEROXVXVLQJDUDGLDO.:,&WHFKQLTXH7KHUHZHUHSD WLHQWVZLWKSDQFUHDWLFFDQFHUVZLWK31(7 VZLWKFKURQLFSDQFUHDWLWLVDQG ZLWK QRUPDO SDQFUHDV 8VLQJ WKH GHGLFDWHG SRVWSURFHVVLQJ VRIWZDUH SURJUDP IRU'&(05,WKHVHYHUDOSHUIXVLRQSDUDPHWHUVZHUHPHDVXUHGIRUWXPRXUDQG QRQWXPRURXVSDUHQFK\PD 5HVXOWV7KH .WUDQV .HS DQG L$8& YDOXHV LQ SDWLHQWV ZLWK SDQFUHDWLF FDQFHU PLQïPLQïPPROVUHVSHFWLYHO\3ZHUHVLJQLÀFDQWO\ ORZHUWKDQWKRVHZLWKQRUPDOSDQFUHDVPLQïPLQïPPROV UHVSHFWLYHO\3,QDGGLWLRQWKHNHSYDOXHVRI31(7 VDQGQRUPDOSDQFUHDV ZHUH DOVR GLIIHUHQW 3 )XUWKHUPRUH WKH .WUDQV NHS L$8& YDOXHV RI SDQFUHDWLFFDQFHUVDQG31(7 VZHUHVLJQLÀFDQWO\GLIIHUHQW37KHSUHYDOHQW 7,& SDWWHUQV RI WKH SDQFUHDWLF FDQFHU 31(7 V FKURQLF SDQFUHDWLWLV DQG QRUPDO SDQFUHDWLFSDUHQFK\PDZHUHGLIIHUHQWSDQFUHDWLFFDQFHUVVKRZHGDVORZJUDGXDO HQKDQFHPHQWSDWWHUQZKLOH31(7 VVKRZHGDUDSLGO\LQFUHDVLQJDQG JUDGXDOO\GHFUHDVLQJHQKDQFHPHQWSDWWHUQ 6FLHQWLILF6HVVLRQ $ 6&'()*+%(XURSHDQ&RQJUHVVRI 5DGLRORJ\ 6DWXUGD\ UHFWLRQPDSWRFRPSHQVDWHWKHDUWHIDFWXDO7 YDULDWLRQV7KHKHSDWLF7 YDOXH ZDVGHWHUPLQHGRYHUDUHJLRQRILQWHUHVW 5HVXOWV7KHLQWUDDQGLQWHURSHUDWRUUHSURGXFLELOLW\DW7ZDVJRRG,&&! 6HJPHQWDOFRUUHFWLRQIDFWRUVZHUHVLJQLÀFDQWO\KLJKHUDW73 $VWURQJ OLQHDUUHODWLRQVKLSZDVIRXQGEHWZHHQ7DQG75 YDOXHVIRUERWKOLYHUDQG KHDUWWKH75 YDOXHVZHUHDERXWWZLFHZLWKDQLQWHUFHSWGHSHQGLQJRQWKH QRQLURQ WLVVXH FRPSRQHQW 7KH FRQFRUGDQFH EHWZHHQ JOREDO DQG PLGVHSWXP YDOXHVFRQÀUPHGWKHFRQVLVWHQFHRIPHDVXUHPHQWV7KHUHOLDELOLW\IRU77 DV VHVVPHQWZDVIXOOIRUWKHPLGVHSWXPVHQVLWLYLW\VSHFLÀFLW\DQGDFFXUDF\ DQGKLJKIRUJOREDOKHDUWVHQVLWLYLW\VSHFLÀFLW\DQGDFFXUDF\)RUWKH VHJPHQWDOPHDVXUHPHQWRILURQOHYHOVDW7 WKHDFFXUDF\ZDVQRRSWLPDO7KH DFFXUDF\ZDVKLJKWRLGHQWLI\SDWLHQWVZLWKPLOGWRQRLURQOLYHUEXUGHQEXW GURSSHGWRLQSDWLHQWVZLWKKHDY\PRGHUDWHLURQEXUGHQ7KHVHQVLWLYLW\ZDV XQVDWLVIDFWRU\WRGHWHFWSDWLHQWVZLWKKHDY\OLYHULURQEXUGHQ &RQFOXVLRQ 7 TXDQWLÀFDWLRQ RI LURQ EXUGHQ LQ WKH PLGVHSWXP JOREDO KHDUW DQGQRKHDY\PRGHUDWHOLYHUVUHVXOWHGWREHIHDVLEOHUHSURGXFLEOHDQGUHOLDEOHDW 7 &KDOOHQJHZDVWKHVHJPHQWDOKHDUW7 DQDO\VLVGXHWRVLJQLÀFDQWO\KLJKHU VXVFHSWLELOLW\DUWHIDFWVDW7 % 5HODWLRQVKLSEHWZHHQP\RFDUGLDO7 YDOXHVDQGULJKWDQGOHIW YHQWULFXODUYROXPHWULFDQGIXQFWLRQDOSDUDPHWHUVLQWKDODVVHPLD PDMRU70SDWLHQWVHYDOXDWHGE\FDUGLDFPDJQHWLFUHVRQDQFH&05 ,'L*LDPSLHWUR&/LJXRUL,6DQVRQL$)HOL]LDQL3 &LDQFLXOOL %%HRPRQWH=REHO5RPH,7 3XUSRVH&05KDVEHFRPHWKHPRVWXVHIXOLPDJLQJWHFKQLTXHLQ70SDWLHQWV WKDQNWR7 DFTXLVLWLRQLQRUGHUWRTXDQWLWDWLYHO\HYDOXDWHP\RFDUGLDOLURQRYHUORDG 7KHDLPRIWKHVWXG\ZDVWRDVVHVVWKHUHODWLRQVKLSEHWZHHQWKHP\RFDUGLDO7 YDOXHDQGOHIWULJKWYHQWULFXODUIXQFWLRQDOSDUDPHWHUVDQGWRH[DPLQHWKHDVVRFLD WLRQVEHWZHHQWKHGHJUHHRIFDUGLDFLURQORDGDQGYHQWULFXODUIXQFWLRQLPSDLUPHQW 0HWKRGVDQG0DWHULDOV$UHWURVSHFWLYHDQDO\VLVRISDWLHQWV0DQG) PHDQDJH\VZLWK70ZDVSHUIRUPHG0\RFDUGLDOLURQORDGZDVDV VHVVHGE\7 PHDVXUHPHQWVDQGYROXPHWULFIXQFWLRQVZHUHDQDO\VHGXVLQJWKH VWHDG\VWDWHIUHHSUHFHVVLRQ66)3VHTXHQFHV 5HVXOWV ,Q SDWLHQWV ZLWK P\RFDUGLDO LURQ GHSRVLWLRQ 7 PV WKHPHDQ /9()ZDVUHVXOWLQJVLJQLÀFDQWO\ORZHUFRPSDUHGWR/9()PHDVXUHGLQ SDWLHQWVZLWKRXWLURQGHSRVLWLRQ6WDWLVWLFDOO\VLJQLÀFDQWFRUUHODWLRQV ZHUHIRXQGHGEHWZHHQERWKWKH/9YROXPHVDQGWKHP\RFDUGLDO7 YDOXHLQYHUVH FRUUHODWLRQVEHWZHHQERWKWKH/9HQGV\VWROLFYROXPHLQGH[U 3DQG WKHOHIWYHQWULFXODU/9HQGGLDVWROLFYROXPHLQGH[U 3ZHUHREVHUYHG ,QFRQWUDVWFDUGLDF7 YDOXHVZHUHQRWDVVRFLDWHGZLWKIXQFWLRQDOPRGLÀFDWLRQVLQ WKHULJKWYHQWULFOHIXQFWLRQDOSDUDPHWHUV &RQFOXVLRQ0\RFDUGLDOLURQORDGDVVHVVHGE\&05LVDVVRFLDWHGZLWKGHWHULR UDWLRQ/9()DQGWKHGHJUHHRIWKHRYHUORDGLVLQYHUVHO\FRUUHODWHGZLWKWKH7 YDOXHV1RQFRUUHODWLRQKDVEHHQIRXQGHGEHWZHHQ7 YDOXHVDQGULJKWYHQWULFOH IXQFWLRQDOSDUDPHWHUV % 6HSWDOODWHJDGROLQLXPHQKDQFHPHQWDWWKHULJKWYHQWULFXODU LQVHUWLRQVPRUHIUHTXHQWWKDQH[SHFWHGLQK\SHUWURSKLFDQGGLODWLYH FDUGLRP\RSDWK\ 3 %LVFKRII5/'XVFKND6+ROOPDQQ06LPRQ$.RYDFV3 :5DGNH ) 09RJW-%DUNKDXVHQ3 +XQROG/EHFN'( 3XUSRVH 7KH SDUWLFXODU SDWWHUQ RI VHSWDO /DWH *GHQKDQFHPHQW /*( DWWKH ULJKWYHQWULFXODU59LQVHUWLRQVKDVEHHQGHVFULEHGLQFRQMXQFWLRQZLWKSXOPRQDU\ K\SHUWHQVLRQ$LPRIWKLVUHWURVSHFWLYHVWXG\ZDVWRFKDUDFWHULVHWKHGLVWULEXWLRQ DQGSUHYDOHQFHRIVHSWDO/*(DWWKH59LQVHUWLRQVLQFDVHVRIK\SHUWURSKLFDQG GLODWLYHFDUGLRP\RSDWK\+&0'&0 0HWKRGVDQG0DWHULDOV$WRWDORIFRQWUDVWHQKDQFHGFDUGLDF05,VWXGLHV ZHUHSHUIRUPHG7DQG7 $FKLHYD3KLOLSVIRUGLIIHUHQWFOLQLFDOLQGLFDWLRQV 7KH05,SURWRFROFRQVLVWHQWO\FRQWDLQHG&LQH66)3LQORQJDQGVKRUWD[HVDQG '7Z,5/*(LQORQJDQGVKRUWD[HVPLQDIWHUGRXEOHGRVHPPRONJ JDGREXWURO$OOFDVHVZHUHUHYLHZHGLQDUHWURVSHFWLYHDQDO\VLV'&0DQG+&0 SDWLHQWVZLWK/*(DWWKHDQWHULRUDQGRULQIHULRUVHSWDO59LQVHUWLRQZHUHHYDOXDWHG DQGFRPSDUHGWRFDUGLRP\RSDWK\SDWLHQWVZLWKRXW/*( 5HVXOWV,QWRWDO'&0RU+&0ZHUHIRXQGLQSWV+\SHUWURSKLF QRQREVWUXFWLYH FDUGLRP\RSDWK\ +1&0 ZDV GHWHFWHG SWV K\SHUWURSKLFREVWUXFWLYH FDUGLRP\RSDWK\ +2&0 ZDV GHWHFWHG LQ SWV 7KHUHRIDQWHULRUDQGLQIHULRU/*(DWWKH59LQVHUWLRQVZDVIRXQGLQSWV +1&0SWV+2&0SWVRQO\LQI/*(ZDVIRXQG LQSWV+1&0SWV+2&0SWVSWV DGHQRFDUFLQRPD RI WKH SDQFUHDV )RUW\ FRQVHFXWLYH SDWLHQWV ZHUH GLYLGHG LQWR UHFXUUHQFHRUUHFXUUHQFHIUHHJURXSV7ZRUDGLRORJLVWVUHWURVSHFWLYHO\UHYLHZHG WKH&7ÀQGLQJVLQFRQVHQVXVZLWKUHJDUGWRWKHVL]HRIWKHWXPRXUORFDOLQYDVLRQ YDVFXODULQYDVLRQUHJLRQDOO\PSKQRGHHQODUJHPHQWDQGWKHSUHVHQFHRIDVVRFL DWHGSDQFUHDWLWLV7KHUHVXOWVIURP&7ZHUHDQDO\VHGWRLGHQWLI\WKHULVNIDFWRUV DVVRFLDWHGZLWKWXPRXUUHFXUUHQFHDIWHUVXUJHU\.DSODQ0HLHUPHWKRGDQG&R[ SURSRUWLRQDOKD]DUGVUHJUHVVLRQPRGHOZHUHXVHGIRUHYDOXDWLRQ 5HVXOWV3UHVHQFHDQGQXPEHURIUHJLRQDOO\PSKQRGHHQODUJHPHQWRQ&7ZHUH LPSRUWDQWSUHGLFWRUVRIWXPRXUUHFXUUHQFHS DQGUHODWLYHULVNHVWLPDWH DQGUHVSHFWLYHO\7KHSUHVHQFHRIUHWURSDQFUHDWLFO\PSKQRGHHQODUJH PHQWZDVDVLJQLÀFDQWSUHGLFWRUS UHODWLYHULVNHVWLPDWHLQPXOWLYDUL DWHDQDO\VLV7KHPHGLDQWXPRXUUHFXUUHQFHWLPHVZHUHPRQWKVDQGPRQWKV LQSDWLHQWVZLWKDQGZLWKRXWO\PSKDGHQRSDWK\UHVSHFWLYHO\S +RZHYHU RWKHU&7ÀQGLQJVZHUHQRWVWDWLVWLFDOO\VLJQLÀFDQWSUHGLFWRUVRIWXPRXUUHFXUUHQFH &RQFOXVLRQ 7KH SUHVHQFH RI UHJLRQDO HVSHFLDOO\ UHWURSDQFUHDWLF O\PSK QRGH HQODUJHPHQWRQ&7PD\LPSURYHSUHGLFWLQJSDWLHQWVDWKLJKULVNRIWXPRXUUHFXU UHQFHDIWHUVXUJLFDOUHVHFWLRQRISDQFUHDWLFFDQFHU 5RRP/0 &DUGLDF 66 &DUGLRP\RSDWKLHV&7 05,DQG3(7 0RGHUDWRUV $(VSRVLWR0LODQ,7 0*XWEHUOHW/HLS]LJ'( % 0\RFDUGLDOODWHHQKDQFHPHQWLQK\SHUWURSKLFFDUGLRP\RSDWK\ VSUHDGPRUHWKDQDPRXQWSUHGLFWVHYROXWLRQWRZDUGVKHDUWIDLOXUH 0&DYD) 'H&REHOOL$(VSRVLWR65DYHOOL$'DPDVFHOOL */LJDEXH5)DWWRUL$'HO0DVFKLR0LODQ,70RGHQD,7%RORJQD,7 FDYDPDULDQJHOD#KVULW 3XUSRVH7KLVVWXG\DLPHGWRH[SORUHE\FDUGLDFPDJQHWLFUHVRQDQFH&05UHOD WLYHUHOHYDQFHRIPRUSKRIXQFWLRQDODQGVWUXFWXUDOLQIRUPDWLRQVUHODWHGWRSRWHQWLDOO\ OLIHWKUHDWHQLQJFOLQLFDOHYHQWVLQK\SHUWURSKLFFDUGLRP\RSDWK\+&0SDWLHQWV 0HWKRGV DQG 0DWHULDOV +&0 SDWLHQWV SWV PHDQ DJH XQGHUZHQW &05 EHWZHHQ DQG SHUIRUPHG RQ D 7 PDJQHW $FKLHYD 3KLOLSV ZLWKDVVHVVPHQWRIOHIWYHQWULFXODUHQGV\VWROLFGLDVWROLFYROXPHVHMHFWLRQIUDFWLRQ HQGGLDVWROLFZDOOPDVVPD[LPXPZDOOWKLFNQHVV0:7RXWÁRZWUDFWREVWUXFWLRQ PLWUDO UHJXUJLWDWLRQ GLDVWROLF IXQFWLRQ ') DQG ODWHHQKDQFHPHQW /( DIWHU LY LQMHFWLRQRIJDGROLQLXPEDVHGFRQWUDVWPHGLXP'XULQJPRQWKVIROORZXS FDUGLDFHYHQWV&(ZHUHUHFRUGHGDQGGLYLGHGLQWRWZRJURXSVDUUK\WKPLF&( >VXVWDLQHG YHQWULFXODU WDFK\FDUGLD YHQWULFXODU ÀEULOODWLRQ VXGGHQ FDUGLDF GHDWK ,&'GLVFKDUJH@DQGKHDUWIDLOXUH+)UHODWHG&(>DWULDOÀEULOODWLRQ$)XQSODQQHG KRVSLWDOLVDWLRQSURJUHVVLRQWR1<+$FODVV,,,,9+)UHODWHGGHDWK@ 5HVXOWVSWVVKRZHG/(PHDQZLWKPHDQQXPEHURILQYROYHGVHJ PHQWV/(16:HUHFRUGHG+)UHODWHGHYHQWVLQSWVQRDUUK\WKPLF&( RFFXUUHG $FFRUGLQJWRHYHQWV(ZHGLYLGHGSWVLQWRWZRJURXSV( QR( GDWDDVVHVVHGE\&05VKRZHGVLJQLÀFDQWGLIIHUHQFHVDERXW0:7( YV QR( S /(( YVQR( S DQG/(16( YV QR( S QXPEHURISDWLHQWVZLWK')LPSDLUPHQW( YVQR( S $WPXOWLYDULDWHDQDO\VLVDSDUWIURPDJHS QXPEHURI/(LQYROYHG VHJPHQWVVHHPVWREHWKHEHVWSUHGLFWRURI+)UHODWHGHYHQWVWKHLQYROYHPHQWRI DQ\VHJPHQWLQFUHDVHGWKHULVNRI+)UHODWHGHYHQWVS 25 &RQFOXVLRQ0\RFDUGLDO/(FRXOGSUHGLFWHYROXWLRQWRZDUGV+)LQ+&0/(VSUHDG VHHPVVWURQJHUWKDQLWVDPRXQW % )HDVLELOLW\UHSURGXFLELOLW\DQGUHOLDELOLW\IRUWKH7 LURQHYDOXDWLRQ DW7LQFRPSDULVRQZLWK7 &7XGLVFD $0HORQL*9DOHUL(&KLRGL00LVVHUH$&DUROOR 0/RPEDUGL00LGLUL$3HSH3DOHUPR,73LVD,7$QFRQD,7 )HUUDUD,7&DPSREDVVR,77UDSDQL,7 3XUSRVH:HDLPHGWRGHWHUPLQHWKHIHDVLELOLW\UHSURGXFLELOLW\DQGUHOLDELOLW\RI WKH7 PDJQHWLFUHVRQDQFHLPDJLQJ05,DW7IRUKHDUWDQGOLYHULURQEXUGHQ TXDQWLÀFDWLRQDQGWKHUHODWLRQVKLSEHWZHHQ7 YDOXHVDW7DQG7 0HWKRGV DQG 0DWHULDOV WUDQVIXVLRQGHSHQGHQW SDWLHQWV XQGHUZHQW 05, 6HJPHQWDODQGJOREDOFDUGLDF7 YDOXHVZHUHFDOFXODWHGDIWHUGHYHORSLQJDFRU 6FLHQWLILF6HVVLRQ 6 &$' ( ) *+% (XURSHDQ&RQJUHVVRI 5DGLRORJ\ % /DWHJDGROLQLXPHQKDQFHGFDUGLDFPDJQHWLFUHVRQDQFH/*(&05 TXDQWLÀFDWLRQRIP\RFDUGLDOGDPDJHDVDSUHGLFWRURIDUUK\WKPLFHYHQWV 6%HUWXJQR*/LJDEXH) )LRFFKL/1RFHWWL69DVDWXUR5/XJOL$%DUELHUL 3 7 RUULFHOOL0RGHQD,7 3XUSRVH7 R LQYHVWLJDWH WKH SURJQRVWLF YDOXH RI /*(&05 WKURXJKRXW WKHD V VRFLDWLRQ EHWZHHQ /*( H[WHQVLRQ DQG WKH RFFXUUHQFH RI VXVWDLQHG YHQWULFXODU WDFK\DUUK\WKPLDV 697 DQG LPSODQWDEOH FDUGLRYHUWHU GHÀEULOODWRU VKRFN ,&'6 LQ+&0SDWLHQWV 0HWKRGVDQG0DWHULDOVSDWLHQWVPHDQDJHPDOHVZLWK GRFXPHQWHG+&0XQGHUZHQW7FDUGLDFPDJQHWLFUHVRQDQFH/*(05LPDJHV ZHUHREWDLQHGPLQDIWHULQMHFWLRQRIPPRONJRIJDGROLQLXPEDVHGFRQWUDVW DJHQW ,QGH[HG HQGGLDVWROLF OHIW YHQWULFXODU PDVV ,('/9 PDVV ZDV DVVHVVHG DQG P\RFDUGLDO GDPDJH H[SUHVVHG DV SHUFHQWDJH RI WRWDO ,('/9 P\RFDUGLDO PDVVZDVTXDQWLÀHGDQGGHÀQHGDVLQWHQVLW\6'DERYHWKHPHDQVLJQDORID QRQHQKDQFHGP\RFDUGLXPDUHD2FFXUUHQFHRI697DQG,&'6GXULQJ PRQWKVIROORZXSZHUHUHFRUGHG 5HVXOWV7KHPHDQ,('/9PDVVZDVJP2Q/*(&05 SDWLHQWVH[KLELWHGP\RFDUGLDOVFDU7KHPHDQ/*(ZDVRI,('/9PDVV PHGLDQUDQJH'XULQJWKHIROORZXSSDWLHQWVSUHVHQWHG 697 SDWLHQWV LPSODQWHG ,&' DQG RI WKRVH KDG RQH RU PRUH ,&'6 3DWLHQWVZKRSUHVHQWHG697KDGVLJQLÀFDQWO\KLJKHU/*(FRPSDUHGWRWKRVH ZLWKRXW>@YV>@3 3DWLHQWVZKRSUHVHQWHGRQHRUPRUH ,&'6 KDG VLJQLÀFDQWO\ KLJKHU /*( FRPSDUHG WR WKRVH ZLWKRXW DQ\ VKRFNV >@YV>@3 &RQFOXVLRQ([WHQVLRQRI/*(SUHGLFWVWKHRFFXUUHQFHRI697DQG,&'6LQ+&0 SDWLHQWV % ,QFUHDVHGODWHJDGROLQLXPHQKDQFHPHQWRIWKHOHIWDWULXPE\ FDUGLRYDVFXODUPDJQHWLFUHVRQDQFHLQFDUGLDFDP\ORLGRVLV ) 6HFFKL $-DEERXU) 6DUGDQHOOL'3HQQHOO50RKLDGGLQ0LODQ,7 /RQGRQ8.IUDQFHVFRVHFFKLPG#JPDLOFRP 3XUSRVH2XUDLPZDVWRGHWHUPLQHWKHSUHYDOHQFHRIOHIWDWULDOODWHJDGROLQLXP HQKDQFHPHQW/*(E\FDUGLDFPDJQHWLFUHVRQDQFH&05LQSDWLHQWVZLWKFDUGLDF DP\ORLGRVLV 0HWKRGV DQG 0DWHULDOV 7KH &05 VWXGLHV RI SDWLHQWV DJHG \HDUV ZLWKNQRZQFDUGLDFDP\ORLGRVLVZHUHUHYLHZHG(&*WULJJHUHGIRXUFKDPEHUDQG ORQJD[LVYLHZVZHUHDFTXLUHGXVLQJDQLQYHUVLRQUHFRYHU\VHTXHQFHPLQXWHV DIWHUDGPLQLVWUDWLRQRIFRQWUDVW*DGRYLVWPPRONJ%DODQFHGVWHDG\VWDWHIUHH SUHFHVVLRQFLQHLPDJHVZHUHXVHGWRGHWHUPLQHOHIWYHQWULFXODUHQGGLDVWROLFDQG V\VWROLFLQGH[HGYROXPHV/9('9L/9(69LHMHFWLRQIUDFWLRQ()VWURNHYROXPH 69DQGPDVVLQGH[2QO\SDWLHQWVZLWKWKHFODVVLFGLIIXVHFLUFXPIHUHQWLDOSDWWHUQ RIOHIWYHQWULFXODU/*(ZHUHLQFOXGHGLQWKHVWXG\ 5HVXOWV2ISDWLHQWVZLWKFDUGLDFDP\ORLGRVLVSDWLHQWVGLVSOD\HG OHIWDWULDO/*( $OOWKUHHDWULDOZHUHLQYROYHGLQERWKVHSWDODQGIUHHZDOOV LQDQGLVRODWHGVHSWDOZDOOLQYROYHPHQWLQ3DWLHQWVZLWKOHIWDWULDO /*(DOVRKDGVLJQLÀFDQWO\KLJKHU/9('9LP/YVP/>PHDQ6'@ S +RZHYHUQRVLJQLÀFDQWGLIIHUHQFHVLQ/9(69LP/YVP/ S () YV S 69 P/ YV P/ S DQGPDVVJPYVJPS ZHUHREVHUYHG &RQFOXVLRQ3DWLHQWVZLWKFDUGLDFDP\ORLGRVLVKDYHDQLQFUHDVHGSUHYDOHQFH RIOHIWDWULDO/*(3DWLHQWVZLWKDWULDO/*(DOVRKDGPRUHGLODWHGOHIWYHQWULFOHVWKRVH ZLWKRXWDWULDO'($WULDO/*(LQFDUGLDFDP\ORLGRVLVPD\EHDPDUNHURIGLVHDVH VHYHULW\DQGLWVSURJQRVWLFLPSOLFDWLRQVUHTXLUHIXUWKHUHYDOXDWLRQ % 'RHVH[LVWDFRUUHODWLRQEHWZHHQODWHHQKDQFHPHQWPDVVDQGOHIW YHQWULFXODUIXQFWLRQLQK\SHUWURSKLFFDUGLRP\RSDWK\" &'H&HFFR*0XVFRJLXUL0'L*LURODPR6)LHUUR00DXUL]L(QULFL 9'DYLG5RPH,7JPXVFRJLXUL#KRWPDLOLW 3XUSRVH7 RFRUUHODWHOHIWYHQWULFXODUYROXPHVDQGIXQFWLRQZLWKODWHHQKDQFHPHQW /(PDVVLQSDWLHQWVZLWKK\SHUWURSKLFFDUGLRP\RSDWK\+&0 0HWKRGV DQG 0DWHULDOV :H UHWURVSHFWLYHO\ HYDOXDWHG SDWLHQWV ZLWK +&0 GLDJQRVLV$OOSDWLHQWVZHUHVWXGLHGZLWKD7056WXG\SURWRFROLQFOXGHGFLQH 7UXH)LVSVHTXHQFHV75PV7(PV)$WKLFNPPLQIRXUFKDPEHU YHUWLFDO ORQJ D[LV DQG VKRUWD[LV IROORZHG E\ LQYHUVLRQ UHFRYHU\ 7XUER)ODVK VHTXHQFHVIRU/(HYDOXDWLRQ75PV7(PV7,PVWKLFNPPLQ IRXUFKDPEHUYHUWLFDOORQJD[LVDQGVKRUWD[LVDFTXLUHGPLQXWHVDIWHULY DGPLQLVWUDWLRQRIPPRONJRIJDGROLQLXP/HIWYHQWULFXODUYROXPHV('9HQG SUHVHQWHG'&0WKHUHRISWVGHPRQVWUDWHGDQWDQGLQI/*(DW WKH59LQVHUWLRQVSWVKDGRQO\DQLQIHULRU/*( &RQFOXVLRQ/*(DWWKHVHSWDOULJKWYHQWULFXODUDQWHULRUDQGLQIHULRULQVHUWLRQVLV DIUHTXHQWÀQGLQJLQGLODWLYHDQGK\SHUWURSKLFFDUGLRP\RSDWK\7KLVVSHFLÀF/*( SDWWHUQ VHHPV WR EH XVHIXO LQ WKH GLIIHUHQWLDO GLDJQRVLV RI P\RFDUGLDO GLVHDVH +RZHYHULWVFOLQLFDOUHOHYDQFHUHPDLQVXQFOHDU % 9LVXDOLVDWLRQRIDP\ORLGGHSRVLWLRQLQWKHKHDUWRIIDPLOLDOV\VWHPLF DP\ORLGRVLVXVLQJ>&@%)3(7 07 DVKLUR 6,NHGD.)XUXNDZD12NDPXUD6)XUXPRWR 5,ZDWD.<DQDL&@%)XVXDOO\XVHGIRUHDUO\GLDJQRVLVRI$O]KHLPHUҋVGLVHDVHFDQ YLVXDOLVH WKH ћDP\ORLG GHSRVLWLRQ LQ WKH FDUGLDF PXVFOH RI D IDPLOLDO V\VWHPLF DP\ORLGRVLVSDWLHQW 0HWKRGVDQG0DWHULDOV7KHVXEMHFWZDVDPDQZLWKIDPLOLDOV\VWHPLFDP\ORLGR VLVFRQÀUPHGE\ELRSV\RIJDVWURGXRGHQDOVSHFLPHQ&DUGLDFDP\ORLGRVLVZDV DOVRVWURQJO\VXVSHFWHGE\HFKRFDULRJUDSK\DQG05,)RUWKLVSDWLHQW3(7ZLWK >&@%)WKDWVHQVLWLYHO\DQGVSHFLÀFDOO\ELQGVWRDJJUHJDWHGDP\ORLGÀEULOV ZDVFRQGXFWHG3(7LPDJLQJZDVFRQGXFWHGXVLQJ6(7:6KLPDG]X,QF .\RWR-DSDQ 689YDOXHV LQWKHKHDUWDQG OXQJ ZHUH FRPSDUHG ZLWK WKRVHRI QRUPDOGDWDEDVH 5HVXOWV7KH3(7LPDJHVUHYHDOHGVLJQLÀFDQWO\UREXVWUHWHQWLRQRI>&@%) LQWKHKHDUWRIWKHSDWLHQWFRPSDUHGWRWKHQRUPDOFRQWURO+LVELRSV\VSHFLPHQV IURPWKHGXRGHQXPDOVRVKRZHGKLJKVLJQDOVRI>&@%)689YDOXHRIWKH KHDUWZDVVLJQLÀFDQWO\KLJKHUWKDQWKHQRUPDOGDWDEDVHZKLOHWKRVHRIWKHOXQJ VKRZHGQRVLJQLÀFDQWGLIIHUHQFH &RQFOXVLRQ7 RRXUNQRZOHGJHWKLVLVWKHÀUVWUHSRUWVKRZLQJWKHXVHIXOQHVVRID ћSOHDWHGVKHHWVWUXFWXUHVSHFLÀF3(7LQLQYHVWLJDWLQJYLVFHUDORUJDQDP\ORLGRVLV 1RQHRIWKHSUHYLRXVWUDFHUVZDVDEOHWRVSHFLÀFDOO\ELQGWRDJJUHJDWHGDP\ORLG ZKLFKIRUPVDћSOHDWHGVKHHWVWUXFWXUH,WLVWUXO\LPSRUWDQWWRGHWHFWWKHDFFXPXOD WLRQRIUHDODP\ORLGÀEULOVIRUHDUO\DQGDFFXUDWHGLDJQRVLVRIDP\ORLGRVLV2XUUHVXOW PD\SURYLGHDQHZHYLGHQFHWKDWRXUDP\ORLGVSHFLÀF3(7WUDFHU>&@%) FDQVXFFHVVIXOO\GHWHFWDP\ORLGGHSRVLWLRQLQWKHKHDUWDVZHOO % 0XOWLGHWHFWRUFRPSXWHGWRPRJUDSK\ZLWKODWHHQKDQFHPHQW0'&7 /(IRUSUHWUHDWPHQWSODQQLQJRIYHQWULFXODUWDFK\FDUGLD975)DEODWLRQ &&RODQWRQL$(VSRVLWR) 'H&REHOOL$3DOPLVDQR51&DYDOOLQ *0DFFDEHOOL6&RORPER3 'HOOD%HOOD$'HO0DVFKLR0LODQ,7 3XUSRVH0\RFDUGLDOVFDUVDUHWKHFRPPRQVXEVWUDWHRI97 UDGLRIUHTXHQF\DEOD WLRQ5)DJXLGHGE\HOHFWURDQDWRPLFDOPDS($0LVIUHTXHQWO\WKHWKHUDS\RI FKRLFH$QLPDJLQJWRROSURYLGLQJDQDQDWRPLFDODQGVWUXFWXUDOVXEVWUDWHWRJXLGH ($0DQGVXEVHTXHQW5)DVKRXOGEHDQLPSRUWDQWKHOSWRUHGXFHSURFHGXUDOWLPH DQGLPSURYHVXFFHVVUDWH:HDLPHGWRHYDOXDWH0'&7IRUWKLVUROHEHLQJ05, XVHPDLQO\SUHFOXGHGIURPGHÀEULOODWRUV,&'LPSODQWHGWRSUHYHQWVXGGHQGHDWK 0HWKRGV DQG 0DWHULDOV SWV ZLWK UHFXUUHQW97 XQGHUZHQW VOLFH0'&7 EHIRUH($0DQG5)DLQFOXGLQJDQDQJLRJUDSKLFVFDQDQGDORZHQHUJ\N9 GHOD\HGVFDQ PLQXWHV DIWHU FRQWUDVWPHGLD LQMHFWLRQ 0'&7VFDQV ZHUH PHUJHGZLWK($0V 5HVXOWV0'&7VFDQVZHUHSURVSHFWLYHO\(&*WULJJHUHGLQSWVDQGUHWURVSHF WLYHO\JDWHGLQSWVSWVKDG,&'SWVVKRZHGVXEHSLFDUGLDO/(VXJJHVWLYHIRU SRVWP\RFDUGLWLVVFDUV($0SHUIRUPHGZLWKHSLFDUGLDODSSURDFKFRQÀUPHGVFDUV LGHQWLÀHGDW0'&7/(YROWDJHP9LQDOOWKHVHSWVSWVKDG/(VXJJHVWLYH IRUSRVWLVFKDHPLFVFDUVZLWKVXEHQGRFDUGLDOSWVRUWUDQVPXUDOSWVLQYROYH PHQW/RZYROWDJHDUHDVDW($0SHUIRUPHGZLWKHQGRFDUGLDODSSURDFKPDWFKHG ZLWK/(DUHDVSWGLGQRWVKRZ/(DUHDVDQGXQGHUZHQW5)DLQDUHDVZLWKYROWDJHV EHWZHHQDQGP9ERUGHU]RQHDW($0 &RQFOXVLRQ,QPRVWRIHQUROOHGSDWLHQWV0'&7/(DOORZHGXVWRPDSWKHVFDUV UHVSRQVLEOHIRUHOHFWULFDOVXEVWUDWHRI97 0'&7/(PD\EHSURSRVHGWRSURYLGH DQDWRPLFDQGVWUXFWXUDOVXEVWUDWHIRUJXLGLQJ($0DQG5)DLQSDWLHQWVZLWKUHFXU UHQW97 DOVRVXJJHVWLQJWKHPRUHDSSURSULDWHDSSURDFKHQGRFDUGLDOYVHSLFDUGLDO 0'&7/(LQVWHDGRI05,PD\DOORZLPDJLQJJXLGHDOVRLQSDWLHQWVZLWK,&' 6FLHQWLILF6HVVLRQ $ 6&'()*+%(XURSHDQ&RQJUHVVRI 5DGLRORJ\ 6DWXUGD\ FDWLRQOHYHOVWHQGWRFRQVLGHULVFRPHVIURPWKHHQYLURQPHQW7KHJUHDWPDMRULW\ RISDWLHQWVFRQVLGHUWKDWRQO\FHUWLÀHGSHUVRQQHOVKRXOGRSHUDWHPHGLFDO LPDJLQJHTXLSPHQWEXWQHYHUDVNIRUWKHLUTXDOLÀFDWLRQVRISDWLHQWV FODLPWKDW7 HFKQRORJLVWVKDYHPRUHHGXFDWLRQRQUDGLRORJLFDOSURWHFWLRQDQGDERXW RISDWLHQWVUDUHO\RUQHYHUZRUU\DERXWUDGLDWLRQH[SRVXUHZKHQXQGHUJRLQJ PHGLFDOLPDJLQJH[DPV &RQFOXVLRQ3DWLHQWVRYHUHVWLPDWHWKHULVNVRILQGXVWULDOUDGLDWLRQH[SRVXUHZKLOH WKH\ XQGHUHVWLPDWH WKH DVVRFLDWHG ULVNV RI PHGLFDO UDGLDWLRQ H[SRVXUH DQG WKH 7 HFKQRORJLVWVDELOLW\WRUHGXFHWKHLQKHUHQWUDGLDWLRQH[SRVXUHRIPHGLFDOLPDJLQJ H[DPV3DWLHQWVNQRZOHGJHRQUDGLDWLRQDQGUDGLRORJLFDOSURWHFWLRQLVEDVHGPRUH RQSHUFHSWLRQVDQGEHOLHIVUDWKHUWKDQIDFWXDONQRZOHGJH % $VWXG\RIWKHDZDUHQHVVRI[UD\UDGLDWLRQGRVHVDPRQJ1RUZHJLDQ VWXGHQWUDGLRJUDSKHUV 6.DGD%HUJHQ12VXQGDUDQNDGD#KLEQR 3XUSRVH 7 R DVVHVV WKH OHYHO RI VWXGHQW UDGLRJUDSKHUVҋ NQRZOHGJH FRQFHUQLQJ ERWK WKH UDGLDWLRQ GRVHV UHFHLYHG E\ SDWLHQWV XQGHUJRLQJ FRPPRQO\ UHTXHVWHG UDGLRORJLFDOLQYHVWLJDWLRQVDQGWKHDVVRFLDWHGULVNVRIWKHVHGRVHV 0HWKRGVDQG0DWHULDOV $VXUYH\ZDVVHQWWRDOOUDGLRJUDSK\SURJUDPWHDFKHUVLQ FKDUJHQ LQ1RUZD\DORQJZLWKDUHTXHVWWRDGPLQLVWHUWKHVXUYH\WRÀQDO\HDU VWXGHQWUDGLRJUDSKHUVLQWKHLUÀQDOWHUPRIVWXG\7KHTXHVWLRQQDLUHVSHUWDLQHGWR UDGLDWLRQUHODWHGLVVXHVDQGGHPRJUDSKLFLQIRUPDWLRQ 5HVXOWV7KHUHVSRQVHUDWHZDV7KHPDMRULW\RIWKHVWXGHQWUDGLRJ UDSKHUVUHSRUWHGSRRUNQRZOHGJHRIUDGLDWLRQGRVHV7KH\ZHUHHLWKHULJQRUDQWRIRU XQGHUHVWLPDWHGWKHUDGLDWLRQGRVHVXVHGLQWKHYDULRXVLPDJLQJH[DPLQDWLRQV2QO\ VWXGHQWUDGLRJUDSKHUVDQVZHUHGPRUHWKDQRIWKHLWHPVLQDTXHVWLRQQDLUH GHVLJQHGIRUDVVHVVPHQWRIWKHLUOHYHORINQRZOHGJHFRUUHFWO\2YHUDOOQ RIWKHVWXGHQWUDGLRJUDSKHUVZHUHQRWDZDUHRIWKHUDGLDWLRQGRVHUHFHLYHGIURPD FKHVW[UD\DQGQ RIWKHVWXGHQWVZHUHLJQRUDQWRIWKHDQQXDOGRVHOLPLW IRUWKHSDWLHQWV7KHVWXG\LGHQWLÀHGQRVWDWLVWLFDOO\VLJQLÀFDQWGLIIHUHQFHVDPRQJ UDGLRJUDSK\LQVWLWXWLRQVS DQGEHWZHHQJHQGHUVS &RQFOXVLRQ2YHUDOOÀQDO\HDUVWXGHQWUDGLRJUDSKHUVҋNQRZOHGJHUHJDUGLQJUDGLD WLRQGRVHVDQGWKHULVNVDVVRFLDWHGZLWKLRQLVLQJUDGLDWLRQLVUHSRUWHGWREHSRRU % 5DGLRJUDSKHUҋVUROHLQGRVHRSWLPLVDWLRQLQFRRSHUDWLRQZLWK GHQWLVWVLQRUWKRSDQWRPRJUDSK\ $+HQQHU +3R\VNR$53LHWLOD2XOX),+DXNLSXGDV), DQMDKHQQHU#RDPNÀ 3XUSRVH7 RÀQGRXWFRQVHTXHQFHRIUHIHUUDOLQRUWKRSDQWRPRJUDPLFLPDJLQJRI WKH WHHWK LQ RUGHU WR GHFUHDVH SDWLHQWҋV GRVH )ROORZXS RI GRVHV ZDV PDGH LQ RUGHUWRÀQGRXWKRZSHUPDQHQWLVWKHPDQQHURIGHQWLVWVWRDVNSDUWLDO237* 0HWKRGV DQG 0DWHULDOV 'RVH DUHD SURGXFW '$3 RI GLIIHUHQW SURJUDPV ZDV PHDVXUHGZLWKRXWSDWLHQW7KHYDULDWLRQLQGLIIHUHQWSURJUDPLVODUJHHJZKHQ XVLQJSDUWLDOSURJUDPLQVWHDGRIZKROHPDQGLEOHWRVHYHQ\HDUROGFKLOGGRVHLV RQO\RQHWKLUGIURPF*\FPòWRF*\FPò7KHUDGLRJUDSKHUVDQGGHQWLVWV HYDOXDWHGFULWLFDOO\WKHSUHVHQWSURFHGXUHVYHU\SRRUUHIHUUDOVZLWKRXWDQ\IRFXVHG LQGLFDWLRQDQGGXHWRWKLVRUWKRSDQWRPRJUDPZDVDOZD\VWDNHQDVZKROHPDQGLEOH 'HQWLVWVKDYHEHHQUHPLQGHGRIWKHSRVVLELOLW\RISDUWLDO237*DOVRODWHU)RUPRI 237*ZDVDQDO\VHGIURPGLJLWDODUFKLHYHLQWZRPRQWKSHULRGV 5HVXOWV$IWHU PHHWLQJ WKH GHQWLVWV VWDUWHG WR ZULWH EHWWHU UHIHUUDOV ZLWK FOHDU LQGLFDWLRQVDQGGHWDLOHGLQIRUPDWLRQ2QWKHEDVLVRIWKLVLQIRUPDWLRQUDGLRJUDSKHU WDNHVZKROHRUSDUWLDOPDQGLEOHDQGVHWWKHN9DQGP$DFFRUGLQJWRWKHUHTXLUHG LPDJH TXDOLW\7KH GHQWLVWV KDYH WR EH UHPLQGHG RI WKLV SRVVLELOLW\ WR PDNH WKH SURFHGXUHSHUPDQHQW &RQFOXVLRQ,WLVHDV\WRGHFUHDVHSDWLHQWGRVHLQFRRSHUDWLRQWKHUHIHUUDOGHQWLVWV ,WUHTXLUHVUDGLRJUDSKHUҋVSURIHVVLRQDODWWLWXGHDQGDFWLYLW\WRUHPLQGWKHGHQWLVWVRI WKHLPSRUWDQFHRIUHIHUUDODQGLWVDIIHFWWRSDWLHQWҋVGRVHDQGKDUPVGXHWRLRQLVLQJ UDGLDWLRQWRFKLOGUHQ0XOWLSURIHVVLRQDOFRRSHUDWLRQRSHQGLVFXVVLRQVDQGDZDUH QHVVRIWKHGRVHOHYHOVDUHWKHNH\SRLQWV % 5DGLRJUDSKLFLPDJLQJLPDJHTXDOLW\DQGUDGLDWLRQGRVH RSWLPLVDWLRQLQGLJLWDOLPDJLQJ 03 3RVVDNND9-2NVDQHQ2XOX),PLNDSRVVDNND#JPDLOFRP 'LJLWDO LPDJLQJ DSSOLFDWLRQV KDYH EHHQ LQFUHDVLQJ UDSLGO\ LQ WKH SDVW \HDUV ,PSOHPHQWDWLRQ RI GLJLWDO LPDJLQJ V\VWHPV KDV LQWURGXFHG D QHHG WR VWXG\ WKH SRVVLELOLWLHVWKDWGLJLWDOLPDJLQJKDVWRRIIHU7UDGLWLRQDOWUDGHRIIVEHWZHHQLPDJH TXDOLW\DQGGRVHQRORQJHUH[LVW GLDVWROLFYROXPH(69HQGV\VWROLF69VWURNHYROXPHHMHFWLRQIUDFWLRQ()DQG P\RFDUGLDOPDVVZHUHFDOFXODWHGE\PDQXDOSODQLPHWU\ZLWKDGHGLFDWHGVRIWZDUH /(PDVVZDVPHDVXUHGRQVKRUWD[LVE\PDQXDOSODQLPHWU\DVDQDUHDZLWK6,!6' IURPQRUPDOWLVVXH3DWLHQWVZHUHGLYLGHGLQWRWZRGLIIHUHQWVXEJURXSVZLWK/(JURXS DQGZLWKRXW/(JURXS)RUVWDWLVWLFDODQDO\VLVZHXVHG6SHDUPDQ VFRUUHODWLRQ 5HVXOWV,QJURXSZHREVHUYHGWKHIROORZLQJ5HVXOWV('9PO(69 PO()69PODQG/(PDVVJLQJURXSZHREVHUYHG ('9PO(69PO()69PO$VLJQLÀFDWLYHSRVLWLYH FRUUHODWLRQEHWZHHQ/(PDVVDQG('9S (69S ZDVREWDLQHG PHDQZKLOHDQHJDWLYHFRUUHODWLRQZLWK()S $FRUUHODWLRQEHWZHHQ69DQG /(PDVVZDVQRWUHSRUWHGS &RQFOXVLRQ3DWLHQWVZLWK/(SUHVHQWDZRUVWOHIWYHQWULFXODUIXQFWLRQFRPSDUHG WRFRQWUROJURXS/(PDVVLVFRUUHODWHGZLWKDSURJUHVVLYHV\VWROLFG\VIXQFWLRQ 7KLVÀQGLQJFRXOGEHUHOHYDQWLQWHUPVRIWKHUDSHXWLFDSSURDFKHVSHFLDOO\LQFDVH RIHDUO\+&0RQVHW % %ODFNEORRGYHUVXVEULJKWEORRG7 DFTXLVLWLRQLQFDUGLRYDVFXODU PDJQHWLFUHVRQDQFH&05IRUWKDODVVDHPLDPDMRU70SDWLHQWV ZKLFKFDQGREHWWHU" ,'L*LDPSLHWUR&/LJXRUL,6DQVRQL3 &LDQFLXOOL/0RUWDWR %%HRPRQWH=REHO5RPH,7 3XUSRVH7 RDVVHVVEHWZHHQEODFNEORRGDQGEULJKWEORRG7 &05DFTXLVLWLRQ ZKLFKLVVXSHULRULQWHUPVRILPDJHVDUWHIDFWVSUHVHQFHDQGWRHVWDEOLVKLIVLJQLÀFDQW GLIIHUHQFHVFDQEHIRXQGHGLQWHUPVRI7 YDOXHVLQWUDDQGLQWHUREVHUYHUYDULDELOLW\ 0HWKRGVDQG0DWHULDOV,QDVHWWLQJRI70SDWLHQWVZHSHUIRUPHGERWKFRQ YHQWLRQDOEULJKWEORRGDQGEODFNEORRG7 &05VHTXHQFHVWRGHWHUPLQHLQWUDDQG LQWHUREVHUYHUYDULDELOLW\DQGWKHSUHVHQFHRIDUWHIDFWV,QDOOSDWLHQWVVHSDUDWH VWXGLHV RI ERWK WHFKQLTXHV ZHUH SHUIRUPHG WR DVVHVV LQWHUVWXG\UHSURGXFLELOLW\ ,PDJHTXDOLW\ZDVDVVHVVHGXVLQJDSRLQWJUDGLQJVFDOHRYHU\SRRUTXDOLW\ H[FHOOHQWTXDOLW\DQGLPDJHDQDO\VLVZDVLQDOOFDVHVFRQGXFWHGE\H[SHUL HQFHGREVHUYHUV 5HVXOWV&DUGLDF7 YDOXHVUDQJHGIURPWRPV7KHPHDQ7 YDOXHV ZHUHQRWGLIIHUHQWEHWZHHQEODFNEORRGDQGEULJKWEORRGDFTXLVLWLRQVYV PVS&RPSDUHGZLWKWKHFRQYHQWLRQDOEULJKWEORRGGLDVWROLF DFTXLVLWLRQWKHFRHIÀFLHQWRIYDULDQFHRIWKHEODFNEORRGWHFKQLTXHZDVVXSHULRUIRU LQWUDREVHUYHUUHSURGXFLELOLW\SLQWHUREVHUYHUUHSURGXFLELOLW\S DQGLQWHUVWXG\UHSURGXFLELOLW\S $VVHVVPHQWRIDUWHIDFWVVKRZHGDVXSHULRU VFRUHIRUEODFNEORRGYVZKLWHEORRGVFDQVS &RQFOXVLRQ%ODFNEORRG7 &05KDVVXSHULRUUHSURGXFLELOLW\DQGUHGXFHGLPDJ LQJDUWHIDFWVIRUWKHDVVHVVPHQWRIFDUGLDFLURQLQFRPSDULVRQZLWKWKHFRQYHQWLRQDO EULJKWEORRGWHFKQLTXHZKLFKPDNHLWWKHSUHIHUUHGWHFKQLTXHIRUFOLQLFDOSUDFWLFH 5RRP3 5DGLRJUDSKHUV 66 'RVHDQGWHFKQLTXHRSWLPLVDWLRQIURPWKH UDGLRJUDSKHUҋVSHUVSHFWLYH 0RGHUDWRUV 3%ODFNEXUQ$QGHUVHQ.ROGLQJ'. '7DFN%DXGRXU%( % 3DWLHQWVNQRZOHGJHDERXWUDGLDWLRQDQGUDGLRORJLFDOSURWHFWLRQ -3 3LQKHLUR/3 95LEHLUR65RGULJXHV$) &/$EUDQWHV&$6LOYD 53 3 $OPHLGD)DUR37MRDRSLQKHLUR#JPDLOFRP 3XUSRVH7 RREWDLQDQGDQDO\VHSDWLHQWVNQRZOHGJHDQGSHUFHSWLRQVUHJDUGLQJUD GLDWLRQH[SRVXUHIURPERWKQDWXUDODQGPDQPDGHUDGLDWLRQRIPHGLFDOSURFHGXUHV DQGLQWHUYHQWLRQV9HULI\LISDWLHQWVZRUU\DERXWWKHLUH[SRVXUHZKHQXQGHUJRLQJ PHGLFDOH[DPVDUHDZDUHRIDVVRFLDWHGULVNVDQGPHDQVRIUDGLRORJLFDOSURWHFWLRQ DQGLIWKHLUNQRZOHGJHRQPHGLFDOUDGLDWLRQH[SRVXUHDIIHFWVWKHLURZQGHFLVLRQV 0HWKRGVDQG0DWHULDOV2QDPHGLFDOHQYLURQPHQWDVHOIDSSOLHGTXHVWLRQQDLUH ZDV XVHG DV LQVWUXPHQW DQG DVVLJQHG WR SDWLHQWV ZKR ZRXOG XQGHUJR PHGLFDO LPDJLQJ H[DPV LQYROYLQJ LRQLVLQJ UDGLDWLRQ$ WRWDO RI YDOLG TXHVWLRQQDLUHV ZHUHLQWHUSUHWHGDQGVWDWLVWLFDOO\DQDO\VHGWKURXJKGHVFULSWLYHVWDWLVWLFVDQG3KL &UDPHUV9FRUUHODWLRQWHVWV 5HVXOWVRISDWLHQWVEHOLHYHPRVWRIWKHLUH[SRVXUHGHULYHVIURPHOHFWURQLF DSSOLDQFHVDQGIURPPHGLFDOLPDJLQJH[DPVZKLOHSDWLHQWVZLWKKLJKHUHGX 6FLHQWLILF6HVVLRQ 6 &$' ( ) *+% (XURSHDQ&RQJUHVVRI 5DGLRORJ\ &RQFOXVLRQ 7KH W\SH RI PDPPRJUDSKLF YLHZ DQG WKH SDWLHQWV ERG\ VWURQJO\ LQÁXHQFHWKHGLVWULEXWLRQRIVFDWWHUHG[UD\UDGLDWLRQ7KHVHUHVXOWVFDQEHXVHG WRLPSURYHWKHVKLHOGLQJGHVLJQRIDPDPPRJUDSKLFXQLWZLWKOHVVUHVRXUFHVDQG OHVVVSHQGLQJRQVKLHOGLQJEDUULHUV % 2SWLFDOJXLGDQFHLQSHUFXWDQHRXV&7JXLGHGSURFHGXUHV 1*UHHQEDXP /$SSHOEDXP$+LUVFKHQEHLQ< $SSOEDXP< /LEVRQ -6RVQD-HUXVDOHP,/5DҋDQDQD,/ 3XUSRVH$SRVWPDUNHWLQJSURVSHFWLYHVWXG\ZDVSHUIRUPHGWRDVVHVVDFFXUDF\ DQGVDIHW\RID&7EDVHGYLGHRJXLGDQFHV\VWHP:HDOVRORRNHGDWVKRUWHQLQJRI SURFHGXUHWLPHDQGUHGXFWLRQRIUDGLDWLRQH[SRVXUHRIWKHSDWLHQWV 0HWKRGVDQG0DWHULDOV$OOSDUWLFLSDQWVVLJQHGDQLQIRUPHGFRQVHQWIRUP3HU FXWDQHRXVELRSV\5)DEODWLRQZDVFRQGXFWHGRQSDWLHQWVLQFOXGLQJERWKVRIW WLVVXHDQGERQHOHVLRQV(LJKWSURFHGXUHVZHUH5)DEODWLRQVDQGZHUHELRSVLHV )1$ $OOSURFHGXUHVZHUHSHUIRUPHGXVLQJ $FWL6LJKWQHHGOHJXLGDQFHV\VWHP7KH PLQLDWXUHYLGHRFDPHUDRIWKHV\VWHPÀWWHGDOOQHHGOHVXVHGIRUWKHSURFHGXUHV **DFFRUGLQJWRFRPPRQSUDFWLFH3URFHGXUHUHODWHGGDWDLQFOXGLQJDFFX UDF\WLPHWRUHDFKOHVLRQQXPEHURIVFDQVDQGFRPSOLFDWLRQUDWHVZHUHFRPSLOHG $FWL6LJKW1HHGOH*XLGDQFH6\VWHP$FWL9LHZV+DLID,VUDHOLVGHVLJQHGWRDVVLVW &7JXLGHG LQWHUYHQWLRQV ,W LQFRUSRUDWHV VNLQDWWDFKHG UHIHUHQFH PDUNHUV DQG D PLQLDWXUHYLGHRFDPHUDPRXQWHGRQWKHQHHGOH5HJLVWUDWLRQRIWKHYLGHRLPDJH ZLWKWKH&7LPDJHDOORZVVKRZLQJWKHORFDWLRQRIWKHQHHGOHLQUHDOWLPH 5HVXOWV$FFXUDWHDFFHVVZDVDFKLHYHGLQDOOOHVLRQVVXFFHVV/HVLRQ GLDPHWHUUDQJHGPPPPPHGLDQPP0HDQWLPHIRUFRUUHFWQHHGOHSODFH PHQWZDVPLQ7 RWDOQXPEHURI&7VFDQVXQWLOEHJLQQLQJRIDFWXDOSURFHGXUH ELRSV\DQGRU5)$ZDV &RQFOXVLRQ 2XU SUHOLPLQDU\ H[SHULHQFH VKRZV WKDW$FWL6LJKWDVVLVWHG SURFH GXUHV\LHOGDQDFFXUDWHIDVWSURFHVVZLWKOHVVFRQÀUPDWLRQVFDQVGXULQJQHHGOH SODFHPHQW$FFXUDF\RIQHHGOHSODFHPHQWZDVLQGHSHQGHQWRIWKHOHVLRQVL]HRU GLIÀFXOW\WRUHDFKWKHVSHFLÀFORFDWLRQ7KHUHZHUHQRV\VWHPUHODWHGFRPSOLFDWLRQV % $QRYHORSWLPLVDWLRQVWUDWHJ\LQ&7UHVXOWVLQVLJQLÀFDQWGRVHUHGXFWLRQV ) =DUE0) 0F(QWHH/5DLQIRUG0VLGD076\GQH\$8'XEOLQ,( IUDQFLV]DUE#XPHGXPW 3XUSRVH 7 R FRPSDUH RSWLPLVDWLRQ RI &7 SURWRFROV XVLQJ TXDOLW\ DVVXUDQFH SKDQWRPVDQGDQDWRPLFDOVWUXFWXUHVZLWKLQDSRUFLQHPRGHODUDGLDWLRQGRVHDQG LPDJHTXDOLW\VWXG\ 0HWKRGVDQG0DWHULDOV7KUHHVFDQSURWRFROVZHUHDSSOLHGFXUUHQWFOLQLFDOSUR WRFROVSKDQWRPSURWRFROVEDVHGRQWKHXVHRIORZHVWP$N9DQGKLJKHVWSLWFK VHWWLQJVEHIRUHVLJQLÀFDQWFKDQJHVZHUHREMHFWLYHO\PHDVXUHGRQLPDJHVSURGXFHG IURPD&DWSKDQ&74$SKDQWRPDQGIXUWKHURSWLPLVHGSURWRFROV7KHVH ZHUHDSSOLHGLQ&7VXLWHVIRUDQDWRPLFDOUHJLRQVSRVWHULRUIRVVDFHUHEUXP DEGRPHQ DQG FKHVW ,PDJH TXDOLW\ ZDV HYDOXDWHG XVLQJ UHODWLYH YLVXDO JUDGLQJ DQDO\VLV EDVHG RQ (8 LPDJH TXDOLW\ FULWHULD JXLGHOLQHV WKHQ FULWLFDOO\ UHYLHZHG ZLWKUHVSHFWWR&7',DQG'/3ÀQGLQJV 5HVXOWV&XUUHQWFOLQLFDOSURWRFROVZHUHUHWDLQHGLQRXWRISURWRFROV&DWSKDQ EDVHGSURWRFROVZHUHUHWDLQHGLQFDVHVZLWKDGRVHUHGXFWLRQEHWZHHQ DQGRYHUFXUUHQWFOLQLFDOSURWRFROV)XUWKHURSWLPLVDWLRQZDVDFKLHYHGLQWKH UHPDLQLQJFDVHVZLWKIXUWKHUGRVHUHGXFWLRQVRI &RQFOXVLRQ7KLVVWXG\GHPRQVWUDWHVWKDWGRVHRSWLPLVDWLRQEDVHGRQREMHFWLYH SKDQWRPVFDQLPSURYH&7SURWRFROVHIÀFDF\KRZHYHULIXVHGLQFRQMXQFWLRQZLWK DQLPDOPRGHOVIXUWKHUGRVHDQGLPDJHTXDOLW\RSWLPLVDWLRQFDQEHDWWDLQHG7KH XVHRIDQLPDOVLQGRVHRSWLPLVDWLRQVWUDWHJLHVDOORZVWKHXVHRIPXOWLSOHH[SRVXUHV ZLWKRXWUDGLDWLRQULVNVWRSDWLHQWVIDFLOLWDWLQJH[SHULPHQWDWLRQDQGHYDOXDWLRQRILP DJHTXDOLW\XVLQJDQDWRPLFDOVWUXFWXUHVFRPSDUDEOHWRWKRVHRISDWLHQWV % 3DHGLDWULF&7VFDQQLQJSDUDPHWHUVXVHGLQ*UHHNKRVSLWDOV '.RXPDULDQRV06DORQLNLGRX(=DORQL$WKHQV*5HOL]DORQL#\DKRRJU 3XUSRVH7 RGHWHUPLQHLIVSHFLÀFSURWRFROVUHODWHGZLWKFKLOGUHQDJHVDUHXVHG LQ&7 0HWKRGVDQG0DWHULDOV7KHVXUYH\FRQVLVWHGRITXHVWLRQVDGGUHVVLQJVFDQQHU GHWDLOVDQGVFDQQLQJSDUDPHWHUVXVHGIRUWKUHHH[DPLQDWLRQVEUDLQFKHVWDQG DEGRPHQ&7IRUIRXUDJHJURXSV\HDUVDQGDGXOWV 5HVXOWV7KHVXUYH\ZDVVHQWWRUDGLRJUDSKHUVDQGKRVSLWDOV7KHZHE EDVHGTXHVWLRQQDLUHZDVÀOOHGRXWE\SHRSOH\HWRQO\TXHVWLRQQDLUHVZHUH IXOO\ FRPSOHWHG 7KH VFDQQHU ZDV PDLQO\ LQ SXEOLF KRVSLWDO PXOWLVOLFH ZLWKGHWHFWRUV7KHSDHGLDWULF&7H[DPLQDWLRQZDVDSSOLHG 3XUSRVH7KHSXUSRVHRIWKHVWXG\ZDVWRPDNHDVWDQGDUGRIDFWLYLW\IRURSWL PLVLQJLPDJHTXDOLW\DQGUDGLDWLRQGRVHZLWKWKH&'5$'DQDO\VHUSURJUDPDQG FRQWUDVWGHWDLOSKDQWRP7KHSURGXFWLVLQWHQGHGIRUUDGLRJUDSKHUVVWXGHQWVDQG SURIHVVLRQDOVZRUNLQJLQWKHÀHOGRIUDGLRJUDSKLFLPDJLQJ7KHIXQFWLRQDODLPZDV WRFUHDWHDVWDQGDUGRIDFWLYLW\WKDWHQDEOHGXQLIRUPSURFHGXUHLQRSWLPLVLQJWKH LPDJHTXDOLW\DQGUDGLDWLRQGRVH 0HWKRGVDQG0DWHULDOV,PDJHVZHUHWDNHQXVLQJGLIIHUHQWSDUDPHWHUVP$N9S ÀOWUDWLRQHWF7KUHHLPDJHVZHUHWDNHQZLWKWKHVDPHSDUDPHWHUVWRDFKLHYHEHWWHU UHOLDELOLW\7KHLPDJHVWDNHQRIWKHFRQWUDVWGHWDLOSKDQWRPZHUHHYDOXDWHGZLWK &'5$'DQDO\]HUSURJUDP7KHVWXG\UHYHDOHGKRZGLIIHUHQWLPDJLQJSDUDPHWHUV DIIHFWHGWKHLPDJHTXDOLW\ 5HVXOWV $FFRUGLQJWRWKHUHVXOWVLPDJHTXDOLW\ZDVEHWWHUDQGUDGLDWLRQH[SRVXUH ZDVORZHUZKHQN9SZDVDGGHGWRIURPDQGZKHQPP$ODGGHGÀOWUDWLRQ ZDVXVHG &RQFOXVLRQ7KHUHVXOWVRIWKHSURMHFWFDQEHXWLOLVHGE\UDGLRJUDSKHUVWXGHQWV DVSDUWRIHYLGHQFHEDVHGOHDUQLQJ2XOX8QLYHUVLW\RI$SSOLHG6FLHQFHVFDQDOVR LPSOHPHQWWKHUHVXOWVRIWKHVWXG\LQWKHFXUULFXOXP7KXVUDGLDWLRQVDIHW\FDQEH LPSURYHGLQWKH6FKRRORI+HDOWKDQG6RFLDO&DUHLQDFFRUGDQFHZLWKWKHUHJXOD WLRQVRIWKH0LQLVWU\RI6RFLDO$IIDLUVDQG+HDOWK % 0DPPRJUDSK\LPDJHTXDOLW\LQ6ZLW]HUODQG 15LFKOL0H\VWUH -/%XOOLDUG/DXVDQQH&+(SDOLQJHV&+ QLFROHULFKOL#KHVDYFK 3XUSRVH $OWKRXJKLPDJHTXDOLW\LQPDPPRJUDSK\KDVEHHQSRVLWLYHO\DVVRFLDWHG ZLWKVFUHHQLQJSHUIRUPDQFHPDPPRJUDSK\TXDOLW\KDVVHOGRPEHHQDVVHVVHG,Q 6ZLW]HUODQGUHJLRQDOVFUHHQLQJSURJUDPPHVXQGHUJRVWULFWTXDOLW\PDQDJHPHQW SURFHGXUHVZKLFKLQFOXGHFRQWLQXHGWUDLQLQJRIUDGLRJUDSKHUV7KLVVWXG\DLPHG DWHYDOXDWLQJTXDOLW\RIPDPPRJUDPVLQ6ZLW]HUODQGLWVHYROXWLRQRYHUWLPHDQG DWLGHQWLI\LQJLWVGHWHUPLQDQWV 0HWKRGVDQG0DWHULDOVPDPPRJUDPVSHUIRUPHGEHWZHHQDQG ZHUHUDQGRPO\GUDZQIURPKRVSLWDOVLQFDQWRQVZLWKDQGZLWKRXWDVFUHHQLQJ SURJUDPDQGHYDOXDWHGDFFRUGLQJWRWKH3*0,33HUIHFW**RRG00RGHU DWH,,QDGHTXDWHFODVVLÀFDWLRQV\VWHP'HWHUPLQDQWVRITXDOLW\ZHUHDVVHVVHG E\PXOWLYDULDWHORJLVWLFUHJUHVVLRQVIRULQGLFDWRUVRITXDOLW\ 5HVXOWV 2YHUDOO WKH LQDGHTXDWH LPDJH UDWH GHFUHDVHG RYHU WLPH \HDU &,ZKLOHWKHSURSRUWLRQRIJRRGRUSHUIHFWLPDJHVLQFUHDVHG \HDU&,+LJKHULPDJHTXDOLW\ZDVDVVRFLDWHGZLWK DPDPPRJUDPEHLQJSHUIRUPHGUHFHQWO\IRUDFUDQLRFDXGDOYLHZLQDKRVSLWDO ZLWKDKLJKRXWSXW!PDPPRJUDSKLFLPDJHVUDGLRJUDSKHU\HDUDQGZLWKLQ DVFUHHQLQJSURJUDP7KHLQDGHTXDWHLPDJHUDWHZDV&,ORZHU ZLWKDGLJLWDOPDPPRJUDPDQGDSHUIHFWRUJRRGLPDJHFODVVLÀFDWLRQWZLFHDVOLNHO\ LQWKHFDQWRQZLWKDQRUJDQLVHGVFUHHQLQJSURJUDP25 &, &RQFOXVLRQ0DPPRJUDSK\LPDJHTXDOLW\LVVWHDGLO\LPSURYLQJVLQFH$O WKRXJKTXDOLW\DVVXUDQFHSURFHGXUHVIRUVFUHHQLQJSURJUDPPHVKDVFRQWULEXWHG WR WKH KLJKHU TXDOLW\ WKH GLIIHUHQFH DFURVV VHWWLQJV KDV GHFUHDVHG7KH DQQXDO YROXPHRILPDJHVSHUIRUPHGSHUUDGLRJUDSKHUDSSHDUVWREHDVWURQJSUHGLFWRU RILPDJHTXDOLW\ % 6WXG\RIWKHVFDWWHUHG[UD\GLVWULEXWLRQVDURXQGDPDPPRJUDSK\XQLW 3 (/LPD3 6RXVD65RGULJXHV$) &/$EUDQWHV&$6LOYD/3 95LEHLUR 53 3 $OPHLGD.%$]HYHGR)DUR37SDWULFLDHQHVOLPD#JPDLOFRP 3XUSRVH7 RPHDVXUHWKHGLVWULEXWLRQRIVFDWWHUHGUDGLDWLRQLQDPDPPRJUDSK\ XQLWIRUVKLHOGLQJGHVLJQSXUSRVHV 0HWKRGVDQG0DWHULDOV0HDVXUHPHQWVZHUHFDUULHGRXWZLWKDQDQWKURSRPRUSKLF SKDQWRPXVHGWRVLPXODWHDERG\IURPRQHDGXOWSDWLHQW7KHGRVHUDWHIRUVFDW WHUHG UDGLDWLRQ ZDV UHFRUGHG E\ SODFLQJ D VROLG VWDWH VHQVRU 8QIRUV ;L 6XUYH\ 'HWHFWRUHYHU\GHJUHHVDWPGLVWDQFHIURPWKH)29FHQWUHLQWKHD[LDODQG FRURQDOSODQHVRIWKHEUHDVW7KHVFDWWHUHGUDGLDWLRQGLVWULEXWLRQZDVWUHDWHGDV LVRGRVHFXUYHVVSHFLI\LQJWKHDPRXQWRIUDGLDWLRQWKDWZLOOEHGHOLYHUHGWRDVSH FLÀFSRLQWLQWKHURRPDURXQGWKHHTXLSPHQW*(6HQRJUDSKH'050RUHWKDQ H[SRVXUHVZHUHPDGHZLWKDWXEHYROWDJHRIN9SDQRGHÀOWHUFRPELQDWLRQ 0R0RDQGODUJHIRFXV 5HVXOWV,QWKHD[LDOSODQHUHVXOWVVKRZWKDWWKHVFDWWHUHGUDGLDWLRQLVDEVRUEHG XSWRRQWKHEDFNRIWKHDQWKURSRPRUSKLFSKDQWRPDWWKHSRWWHUEXFN\SODQH KHLJKW ,Q WKH FRURQDO SODQH WKH VFDWWHUHG UDGLDWLRQ VLJQLÀFDQWO\ LQFUHDVHV ZLWK WKH DQJOH GXH WR EDFNVFDWWHULQJ HIIHFW$VVXPLQJ WKH GLUHFWLRQRI WKH LQFLGHQFH EHDPLVGHJUHHUHVXOWVVKRZWKDWWKHVFDWWHUHGUDGLDWLRQLVKLJKHUDW GHJUHHVWKDQDWGHJUHHV 6FLHQWLILF6HVVLRQ $ 6&'()*+%(XURSHDQ&RQJUHVVRI 5DGLRORJ\ 6DWXUGD\ 5HVXOWV(OHYHQRIDOOFDVHVWKDWZHUHFOLQLFDOO\GLDJQRVHGDV&/'$OOFDVHVKDG &7ÀQGLQJVRIHPSK\VHPDWRXVFKDQJH7KHLUPHDQWRWDOOXQJYROXPHZDV PODQGPHDQYROXPHRIHPSK\VHPDWRXVFKDQJHZDVPO 6L[LQIDQWVKDGDVHYHUHLQLWLDOUHVSLUDWRU\FRXUVHDQGZHQWKRPHRQR[\JHQ)LYH RIVL[FDVHVZKRKDGODUJHDPRXQWRIHPSK\VHPDWRXVFKDQJHKDGFRQVHTXHQWO\ EHFRPHZLWKKRPHR[\JHQWKHUDS\7KHLUPHDQYROXPHRIHPSK\VHPDZDVPO 7KHUHZDVQRGLIIHUHQFHEHWZHHQHDFKLOOQHVVW\SHDQGOXQJYROXPHPHDVXUHPHQW &RQFOXVLRQ4XDQWLWDWLYHHYDOXDWLRQRIHPSK\VHPDWRXVFKDQJHVFODVVLÀFDWLRQRI SURJQRVLVLQLQIDQWZLWK&/' % &RURQDU\DUWHU\DEQRUPDOLWLHVLQ.DZDVDNLGLVHDVHFRPSDULVRQ EHWZHHQ&7DQG05FRURQDU\DQJLRJUDSK\ -.LP+*RR6HRXO.5HZRR\D#HPSDOFRP 3XUSRVH7 RFRPSDUHYLVLELOLW\DQGGLDJQRVWLFSHUIRUPDQFHRIFRURQDU\DUWHU\DE QRUPDOLWLHVEHWZHHQ&7DQG05LQFKLOGUHQDQGDGROHVFHQWVZLWK.DZDVDNLGLVHDVH 0HWKRGV DQG 0DWHULDOV %HWZHHQ DQG D WRWDO RI FKLOGUHQ DQG DGROHVFHQWVPDOHVUDQJH\HDUVZLWK.DZDVDNLGLVHDVHZKRSHUIRUPHG &7Q RU05Q FRURQDU\DQJLRJUDSK\ZHUHLQFOXGHGLQWKLVVWXG\,Q RIWKHPERWK&7DQG05ZHUHSHUIRUPHG9LVLELOLW\ZDVJUDGHGRQDSRLQWVFDOH H[FHOOHQWGLDJQRVWLFIRUFRURQDU\DUWHULDOVHJPHQWVRIHDFKSDWLHQW&RUR QDU\DUWHU\DEQRUPDOLWLHVDQHXU\VPVWHQRVLVDQGRFFOXVLRQZHUHHYDOXDWHGRQ&7 DQG05EDVHGRQUHIHUHQFHVWDQGDUGREWDLQHGIURPFDUGLDFFDWKHWHULVDWLRQQ HFKRFDUGLRJUDSK\ Q IROORZXS &7 DQG 05 DQG FOLQLFDO KLVWRU\ &RURQDU\ DUWHU\YLVLELOLW\DQGGLDJQRVWLFSHUIRUPDQFHZHUHFRPSDUHGEHWZHHQ&7DQG05 5HVXOWV2Q&7DQG05VWXGLHVDQGUHVSHFWLYHO\RIFRURQDU\DUWHULDO VHJPHQWVZHUHDVVHVVDEOH3,QSDWLHQWVZLWKERWK&7DQG05 DQGUHVSHFWLYHO\RIWKHPZHUHDVVHVVDEOH32Q&7DQG05 VWXGLHVVHQVLWLYLW\VSHFLÀFLW\SRVLWLYHSUHGLFWLYHYDOXH339QHJDWLYHSUHGLFWLYH YDOXH139DQGDFFXUDF\ZHUHYV3YV 3 YV3 YV3DQG YV3 UHVSHFWLYHO\,QWKHSDWLHQWVWKH\ZHUHYV 3YV3 YV3 YV 3 DQGYV3 UHVSHFWLYHO\ &RQFOXVLRQ&7VKRZVVLJQLÀFDQWO\KLJKHUFRURQDU\DUWHU\YLVLELOLW\VHQVLWLYLW\139 DQGDFFXUDF\LQHYDOXDWLQJFRURQDU\DUWHU\DEQRUPDOLWLHVRI.DZDVDNLGLVHDVH % ,WHUDWLYHLPDJHUHFRQVWUXFWLRQWHFKQLTXHVLQSDHGLDWULF FDUGLRYDVFXODU&7DQJLRJUDSK\LPDJHTXDOLW\DQGSRWHQWLDOIRU UDGLDWLRQGRVHUHGXFWLRQ ) 7ULFDULFR 3 $SIDOWUHU86FKRHSI59OLHJHQWKDUW-56SHDUV *6DYLQR50DUDQR/%RQRPR$+ODYDFHN&KDUOHVWRQ6&6&86 5RPH,7IWUL[#OLEHURLW 3XUSRVH:HDVVHVVHGLPDJHTXDOLW\LPDJHQRLVHDQGWKHSRWHQWLDOIRUIXUWKHU UDGLDWLRQGRVHUHGXFWLRQLQFKLOGUHQXQGHUJRLQJXOWUDORZUDGLDWLRQGRVHFDUGLRYDV FXODU&7DQJLRJUDSK\F&7$XVLQJLWHUDWLYHUHFRQVWUXFWLRQWHFKQLTXHV 0HWKRGV DQG 0DWHULDOV 7ZHQW\IRXU FKLOGUHQ PHGLDQ DJH PRQWKV ZLWK VXVSHFWHGRUNQRZQFRQJHQLWDOFDUGLRYDVFXODUDQRPDOLHVXQGHUZHQWGXDOVRXUFH F&7$ZLWKQ RUZLWKRXWQ (&*V\QFKURQLVDWLRQ'DWDZHUHUHFRQVWUXFWHG ZLWKÀOWHUHGEDFNSURMHFWLRQ)%3LWHUDWLYHUHFRQVWUXFWLRQLQLPDJHVSDFH,5,6 DQGVLQRJUDPDIÀUPHGLWHUDWLYHUHFRQVWUXFWLRQ6$),5()RU(&*V\QFKURQLVHG VWXGLHVKDOIGRVHLPDJHDFTXLVLWLRQZDVVLPXODWHGE\GLVFDUGLQJSURMHFWLRQVIURP RQHWXEH6LJQDOQRLVHZDVPHDVXUHGZLWKLQWKHDVFHQGLQJDQGGHVFHQGLQJDRUWD OHIWDWULXPPDLQSXOPRQDU\DUWHU\DQGWKHWUDFKHD,PDJHTXDOLW\ZDVJUDGHGIURP QRQGLDJQRVWLFWRH[FHOOHQWIRUWKHYHQWULFXODUVHSWXPPLWUDOYDOYHDQGDOO VWUXFWXUHVGHVFULEHGDERYH(IIHFWLYHGRVH('ZDVHVWLPDWHGXVLQJDJHZHLJKW VSHFLÀFFRQYHUVLRQIDFWRUV5HVXOWVZHUHFRPSDUHGXVLQJ7DQG&KLVTXDUHWHVWLQJ 5HVXOWV,PDJHQRLVHZLWK,5,6DQGIXOOGRVH6$),5(ZDVORZHUWKDQZLWK)%3 DQGYHUVXVDOOSZKLOH615ZDVKLJKHU DQGYHUVXVS,PDJHTXDOLW\VFRUHVZHUHKLJKHU IRU,5,6DQGIXOOGRVH6$),5(WKDQIRU)%3DQGYHUVXV S $YHUDJH('ZDVP6YZLWKRXWDQGP6YZLWK(&*V\QFKURQLVDWLRQ ,QKDOIGRVH(&*V\QFKURQLVHG6$),5(VWXGLHVHVWLPDWHGDYHUDJH('P6Y LPDJHQRLVHZDVVWLOOVLJQLÀFDQWO\SORZHUDQG615 KLJKHUWKDQLQIXOOGRVH)%3VWXGLHVZKLOHLPDJHTXDOLW\ZDVPDLQWDLQHG &RQFOXVLRQ$WXOWUDORZUDGLDWLRQGRVHSDHGLDWULFF&7$LWHUDWLYHUHFRQVWUXFWLRQ WHFKQLTXHVLPSURYHLPDJHTXDOLW\DQGKROGSRWHQWLDOIRUVXEVWDQWLDOIXUWKHUUHGXF WLRQVLQUDGLDWLRQH[SRVXUH ZLWKRXWDQ\SDUDPHWHUFKDQJHZLWKUHVSHFWWRDGXOWSURWRFROLQRIFDVHV 3DHGLDWULF&7SDUDPHWHUVZHUHQRWDGMXVWHGRQWKHEDVLVRIWKHDJHRIWKHFKLOGLQ RIFDVHV)RUFKLOGUHQDQG\HDUVROGDQGIRUDGXOWVFRUUHVSRQGLQJO\ WKHWKLUG&7',TXDUWHUZDVFDOFXODWHGDWDQGP*\IRUEUDLQ &7 DQGP*\IRUFKHVW&7DQGDQGP*\ IRUDEGRPHQ&7 &RQFOXVLRQ7KHUHLVDFRQVLGHUDEOHSRWHQWLDOIRUGRVHUHGXFWLRQE\RSWLPLVDWLRQRI VFDQSURWRFROVDQGEHWWHUHGXFDWLRQRIWKHSHUVRQQHO$UHGXFWLRQRI&7',LQDGXOW SURWRFROVXSWRLVUHTXLUHGZKLFKZLOOUHVXOWLQDVLJQLÀFDQWGRVHUHGXFWLRQ LQSDHGLDWULFSURWRFROV % 7KHFRQWUROLQIHFWLRQLQDPDPPRJUDSK\VHWWLQJDORRNLQJRYHU SUDFWLFHVDQGDQDO\VLVRIPLFURRUJDQLVPV 00&3 5LEHLUR (/GH2OLYHLUD-6*RPHV0/*RQFDOYHV -3 &RVWD//DQFD-*2ҋ1HLOO-&0DXULFLR/LVERQ377 RPDU37 PDUJDULGDULEHLUR#HVWHVOLSOSW 3XUSRVH7KHFOHDQLQJDQGGLVLQIHFWLRQRIPHGLFDOVXUIDFHVDQGHTXLSPHQWVDV ZHOOWKHKDQGK\JLHQHDUHEDVLFPHDVXUHVWRJXDUDQWHHVDIHSUDFWLFHVLQWKHFRQWURO LQIHFWLRQRIKHDOWKFDUH7KLVVWXG\DLPHGWRLGHQWLI\WKHVWHSVLQPDPPRJUDSK\ &5FRPSXWRUL]HGUDGLRORJ\SURFHVVFKDUDFWHULVLQJWKHPDFFRUGLQJWRWKHSUHV HQFHRIPLFURRUJDQLVPVDQGLGHQWLI\WKHSUDFWLFHVWKDWOHDGWRWKHLUWUDQVPLVVLRQ 0HWKRGVDQG0DWHULDOV7KHREVHUYDWLRQDOGDWDZHUHFROOHFWHGLQDIRUPIURP:+2 LQRUGHUWRFKDUDFWHULVHWKHK\JLHQHSUDFWLFHVDSSOLHGE\UDGLRJUDSKHUV,QDGGLWLRQ IRUGLIIHUHQWWLPHVPLFURRUJDQLVPVZHUHFROOHFWHGIURPÀYHVXUIDFHVLQWKHPDP PRJUDSK\URRPDQDO\WLFFRPSRQHQW%HIRUHSHUIRUPLQJHDFKH[DPLQDWLRQWKH UDGLRJUDSKHUQHYHUZDVKHGKHUKDQGV8VLQJZDWHUDQGVRDSVKHDOZD\VZDVKHG KHUKDQGVDIWHUWKHH[DPLQDWLRQVH[FHSWLQFDVH2QO\RQHWLPHVKHXVHGDQ DOFRKROEDVHGDQWLVHSWLFVROXWLRQ7KHHTXLSPHQWZDVGLVLQIHFWHGLQRIWKH FDVHV7KHPLFURRUJDQLVPVIRXQGLQWKHPDPPRJUDSK\VXUIDFHVZHUHFRDJXODVH QHJDWLYH6WDSK\ORFRFFXV0LFURFRFFXVVSS6XVSHFWHG(QWHURFRFFXVVSS 6WUHSWRFRFFXV VSS %DFWHULDO FRQWDPLQDWLRQ RI VXUIDFHV DQG WKH SDWKRJHQLFPLFURRUJDQLVP(VFKHULFKLD&ROLFROOHFWHGRQWKHNH\ERDUG 5HVXOWV7KHKDQGVK\JLHQHVKRXOGEHSHUIRUPHGEHIRUHDQGDIWHUWKHFRQWDFW ZLWKWKHSDWLHQWXVLQJDQDOFRKROEDVHGDQWLVHSWLFVROXWLRQ7KHPDPPRJUDSK\ҋV HTXLSPHQWDQGRWKHUPHGLFDOVXUIDFHVPXVWEHGLVLQIHFWHGEHWZHHQHDFKSDWLHQW DWWKHEHJLQQLQJDQGHQGRIHDFKZRUNVHVVLRQ &RQFOXVLRQ$OWKRXJK [UD\ H[DPLQDWLRQV VXFK DV PDPPRJUDSK\ DUH XQGHU YDOXHGLQWKLVPDWWHUGXHWRWKHSURFHGXUHVPRVWO\ZLWKDPEXODWRU\SDWLHQWVWKLV VWXG\DOORZHGWKHLGHQWLÀFDWLRQRIWKHPDQ\W\SHVRIPLFURRUJDQLVPEHLQJRQHRI WKHVHSDWKRJHQLF 5RRP4 3DHGLDWULF 66 +HDUWDQGFKHVW 0RGHUDWRUV &%DODVV\9LHQQD$7 &2ZHQV/RQGRQ8. % 4XDQWLWDWLYHHYDOXDWLRQRIFKURQLFOXQJGLVHDVHLQLQIDQWZLWKWKLQ VHFWLRQ&7 ) 7 VXVKLPD62QR+)XMLWD7 7 RNXGD6.DNHKDWD+6HLQR.6KLEXWDQL +0LXUD< 7 DNDL+LURVDNL-3IP\VWVKP#\DKRRFRMS 3XUSRVH $FOLQLFDOFKURQLFSXOPRQDU\GLVRUGHUJURXSRILQIDQWLVQDPHGZLWKFKURQLF OXQJGLVHDVHFKURQLFOXQJGLVHDVH&/'&/'LVGHÀQHGWKDWDUHVSLUDWRU\GLVWUHVV V\PSWRPWRQHHGR[\JHQDWLRQIROORZVLQIDQF\DKHDGRIRSHQLQJGD\LQVWDUV :HHYDOXDWHGDERYHPHQWLRQHGWKLQVHFWLRQ&7ÀQGLQJVDQGSHUIRUPHGREMHFWLYH TXDQWLÀFDWLRQRIHPSK\VHPDLQSDWLHQWVZLWK&/' 0HWKRGVDQG0DWHULDOV9HU\RUH[WUHPHO\ORZELUWKZHLJKWLQIDQWVRIFDVHV LQWKLVKRVSLWDOLQ6HSWHPEHUVLQFH0D\ZHUHOLVWHG7KHLUPHDQELUWK ZHLJKWZDVJDQGPHDQJHVWDWLRQDODJHZDV ZHHNV7KLQVHFWLRQ&7ZHUHSHUIRUPHGDWZHHNVFRUUHFWHGDJHLQDOOFDVHV 7KHHQWLUHOXQJZDVVFDQQHGZLWKPPVHFWLRQWKLFNQHVVZLWKD0'&7VFDQ QHU/LJKW6SHHG*(86$7KHWRWDOOXQJYROXPH&7QXPEHU+8DQG YROXPHRIHPSK\VHPDWRXVFKDQJH&7QXPEHU+8ZHUHPHDVXUHGXVLQJ WKHWKUHVKROGPHWKRGRQDZRUNVWDWLRQ 6FLHQWLILF6HVVLRQ 6 &$' ( ) *+% (XURSHDQ&RQJUHVVRI 5DGLRORJ\ GHÀQHGDVPRUHWKDQQDUURZLQJRIWKHDLUZD\/RJLVWLFUHJUHVVLRQPRGHOZDV XVHGIRUFRUUHODWLRQEHWZHHQ&7PHDVXUHPHQWVDQGWKHEURQFKRVFRSLFÀQGLQJDQG UHFHLYHURSHUDWLQJFKDUDFWHULVWLFFXUYHZDVXVHGWRÀQGFXWRIIYDOXHV 5HVXOWVFKLOGUHQXQGHU\HDUVLQIDQWVZHUHLQFOXGHGRIZKLFKKDG DLUZD\PDODFLD &7 PHDVXUHPHQWV ZKLFK GHPRQVWUDWHG VLJQLÀFDQW FRUUHODWLRQ ZLWKEURQFKRVFRSLFÀQGLQJVLQFOXGHGWKHVXSUDJORWWLFODU\QJHDO$3$8& WUDFKHDO$3$8&EURQFKLDO$3$8&WUDFKHDO$3WUDFKHDO7UUDWLR $8&EURQFKXV$3GLVWDOWUDFKHDO7UUDWLR$8&DQGDLUZD\QDUURZ LQJLQ'UHFRQVWUXFWHGLPDJHVS &RQFOXVLRQ7KHDFFXUDF\RIIUHHEUHDWKLQJ&7VFDQRIWKHDLUZD\LQGHWHFWLQJ DLUZD\PDODFLDLQFKLOGUHQLVFRPSDUDEOHWRWKHEURQFKRVFRS\ZLWKOHVVHUUDGLDWLRQ GRVHFRPSDUHGWRGXDOSKDVHRUFLQH&7VFDQVRIWKHDLUZD\ % &KHVW05,LQWKHHYDOXDWLRQRISXOPRQDU\DOWHUDWLRQVGHWHFWHGE\&7 LQWKHIROORZXSRISDHGLDWULFSDWLHQWVZLWKPLGGOHOREHV\QGURPH 0/6FRPSDULVRQZLWK;5 *6HUUD*&LDUOR90DVVDFFHVL$)LRUHOOL6/LEHUDOL03DROHWWL &&DWDODQR) 0DFUL) )UDLROL5RPH,7 3XUSRVH7 RDVVHVVWKHPRVWIUHTXHQWSXOPRQDU\DOWHUDWLRQVGHWHFWHGE\&7LQ DJURXSRISHGLDWULFSDWLHQWVDIIHFWHGE\PLGGOHOREHV\QGURPH0/6DWWKHWLPH RIGLDJQRVLVDQGWKHSRVVLEOHUROHRIFKHVW05,LQFRPSDULVRQZLWK;5LQWKHLU IROORZXS 0HWKRGVDQG0DWHULDOVSDWLHQWVZLWK0/6PHDQDJH\HDUVXQGHUZHQWD FKHVW&7DWWLPHRIGLDJQRVLVN9&$5(GRVHZLWKTXDOLW\UHIHUHQFHP$V FROOLPDWLRQ[PPURWDWLRQWLPHVHFVFDQWLPHVHF$WIROORZXS PHDQWLPHPRQWKVDOOSDWLHQWVZHUHHYDOXDWHGZLWKFKHVW05,UHVSLUDWRU\ WULJJHUHG'3ZHLJKWHG%/$'(VHTXHQFH757()29PPÁLS DQJOHVOLFHWKLFNQHVVPPD[LDODQGFRURQDOSODQHDQG;57KHIROORZLQJ OXQJ DOWHUDWLRQV ZHUH DVVHVVHG EURQFKLHFWDVLV EURQFKLDOZDOOWKLFNHQLQJ DWHO HFWDVLVFRQVROLGDWLRQ PXFXVSOXJJLQJ /\PSKDGHQRSDWKLHV ZHUH HYDOXDWHG RQ &7 VDQG05,VIUHTXHQFLHVRIHDFKDOWHUDWLRQZHUHUHFRUGHGIRUHDFKH[DPLQDWLRQ LQDOOSDWLHQWV 5HVXOWV&7DWGLDJQRVLVUHSRUWHGEURQFKLHFWDVLVLQRISDWLHQWVEURQFKLDO ZDOOWKLFNHQLQJ DWHOHFWDVLVFRQVROLGDWLRQ PXFXVSOXJJLQJ O\PSKDGHQRSDWKLHV)ROORZXS05,EURQFKLHFWDVLVLQRISDWLHQWV;5 EURQFKLDOZDOOWKLFNHQLQJ;5DWHOHFWDVLVFRQVROLGDWLRQ;5 PXFXVSOXJJLQJ;5O\PSKDGHQRSDWLHV7KHPRVWIUHTXHQW ORFDOLVDWLRQZDVPLGGOHOREHIRUDOODOWHUDWLRQVERWKDWEDVHOLQHDQGIROORZXS &RQFOXVLRQ &7 HYDOXDWLRQ VKRZHG WKDW 0/6 FDQ EH FKDUDFWHULVHG E\ YDULRXV SDUHQFK\PDODQGDLUZD\VDOWHUDWLRQVDOUHDG\DWGLDJQRVLVDWIROORZXS;5XQGHU HVWLPDWHGWKHQXPEHURIDOWHUDWLRQVFRPSDUHGWRFKHVW05,05,PLJKWUHSUHVHQW DIHDVLEOHRSWLRQLQWKHIROORZXSRISDWLHQWVDIIHFWHGE\0/6 % )ORZVHQVLWLYH'05,RIDRUWLFEORRGÁRZLQSDWLHQWVZLWK0DUIDQ V\QGURPH -*HLJHU 00DUNO5$UQROG%-XQJ'+LUWOHU/+HU]HU%6WLOOHU 0/DQJHU)UHLEXUJ'(&KLFDJR,/86MXOLDJHLJHU#XQLNOLQLNIUHLEXUJGH 3XUSRVH7 RDSSO\ÁRZVHQVLWLYH'05,IRUWKHFKDUDFWHULVDWLRQRIÁRZSDWWHUQ FKDQJHVLQSDWLHQWVZLWK0DUIDQV\QGURPH0)6FRPSDUHGWRQRUPDOFRQWUROV 0HWKRGVDQG0DWHULDOV)ORZVHQVLWLYH'05,RIWKHWKRUDFLFDRUWDWHPSRUDO UHVROXWLRQaPVVSDWLDOUHVROXWLRQaPPYHQF FPVZDVSHUIRUPHGLQ SDWLHQWVPHDQDJH\ZLWKFRQÀUPHG0)6DQGKHDOWK\YROXQWHHUVPHDQDJH \ $RUWLFKDHPRG\QDPLFVZDVYLVXDOLVHGE\'SDUWLFOHWUDFHVDQGVWUHDPOLQHV $EQRUPDOÁRZSDWWHUQVKHOL[DQGYRUWH[ÁRZLQWKHDVFHQGLQJDRUWD$$RDRUWLF DUFKDQGGHVFHQGLQJDRUWD'$RZHUHJUDGHGLQWKUHHFDWHJRULHVEOLQGHGUHDG LQJ REVHUYHUV 4XDQWLWDWLYH HYDOXDWLRQ FRPSULVHG WKH FDOFXODWLRQ RI UHJLRQDO WLPHDYHUDJHGDEVROXWHZDOOVKHDUVWUHVV:66DQGSHDNYHORFLWLHVDWHLJKWVLWHV 5HVXOWV /RFDO KHOLFDO ÁRZ LQ WKH$$R ZDV VLJQLÀFDQWO\ S LQFUHDVHG LQ 0)6 SDWLHQWV DQG ZDV DVVRFLDWHG ZLWK DRUWLF VLQXV GLODWDWLRQ7KH LQFLGHQFH RI JOREDODQGYRUWH[ÁRZLQWKH'$RZDVLQFUHDVHGLQSDWLHQWVDQGFRP SDUHG WR YROXQWHHUV QRQH DQG ,QWHUREVHUYHU DJUHHPHQW ZDV VXEVWDQWLDO ѣ 4XDQWLWDWLYH DQDO\VLV UHYHDOHG D VLJQLÀFDQW LQFUHDVHLQ UHJLRQDO DRUWLF :661PLQSDWLHQWVYV1PLQYROXQWHHUVSDW WKHORFDWLRQRIORFDOKHOL[ÁRZ &RQFOXVLRQ'ÁRZDQDO\VLVUHYHDOHGPDUNHGGLIIHUHQFHVRIWKHDRUWLFÁRZSDW WHUQVEHWZHHQ0)6SDWLHQWVDQGFRQWUROV7KHSUHVHQFHRIORFDOKHOL[ÁRZDQGWKH LQFUHDVHG:66LQWKH0)6SDWLHQWVҋ$$RPD\EHDVVRFLDWHGZLWKWKHLQFUHDVHG LQFLGHQFHRIDRUWLFURRWGLODWDWLRQ7KHKLJKSUHYDOHQFHRIYRUWH[DQGKHOL[ÁRZLQ WKHSUR[LPDO'$RPD\SURPRWH7\SH%GLVVHFWLRQRULJLQDWLQJIURPWKLVVLWH % 1HZFRQYHUVLRQFRHIÀFLHQWVIRUGRVHUHFRQVWUXFWLRQLQKLJK UHVROXWLRQFRPSXWHGWRPRJUDSK\+5&7RIWKHFKHVWLQQHRQDWHV DQGLQIDQWV 0&6HLGHQEXVFK.6FKQHLGHU 0XQLFK'(PLFKDHOVHLGHQEXVFK#PHGXQLPXHQFKHQGH 3XUSRVH5HFRQVWUXFWLRQRIRUJDQDQGWLVVXHGRVHVDFKLHYHGGXULQJFRPSXWHG WRPRJUDSKLF&7H[DPLQDWLRQVLVSHUIRUPHGE\DSSO\LQJFRQYHUVLRQFRHIÀFLHQWV V\QRQ\PRXVO\QRUPDOLVHGRUJDQGRVHVWREDVLFGRVHLQGLFDWRUVOLNHWKH&7',RU WKHGRVHOHQJWKSURGXFW7KHFDOFXODWLRQVRIFRQYHUVLRQFRHIÀFLHQWVSXEOLVKHGVRIDU FRQVLGHURQO\VOLFHWKLFNQHVVHVRIPRUHWKDQPP$VDFRQVHTXHQFHHVSHFLDOO\ LQVPDOORUJDQVWKHWLVVXHGRVHVDUHJUHDWO\XQGHUHVWLPDWHG$V+5&7H[DPLQD WLRQVRIWKHOXQJVLQQHRQDWHVDQGLQIDQWVDUHSHUIRUPHGZLWKVOLFHWKLFNQHVVHVRI PPQHZFRQYHUVLRQIDFWRUVDUHQHHGHG 0HWKRGV DQG 0DWHULDOV )RU WKH FDOFXODWLRQ RI QHZ FRQYHUVLRQ FRHIÀFLHQWV D QHZDOJRULWKPQDPHG&7;ZDVGHYHORSHGE\WKHDXWKRUVLQRUGHUWRDSSO\WKH FRPPHUFLDOO\DYDLODEOH3&;0&0RQWH&DUORDOJRULWKPGHYHORSHGE\WKH)LQQLVK 5DGLDWLRQDQG1XFOHDU6DIHW\$XWKRULW\678.IRUGRVHFDOFXODWLRQVLQ&7 5HVXOWV1HZFRQYHUVLRQFRHIÀFLHQWVIRURUJDQGRVHUHFRQVWUXFWLRQLQ+5&7RI QHRQDWHV DQG \RXQJ LQIDQWV DUH SUHVHQWHG ZLWK D VOLFH UHVROXWLRQ RI PP DQG DQDQJXODUUHVROXWLRQRIZLWKDIRUPDOFRQVLGHUDWLRQRIYDULRXVERZWLHÀOWHUV ,QVPDOORUJDQVVXFKDVWKHWK\URLGJODQGDQGWKHPDPPDU\JODQGVRUJDQGRVHV FDOFXODWHGE\DSSO\LQJWKHQHZPHWKRGFDQH[FHHGWKHWLVVXHGRVHVSUHGLFWHGE\ WKHFRQYHUVLRQFRHIÀFLHQWVSXEOLVKHGVRIDUE\PRUHWKDQ &RQFOXVLRQ $IWHULPSOHPHQWDWLRQRIUHDOERZWLHÀOWUDWLRQGDWDWKHQHZFRQYHUVLRQ FRHIÀFLHQWVVKRXOGDOORZDUHDOLVWLFUHFRQVWUXFWLRQRIRUJDQGRVHVDFKLHYHGGXULQJ +5&7H[DPLQDWLRQVLQQHRQDWHVDQGLQIDQWV % 5DGLDWLRQGRVHUHGXFWLRQLQFKHVW&7ZLWKWKHDGDSWLYHVWDWLVWLFDO LWHUDWLYHUHFRQVWUXFWLRQ$6,5WHFKQLTXHLQFKLOGUHQ 6/HH6HRXO.5 3XUSRVH7 RUHWURVSHFWLYHO\FRPSDUHUDGLDWLRQGRVHDQGLPDJHTXDOLW\RISHGLDWULF FKHVW&7WDNHQZLWKDGDSWLYHVWDWLVWLFDOLWHUDWLYHUHFRQVWUXFWLRQ$6,5DQGZLWK URXWLQHSURWRFRO 0HWKRGVDQG0DWHULDOV7ZHQW\VL[SDHGLDWULFSDWLHQWV0) DJH \HDUVPHDQKDGVHSDUDWHFKHVW&7ZLWKORZGRVH $6,5DQGURXWLQHGRVH RQGLIIHUHQWGD\VEHWZHHQ-DQXDU\DQG-XQHPHDQIROORZXSLQWHUYDO GD\V9ROXPH&7GRVHLQGLFHV&7',YROGRVHOHQJWKSURGXFWV'/3ZHUH UHFRUGHGDQGHIIHFWLYHGRVHZHUHFDOFXODWHGWRHVWLPDWHUDGLDWLRQGRVH7KHLP DJHTXDOLW\ZDVHYDOXDWHGVXEMHFWLYHO\E\WKUHHUDGLRORJLVWVIRUQRLVHVKDUSQHVV DUWHIDFWVDQGGLDJQRVWLFDFFHSWDELOLW\ZLWKDIRXUSRLQWVFDOH2EMHFWLYHQRLVH DQG&7QXPEHUZHUHPHDVXUHGLQWKHGHVFHQGLQJDRUWDDQGSDUDVSLQDOPXVFOH DWWKHOHYHORIFDULQD 5HVXOWV7KH$6,5VWXGLHVSUHVHQWHGDQGUHGXFWLRQVLQ&7',YRO IURPWRP*\'/3IURPWRP*\[FPDQGHIIHFWLYH GRVHIURPWRP6YUHVSHFWLYHO\FRPSDUHGWRWKHURXWLQHGRVHVWXG LHV7KHVXEMHFWLYHLPDJHTXDOLW\ZDVQRWGLIIHUHQWEHWZHHQWKH$6,5DQGURXWLQH SURWRFRO7KHREMHFWLYHQRLVHZDVKLJKHULQWKHSDUDVSLQDOPXVFOHRI$6,5JURXS YVEXWQRWGLIIHUHQWLQWKHDRUWDYV &RQFOXVLRQ7KHXVHRI$6,5ORZHUVWKHUDGLDWLRQGRVHLQSDHGLDWULFFKHVW &7PRUHWKDQZKLOHPDLQWDLQLQJLPDJHTXDOLW\ % &RPSDULVRQRIQRQEUHDWKKHOGVLQJOHSKDVH&7DQG' UHFRQVWUXFWHGEURQFKRVFRSLFLPDJHVZLWKEURQFKRVFRS\IRU GLDJQRVLQJDLUZD\PDODFLDLQLQIDQWV ++RQJ6$,P6HRXO.5GD\GUHDPHUKRQJ#JPDLOFRP 3XUSRVH7KHFOLQLFDOGLDJQRVLVRIDLUZD\PDODFLDLQFKLOGUHQLVGLIÀFXOWDQGDQ DFFXUDWHDQGQRQLQYDVLYHPHWKRGLVEHLQJUHTXLUHG7KHSXUSRVHRIRXUVWXG\ LVWRFRPSDUHWKHDFFXUDF\RIIUHHEUHDWKLQJ&7VFDQVRIWKHDLUZD\LQFKLOGUHQ IRUWKHGLDJQRVLVRIDLUZD\PDODFLDXVLQJEURQFKRVFRS\DVWKH´JROGVWDQGDUGµ 0HWKRGV DQG 0DWHULDOV7KLV UHWURVSHFWLYH VWXG\ LQFOXGHV FKLOGUHQ ZKR UH FHLYHGERWKEURQFKRVFRS\DQG&7VFDQRIWKHDLUZD\VLQRXULQVWLWXWLRQ&7VFDQV LQFOXGHGWKHFKHVWGLPHQVLRQ'&7EURQFKRVFRS\QHFNDQGEUDLQ&7VFDQV $OOSDWLHQWVZHUHVFDQQHGZLWKDQRQEUHDWKKHOGSURWRFROXVLQJDGHWHFWRU PXOWLVOLFHKHOLFDO&7VFDQQHU$QWHURSRVWHULRU$3DQGWUDQVYHUVH7UGLDPHWHUV RIWKHVXSUDJORWWLFODU\Q[JORWWLVWUDFKHDDQGEURQFKXVZHUHPHDVXUHGLQWKHD[LDO &7VFDQV $LUWUDSSLQJDQGDLUZD\QDUURZLQJLQWKH'UHFRQVWUXFWHGLPDJHVZHUH FKHFNHG%URQFKRVFRS\ZDVXVHGDVWKHJROGVWDQGDUGDQGDLUZD\PDODFLDZDV 6FLHQWLILF6HVVLRQ $ 6&'()*+%(XURSHDQ&RQJUHVVRI 5DGLRORJ\ 6DWXUGD\ % ´0DJQHWLFUHVRQDQFHPDPPRJUDSK\KDVDKLJKVHQVLWLYLW\EXWORZ VSHFLÀFLW\µQHZWKRXJKWVDQGIUHVKGDWDRQDQROGPDQWUD 0'LHW]HO.6FKRHQ5=RXEL+3 %XUPHLVWHU0*DMGD,%5XQQHEDXP :$.DLVHU3 $7 %DOW]HU-HQD'(GLHW]HOPDWWKLDV #KRWPDLOFRP 3XUSRVH (YHQ LQ LWV UG GHFDGH RI FOLQLFDO DSSOLFDWLRQ GLDJQRVWLFDFFXUDF\ RI 05PDPPRJUDSK\ 050 LV VWLOO QRW ZHOO XQGHUVWRRG DQG UHPDLQV GLVFXVVHG FRQWURYHUVLDOO\ 7 R D PDMRU SDUW WKLV LV FHUWDLQO\ GXH WR GLIIHUHQW VWDQGDUGVRI UHIHUHQFH625KLVWRORJLFDOYHULÀFDWLRQIROORZXSHWFDQGFRPSRVLWLRQRISDWLHQW FROOHFWLYHVLQSUHYLRXVVWXGLHVSDUWLFXODUO\WKHJURXSRIWUXHQHJDWLYH050UHVXOWV LVFKDOOHQJLQJWRDQDO\VHDVVXFKRIWHQGRQRWJHWKLVWRORJLFDOVDPSOLQJDQ\PRUH DQGDUHIROORZHGXSFOLQLFDOO\UDGLRORJLFDOO\,QWKLVVFHQDULRRQO\ORQJWHUP050 IROORZXSLVDEOHWRSURYLGHDYDOLG625$FFRUGLQJO\ZHGHVLJQHGWKLVLQYHVWLJD WLRQWRLGHQWLI\WKHDFFXUDF\RI050DVLQWHUSUHWHGE\QRQH[SHUWUHDGHUVGHÀQLQJ KLVWRORJLFDOYHULÀFDWLRQDQGORQJWHUP050IROORZXSDV625 0HWKRGVDQG0DWHULDOV2YHU\HDUVDOOFRQVHFXWLYHSDWLHQWVUHFHLYLQJ050ZLWK VXEVHTXHQWKLVWRORJLFDOYHULÀFDWLRQRU050IROORZXS!\HDUVZHUHLQFOXGHGLQWR WKLV SURVSHFWLYH FURVVVHFWLRQDO LQYHVWLJDWLRQ H[FOXVLRQ %,5$'6 9, DGMXYDQW QHRDGMXYDQW FKHPRWKHUDS\ RU DQ\ RWKHU EUHDVWWUHDWPHQW EHWZHHQLQLWLDO DQG IROORZXS050,QLWLDO050ZDVLQWHUSUHWHGE\QRQH[SHUWUHDGHUVa050 3ULPDU\ 050GLDJQRVLV DQG UHVXOWV RI WKH UHIHUHQFHVWDQGDUGV KLVWRORJ\ ÀQG LQJV XSRQ ORQJWHUP IROORZXS 625KLVWRORJ\625IROORZXS ZHUHDVVHVVHG E\ FRQWLQJHQF\WDEOHV 5HVXOWV SDWLHQWV ZHUH LQFOXGHG 625KLVWRORJ\ 625IROORZXS 3UHWHVWSUREDELOLW\ ZDV 0DLQ LQGLFDWLRQ IRU LQLWLDO050 ZDV VFUHHQLQJ IRU UHFXUUHQFH RI EUHDVWFDQFHU RU %,5$'6 ,, ,,, DQG ,9 FODVVLÀFDWLRQLQFRQYHQWLRQDOLPDJLQJ7KHQRQH[SHUWUHDGHUVDFKLHYHG KLJKVSHFLÀFLW\DQGSRVLWLYHOLNHOLKRRGUDWLR2YHUDOODFFXUDF\UHDFKHG H[FHOOHQWRGGVUDWLR6HQVLWLYLW\QHJDWLYHSUHGLFWLYHYDOXH DQGQHJDWLYHOLNHOLKRRGUDWLR &RQFOXVLRQ 050 SURYLGHV H[FHOOHQW RYHUDOO GLDJQRVWLF DFFXUDF\ VHQVLWLYLW\ DQGQHJDWLYHSUHGLFWLYH(YHQLQQRQH[SHUWUHDGHUV050KDVDKLJKVSHFLÀFLW\ % &RPSXWHUDLGHGGLDJQRVLV&$'[LVDIHDVLEOHSURJQRVWLFELRPDUNHU IRUWKHQRQLQYDVLYHSUHGLFWLRQRID[LOODU\O\PSKQRGHPHWDVWDVHV 0'LHW]HO5=RXEL++DEUHFKW0*DMGD,%5XQQHEDXP:$.DLVHU 3 $7 %DOW]HU-HQD'(GLHW]HOPDWWKLDV#KRWPDLOFRP 3XUSRVH&RPSXWHUDLGHGGLDJQRVLV&$'[DOORZVVHPLDXWRPDWLFDVVHVVPHQW RIEUHDVWOHVLRQLQ05PDPPRJUDSK\0503UHYLRXVLQYHVWLJDWLRQVVXJJHVWHG WKDWVXFK&$'[GDWDPLJKWQRWRQO\EHXVHGIRUGLIIHUHQWLDOGLDJQRVLVRIEHQLJQYV OHVLRQVEXWFRXOGDOVRSURYLGHVRPHSURJQRVWLFLQIRUPDWLRQ:HDLPHGWRIXUWKHU HYDOXDWHWKLVDSSURDFKDQGHYDOXDWHGWKHSRWHQWLDORI&$'[WRSUHGLFWWKHPRVW VLQJOHLPSRUWDQWSURJQRVWLFIDFWRULQSULPDU\EUHDVWFDQFHULHD[LOODU\O\PSKQRGH PHWDVWDVLVE\&$'[EDVHGDQDO\VLVRI050 0HWKRGVDQG0DWHULDOVFRQVHFXWLYH SDWLHQWVZLWKSULPDU\LQYDVLYHEUHDVW FDQFHUUHFHLYLQJSUHWKHUDSHXWLFVWDJLQJ050DFFRUGLQJWR(862%,JXLGHOLQHV ZHUHLQFOXGHGLQWRWKLVSURVSHFWLYHFURVVVHFWLRQDOVWXG\6XUJLFDOD[LOODU\VWDJLQJ ZDVGHÀQHGDVUHIHUHQFHVWDQGDUG%UHDVW05,ZDVDQDO\VHGXVLQJFRPPHUFLDO &$'VRIWZDUH,WHYDOXDWHVVHPLDXWRPDWLFDOO\IXQFWLRQDOWLVVXHSDUDPHWHUVRIWKH PRVWVXVSHFWYR[HODVZHOORIWKHZKROHWXPRXUHJLQLWLDOHQKDQFHPHQWZDVKRXW SHDNHQKDQFHPHQWWLPHWRSHDNHQKDQFHPHQWHWF6LJQLÀFDQWDQGLQGHSHQGHQW SUHGLFWRUVIRUO\PSKQRGHPHWDVWDVLVZHUHLGHQWLÀHGORJLVWLFUHJUHVVLRQEDFNZDUG IHDWXUHVHOHFWLRQDQGFRPELQHGLQWRDPXOWLYDULDWHPRGHOWRSUHGLFWQRGDOSRVLWLYH EUHDVWFDQFHUV$8&DUHDXQGHUWKH52&FXUYH 5HVXOWV 7KHUH ZHUH QRGDOSRVLWLYH DQG QRGDOQHJDWLYH FDQFHUV %/5$ LGHQWLÀHG&$'SDUDPHWHUVDVVLJQLÀFDQWLQGHSHQGHQWSUHGLFWRUVIRUWKHSUHGLF WLRQ RI O\PSKQRGHPHWDVWDVLV 3 0XOWLYDULDWH DQDO\VLV UHDFKHG KLJK DFFXUDF\$8&VWDQGDUGHUURUDQGPRGHUDWHPRGHOÀWUWR SUHGLFWQRGDOSRVLWLYHFDQFHUV &RQFOXVLRQ &$'[EDVHG LQWHUSUHWDWLRQ RI 05PDPPRJUDSK\ LV D VLJQLÀFDQW SUHGLFWRU RI D[LOODU\ O\PSKQRGHPHWDVWDVLV$FFRUGLQJO\ LW FRXOG EH XVHG DV D SURJQRVWLFELRPDUNHUDQGVKRXOGEHIXUWKHULQYHVWLJDWHGIRUSRWHQWLDOQRQLQYDVLYH ULVNVWUDWLÀFDWLRQRIEUHDVWFDQFHUSDWLHQWVLQIXWXUHVWXGLHV % 4XDQWLWDWLYHSXOPRQDU\SHUIXVLRQLPDJLQJDW7RI\HDUROG FKLOGUHQDIWHUFRQJHQLWDOGLDSKUDJPDWLFKHUQLD&'+UHSDLU :1HII.=DKQ7 6FKDLEOH626FKRHQEHUJ/56FKDG) *=RHOOQHU 0DQQKHLP'(ZROIJDQJQHII#XPPGH 3XUSRVH7 RLQYHVWLJDWHZKHWKHUG\QDPLFFRQWUDVWHQKDQFHG05LPDJLQJ'&( 05, RI WKH OXQJ LQ VXUYLYRUV DIWHU &'+UHSDLU DW 7 LV IHDVLEOH LQ \HDUROG FKLOGUHQ 0HWKRGVDQG0DWHULDOVFKLOGUHQZLWKDPHDQDJH\HDUVDQGNJ RIERG\ZHLJKWDIWHU&'+UHSDLULQFOXGLQJIHPDOHDQGPDOHFKLOGUHQXQGHUZHQW '&(05,DW7XVLQJDWLPHUHVROYHGDQJLRJUDSK\ZLWKVWRFKDVWLFWUDMHFWRULHV 7:,67VHTXHQFH4XDQWLÀFDWLRQRIOXQJSHUIXVLRQZDVSHUIRUPHGXVLQJDSL[HO E\SL[HOGHFRQYROXWLRQDSSURDFKLPSOHPHQWHGLQDQLQKRXVH2VLUL;SOXJLQ6L[ 52,VZHUHFDUHIXOO\SODFHGLQWKHXSSHUPLGGOHDQGORZHUSDUWRIWKHULJKWDQGOHIW OXQJWRDFFHVVGLIIHUHQFHVLQSXOPRQDU\EORRGÁRZZKLOHDYRLGLQJWKHLQFOXVLRQRI ODUJHUSXOPRQDU\DUWHULHVDQGYHLQV 5HVXOWV$YHUDJHUHJLRQDOSXOPRQDU\EORRGÁRZU3%)IRUWKHK\SRSODVWLFOXQJV ZDV P/ P/PLQ DQG P/ P/PLQ IRU WKH FRQWUDODWHUDO VLGH7KH GLIIHUHQFH EHWZHHQ K\SRSODVWLF DQG FRQWUDODWHUDO OXQJ ZDV VLJQLÀFDQW S $OVRWKHGLIIHUHQFHVLQU3%)PHDVXUHGLQWKHDSLFDOPLGGOHDQGORZHU OXQJZHUHVLJQLÀFDQWO\GLIIHUHQWEHWZHHQK\SRSODVWLFOXQJVDQGFRQWUDODWHUDOVLGHV DSLFDOS PLGGOHS ORZS 6LJQLÀFDQWGLIIHUHQFHVEHWZHHQ XSSHUPLGGOHDQGORZHUOXQJUHJLRQVRIWKHVDPHVLGHFRXOGQRWEHGHWHFWHG &RQFOXVLRQ '&(05, RI WKH OXQJ LQ \HDUROG SDWLHQWV LV IHDVLEOH DW 7 ,SVLODWHUDOOXQJK\SRSODVLDZLWKUHGXFHGSHUIXVLRQLVUHÁHFWHGE\VLJQLÀFDQWORZHU U3%)YDOXHVFRPSDUHGWRWKHFRQWUDODWHUDOOXQJ'&(05,RIWKHOXQJLQ&'+FDQ KHOSFKDUDFWHULVLQJOXQJK\SRSODVLDLQLWLDOO\DQGLQORQJWHUPIROORZXSRIFKLOGUHQ DIWHU&'+UHSDLU 5RRP= &RPSXWHU$SSOLFDWLRQV 66 &RPSXWHUDVVLVWHGGLDJQRVLV&$' 0RGHUDWRUV %0HUOLQR5RPH,7 5YDQҊW.ORRVWHU/HLGHQ1/ % $VLPSOHDQGUREXVWFODVVLÀFDWLRQWUHHIRUGLIIHUHQWLDWLRQEHWZHHQ EHQLJQDQGPDOLJQDQWOHVLRQVLQ05PDPPRJUDSK\ 3 $7 %DOW]HU7 *URHVFKHO+3 %XUPHLVWHU:$.DLVHU0'LHW]HO -HQD'(SDVFDOEDOW]HU#PHGXQLMHQDGH 3XUSRVH $PXOWLWXGHRIOHVLRQGHVFULSWRUVKDVEHHQSURSRVHGLQRUGHUWRLPSURYH GLIIHUHQWLDOGLDJQRVLVLQEUHDVW05,,QFOLQLFDOURXWLQHDSUDFWLFDODOJRULWKPIRUOHVLRQ FODVVLÀFDWLRQLVQHHGHG6XFKDQDOJRULWKPVKRXOGEHDVVLPSOHDVSRVVLEOHDQG LQFOXGHRQO\WKHPRVWLPSRUWDQWOHVLRQIHDWXUHVZLWKWKHKLJKHVWSRZHUWRGLIIHUHQWL DWHEHQLJQIURPPDOLJQDQWOHVLRQV7KLVLQYHVWLJDWLRQZDVSHUIRUPHGLQRUGHUWR GHYHORSDVLPSOHFODVVLÀFDWLRQWUHHIRUGLIIHUHQWLDOGLDJQRVLVLQDODUJHGDWDEDVH DQGHVWLPDWHLWVGLDJQRVWLFDFFXUDF\ 0HWKRGVDQG0DWHULDOVOHVLRQVLQVWDQGDUGLVHGEUHDVW05,7 G\QDPLF 7ZDIWHUPPRO*G'73$7Z76(ZLWKKLVWRORJLFDOYHULÀFDWLRQPDOLJ QDQWEHQLJQZHUHLQYHVWLJDWHGFDWHJRULFDOOHVLRQGHVFULSWRUVZHUHDV VHVVHGE\H[SHULHQFHGUHDGHUV&ODVVLÀFDWLRQDQDO\VLVZDVSHUIRUPHGXVLQJWKH &KLVTXDUHGDXWRPDWLFLQWHUDFWLRQGHWHFWLRQ&+$,'PHWKRG5HVXOWVLQFOXGHWKH SUREDELOLW\IRUPDOLJQDQF\IRUHYHU\GHVFULSWRUFRPELQDWLRQLQWKHFODVVLÀFDWLRQWUHH 5HVXOWV$FODVVLÀFDWLRQWUHHLQFRUSRUDWLQJOHVLRQGHVFULSWRUVZLWKDGHSWKRI UDPLÀFDWLRQVURRWURRWOLNHERUGHUGHQGULWHGHOD\HGHQKDQFHPHQW3HUVLVW HQW3ODWHDX:DVKRXWERUGHULQWHUQDOHQKDQFHPHQWRHGHPDDQGWHUPLQDO QRGHVZDVFDOFXODWHGRIDOOEHQLJQDQGRIDOOPDOLJQDQWOHVLRQVZHUH FRUUHFWO\LGHQWLÀHGPDOLJQDQWDQGEHQLJQOHVLRQVFRXOG EHFODVVLÀHGZLWKDQDFFXUDF\DERYH &RQFOXVLRQ7KHFODVVLÀFDWLRQDOJRULWKPXVHGZDVDEOHWRUHGXFHWKHQXPEHURI FDWHJRULFDOGHVFULSWRUVWREHDQDO\VHGIURPWRUHVXOWLQJLQDKLJK FODVVLÀFDWLRQDFFXUDF\0RUHWKDQRQHWKLUGRIDOOOHVLRQVFRXOGEHFODVVLÀHGZLWK DQDFFXUDF\DERYH 6FLHQWLILF6HVVLRQ 6 &$' ( ) *+% (XURSHDQ&RQJUHVVRI 5DGLRORJ\ 0HWKRGVDQG0DWHULDOV7KLVUHWURVSHFWLYHVWXG\ZDVDSSURYHGE\RXU,5%DQG LQFRPSOLDQFHZLWK+,3$$UHJXODWLRQV $PRQJFRQVHFXWLYHF&7$H[DPLQDWLRQV ZHUHRIDGHTXDWHTXDOLW\IRUDXWRPDWHGHYDOXDWLRQE\&25$QDO\VHU5FDGLD 0HGLFDO,PDJLQJ+DLID,VUDHO)LQGLQJVZHUHFRPSDUHGWRKXPDQH[SHUWLQWHU SUHWDWLRQIRUGHWHFWLRQRIVWHQRVLVGHÀQHGDVYHVVHOGLDPHWHUUHGXFWLRQLQ WKHOHIWPDLQ/0OHIWDQWHULRUGHVFHQGLQJ/$'FLUFXPÁH[/&[ULJKWFRURQDU\ DUWHU\5&$RUDUWHULDOVLGHEUDQFKHV 5HVXOWV $PRQJFDVHVHYDOXDWHGE\WKH&25$QDO\VHUKXPDQH[SHUWLQWHUSUH WDWLRQLGHQWLÀHGSDWLHQWVZLWKVWHQRVLV2QDSHUSDWLHQWSHUYHVVHOOHYHO WKH&25$QDO\VHUUHYHDOHGDVHQVLWLYLW\RIDVSHFLÀFLW\RI D QHJDWLYH SUHGLFWLYH YDOXH RI DQG D SRVLWLYH SUHGLFWLYH YDOXH RI :LWKUHVSHFWWRLQGLYLGXDOVHJPHQWVWKH&25$QDO\VHUGHWHFWHG /0OHVLRQV/$'OHVLRQV/&[OHVLRQV5&$OHVLRQVDQGDUWH ULDOVLGHEUDQFKHV)DOVHSRVLWLYHLQWHUSUHWDWLRQVZHUHORFDOLVHGWRWKH/0Q /$'Q /&[Q 5&$Q DQGDUWHULDOEUDQFKHVQ DQGZHUHUHODWHG SUHGRPLQDQWO\WRRYHUHVWLPDWLRQRIVWHQRWLFOHVLRQVZLWKOHVVWKDQGLDPHWHU DQGFDOFLÀHGYHVVHOV &RQFOXVLRQ $QDXWRPDWHGFRPSXWHGDLGHGGHWHFWLRQDOJRULWKPRIVWHQRWLFOHVLRQV RQF&7$SURYLGHVDKLJKQHJDWLYHSUHGLFWLYHYDOXHWRUXOHRXW$&6LQSDWLHQWVZLWK DFXWHFKHVWSDLQDQGDQLQWHUPHGLDWHSUHWHVWOLNHOLKRRGIRU$&6 % $FRPSXWHUDVVLVWHGPHWKRGIRUWKHUDSLGDQGDFFXUDWHDVVHVVPHQW RIOHIWYHQWULFXODUYROXPHVHMHFWLRQIUDFWLRQDQGPDVVE\05, 00D]RQDNLV.3DJRQLGLV-'DPLODNLV,UDNOLRQ*5PD]RQDN#PHGXRFJU 3XUSRVH7 RGHYHORSDQGHYDOXDWHDFRPSXWHUDVVLVWHGVWHUHRORJLFDOPHWKRGIRU WKHDVVHVVPHQWRIOHIWYHQWULFXODU/9VL]HDQGIXQFWLRQIURP05,GDWD 0HWKRGVDQG0DWHULDOV6KRUWD[LV05,VOLFHVFRYHULQJWKHHQWLUH/9ZHUHRE WDLQHG IURP FRQVHFXWLYH VXEMHFWV ZLWK VXVSHFWHG FRURQDU\ DUWHU\ GLVHDVH$ FRPSXWHUJHQHUDWHGV\VWHPDWLFJULGRIWHVWSRLQWVZDVUDQGRPO\VXSHULPSRVHG RQHDFKVOLFH&URVVVHFWLRQDO/9DUHDVZHUHHVWLPDWHGXVLQJWKHVHPLDXWRPDWLF VWHUHRORJLFDOSRLQWFRXQWLQJPHWKRG7KH/9YROXPHVHMHFWLRQIUDFWLRQDQGPDVV ZHUHFDOFXODWHGWKURXJKWKHV\VWHPDWLFVOLFHVDPSOLQJSURFHGXUH7KHUHSURGXF LELOLW\RIVWHUHRORJLFDOPHWKRGZDVGHWHUPLQHGE\WKUHHLQGHSHQGHQWREVHUYHUV7KH SDUDPHWHUVGHULYHGIURPPDQXDOO\WUDFHG/9FRQWRXUVVHUYHGDVUHIHUHQFHYDOXHV 5HVXOWV6WHUHRORJLFDOYROXPHDVVHVVPHQWVREWDLQHGE\VDPSOHVFRQVLVWLQJRI HYHU\WKLUGVOLFHGHSLFWLQJ/9GLIIHUHGVLJQLÀFDQWO\IURPWKRVHE\PDQXDOWUDFLQJ S6DPSOHVRIVOLFHVDULVLQJIURPWKHV\VWHPDWLFVDPSOLQJVFKHPH SURYLGHGYROXPHHVWLPDWLRQVZLWKDPHDQFRHIÀFLHQWRIHUURURILQOHVV WKDQPLQ1RGLIIHUHQFHZDVIRXQGEHWZHHQWKHUHIHUHQFHYDOXHVDQG/9SD UDPHWHUVHVWLPDWHGE\WKHVDPSOLQJLQWHQVLW\S!7KHVHVWHUHRORJLFDO HVWLPDWLRQVZHUHKLJKO\FRUUHODWHGZLWKWKHUHIHUHQFHYDOXHVU 7KH OLPLWVRIDJUHHPHQWEHWZHHQWKHWZRPHWKRGVZHUHFOLQLFDOO\DFFHSWDEOHHQG GLDVWROLFYROXPHWRFPHQGV\VWROLFYROXPHWRFPHMHFWLRQ IUDFWLRQWRPDVVWRJ7KHLQWUDREVHUYHUDQGLQWHUREVHUYHU YDULDELOLWLHVDVVRFLDWHGZLWKWKHVWHUHRORJLFDOHVWLPDWLRQVZHUHDQG UHVSHFWLYHO\ &RQFOXVLRQ 6WHUHRORJLFDO DQDO\VLV RQ V\VWHPDWLFDOO\ VDPSOHG 05, VOLFHV DOORZVWKHUHSURGXFLEOHDQGDFFXUDWHDVVHVVPHQWRI/9SDUDPHWHUVZLWKUHGXFHG XVHULQWHUYHQWLRQ % $XWRPDWHGEUDQFKQDPHODEHOOLQJV\VWHPRIWUDFKHREURQFKLDOWUHH E\FRPSXWDWLRQDODQDWRP\ +1DWRUL 00RUL+7 DNDEDWDNH++RQPD< 1LPXUD.0RUL 6DSSRUR-31DJR\D-3KQDWRUL#VDSPHGDFMS 3XUSRVH)RUFRPSXWDWLRQDODQDWRP\ZHSURSRVHGWKHV\VWHPWKDWDXWRPDWLFDOO\ DVVLJQHGDQDWRPLFDOQDPHVWRWKHEURQFKLDOEUDQFKHVH[WUDFWHGIURPPXOWLGHWHFWRU &70'&7GDWD'HVLJQHGV\VWHPZDVDEOHWRSURFHVVYDULDQWFDVHVRIEUDQFKLQJ W\SHVRIWUDFKHREURQFKLDOWUHH 0HWKRGVDQG0DWHULDOV1HZ9(6YLHZHUGHYHORSHGE\FRDXWKRU.0ZDVXVHG IRUYLUWXDOEURQFKRVFRS\%URQFKLDOPRGHOVEDVHGRQ0'&7GDWDVHWVZHUHPDGH XVLQJUHFRJQLWLRQRIEUDQFKLQJSDWWHUQDQGGLUHFWLRQVRIWKRVHEUDQFKHV0DFKLQH OHDUQLQJDSSURDFKZDVHPSOR\HGIRUWKLVV\VWHP0'&7GDWDRIFDVHVZHUH XVHG DV WUDLQLQJ GDWD )RU HYDOXDWLRQ RI WKH DXWRPDWHG EUDQFK QDPH ODEHOOLQJ V\VWHPQHZH[WHUQDOFDVHVRI0'&7GDWDZHUHXVHG 5HVXOWV,QYLUWXDOEURQFKRVFRS\EURQFKLDOQDPHVZHUHDXWRPDWLFDOO\RYHUODLGRQ QDYLJDWLRQ LPDJHV %URQFKLDO QDPHV VHTXHQWLDOO\ DSSHDUHG IURP WUDFKHD PDLQ EURQFKLOREDUEURQFKLWRVHJPHQWDOEURQFKL1DPHVRIVXEVHJPHQWDOEURQFKLZHUH DOVRVKRZQIUHTXHQWO\DQGVXEVXEVHJPHQWDOEURQFKLZHUHVKRZQLQVRPHFDVHV $XWRPDWHG EUDQFK QDPH ODEHOOLQJ V\VWHP ZRUNHG SURSHUO\ HYHQ IRU WKH YDULDQW % &RPSXWHUDLGHGGHFLVLRQVXSSRUWIRUWKHFKDUDFWHULVDWLRQRIOLYHU OHVLRQVLQ&7VFDQV 0+DPPRQ3 'DQNHUO0&RVWD$7 V\PEDO66HLIHUW06KOLQJ08GHU $&DYDOODUR(UODQJHQ'(PDWWKLDVKDPPRQ#XNHUODQJHQGH 3XUSRVH'DLO\URXWLQHRIUDGLRORJLVWVLQFOXGHVGLIIHUHQWLDWLQJDYDULHW\RIOHVLRQ W\SHVLQ&7VFDQVDFKDOOHQJLQJDQGWLPHFRQVXPLQJWDVN:HHYDOXDWHGDQLQ QRYDWLYH7+(6(860(',&2&%,5&$'FRQWHQWEDVHGLPDJHUHWULHYDOFRPSXWHU DLGHGGHFLVLRQ V\VWHP WKDW DVVLVWV WKH UHDGHU LQ GLVFULPLQDWLQJ OLYHU OHVLRQV E\ UHWULHYLQJVFRULQJUDQNLQJDQGGLVSOD\LQJVLPLODUOHVLRQVDFFRUGLQJWRXVHUGHÀQHG VLPLODULW\FULWHULDLQFOXGLQJOHVLRQEHQLJQDQF\GHQVLW\DQGW\SH 0HWKRGVDQG0DWHULDOV$VHWRI&7VFDQVFRQWDLQLQJOLYHUOHVLRQVDQ QRWDWHGE\H[SHULHQFHGUDGLRORJLVWVZHUHXVHGIRUJHQHUDWLRQDQGHYDOXDWLRQRI WKHOHDUQLQJEDVHGPRGHOVLQWKHV\VWHP$UDQNHGOLVWRIOHVLRQVVKRZLQJVLPLODU EHQLJQDQF\ EHQLJQPDOLJQDQW GHQVLW\ K\SRGHQVHK\SHUGHQVH RU OHVLRQ W\SH F\VWKDHPDQJLRPDPHWDVWDVLVFDQEHUHWULHYHGIURPMXVWDUHJLRQRILQWHUHVWDV LQSXW TXHU\$GGLWLRQDO LQSXW HJ FKDUDFWHULVLQJ VHPDQWLF IHDWXUHV KDV VKRZQ WRLPSURYHWKHSHUIRUPDQFHHVSHFLDOO\IRULQGHWHUPLQDWHVXEFHQWLPHWHUOHVLRQV 5HVXOWV $OJRULWKPUXQWLPHLVZLWKLQDIHZVHFRQGVSHUOHVLRQ2QXQVHHQWHVWGDWD WKHFODVVLÀFDWLRQDFFXUDF\REWDLQHGZDVIRUUHWULHYDOZLWKVLPLODUGHQVLW\ IRUVLPLODUEHQLJQDQF\DQGLQWKHOHVLRQW\SHFDVH7KHGDWDFRO OHFWLRQXVHGLVWKHELJJHVWVDPSOHFRPSDUHGWRVLPLODUVWXGLHVDQGWKHSUHGLFWLYH SHUIRUPDQFHDFKLHYHGLVFRPSHWLWLYHZLWKUHVSHFWWRVWDWHRIWKHDUW &RQFOXVLRQ$V SURYHQ E\ WKLV VWXG\ WKH LQYHVWLJDWHG V\VWHP DXWRPDWLFDOO\ GLVFULPLQDWHGUHOLDEO\EHWZHHQGLIIHUHQWW\SHVRIOLYHUOHVLRQV7KHV\VWHPDVVLVWV UHDGLQJDQGGHFLVLRQPDNLQJSURFHVVE\TXLFNUHWULHYDOUDQNLQJDQGGLVSOD\LQJ VLPLODUOHVLRQVZLWKUHODWHGUDGLRORJLFDOUHSRUWLQIRUPDWLRQ7KLVVHUYHVDVDVHFRQG RSLQLRQDQGSURYLGHVYDOXDEOHDGGLWLRQDOLQIRUPDWLRQIRUUDGLRORJLFDOGHFLVLRQPDNLQJ HVSHFLDOO\ZKHQ05,LVFRQWUDLQGLFDWHG % $XWRPDWHGGHWHFWLRQRIRVWHRO\WLFWKRUDFROXPEDUVSLQHOHVLRQVLQ &7VFDQV 0+DPPRQ0:HOV3 'DQNHUO0.HOP$7 V\PEDO66HLIHUW06KOLQJ 08GHU$&DYDOODUR(UODQJHQ'(PDWWKLDVKDPPRQ#XNHUODQJHQGH 3XUSRVH2VWHRO\WLFVSLQDOERQHOHVLRQDVVHVVPHQWLQ&7VFDQVLVDFKDOOHQJLQJ DQGLPSRUWDQWWDVNLQURXWLQHUDGLRORJ\:HHYDOXDWHGWKHVHQVLWLYLW\DQGQXPEHU RIIDOVHSRVLWLYHUHVXOWVRIDQRYHOIXOO\DXWRPDWLFFRPSXWHUDLGHGGHWHFWLRQ&$' V\VWHPIHDWXULQJDQLQQRYDWLYHDOJRULWKPIURP7+(6(860(',&2 0HWKRGVDQG0DWHULDOV:HUHWURVSHFWLYHO\HYDOXDWHGWKH&$'V\VWHPRQ&7 VFDQVRISDWLHQWVLQFOXGLQJGLDJQRVLVVXFKDVRVWHRSRURVLVGHJHQHUDWLYHVSLQH GLVRUGHUV DQG YHUWHEUDO IUDFWXUHV ZLWK RVWHRO\WLF VSLQH OHVLRQV ODUJHU WKDQ FPó7KHVRIWZDUHLVEDVHGRQWKHSULQFLSOHVRIPDFKLQHOHDUQLQJDQGDXWRPDWL FDOO\GHWHFWVDQGKLJKOLJKWVRVWHRO\WLFOHVLRQV'HWHFWHGGHJHQHUDWLYHSURFHVVHV HJ6FKPRUOҋVQRGXOHVRUKDHPDQJLRPDVZHUHQRWFRQVLGHUHGDVIDOVHSRVLWLYH ÀQGLQJV0DQXDOOHVLRQDQQRWDWLRQZDVSHUIRUPHGE\DQH[SHULHQFHGUDGLRORJLVW JROGVWDQGDUG6HQVLWLYLW\DQGIDOVHSRVLWLYHUDWHVRQXQVHHQGDWDZHUHFDOFXODWHG IROGFURVVYDOLGDWLRQ 5HVXOWV$OJRULWKP UXQWLPH LV OHVV WKDQ PLQXWHV SHU GDWD VHW 2XU V\VWHP DFKLHYHV D VHQVLWLYLW\ RI DW IDOVH SRVLWLYHV SHU VSLQHRQ DYHUDJH 7KH PHGLDQVHQVLWLYLW\LVDWIDOVHSRVLWLYHVSHUVSLQH7KHGLIIHUHQFHEHWZHHQ WKHWZRVHQVLWLYLW\YDOXHVLVGXHWRWKHGLIIHUHQWGDWDTXDOLW\ZKLFKLVFRQWULEXWLQJ WRWKHGHJUHHRIGLIÀFXOW\RIWKHGHWHFWLRQWDVN &RQFOXVLRQ7KHSUHVHQWHG&$'V\VWHPVXFFHVVIXOO\GHWHFWVRVWHRO\WLFWKRUDFR OXPEDUVSLQHOHVLRQVHYHQLQFKDOOHQJLQJGDWDVHWV,WFDQWKHUHIRUHEHDSSOLHGDVD IXOO\DXWRPDWLFSUHSURFHVVLQJVWHSWRLQGLFDWHVXVSLFLRXVDUHDVDQGWKXVVXSSRUWWKH UDGLRORJLVW7KLVLVH[WUHPHO\YDOXDEOHGXULQJWKHUHDGLQJRI&7VFDQVDVRVWHRO\WLF ERQHOHVLRQVDUHDWWKHULVNRIEHLQJPLVVHGHYHQE\H[SHULHQFHGUDGLRORJLVWV % &RPSXWHGDLGHGVWHQRVLVGHWHFWLRQRQFRURQDU\&7DQJLRJUDSK\LQ FKHVWSDLQSDWLHQWVZLWKDQLQWHUPHGLDWHSUHWHVWOLNHOLKRRGIRUDFXWH FRURQDU\V\QGURPH 7 +HQ]OHU00H\HU3 $SIDOWUHU626FKRHQEHUJ&)LQN 0DQQKHLP'(WKRPDVKHQ]OHU#PHGPDXQLKHLGHOEHUJGH 3XUSRVH7 RFRPSDUHWKHSHUIRUPDQFHRIDQDXWRPDWHGFRPSXWHGDLGHGDOJRULWKP IRU VWHQRVLV GHWHFWLRQ RQ FRURQDU\ &7 DQJLRJUDSK\ F&7$ ZLWK H[SHUW KXPDQ LQWHUSUHWDWLRQLQSDWLHQWVZLWKDFXWHFKHVWSDLQDQGDQLQWHUPHGLDWHSUHWHVWOLNHOL KRRGIRUDFXWHFRURQDU\V\QGURPH$&6 6FLHQWLILF6HVVLRQ $ 6&'()*+%(XURSHDQ&RQJUHVVRI 5DGLRORJ\ 6DWXUGD\ W\SHRIEUDQFKLQJ,QVRPHFDVHVVHTXHQWLDOVKLIWRIDVVLJQHGQDPHVWRSUR[LPDO RFFXUUHGLQWKHEHORQJLQJEURQFKLDWWKHGHOHWHGVLWHRIWKHH[SHFWHGEURQFKXVE\ SRRUUHFRQVWUXFWLRQRIDEURQFKLDOLPDJHDQGE\FRQJHQLWDORURSHUDWLYHGHOHWLRQRI WKHEURQFKXVZDVSUHVHQW6WULFWQDPHPDWFKLQJWRGRFWRUVҋLQWHUSUHWDWLRQUHYHDOHG PDWFKHGIRUWKHWUDFKHDDQGPDLQEURQFKL)RUWKHGLVWDOEURQFKLRYHUDOO UHVXOWVRIRIODEHOOHGQDPHVZHUHFRUUHFW &RQFOXVLRQ $FFRUGLQJWRWKHNQRZOHGJHRIFRPSXWDWLRQDODQDWRP\DXWRPDWHGDV VLJQPHQWRIEURQFKLDOEUDQFKQDPHVPD\KHOSGRFWRUVGXULQJYLUWXDOEURQFKRVFRS\ % 'HYHORSPHQWRIDFRPSXWHUDLGHGLQGHSHQGHQWPRQLWRUXQLW YHULÀFDWLRQV\VWHPXVLQJ&ODUNVRQҋVVHFWRULQWHJUDWLRQURXWLQH 00DWVXVKLPD 57 DQDND< .LNXFKL.XUREH-3.DQD]DZD-3)XNXL-3 OLQDF#PHGNXUREHWR\DPDMS 3XUSRVH7 RGHYHORSDFRPSXWHULVHGPHWKRGIRUYHULÀFDWLRQRIPRQLWRUXQLW08 EDVHGRQJHRPHWULFDOIDFWRUVLQUDGLDWLRQWUHDWPHQWSODQQLQJDQGWRLQYHVWLJDWH WKHFOLQLFDOHIIHFWLYHQHVVRIRXUV\VWHP 0HWKRGVDQG0DWHULDOV6KDSHLQIRUPDWLRQRQ;MDZ<MDZDQGPXOWLOHDIFROOLPD WRU0/&ZDVUHDGIURPWKHSODQQLQJGDWDDQGUDGLDOGLUHFWLRQGLVWDQFHULRIWKH GLYLVLRQIRULQWHJUDWLRQRIVHJPHQWVZDVFDOFXODWHG&ODUNVRQҋVVHFWRULQWHJUDWLRQ URXWLQHZDVXVHGWRFDOFXODWHWKHPHDQSKDQWRPVFDWWHUFRUUHFWLRQIDFWRU6SDQG PHDQ WLVVXHPD[LPXP UDWLR 705 IRU H[WHUQDO SKRWRQ EHDPV RI LUUHJXODU DQG FRQIRUPDOÀHOGVZLWK0/&2XUV\VWHPZLWKDXVHUIULHQGO\JUDSKLFDOLQWHUIDFHZDV LQVWDOOHGRQDSHUVRQDOFRPSXWHU*+]&38WRYHULI\LWVDFFXUDF\LQFDVHV LQFOXGLQJÀYHVTXDUHÀHOGVVL[UHFWDQJXODUÀHOGVIRXUNLQGVҋZHGJHVKDSHGÀHOGV HLJKWLUUHJXODUÀHOGVDQGWKUHHFRQIRUPDOÀHOGV 5HVXOWV $YHUDJHULGLIIHUHQFHWKHGLIIHUHQFHLQ08DQGPHDVXUHGDEVRUEHGGRVH ZHUHPPDQGUHVSHFWLYHO\0D[LPXPYDOXHVZHUHPP DQGUHVSHFWLYHO\7KHWLPHWRFDOFXODWHRQHÀHOGZDVV2XUV\VWHP SURYLGHGIXOO\DXWRPDWHG08YHULÀFDWLRQZLWKRXWDQ\PDQXDOKDQGFDOFXODWLRQ &RQFOXVLRQ ,W LV QHFHVVDU\ WR HQVXUH GLVDJUHHPHQW EHWZHHQ YHULÀFDWLRQ DQG SULPDU\FDOFXODWLRQVZLWKKRPRJHQHRXVFRQGLWLRQVRUKHWHURJHQHLW\FRUUHFWLRQVLV E\LQGHSHQGHQW08YHULÀFDWLRQDFFRUGLQJWRWKHUHSRUWRI$$307 DVN *URXS7KHUHVXOWVLQGLFDWHGWKDWRXUV\VWHPZLOODLGRSHUDWRUVLQ08YHULÀFDWLRQ ZLWKKLJKDFFXUDF\DQGOHVVFRPSOH[LW\IRUH[WHUQDOUDGLDWLRQWKHUDS\ % )XOO\LWHUDWLYHUHFRQVWUXFWLRQDOJRULWKPIRU0'&7 LQLWLDOUHVXOWV 0'REULW]7 .RHKOHU.0%URZQ$)LQJHUOH(-5XPPHQ\3 %1RHO 0XQLFK'(+DPEXUJ'(&OHYHODQG2+86GREULW]#URHPHGWXPGH 3XUSRVH7 RHYDOXDWHIXOO\LWHUDWLYHUHFRQVWUXFWLRQ,5LQ0'&7ZLWKUHVSHFWWR LPDJHTXDOLW\DQGGLDJQRVWLFYDOXHFRPSDUHGZLWKFRQYHQWLRQDO)%3 0HWKRGVDQG0DWHULDOV7KHVWXG\ZDVSHUIRUPHGSURVSHFWLYHO\ZLWKSDWLHQWVZKR KDGVXIIHUHGIURPPDOLJQDQWGLVHDVHVLQDWXPRXUIROORZXS'DWDZHUHDFTXLUHG RQ D 3KLOLSV %ULOOLDQFH L&7 DQG UHFRQVWUXFWHG XVLQJ FRQYHQWLRQDO )%3 DQG ,5 ,5 XVHV HGJHSUHVHUYLQJ UHJXODULVDWLRQ WR WUDGH RII QRLVH DQG UHVROXWLRQ 1RLVH WH[WXUHLVFRQWUROOHGE\DSDUDPHWHUDQGE\IDGLQJWKH)%3LPDJHWRWKH,5UHVXOW 7 RGHWHUPLQHWKHGLDJQRVWLFYDOXHRI,5H[SHULHQFHGUDGLRORJLVWVLQGHSHQGHQWO\ GHÀQHGSDWKRORJLFDODQGDQDWRPLFDOIHDWXUHVLQWKHUHFRQVWUXFWLRQV 5HVXOWV $QH[WUHPHFKRLFHRI,5SDUDPHWHUVUHVXOWHGLQDOPRVWFRPSOHWHUHPRYDO RILPDJHQRLVHZKLOHSURGXFLQJDQXQIDPLOLDULPDJHWH[WXUH:LWKRXW)%3IDGLQJ VKDUSQHVVRIVRPHRUJDQHGJHVZDVIRXQGWREHGLIÀFXOWWRUDWH,QRQHFDVHWKH VXUIDFHRIWKHOLYHUVHHPVWRKDYHQRGXODUOLNHFLUUKRWLFFKDQJHV/HVVH[WUHPH SDUDPHWHUVIRU,5OHGWRVWLOOVWURQJO\UHGXFHGQRLVHOHVVXQIDPLOLDUWH[WXUHDQGQR DUWLÀFLDOFKDQJHV,QWKHSRUWDOYHQRXVSKDVHYDVFXODUVWUXFWXUHVDUHEHWWHUGHOLQH DWHGLQ,5UHFRQVWUXFWLRQVFRPSDUHGWR)%3 $OOSDWKRORJLFDODQGDQDWRPLFDOIHDWXUHV FRXOGEHGHWHFWHGDQGGHÀQHGLQ)%3DQG,5LPDJHV+RZHYHUWKHVHIHDWXUHVDUH PRUHFOHDUO\YLVLEOHLQ,5LPDJHV2YHUDOO,5ZDVDVVHVVHGWREHVXSHULRUWR)%3 &RQFOXVLRQ,QWKLVVWXG\ZHLOOXVWUDWHWKHFOLQLFDOYDOXHRI,5,5KDVWKHSRWHQWLDO WRUHGXFHSDWLHQWGRVHDQGLPSURYHGLDJQRVWLFYDOXHIRUDQ\FOLQLFDOSURWRFRO 6FLHQWLILF6HVVLRQ 6 &$' ( ) *+% (XURSHDQ&RQJUHVVRI 5DGLRORJ\ 6FLHQWLILF6HVVLRQ $ 6&'()*+%(XURSHDQ&RQJUHVVRI 5DGLRORJ\ 6XQGD\0DUFK 6FLHQWLILF6HVVLRQ 6 &$' ( ) *+% (XURSHDQ&RQJUHVVRI 5DGLRORJ\ % :KROHERG\GLIIXVLRQZHLJKWHGLPDJLQJDW7HVODÀHOGVWUHQJWKIRU HDUO\WUHDWPHQWDVVHVVPHQWDQGWUHDWPHQWSUHGLFWLRQLQO\PSKRPD .1GH3DHSH&%HYHUQDJH) GH.H\]HU3 :ROWHU52\HQ*9HUKRHI 99DQGHFDYH\H/RXYDLQ%( 3XUSRVH7 RHYDOXDWH7ZKROHERG\GLIIXVLRQZHLJKWHGLPDJLQJ:%':,IRU HDUO\DVVHVVPHQWRIFKHPRWKHUDS\LQDJJUHVVLYHQRQ+RGJNLQO\PSKRPD1+/ 0HWKRGVDQG0DWHULDOV)RXUWHHQSDWLHQWVZLWK1+/WUHDWHGZLWKVWDQGDUGFKHPR WKHUDS\XQGHUZHQW7:%':,ZLWKEYDOXHVE VPPSULRUWRDQG ZHHNVDIWHULQLWLDWLRQRIWUHDWPHQW7KHDSSDUHQWGLIIXVLRQFRHIÀFLHQW$'&ZDV FDOFXODWHGIURPUHJLRQVRILQWHUHVW52,GUDZQRQO\PSKRPDORFDWLRQVRQWUDQV YHUVHEDQGELPDJHV3UHWUHDWPHQW$'&$'&FKDQJHWRSUHWUHDWPHQW $'&$'&EDVHDWZHHNV$'&UDWLRZDQGDWZHHNV$'&UDWLRZGXULQJ WUHDWPHQWRIUHVSRQGLQJDQGQRQUHVSRQGLQJOHVLRQVZHUHFRPSDUHGXVLQJD0DQQ :KLWQH\8WHVW7KHSUHGLFWLYHYDOXHRI$'&EDVH$'&UDWLRZDQG$'&UDWLRZ ZDVFRUUHODWHGZLWKSURJUHVVLRQIUHHVXUYLYDO3)6ZLWKDORJUDQNWHVWLQFOXGLQJ WKHHIIHFWRIWKHLQWHUQDWLRQDOSURJQRVWLFLQGH[,3, 5HVXOWV(LJKWSDWLHQWVVKRZHGFRPSOHWHUHPLVVLRQDIWHUPRQWKVRIIROORZXS ZKHUHDVSDWLHQWVVKRZHGSHUVLVWHQWRUUHFXUUHQWGLVHDVHZLWKLQWRPRQWKV 7KH$'&EDVH$'&UDWLRZDQG$'&UDWLRZZHUHVLJQLÀFDQWO\GLIIHUHQWLQOHVLRQV VKRZLQJUHFXUUHQFHYHUVXVUHPLVVLRQ$'&EDVH [PPVYHUVXV [PPVS $'&UDWLRZ LQFUHDVHYHUVXV S $'&UDWLRZ LQFUHDVHYHUVXVS3HUERG\ UHJLRQWKH$'&UDWLRZGHPRQVWUDWHGKLJKHVWDFFXUDF\RIZLWKDQHJDWLYH SUHGLFWLYHYDOXHRIDQGSRVLWLYHSUHGLFWLYHYDOXHRI'LIIHUHQFHVLQ $'& EDVH $'&UDWLRZDQG $'&UDWLRZEHWZHHQSDWLHQWJURXSVFRUUHODWHGVLJQLÀFDQWO\ ZLWK3)6$'&EDVHS $'&UDWLRZS DQG$'&UZS LQFRQWUDVWWRWKH,3, &RQFOXVLRQ:%':,PD\DOORZIRUWUHDWPHQWSUHGLFWLRQDQGHDUO\WUHDWPHQWDV VHVVPHQWRI'/%&/XVLQJGLIIHUHQFHVLQ$'&EDVH$'&UDWLRZDQG$'&UDWLRZ % ,VZKROHERG\GLIIXVLRQZHLJKWHGLPDJLQJDW7HVODÀHOGVWUHQJWK IHDVLEOHIRUVWDJLQJO\PSKRPD" .1'H3DHSH) 'H.H\]HU3 :ROWHU52\HQ*9HUKHRI99DQGHFDYH\H /HXYHQ%( 3XUSRVH7 RGHWHUPLQHWKHIHDVLELOLW\RI7ZKROHERG\GLIIXVLRQZHLJKWHGLPDJLQJ :%':,IRUVWDJLQJRIQRQ+RGJNLQO\PSKRPD1+/ 0HWKRGVDQG0DWHULDOVSDWLHQWVZLWK1+/XQGHUZHQW7:%':,ZLWKE YDOXHVVPP5HJLRQVRILQWHUHVW52,ZHUHGUDZQRQFRURQDOUHIRUPDW WHGELPDJHVLQHYHU\K\SHULQWHQVHOHVLRQLQQRUPDOWLVVXHLVRK\SRLQWHQVH DQGLQWKHVXUURXQGLQJDLUWRGHWHUPLQHEDFNJURXQGQRLVH6LJQDOWREDFNJURXQG UDWLR 6%5 6,OHVLRQ6,EDFNJURXQG ZDV GHWHUPLQHG IRU HYHU\ 52,$GGLWLRQDOO\ DSSDUHQWGLIIXVLRQFRHIÀFLHQW$'&ZDVFDOFXODWHGIURP52,VGUDZQRQWUDQVYHUVH EDQGELPDJHVLQK\SHULQWHQVHOHVLRQVDQGQRUPDORUEHQLJQWLVVXH6%5 DQG$'&RIPDOLJQDQWDQGEHQLJQWLVVXHZHUHFRPSDUHGXVLQJ0DQQ:KLWQH\8 WHVWVZKLOHUHFHLYHURSHUDWLQJFKDUDFWHULVWLFFXUYHVZHUHFRQVWUXFWHGWRGHWHUPLQH VHQVLWLYLW\VVSHFLÀFLW\VSDQGDFFXUDF\DFF $JUHHPHQWEHWZHHQ:%':,DQG 3(7&7IRU$QQ$UERUFODVVLÀFDWLRQZDVDVVHVVHGE\FDOFXODWLQJNDSSDVFRUHV 5HVXOWV 6%5 DQG$'& RI EHQLJQ DQG PDOLJQDQW WLVVXH GLIIHUHG VLJQLÀFDQWO\ SZLWK $'&EHLQJWKHEHVWGLVFULPLQDWRUIRUO\PSKQRGHVQ V VS DFF DQG 6%5 IRU ERQH DQG VRIW WLVVXH ERQH Q V VS DFF VRIW WLVVXH Q V VS DFF 3(7&7 DQG:%':,VKRZHGJRRGWRH[FHOOHQWDJUHHPHQW"O\PSKQRGHV "ERQH "VRIW WLVVXH IRU OHVLRQ GLIIHUHQWLDWLRQ DQG DJUHHG RQ$QQ$UERU VWDJH LQ RISDWLHQWV:%':,FRUUHFWO\GRZQVWDJHGRQHSDWLHQWVWDJH,9WR,,DQG LQFRUUHFWO\GRZQVWDJHGDQRWKHUVWDJH,,WR, &RQFOXVLRQ:%':,LVIHDVLEOHIRUVWDJLQJ1+/VKRZLQJFRPSDUDEOHUHVXOWVWR 3(7&7 6%5LVPRVWDFFXUDWHIRUFKDUDFWHULVLQJERQHDQGVRIWWLVVXHOHVLRQVZKLOH $'&LVSUHIHUUHGWRFKDUDFWHULVHO\PSKQRGHV % :KROHERG\PDJQHWLFUHVRQDQFHLPDJLQJZLWKGLIIXVLRQZHLJKWHG VHTXHQFHVIRUWKHIROORZXSRIVWDJH,,,PHODQRPDSDWLHQWV *3HWUDOLD 03DGUHQRVWUR6$OHVVL5'L)LOLSSL65DLPRQGL/%RQHOOR -*DUFLD%HQQHWW0%HOORPL0LODQ,75HXV(6JLXVHSSHSHWUDOLD#LHRLW 3XUSRVH 7 R HYDOXDWH WKH IHDVLELOLW\ DQG WKH SRWHQWLDO RI ZKROH ERG\ PDJQHWLF UHVRQDQFH LPDJLQJ :%05, ZLWK GLIIXVLRQZHLJKWHG ': VHTXHQFHV DV D VXEVWLWXWHRIZKROHERG\FRPSXWHGWRPRJUDSK\&7IRUWKHIROORZXSRIVWDJH,,, PHODQRPDSDWLHQWV 5RRP$ 2QFRORJLF,PDJLQJ 66 :KROHERG\05,LQFDQFHUSDWLHQWV 0RGHUDWRUV 00D\HUK|IHU9LHQQD$7 +36FKOHPPHU+HLGHOEHUJ'( % %RQHPDUURZOHVLRQVLQSDWLHQWVZLWKP\HORPDZKROHERG\':,%6 YV7ZHLJKWHGFRQWUDVWHQKDQFHG05LPDJLQJ (6TXLOODFL) %RODFFKL&&LFFLRҋ0$QWRQLFROL*0DQHQWL*6LPRQHWWL 5RPH,7HWWRUHVTXLOODFL#WLVFDOLLW 3XUSRVH7KHSXUSRVHRIRXUVWXG\ZDVWRFRPSDUH7ZHLJKWHGFRQWUDVWPDWHULDO HQKDQFHG IDWVXSSUHVVHG VSLQHFKR PDJQHWLF UHVRQDQFH 05 VHTXHQFHV DQG ':,%6IRUGHSLFWLRQRIERQHPDUURZDEQRUPDOLWLHVLQSDWLHQWVZLWKP\HORPD 0HWKRGV DQG 0DWHULDOV 2QH KXQGUHG DQG WKLUW\ÀYH SDWLHQWV ZLWK SUHYLRXVO\ GLDJQRVHG 00 XQGHUZHQW 7 :%05, IRU SUHWUHDWPHQW VWDJLQJ PRUSKRORJL FDO 7: 'LIIXVLRQZHLJKWHG LPDJLQJ ZLWK EDFNJURXQG VXSSUHVVLRQ ':,%6 DQGFRQWUDVWHQKDQFHG'7:VHTXHQFHVZHUHSHUIRUPHG9ROXPHDQGVLJQDO GLIIHUHQFHWRQRLVH UDWLR 6'15 ZHUH PHDVXUHG 6WDJLQJ GHWHUPLQHG ZLWK 05 ÀQGLQJVZLWKHDFKVHTXHQFHZHUHFRPSDUHGZLWKWKHUHVXOWVRIDUHYLHZSDQHO 5HVXOWV 5HJDUGLQJ YROXPH RI ERQH PDUURZ DEQRUPDOLWLHV D ORZ FRUUHODWLRQ U RI ERWK VHTXHQFHV ZDV IRXQG 6'15 ZDV VXEVWDQWLDOO\ KLJKHU RQ ':,%6LPDJHVWKDQRQ'7ZHLJKWHGFRQWUDVWHQKDQFHGPHDQYV 37KHTXDOLWDWLYHDQDO\VLVGHPRQVWUDWHGWKHVDPHLPDJLQJSDWWHUQZLWK ERWKVHTXHQFHVLQNDSSD RIQRUPDODSSHDULQJPDUURZZLWKOLPLWHG GLVHDVHLQNDSSD RIIRFDOLQÀOWUDWLRQDQGLQNDSSD RIGLIIXVHLQÀOWUDWLRQ,QWHUREVHUYHUUHSURGXFLELOLW\RIWKHWKUHHLPDJLQJSDWWHUQV ZDVVLPLODUIRUERWKVHTXHQFHV7KHNDSSDYDOXHVIRUWKHVHWKUHH]RQHVZLWK7 ZHLJKWHGFRQWUDVWHQKDQFHG05VHTXHQFHZHUHDQGDQGWKRVH IRUWKH':,%6VHTXHQFHVZHUHDQGUHVSHFWLYHO\6WDJLQJGHWHU PLQHGZLWK05ÀQGLQJVZHUHHTXDOZLWKERWKVHTXHQFHVLQRILQYROYHGERQHV &RQFOXVLRQ7ZHLJKWHGFRQWUDVWHQKDQFHGIDWVXSSUHVVHG05LPDJHVDUHVX SHULRUWR':,%6LQWKHGHPRQVWUDWLRQRIWKHGLIIXVHDQGOLPLWHGGLVHDVH+RZHYHU VWDJLQJGHWHUPLQHGZLWKERWKVHTXHQFHVLVFRPSDUDEOH % :KROHERG\05,IRUUHVSRQVHDVVHVVPHQWRIPXOWLSOHP\HORPDDIWHU VWHPFHOOWUDQVSODQWDWLRQ &:HEHU++HQWVFKHO7 %OH\1.URHJHU*$GDP3 %DQQDV +DPEXUJ'(KDQQDKKHQWVFKHO#JP[GH 3XUSRVH&RPSDULVRQRIZKROHERG\05,:%05,ZLWKVHUXPDQDO\VHVWRGHWHU PLQHZKHWKHU:%05,HQDEOHVUHOLDEOHWKHUDS\UHVSRQVHDVVHVVPHQWLQSDWLHQWV ZLWKPXOWLSOHP\HORPDDIWHUVWHPFHOOWUDQVSODQWDWLRQ6&7 0HWKRGV DQG 0DWHULDOV SDWLHQWV PHQ ZRPHQ PHDQ DJH \HDUVZLWKPXOWLSOHP\HORPDDIWHU6&7ZHUHH[DPLQHGZLWK:%05,DWWZRWLPH SRLQWVDIWHU6&7 ([WHQWRILQWUDDQGH[WUDPHGXOODU\P\HORPDPDQLIHVWDWLRQVIURP ERWK:%05,H[DPLQDWLRQVZDVFRUUHODWHGZLWKKHPDWRORJLFDOSDUDPHWHUVDQGZLWK PHGLXPWHUPSDWLHQWRXWFRPH0F1HPDUV VWHVWZDVXVHGIRUVWDWLVWLFDODQDO\VLV 5HVXOWV :%05, LGHQWLÀHG QHZ RU SURJUHVVLYH OHVLRQV LQ RI SDWLHQWV SDWLHQWVKDGRQO\LQWUDPHGXOODU\OHVLRQVDQGSDWLHQWV KDGLQWUDDQGH[WUDPHGXOODU\O\PSKRPDPDQLIHVWDWLRQV5HVXOWVRI:%05,DQG VHUXPDQDO\VHVDJUHHGLQRIDOOSDWLHQWVSDWLHQWVZHUH FODVVLÀHGFRQFRUGDQWO\DVUHVSRQGHUVDQGSDWLHQWVDVQRQUHVSRQGHUV 7KHUHPDLQLQJSDWLHQWVZHUHFODVVLÀHGXQHTXDOO\ZLWKERWKPHWKRGV KRZHYHUZLWKRXWEHLQJVWDWLVWLFDOO\VLJQLÀFDQWS &RQFOXVLRQ :%05, HQDEOHV UHVSRQVH DVVHVVPHQW LQ SDWLHQWV ZLWK PXOWLSOH P\HORPD DIWHU 6&7 EXW ZLWKRXW DGGLWLRQDO EHQHÀW FRPSDUHG WR URXWLQHO\ SHU IRUPHGVHUXPDQDO\VHV+RZHYHU:%05,DOORZVH[DFWORFDOL]DWLRQRILQWUDDQG H[WUDPHGXOODU\O\PSKRPDPDQLIHVWDWLRQVZKLFKDGYRFDWHV:%05,SDUWLFXODUO\IRU V\PSWRPDWLFSDWLHQWVRUSDWLHQWVZLWKQRQVHFUHWRU\P\HORPD 6FLHQWLILF6HVVLRQ $ 6&'()*+%(XURSHDQ&RQJUHVVRI 5DGLRORJ\ 6XQGD\ RISDWLHQWV:%05,DQG3(7&7HTXDOO\GHWHFWHGPHWDVWDVHV3(7&7 ZDVVXSHULRUGHWHFWLQJORFDOUHFXUUHQFH3(7&7YV:%05,6HFRQG DU\WXPRXUVGHWHFWHGZHUHRYDULDQJDVWULFOXQJSDURWLGFDQFHUDQGPXOWLSOH P\HORPD&RQFRUGDQFHEHWZHHQERWKPRGDOLWLHVZDV &RQFOXVLRQ0RQLWRULQJRIWXPRXUPDUNHUNLQHWLFVFRPELQHGZLWKZKROHERG\LPDJ LQJLVHIIHFWLYHIRUHDUO\GHWHFWLRQRIWXPRXUUHFXUUHQFHLQFOLQLFDOO\DV\PSWRPDWLF EUHDVWFDQFHUSDWLHQWV%RWK)'*3(7&7DQG:%05,DUHUHOLDEOHPHWKRGVIRU PHWDVWDVHVGHWHFWLRQ3(7&7VKRZVDGYDQWDJHVLQORFDOUHFXUUHQFH % :KROHERG\05,DQG)'*3(7&7IRUWULDJHLQSDWLHQWVSODQQHGIRU UDGLRHPEROLVDWLRQWKHUDS\ *3 6FKPLGW 3 03DSURWWND 7 ) - D N R E V57 +RIIPDQQ $%DXU0HOQ\N$+DXJ0) 5HLVHU&5LVW0XQLFK'( 'UHVGHQ'(JHUZLQVFKPLGW#PHGXQLPXHQFKHQGH 3XUSRVH7 RHYDOXDWHWKHSRWHQWLDORIZKROHERG\05,:%05,DQG)'*3(7 &7DVGLDJQRVWLFWULDJHPHWKRGVIRUSDWLHQWVSODQQHGIRUUDGLRHPEROLVDWLRQ5( RIOLYHUPHWDVWDVHV 0HWKRGVDQG0DWHULDOVSDWLHQWVZLWKPXOWLIRFDOOLYHUPHWDVWDVHVZHUHHYDOX DWHG IRU SRWHQWLDO SDOOLDWLYH WKHUDS\ ZLWK 5( XVLQJ <WWULXPPLFURVSKHUHV$OO SDWLHQWVZHUHH[DPLQHGZLWK3(7&7DQG:%05,IRUH[FOXVLRQRIH[WUDKHSDWLF WXPRXUPDQLIHVWDWLRQV$OOSDWLHQWVXQGHUZHQWP7 FDOEXPLQHDQJLRJUDSK\IRO ORZHGE\VFLQWLJUDSK\WRH[FOXGHVLJQLÀFDQWKHSDWRSXOPRQDU\VKXQWLQJ 5HVXOWV2XWRIWKHSDWLHQWVLQFOXGHGLQWRWKHSUHWKHUDSHXWLFGLDJQRVWLFDOJR ULWKPZHUHHOLJLEOHDQGUHFHLYHG5(ZKLOHFRXOGQRWEHWUHDWHG,Q H[FOXVLRQ FULWHULD ZDV GLDJQRVLV RI VLJQLÀFDQW H[WUDKHSDWLF PHWDVWDWLF GLVHDVH ,QGLDJQRVLVZDVPDGHFRQFRUGDQWO\E\ERWK)'*3(7&7DQG:%05,LQ E\3(7&7 LQE\:%05,DORQH3DWLHQWEDVHGVHQVLWLYLW\IRUGHWHFWLRQRI H[WUDKHSDWLFGLVHDVHZDVIRU3(7&7DQGIRU:%05,)DOVHSRVLWLYH GLDJQRVLVRIH[WUDKHSDWLFGLVHDVHOHDGLQJWRH[FOXVLRQIRU5(ZDVPDGHLQRI SDWLHQWVLQRQHSDWLHQWE\3(7&7DQGLQRQHSDWLHQWE\:%05,DORQH2YHUDOO VSHFLÀFLW\IRULQFOXVLRQWR5(E\FRPELQLQJERWKPRGDOLWLHVZDV,QRI SDWLHQWVDQJLRJUDSKLFGLDJQRVLVPDGH5(LPSRVVLEOH &RQFOXVLRQ%RWK)'*3(7&7DQG:%05,DUHHIÀFLHQWGLDJQRVWLFWULDJHPHWK RGVIRUSDWLHQWVSODQQHGIRU5(RIOLYHUPHWDVWDVHV2YHUDOO)'*3(7&7VKRZV DKLJKHUGLDJQRVWLFDFFXUDF\FRPSDUHGWR:%05,DQGPD\EHXVHGDVLPDJLQJ PHWKRGRIFKRLFHDVDVWDQGDORQHH[DPLQDWLRQ,QFRPELQDWLRQERWKPRGDOLWLHV H[KLELWHGKLJKVHQVLWLYLW\IRUWKHGLDJQRVLVRIH[WUDKHSDWLFWXPRXUPDQLIHVWDWLRQV DQGUHVXOWLQKLJKVSHFLÀFLW\ % 'LDJQRVWLFFDSDELOLW\RIZKROHERG\GLIIXVLRQZHLJKWHGLPDJLQJLQ PDOLJQDQWWXPRXUVFRPSDUHGZLWKZKROHERG\))'*3(7&7 ;< :DQJ1:X< ) =KDR%HLMLQJ&1ROLYHUZ[\B]]#VLQDFRP 3XUSRVH:HVWXGLHGWKHGLDJQRVWLFFDSDELOLW\RIZKROHERG\GLIIXVLRQZHLJKWHG LPDJLQJ:%':,ZLWK705VFDQQHULQPDOLJQDQWOHVLRQVZLWKFRPSDULVRQWR ZKROHERG\))'*3(7&7 0HWKRGVDQG0DWHULDOVSDWLHQWVZLWKSDWKRORJLFDOO\SURYHGPDOLJQDQWWXPRXUV ZHUHHQUROOHG$OOSDWLHQWVXQGHUZHQWERWK:%':,DQG))'*3(7&7 DQG WKHQZHUHIROORZHGXSIRUPRQWKV7KUHHH[SHULHQFHG05UDGLRORJLVWVZKRZHUH EOLQGHGWRWKHÀQDOGLDJQRVLVUHDGWKH:%':,UHVSHFWLYHO\DQDO\VHWKHOH VLRQVLGHQWLÀHGE\3(7&7DQGDOOUDGLRORJLFH[DPLQDWLRQV3UREDELOLW\RIPDOLJQDQW OHVLRQVZDVDVVHVVHGXVLQJDSRLQWYLVXDOVFRULQJV\VWHP7KHUHFHLYHURSHUDW LQJFKDUDFWHULVWLF52&VHQVLWLYLW\DQGVSHFLÀFLW\ZHUHFRPSDUHGEHWZHHQWKH WZRPHWKRGV.DSSDDQDO\VHVZHUHXVHGWRFRPSDUHWKHGLDJQRVWLFFRQVLVWHQF\ EHWZHHQERWKPHWKRGV 5HVXOWV7KHDUHDXQGHUWKH52&FXUYHRI:%':,3(7&7 $'&DQG689PD[ ZHUHDQGUHVSHFWLYHO\7KHUHLVQRVWDWLVWLFDOO\VLJQLÀFDQW GLIIHUHQFHEHWZHHQ:%':,DQG3(7&73!7KHVHQVLWLYLW\VSHFLÀFLW\DQG DFFXUDF\ZHUHDQGUHVSHFWLYHO\LQ:%':,DQG DQGUHVSHFWLYHO\LQ3(7&7 .DSSDYDOXHRIWKHGLDJQRVWLFFRQVLVW HQF\EHWZHHQ:%':,DQG3(7&7ZDV,QDQDO\VLVRIWKHLPSDFWRIOHVLRQ VL]H RQ WKH DFFXUDF\ WKHUH ZDV VWDWLVWLFDO VLJQLÀFDQFH EHWZHHQ: % ' : , D Q G 3(7&7LQDJURXSRIPPGLDPHWHU3 $FFRUGLQJWRWKHORFDWLRQRI OHVLRQVWKHDFFXUDF\RI:%':,ZDVVLPLODUWRRUVRPHWLPHVEHWWHUWKDQ3(7&7 LQVWHUQXPFODYLFOHVFDSXODYHUWHEUDOFROXPQSHOYLVDQGERQHVRIH[WUHPLWLHV &RQFOXVLRQ:%':,KDGDKLJKHUVHQVLWLYLW\VSHFLÀFLW\DQGDFFXUDF\LQGHWHFWLQJ PDOLJQDQWOHVLRQV 0HWKRGVDQG0DWHULDOVZHHYDOXDWHGVHYHQW\RQH:%05,LQSDWLHQWVZLWK VWDJH,,,PHODQRPDSHUIRUPHGDWEDVHOLQHDQGHYHU\PRQWKVGXULQJDGMXYDQW WKHUDS\)LQGLQJVZHUHFODVVLÀHGEHQLJQRUVXVSLFLRXVIRUPHWDVWDVLVDQGGLYLGHG LQWRERG\UHJLRQVEUDLQQHFNWKRUD[XSSHUDEGRPHQOLYHUSHOYLVVRIWWLVVXHV ERQHDQGO\PSKQRGHV%LRSV\RUIROORZXSZDVFRQVLGHUHGDVJROGVWDQGDUGIRU GLDJQRVLV7KHVHQVLWLYLW\6(VSHFLÀFLW\63SRVLWLYHSUHGLFWLYHYDOXH339 QHJDWLYHSUHGLFWLYHYDOXH139DQGGLDJQRVWLFDFFXUDF\'$RI:%05,ZHUH FDOFXODWHGSHUSDWLHQWDQGSHUVLQJOHERG\UHJLRQ 5HVXOWV $OOSDWLHQWVZHOOWROHUDWHGWKHH[DP2QHKXQGUHGDQGIRUW\ÀQGLQJVZHUH FRQVLGHUHGIRUDQDO\VLVZLWKWKHIROORZLQJSHUSDWLHQWYDOXHV6(63 339139'$7KH'$SHUVLQJOHERG\UHJLRQZDVEUDLQ QHFNWKRUD[XSSHUDEGRPHQOLYHUSHOYLVVRIW WLVVXHVERQHDQGO\PSKQRGHV7KHVPDOOHVWPHWDVWDVLVGH WHFWHGZDVPPLQWKHOLYHUWKHODUJHVWPHWDVWDVLVPLVVHGZDVPPLQWKHEUDLQ &RQFOXVLRQ :%05, ZDV IHDVLEOH LQ WKH IROORZXS RI SDWLHQWV ZLWK VWDJH ,,, PHODQRPD :%05, DFKLHYHG DFFHSWDEOH GLDJQRVWLF SHUIRUPDQFH SHU SDWLHQW DQGSHUVLQJOHERG\UHJLRQPDNLQJLWFRPSDUDEOHWRRWKHUZKROHERG\LPDJLQJ WHFKQLTXHVLQFOXGLQJFRPSXWHGWRPRJUDSK\DQGSRVLWURQHPLVVLRQWRPRJUDSK\ KRZHYHUDYRLGLQJLRQLVLQJUDGLDWLRQ % :KROHERG\05,ZLWK':,DQG'&(7ZLQWXPRXUVWDJLQJ FRPSDULVRQZLWK3(7&7 (6TXLOODFL&&LFFL*0DQHQWL) %RODFFKL26FKLOODFL*6LPRQHWWL 5RPH,7HWWRUHVTXLOODFL#WLVFDOLLW 3XUSRVH7 RDVVHVWKHGLDJQRVWLFSHUIRUPDQFHRIZKROHERG\PDJQHWLFUHVRQDQFH LPDJLQJ:%05,ZLWKGLIIXVLRQZHLJKWHGZKROHERG\LPDJLQJZLWKEDFNJURXQG ERG\VLJQDOVXSSUHVVLRQ':,%6LQPDOLJQDQWWXPRXUGHWHFWLRQDQGWRH[SORUHWKH SRWHQWLDOGLDJQRVWLFDGYDQWDJHVLQJHQHUDWLQJIXVHG':,%6'FRQWUDVWHQKDQFHG 7Z'&(7ZLPDJHV 0HWKRGV DQG 0DWHULDOV FDQFHU SDWLHQWV XQGHUZHQW :%05, IRU VWDJLQJ SXUSRVH)XVHG':,%6'&(7ZLPDJHVZHUHJHQHUDWHGRIIOLQH'&(7Z ':,%6LPDJHVDORQHDQGIXVHGZLWK'&(7ZZHUHFRPSDUHGE\WZRUHDGHUV JURXSVIRUGHWHFWLRQRISULPDU\GLVHDVHVDQGORFDOGLVWDQWPHWDVWDVHV'LDJQRVWLF SHUIRUPDQFHEHWZHHQWKHWKUHH:%05,GDWDVHWVZDVDVVHVVHGXVLQJUHFHLYHU RSHUDWLQJFKDUDFWHULVWLF52&FXUYHDQDO\VLV))'*3(7&7DQGKLVWRSDWKR ORJLFDOUHVXOWVZHUHXVHGDVVWDQGDUGRIUHIHUHQFHV 5HVXOWV $UHDVXQGHUWKH52&FXUYHVRI':,%6YV'&(7ZYVERWKVHTXHQFHV LQIXVHGIDVKLRQZHUHDQGUHVSHFWLYHO\7KHGLDJQRVWLFSHUIRUP DQFHLQWXPRXUGHWHFWLRQRIIXVHG':,%6'&(7ZLPDJHVZHUHVWDWLVWLFDOO\ VXSHULRUWR':,%63DQG'&(7Z3ZKLOHWKHGLIIHUHQFH EHWZHHQ':,%6DQG'&(7ZGLGQRWVKRZVWDWLVWLFDOVLJQLÀFDQFHGLIIHUHQFH 7KHUH ZDV QR VWDWLVWLFDOO\ GLIIHUHQFH LQ GHWHFWLRQ UDWHV RI PDOLJQDQF\ EHWZHHQ :%05,ZLWK':,%6DQG))'*3(7&7 &RQFOXVLRQ:%05,ZLWKIXVHG':,%6'&(7ZLPDJHVLVWREHFRQVLGHUHG DVDYDOLGDQGHFRQRPLFDOWHUQDWLYHWRROWR3(7&7IRUWXPRXUVWDJLQJDQGIROORZXS LQFDQFHUSDWLHQWV % )'*3(7&7DQGZKROHERG\05,IRUHDUO\GHWHFWLRQRIWXPRXU UHFXUUHQFHLQDV\PSWRPDWLFEUHDVWFDQFHUSDWLHQWVZLWKWXPRXU PDUNHUNLQHWLFV *3 6FKPLGW3 6WLHEHU''L*LRLD9+HLQHPDQQ '1DJHO&5LVW0) 5HLVHU$%DXU0HOQ\N 0XQLFK'(JHUZLQVFKPLGW#PHGXQLPXHQFKHQGH 3XUSRVH7 RHYDOXDWHWKHGLDJQRVWLFSRWHQWLDORILQWHJUDWHGLPDJLQJZLWK)'*3(7 &7DQGZKROHERG\05,:%05,FRPELQHGZLWKWXPRXUPDUNHUPRQLWRULQJIRU WKHHDUO\GHWHFWLRQRIDV\PSWRPDWLFWXPRXUUHFXUUHQFHLQEUHDVWFDQFHUSDWLHQWV 0HWKRGVDQG0DWHULDOV$IWHUFXUDWLYHVXUJHU\DV\PSWRPDWLFEUHDVWFDQFHU SDWLHQWV XQGHUZHQW UHJXODU WXPRXU PDUNHU PRQLWRULQJ IRU &($ &$ DQG &$DWZHHNLQWHUYDOVZLWKLQDQLQWHQVLÀHGGLDJQRVWLFDIWHUFDUHDOJRULWKP$ UHSURGXFLEOHSUHYLRXVO\GHÀQHGLQFUHDVHRIVLQJOHRUFRPELQHGPDUNHUV ZDVFRQVLGHUHGDVDVWURQJLQGLFDWRURIUHFXUUHQWGLVHDVH$OOSDWLHQWVZLWKSDWKR ORJLFPDUNHULQFUHDVHXQGHUZHQW:%05,RQD7VFDQQHUDQG)'*3(7&7LQ DGGLWLRQIRUYHULÀFDWLRQPHGLDQGD\V3UHVHQFHDQGGLVWULEXWLRQRIORFDOUHFXU UHQFHO\PSKQRGHLQYROYHPHQWDQGGLVWDQWPHWDVWDWLFGLVHDVHZHUHDVVHVVHG $OOSDWLHQWVXQGHUZHQW:%05,RU)'*3(7&7IROORZXSH[DPVZLWKLQPRQWKV DIWHULQGLYLGXDOLVHGWKHUDS\ 5HVXOWV:%05,DQG)'*3(7&7GHWHFWHGWXPRXUUHFXUUHQFHLQ RI SDWLHQWV KDG VHFRQGDU\ PDOLJQDQFLHV DQG K D G Q R GHWHFWDEOH PDOLJQDQF\/LPLWHG GLVHDVH RUJDQPHWDVWDVHVZDVIRXQGLQ 6FLHQWLILF6HVVLRQ 6 &$' ( ) *+% (XURSHDQ&RQJUHVVRI 5DGLRORJ\ % (YDOXDWLRQRISXOPRQDU\EORRGÁRZXVLQJQHZPHWKRGRIG\QDPLF [UD\H[DPLQDWLRQFRPSDULVRQZLWKP7F0$$SHUIXVLRQVFLQWLJUDSK\ 7 $EH7 ,]XND10RWRKDVKL(8HPD< $NL\DPD< 6KLUDLVKL+2JDWD 0,WR6.XGRX7 RN\R-3 3XUSRVH7 RHYDOXDWHWKHSXOPRQDU\EORRGÁRZXVLQJG\QDPLFFKHVW[UD\ZLWKRXW FRQWUDVWHQKDQFHPHQWLQFRPSDULVRQZLWKP7 F0$$VFLQWLJUDSK\ 0HWKRGVDQG0DWHULDO'\QDPLFFKHVWSXOVHG[UD\DWIUDPHVSHUVHFRQGLQ WRWDOVHFRQGRIWLGDOEUHDWKLQJZDVSHUIRUPHGLQSDWLHQWVZLWKSXOPRQDU\ GLVHDVH7KHLQVWLWXWLRQDOUHYLHZERDUGDSSURYDODQGZULWWHQLQIRUPHGFRQVHQWZDV REWDLQHGLQDOOSDWLHQWV,PDJHGDWDVHWVZHUHH[WUDFWHGE\VLJQDOLQWHQVLW\SL[HOVRI EORRGÁRZVXVLQJDEDQGSDVVÀOWHURSWLPLVHGIRUKHDUWEHDWV'HWHUPLQHGEORRG ÁRZVZDVGLYLGHGLQWRHLJKWÀHOGVXSSHUPLGGOHORZHUVXESKUHQLFLQULJKWDQG OHIWLQHDFKDUWHULDODQGFDSLOODU\SKDVHVDQGZDVFRPSDUHGZLWKWKHP7 F0$$ VFLQWLJUDSK\ 5HVXOWV$OO SDWLHQWV ZHUH SHUIRUPHG WHFKQLFDOO\ ZLWK WKH WRWDO H[SRVHGG R V H RI P*\ 7KH EORRG ÁRZV LQ HDFK XSSHU PLGGOH ORZHU DQGVXESKUHQLF ÀHOGV ZHUH DQG LQ WKH ULJKW DQG DQGLQWKHOHIWLQDUWHULDO SKDVH7KHFDSLOODU\EORRGÁRZVLJQDOVZHUH DQGLQWKHULJKWDQGDQG LQWKHOHIWLQWKLVVWXG\,QWKRVHFDVHV7KHP7 F0$$XSWDNHZDV LQWKHULJKWDQG DQGLQWKHOHIWUHVSHFWLYHO\&RPSDULVRQRIWKHH[DPLQDWLRQVKDGJRRG FRUUHODWLRQVZLWK5 LQDUWHULDOSKDVHDQG5 LQFDSLOODU\SKDVH &RQFOXVLRQ'\QDPLFFKHVW[UD\EORRGÁRZVKDGJRRGFROODWLRQZLWKP7 F0$$ VFLQWLJUDSK\7KLVPHWKRGPD\DOORZPHDVXUHPHQWDQGTXDQWLÀFDWLRQRISXOPRQDU\ EORRGÁRZVZLWKRXWFRQWUDVW % Ҋ6WXQQHGOXQJҋDQRYHOREVHUYDWLRQRIUHVROYLQJSXOPRQDU\ HPEROLVPRQOXQJSHUIXVLRQ&7 -+5HLG(YDQ%HHN0:LOOLDPV0&RQQHOO-7 0XUFKLVRQ(GLQEXUJK8. MRKQUHLG#ERUGHUVVFRWQKVXN 3XUSRVH3XOPRQDU\HPEROL3(IUHTXHQWO\UHVROYHLQDQLQFRQVLVWHQWPDQQHU$ SLORWVWXG\ZDVFDUULHGRXWWRDVVHVV&7SHUIXVLRQSDWWHUQVRI3(UHVROXWLRQDQG WRSRWHQWLDOO\LGHQWLI\YLDEOHSDUHQFK\PDH[KLELWLQJGHOD\HGSHUIXVLRQVLPLODUWRWKH SKHQRPHQRQRIҊVWXQQHGҋP\RFDUGLXP 0HWKRGVDQG0DWHULDOV)ROORZLQJLQVWLWXWLRQDODSSURYDODSLORWVWXG\RISDWLHQWV 0) PHDQ\HDUVZLWK&73$GLDJQRVLVRIPDMRU3(ZHUHSURVSHFWLYHO\HYDOX DWHGE\&7OXQJSHUIXVLRQDIWHUDQDYHUDJHRIPRQWKV7KURPEXVORDGPRGLÀHG 0LOOHUVFRUH006DQG59/9UDWLRZHUHGHWHUPLQHG3HUIXVLRQPDSVZHUHYLVXDOO\ VFRUHGDQGFRUUHODWHGZLWKUHVLGXDOHQGROXPLQDOÀOOLQJGHIHFWV'HIHFWVZHUHIXUWKHU DVVHVVHGE\JHQHUDWLQJWLPHSHUIXVLRQFXUYHVXVLQJUHJLRQVRILQWHUHVW 5HVXOWV7KHPHDQLQLWLDOWKURPEXVORDGZDV006DQGPHDQ59/9UDWLRZDV 7KHPHDQUHVLGXDOWKURPEXVORDGZDV006UDQJHZLWKQRSRVW WUHDWPHQW59GLODWDWLRQ2QO\SDWLHQWVZHUHFOHDURIUHVLGXDOWKURPEXV DQGRQO\SDWLHQWVKDGQRUHVLGXDOSHUIXVLRQGHIHFWVDIWHUDPLQLPXPRI WKUHHPRQWKVWUHDWPHQW3HUIXVLRQGHIHFWVUDQJHGIURPWRRIWKHDIIHFWHG OXQJ&7SHUIXVLRQGHIHFWVPDWFKHGDUHDVVKRZLQJUHVLGXDOHPEROLFPDWHULDOLQ RQO\SDWLHQWV,QSDWLHQWVSHUIXVLRQGHIHFWVVKRZHGGHOD\HGFRQWUDVW HQKDQFHPHQW &RQFOXVLRQ0RVWSDWLHQWVKDYHSHUIXVLRQGHIHFWVDWWKUHHPRQWKVRIWHQVXEVWDQWLDO DQGWKHVHPD\QRWFRUUHVSRQGZLWKWKHDUHDVRIUHVLGXDOHQGROXPLQDOPDWHULDO 6RPH GHIHFWV H[KLELW GHOD\HG HQKDQFHPHQW ZKLFK ZH KDYH WHUPHGҊVWXQQHGҋ OXQJVXJJHVWLQJWKH\PD\SRWHQWLDOO\UHVSRQGWRUHYDVFXODULVDWLRQWHFKQLTXHV % 9ROXPHUHQGHULQJUHFRQVWUXFWLRQRIULJKWYHQWULFOHLPSURYHV LQWHUREVHUYHUDJUHHPHQWDQGDFFXUDF\RILQWHUYHQWULFXODUVHSWXP ERZLQJVLJQLQSDWLHQWVZLWKDFXWHSXOPRQDU\HPEROLVP *6WDVNLHZLF](&]HNDMVND&KHKDE-3U]HJDOLQVNL68KOLJ.7 RUUHV 50DFLHMHZVNL$'URS/XEOLQ3/JU]HJRU]VWDVNLHZLF]#JPDLOFRP 3XUSRVH%RZLQJRILQWHUYHQWULFXODUVHSWXP,96LVRQHRIWKHVLJQVRIVHYHUH3( DGDSWHGIURPHFKRFDUGLRJUDSK\KRZHYHULWLVDIIHFWHGE\KLJKLQWHUREVHUYHUYDUL DELOLW\7KHDLPRIWKHVWXG\ZDVWRHYDOXDWHDSSOLFDWLRQRIYROXPHWULFUHFRQVWUXFWLRQ RIWKHULJKWYHQWULFOHIRULPSURYHPHQWRIUHOLDELOLW\RIWKLVVLJQ 0HWKRGVDQG0DWHULDOVFRQVHFXWLYHSDWLHQWVZLWK&73$GLDJQRVLVRIDFXWH3( DQGHFKRFDUGLRJUDSKLFDOO\PHDVXUHGSXOPRQDU\DUWHU\V\VWROLFSUHVVXUH3$63 ZHUHLQFOXGHGLQWRWKHVWXG\,96ERZLQJZDVHYDOXDWHGZLWKPXOWLSODQDUUHIRUPD 5RRP' &KHVW 66 ,QWHUDFWLRQOXQJKHDUWDQGFLUFXODWLRQ 0RGHUDWRUV -%UHPHULFK%DVOH&+ 1.DUDEXOXW'HQL]OL75 % +LJKSLWFKGXDOVRXUFH&7SXOPRQDU\DQJLRJUDSK\LQIUHHO\ EUHDWKLQJSDWLHQWV 5:%DXHU%6FKHOO0%HHUHV-:LFKPDQQ%%RGHOOH7 /HKQHUW 7 -9RJO-0.HUO)UDQNIXUWD0DLQ'(UDOIZEDXHU#DROFRP 3XUSRVH%UHDWKKROGPD\OHDGWR9DOVDOYDҋVPDQRHXYUHLQGXFLQJFRQWUDVWDUWHIDFWV LQWKHSXOPRQDU\DUWHULHVVXFKDVLQKRPRJHQHRXVHQKDQFHPHQWRUORVVRIWKHFRQ WUDVWEROXVGXULQJSXOPRQDU\&7DQJLRJUDSK\:HLQYHVWLJDWHGDQRYHOKLJKSLWFK GXDOVRXUFH&7SURWRFROWKDWGRHVQRWUHTXLUHDEUHDWKKROGSKDVH 0HWKRGVDQG0DWHULDOVFRQVHFXWLYHSDWLHQWVXQGHUZHQW&7SXOPRQDU\DQJL RJUDSK\&73$LQGXDOVRXUFHKLJKSLWFKPRGHSLWFKN9P$VPO FRQWUDVWPDWHULDOZLWKRXWEUHDWKLQJFRPPDQG3XOPRQDU\DUWHULDO3$HQKDQFH PHQWLPDJHQRLVHVLJQDOWRQRLVHUDWLRRYHUDOOLPDJHTXDOLW\LQFLGHQFHRIWRWDO RUSDUWLDOLQWHUUXSWLRQRIWKHFRQWUDVWFROXPQLQWKH3$WUHHPRWLRQDUWHIDFWVRIWKH DRUWLFURRWGLDSKUDJPDQGSXOPRQDU\VWUXFWXUHVZHUHUHFRUGHG 5HVXOWV 0HDQ FHQWUDO DQG SHULSKHUDO 3$ DWWHQXDWLRQ ZDV +8 DQG +8PHDQLPDJHQRLVH+80HDQH[DPLQDWLRQWLPHZDV VPHDQ'/3P*\FP7KHUHZHUHQRPRWLRQDUWHIDFWVRIWKHGLDSKUDJP RUWKHSXOPRQDU\YHVVHOVUHODWHGWREUHDWKLQJ7KHUHZDVQRFDVHRISDUWLDORUWRWDO LQWHUUXSWLRQRIWKHFRQWUDVWFROXPQLQWKH3$WUHHQRH[DPLQDWLRQZDVUDWHGQRQ GLDJQRVWLF,QFDVHVWKHDRUWLFURRWZDVSLFWXUHGZLWKRXWDQ\PRWLRQDUWHIDFW DQGZLWKVDWLVI\LQJFRQWUDVWHQKDQFHPHQWWRUXOHRXWGLVVHFWLRQ &RQFOXVLRQ+LJKSLWFKGXDOVRXUFH&73$LQIUHHO\EUHDWKLQJSDWLHQWVHIIHFWLYHO\ DYRLGVDUWHIDFWVUHODWHGWREUHDWKKROGRUEUHDWKLQJDVZHOODVWRFDUGLDFPRWLRQ DQGWKXVUHSUHVHQWVDUHOLDEOHWRROWRUXOHRXWSXOPRQDU\HPEROLVP:LWKIXUWKHU RSWLPLVHGFRQWUDVWLQMHFWLRQDRUWLFGLVVHFWLRQPD\EHDGGLWLRQDOO\UXOHGRXWZLWKLQ WKHVDPHH[DPLQDWLRQZLWKRXWWKHXVHRI(&*V\QFKURQLVDWLRQ % %UHDWKKROGDWHDVHDPHWKRGRILPSURYLQJWKHGLDJQRVWLFTXDOLW\RI &7SXOPRQDU\DQJLRJUDP ../DX-/L1$UGOH\7 /DX0HOERXUQH9LFWRULD$8 NHQNSODX#\DKRRFRPDX 3XUSRVHRI&7SXOPRQDU\DQJLRJUDSK\&73$LVLQFRQFOXVLYHGXHWRSRRU FRQWUDVWHQKDQFHPHQWRISXOPRQDU\DUWHULHV3$7\SLFDOO\&73$LVXQGHUWDNHQ DIWHUSDWLHQWWDNLQJIXOO\LQVSLUDWLRQDQGEUHDWKKROGLQJ7KHVXGGHQQHJDWLYHLQWUD WKRUDFLFSUHVVXUHGXULQJTXLFNLQVSLUDWLRQLQFUHDVHVYHQRXVUHWXUQWRWKHKHDUWDQG GLOXWHVWKHFRQWUDVWLQ3$WUDQVLHQWLQWHUUXSWLRQRIFRQWUDVW7KHYDOVDOYDDVVRFL DWHGZLWKEUHDWKKROGLQJORZHUVWKHFDUGLDFRXWSXWDQGGHOD\VWKHSHDNFRQWUDVW RSDFLÀFDWLRQRI3$7KHDLPRIWKLVVWXG\ZDVWRDVVHVVWKHHIÀFDF\RIEUHDWKKROG DWHDVHGXULQJ&73$RQWKHFRQWUDVWHQKDQFHPHQWRI3$ 0HWKRGVDQG0DWHULDOV&73$VZHUHXQGHUWDNHQLQFRQVHFXWLYHSDWLHQWVZKR GHHSO\ LQVSLUHG DQG EUHDWKKHOG GXULQJ VFDQQLQJ DQG FRQVHFXWLYH SDWLHQWV ZKRVLPSO\EUHDWKKHOGDWHDVH+RXQVÀHOGXQLWV+8LQSXOPRQDU\WUXQNPDLQ SXOPRQDU\DUWHULHVDQGSUR[LPDOEUDQFKHVZHUHPHDVXUHGE\EOLQGHGUHDGHUV 5HVXOWVZHUHFRPSDUHGEHWZHHQSDWLHQWJURXSV3(DQGFRH[LVWLQJOXQJGLV HDVHVZHUHDOVRUHFRUGHG 5HVXOWV 6XERSWLPDO FRQWUDVW HQKDQFHPHQW ZDV IRXQG LQ RI WKH GHHSO\ LQVSLUHGJURXSDQGRIWKHDWHDVHJURXS+8VUDQJHGIURPWRLQ GLIIHUHQWSDUWRI3$VLQWKHLQVSLUHGJURXSDQGWRLQWKHDWHDVHJURXS ZLWK PHDQ LQFUHDVH RI FRQWUDVW GHQVLW\ S ,PDJHV RI WKH OXQJ SDUHQFK\PDLQERWKJURXSVZHUHFRQVLGHUHGDGHTXDWH/HVVEUHDWKLQJDUWHIDFW ZDVQRWHGLQWKHDWHDVHJURXS &RQFOXVLRQ%UHDWKKROGLQJDWHDVHGXULQJVFDQQLQJLPSURYHVWKHRYHUDOOFRQWUDVW GHQVLW\LQWKH3$DQGWKHUHIRUHWKHGLDJQRVWLFTXDOLW\RIWKH&73$ 6FLHQWLILF6HVVLRQ $ 6&'()*+%(XURSHDQ&RQJUHVVRI 5DGLRORJ\ 6XQGD\ HYHQWV RI 59/9&K 59/9YROXPH DQG KV7Q, ZHUH DQG 7KH FRPELQDWLRQRIKV7Q,DQG59/9UDWLRVUHYHDOHGQRLQFUHDVHVLQWKH$8& &RQFOXVLRQ+V7Q,LVDVVRFLDWHGZLWKDGYHUVHFOLQLFDOHYHQWV$FRPELQDWLRQRI KV7Q, ZLWK &7 SDUDPHWHUV VKRZHG QR IXUWKHU LPSURYHPHQW LQ WKH SUHGLFWLRQ RI DGYHUVHFOLQLFDOHYHQWV % &RQWUDVWHQKDQFHG0'&7YVWLPHUHVROYHG05DQJLRJUDSK\ YVFRQWUDVWHQKDQFHGSHUIXVLRQ05,DVVHVVPHQWRIWUHDWPHQW UHVSRQVHE\SDWLHQWVZLWKFKURQLFWKURPERHPEROLFSXOPRQDU\ K\SHUWHQVLRQ < 2KQR01LVKLR+.R\DPD7 <RVKLNDZD'7 DNHQDND60DWVXPRWR .6XJLPXUD.REH-3\RVLUDG#NREHXDFMS 3XUSRVH7 R FRPSDUH WKHUDSHXWLF HIIHFW DVVHVVPHQW FDSDELOLW\ RI 0'&7 WLPH UHVROYHG05DQJLRJUDSK\G\QDPLFSHUIXVLRQ05,DQGFRQYHQWLRQDOSDUDPHWHUV IRUFKURQLFWKURPERHPEROLFSXOPRQDU\K\SHUWHQVLRQ&7(3+SDWLHQWV 0HWKRGVDQG0DWHULDOV7ZHQW\IRXUFRQVHFXWLYH&7(3+SDWLHQWVPHQDQG ZRPHQPHDQVWDQGDUGGHYLDWLRQDJH\HDUVWUHDWHGZLWKFRQYHQWLRQDO WKHUDS\XQGHUZHQWSUHDQGSRVWWKHUDSHXWLF0'&7 WLPHUHVROYHG05DQJLRJUDSK\ G\QDPLFSHUIXVLRQ05,DQGFDUGLDF86DQGULJKWKHDUWFDWKHWHULVDWLRQ $OOSDWLHQWV ZHUHGLYLGHGLQWRWZRJURXSVUHVSRQVHQ DQGQRQUHVSRQVHQ &7(3+ LQGH[HVIRU0'&7&7(3+&7DQG05DQJLRJUDSK\&7(3+05$ZHUHFDOFXODWHG RQ WKH EDVLV RI HPEROLF EXUGHQ 3XOPRQDU\ EORRG ÁRZ 3%) SXOPRQDU\ EORRG YROXPH3%9DQGPHDQWUDQVLWWLPH077PDSVZHUHJHQHUDWHGIURPDOOSHUIXVLRQ 05GDWDIROORZHGE\GHWHUPLQDWLRQRILPSURYHPHQWVLQPHDQ3%) 3%9DQG077 DW52,VIRUHDFKSDWLHQW5HFHLYHURSHUDWLQJFKDUDFWHULVWLF52&EDVHGSRVLWLYH WHVWVZHUHSHUIRUPHGWRGHWHUPLQHWKHIHDVLEOHWKUHVKROGYDOXHVIRUGLVWLQJXLVKLQJ UHVSRQVHIURPQRQUHVSRQVHJURXSV)LQDOO\GLDJQRVWLFFDSDELOLWLHVZHUHFRPSDUHG E\PHDQVRIWKH0F1HPDUҋVWHVW 5HVXOWV:KHQHDFKRIWKHIHDVLEOHWKUHVKROGYDOXHVZDVXVHGVSHFLÀFLW\ SDQGDFFXUDF\SIRULPSURYHPHQWLQ3%)ZHUHVLJQLÀFDQWO\ KLJKHUWKDQWKRVHIRULPSURYHPHQWVLQ0:'VSHFLÀFLW\DFFXUDF\ DQG&7(3+&7$VSHFLÀFLW\DFFXUDF\ &RQFOXVLRQ '\QDPLF SHUIXVLRQ 05, DQG WLPHUHVROYHG 05 DQJLRJUDSK\ KDYH HTXDORUEHWWHUFDSDELOLW\IRUDVVHVVPHQWRIWKHUDSHXWLFHIIHFWRQ&7(3+SDWLHQWV WKDQGRFRQYHQWLRQDOSDUDPHWHUVDQG0'&7 % ,QFLGHQFHDQGDHWLRORJ\RIPRVDLFOXQJDWWHQXDWLRQ0/$LQDODUJH FRKRUWRISDWLHQWVZLWKULJKWKHDUWFDWKHWHU5+&FRUURERUDWHG SXOPRQDU\K\SHUWHQVLRQ3+ /:RRGV$1DLU'3DWHO$'HYDUDM%0DGGHQ,9ODKRV/RQGRQ8. OLDPZRRGV#GRFWRUVRUJXN 3XUSRVH7 RGHWHUPLQHWKHH[WHQWVHYHULW\DQGDHWLRORJ\RI0/$GHWHFWHGDWWKLQ VHFWLRQ&7LQDODUJH5+&FRUURERUDWHG3+JURXS 0HWKRGVDQG0DWHULDOV&7VFDQVRISDWLHQWVZLWK5+&FRQÀUPHG3+UHIHUUHG WRDWHUWLDU\FHQWUHZHUHUHWURVSHFWLYHO\HYDOXDWHG,QVSLUDWRU\DQGH[SLUDWRU\LPDJ LQJZDVUHYLHZHGIURPWKHVDPHWLPHSRLQWZKHUHDYDLODEOHWHFKQLFDOO\DGHTXDWHRU IURPPHWDFKURQRXVVWXGLHVLIQRW7KUHHFKHVWUDGLRORJLVWVGHWHUPLQHGE\FRQVHQVXV 0/$VHYHULW\DEVHQWPLQRUSK\VLRORJLFPLOGPRGHUDWHVHYHUH)RU SDLUHG LQVSLUDWRU\H[SLUDWRU\ VWXGLHV SUHGRPLQDQW DHWLRORJ\ ZDV GHWHUPLQHG DV DLUWUDSSLQJ$0/$YDVFXODU90/$RUPL[HGLQGHWHUPLQDWH00/$ 5HVXOWVRISDWLHQWVKDGWHFKQLFDOO\DGHTXDWHLQVSLUDWRU\LPDJLQJ 0/$ZDVSUHVHQWLQVHYHULW\UHVSHFWLYHO\ RI SDWLHQWV KDG SDLUHG LQVSLUDWRU\H[SLUDWRU\ LPDJLQJ ZLWK D FRPSDUDEOH SHUFHQWDJHGHPRQVWUDWLQJDWOHDVWPLOG0/$7KH0/$DHWLRORJ\ZDV $0/$ LQ90/$LQDQG00/$LQ:KHQFRQVLGHULQJSDWLHQWVZLWKDWOHDVW PLOG0/$WKHSURSRUWLRQRI90/$LQFUHDVHG7KHSURSRUWLRQRISDWLHQWVZLWK 0/$GXHWR90/$ZDVVLJQLÀFDQWO\KLJKHULQSDWLHQWVZLWKFKURQLFWKURPERHPEROLF 3+&7(3+WKDQRWKHUFDXVHVFRPELQHGY)LVKHUH[DFWWHVWS +RZHYHUYDVFXODUSUHGRPLQDQWPRVDLFLVPDOVRRFFXUUHGLQRILGLRSDWKLF3+ RIREVWUXFWLYHOXQJGLVHDVHDQGRIOHIWKHDUWGLVHDVH3+DHWLRORJLHV 2YHUDOORIYDVFXODUPRVDLFLVPZDVQRWGXHWR&7(3+ &RQFOXVLRQ,QWKLVFRKRUW0/$LVFRPPRQHUWKDQSUHYLRXVO\UHSRUWHG$OWKRXJK XVXDOO\GXHWRDLUWUDSSLQJDVLJQLÀFDQWSURSRUWLRQLVYDVFXODULQDHWLRORJ\WKRXJK QRWQHFHVVDULO\GXHWR&7(3+ WLRQV 035 DQG YROXPH UHQGHULQJ 95 UHFRQVWUXFWLRQV 7ZR UHDGHUV JUDGHG WKHSRVLWLRQRI,96DVQRUPDOÁDWWHQHGRUERZHG,QWHUREVHUYHUDJUHHPHQWZDV PHDVXUHGIRUERWKPHWKRGVRILGHQWLÀFDWLRQRI,96SRVLWLRQ52&DQDO\VLVZDVSHU IRUPHGWRFRPSDUHDFFXUDF\RIERWKPHWKRGVIRULGHQWLÀFDWLRQRILQFUHDVHG3$63 5HVXOWV,QWHUREVHUYHUDJUHHPHQWZDVIRXQGWREHIDLUNDSSD S IRUWKH035EDVHGJUDGLQJRI,96SRVLWLRQDVQRUPDORUDEQRUPDO)RUWKH95EDVHG DVVHVVPHQWNDSSDZDVJRRGS52&DQDO\VLVIRUERWKPHWKRGV VKRZHGLQVLJQLÀFDQWO\EHWWHUSHUIRUPDQFHRI95EDVHGPHWKRGIRULGHQWLÀFDWLRQRI LQFUHDVHG3$63 ZLWKDUHDXQGHU52&FXUYHIRU035EDVHGPHWKRGDQG IRU95PHWKRG6HQVLWLYLW\DQGVSHFLÀFLW\ZHUHDQGIRU95PHWKRG DQGDQGIRU035PHWKRGUHVSHFWLYHO\ &RQFOXVLRQ95EDVHGHYDOXDWLRQRI,96SRVLWLRQLVFKDUDFWHULVHGE\JRRGLQWHU REVHUYHUDJUHHPHQWDQGPRGHUDWHDFFXUDF\IRULGHQWLÀFDWLRQRILQFUHDVHG3$63 5HVXOWVLQGLFDWHWKDWWKLVPHWKRGPD\LPSURYHXVHRIWKLVYDOXDEOHDGGLWLRQDOVLJQ HYDOXDWHGLQSDWLHQWVZLWKDFXWH3( % $VVHVVPHQWRIWKHFRUUHODWLRQEHWZHHQ&7DQJLRJUDSKLFFORWORDG VFRUHSXOPRQDU\SHUIXVLRQGHIHFWVFRUHDQGJOREDOULJKWYHQWULFXODU IXQFWLRQE\GXDOVRXUFH&7IRUDFXWHSXOPRQDU\HPEROLVP < ) =KRX3 +DQ< :DQJ+6KL:XKDQ&1]KRX\XQIHQJ #\DKRRFQ 3XUSRVH7 RLQYHVWLJDWHWKHFRUUHODWLRQEHWZHHQ&7DQJLRJUDSKLFFORWORDG&7$&/ VFRUH SXOPRQDU\ SHUIXVLRQ GHIHFW 33' VFRUH DQG WKH JOREDO ULJKW YHQWULFXODU IXQFWLRQLQWKHDVVHVVPHQWRIWKHVHYHULW\RISXOPRQDU\HPEROLVP3( 0HWKRGVDQG0DWHULDOV)RUW\QLQHSDWLHQWVZLWKDFXWH3(ZKRXQGHUZHQWGXDO VRXUFH&7VFDQZHUHLQFOXGHGLQWKHVWXG\&7DQJLRJUDSK\DQGSHUIXVLRQLPDJLQJ ZHUHSHUIRUPHG7KHGDWDIURP(&*JDWHGFRURQDU\DQJLRJUDSK\VFDQQLQJSURWRFRO ZHUHXVHGIRUULJKWYHQWULFXODUIXQFWLRQDQDO\VLV7ZRUHDGHUVHYDOXDWHGWKH&7$&/ DQG33'VFRUHVDFFRUGLQJWRWKH4DQDGOLDQG&KDHPHWKRGVUHVSHFWLYHO\DQG WKHLUUHVXOWVZHUHLQFRQVHQVXV 5HVXOWV7KH33'VFRUHKDGDVWURQJSRVLWLYHFRUUHODWLRQZLWKWKH&7$&/VFRUHU SDQGERWKVFRUHVLQWXUQKDGDVWURQJSRVLWLYHFRUUHODWLRQZLWKWKH ULJKWYHQWULFXODUOHIWYHQWULFXODU59/9GLDPHWHUUDWLRU U S +RZHYHUWKH33'VFRUHKDGDVWURQJQHJDWLYHFRUUHODWLRQZLWKHMHFWLRQIUDFWLRQ ()U SZKLOHWKH&7$&/VFRUHKDGDORZQHJDWLYHFRUUHODWLRQ ZLWK()U S %HWZHHQWKH59/9JURXSQ DQGWKH59/9! JURXSQ WKH33'VFRUH&7$&/VFRUHSXOPRQDU\DUWHU\WUXQNGLDPHWHU() DQGUHÁX[RILQIHULRUYHQDFDYDZHUHVLJQLÀFDQWO\GLIIHUHQWDOOZLWKS7KH HQGV\VWROLFYROXPHS ZDVVLJQLÀFDQWO\GLIIHUHQWEXWWKHHQGGLDVWROLFYROXPH S DQGVWURNHYROXPHS VKRZHGQRVWDWLVWLFDOO\VLJQLÀFDQWGLIIHUHQFH EHWZHHQWKHWZRJURXSV &RQFOXVLRQ 7KHUHIRUH FRQVLGHULQJ 33' VFRUHV &7$&/ VFRUHV DQG FDUGLR YDVFXODUPDQLIHVWDWLRQVWRJHWKHUPD\EHKHOSIXOLQWKHHYDOXDWLRQRI3(VHYHULW\ DFFHSWHGE\%-5 % &RPSDULVRQRIKLJKVHQVLWLYHWURSRQLQ,DQGTXDQWLWDWLYH&7 SDUDPHWHUVIRUSUHGLFWLRQRIDGYHUVHFOLQLFDOHYHQWVLQSDWLHQWVZLWK DFXWHSXOPRQDU\HPEROLVP 3 $SIDOWUHU ) :HLOEDFKHU00H\HU7 +HQ]OHU7 :DOWHU-*UXHWWQHU 8-6FKRHSI&)LQN0DQQKHLP'(&KDUOHVWRQ6&86 3XUSRVH7 RFRPSDUHKLJKVHQVLWLYHWURSRQLQ,KV7Q,DQGTXDQWLWDWLYH&7SD UDPHWHUVIRUSUHGLFWLRQRIDGYHUVHFOLQLFDOHYHQWVLQSDWLHQWVZLWKDFXWHSXOPRQDU\ HPEROLVP3( 0HWKRGVDQG0DWHULDOV3XOPRQDU\&7$VWXGLHVRISDWLHQWVZHUHUHWURVSHF WLYHO\HYDOXDWHGSDWLHQWV\HDUV>@KDGDFXWH3(DQGKV7Q,PHDVXUH PHQWVZLWKLQKRXUVRI&7 5LJKWYHQWULFXODUG\VIXQFWLRQ59'ZDVDVVHVVHGRQ &7E\FDOFXODWLQJWKHULJKWYHQWULFXODUOHIWYHQWULFXODU59/9GLDPHWHUUDWLRVRQ WUDQVYHUVHVHFWLRQV59/9WUDQVIRXUFKDPEHUYLHZV59/9FK59/9YROXPH UDWLR59/9YRO3XOPRQDU\&7$REVWUXFWLRQVFRUHV264DQDGOL0DVWRUDZHUH FDOFXODWHG+V7Q,59/9UDWLRVDQG26ZHUHFRPSDUHGIRUSUHGLFWLQJDGYHUVH FOLQLFDOHYHQWV 5HVXOWVSDWLHQWVZLWK3(KDGDWOHDVWRQHDGYHUVHFOLQLFDOHYHQWLQWHQVLYH FDUHWUHDWPHQWQ GHDWKQ WKRVHSDWLHQWVVKRZHGVLJQLÀFDQWO\KLJKHU59 /9UDWLRVDQG26FRPSDUHGWRWKRVHZLWKRXW59/9WUDQVYV 59/9FKYV59/9YROXPHYV0DVWRUD >@YV>@DQG4DQDGOL>@YV>@S" (OHYDWHGKV7Q,ZDVVLJQLÀFDQWO\DVVRFLDWHGZLWKDGYHUVHFOLQLFDOHYHQWVYV SDGMXVWHG25 &,S+V7Q,VKRZHGQR FRUUHODWLRQZLWK59/9UDWLRVRU267KH$8&IRUWKHSUHGLFWLRQRIDGYHUVHFOLQLFDO 6FLHQWLILF6HVVLRQ 6 &$' ( ) *+% (XURSHDQ&RQJUHVVRI 5DGLRORJ\ % 'LDJQRVWLFGLJLWDOVXEWUDFWLRQGDFU\RF\VWRJUDSK\FULWHULDRI HYDOXDWLRQIUHTXHQF\DQGORFDOLVDWLRQRISDWKRORJLFDOÀQGLQJV '.)LOLSSLDGLV$:HLVVEDFK&0H\HU$0D]LRWL++6FKLOG .(:LOKHOP$WKHQV*5%RQQ'(GÀOLSSLDGLV#\DKRRJU 3XUSRVH7 RHYDOXDWHWKHIUHTXHQF\DQGORFDOLVDWLRQRISDWKRORJLFDOÀQGLQJVLQ SDWLHQWVVXIIHULQJIURPHSLSKRUD 0HWKRGVDQG0DWHULDOV5HWURVSHFWLYHDQDO\VLVRIGLDJQRVWLFGDFU\RF\VWR JUDPVLQSDWLHQWVVXIIHULQJIURPHSLSKRUD6WHQRVLVZDVGHÀQHGDVHDUO\UHÁX[ WKURXJK WKH SXQFWXP ZLWK UHVLGXDO ÁRZ RI FRQWUDVW PDWHULDO WR WKH QDVDO FDYLW\ &RPSOHWHREVWUXFWLRQZDVDVVXPHGLIQRÁRZRIFRQWUDVWPDWHULDOWRWKHQDVDO FDYLW\ZDVVHHQHYHQDIWHUIRUFHGLUULJDWLRQ 5HVXOWV,QFDVHVQRWHDUGXFWREVWUXFWLRQZDVIRXQG,Q FDVHVDWHDUGXFWREVWUXFWLRQZDVVHHQ,QFDVHVWKHUHZDVDVWHQRVLV ZKLOVWLQFDVHVWKHUHZDVDFRPSOHWHREVWUXFWLRQ/RFDOLVDWLRQRIWKH VWHQRVLV LQFOXGHG MXQFWLRQ RI WKH QDVRODFULPDO VDF DQG QDVRODFULPDO GXFW DW FDVHVSRVWVDFFDOOHYHODWFDVHVFRPPRQFDQDOLFXOXVDWFDVHV DQGORZHUFDQDOLFXOXVDWFDVH/RFDOLVDWLRQRIFRPSOHWHREVWUXFWLRQV LQFOXGHGMXQFWLRQRIQDVRODFULPDOVDFDQGQDVRODFULPDOGXFWDWFDVHV FRPPRQFDQDOLFXOXVOHYHODWFDVHVSRVWVDFFDOOHYHODWFDVHV DQGORZHUFDQDOLFXOXVDWFDVHV &RQFOXVLRQ(SLSKRUDLVPRVWO\FDXVHGE\VWHQRVLVRUFRPSOHWHREVWUXFWLRQRI WKHQDVRODFULPDOGXFWV\VWHP7KHPRVWFRPPRQVLWHRIREVWUXFWLRQLVWKHMXQFWLRQ RIWKHQDVRODFULPDOVDFDQGQDVRODFULPDOGXFW&RPSOHWHREVWUXFWLRQVDUHPRUH FRPPRQWKDQVWHQRVLV % (PEROLVDWLRQWHFKQLTXHVIRUSRVWWUDXPDWLFVSOHQLFLQMXU\ *UHQREOHҋVH[SHULHQFH -)UDQGRQ2(NHU) 7KRQ\05RGLHUH&6HQJHO3 'XUDQG06DKLQ $9HQGUHOO,%ULFDXOW*UHQREOH)5MIUDQGRQ #FKXJUHQREOHIU 3XUSRVH1RQRSHUDWLYHPDQDJHPHQWRIVSOHQLFLQMXU\LVQRZWKHVWDQGDUGLQVWDEOH WUDXPDSDWLHQW2XUREMHFWLYHLVWRFRPSDUHWKHRXWFRPHVRISUR[LPDOGLVWDORU FRPELQHGHPEROLVDWLRQSURFHGXUHVLQSDWLHQWVZLWKVSOHQLFLQMXU\ 0HWKRGV DQG 0DWHULDOV %HWZHHQ DQG DOO SDWLHQWV DGPLWWHG LQ RXU FHQWHUIRUSRVWWUDXPDWLFVSOHQLFLQMXU\UHTXLULQJHPEROLVDWLRQZHUHUHYLHZHG7KH\ XQGHUZHQWSUR[LPDOJURXS$GLVWDOJURXS%RUFRPELQHGSUR[LPDODQGGLVWDO JURXS & HPEROLVDWLRQ SURFHGXUHV 5HEOHHGLQJ UHTXLULQJ VSOHQHFWRP\ RU QRW DQGFRPSOLFDWLRQVDIWHUHPEROLVDWLRQDVVSOHQLFLQIDUFWLRQDEVFHVVSDQFUHDWLWLV SDQFUHDWLFSVHXGRF\VWRUKHPDWRPDODUJHKHPRSHULWRQHXPSVHXGRDQHXU\VP ÀVWXOD SOHXUDO HIIXVLRQ RU GLVWDO FRLO PLJUDWLRQ ZHUH DVVHVVHG LQ DOO JURXSV$ )LVKHUҋVH[DFWWHVWZDVXVHG 5HVXOWV)RUW\VHYHQSDWLHQWVXQGHUZHQWHPEROLVDWLRQVDVQ Q DQGQ LQJURXSV$%DQG&UHVSHFWLYHO\5HEOHHGLQJZDVREVHUYHGLQ RIDOOSDWLHQWVQ ZLWKRXWDQ\VLJQLÀFDQWGLIIHUHQFHEHWZHHQDOOJURXSV Q LQ$Q LQ%Q LQ&S 6SOHQHFWRP\ZDVUHTXLUHGLQRISD WLHQWVRQO\LQJURXS%Q ZLWKRXWDQ\VWDWLVWLFDOO\VLJQLÀFDQWGLIIHUHQFHS 7ZHQW\QLQHFRPSOLFDWLRQVDIWHUHPEROLVDWLRQZHUHREVHUYHGLQRISDWLHQWV Q LQJURXS$Q LQJURXS%Q DQGLQJURXS&Q ZLWKRXW DQ\VWDWLVWLFDOO\VLJQLÀFDQWGLIIHUHQFHS &RQFOXVLRQ 3UR[LPDO GLVWDO DQG FRPELQHG HPEROLVDWLRQ WHFKQLTXHV IRU SRVW WUDXPDWLFVSOHQLFLQMXU\SUHVHQWHGQRVWDWLVWLFDOO\GLIIHUHQWUDWHVRIUHEOHHGLQJDQG FRPSOLFDWLRQVDIWHUHPEROLVDWLRQ6SOHQHFWRP\ZDVQHHGHGLQIHZFDVHVRQO\IRU SDWLHQWVZKRXQGHUZHQWGLVWDOHPEROLVDWLRQ % 1DVRODFULPDOSRO\XUHWKDQHVWHQWLPSURYLQJRXWFRPHVZLWKWKH :LOKHOPW\SH:LOKHOPWHDUOHDGHUVWHQW '.)LOLSSLDGLV $:HLVVEDFK&0H\HU$0D]LRWL++6FKLOG .(:LOKHOP$WKHQV*5%RQQ'(GÀOLSSLDGLV#\DKRRJU 3XUSRVH7 RHYDOXDWHWKHHIIHFWLYHQHVVDQGORQJWHUPUHVXOWVRIQDVRODFULPDOGXFW VWHQWLPSODQWDWLRQLQWKHWUHDWPHQWRIHSLSKRUD 0HWKRGVDQG0DWHULDOVSDWLHQWVPHDQDJH>UDQJH@PDOHVDQG IHPDOHVZLWKVHYHUHHSLSKRUDXQGHUZHQWQDVRODFULPDOGXFWVWHQWLQJ:LOKHOP W\SH SRO\XUHWKDQH VWHQW XQGHU ÁXRURVFRSLF JXLGDQFH DIWHU GDFU\RF\VWRJUDSK\ DVDWUHDWPHQWIRUREVWUXFWLRQVRIWKHQDVRODFULPDOV\VWHP7KHDHWLRORJ\RIWKH REVWUXFWLRQZDVFKURQLFLQIHFWLRQFKURQLFGDFU\RF\VWLWLVLQDOOFDVHV 5HVXOWV 7KH RYHUDOO WHFKQLFDO VXFFHVV UDWH RI VWHQW SODFHPHQW ZDV 1 R FDVHVRISDOSHEUDOKDHPDWRPDZHUHUHFRUGHGQHLWKHUZHUHWKHUHFDVHVRIDFXWH GDFU\RF\VWLWLVIROORZLQJWKHSURFHGXUH6HFRQGDU\SDWHQF\ZDVDFKLHYHGLQ % 8VHRISXOPRQDU\&7DQJLRJUDSK\WRGLDJQRVHDQDHPLD &6/-XQJ0*URWK7 $%OH\) 2+HQHV$7UHV]O*$GDP3 %DQQDV +DPEXUJ'( 3XUSRVH$QDHPLDLVDVVRFLDWHGZLWKLQFUHDVHGPRUWDOLW\LQSDWLHQWVZLWKDFXWH V\PSWRPDWLFSXOPRQDU\HPEROLVP3(7KHSXUSRVHRIWKLVVWXG\ZDVWRHYDOX DWHWKHIHDVLELOLW\RI+RXQVÀHOGXQLW+8PHDVXUHPHQWVRQDVLQJOHXQHQKDQFHG WULJJHUVFDQRISXOPRQDU\&7DQJLRJUDSK\VFDQVIRUWKHGLDJQRVLVRIDQDHPLDDV DSRWHQWLDOSURJQRVWLFPDUNHU 0HWKRGVDQG0DWHULDOVFRQVHFXWLYHSDWLHQWVZLWKVXVSHFWHG3(XQGHUZHQW SXOPRQDU\&7DQJLRJUDSK\7ZRUDGLRORJLVWVEOLQGHGWRODERUDWRU\UHVXOWVSHU IRUPHG+8PHDVXUHPHQWVLQWKHVLQJOHXQHQKDQFHGWULJJHUVFDQLQGHSHQGHQWO\ E\UHJLRQEDVHGDQDO\VLV52,+8YDOXHVIURPDVFHQGLQJDQGGHVFHQGLQJDRUWD DQGWKHFDOFXODWHGPHDQRIERWKZHUHFRUUHODWHGZLWKVHUXPKDHPRJORELQOHYHOV ,QWHU DQG LQWUDREVHUYHU YDULDELOLW\ ZDV GHWHUPLQHG IRU +8 PHDVXUHPHQWV DQG UHFHLYHURSHUDWLQJFKDUDFWHULVWLF52&DQDO\VLVZDVSHUIRUPHGIRUGLDJQRVLVRI DQDHPLD&DOFXODWHGOLQHDUPRGHOVZHUHXVHGWRDVVHVVIRUPXODVIRUHVWLPDWLRQ RIKDHPRJORELQOHYHOVIURP+8PHDVXUHPHQWV 5HVXOWV +8 PHDVXUHPHQWV UHYHDOHG KLJK LQWUD DQG LQWHUUDWHU UHOLDELOLW\ ,&&!DQG,&&!UHVSHFWLYHO\&DOFXODWHGPHDQ+8YDOXHVVKRZHG DPRGHUDWHFRUUHODWLRQZLWKVHUXPKDHPRJORELQOHYHOVU ZKLFKDOORZHG JHQHUDWLRQ RI GLIIHUHQW IRUPXODV IRU FDOFXODWLRQ RI KDHPRJORELQ OHYHOV IURP +8 PHDVXUHPHQWV52&DQDO\VHVFRQÀUPHGDKLJKVHQVLWLYLW\IRUPHQIRU ZRPHQDQGVSHFLÀFLW\IRUPHQIRUZRPHQIRUGLDJQRVLQJDQDHPLD &RQFOXVLRQ'LDJQRVLVRIDQDHPLDDQGTXDQWLÀFDWLRQRIKDHPRJORELQOHYHOVXSRQ DVLQJOHXQHQKDQFHGWULJJHUVFDQRISXOPRQDU\&7DQJLRJUDSK\LVIHDVLEOH:H VXJJHVWGLVFORVLQJWKHDQDHPLFVWDWHLQWKHUDGLRORJLFDOUHSRUWLQGHSHQGHQWRIWKH SUHVHQFHRI3(VLQFHDQDHPLDFDUULHVLQFUHDVHGULVNVRIPRUELGLW\DQGPRUWDOLW\ 5RRP' ,QWHUYHQWLRQDO5DGLRORJ\ 66 6SHFLDOLQGLFDWLRQV 0RGHUDWRUV (&ULDGR3DUHGHV6DEDGHOO(6 0-/HH'XEOLQ,( % 3UHGLFWRUVDQGYROXPHPHDVXUHPHQWRIUHVLGXDOÁRZLQHPEROLVHG LQWUDFUDQLDODQHXU\VPVDWIROORZXS =6HUDÀQ3 6WU]HŋQLHZVNL:/DVHN:%HXWK%\GJRV]F]3/ VHUDÀQ#FPXPNSO 3XUSRVH7KHSRVVLELOLW\RIUHFDQDOLVDWLRQDQGWKHQHHGIRUUHWUHDWPHQWDUHWKH PRVWLPSRUWDQWGUDZEDFNVRILQWUDFUDQLDODQHXU\VPHPEROLVDWLRQ7KHYROXPHRI UHVLGXDOÁRZDWIROORZXSLVDNH\IDFWRUWKDWGHWHUPLQHVGHFLVLRQRQWKHDQHXU\VP UHHPEROLVDWLRQ 7KH SXUSRVH RI WKH VWXG\ ZDV WR GHWHUPLQH IDFWRUV SUHGLFWLQJ WKH SUHVHQFH RI UHVLGXDO ÁRZ DW IROORZXS DQG WR FRPSDUH YROXPHV R I W K H Á R Z PHDVXUHGZLWK'GLJLWDOVXEWUDFWHGDQJLRJUDSK\'6$DQGPDJQHWLFUHVRQDQFH DQJLRJUDSK\05$ 0HWKRGVDQG0DWHULDOV,QFRQVHFXWLYHO\H[DPLQHGSDWLHQWVDQHXU\VPV ZHUH IRXQG LQFRPSOHWHO\ RFFOXGHG ,QGHSHQGHQW SUHGLFWRUV RI WKH UHVLGXDO ÁRZ ZHUHGHWHUPLQHGLQFOXGLQJDQDWRPLFDODQGFOLQLFDOIDFWRUV'LDPHWHUVDQGYROXPH RIUHVLGXDOÁRZDUHDVZHUHFRPSDUHGEHWZHHQWKUHHGLPHQVLRQDO'6$''6$ WLPHRIÁLJKW05$72)05$FRQWUDVWHQKDQFHG72)05$&(72)05$DQG FRQWUDVWHQKDQFHG05$&(05$ 5HVXOWV $QHXU\VPQHFNVL]HDQGVDFNWRQHFNUDWLRZHUHLQGHSHQGHQWSUHGLFWRUV RIUHVLGXDOÁRZ3 $52&FXUYHFXWRIISRLQWVZHUHPPIRUDQHXU\VP QHFNVL]HDQGIRUVDFNWRQHFNUDWLR7KHPHDQUHFDQDOLVDWLRQYROXPHUDQJHG IURPPPLQ72)05$WRPPLQ''6$3$129$$ GLUHFWFRPSDULVRQUHYHDOHGVLJQLÀFDQWGLIIHUHQFHVLQWKHYROXPHVPHDVXUHGZLWK ''6$DQG&(05$DVFRPSDUHGWR72)05$DQG&(72)05$3 &RQFOXVLRQ7KHSUHVHQFHRIWKHUHVLGXDOÁRZZLWKLQWKHHPEROLVHGDQHXU\VPLV SUHGLFWHGE\WKHDQHXU\VPDQDWRP\72)05$DQG&(72)05$WHQGWRXQGHU HVWLPDWHWKHVL]HRIWKHÁRZ7KHGHÀQLWLYHGHFLVLRQRQUHHPEROLVDWLRQVKRXOGEH PDGHEDVLQJRQ''6$ 6FLHQWLILF6HVVLRQ $ 6&'()*+%(XURSHDQ&RQJUHVVRI 5DGLRORJ\ 6XQGD\ 0HWKRGVDQG0DWHULDOV:HUHWURVSHFWLYHO\UHYLHZHGRQHKXQGUHGDQGIRXUWHHQ FRQVHFXWLYHSDWLHQWVPDOHVIHPDOHVPHDQDJH\HDUVVGZLWK LQWUDFUDQLDODQHXU\VPVWUHDWHGLQRXU,QVWLWXWLRQZLWKHQGRYDVFXODUDSSURDFK EHWZHHQ-DQXDU\DQG-XO\(IÀFDF\LQGHSOR\PHQWSURFHGXUHDQGDQJL RJUDSKLFRXWFRPHVDWIROORZXSLQWHUPVRIFRPSOHWHDQHXU\VPRFFOXVLRQZHUH FRPSDUHGXVLQJ)LVFKHU VH[DFWWHVWEHWZHHQSDWLHQWVWUHDWHGZLWKDÁRZGLYHUWHU GHYLFH6,/.ÁRZGLYHUWHU6)'SDWLHQWVWUHDWHGZLWKFRLODQGWKRVHWUHDWHGZLWK VWHQWDVVLVWHGFRLOHPEROLVDWLRQ 5HVXOWV $PRQJDOOFDVHVZHUHWUHDWHGZLWK6)'ZLWKFRLOLQJ DQGZLWKVWHQWDVVLVWHGFRLOLQJ(QGRYDVFXODUWUHDWPHQWZDVVXFFHVV IXOO\SHUIRUPHGLQDQHXU\VPV6)'FRXOGQRWEHGHOLYHUHGLQ FDVHVZKLOHFRLOHPEROLVDWLRQIDLOHGLQFDVHVDQGVWHQWDVVLVWHG FRLOHPEROLVDWLRQLQFDVHS :HREWDLQHGDFRPSOHWHDQHXU\VP RFFOXVLRQ LQ DOO FDVHV WUHDWHG ZLWK 6)' DQG QR VLJQLÀFDQW VWDWLVWLFDO GLIIHUHQFH S!ZDVIRXQGDWPRQWKVPHDQVGDQJLRJUDSKLFIROORZXSEHWZHHQ WKHWKUHHGLIIHUHQWJURXSV &RQFOXVLRQ $OWKRXJKVRPHGLIÀFXOWLHVLQGHSOR\PHQWSURFHGXUHLQFRPSDULVRQZLWK FRLODQGVWHQWDVVLVWHGFRLOHPEROLVDWLRQWKHWUHDWPHQWRILQWUDFUDQLDODQHXU\VPV ZLWK6)'VHHPVWREHKLJKO\HIÀFDFLRXVDQGHDUO\DQJLRJUDSKLFIROORZXSUHVXOWV DUHTXLWHHQFRXUDJLQJ % 3RVWWUDXPDWLFHSLVWD[LVWUHDWHGZLWKHPEROLVDWLRQ .3\UD7 -DUJLHããR3 7URMDQRZVNL0-DU]ćEHN06]F]HUER7URMDQRZVND /XEOLQ3/NS\UD#SRF]WDIP 3XUSRVH (SLVWD[LV LV D FRPPRQ FRQVHTXHQFH RI FUDQLRIDFLDO LQMXU\ LQYROYLQJ GDPDJHWRWKHH[WHUQDOFDURWLGDUWHU\EUDQFKHV'HSHQGLQJRQWKHLQWHQVLW\DQG WKHVLWHRIEOHHGLQJDQGDOVRRQWKHH[SHULHQFHRIWKHPHGLFDOWHDPFRQVHUYDWLYH WUHDWPHQWVXUJLFDORUHQGRYDVFXODUWUHDWPHQWLVDSSOLHG,QWKLVSDSHUWKHSRVVLELOLW\ RIHQGRYDVFXODUHPEROLVDWLRQDQGLWVHIIHFWLYHQHVVLQWKHWUHDWPHQWRIHSLVWD[LV IROORZLQJFUDQLRIDFLDOLQMXU\LVHYDOXDWHG 0HWKRGVDQG0DWHULDOV7KHUHZHUHSDWLHQWVPDOHVDQGIHPDOHVLQWKH PHDQDJH\HDUVZLWKSRVWWUDXPDWLFHSLVWD[LV,QSDWLHQWVDQJLRJUDSK\ 'LVFORVHGSVHXGRDQHXU\VPVRIWKHH[WHUQDOFDURWLGEUDQFKHVLQH[WUDYDVDWLRQ RIFRQWUDVWPHGLDLQFDYHUQRFDURWLGÀVWXODH)ROORZLQJGLDJQRVWLFDQJLRJUDSK\ WKHULVNRIHQGRYDVFXODUHPEROLVDWLRQZDVUHJDUGHGWREHWRRKLJKLQSDWLHQWV 5HPDLQLQJSDWLHQWVZHUHHPEROLVHGXVLQJJHODWLQIRDPSRO\YLQ\ODOFRKROSDU WLFOHVSDUWLFOHVRIDFU\OLFSRO\PHUDQGSODWLQLXPPLFURFRLOV 5HVXOWV,QDOOHPEROLVHGSDWLHQWVLPPHGLDWHDUUHVWRIHSLVWD[LVZDVDFKLHYHG,Q FDVHVWKHEOHHGLQJUHFXUUHGDQGLQZDVFRQWUROOHGZLWKUHSHDWHGHP EROLVDWLRQ,QSDWLHQWVWKHVLGHHIIHFWRIWKHSURFHGXUHZDVWUDQVLHQWIDFLDO SDLQDQGVZHOOLQJSDUDHVWKHVLDWULVPXVDQGIHYHU7KRVHV\PSWRPVGLVDSSHDUHG ZLWKLQDIHZGD\V,QSDWLHQWVVHQVRU\GLVWXUEDQFHVLQWKHFKHHNDUHDZHUH SHUPDQHQW2QHSDWLHQWGHYHORSHGDVPDOOXOFHUDWLRQRIWKHSDODWHVXFFHVVIXOO\ WUHDWHGFRQVHUYDWLYHO\7KHUHZHUHQRVHULRXVQHXURORJLFDOFRPSOLFDWLRQVLQDQ\ RIWKHSDWLHQWV &RQFOXVLRQ(QGRYDVXODUHPEROLVDWLRQ LVDQHIIHFWLYHPHWKRGRISRVWWUDXPDWLF HSLVWD[LVDQGVKRXOGEHFRQVLGHUHGLQSODQQLQJRIWKHWUHDWPHQW % 7UDFKHREURQFKLDOVWHQWLQJIRUPDOLJQDQWDLUZD\GLVHDVHORQJWHUP UHVXOWVIURPDVLQJOHFHQWUH 5,QFKLQJROR 6&6SLOLRSRLORV0.URNLGLV,$KPHG$0F*UDWK 3 *NRXW]LRV56DOWHU7 6DEKDUZDO5RPH,73DWUDV*5/RQGRQ8. 'XEOLQ,( 3XUSRVH7 RLQYHVWLJDWHWKHLPPHGLDWHDQGORQJWHUPRXWFRPHVRIFRYHUHGDQG XQFRYHUHGVHOIH[SDQGDEOHPHWDOOLFVWHQW6(06LQVHUWLRQIRUWKHPDQDJHPHQW RIWUDFKHREURQFKLDOPDOLJQDQWGLVHDVH 0HWKRGVDQG0DWHULDOV:HUHWURVSHFWLYHO\VHDUFKHGRXUGHSDUWPHQWGDWDEDVH IRU SDWLHQWV WUHDWHG ZLWK FRYHUHG RU XQFRYHUHG 6(06V IRU WKH PDQDJHPHQW RI WUDFKHREURQFKLDOSDWKRORJ\RZLQJWRORFDORUPHWDVWDWLFGLVHDVH%HWZHHQ-DQXDU\ DQG'HFHPEHULQWRWDOSDWLHQWVPDOHVPHDQDJH\HDUV XQGHUZHQW6(06LQVHUWLRQVXQFRYHUHGFRYHUHG7KHK\EULGSURFHGXUH ZDVSHUIRUPHGXQGHUEURQFKRVFRSLFDQGÁXRURVFRSLFJXLGDQFH7KHVWXG\ VSULPDU\ HQGSRLQWVLQFOXGHGWHFKQLFDOVXFFHVVDQGV\PSWRPDWRORJ\UHFXUUHQFHUDWHVZKLOH VHFRQGDU\HQGSRLQWVLQFOXGHGSDWLHQWV VXUYLYDODQGFRPSOLFDWLRQUDWHV%DVHOLQH GHPRJUDSKLFVDQGSURFHGXUDOGHWDLOVZHUHUHFRUGHG 5HVXOWV7 HFKQLFDOVXFFHVVUDWHZDVFDVHV,QWRWDONLVVLQJERWK EURQFKXVPDLQEURQFKXVGLVWDOEURQFKXVWUDFKHDODQGWUDFKHDOSOXV PDLQEURQFKXVVWHQWLQJGHSOR\PHQWVZHUHSHUIRUPHG7KHPHDQWLPHIROORZXS ZDVPRQWKVUDQJHPRQWKV7KHV\PSWRPDWRORJ\UHFXUUHQFHUDWH GXULQJDPHDQIROORZXSSHULRGRIQLQHPRQWKVUDQJHPRQWKVWR\HDUV6WHQWV PDOIXQFWLRQRFFXUUHGLQFDVHVDQGDOOWKHVHVWHQWVZHUHHDVLO\ZLWKGUDZQLQWKH UHVWRIWKHFDVHVWKHVWHQWVUHPDLQLQSODFHDQGIXQFWLRQDO &RQFOXVLRQ7UHDWPHQWRIHSLSKRUDZLWKSRO\XUHWKDQHVWHQWVLVDWHFKQLTXHWKDWLV ZHOOWROHUDWHGE\SDWLHQWVDQGDFKLHYHVDKLJKORQJWHUPVXFFHVVUDWHFRPSDUDEOH WRVXUJLFDOGDUF\RUKLQRVWRP\ % 7KHFODVVLFDOSDSHUVRILQWHUYHQWLRQDOUDGLRORJ\WKHHYROXWLRQ RIDVSHFLDOW\ 07 &URFNHWW2%XFNOH\:7 RUUHJJLDQL5%URZQH'XEOLQ,( &52&.(7707#*0$,/&20 3XUSRVH7KHYDOXHRIDVFLHQWLÀFSDSHULVGHÀQHGE\LWVLPSDFWRQWKHELRPHGLFDO ÀHOGLQZKLFKLWLVSXEOLVKHG3DSHUVZKLFKLPSDFWJUHDWO\RQWKHLUÀHOGDFKLHYH FODVVLFDOVWDWXV7KLVPD\EHGHÀQHGXVLQJWKHFRQFHSWRIDFLWDWLRQFODVVLFWKH QXPEHURIWLPHVDSDSHULVFLWHGUHÁHFWVLWVLPSDFWDQGUHOHYDQFH7KHSXUSRVHRI WKLVVWXG\ZDVWRLGHQWLI\DQGDQDO\VHWKHPRVWFLWHGLQWHUYHQWLRQDOUDGLRORJ\ SDSHUVRIWKHODVW\HDUV 0HWKRGVDQG0DWHULDOV8VLQJWKH-&5GDWDEDVHWKHKLJKHVWLPSDFWIDFWRU UDGLRORJ\MRXUQDOVZHUHVHOHFWHGIRUUHYLHZ)URPWKHVHMRXUQDOVWKHPRVWFLWHG LQWHUYHQWLRQDOUDGLRORJ\SXEOLFDWLRQVZHUHFKRVHQDQGIXUWKHUDQDO\VHG 5HVXOWV7KHPRVWFLWHGSDSHUUHFHLYHGQHDUO\FLWDWLRQVZKLOVWWKHDYHUDJH QXPEHURIFLWDWLRQVZDV7KHROGHVWSDSHUZDVSXEOLVKHGLQDQGPRVW UHFHQWLQ0RVWSDSHUVRULJLQDWHGLQWKH86$IROORZHGE\,WDO\)UDQFHDQG *HUPDQ\7KHWKUHHPRVWSUROLÀFLQVWLWXWLRQVZHUH+DUYDUG8QLYHUVLW\86$2V SHGDOH&LYLOH,WDO\DQG0DVVDFKXVHWWV*HQHUDO+RVSLWDO86$7KHPRVWFLWHG SDSHUVZHUHSXEOLVKHGLQMRXUQDOVZLWK5DGLRORJ\ $-5PDNLQJXSWKHPDMRULW\ )LYHDXWKRUVKDYH!ÀUVWQDPHSDSHUVLQWKHWRSZLWK61*ROGEHUJRQWRS ZLWK!RISDSHUVZHUHSXEOLVKHGDIWHU7KHROGHUSDSHUVIRFXVPDLQO\ RQFDUGLRYDVFXODULQWHUYHQWLRQDOWHFKQLTXHVZLWKPRUHUHFHQWSDSHUVGRPLQDWHG E\DGYDQFHVLQLQWHUYHQWLRQDOQHXURUDGLRORJ\ &RQFOXVLRQ7KLVDQDO\VLVLGHQWLÀHVPDQ\RIWKHODQGPDUNLQWHUYHQWLRQDOUDGLRORJ\ SDSHUVRIODVWVL[GHFDGHVDQGSURYLGHVDIDVFLQDWLQJLQVLJKWLQWRWKHFKDQJLQJ GLVFRXUVHZLWKLQWKHÀHOG,WDOVRLGHQWLÀHVWKHWRSLFVDXWKRUVDQGLQVWLWXWLRQVZKLFK KDYHKDGWKHJUHDWHVWLPSDFWRQWKHVSHFLDOW\ % 3HUFXWDQHRXVDUWHULRYHQRXVVKXQWLQJLQSDWLHQWVZLWKVHYHUH &23'DQRYHOLQWHUYHQWLRQDOWUHDWPHQW 7 6FKORVVHU0%XUEHONR08OULFK*$QWRFK5$GDPXV (VVHQ'(WKRPDVVFKORVVHU#XQLGXHGH 3XUSRVH7KHDLPRIWKLVVWXG\ZDVWRHYDOXDWHWKHWHFKQLFDOIHDVLELOLW\DQGVDIHW\ RIDQHZLQWHUYHQWLRQDOUDGLRORJLFDOWHFKQLTXHWRFUHDWHDVKXQWEHWZHHQWKHH[WHUQDO LOLDFYHLQDQGDUWHU\LQSDWLHQWVZLWKVHYHUH&23'7KHFUHDWLRQRIWKLVÀVWXODDLPV LPSURYLQJ SXOPRQDU\ R[\JHQDWLRQ UHGXFLQJ V\VWHPLF YDVFXODU UHVLVWDQFH DQG LQFUHDVLQJFDUGLDFRXWSXWLQWKHVHSDWLHQWV 0HWKRGVDQG0DWHULDOV7KLUW\VHYHQSDWLHQWVZHUHLQFOXGHGLQWKLVPXOWLFHQWUH WULDO7ZRSDWLHQWVKDGWREHH[FOXGHGIURPWKHVWXG\EDVHGRQWRRODUJHGLVWDQFH EHWZHHQWKHLOLDFYHVVHOVRQERWKVLGHV,QSDWLHQWVWKHDUWHU\ZDVSXQFWXUHG IURP WKH YHLQ ZLWK D QRYHO FURVVLQJ QHHGOH 8VLQJ D VSHFLDO GHOLYHU\ V\VWHP D QRYHOQLWLQROGHYLFHDQDVWRPRWLFFRXSOLQJV\VWHP52;PHGLFDOZDVLPSODQWHG EHWZHHQWKHDUWHU\DQGYHLQWRPDLQWDLQDÀVWXODEHWZHHQERWKYHVVHOV$OOVKXQWV ZHUHGLODWHGZLWKDPPEDOORRQDQGGRFXPHQWHGE\'6$ 5HVXOWV6KXQWLPSODQWDWLRQZDVVXFFHVVIXOLQDOOSDWLHQWV7KHSHUIXVHGDUWHULR YHQRXVVKXQWVFRXOGEHZHOOGRFXPHQWHGLQ'6$DQGWKHGLDPHWHUZDVPHDVXUHG EHWZHHQDQGPPLQDOOFDVHV3HULLQWHUYHQWLRQDOGLVVHFWLRQRIWKHLOLDFDUWHU\ RFFXUUHGLQRQHSDWLHQW7KLVGLVVHFWLRQZDVQRWÁRZOLPLWLQJ3RVWLQWHUYHQWLRQDO YHQRXVEOHHGLQJLQRQHSDWLHQWZDVWUHDWHGVXFFHVVIXOO\E\ORFDOFRPSUHVVLRQ &RQFOXVLRQ7KHQHZLQWHUYHQWLRQDOUDGLRORJLFDOWHFKQLTXHWRFUHDWHDQDUWHULR YHQRXVVKXQWLQWKHLOLDFYHVVHOVSUHVHQWHGLQWKLVVWXG\KDVSURYHQWREHIHDVLEOH DQGVDIH7KHLQWHQGHGLPSURYHPHQWRISXOPRQDU\R[\JHQDWLRQWRUHGXFHG\VSQRH LQSDWLHQWVZLWKVHYHUH&23'KDVWREHHYDOXDWHG % 7KHVDIHW\DQGHIÀFDF\RIÁRZGLYHUVLRQWUHDWPHQWRILQWUDFUDQLDO DQHXU\VPVSUHOLPLQDU\UHVXOWV '%DJDWWR%3HWUDOLD5*LURPHWWL0%D]]RFFKL8GLQH,7 GDQLHOHEDJDWWR#JPDLOFRP 3XUSRVH7 RLOOXVWUDWHPRQRFHQWULFH[SHULHQFHRIÁRZGLYHUVLRQDSSURDFKIRUHQ GRYDVFXODUWUHDWPHQWRILQWUDFUDQLDODQHXU\VPV7 RDVVHVWKHVDIHW\DQGHIÀFDF\RI WKLVDOWHUQDWLYHDQGSURPLVLQJWHFKQLTXHLQFRPSDULVRQZLWKFRLODQGVWHQWDVVLVWHG FRLOHPEROLVDWLRQ 6FLHQWLILF6HVVLRQ 6 &$' ( ) *+% (XURSHDQ&RQJUHVVRI 5DGLRORJ\ DQJLRPDGHVPRLGWXPRXUQRQHRUHTXDOWRPXVFOHHQKDQFHPHQWEHQLJQ OHVLRQVOLSRVDUFRPDOLSRPDOLNH &RQFOXVLRQ,QRXUH[SHULHQFHWKHSUHVHQFHRIDQH[SRQHQWLDOFXUYHSDUDOOHOWR DUWHULDOLVKLJKO\VXVSLFLRXVIRUPDOLJQDQWOHVLRQZKLOHDQHQKDQFHPHQWHTXDOWR WKDWRIPXVFOHH[FOXGHVWKHPDOLJQDQF\H[FHSWIRUWKHOLSRVDUFRPDOLSRPDOLNH '&(05,PD\FRQÀUPWKHGLDJQRVLVRIQHXULQRPD % 'LIIXVLRQZHLJKWHGLPDJLQJDVDQRQLQYDVLYHSUHGLFWRURIWXPRXU JUDGLQJLQVRIWWLVVXHVDUFRPD 0&+HUEULN/8PXWOX-.DONPDQQ6%DXHU/3RGOHVND) *UDEHOOXV *7 DHJHU7 /DXHQVWHLQ(VVHQ'(PKHUEULN#JP[GH 3XUSRVH7XPRXU JUDGLQJ LV D YDOXDEOH SUHGLFWRU ZLWK UHJDUG WR SURJQRVLV DQG WKHUDS\ PDQDJHPHQW RI VRIW WLVVXH VDUFRPDV 676 +LVWRSDWKRORJ\ KDV EHHQ FRQVLGHUHGWKHJROGVWDQGDUGRIWXPRXUJUDGLQJ7KHDLPRIRXUVWXG\ZDVWRDV VHVVWKHGLDJQRVWLFSRWHQWLDORIGLIIXVLRQZHLJKWHG05,DVDQRQLQYDVLYHSUHGLFWRU RIWXPRXUJUDGLQJ 0HWKRGVDQG0DWHULDOVSDWLHQWVZLWKKLVWRORJLFDOO\SURYHQ676ZHUHHQUROOHG LQWKLVWULDODQGZHUHH[DPLQHGSULRUWRLVRODWHGOLPESHUIXVLRQ,/3RQD7 HVOD VFDQQHU%H\RQGFOLQLFDOO\DSSOLHGVHTXHQFHVDWUDQVYHUVDO(3,':,VHTXHQFH ZDVFROOHFWHG6HTXHQFHSDUDPHWHUVLQFOXGHG757( PVVOLFHWKLFNQHVV PPYR[HOVL]HððPPDFTXLVLWLRQWLPHPLQEYDOXHV $OOPDOLJQDQWOHVLRQVZHUHDVVHVVHGE\DFTXLULQJ$'&DSSDUHQWGLIIXVLRQ FRHIÀFLHQWYDOXHVLQWUDQVYHUVDOSODQHE\SRO\JRQDOUHJLRQRILQWHUHVWSODFHPHQW 7KHUHVXOWVZHUHFRPSDUHGWRKLVWRSDWKRORJLFJUDGLQJRISUHWKHUDSHXWLFVSHFLPHQV *WR*$'&YDOXHVZHUHFRPSDUHGE\:LOFR[RQVLJQHGUDQNWHVW$SYDOXH ZDVGHWHUPLQHGWREHVWDWLVWLFDOO\VLJQLÀFDQW 5HVXOWV$FFRUGLQJWRKLVWRSDWKRORJ\WXPRXUVZHUHUDWHGDV*DQGWXPRXUV ZHUHUDWHGDV*DQG*HDFK&RUUHODWLRQRIKLVWRSDWKRORJLFJUDGLQJDQG$'& YDOXHVDOORZHGIRUDVWDWLVWLFDOVLJQLÀFDQWGLIIHUHQWLDWLRQRI*$'&DQG *WXPRXUV$'&S +RZHYHUDVVHVVPHQWRI$'&YDOXHVGLGQRW VKRZDVWDWLVWLFDOVLJQLÀFDQWGLIIHUHQFHLQWKHGLIIHUHQWLDWLRQRI*WR*RU*WR *WXPRXUVS! &RQFOXVLRQ'LIIXVLRQZHLJKWHGLPDJLQJFDQEHDQRQLQYDVLYHSUHGLFWRURIWXPRXU JUDGLQJIRUGLIIHUHQWLDWLRQEHWZHHQ*DQG*VRIWWLVVXHVDUFRPD % &RPSDULVRQRIYLDEOHWXPRXUYROXPHVHVWLPDWHGRQG\QDPLF05, E\FRPSXWHUDLGHGTXDQWLÀFDWLRQWHFKQLTXHZLWKWKHWXPRXUYLDELOLW\ VFRUHVRISDWKRORJ\IROORZLQJH[FLVLRQRIVRIWWLVVXHVDUFRPDҋV SURVSHFWLYHVWXG\ $.6LQJK9.XUUD< /(&KHQ:&DL*1LHOVHQ'+DUPRQ ) -+RUQLFHN%RVWRQ0$869.855$#3$571(5625* 3XUSRVH 7 R DVVHVV WKH DFFXUDF\ RI YLDEOH WXPRXU YROXPH HVWLPDWHG XVLQJ FRPSXWHUDLGHGWHFKQLTXHRQG\QDPLF05,GDWDVHWV 0HWKRGVDQG0DWHULDOV,QWKLVRQJRLQJSURVSHFWLYHVWXG\YLDEOHWXPRXUHVWLPDWHV REWDLQHGE\SDWKRORJLVWRQVOLFHVRIVRIWWLVVXHVDUFRPDVSHFLPHQVSRVWH[FLVLRQ ZHUH FRPSDUHG WR WXPRXU YLDELOLW\ YROXPHV HVWLPDWHG E\ FRPSXWHUDLGHG SRVW SURFHVVLQJRISRVWJDGROLQLXPG\QDPLF7ZHLJKWHGIDWVDWXUDWHG)6VHTXHQFH IURP05,GDWDVHWV7KH05,IRUWKHVHSDWLHQWVZDVSHUIRUPHGDIWHUXQGHUJRLQJ SUHRSHUDWLYHFKHPRWKHUDS\RUUDGLDWLRQWUHDWPHQWDQGZLWKLQGD\VEHIRUH H[FLVLRQ&RPSXWHUDLGHGTXDQWLÀFDWLRQRIYLDEOHWXPRXUZDVDLGHGE\HVWLPDWLRQ RIFRQWUDVWZDVKLQDQGZDVKRXWFXUYHV&DUHZDVWDNHQWRPDWFKWKH05,D[LDO LPDJHV WR WKH FRUUHVSRQGLQJ ORFDWLRQV RI FXWVHFWLRQV GXULQJ SDWKRORJ\ WXPRXU VOLFLQJIRUUHSRUWLQJRIYLDEOHWXPRXUHVWLPDWHWKDWVHUYHGDVVWDQGDUGRIUHIHUHQFH 3HDUVRQҋVFRUUHODWLRQDQG%ODQG$OWPDQ%$DQDO\VLVZDVXVHG 5HVXOWV7KHYLDEOHDSSHDULQJWXPRXUYROXPHSHUFHQWDJHGHULYHGIURPG\QDPLF 05,FRQWUDVWDFTXLVLWLRQVZDVZLWKLQVWDQGDUGGHYLDWLRQ6'>WR@ RIWKH%$SORWLQGLFDWLQJVLPLODULW\WRSDWKRORJLFDOWXPRXUYLDELOLW\HVWLPDWHVDQG JRRGFRUUHODWLRQU SFRQÀGHQFHLQWHUYDO WR 7KHUHZHUHQRRXWOLHUVLQWKH%$SORW &RQFOXVLRQ7KHYLDEOHWXPRXUIUDFWLRQVREWDLQHGE\FRPSXWHUDLGHGTXDQWLÀFDWLRQ PHWKRGVRQG\QDPLF05,GDWDVHWVIRUVRIWWLVVXHVDUFRPDVKRZVLPLODUUHVXOWVWR VXUJLFDOSDWKRORJ\HVWLPDWHVRIYLDEOHWXPRXUIUDFWLRQDIWHUH[FLVLRQRIVRIWWLVVXH VDUFRPD7KHVHÀQGLQJVZDUUDQWYDOLGDWLRQRQDODUJHUFRKRUWRISDWLHQWV ZDVSDWLHQWVDQGZDVDWWULEXWHGWRVWHQWRFFOXVLRQGXHWRWXPRXULQ JURZWKVWHQWPLJUDWLRQDQGEURQFKRVSDVP 7KH HVWLPDWHG SDWLHQWV VXUYLYDO UDWH DFFRUGLQJ WR WKH .DSODQ0H\HU VWDWLVWLFDO DQDO\VLVZDVXSWR\HDUVRIIROORZXSZKLOHWKHRYHUDOOFRPSOLFDWLRQV UDWHZDVVWHQWV &RQFOXVLRQ7UDFKHREURQFKLDO6(06VSURYLGHVDIHDQGHIIHFWLYHPLQLPDOO\LQYD VLYHPDQDJHPHQWRISDWLHQWVVXIIHULQJIURPV\PSWRPDWLFPDOLJQDQWDLUZD\GLVHDVH % )ROORZXSRIUDGLRORJLFDOO\LQVHUWHG7&9$3RIWKHXSSHUDUPORQJ WHUPFRPSOLFDWLRQVLQFDWKHWHUGD\V -'%XVFK) +HOOHU-+HUUPDQQ%3 6FKRHQQDJHO*$GDP &5+DEHUPDQQ+DPEXUJ'(MGEXVFK#XNHGH 3XUSRVH 7 R UHWURVSHFWLYHO\ HYDOXDWH UDGLRORJLFDOO\ SODFHG WRWDOO\ LPSODQWDEOH FHQWUDO YHQRXV DUP SRUWV 7&9$3 LQ WHUPV RI VDIHW\ WHFKQLFDOIHDVLELOLW\ DQG GHYLFHUHODWHGFRPSOLFDWLRQV 0HWKRGVDQG0DWHULDOVFRQVHFXWLYHSDWLHQWVPHDQDJH\HDUVUDQJH \HDUV PDOHIHPDOH UDWLR ZKR UHFHLYHG D 7&9$3 EHWZHHQ -DQXDU\ DQG -XO\ DW RXU XQLYHUVLW\ KRVSLWDO ZHUH LQFOXGHG LQWR WKLV VWXG\7KHLQVHUWLRQSURFHGXUHZDVSHUIRUPHGLQDQLQWHUYHQWLRQDOUDGLRORJ\VXLWH 7ZRGLIIHUHQWYDVFXODUDFFHVVV\VWHPV7LWDQLXP9LWDO3RUW0LQL&RRN0HGLFDO ,QF%ORRPLQJWRQ86$Q 7LWDQLXP9LWDO3RUW3HWLWH&RRN0HGLFDO,QF %ORRPLQJWRQ 86$ Q ZHUH XVHG 1R DQWLELRWLF SURSK\OD[LV RU ORQJWHUP DQWLFRDJXODQWPHGLFDWLRQVZHUHURXWLQHO\DGPLQLVWHUHG 5HVXOWV ,Q SDWLHQWV LQ WRWDO GHYLFHV ZHUH LPSODQWHG$OO SURFHGXUHV ZHUHFRPSOHWHGZLWKRXWPDMRUFRPSOLFDWLRQVZLWKDSULPDU\WHFKQLFDOVXFFHVVRI 'XULQJIROORZXSDQGDWRWDOQXPEHURIGD\VLQPHDQ GD\VSHUSDWLHQWUDQJHGD\VRI7&9$3LPSODQWDWLRQSDWLHQWVKDGWR EHUHYLVHGGXHWRFRPSOLFDWLRQV7KRVHZHUHREVHUYHGDIWHUDPHDQGXUD WLRQRIGD\VUDQJHGD\VHDUO\FRPSOLFDWLRQVDQG ODWHFRPSOLFDWLRQV&RPSOLFDWLRQVZHUHDVIROORZVSDWLHQWVKDG ORFDOLQIHFWLRQWZRKDGV\VWHPLFLQIHFWLRQHLJKWSDWLHQWVGHYHORSHGYHQRXV WKURPERVLVWKUHHKDGSDUDO\VLVRIWKHPHGLDQQHUYHRQHVXIIHUHG IURPVNLQGHKLVFHQFHDWWKHSRUWVLWHDQGHOHYHQSDWLHQWVUHTXLUHG UHYLVLRQRZLQJWRPHFKDQLFDOSUREOHPV &RQFOXVLRQ5DGLRORJLFDOO\LQVHUWHG7&9$3FDQEHVDIHO\XVHGDQGKDVDORZ FRPSOLFDWLRQUDWHGXULQJIROORZXS 5RRP( 0XVFXORVNHOHWDO 66 7XPRXUV 0RGHUDWRUV *0$OOHQ2[IRUG8. &YDQ5LMVZLMN/HLGHQ1/ % '&(05,LQGLIIHUHQWLDOGLDJQRVLVRIVRIWWLVVXHPDVVHV 7 5REED9&OHPHQWL06WUDWWD*5HJLV$*DOOR$/LQDUL53LDQD &)DOHWWL7XULQ,7%RORJQD,7WL]LDQDUREED#\DKRRLW 3XUSRVH7KHUROHRI'&(05,G\QDPLFFRQWUDVWHQKDQFHGPDJQHWLFUHVRQDQFH LPDJLQJLQGLIIHUHQWLDOGLDJQRVLVEHWZHHQEHQLJQPDOLJQDQWVRIWWLVVXHPDVVHV 0HWKRGVDQG0DWHULDOV'XULQJVWDQGDUG05,ZHSHUIRUPHG'&(05,LQVRIW WLVVXHPDVVXVLQJ')63*5IDVWVSRLOHGJUDGLHQWUHFDOOHGDFTXLVLWLRQLQVWHDG\ VWDWHPXOWLSKDVHVHTXHQFHVWHPSRUDOUHVROXWLRQUDQJLQJIURPVHFWRVHF DIWHUFRQWUDVWPHGLD0XOWL+DQFHPOVDQGVDOLQHPODWPOVLQMHFWLRQ 7KHVLJQDOLQWHQVLW\WLPHFXUYHVZHUHREWDLQHGIURPUHJLRQVRILQWHUHVWRQDUWHULDO DQGYHQRXVYHVVHOVVNHOHWDOPXVFOHDQGWKHDUHDVZLWKKLJKHUDQGHDUOLHVWFRQWUDVW HQKDQFHPHQW :H HYDOXDWHG WKH PRUSKRORJLFDO SDWWHUQV RI VLJQDOLQWHQVLW\WLPH FXUYHVDQGFRUUHODWHGWKHPZLWKKLVWRORJLFDOGLDJQRVLVGDWDH[FHSWIRUDQJLRPD P\RVLWLVRVVLÀFDQVDQGKDHPDWRPD 5HVXOWV:HREWDLQHGIRXUSDWWHUQVRIFXUYHVDQH[SRQHQWLDOFXUYHSDUDOOHOWR DUWHULDOFXUYHIROORZHGE\DSODWHDXRUDIXUWKHULQFUHDVHRIHQKDQFHPHQWVDUFRPD DQGP\RVLWLVRVVLÀFDQVJUDGXDOSURJUHVVLRQRIHQKDQFHPHQWZLWKWKHSHDN EHWZHHQDUWHULDODQGYHQRXVFXUYHIROORZHGE\DSODWHDXVDUFRPDJUDGXDO SURJUHVVLRQRIHQKDQFHPHQWZLWKWKHSHDNDIWHUWKHYHQRXVFXUYHIROORZHGE\D IXUWKHULQFUHDVHRIHQKDQFHPHQWVDUFRPDDQGEHQLJQWXPRXUVQHXULQRPD 6FLHQWLILF6HVVLRQ $ 6&'()*+%(XURSHDQ&RQJUHVVRI 5DGLRORJ\ 6XQGD\ DJHYDULDWLRQRI$'&у$'&EHIRUH05DQGDIWHU05&7ZHUHFDOFXODWHG DQGFRPSDUHGEHWZHHQUHVSRQGHUVDQGQRQUHVSRQGHUV 5HVXOWV$OOSULPDU\WXPRXUVZHUHFRUUHFWO\GHWHFWHGRQ05,DQGUHVSRQVHWR&7 ZDVHVWDEOLVKHGDVLQWHQVLW\VLJQDOGHFUHDVHRYHUDSHULRGRIWLPHGXULQJIROORZXS &RPSDUHGWRQRUPDOERQHPDUURZWXPRXUVKRZHGKLJKVLJQDOLQWHQVLW\RQ':, 7KHPHDQ$'&YDOXHVZHUHRQ05[PPòVHFDQGRQ05 [PPòVHF7KHPHDQSHUFHQWDJHRIWXPRXU$'&FKDQJHVLQUH VSRQGHUVу ZDVVLJQLÀFDQWO\GLIIHUHQWSWKDQWKDWLQQRQUHVSRQGHUV у LQUHODWLRQWRWKHKLJKHUFHOOXODULW\RIQHRSODVWLFERQHPDUURZLQYROYHPHQW &RQFOXVLRQ 05 ':, LV D QRQLQYDVLYH WRRO DEOH WR SUHGLFW HDUO\ WKHUDSHXWLF UHVSRQVHLQSDWLHQWVZLWK00E\GHWHUPLQLQJLQGLYLGXDOFKDQJHVRI$'&YDOXHV FRUUHVSRQGLQJWRELRORJLFDOFKDQJHVLQWXPRXUWLVVXH % 'LDJQRVWLFYDOXHRITXDOLWDWLYHDQGTXDQWLWDWLYHGLIIXVLRQZHLJKWHG 05,DQGFKHPLFDOVKLIWLPDJLQJLQWKHGLIIHUHQWLDWLRQRIEHQLJQDQG PDOLJQDQWYHUWHEUDOERG\IUDFWXUHVHYDOXDWLRQLQDSURVSHFWLYH JURXSRISDWLHQWV 7 *HLWK*6FKPLGW$%LIIDU2'LHWULFK+5'XHUU05HLVHU $%DXU0HOQ\N0XQLFK'(WRELDVJHLWK#PHGXQLPXHQFKHQGH 3XUSRVH7 RFRPSDUHWKHGLDJQRVWLFYDOXHRITXDOLWDWLYHGLIIXVLRQZHLJKWHGLPDJLQJ ':,TXDQWLWDWLYH':,DQGFKHPLFDOVKLIWLPDJLQJLQDVLQJOHSURVSHFWLYHFRKRUW RISDWLHQWVZLWKDFXWHRVWHRSRURWLFDQGPDOLJQDQWYHUWHEUDOIUDFWXUHV 0HWKRGVDQG0DWHULDOV3DWLHQWVZLWKRVWHRSRURWLFZRPHQPHQPHDQ DJH\HDUVDQGPDOLJQDQWYHUWHEUDOIUDFWXUHVZRPHQPHQ PHDQDJH\HDUV7ZHLJKWHG67,5DQG7ZHLJKWHGVHTXHQFHV ZHUHDFTXLUHGDW7 $GLIIXVLRQZHLJKWHGVWHDG\VWDWHIUHHSUHFHVVLRQVHTXHQFH 36,)DWGLIIHUHQWGHOWDYDOXHVZDVHYDOXDWHGTXDOLWDWLYHO\$GLIIXVLRQZHLJKWHG HFKRSODQDU LPDJLQJ (3, DQG GLIIXVLRQZHLJKWHG VLQJOHVKRW WXUER VSLQ HFKR VV76(VHTXHQFHDWGLIIHUHQWEYDOXHVZHUHHYDOXDWHGTXDOLWDWLYHO\DQGTXDQWL WDWLYHO\XVLQJWKHDSSDUHQWGLIIXVLRQFRHIÀFLHQW2SSRVHGSKDVHVHTXHQFHVZHUH XVHGWRDVVHVVVLJQDOLQWHQVLW\TXDOLWDWLYHO\7KHVLJQDOORVVEHWZHHQLQRSSRVHG SKDVHLPDJHVZDVGHWHUPLQHGTXDQWLWDWLYHO\7ZRWDLOHG)LVKHUҋVH[DFWDQG0DQQ :KLWQH\WHVWVDQG52&DQDO\VLVZHUHSHUIRUPHG6HQVLWLYLWLHVVSHFLÀFLWLHVDQG DFFXUDFLHVZHUHGHWHUPLQHG 5HVXOWV4XDOLWDWLYH':36,)VKRZHGWKHKLJKHVWDFFXUDF\GHOWD PVVHQVLWLYLW\ VSHFLÀFLW\DFFXUDF\4XDOLWDWLYH':(3,DQG':VV76(LQGL FDWHGQRVLJQLÀFDQWGLIIHUHQFHVEHWZHHQEHQLJQDQGPDOLJQDQWIUDFWXUHVS! H[FHSW':(3,DWE VPPS4XDQWLWDWLYH':(3,DQGTXDOLWDWLYH RSSRVHGSKDVHLPDJLQJH[KLELWHGQRVLJQLÀFDQWGLIIHUHQFHVS!TXDQWLWDWLYH ':VV76(DQGTXDQWLWDWLYHFKHPLFDOVKLIWLPDJLQJVKRZHGVLJQLÀFDQWGLIIHUHQFHV EHWZHHQEHQLJQDQGPDOLJQDQWIUDFWXUHVS &RQFOXVLRQ':36,)GHOWD PVKDGWKHKLJKHVWDFFXUDF\LQGLIIHUHQWLDWLQJ EHQLJQ DQG PDOLJQDQW YHUWHEUDO IUDFWXUHV 4XDQWLWDWLYH FKHPLFDOVKLIW LPDJLQJ DQGTXDQWLWDWLYH':VV76(KDGDORZHUDFFXUDF\LQFRPSDULVRQZLWK':36,) EHFDXVHRIDODUJHRYHUODS4XDOLWDWLYHO\DVVHVVHGRSSRVHGSKDVH':(3,DQG ':VV76( DQG TXDQWLWDWLYH ':(3, ZHUH QRW VXLWDEOH WR GLIIHUHQWLDWH EHWZHHQ EHQLJQDQGPDOLJQDQWYHUWHEUDOIUDFWXUHV % 0DJQHWLFUHVRQDQFHJXLGHGIRFXVHGXOWUDVRXQG05J)86IRUWKH WUHDWPHQWRIRVWHRLGRVWHRPD $1DSROL0$Q]LGHL%&DYDOOR0DULQFROD/0ROLVVR*&DUWRFFL) %RQL /%HUWDFFLQL91RFH&&DWDODQR5RPH,7DOHVVDQGURQDSROL#XQLURPD LW 3XUSRVH7KHDLPRIRXUVWXG\ZDVWRHYDOXDWHWKHVDIHW\DQGHIÀFDF\RIWKH05J )86DVDQRQLQYDVLYHPHWKRGIRUWKHWUHDWPHQWRISDLQFDXVHGE\RVWHRLGRVWHRPD 0HWKRGVDQG0DWHULDOV6HOHFWHGDQGLQIRUPHGSDWLHQWVZLWKOLPLWHGMRLQWIXQF WLRQDQGUHGXFHGTXDOLW\RIOLIHGXHWRSDLQIXORVWHRLGOHVLRQFRQÀUPHGDWZRUNXS 05DQG&7H[DPXQGHUZHQW05J)86([$EODWH,Q6LJKWHF+DLID,VUDHO KRXVHGLQWRD705V\VWHP*(&OLQLFDOHYDOXDWLRQZDVDVVHVVHGXVLQJYLVXDO DQDORJXHVFDOH9$6(DFKSDWLHQWZDVSODQQHGZLWKDPD[LPXPRIVRQLFDWLRQV WRFRPSOHWHQLGXVDEODWLRQ&OLQLFDODQGLPDJLQJIROORZXSZDVSHUIRUPHGDQG PRQWKVDIWHUWUHDWPHQWSDWLHQWVZLWKRVWHRLGOHVLRQXQGHUZHQW05J)86WUHDW PHQW,QWZRSDWLHQWVZHWUHDWHGDVPDOODQGVXESHULRVWHDOORFDWHGRVWHRPDRQH SDWLHQWKDGDODUJHUOHVLRQRVWHREODVWRPD 5HVXOWV$IWHUWUHDWPHQW9$6TXHVWLRQQDLUHVGHPRQVWUDWHGLQWZRSDWLHQWVZLWK W\SLFDO RVWHRPD WKH FRPSOHWH GLVDSSHDUDQFH RI SDLQIXO V\PSWRPV ZKLOH WKLUG SDWLHQWUHIHUUHGDQLQLWLDOUHGXFWLRQRISDLQDQGDJUDGXDOUHFXUUHQFHRIV\PSWRPV 7KHUHZHUHQRREVHUYHGWUHDWPHQWUHODWHGFRPSOLFDWLRQVSHULDQGSRVWSURFHGXUH &RQFOXVLRQ,QRXUH[SHULHQFH05J)86UHSUHVHQWVDVDIHDQGHIIHFWLYHWUHDWPHQW IRUWKHDEODWLRQRIRVWHRLGRVWHRPD % ':,LQGLIIHUHQWLDOGLDJQRVLVRIHQFKRQGURPDDQGFHQWUDOFKRQGURVDUFRPD 7 5REED9&OHPHQWL06WUDWWD*5HJLV$*DOOR53LDQD$/LQDUL 9&LFFRQH&)DOHWWL7XULQ,7%RORJQD,7WL]LDQDUREED#\DKRRLW 3XUSRVH7KHUROHRI':,GLIIXVLRQZHLJKWHG LPDJLQJLQGLIIHUHQWLDOGLDJQRVLV EHWZHHQHQFKRQGURPDDQGFHQWUDOFKRQGURVDUFRPD 0HWKRGVDQG0DWHULDOV:HSHUIRUPHG':,1RYHPEHU-XO\LQ SDWLHQWVZLWKDLQWUDPHGXOODU\FKRQGUDOOHVLRQRIWKHERQH'XULQJVWDQGDUG05,D VSLQHFKRHFKRSODQDULPDJLQJEVPPZDVSHUIRUPHG7KH $'&DSSDU HQWGLIIXVLRQFRHIÀFLHQWFRORULPHWULFPDSZDVPDWFKHGDJDLQVWWKHFRUUHVSRQGLQJ D[LDO)5)6(7/DUJHUHJLRQVRILQWHUHVWZHUHSORWWHGRQWKHOHVLRQDWOHDVWLQ WKUHHFRQVHFXWLYHVOLFHV7KHDYHUDJH$'&RIHDFKOHVLRQVZDVFDOFXODWHGDQG FRUUHODWHGE\$129$DQDO\VLVRIYDULDQFHWHVWZLWKWKHKLVWRORJLFDOGDWDLQIRXU ,,,JUDGHDQGLQVL[,,,,9JUDGHFKRQGURVDUFRPDWKHGLDJQRVLVZDVKLVWRORJLFDOO\ SURYHQZKLOHLQIRXUHQFKRQGURPDDWR\HDUIROORZXSZDVGRQH 5HVXOWV7KH$129$WHVWVKRZVDVWDWLVWLFDOO\VLJQLÀFDQWGLIIHUHQFHSLQ $'&V)FULWLFDO)RIWKHWKUHHJURXSVHQFKRQGURPDDYHUDJH $'& [PPV,,,JUDGHFKRQGURVDUFRPDDYHUDJH$'&[PPV DQG,,,,9JUDGHFKRQGURVDUFRPDDYHUDJH$'&[PPV &RQFOXVLRQ (YHQ LI VWDWLVWLFDOO\ VLJQLÀFDQW WKHUH LV RQO\ D VOLJKW GLIIHUHQFH DPRQJFKRQGURPDDQGFKRQGURVDUFRPD$'&VDQGPDQ\GDWDDUHQHFHVVDU\WR LQYHVWLJDWHWKHXWLOLW\RI':,LQGLIIHUHQWLDOGLDJQRVLVRI,JUDGHFKRQGURVDUFRPD DQGHQFKRQGURPD % $VVHVVPHQWRIGLIIXVLRQZHLJKWHGLPDJLQJIRUWKHUDS\PRQLWRULQJLQ QHRDGMXYDQWLVRODWHGOLPSSHUIXVLRQWKHUDS\RIVRIWWLVVXHVDUFRPD 0&+HUEULN/8PXWOX-.DONPDQQ6%DXHU) *UDEHOOXV*7 DHJHU 7 /DXHQVWHLQ(VVHQ'(PKHUEULN#JP[GH 3XUSRVH $VVHVVPHQWRIWKHUDS\UHVSRQVHLVDQLQHYLWDEOHDVSHFWRIQHRDGMXYDQW LVRODWHGOLPSSHUIXVLRQ,/3WKHUDS\RIVRIWWLVVXHVDUFRPD6760RUSKRORJLF DVVHVVPHQW E\ PHDQV RI 5(&,67 FULWHULD KDV EHHQ VKRZQ WR SURYLGH OLPLWHG DFFXUDF\ :H DLPHG WR HYDOXDWH GLIIXVLRQZHLJKWHG LPDJLQJ ':, IRU DVVHVV PHQWRIFDQFHUUHVSRQVHLQFRUUHODWLRQZLWKPRUSKRORJLFDO5(&,67FULWHULDDQG KLVWRSDWKRORJLFUHJUHVVLRQ 0HWKRGVDQG0DWHULDOVSDWLHQWVZLWKKLVWRORJLFDOO\SURYHQ676ZHUHHQUROOHG LQWKLVWULDODQGZHUHH[DPLQHGSULRUDVZHOODVGD\VDQGZHHNVDIWHU WKHLQLWLDWLRQRIQHRDGMXYDQW,/3 05,ZDVSHUIRUPHGRQD7HVODVFDQQHU%H\RQG FOLQLFDO VHTXHQFHV D WUDQVYHUVDO (3,':, VHTXHQFH ZDV FROOHFWHG 6HTXHQFH SDUDPHWHUV LQFOXGHG 757( PV VOLFH WKLFNQHVV PP YR[HO VL]H ððPPDFTXLVLWLRQWLPHPLQEYDOXHV0RUSKRORJLF DQDO\VLVZDVDVVHVVHGDFFRUGLQJWR5(&,67FULWHULD)RUIXQFWLRQDODQDO\VLV $'& YDOXHVDVZHOODV&15LQFRUUHODWLRQWRKHDOWK\PXVFOHWLVVXHZHUHHYDOXDWHG 5HVXOWVZHUHFRUUHODWHGZLWKKLVWRSDWKRORJLFUHJUHVVLRQDIWHUVXUJHU\7KHFKDQJHV LQ$'&YDOXHVZHUHFRPSDUHGE\:LOFR[RQVLJQHGUDQNWHVW 5HVXOWV$FFRUGLQJWRKLVWRSDWKRORJ\SDWLHQWVZHUHGHWHUPLQHGDVUHVSRQG HUV:KLOHPRUSKRORJLFDVVHVVPHQWRIWKHUDS\UHVSRQVHGLGQRWVKRZVWDWLVWLFDO VLJQLÀFDQWFRUUHODWLRQZLWKKLVWRSDWKRORJLFUHVSRQVHWKHHYDOXDWLRQRI':,LPDJLQJ VKRZHGDVWDWLVWLFDOO\VLJQLÀFDQWLQFUHDVHRIPHDQ $'&YDOXHVLQWHUPVRIDUHJUHV VLRQRIGLIIXVLRQGLVUXSWLRQ&15YDOXHVFRQÀUPHGSRVLWLYHSDWKRORJLFUHVSRQVH E\PHDQVRIDVLJQLÀFDQWGHFUHDVHXQGHUWKHUDS\ &RQFOXVLRQ':,FDQEHXVHGIRUWKHDVVHVVPHQWRIWKHUDS\UHVSRQVHRI676 DIWHU,/3 % 05,ZLWKGLIIXVLRQZHLJKWHGLPDJLQJDQGDSSDUHQWGLIIXVLRQ FRHIÀFLHQW$'&LQWKHDVVHVVPHQWRIUHVSRQVHWRWUHDWPHQWLQ SDWLHQWVZLWKPXOWLSOHP\HORPDSUHOLPLQDU\UHVXOWV 3 $%RQDIÀQL',SSROLWR,0DFFKL) 5RVVLQL$'L/HOLR66LURQL0RQ]D,7 SDERQDIÀQL#JPDLOFRP 3XUSRVH 7 R DVVHVV WKH DGGHG YDOXH RI$'& LQ WKH HYDOXDWLRQ RI UHVSRQVHW R FKHPRWKHUDS\&7LQSDWLHQWVZLWKPXOWLSOHP\HORPD00 0HWKRGVDQG0DWHULDOVSDWLHQWVZLWK00XQGHUZHQW7:%05,$FKLHYD 3KLOLSVIURPYHUWH[WRIHHWEHIRUHDQGDIWHU&7 ZLWKWKHIROORZLQJSURWRFROFRURQDO DQGVDJLWWDOVKRUWWDXLQYHUVLRQUHFRYHU\67,57776(DQGD[LDO':,%6VH TXHQFHVEIDFWRUPPVHF':,%6LPDJHVZHUHFRPSDUHGZLWK7 DQG67,5LPDJHVLQÀYHGLVWULFWVVNXOOVSLQHVWHUQXPDQGULEVSHOYLVXSSHUDQG ORZHUOLPEVWRHYDOXDWHUHVSRQVHWRWUHDWPHQW52,ZHUHPDQXDOO\GUDZQDORQJ FRQWRXUVRIWXPRXUVRQ $'&PDSV7KHPHDQ $'&YDOXHVRIOHVLRQVDQGSHUFHQW 6FLHQWLILF6HVVLRQ 6 &$' ( ) *+% (XURSHDQ&RQJUHVVRI 5DGLRORJ\ 5RRP( *,7UDFW 66D 5HFWDODQGJDVWURRHVRSKDJHDOFDQFHU 0RGHUDWRUV $'LHJXH]%XHQRV$LUHV$5 &.XOLQQD&RVHQWLQL9LHQQD$7 % 1RGDOUHVWDJLQJDIWHUFKHPRUDGLDWLRQIRUORFDOO\DGYDQFHGUHFWDO FDQFHUSUHGLFWLYHIDFWRUV 00DDV'0-/DPEUHJWV0%HUNKRI*/%HHWV5*+%HHWV7 DQ 0DDVWULFKW1/PRQLTXHPDDV#OLYHQO 3XUSRVH5HVWDJLQJ1VWDJHDIWHU&57LVPRUHDFFXUDWHWKDQ1VWDJHSUHGLFWLRQDW SULPDU\VWDJLQJRIUHFWDOFDQFHU $\S1VWDWXVDIWHU&57LVPDQGDWRU\WRDOORZIRU OHVVLQYDVLYHWUHDWPHQWDIWHU&57HJORFDOH[FLVLRQ $LPZDVWRLGHQWLI\SUHGLFWLYH IDFWRUVZKLFKFDQKHOSDUDGLRORJLVWLQSUHGLFWLQJ\1VWDJH 0HWKRGVDQG0DWHULDOV)RUSDWLHQWVZLWKORFDOO\DGYDQFHGUHFWDOFDQFHUDOO YLVLEOHQRGHVLQWKHPHVRUHFWXPZHUHPHDVXUHGDQGUHFRUGHGEHIRUHDQGDIWHU &57RQD'7:*5(VHTXHQFHZLWKPPYR[HOV%DVHOLQHFKDUDFWHULVWLFV ZHUHFROOHFWHGDQGFRPSDUHGEHWZHHQSDWLHQWVZLWKDQGZLWKRXWQRGDOLQYROYHPHQW DWKLVWRSDWKRORJ\:LWKUHJUHVVLRQDQDO\VHVSUHGLFWLYHIDFWRUVIRUQRGDOLQYROYH PHQWZHUHLGHQWLÀHG52&FXUYHVZHUHFRQVWUXFWHGIRUDSUHGLFWLYHPRGHOEDVHG RQWKHUHJUHVVLRQDQDO\VHV 5HVXOWVQRGHVZHUHLGHQWLÀHGRIZKLFKGLVDSSHDUHGDIWHU&57 3DWLHQWV ZLWK \S1 KDG ODUJHU QRGHV WKDQ \S1SDWLHQWV PHDQ YV PP EHIRUH&57DQGYVPPDIWHU&57 UHVSHFWLYHO\ERWKS5HJUHV VLRQDQDO\VHVLGHQWLÀHGSUHDQGSRVW&57VL]H7GRZQVWDJLQJDQGKLJKHUDJHDV SUHGLFWLYHIDFWRUVIRU\S1$8&VIRUWKHUHJUHVVLRQEDVHGPRGHOSUH&57VL]H DQGSRVW&57VL]HZHUHDQGUHVSHFWLYHO\S &RQFOXVLRQ 1RGDO VL]H ERWK SUH DQG SRVW&57 7GRZQVWDJLQJ DQG KLJKHU DJHDWSULPDU\VWDJLQJDUHSUHGLFWRUVRI\S1VWDJH:LWKWKLVNQRZOHGJHDQGE\ XVHRIWKHVHFULWHULDDUDGLRORJLVWFRXOGVHOHFW\1SDWLHQWVZLWKKLJKHUVHQVLWLYLW\ WKDQZKHQVL]HLVXVHGDVDVLQJOHFULWHULRQ:LWKDKLJKHUVHQVLWLYLW\OHVVLQYDVLYH WUHDWPHQWDIWHU&57FDQEHDSSOLHGPRUHVDIHO\ % *DGRIRVYHVHWHQKDQFHG05,IRUQRGDOVWDJLQJLQUHFWDOFDQFHU SLWIDOOVDQGOHDUQLQJFXUYH /+HLMQHQ'0-/DPEUHJWV*/%HHWV00DDV0+0DUWHQV 9&&DSSHQGLMN) &+%DNHUV5*+%HHWV7 DQ0DDVWULFKW1/ GODPEUHJWV#PXPFQO 3XUSRVH 1RGDO VWDJLQJ LQ UHFWDO FDQFHU UHPDLQV LQVXIÀFLHQWO\ DFFXUDWH, Q D UHFHQWSLORWVWXG\ZHKDYHVKRZQLPSURYHGSHUIRUPDQFHLQH[SHUWKDQGVXVLQJ JDGRIRVYHVHWHQKDQFHG 05, VHQVLWLYLW\ VSHFLÀFLW\ )RU WKH FXUUHQW VWXG\JDGRIRVYHVHW05,ZDVLPSOHPHQWHGLQFOLQLFVDVSDUWRIRQJRLQJUHVHDUFK DQGDVVHVVHGE\ҊQRQH[SHUWҋDEGRPLQDOUDGLRORJLVWV $LPZDVWRLGHQWLI\WKHSLWIDOOV RIJDGRIRVYHVHW05,IRUQRGDOVWDJLQJ 0HWKRGVDQG0DWHULDOVSDWLHQWVXQGHUZHQWVWDQGDUG7:)6(DQGJDGR IRVYHVHW05,7UHDWPHQWSODQQLQJZDVEDVHGRQ7:05,SDWLHQWVXQGHUZHQW [*\LPPHGLDWHVXUJHU\XQGHUZHQWFKHPRUDGLDWLRQDUHVWDJLQJ05, DQG VXUJHU\ 3DWLHQWV ZHUH VFRUHG DV F11 EDVHG RQ WKH SUHVHQFHDEVHQFH RIQRGDOJDGRIRVYHVHWHQKDQFHPHQWRQWKHSUHVXUJLFDO05,+LVWRORJ\ZDVWKH JROGVWDQGDUG ,Q FDVH RI )3)1 ÀQGLQJV QRGHV ZHUH UHHYDOXDWHG E\ D SHOYLF 05H[SHUWRQDSHUQRGHEDVLVDQGFRPSDUHGZLWKKLVWRORJ\WRLGHQWLI\WKHSLWIDOOV 5HVXOWV SDWLHQWV ZHUH S1 S1 7KLUW\WUHH ZHUH FRUUHFWO\ VWDJHGR Q JDGRIRVYHVHW05,VHQVLWLYLW\VSHFLÀFLW\S1SDWLHQWVZHUHXQGHU VWDJHGS1ZHUHRYHUVWDJHG)1ÀQGLQJVZHUHGXHWR1QRGHREVFXUHGE\ DGMDFHQWYHVVHOQ PLFURVFRSLFWXPRXUFHOOVWRRVPDOOWRGHWHFWZLWK05,Q )3ÀQGLQJVZHUHGXHWRGHFUHDVHGJDGRIRVYHVHWXSWDNHLQSUHVDFUDOSHULYDVFXODU QRGHVQ LQWHUSUHWDWLRQHUURUVWKDWZHUHFRUUHFWHGDIWHUUHHYDOXDWLRQE\WKH H[SHUWQ DQGDEVHQFHRIJDGRIRVYHVHWXSWDNHHFLQ &RQFOXVLRQ 3LWIDOOV PDLQO\ RFFXU GXH WR UHDGHUVҋ LQH[SHULHQFH DQG LQVXIÀFLHQW XSWDNHRIJDGRIRVYHVHWLQQRGHVORFDWHGEHWZHHQYHVVHOVKLJKLQWKHPHVRUHF WXP*DGRIRVYHVHW05,FDQLPSURYHUDGLRORJLVWVҋSHUIRUPDQFHIRUQRGDOVWDJLQJ 8QGHUVWDQGLQJ WKH SLWIDOOV DQG OHDUQLQJ FXUYH LV FUXFLDO WR DOORZ EURDG FOLQLFDO LPSOHPHQWDWLRQ % 3DLQSDOOLDWLRQRIERQHPHWDVWDVLVLQLWLDOFOLQLFDOH[SHULHQFHXVLQJ KLJKLQWHQVLW\IRFXVHGXOWUDVRXQGWKHUDS\ZLWKPDJQHWLFUHVRQDQFH JXLGDQFH $1DSROL0$Q]LGHL(0DURWWD*%UDFKHWWL*&DUWRFFL)%RQL /%HUWDFFLQL91RFH&&DWDODQR5RPH,7DOHVVDQGURQDSROL#XQLURPD LW 3XUSRVH 7 R GHWHUPLQH WKH HIÀFDF\ RI QRQLQYDVLYH KLJKLQWHQVLW\ 05JXLGHG IRFXVHGXOWUDVRXQG05J)86WUHDWPHQWIRUSDOOLDWLRQRIERQHPHWDVWDVLVSDLQLQ SDWLHQWVQRWFDQGLGDWHGIRUH[WHUQDOEHDPUDGLRWKHUDS\(%57 0HWKRGVDQG0DWHULDOV8QGHUWKH,5%DSSURYDOSDWLHQWVZLWKOHVLRQVXQGHU ZHQW05J)86WUHDWPHQWXVLQJWKH([$EODWHV\VWHP,Q6LJKWHF7UHDWPHQWV ZHUHGRQHLQDVLQJOHVHVVLRQLQDQDPEXODWRU\VHWWLQJSDWLHQWVXQGHUZHQWSULRU (%57ZLWKDPHDQPRQWKVUHFXUUHQWSDLQ,QSDWLHQWV05J)86WUHDWPHQWZDV SHUIRUPHGDVÀUVWWUHDWPHQWPRGDOLW\(IIHFWLYHQHVVRISDLQSDOOLDWLRQZDVHYDOXDWHG DWIROORZXSXVLQJWKHYLVXDODQDORJSDLQVFRUH9$6DQGPHDVXUDEOHFKDQJHVLQ DQDOJHVLFVLQWDNH)RUWXPRXUFRQWUROSHUIXVLRQ7ZLPDJHVZHUHREWDLQHGSUH DQGSRVWWUHDWPHQWLQRUGHUWRGHWHUPLQHWKHQRQSHUIXVHGVRQLFDWLRQUHODWHGDUHD 5HVXOWV$OO SDWLHQWV DQG DOO OHVLRQV ZHUH WUHDWHG 0HDQ IROORZXS WLPHZ D V PRQWKV$WEDVHOLQH9$6ZDVLWZDVDWGD\VDWWZRZHHNVDQG DQGDWRQHDQGIRXUPRQWKVUHVSHFWLYHO\1RKHDWLQJUHODWHGDGYHUVHHYHQWZDV UHFRUGHGGXULQJWKLVFOLQLFDODSSOLFDWLRQSDWLHQWPHGLFDWLRQLQWDNHZDVFRQVLGHUDEO\ UHGXFHG9DULDEOHGHJUHHRQQRQSHUIXVHGYROXPHZDVREVHUYHGDIWHUWUHDWPHQW PDLQO\ZLWKLQWKHSHULFRUWLFDOUHJLRQ'HHSHUSHQHWUDWLRQRIWKHDFRXVWLFHQHUJ\LV DWSUHVHQWGHVLUDEOHHYHQLIWHFKQLFDOO\GLIÀFXOWWRDFKLHYHZLWKWKHFXUUHQWV\VWHP &RQFOXVLRQ05J)86LVDSURPLVLQJQRQLQYDVLYHWUHDWPHQWPRGDOLW\IRUVXFFHVV IXOSDOOLDWLRQRIERQHPHWDVWDVLVSDLQLQSDWLHQWVZKRDUHQRWFDQGLGDWHIRU(%57 % ,WHUDWLYHGHFRPSRVLWLRQRIZDWHUDQGIDWZLWKHFKRDV\PPHWU\DQG OHDVWVTXDUHVHVWLPDWLRQ,'($/IDVWVSLQHFKRLPDJLQJRIWKH YHUWHEUDOFROXPQPHWDVWDVLVLQLWLDOFOLQLFDOH[SHULHQFH 6/-XYHNDU$0DKDMDQ6'HVDL$3XUL0XPEDL,1VOMXYHNDU#JPDLOFRP 3XUSRVH2XUSXUSRVHZDVWRWHVWUHOLDELOLW\DQGDFFXUDF\RILWHUDWLYHGHFRPSRVLWLRQ RIZDWHUDQGIDWZLWKHFKRDV\PPHWU\DQGWKHOHDVWVTXDUHVHVWLPDWLRQ,'($/ PHWKRGLQFRPELQDWLRQZLWKIDVWVSLQHFKRLPDJLQJLQGHWHFWLQJYHUWHEUDOPHWDVWDVLV DQGFRPSDULVRQRI,'($/DQGURXWLQHVHTXHQFHVLQGHWHFWLRQRIWKHPHWDVWDVLV 0HWKRGVDQG0DWHULDOV:HFRPSDUHG,'($/IDVWVSLQHFKRZLWKFRQYHQWLRQDO IDWVXSSUHVVHGIDVWVSLQHFKRLPDJLQJLQSDWLHQWVZKRFDPHIRUPHWDVWDWLFZRUN XSLQWKHYHUWHEUDOFROXPQ5RXWLQHVSLQHFKRDQG67,5VHTXHQFHVZHUHDFTXLUHG LQDOOWKHFDVHV(DFKOHVLRQZDVGRFXPHQWHGDVEHQLJQRUPDOLJQDQWEDVHGRQ WKHURXWLQHVHTXHQFHVDQG,'($/VHTXHQFHDQGDFRUURERUDWLYHGDWDZHUHDOVR JHQHUDWHG6WDWLVWLFDOFRUUHODWLRQZDVSHUIRUPHG 5HVXOWVVXEMHFWVGHPRQVWUDWHGEUHDVWPHWDVWDVHVVKRZHGSURVWDWLFPHWDV WDVLVDQGIURPXQNQRZQSULPDU\DQGRQHKDGDODUJHSUHVXPSWLYHVFKZDQQRPD VXEMHFWVGHPRQVWUDWHGGHJHQHUDWLYHGLVFGLVHDVHZLWKDVVRFLDWHG0RGLF7\SH, RU,,FKDQJHVDWRQHRUPRUHOHYHOV,QDOOFDVHVPDUURZVLJQDODEQRUPDOLWLHVFRXOG EHSDUWLFXODUO\ZHOOFKDUDFWHULVHGZLWK,'($/GHULYHGLPDJHVDQGSDUDPHWULFUDWLR PDSV0DUURZVLJQDODEQRUPDOLWLHVFRXOGEHSDUWLFXODUO\ZHOOFKDUDFWHULVHGZLWK ,'($/GHULYHGLPDJHVDQGSDUDPHWULFPDSV&RUUHODWLRQRIWKHOHVLRQGHWHFWLRQ E\ URXWLQH VSLQHFKR VHTXHQFHV DQG ,'($/ VHTXHQFH D VLJQLÀFDQW VWDWLVWLFDO GLIIHUHQFHZDVIRXQGLQFKDUDFWHULVDWLRQRIWKHPDUURZVLJQDODEQRUPDOLWLHVDQG OHVLRQFKDUDFWHULVDWLRQ &RQFOXVLRQ,'($/VHTXHQFHSURYLGHVUREXVWZDWHUIDWVHSDUDWLRQZLWKRSWLPLVHG 615SHUIRUPDQFH,'($/LPDJLQJLVDSURPLVLQJ05,WHFKQLTXHDIIRUGLQJDUDSLG DXWRPDWHGKLJKUHVROXWLRQKLJKFRQWUDVWVXUYH\RIWKHHQWLUHVSLQHZLWKRSWLPLVHG WLVVXHFKDUDFWHULVDWLRQ 6FLHQWLILF6HVVLRQ $ 6&'()*+%(XURSHDQ&RQJUHVVRI 5DGLRORJ\ 6XQGD\ DQDO\VLVRIWKHUHFWDOWXPRXUZHUHSHUIRUPHGIROORZLQJVHJPHQWDWLRQIURPVXUURXQG LQJVWUXFWXUHVE\WKUHVKROGLQJGHULYLQJIUDFWDOGLPHQVLRQ)'DQGIUDFWDODEXQGDQFH )$'DQG'IUDFWDOSDUDPHWHUVZHUHFRPSDUHGE\WWHVWLQJ5HSURGXFLELOLW\ZDV DVVHVVHGE\%ODQG$OWPDQVWDWLVWLFV6WDWLVWLFDOVLJQLÀFDQFHZDVDW 5HVXOWV0HDQ6'EORRGÁRZZDVP/PLQP/)UDFWDOGLPHQVLRQ DQGIUDFWDODEXQGDQFHZHUHVLJQLÀFDQWO\ORZHUIRU'WKDQ'DQDO\VLVYHUVXV S DQGYHUVXVS UHVSHFWLYHO\*RRGDJUHH PHQWZDVQRWHGEHWZHHQWKHUHSHDWHGVWXGLHVIRUIUDFWDOGLPHQVLRQPHDQGLIIHUHQFH OLPLWVRIDJUHHPHQWWRDQGWR DQGIUDFWDODEXQGDQFHPHDQGLIIHUHQFHOLPLWVRIDJUHHPHQWWR DQGWRIRU'DQG'IUDFWDODQDO\VLVUHVSHFWLYHO\ 7KHOLPLWVRIDJUHHPHQWZHUHQDUURZHUIRU'WKDQ'DQDO\VLV &RQFOXVLRQ $VDPHDVXUHRIVSDWLDOKHWHURJHQHLW\IUDFWDODQDO\VLVFRPSOHPHQWV SHUIXVLRQ&7 DQGLVDUHSURGXFLEOHWHFKQLTXH % $FFXUDWHLGHQWLÀFDWLRQRIFRPSOHWHUHVSRQGHUVDIWHU&57IRUUHFWDO FDQFHUZLWKHQGRVFRS\DQG05, 00DDV '0-/DPEUHJWV-:$/HLMWHQV06RVHI.:(+XOVHZH */%HHWV5*+%HHWV7 DQ0DDVWULFKW1/5RHUPRQG1/+HHUOHQ1/ 6LWWDUG1/PRQLTXHPDDV#OLYHQO 3XUSRVH &KHPRUDGLDWLRQ &57 IRU UHFWDO FDQFHU OHDGV WR FRPSOHWH WXPRXU UHVSRQVH&5LQ$FFXUDWHLGHQWLÀFDWLRQRID&5LVQHFHVVDU\WRDOORZ IRUOHVVLQYDVLYHWUHDWPHQWHJORFDOH[FLVLRQRUZDLWDQGVHH6WDQGDUGLPDJLQJ FDQQRWDFFXUDWHO\LGHQWLI\D&5$LPZDVWRHYDOXDWHWKHDFFXUDF\RIHQGRVFRS\ IRULGHQWLÀFDWLRQRID&5DQGFRPSDUHLWWR7:DQGGLIIXVLRQZHLJKWHG05,':, 0HWKRGVDQG0DWHULDOVSDWLHQWVZKRXQGHUZHQW&57DQG7:05,':,DQG HQGRVFRS\ZHHNVDIWHUFRPSOHWLRQRI&57ZHUHLQFOXGHG2QHUHDGHUVFRUHGWKH 7:LPDJHVIROORZHGE\LPPHGLDWHHYDOXDWLRQRIWKH':,LPDJHVZLWKWKH7: LPDJHVDWKLVGLVSRVDO$VHFRQGUHDGHUVFRUHGWKHHQGRVFRS\LPDJHV5HDGHUV ZHUHEOLQGHGIRUKLVWRORJ\DQGHDFKRWKHUVҋUHVXOWV6FRULQJZDVSHUIRUPHGZLWKD FRQÀGHQFHOHYHOVFRUH GHÀQLWHO\UHVLGXDOWXPRXU GHÀQLWHO\&5 5HVXOWV2IWKHSDWLHQWVKDGUHVLGXDOWXPRXUDQGKDGD&57KH$8&V IRU 7:05, 7':, DQG HQGRVFRS\ ZHUH DQG UHVSHFWLYHO\ &RUUHVSRQGLQJ VHQVLWLYLWLHV DQG VSHFLÀFLWLHV ZHUH DQG IRU7: DQGIRU7':,DQGDQGIRUHQGRVFRS\ &RQFOXVLRQ (QGRVFRS\ LV PRUH DFFXUDWH LQ LGHQWLI\LQJ D &5 DIWHU &57 WKDQ 05,':,PDLQO\EHFDXVHRIDKLJKHUVHQVLWLYLW\ZKLFKFRUUHFWVIRUWKHXQGHU VWDJLQJRID&5ZLWK05,05,UHPDLQVFUXFLDOWRHYDOXDWHWKHSUHVHQFHRIDQ\ H[WUDPXUDOUHVLGXDOWXPRXUDQGRULQYROYHGQRGHV$FRPELQDWLRQRIHQGRVFRS\ DQG05,':,LVWKHUHIRUHUHFRPPHQGDEOHWRLGHQWLI\SDWLHQWVZLWKD&5DIWHU&57 PDNLQJOHVVLQYDVLYHWUHDWPHQWDIWHU&57IHDVLEOH % 3UHRSHUDWLYHORFRUHJLRQDO7DQG1VWDJLQJRIJDVWURHVRSKDJHDO FDQFHUV*(&FRPSDULVRQEHWZHHQPDJQHWLFUHVRQDQFH 05LQFOXGLQJGLIIXVLRQZHLJKWHGVHTXHQFHV':,FRPSXWHG WRPRJUDSK\&7HQGRVFRSLFXOWUDVRXQG(86 ) *LJDQWL) 'H&REHOOL0&HOOLQD51LFROHWWL&0DUWLQHQJKL3 $UFLGLDFRQR (2UVHQLJR&6WDXGDFKHU$'HO0DVFKLR0LODQ,7JLJDQWLIUDQFHVFR#KVULW 3XUSRVH3UHRSHUDWLYH*(&FDQFHUVVWDJLQJLVZLGHO\SHUIRUPHGZLWK&7DQG(86 05KDVOLPLWDWLRQVPRWLRQDUWHIDFWVORQJDFTXLVLWLRQWLPHSDUWLDOO\RYHUFRPHE\ WHFKQRORJLFDOGHYHORSPHQW:HHYDOXDWHGWKHXVHIXOQHVVRI05LQFOXGHG':, FRPSDUHGZLWK&7DQG(86 0HWKRGV DQG 0DWHULDOV 'XULQJ D PRQWK SHULRG SDWLHQWV ZLWK *(& RHVRSKDJHDOFDUGLDOJDVWULFXQGHUZHQWSUHRSHUDWLYH(86PXOWLGHWHFWRU FKDQQHOV&7DQG705LQFOXGLQJ':,EVPP $OOWKHLPDJHVZHUH DQDO\VHGLQEOLQGDQGWKHUHVXOWVZHUHFRPSDUHGZLWKKLVWRORJLFDOÀQGLQJVDIWHU UHVHFWLRQDVVXPLQJ77DVRUJDQFRQÀQHG*(&DQG77DVLQÀOWUDWLQJ*(& /\PSKQRGHVZHUHVWDJHGDVQHJDWLYH1RUSRVLWLYH16HQVLWLYLW\VSHFLÀFLW\ SRVLWLYH339DQGQHJDWLYHSUHGLFWLYHYDOXH139ZHUHFDOFXODWHG 5HVXOWV6HQVLWLYLW\VSHFLÀFLW\339139FDOFXODWHGIRU7ZHUHIRU05 ZKLOHIRU&7 DQGIRU(86 IRU1VWDWXVIRU05IRU&7 IRU(86 0HDQDSSDUHQWGLIIXVLRQFRHIÀFLHQWRISULPDU\WXPRXUVZDV [PPVRIO\PSKQRGHVZDV[PPV &RQFOXVLRQ(86LVVOLJKWO\VXSHULRUWR&7DQG05IRU7VWDJHZKLOHUHJDUGLQJ 1VWDJH05UHVXOWVDUHVXSHULRUWRERWK&7DQG(86WKDQNVWRWKHDGGLWLRQRI ':,:HFDQFRQFOXGHWKDW05FDQEHDYDOLGGLDJQRVWLFWRROLIXVHGLQVWDQGDUG SURWRFROVLQWKHVWDJLQJRIRHVRSKDJHDODQGJDVWULFQHRSODVPV % ':05DQG'&(05HYDOXDWLRQRIWKHUHVSRQVHLQUHFWDOFDQFHU EHIRUHGXULQJDQGDIWHUQHRDGMXYDQWWUHDWPHQW 5'HO9HVFRYR9'L3DROD6%DWWLVWL,6DQVRQL5*UDVVR %%HRPRQWH=REHO5RPH,7UGHOYHVFRYR#XQLFDPSXVLW 3XUSRVH7 RHYDOXDWHWKHUHVSRQVHRIUHFWDODGHQRFDUFLQRPDWRFKHPRUDGLDWLRQ WKHUDS\&57FDOFXODWLQJFKDQJHVRIDSSDUHQWGLIIXVLRQFRHIÀFLHQWV$'&VEHIRUH GXULQJDQGDIWHUWUHDWPHQWDQGWRFRUUHODWHZLWKWKHFKDQJHVRIG\QDPLFFRQWUDVW HQKDQFHG05'&(05YDOXHV 0HWKRGVDQG0DWHULDOVZHHQUROOHGSDWLHQWVSWVZLWKSULPDU\UHFWDOFDUFLQRPD ZKRZHUHXQGHUJRLQJSUHRSHUDWLYH&57 ':,DQG'&(05ZHUHSHUIRUPHGZLWKD 7V\VWHPLQDOOSDWLHQWVEHIRUHGXULQJDQGDIWHUSUHRSHUDWLYH&57 $OOSDWLHQWV XQGHUZHQW KLVWRSDWKRORJLF SRVWRSHUDWLYH VWDJLQJ$'&V YDOXHV ZHUH FDOFXODWHG WKURXJK WKH VSHFLÀF IRUPXOD ZKLOH WXPRXUSHUIXVLRQ ZDV FDOFXODWHG E\ D VHPL TXDQWLWDWLYHSHUIXVLRQVRIWZDUH'<&+2GHYHORSHGRQ0DWODE:HHYDOXDWHGWKH FKDQJHVRI $'&VDQG'&(05GLYLGLQJSDWLHQWVLQWRWZRJURXSVQRWGRZQVWDJHG JURXS15DQGGRZQVWDJHGJURXS5DWKLVWRORJLFSRVWRSHUDWLYHVWDJLQJ 5HVXOWVSDWLHQWVZHUH15ZKLOHSDWLHQWVZHUH53UHWUHDWPHQW $'&VYDOXHV ZHUHVLJQLÀFDQWO\ORZZHREVHUYHGDSURJUHVVLYHLQFUHDVLQJRI$'&VYDOXHVGXU LQJWUHDWPHQWLQ5ZKLOHWKHUHZDVQRVLJQLÀFDQW$'&VLQFUHDVHLQWKH15S 7KHPHDQYDOXHVRIWXPRXU $'&VFKDQJHLQWKH5ZDVVLJQLÀFDQWO\KLJKHU WKDQWKDWLQWKH15DWHDFKWLPHSRLQWS7KH5VKRZHGLQFUHDVHRI ORFDOSHDNLQWHQVLW\/3,ZLWKUHVSHFWWR/3,EHIRUHWUHDWPHQWRQRSSRVLWHWKH15 VKRZHGGHFUHDVHRI/3,FRPSDUHGWR/3,EHIRUHWUHDWPHQW &RQFOXVLRQ7XPRXUUHVSRQVHPRUHOLNHO\RFFXUVLQSWVZKRUHSRUWKLJKHU/3, YDOXHVRQ'&(05DQDO\VLVGXULQJWUHDWPHQWZLWKUHVSHFWWRSUHWUHDWPHQW % 6WDQGDUGLVHGLQGH[RIVKDSH6,6DQRYHOVHPLTXDQWLWDWLYH '&(05,SDUDPHWHUEDVHGRQSDWWHUQDQDO\VLV3$DEOHWRGLYLGH UHVSRQGHU5E\QRWUHVSRQGHU15DIWHUSUHRSHUDWLYHUDGLRFKHPR WKHUDS\S&57LQORFDOO\DGYDQFHGUHFWDOFDQFHU/$5& 5)XVFR03HWULOOR66HWROD06DQVRQH$5RWRQGR$3HWULOOR1DSOHV,7 UREHUWDIXVFR#XQLQDLW 3XUSRVH05,LVFRQVLGHUHGWKHEHVWDYDLODEOHWRROIRU/$5&VWDJLQJDIWHUS&57 DOWKRXJKLQPRVWFDVHVWRWXPRXUUHVSRQVHGRHVQRWFRUUHVSRQGDVL]HUHGXFWLRQ 7 RLGHQWLI\D'&(05,LQGH[EDVHGRQ3$ZKLFKFRXOGGLIIHUHQWLDWHEHWZHHQUH VSRQGHUV575*RU75*DQGQRWUHVSRQGHUV1575*RU75*DIWHUS&57 0HWKRGVDQG0DWHULDOVSDWLHQWVXQGHUZHQW'&(05,H[DPLQDWLRQEHIRUHDQG DIWHUS&57 3UHDQGSRVWFRQWUDVW7ZVFDQVZHUHDFTXLUHGDIWHU*G'27$LQMHF WLRQ5HJLRQVRILQWHUHVW52,ZHUHGUDZQLQVLGHWKHWXPRXUDQGDIWHUWLPHLQWHQVLW\ FXUYHV7,&ZHUHSORWWHG%DVLQJRQ3$VKDSHGHVFULSWRUVZHUHFRPSXWHGDQG LQGLYLGXDOSHUFHQWDJHFKDQJHVZHUHFDOFXODWHG 5HVXOWV 3HUIRUPLQJ .UXVNDO :DOOLV DQG :LOFR[RQ WHVW IRU SHUFHQWDJH FKDQJH EHIRUHDQGDIWHUS&57LQUHVSRQGHUVPD[LPXPVORSHGHYLDWLRQ06'ZDVKLQ VORSHZDVKRXWLQWHUFHSWDUHDXQGHUWKHFXUYH$8&$8&ZDVKRXW$8&:2 DQGKHLJKWVUDWLR+5VKRZHGVWDWLVWLFDOO\VLJQLÀFDQWGLIIHUHQFHV3$F FRUGLQJWRWKHKRWHOOLQJWUDFHFULWHULRQ+7&у06' у$8&:2PDWFKSURYLGHG WKHEHVWUHVXOWVDQGDFXWRIIYDOXHFKDQJHRIGLYLGHG5IURP15ZLWK6(1 RI63(RI139RIDQG339RI &RQFOXVLRQу06' у$8&:2PDWFKGHÀQHG´VWDQGDUGLVHGLQGH[RIVKDSHµ 6,6VHHPVWREHDSURPLVLQJVHPLTXDQWLWDWLYHQXPHULFDOSDUDPHWHUFDSDEOHWR HYDOXDWH UHVLGXDO WXPRXU DFWLYLW\ DIWHU S&57 LQ /$5& GHÀQLQJ D UREXVW FXWRII YDOXHRIWRVHSDUDWH5E\15 % 5HSURGXFLELOLW\RI'DQG'IUDFWDODQDO\VLVWHFKQLTXHVIRUWKH DVVHVVPHQWRIVSDWLDOSDWWHUQRISHUIXVLRQ&7UHJLRQDOEORRGÁRZLQ UHFWDOFDQFHU 9-*RK '%DQHUMHH%6DQJKHUD$.KDQ,6LPFRFN-6WLUOLQJ 5*O\QQH-RQHV/RQGRQ8.1RUWKZRRG8. 3XUSRVH7 RGHWHUPLQHWKHUHSURGXFLELOLW\RI'DQG'IUDFWDODQDO\VLVWHFKQLTXHV IRUWKHDVVHVVPHQWRIVSDWLDOSDWWHUQRISHUIXVLRQ&7UHJLRQDOEORRGÁRZLQUHFWDO FDQFHU 0HWKRGVDQG0DWHULDOV)ROORZLQJLQVWLWXWLRQDOUHYLHZERDUGDSSURYDODQGLQIRUPHG FRQVHQWSURVSHFWLYHSDWLHQWVPDOHVIHPDOHVPHDQDJH\HDUVZLWK UHFWDODGHQRFDUFLQRPDXQGHUZHQWWZRUHSHDWHGYROXPHWULFKHOLFDOSHUIXVLRQ&7 VWXGLHV'DGDSWLYHVSLUDOFP]D[LVFRYHUDJHGXDOVRXUFH&7 6LHPHQV +HDOWKFDUHZLWKRXWLQWHUYHQLQJWUHDWPHQWZLWKLQKRXUVGHULYLQJUHJLRQDOEORRG ÁRZE\GHFRQYROXWLRQDQDO\VLV93&7 6LHPHQV+HDOWKFDUH'DQG'IUDFWDO 6FLHQWLILF6HVVLRQ 6 &$' ( ) *+% (XURSHDQ&RQJUHVVRI 5DGLRORJ\ RUHFWDOIDVFLDLQÀOWUDWLRQLQSDWLHQWVZLWKUHFWDOFDUFLQRPDXQGHUJRLQJ05UHVWDJLQJ DIWHUQHRDGMXYDQWFKHPRDQGUDGLDWLRQWKHUDS\&57 0HWKRGVDQG0DWHULDOV)LIW\ÀYHFRQVHFXWLYHSDWLHQWVPHDQDJH\HDUV UDQJH\HDUV0)ZLWKORFDOO\DGYDQFHGUHFWDOFDUFLQRPDLQYROY LQJWKHKLJKHUPLGGOHRUORZHUUHFWXPXQGHUZHQW&57IROORZHGE\VXUJHU\05 LPDJLQJ ZDV SHUIRUPHG EHIRUH DQG DIWHU FRPSOHWLRQ RI &57 XVLQJ7ZHLJKWHG IDVW VSLQHFKR DQG 7ZHLJKWHG 63,5 VHTXHQFHV EHIRUH DQG DIWHUJDGROLQLXP LQMHFWLRQDQG05LPDJHVZHUHDVVHVVHGE\WZRUDGLRORJLVWVLQFRQVHQVXV7KH HYLGHQFHRIUHWLFXODULQWHUZRYHQZLWKLQWKHPHVRUHFWDOIDWFUHDWLQJDPHVKZRUNRU OLQHDUVKDSHGWUDYHOOLQJVHSDUDWHO\WKURXJKWKHPHVRUHFWDOIDWHQKDQFLQJVWUDQGV ZLWKLQWKHPHVRUHFWDOIDWRQ05LPDJHVZHUHUHWURVSHFWLYHO\FRUUHODWHGZLWKWKH KLVWRSDWKRORJLFÀQGLQJV 5HVXOWV $IWHU&57WKHGLVHDVHZDVHLWKHUOLPLWHGWRWKHUHFWDOZDOOQ SDWLHQWV RUSUHVHQWHGPHVRUHFWDOIDWLQÀOWUDWLRQQ RQKLVWRORJ\,QSDWLHQWVUHWLFXODU RUOLQHDUVKDSHGPHVRUHFWDOHQKDQFLQJVWUDQGVZHUHREVHUYHG,QSDWLHQWVWKH UHWLFXODUVKDSHGHQKDQFLQJVWUDQGVUHDFKHGWKHPHVRUHFWDOIDVFLDDQGDSRVLWLYH FLUFXPIHUHQWLDOUHVHFWLRQPDUJLQDIWHUWRWDOPHVRUHFWDOH[FLVLRQZDVIRXQGRQWKH KLVWRORJLFDQDO\VLV25 &,VORJLVWLFUHJUHVVLRQZKHUHDV OLQHDUVKDSHGHQKDQFLQJVWUDQGVHLWKHUUHDFKLQJRUQRWUHDFKLQJWKHPHVRUHFWDO IDVFLDUHYHDOHGQRFRUUHODWLRQZLWKPHVRUHFWDOIDVFLDLQÀOWUDWLRQ25RU &,V &RQFOXVLRQ5HWLFXODUVKDSHGHQKDQFLQJVWUDQGVUHDFKLQJWKHPHVRUHFWDOIDVFLD ZHUHVLJQLÀFDQWO\UHODWHGWRPHVRUHFWDOIDVFLDLQÀOWUDWLRQ 5RRP) *HQLWRXULQDU\ 66 $GUHQDODQGNLGQH\LPDJLQJ 0RGHUDWRUV 05DPDOKR$OPDGD37 '+06]RODU*UD]$7 % (YLGHQFHEDVHGPHGLFLQHGHFLVLRQPDNLQJRQUHQDOOHVLRQVEDVHG RQPHWDDQDO\VLVRI05GLIIXVLRQZHLJKWHGLPDJLQJ (/DVVHO 55DR&6FKZHQNH626FK|QEHUJ+-0LFKDHO\ 0DQQKHLP'(*DOYHVWRQ7;86%HUOLQ'( 3XUSRVH&RPPRQO\SHUIRUPHGFRQWUDVWHQKDQFHG05,FDQRQO\GLVWLQJXLVKWRD OLPLWHGH[WHQWEHWZHHQPDOLJQDQWDQGEHQLJQIRFDOUHQDOOHVLRQV7KHDLPRIWKLV PHWDDQDO\VLVLVWRUHYLHZUHQDOGLIIXVLRQZHLJKWHGLPDJLQJWRFRPSDUH $'&YDOXHV IRUGLIIHUHQWUHQDOOHVLRQVZKLFKFDQEHDSSOLHGLQFOLQLFDOSUDFWLFH 0HWKRGVDQG0DWHULDOV$VHDUFKRQ3XE0HGZDVSHUIRUPHGWRLGHQWLI\UHOHYDQW DUWLFOHVSXEOLVKHGRQUHQDO':,RIIRFDOUHQDOOHVLRQVEHWZHHQDQGE\ WZRLQGHSHQGHQWUHYLHZHUV7KHVHUHYLHZHUVH[WUDFWHGWKH$'&YDOXHVIURPWKH VHOHFWHGVWXGLHVE\OHVLRQW\SHWRGHWHUPLQHWKHGLJQLW\RIDOHVLRQZLWKLQWKHNLGQH\ 7KHGDWDWDEOHZDVÀQDOLVHGLQDFRQVHQVXVUHDG7KH $'&YDOXHVZHUHHYDOXDWHG VWDWLVWLFDOO\E\DPHWDUHJUHVVLRQEDVHGRQDOLQHDUPL[HGPRGHO$WZRVLGHGS YDOXHRIOHVVWKDQLQGLFDWHGVWDWLVWLFDOVLJQLÀFDQFH 5HVXOWV7KHPHWDDQDO\VLVLVEDVHGRQVWXGLHVZLWKDFXPXODWLYHQXPEHURI SDWLHQWV5HQDOFHOOFDUFLQRPDVKDYHVLJQLÀFDQWORZHU $'&YDOXHVWKDQEHQLJQ WLVVXHVPPYVVPPSYDOXH8URHSLWKHOLDO PDOLJQDQFLHVFDQEHGLIIHUHQWLDWHGE\ORZHVW$'&YDOXHVVPPS YDOXH7KHUHLVDVWDWLVWLFDOO\VLJQLÀFDQWGLIIHUHQFHEHWZHHQWKH $'&YDOXHV RIUHQDOFHOOFDUFLQRPDVDQGRQFRF\WRPDVVPPYHUVXV VPPSYDOXH &RQFOXVLRQ7KHHYDOXDWLRQRI $'&YDOXHVFDQKHOSWRGHWHUPLQHEHWZHHQEHQLJQ DQGPDOLJQDQWOHVLRQVLQJHQHUDOEXWDOVRVHHPVDEOHWRGLIIHUHQWLDWHRQFRF\WRPDV IURPPDOLJQDQWWXPRXUVKHQFHSRWHQWLDOO\UHGXFLQJWKHQXPEHURIXQQHFHVVDULO\ SHUIRUPHGQHSKUHFWRPLHV % &RPSDULVRQRIPLQXWHGHOD\HGFRQWUDVWHQKDQFHG&7DQG FKHPLFDOVKLIW05LQWKHHYDOXDWLRQRIDGUHQDOPDVVHV +-.RR+-&KRL0+.LP.6&KR6HRXO.5HOÀQ #JPDLOFRP 3XUSRVH7 RUHWURVSHFWLYHO\FRPSDUHWKHGLDJQRVWLFSHUIRUPDQFHRIGHOD\HGHQ KDQFHGFRPSXWHGWRPRJUDSK\&7DQGFKHPLFDOVKLIWPDJQHWLFUHVRQDQFH05 LPDJLQJIRUHYDOXDWLQJDGUHQDOPDVVHV % $SSDUHQWGLIIXVLRQFRHIÀFLHQW$'&PRGLÀFDWLRQVLQDVVHVVLQJ JDVWURHVRSKDJHDOFDQFHU*(&UHVSRQVHWRQHRDGMXYDQWWUHDWPHQW 17FRPSDULVRQWRWXPRXUUHJUHVVLRQJUDGH75*DWKLVWRORJ\ 0&HOOLQD) 'H&REHOOL) *LJDQWL/$OEDUHOOR(2UVHQLJR'&KLDUL $(VSRVLWR&6WDXGDFKHU$'HO0DVFKLR0LODQ,7FHOOLQDPLFKDHOD#KVULW 3XUSRVH7 RHYDOXDWHZKHWKHUPRGLÀFDWLRQVLQWKH$'&EHIRUHDQGDIWHU17у $'&IRUORFDOO\DGYDQFHG*(&DUHUHODWHGWR75*DQREMHFWLYHKLVWRORJLFDOSD UDPHWHURIWUHDWPHQWUHVSRQVHVFRULQJWKHUHVLGXDOQHRSODVWLFLQJUDGHVREWDLQHG DIWHUUDGLFDOUHVHFWLRQSUHGLFWRUIRUGLVHDVHIUHHVXUYLYDO 0HWKRGVDQG0DWHULDOVSDWLHQWVDIIHFWHGE\DELRSV\SURYHGORFDOO\DGYDQFHG (*&XQGHUZHQW7GLIIXVLRQZHLJKWHGLPDJLQJSUHDQGSRVW170HDQOHVLRQ $'&VOHVLRQYROXPHV9у$'&9FKDQJHVSUHDQGSRVW17у9ZHUHFDOFX ODWHG3DWLHQWVZLWK75*ZHUHFRQVLGHUHGUHVSRQGHUV5SDWLHQWVZLWK75* QRQUHVSRQGHU15 5HVXOWV 1R FRUUHODWLRQ EHWZHHQ у9 DQG 75* 5 ZDV IRXQG 7KH GLI IHUHQFH LQ у9 EHWZHHQ WKH WZR JURXSV ZDV QRW VWDWLVWLFDOO\ VLJQLÀFDQW GLIIHUHQW 3 $IWHU 17 SDWLHQWV VKRZHG DQ LQFUHDVH LQ$'& YDOXHV SDWLHQWVGLGQRWVKRZVLJQLÀFDQWFKDQJHVSDWLHQWVVKRZHG GHFUHDVLQJ$'&YDOXHV$'&VFKDQJHVVKRZHGDVLJQLÀFDQWLQYHUVHFRUUHODWLRQ ZLWKUHVSRQVHWR17U 5VKRZHGDVWDWLVWLFDOO\VLJQLÀFDQWORZHUSUH17 $'&[PPVWKDQ15[PPV3 DQG KLJKHUSRVW17 $'&[PPVYV[PPV3 у$'& ZDV VWDWLVWLFDOO\ VLJQLÀFDQW KLJKHU IRU 5 WKDQ IRU 15 YV 3 &RQFOXVLRQ7KHRQO\GLPHQVLRQDOFULWHULDу9LVQRWDJRRGLQGLFDWRURIUHVSRQVH $'&FDQEHFRQVLGHUHGDSUHGLFWRURIWUHDWPHQWUHVSRQVHHYHQEHIRUHWKHEHJLQ QLQJRI17 у$'&FDQEHXVHGWRDVVHVVWXPRXUUHVSRQVHWR17 DVDUHOLDEOH LQGLFDWRURIWKH75*FODVVLÀFDWLRQ % 3(7JXLGHGSURJQRVLVDSURPLVLQJUROHRIPHWDEROLFLPDJLQJLQ RHVRSKDJHDOFDQFHU /(YDQJHOLVWD$5&HUYLQR5$OÀHUL&&DVWRUR3 &0X]]LR) 3RPHUUL 3DGXD,7ODXUDHYDQJHOLVWD#LRYHQHWRLW 3XUSRVH7 R HYDOXDWH WKH SURJQRVWLF YDOXH RI )'*3(7&7 DIWHU QHRDGMXYDQW WKHUDS\LQORFDOO\DGYDQFHGRHVRSKDJHDOFDQFHU(&SDWLHQWV 0HWKRGV DQG 0DWHULDOV$PRQJ (& SDWLHQWV ZKR XQGHUZHQW )'*3(7 &7 DIWHU QHRDGMXYDQW WUHDWPHQW ZH VHOHFWHG SDWLHQWV ZLWKRXW HYLGHQFH RU VXVSLFLRXVIRUGLVWDQWPHWDVWDVHV$OOSDWLHQWVZHUHIROORZHGIRUDPHDQSHULRGRI PRQWKVIURPQXFOHDULPDJLQJ3(7&7ÀQGLQJVZHUHFRUUHODWHGZLWKSDWLHQW PDQDJHPHQWDQGORQJWHUPSURJQRVLV&KLVTXDUHWHVWZDVXVHGIRUFRPSDULVRQ RI FDWHJRULFDO YDULDEOHV DQG W6WXGHQW WHVW IRU FRQWLQXRXV GDWD 6XUYLYDO FXUYHV ZHUHFRPSXWHGXVLQJ.DSODQ0HLHUPHWKRG$SYDOXHRIZDVFRQVLGHUHG VWDWLVWLFDOO\VLJQLÀFDQW 5HVXOWV SDWLHQWV KDG QHJDWLYH DQG SRVLWLYH YV 3(7&7 DIWHU QHRDGMXYDQW WKHUDS\ SDWLHQWV XQGHUZHQW UDGLFDOLQWHQW VXUJHU\ DQG GLGQRWZKHUHDVSHUIRUPHGVXUJHU\DQGGLGQRWS$IWHUD PHGLDQWLPHRIPRQWKVSDWLHQWVZHUHGLVHDVHIUHHUHODSVHGDQGGLHG 7KHHYHQWIUHHVXUYLYDOZDVVLJQLÀFDQWO\KLJKHULQSDWLHQWVZLWKQHJDWLYHWKDQZLWK SRVLWLYH 3(7&7 DIWHU QHRDGMXYDQW WUHDWPHQW YV ORJ UDQN S &RQVLGHULQJSDWLHQWVZLWKSRVLWLYH3(7&7 LQQRQVXUJHU\VXEVHWRQO\SDWLHQW ZDVDOLYHZLWKRXWHYLGHQFHRIGLVHDVHZKLOHLQVXUJHU\VXEVHWSDWLHQWVZHUH GLVHDVHIUHHYVS &RQFOXVLRQ3(7&7FRXOGVWUDWLI\WKHUHFXUUHQFHULVNRI(&SDWLHQWVEDVHGRQ WUHDWPHQWHIÀFDF\$IWHUPRQWKVIURP3(7&7 RISDWLHQWVZLWKQHJDWLYH 3(7&7ZKRGLGQRWXQGHUJRVXUJHU\UHVXOWHGGLVHDVHIUHH$SRVLWLYH3(7&7 DIWHUQHRDGMXYDQWWKHUDS\VKRXOGEHIROORZHGE\VXUJHU\IRULPSURYLQJWKHHYHQW IUHHVXUYLYDO % 6SHFWUDOSUHVDWXUDWLRQLQYHUVLRQUHFRYHU\05LPDJLQJVHTXHQFH DIWHUJDGROLQLXPLQMHFWLRQWRLGHQWLI\PHVRUHFWDOIDVFLDLQÀOWUDWLRQ LQSDWLHQWVZLWKUHFWDOFDUFLQRPDDIWHUQHRDGMXYDQWFKHPRDQG UDGLDWLRQWKHUDS\ (4XDLD98OFLJUDL/'H3DROL%&DELEER(3DQWDQR0&RYD7ULHVWH,7 TXDLD#XQLWVLW 3XUSRVH7 RUHWURVSHFWLYHO\DVVHVVWKHYDOXHRIVSHFWUDOSUHVDWXUDWLRQLQYHUVLRQ UHFRYHU\63,505LPDJLQJVHTXHQFHDIWHUJDGROLQLXPLQMHFWLRQWRLGHQWLI\PHV 6FLHQWLILF6HVVLRQ $ 6&'()*+%(XURSHDQ&RQJUHVVRI 5DGLRORJ\ 6XQGD\ PPVHFP\HOROLSRPDVPHDQYDOXHPPVHFDQGSULPL WLYHFDUFLQRPDVPHDQYDOXHPPVHF$KLJKHU$'&YDOXHZDVVHHQ LQWKHDGUHQDOPHWDVWDVLVPHDQYDOXHPPVHFFRPSDUHGWRWKH RWKHUDGUHQDOOHVLRQVSLQUHODWLRQWRWKHSUHVHQFHRIPRUHKRPRJHQHRXV ZDWHUSURWRQVGLIIXVLRQ &RQFOXVLRQ:HFRXOGQRWREWDLQGLIIHUHQWLDOGLDJQRVLVEHWZHHQEHQLJQDQWDQG PDOLJQDQWDGUHQDOOHVLRQVXVLQJGLIIXVLRQZHLJKWHGLPDJHVDQG$'&PDS4XDQ WLWDWLYH':,HYDOXDWLRQE\$'&PDSVRIIHUVDIXUWKHUQRQLQYDVLYHWRROLQWHUPVRI FKDUDFWHULVDWLRQRQO\RIPHWDVWDWLFOHVLRQVDJDLQVWWKHRWKHUDGUHQDOOHVLRQV7KH FKHPLFDOVKLIWLPDJHVUHPDLQWKHPRVWKHOSIXOVHTXHQFHVLQFKDUDFWHULVDWLRQRI DGUHQDOOHVLRQV % 4XDQWLWDWLYH1DDQG':LPDJLQJRIWKHKHDOWK\KXPDQNLGQH\IRU HVWDEOLVKLQJQRUPYDOXHVIRUWKH1DFRQFHQWUDWLRQVDW7 6+DQHGHU6.RQVWDQGLQ3 .HWWQDNHU/56FKDG626FK|QEHUJ +-0LFKDHO\0DQQKHLP'(KDQHGHU#JRRJOHPDLOFRP 3XUSRVH7KH SXUSRVH RI WKLV SURVSHFWLYH VWXG\ ZDV WR HVWDEOLVK SK\VLRORJLFDO UDQJHVIRUWKHUHQDOFRUWLFRPHGXOODU\1DFRQFHQWUDWLRQ>1D@JUDGLHQWWKH FRUUHODWLRQZLWK':LPDJLQJDW7DQGSK\VLRORJLFDOSDUDPHWHUVLQDFROOHFWLYH RIKHDOWK\YROXQWHHUV 0HWKRGVDQG0DWHULDOVKHDOWK\YROXQWHHUVIPPHDQDJHDZHUH LQFOXGHG LQ WKLV ,5%DSSURYHG VWXG\ )RU 1DLPDJLQJ D 'GHQVLW\ DGDSWHG UDGLDO *5(VHTXHQFH 7( PV 75 PV SURMHFWLRQV VSDWLDO UHVROXWLRQ [[ PP ZDV XVHG DW 7 7LP7ULR 0DJQHWRP 6LHPHQV LQ FRPELQDWLRQ ZLWK D GHGLFDWHG 1DFRLO DQG UHIHUHQFH 1DSKDQWRPV ZLWKDJDURVH$[LDOGLIIXVLRQZHLJKWHGLPDJHV7( PV75 PVE YDOXHV VSDWLDOUHVROXWLRQ [[PPZHUHDFTXLUHGZLWKDVWDQGDUG ERG\FRLO 0HDQ YDOXHV VWDQGDUG GHYLDWLRQV IRU >1D@ DQG$'&YDOXHV ZHUH FDOFXODWHGIRUHDFKYROXQWHHUDQGDVRYHUDOOYDOXHV3HDUVRQFRUUHODWLRQFRHIÀFLHQWV ZHUHFDOFXODWHGWRFKHFNIRUVWDWLVWLFDOO\VLJQLÀFDQWFRUUHODWLRQVZLWK$'&YDOXHV JHQGHUVHUXP>1D@ERG\PDVVLQGH[%0,DQGJORPHUXODUÀOWUDWLRQUDWH*)5 5HVXOWV7KHPHDQFRUWLFRPHGXOODU\>1D@IRUDOOKHDOWK\YROXQWHHUVLQFUHDVHG IURPFRUWLFDOPPROOWRPHGXOODUORFDWLRQPPROO,QWHULQGL YLGXDOGLIIHUHQFHVUDQJHGIURPFRUWLFDOPHGXOODU\PPROOWR PPROOZLWKVLJQLÀFDQWKLJKHUYDOXHVIRUZRPHQS 7KHPHDQFRUWLFRPHGXOODU\>1D@JUDGLHQWZDVPPROOPP7KHPHDQ UHQDO$'&YDOXHZDV[PPVDQGUDQJHGLQWHULQGLYLGXDOO\IURP[ PPVWR[PPV1RVWDWLVWLFDOO\VLJQLÀFDQWFRUUHODWLRQVZHUHIRXQG EHWZHHQWKHUHQDOFRUWLFRPHGXOODU\1DFRQFHQWUDWLRQDQG$'&YDOXHVVHUXP >1D@%0,DQG*)5 &RQFOXVLRQ'HVSLWHLQWUDLQGLYLGXDOGLIIHUHQFHVDUDQJHRIQRUPDOYDOXHVIRUWKH FRUWLFRPHGXOODU\>1D@FRXOGEHGHÀQHGDQGWKHODFNLQJFRUUHODWLRQZLWKRWKHU SK\VLRORJLFDOSDUDPHWHUVFRXOGEHVKRZQ % 7XPRXUQHFURVLVRQPDJQHWLFUHVRQDQFHLPDJLQJFRUUHODWHVZLWK DJJUHVVLYHKLVWRORJ\DQGGLVHDVHSURJUHVVLRQLQFOHDUFHOOUHQDOFHOO FDUFLQRPD 3 %HGG\(*HQHJD/1JR1+LQGPDQ-:HL$%XOORFN56%KDWW 0%$WNLQV,3HGURVD%RVWRQ0$86SEHGG\#HLUFRPQHW 3XUSRVH7KHDLPRIWKLVVWXG\ZDVWRFRUUHODWHWKH05LPDJLQJIHDWXUHVRIFOHDU FHOOUHQDOFHOOFDUFLQRPDFF5&&ZLWKWKHSDWKRORJLFDODSSHDUDQFHDQGWRDVVHVV LIWKH05LPDJLQJIHDWXUHVFRUUHODWHZLWKGLVHDVHSURJUHVVLRQ 0HWKRGV DQG 0DWHULDOV ,QLWLDO VWDJLQJ 05,V RI SDWLHQWV ZLWK FF5&& ZHUH UHW URVSHFWLYHO\ DVVHVVHG E\ WZR UDGLRORJLVWV IRU WKH SUHVHQFH RI WXPRXU QHFURVLV F\VWLFGHJHQHUDWLRQLQWUDYR[HOIDWKDHPRUUKDJHUHWURSHULWRQHDOFROODWHUDOYHVVHOV DQGUHQDOYHLQWKURPERVLV4XDQWLWDWLYHDQDO\VLVRIWKH05LPDJLQJIRULQWUDFHO OXODUOLSLGZLWKLQWKHWXPRXUVZDVDOVRSHUIRUPHG7KHVHÀQGLQJVZHUHFRUUHODWHG ZLWKKLVWRSDWKRORJLFÀQGLQJVRIFOHDUFHOOSHUFHQWDJHJURZWKSDWWHUQDQGWLPHWR GLVHDVHSURJUHVVLRQ 5HVXOWVSDWLHQWVZLWKFF5&&ZHUHLQFOXGHGSDWLHQWVKDGIROORZXSGDWD DYDLODEOHIRUSURJUHVVLRQDQDO\VLV7KHSUHVHQFHRIWXPRXUQHFURVLVUHWURSHULWRQHDO FROODWHUDOVDQGUHQDOYHLQWKURPERVLVRQ05,ZHUHVLJQLÀFDQWO\DVVRFLDWHGZLWK ORZFOHDUFHOOSHUFHQWDJHIRUERWKUHDGHUVS05,HYLGHQFHRIQHFURVLV UHWURSHULWRQHDOFROODWHUDOVDQGUHQDOYHLQWKURPERVLVZDVDVVRFLDWHGZLWKGLVHDVH SURJUHVVLRQ S 0XOWLYDULDEOH DQDO\VLV GHPRQVWUDWHG WKDW ZKHQ WXPRXU VL]HQHFURVLVUHWURSHULWRQHDOFROODWHUDOVDQGUHQDOYHLQWKURPERVLVZHUHDQDO\VHG WRJHWKHUQHFURVLVZDVWKHRQO\IHDWXUHWKDWUHPDLQHGVWDWLVWLFDOO\DVVRFLDWHGZLWK GLVHDVH SURJUHVVLRQ S DGMXVWHG RGGV UDWLR &, IRU UHDGHURQHDQGS DGMXVWHGRGGVUDWLR &, IRUUHDGHUWZR 0HWKRGVDQG0DWHULDOVPLQXWHGHOD\HGDGUHQDOSURWRFRO&7XQHQKDQFHG VHFRQGDQGPLQXWHGHOD\HG&7RUFKHPLFDOVKLIW05LPDJHVIRUDGUHQDO PDVVHVLQSDWLHQWVZHUHUHWURVSHFWLYHO\UHYLHZHGIRUWKHSHULRGIURP-DQXDU\ WKURXJK$XJXVWK\SHUDWWHQXDWLQJDGUHQDOPDVVHV!+8RQ XQHQKDQFHG&7LPDJHVLQSDWLHQWVPHQDQGZRPHQPHDQDJH \HDUVDQDO\VHGXVLQJDEVROXWHSHUFHQWDJHZDVKRXW$3:DQGUHODWLYHSHUFHQWDJH ZDVKRXW53:IRUHYDOXDWLQJ&7 DQGK\SHUDWWHQXDWLQJDGUHQDOPDVVHVZHUH DQDO\VHGZLWKFKHPLFDOVKLIW05E\FDOFXODWLQJDGUHQDOWRVSOHHQUDWLR$65DQG VLJQDOLQWHQVLW\LQGH[6,,5HFHLYHURSHUDWLQJFKDUDFWHULVWLF52&DQDO\VLVZDV SHUIRUPHGWRFRPSDUHWKHGLDJQRVWLFSHUIRUPDQFHRI&7DQG05 5HVXOWV $OODGUHQDOPDVVHVLQFOXGHGDGHQRPDVDQGQRQDGHQRPDV7KH VHQVLWLYLW\DQGVSHFLÀFLW\IRUWKH$3:DW&7ZHUHDQGUHVSHFWLYHO\ DQGWKRVHIRUWKH53:ZHUHDQGUHVSHFWLYHO\ $QGDW05WKHVHQVLWLY LW\DQGVSHFLÀFLW\IRUWKH6,,ZHUHDQGUHVSHFWLYHO\ $UHDVXQGHUWKH 52&FXUYHZHUHDQGIRUWKH$3:53:DQG6,,UHVSHFWLYHO\ +RZHYHUWKHUHZDVQRVLJQLÀFDQWGLIIHUHQFHIRUGLDJQRVWLFSHUIRUPDQFHEHWZHHQ $3:53:DQG6,,3! &RQFOXVLRQ&KHPLFDOVKLIW05VKRZVDKLJKVHQVLWLYLW\DQGVSHFLÀFLW\IRUHYDOX DWLQJ DGUHQDO PDVVHV EXW LV RI QR DGGLWLRQDO GLDJQRVWLF YDOXHFRPSDUHG WR WKH PLQXWHGHOD\HGFRQWUDVWHQKDQFHG&7 % (YDOXDWLRQRIDGUHQDOPHWDVWDVHVIURPUHQDOFHOOFDUFLQRPDRU KHSDWRFHOOXODUFDUFLQRPDXVLQJXQHQKDQFHGDQGGHOD\HGFRQWUDVW HQKDQFHG&7 < &KRL&.LP%3DUN63DUN-3DUN+<RRQ$.LP6HRXO.5 \D FKRL#VDPVXQJFRP 3XUSRVH 7 R UHWURVSHFWLYHO\ PHDVXUH WKH DWWHQXDWLRQ YDOXHV DQG SHUFHQWDJH HQKDQFHPHQWZDVKRXWRIDGUHQDOPHWDVWDVHVDWGHOD\HGFRQWUDVWHQKDQFHG&7 LQSDWLHQWVZLWK5&&VDQG+&&VDQGWRFRPSDUHZLWKWKRVHRIDGUHQDODGHQRPDV 0HWKRGVDQG0DWHULDOV)LIWHHQSDWLHQWVZLWKDGUHQDOPHWDVWDVHVDQGSD WLHQWVZLWKDGUHQDODGHQRPDVXQGHUZHQWGHGLFDWHGDGUHQDO&7 7KHDWWHQXDWLRQ YDOXHVDQGSHUFHQWDJHHQKDQFHPHQWZDVKRXWZHUHFDOFXODWHG7KHFKDQJHLQVL]H RIDGUHQDOPDVVHVZDVDOVRDVVHVVHG7KHÀQDOGLDJQRVLVZDVPDGHE\VXUJHU\ RU ELRSV\ D GHFUHDVH LQ VL]H DIWHU WDUJHWHG FKHPRWKHUDS\ PHWDVWDVHV DQG VWDELOLW\LQVL]HRQIROORZXSLPDJLQJDWOHDVWPRQWKVDGUHQDODGHQRPDV 5HVXOWV7KHPHDQDEVROXWHSHUFHQWDJHZDVKRXWYDOXHRIPHWDVWDVHV+8 ZDVQRWVLJQLÀFDQWO\GLIIHUHQWIURPWKDWRIDGHQRPDV+87KHPHDQUHOD WLYHSHUFHQWDJHZDVKRXWYDOXHRIPHWDVWDVHV+8ZDVVLJQLÀFDQWO\ORZHU WKDQWKDWRIDGHQRPDV+8EXWRIPHWDVWDVHVKDG$3:RI! RU53:RI!2QXQHQKDQFHG&7 WKHPHDQDWWHQXDWLRQYDOXHRIPHWDVWDVHV DQGDGHQRPDVZDV+8DQG+8UHVSHFWLYHO\DOOPHWDVWDVHV KDG!+8$OOPHWDVWDVHVVKRZHGDPHDVXUDEOHJURZLQJLQVL]H &RQFOXVLRQ ,Q SDWLHQWV ZLWK 5&&V DQG +&&V WKH SHUFHQWDJH HQKDQFHPHQW ZDVKRXWRIDGUHQDOPHWDVWDVHVZDVVLPLODUWRWKDWRIDGUHQDODGHQRPDV7KXVLI DQDGUHQDOPDVVLQWKRVHSDWLHQWVKDV&7ÀQGLQJVVXJJHVWLQJDOLSLGSRRUDGUHQDO DGHQRPDFDUHIXOVHULDOLPDJLQJIROORZXSLVUHFRPPHQGHGWRH[FOXGHDSRVVLELO LW\RIPHWDVWDVLV % 9DOXHRIIXQFWLRQDO05,ZLWKGLIIXVLRQZHLJKWHGLPDJLQJLQ FKDUDFWHULVDWLRQRILQGHWHUPLQHGDGUHQDOOHVLRQVFRPSDULVRQZLWK FKHPLFDOVKLIWLPDJLQJ &57 DOHL)UDQ]HVL',SSROLWR/0RQJX]]L&&DSUDUR$&&DGRQLFL 66LURQL0RQ]D,7FWIGRF#KRWPDLOFRP 3XUSRVH7 RDVVHVVWKHYDOXHRIDGGLQJIXQFWLRQDOVHTXHQFHVXVLQJGLIIXVLRQ ZHLJKWHG LPDJLQJ DQG DSSDUHQW GLIIXVLRQ FRHIÀFLHQW YDOXH WR FRQYHQWLRQDO 05 LPDJLQJH[DPLQDWLRQLQWKHGLIIHUHQWLDOGLDJQRVLVRIDGUHQDOOHVLRQV 0HWKRGVDQG0DWHULDOV$WRWDORISDWLHQWVZLWKDYDULHW\RIDGUHQDOOHVLRQV DGHQRPDV P\HOROLSRPDV DGUHQDO PHWDVWDVLV DQG SULPLWLYH FDUFLQRPDV ZHUH SURVSHFWLYHO\LQYHVWLJDWHGZLWK05,VFDQ7 $FKLHYD3KLOLSV7KHVWXG\ZDV SHUIRUPHGZLWKDSKDVHGDUUD\PXOWLFRLOXVLQJDFRQYHQWLRQDOSURWRFROWKDWLQFOXGHG DOVRGLIIXVLRQZHLJKWHGLPDJLQJ':,ZLWKEYDOXHRIDQGPP VHF':,LPDJHVZHUHFRPSDUHGZLWK7))(LQDQGRSSRVHGSKDVH7KHPHDQ $'& YDOXH RI DGUHQDO OHVLRQV ZDV FDOFXODWHG DQG FRUUHODWHG ZLWK 05, ÀQGLQJV 52,ZHUHPDQXDOO\GUDZQDORQJWKHFRQWRXUVRIDGUHQDOOHVLRQRQ$'&PDSVDQG VWDWLVWLFDODQDO\VLVZDVSHUIRUPHG 5HVXOWV/HVLRQVZHUHSURYHGHLWKHUE\IROORZXSVL]HLQFUHDVHRIRYHUDSHULRG RIWLPHRUELRSV\RQFRORJLFSDWLHQWV$OODGUHQDOOHVLRQVSUHVHQWHGUHVWULFWLRQRI GLIIXVLRQDQGPRWLRQRIZDWHUSURWRQVRQGLIIXVLRQZHLJKWHGLPDJHV7KHUHZDV QRVLJQLÀFDQWGLIIHUHQFHLQREWDLQHG $'&YDOXHVEHWZHHQDGHQRPDVPHDQYDOXH 6FLHQWLILF6HVVLRQ 6 &$' ( ) *+% (XURSHDQ&RQJUHVVRI 5DGLRORJ\ 765ZHUHFDOFXODWHG7ZRH[SHULHQFHGUDGLRORJLVWVYLVXDOO\DVVHVVHGSUHVHQFH DQGGLVWULEXWLRQRIODWHHQKDQFHPHQWLQFHQWUDODUHDVPHGLDQPQ6' 5HVXOWV$PRQJ WKHVH WXPRXUV WKHUH ZHUH RQFRF\WRPDV LQ SDWLHQWV ZHUHLGHQWLÀHGSUHVHQWLQJZLWKDFHQWUDOVFDUUHQDOFHOOFDUFLQRPDV5&&LQ SDWLHQWV ZLWK D FHQWUDO QHFURVLV DQG OHLRP\RPD &RPSOHWHODWH HQKDQFH PHQWRIWKHFHQWUDO]RQHZDVREVHUYHGLQRQFRF\WRPDVDQGLQ5&&V S 6,,DQG765ZHUHVLJQLÀFDQWO\GLIIHUHQWS DQGS UHVSHFWLYHO\ EHWZHHQ RQFRF\WRPD DQG 5&& JURXSV &RPELQDWLRQ RI FRPSOHWH HQKDQFHPHQWDQG6,,RU765SURYLGHGVHQVLWLYLW\RIDQGVSHFLÀFLW\RI DQGSRVLWLYHSUHGLFWLYHYDOXHRIDQGDQGQHJDWLYHSUHGLFWLYH YDOXHRIDQGUHVSHFWLYHO\ &RQFOXVLRQ&HQWUDOVFDURIRQFRF\WRPDVDQGFHQWUDOQHFURVLVRI5&&6PD\ERWK HQKDQFHRQODWH*GHQKDQFHG05LPDJHV+RZHYHUDFRPSOHWHHQKDQFHPHQWLV KLJKO\HYRFDWLYHRIRQFRF\WRPD % 6WXG\RIUHQDOLURQRYHUORDGE\7 05,LQDODUJHFRKRUWRI WKDODVVHPLDPDMRUSDWLHQWV (*UDVVHGRQLR $0HORQL*5HVWDLQR*9DOHUL/1DWDOH*5*LXJQR 0/RPEDUGL00LGLUL$3HSH3DOHUPR,73LVD,7&DPSREDVVR,7 $QFRQD,75RPH,7&DOWDJLURQH,7HJUDVVHGRQLR#JPDLOFRP 3XUSRVH7KLVVWXG\DLPHGWRGHVFULEHWKHUHQDO7 YDOXHVLQSDWLHQWVZLWKWKD ODVVHPLDPDMRU70WRLQYHVWLJDWHWKHFRUUHODWLRQEHWZHHQUHQDODQGFDUGLDFRU KHSDWLFVLGHURVLVDQGELYHQWULFXODUFDUGLDFIXQFWLRQ 0HWKRGVDQG0DWHULDOV70SDWLHQWVPHQ\HDUVXQGHUZHQW 05,0XOWLHFKR7 VHTXHQFHVZHUHXVHGIRULURQRYHUORDGDVVHVVPHQW,QWKH KHDUWVHJPHQWDODQGJOREDO7 YDOXHVZHUHFDOFXODWHG7KHOLYHU7 YDOXHZDV DVVHVVHGLQDVLQJOH52,)RUHDFKNLGQH\7 YDOXHVZHUHFDOFXODWHGLQWKUHHGLI IHUHQW52,VDQGZHUHDYHUDJHGWRREWDLQDUHSUHVHQWDWLYHYDOXHIRUWKHNLGQH\7KH PHDQ7 YDOXHRYHUWKHNLGQH\VZDVDOVRFDOFXODWHG%LYHQWULFXODUPRUSKRORJLFDO DQGIXQFWLRQDOSDUDPHWHUVZHUHHYDOXDWHGE\FLQHLPDJHV 5HVXOWV7 YDOXHVLQWKHULJKWNLGQH\ZHUHVLJQLÀFDQWORZHUWKDQLQWKHOHIWNLGQH\ PVYVPV37KHPHDQ7 YDOXHRYHUWKHNLGQH\V ZDVPVDQGSDWLHQWVKDGDSDWKRORJLFDOYDOXH7 PV 0HDQUHQDO7 YDOXHVLQFUHDVHGZLWKDJHU 3DQGZHUHVLJ QLÀFDQWO\QHJDWLYHO\FRUUHODWHGZLWKVHUXPIHUULWLQOHYHOVU 3 6LJQLÀFDQWSRVLWLYHFRUUHODWLRQVRIWKHPHDQ7 YDOXHVZHUHGHPRQVWUDWHGIRUOLYHU U 3DQGJOREDOKHDUWU 3 7 YDOXHV1RFRUUHOD WLRQZDVIRXQGEHWZHHQUHQDOLURQRYHUORDGDQGELYHQWULFXODUIXQFWLRQSDUDPHWHUV &RQFOXVLRQ6\VWHPLF7 GLIIHUHQFHVEHWZHHQOHIWDQGULJKWNLGQH\VZHUHIRXQG ZLWKVLJQLÀFDQWORZHUYDOXHVLQWKHULJKWRQH0HDQ7 YDOXHLQFUHDVHGZLWKDJH 5HQDOLURQGHSRVLWLRQZDVQRWYHU\FRPPRQLQ70EXWLWZDVFRUUHODWHGZLWKLURQ GHSRVLWLRQLQOLYHUDQGKHDUW 5RRP) %UHDVW 66 ,QWHUYHQWLRQDOSURFHGXUHV 0RGHUDWRUV 6$OOHQ6XWWRQ8. 0ÉOYDUH]%HQLWR&yUGRED(6 % 0XOWLFHQWUHFRRSHUDWLYHVWXG\RIWKHHIIHFWLYHQHVVRIÀQHQHHGOH DVSLUDWLRQF\WRORJ\)1$&RID[LOODU\O\PSKQRGHVXQGHU VRQRJUDSKLFJXLGDQFHLQWKHSUHWUHDWPHQWPDQDJHPHQWRIEUHDVW FDQFHUSDWLHQWVUHVXOWVDIWHUFRQVHFXWLYHFDQFHUFDVHV 3 3DODQD -GHO5LHJR09LOODMRV07 HL[LGR09LODJUDQ0'LD]5XL] /&DQDOHV-5LEH06HQWLV6DEDGHOO(67 HUUDVD(6*UDQROOHUV(6 0DQUHVD(67 HUUDVVD(69LF(6SSDODQD#WDXOLFDW 3XUSRVH7 RGHWHUPLQHWKHVHQVLWLYLW\RI)1$&LQDFRQVHFXWLYHVHULHVRISDWLHQWV ZLWKEUHDVWFDQFHU7 RHYDOXDWHWKHVHQVLWLYLW\RI)1$&EURNHQGRZQE\WXPRXU VL]HYROXPHDQGSKHQRW\SH7 RSURSRVHUHFRPPHQGDWLRQVIRUWKHXVHRI)1$& LQWKLVFOLQLFDOVHWWLQJ 0HWKRGVDQG0DWHULDOV)URP$SULOWR-XQHZHVWXGLHGSDWLHQWV ZLWKEUHDVWFDQFHUXVLQJDSURWRFROIRUO\PSKQRGHHYDOXDWLRQ)1$&ZDVSHUIRUPHG RQ O\PSK QRGHV ZLWK PRUSKRORJLF FKDQJHV DFFRUGLQJ WR WKH %HGL FODVVLÀFDWLRQ RUZKHQO\PSKQRGHDSSHDUHGQRUPDORQWKHQRGHFORVHVWWRWKHLQGH[WXPRXU &RQFOXVLRQ05,IHDWXUHVRIFF5&&FORVHO\FRUUHODWHZLWKWKHSHUFHQWDJHRIFOHDU FHOOIHDWXUHVLQWKHWXPRXUDWKLVWRSDWKRORJ\05,HYLGHQFHRIQHFURVLVLVDSRRU SURJQRVWLFLQGLFDWRULUUHVSHFWLYHRIWXPRXUVL]HDQGWKLVÀQGLQJPD\EHXVHIXOLQ JXLGLQJWKHUDSHXWLFPDQDJHPHQW % 'LDJQRVWLFSHUIRUPDQFHRIPXOWLGHWHFWRU&7IRUGHWHFWLQJUHQDO VLQXVLQYDVLRQLQSDWLHQWVZLWKUHQDOFHOOFDUFLQRPD &.LP+&KRL0K.LP.6&KR6HRXO.5FKHUU\NLP #GUHDPZL]FRP 3XUSRVH7KHSXUSRVHRIRXUVWXG\ZDVWRHYDOXDWHWKHDFFXUDF\RIPXOWLGHWHFWRU &7IRUGHWHFWLQJUHQDOVLQXVLQYDVLRQLQWKHSUHRSHUDWLYHDVVHVVPHQWRISDWLHQWV ZLWKUHQDOFHOOFDUFLQRPD 0HWKRGVDQG0DWHULDOVSDWLHQWVZLWKVXUJLFDOO\UHQDOFHOOFDUFLQRPDSDWLHQWV ZKR XQGHUZHQW 0'&7 ZHUH LQFOXGHG LQ WKLV VWXG\ &RQWUDVWHQKDQFHG DFTXLVL WLRQVZHUHREWDLQHGGXULQJDUWHULDOFRUWLFRPHGXOODU\DQGQHSKURJUDSKLFSKDVH ,PDJHDQDO\VLVZDVÀUVWSHUIRUPHGZLWKRQO\D[LDO&7LPDJHV$VHFRQGDQDO\VLV ZDV WKHQ SHUIRUPHG ZLWK ERWK D[LDO DQG FRURQDO &7 LPDJHV 3UHVHQFH RI UHQDO VLQXVLQYDVLRQRISHULUHQDOIDWZDVHYDOXDWHGLQD[LDOLPDJHVDQGFRPELQHGD[LDO DQGFRURQDOUHIRUPDWWHGLPDJHV+LVWRORJLFDOHYDOXDWLRQKDVEHHQWKHGLDJQRVWLF VWDQGDUG7KHYDOXHRIDGGLWLRQRIFRURQDOLPDJHVWRD[LDOLPDJHVZDVHYDOXDWHG E\PHDQVRIUHFHLYHURSHUDWLQJFKDUDFWHULVWLF52&DQDO\VLV 5HVXOWV7KHPHDQWXPRXUVL]HZDVFP7KHVHQVLWLYLW\VSHFLÀFLW\DFFXUDF\ RID[LDOLPDJHVDQGFRPELQHGLPDJHVZHUHDQG UHVSHFWLYHO\7KH$8&VRI52&DQDO\VLVZHUHIRUD[LDOLPDJHVDQG IRUFRPELQHGLPDJHVS &RQFOXVLRQ0'&7LVDFFXUDWHLQWKHSUHRSHUDWLYHHYDOXDWLRQRIUHQDOVLQXVLQYD VLRQLQWKHSDWLHQWVZLWKUHQDOFHOOFDUFLQRPDEXWWKHUHZDVQRDGGLWLRQDOGLDJQRVWLF YDOXHRIFRURQDOUHIRUPDWWHGLPDJHWRD[LDOLPDJHV % 8WLOLW\RI7HVODGLIIXVLRQZHLJKWHGPDJQHWLFUHVRQDQFH':05 LPDJLQJIRUWKHFKDUDFWHULVDWLRQRIVPDOOVROLGUHQDOWXPRXUV ) $JQHOOR -&KDUWRQ0< -HXQJ*/D7 RQD0*DOLD00LGLUL&5R\ 3DOHUPR,76WUDVERXUJ)5 3XUSRVH7 RGHWHUPLQHWKHXWLOLW\RIDSSDUHQWGLIIXVLRQFRHIÀFLHQWV$'&VIRUWKH FKDUDFWHULVDWLRQRIVPDOOVROLGUHQDOOHVLRQV 0HWKRGVDQG0DWHULDOVSDWLHQWV*)5P/PLQZLWKVPDOOFP VROLGUHQDOPDVVHV>5&&VFOHDUFHOOW\SHVRWKHUW\SHV$0/VIDW FRQWDLQLQJPLQLPDOIDWDQGRQFRF\WRPDV@ZHUHH[DPLQHGRQD7V\VWHP XVLQJ':66(3,EYDOXHVVPP7KH $'&RIWKHOHVLRQVDQGWKH $'& RINLGQH\ZHUHHYDOXDWHG5HFHLYHURSHUDWRUFKDUDFWHULVWLFDQDO\VLVZDVSHUIRUPHG WRHYDOXDWHWKHGLDJQRVWLFYDOXHRI$'&IRUGLIIHUHQWLDWLQJFOHDUFHOO5&&VIURP RWKHUW\SH5&&V$0/VDQGRQFRF\WRPDV 5HVXOWV7KHPHDQ$'&RIWKHOHVLRQV>PPVHF@ZDV ORZHU WKDQ WKDW RI NLGQH\ > PP VHF @ S 0DQQ :KLWQH\ WHVW7KH PHDQ$'& ZDV GLIIHUHQW EHWZHHQ 5&&V > PP VHF @$0/V > PP VHF @ DQG RQFRF\WRPDV >PPVHF@S.UXVNDO:DOOLVWHVW7KHPHDQ $'&RI FOHDUFHOO5&&VZDVVLJQLÀFDQWO\KLJKHUWKDQWKDWRIRWKHU5&&V>PP VHFYV@S6WXGHQWWWHVW7KHUHZDV QRVLJQLÀFDQWGLIIHUHQFHEHWZHHQPHDQ$'&RIIDWFRQWDLQLQJ>PP VHF@DQGPLQLPDOIDW $0/V>PPVHF@S 6WXGHQWWWHVW7KHEHVWFXWRII$'&YDOXHIRUGLIIHUHQWLDWLQJFOHDUFHOO5&&VIURP RWKHU5&&V $0/VDQGRQFRF\WRPDVZHUHDQGPPVHFUHVSHFWLYHO\ &RQFOXVLRQ ':, LV XVHIXO WR GLIIHUHQWLDWH EHQLJQ IURP PDOLJQDQW VPDOO VROLG UHQDOOHVLRQV % &HQWUDOVFDULQUHQDORQFRF\WRPDVODWHFRQWUDVWHQKDQFHPHQWZLWK 05LPDJLQJ ) &RUQHOLV$6/DVVHUH7 7 RXUGLDV&'HPLQLHUH-0)HUULHUH< /H%UDV 1*UHQLHU%RUGHDX[)5IUDQFRLVFRUQHOLV#KRWPDLOFRP 3XUSRVH7KHSXUSRVHRIWKLVVWXG\ZDVWRHYDOXDWHWKHODWH*GHQKDQFHPHQWRI FHQWUDODUHDRIUHQDOWXPRXUVFRPSDWLEOHZLWKÀEURXVVFDURUQHFURVLV 0HWKRGVDQG0DWHULDOV7KLVUHWURVSHFWLYHVWXG\ZDVLQVWLWXWLRQDOUHYLHZERDUG DSSURYHGLQIRUPHGFRQVHQWZDVZDLYHG%DVHGRQWKHWKHVDXUXVRIRXULQVWLWXWLRQDO 5,6WXPRXUVLQSDWLHQWVLPDJHGZLWKODWH*GHQKDQFHG05VHTXHQFHVEH WZHHQDQGSUHVHQWHGZLWKKLJKVLJQDOLQWHQVLW\6,FHQWUDODUHDRQ7Z VHTXHQFHVFRPSDWLEOHZLWKFHQWUDOVFDU6,ZDVPHDVXUHGLQDOOUHQDOWXPRXUVDQG VSOHHQRQLQDQGRSSRVHGSKDVHLPDJHV6,LQGH[6,,DQGWXPRXUWRVSOHHQUDWLR 6FLHQWLILF6HVVLRQ $ 6&'()*+%(XURSHDQ&RQJUHVVRI 5DGLRORJ\ 6XQGD\ % 0DQDJHPHQWRIÁDWHSLWKHOLDODW\SLDGLDJQRVHGDWYDFXXPDVVLVWHG EUHDVWELRSV\SHUIRUPHGRQVXVSLFLRXVPLFURFDOFLÀFDWLRQV &RPSDULVRQEHWZHHQ*DQG*GHYLFHV $9LOOD ) &KLHVD,5RVHQEHUJ0&DODEUHVH/D6SH]LD,7*HQRD,7 FKLHVDIDELR#JPDLOFRP 3XUSRVH:HLQWHQGHGWRHVWDEOLVKLIZRPHQZLWKGLDJQRVLVRIÁDWHSLWKHOLDODW\SLD )($DWVWHUHRWDFWLFYDFXXPDVVLVWHGEUHDVWELRSV\9$%%ZLWKRXWUHVLGXDOPL FURFDOFLÀFDWLRQVFRXOGEHPDQDJHGZLWKPDPPRJUDSKLFIROORZXS)8LQVWHDGRI VXUJHU\DQGZKHWKHUEHWWHUUHVXOWVFRXOGEHDFKLHYHGZLWK*GHYLFHFRPSDUHG ZLWK* 0HWKRGVDQG0DWHULDOV9$%%SHUIRUPHGLQWZREUHDVWXQLWVLQWKHVDPHPHWUR SROLWDQDUHDZHUHUHYLHZHG)URP2FWREHUWR-DQXDU\)($ZHUH IRXQGLQFHQWUHZLWK*GHYLFHDQGLQFHQWUHZLWK*3DWLHQWVZHUHVXE JURXSHGLQWKRVHZLWKRXWJURXS $DQGZLWKJURXS%UHVLGXDOPLFURFDOFLÀFDWLRQV 7KHXQGHUHVWLPDWLRQVUDWH85RIPDOLJQDQF\IRUHDFKJURXSDQGWKHSURSRUWLRQ RIJURXS$SDWLHQWVZHUHFRPSDUHGEHWZHHQWKHWZRFHQWUHV 5HVXOWV7KH85RI)($ZDVZLWK*FHQWUHDQGZLWK *FHQWUH)RUSDWLHQWVFRQVLGHUHGDVDZKROHWKH85RIJURXS$ZDV WKH85IRUJURXS%ZDVS,QFHQWUHWKH85IRUJURXS $ZDVWKH85IRUJURXS%ZDV,QFHQWUHWKH85IRUJURXS $ZDVWKH85IRUJURXS%ZDVWKHSURSRUWLRQRISDWLHQWV LQJURXS$ZDVLQFHQWUHDQGLQFHQWUHS &RQFOXVLRQ:RPHQZLWK)($ZLWKRXWUHVLGXDOPLFURFDOFLÀFDWLRQVFRXOGEHPDQ DJHGZLWKPDPPRJUDSKLF)8*9$%%LVDVVRFLDWHGZLWKDORZHUSUHYDOHQFHRI UHVLGXDOPLFURFDOFLÀFDWLRQVFRPSDUHGWR* % $FFXUDF\RIPLQLPDOLQYDVLYHEUHDVWELRSV\LQDQLQFLSLHQWVFUHHQLQJ SURJUDPDQDO\VLVRIFRQVHFXWLYHSHUFXWDQHRXVLQWHUYHQWLRQV 6++H\ZDQJ.RHEUXQQHU-1DHKULJ++ÁHU$+DFNHU66HGODFHN 1+LQWHUPHLHU0XQLFK'(+(<:$1*.2(#DROFRP 3XUSRVH7 RFRXQWHUFKHFNFRUUHODWLRQRI339DQGWXPRXUVWDJHZLWKOHVLRQW\SH DQGELRSV\PHWKRGLQFRQVHFXWLYHPLQLPDOLQYDVLYHELRSVLHV 0HWKRGVDQG0DWHULDOV86JXLGHGFRUHQHHGOHELRSVLHV 86&1% VWHUHRWDFWLFFRUHVQHHGOHELRSVLHV 0;&1%VWHUHRWDFWLFYDFXXPDVVLVWHGEL RSLHV 0;9$%ZHUHSURVSHFWLYHO\GRFXPHQWHGLQDFRXQWU\ZLGHVFUHHQLQJ5,6 GDWDEDVH(YDOXDWLRQDIWHU\HDUVIROORZXSDQGFDQFHUUHJLVWU\PDWFKLQJ 5HVXOWV339FOHDUO\FRUUHODWHGZLWKOHVLRQW\SHIRUDUFKLWHFWXUDOGLVWRUWLRQ IRUPDVVZZRPLFURFDOFLÀFDWLRQVIRUPLFURFDOFLÀFDWLRQVRQO\ IRUIRFDODV\PPHWULHV7KH339ZDVKLJKHVWIRU86JXLGHG&1%IROORZHG E\0;JXLGHG&1%DQG9$%%7KHHDUOLHVWVWDJHVZHUHGHWHFWHGE\ 9$%%'&,67D7EIROORZHGE\0;&1%'&,6 7D7EDQGE\86&1%'&,67D7E &RQFOXVLRQ'LIIHUHQWOHVLRQVDUHH[DPLQHGE\WKHDYDLODEOHLPDJLQJPHWKRGV 'HWHFWLRQRIYHU\HDUO\PDOLJQDQF\LVDVVRFLDWHGZLWKDORZHU339:HWKDQNDOO LQWHUYHQWLRQDOLVWVIRUWKHLUFRRSHUDWLRQZLWKWKLVHYDOXDWLRQVXSSRUWHGE\(WKLFRQ 1RUGHUVWHGW % ,VLPDJHJXLGHGELRSV\DOZD\VQHFHVVDU\LQZRPHQXQGHU\HDUV ZLWKVROLGSDOSDEOHEUHDVWPDVVHV" $(&RUU'0'XNH1+DPEO\-'&XQQLQJKDP'XEOLQ,(DOLFRUU#UFVLLH 3XUSRVH7 RHYDOXDWHWKHQHHGIRUSHUFXWDQHRXVQHHGOHELRSV\LQZRPHQ\UV ZLWKV\PSWRPDWLFEUHDVWOHVLRQV 0HWKRGVDQG0DWHULDOV$FFRUGLQJWRRXUFXUUHQWSURWRFROVVROLGSDOSDEOHEUHDVW PDVVHV DUH ELRSVLHG XQGHU LPDJHJXLGDQFH LUUHVSHFWLYH RI SDWLHQW DJH :H UH YLHZHGDOOFRUHQHHGOHELRSVLHVRYHUDIRXU\HDUSHULRGLQDV\PSWRPDWLFEUHDVW VHUYLFHSDWLHQWV)0XQGHUZHQWLPDJHJXLGHGELRSV\LQWKLVSHULRG RIZKRPDOOIHPDOHZHUH\UVZHUHFDWHJRULVHG%,5$'6 DZHUHFDWHJRULVHG%,5$'6EDQGDERYH,PDJLQJSDWKRORJLFDO ÀQGLQJVDQGGHFLVLRQVIURPPXOWLGLVFLSOLQDU\PHHWLQJVZHUHH[DPLQHG 5HVXOWV $OOELRSVLHVZHUHSHUIRUPHGXQGHUXOWUDVRXQGJXLGDQFHZLWK*WUXFXW FRUHQHHGOHV&RVWVH[FOXGLQJPHGLFDOPDQKRXUVIRUDQXOWUDVRXQGJXLGHGEUHDVW ELRSV\LQRXULQVWLWXWLRQLV½ZLWKDIXUWKHU½IRUSDWKRORJLFDOSURFHVVLQJRI VSHFLPHQ3DWKRORJLFDOUHVXOWVRIWKHSDWLHQWVVFRUHGDV%,5$'6RUD \UV RI DJH LQFOXGHG ÀEURDGHQRPD RWKHU EHQLJQ ÀQGLQJV LQYDVLYHFDUFLQRPD'&,6,Q ÀQGLQJVVXJJHVWHGOLNHO\ÀEURDGHQRPDEXWFRXOGQRWH[FOXGHSK\OORGHV$OOXQ GHUZHQWVXUJLFDOH[FLVLRQZKHUHWKHÀQDOSDWKRORJ\GHPRQVWUDWHGÀEURDGHQRPD 3DWLHQWVZHUHVWUDWLÀHGDFFRUGLQJWRWKHÀQDOQRGDOVWDJLQJREWDLQHGE\D[LOODU\GLV VHFWLRQRUVHQWLQHOQRGHELRSV\KLVWRORJ\WXPRXUSKHQRW\SHDQGSURJQRVWLFIDFWRUV 5HVXOWV)1$&ZDVSRVLWLYHLQDQGVHQWLQHOQRGHELRSV\ZDVDYRLGHGLQDOO WKHVHFDVHV7KHSUHYDOHQFHRIO\PSKQRGHPHWDVWDVHVLQWKHVHULHVZDV 7KHVHQVLWLYLW\RI)1$&ZDVDQGWKHVSHFLÀFLW\ZDV7KHRGGVUDWLR ZDVDQGWKHSUHWHVWQHJDWLYHOLNHOLKRRGUDWLRZDV&, ,QWXPRXUVPPLQVL]HRUPPLQYROXPHRQO\RIFDVHVZHUH SRVLWLYH7ULSOHQHJDWLYHFDQFHUVKDGDKLJKSHUFHQWDJHRISRVLWLYHO\PSKQRGH UHJDUGOHVVRIWXPRXUVL]H &RQFOXVLRQ7KHVHQVLWLYLW\RI)1$&LVORZHUWKDQSUHYLRXVO\UHSRUWHG7ULSOHQHJD WLYHFDQFHUVKDGDKLJKSUHYDOHQFHRIO\PSKQRGHLPSDLUPHQWUHJDUGOHVVRIWXPRXU VL]H)1$&KDVORZVSHFLÀFLW\DQGFDQEHDYRLGHGZKHQWXPRXUVL]HPP RUWXPRXUYROXPHPPXQVSHFLÀFO\PSKQRGHVQRQWULSOHQHJDWLYHFDQFHU % 6WDJLQJWKHD[LOODZLWKXOWUDVRXQGDQGELRSV\PD[LPLVLQJ GLDJQRVWLF\LHOGZKLOVWPLQLPLVLQJXQQHFHVVDU\ELRSV\ .$7 D\ORU0*:DOOLV-)RUHPDQ3 '%ULWWRQ&DPEULGJH8. NDWKU\QWD\ORU#DGGHQEURRNHVQKVXN 3XUSRVH7KHXVHRIXOWUDVRXQGJXLGHGQHHGOHELRSV\RID[LOODU\O\PSKQRGHVLQ EUHDVWFDQFHUFDQDYRLGXQQHFHVVDU\VHQWLQHOO\PSKQRGHELRSV\LQQRGHSRVLWLYH SDWLHQWV:HZLVKHGWRHVWDEOLVKDSUDFWLFDOSURWRFROIRUD[LOODU\QRGHELRSV\LQD EXV\FOLQLFDOVHWWLQJWKDWPD[LPLVHGGLDJQRVWLF\LHOGZKLOVWPLQLPLVLQJXQQHFHV VDU\ELRSV\ 0HWKRGVDQG0DWHULDOV%DVHGXSRQDSUHYLRXVO\SXEOLVKHGVWXG\IURPWKLVLQ VWLWXWLRQWKHD[LOODU\QRGHELRSV\FULWHULDIRUSDWLHQWVZLWKVXVSHFWHGEUHDVWFDQFHU ZHUHGHWHUPLQHG$[LOODU\DQGEUHDVWFRUHELRSVLHV&%ZHUHSHUIRUPHGLQWKH VDPHFOLQLFVHVVLRQE\DQ\RQHRISUDFWLWLRQHUV7KLVSURWRFROZDVXQGHUWDNHQ WKURXJKRXWDQGLWVHIIHFWLYHQHVVHYDOXDWHG 5HVXOWVLQYDVLYHFDQFHUVSUHVHQWHGGXULQJWKHVWXG\SHULRGRIZKLFK ZHUHO\PSKQRGHSRVLWLYHDWVXUJLFDOKLVWRORJ\&%ZDVSHUIRUPHGLQ RISDWLHQWVRIPDOLJQDQWQRGHVZLWK76GLDPHWHU!RU PPZHUH PDOLJQDQWDW&%RIQRGHVZLWKDFRUWH[!RU PPZHUHPDOLJQDQWDW&% RIQRGHVZLWKDQDEVHQWKLOXPZHUHPDOLJQDQWDW&%DQGRIQRGHVZLWK DOREXODWHGFRUWH[ZHUHPDOLJQDQWDW&%2YHUDOOSUHRSHUDWLYHGLDJQRVLVRID[LOODU\ PHWDVWDVHVZDV &RQFOXVLRQ 7KH VXJJHVWHG ELRSV\ SURWRFRO FDQ EH VXFFHVVIXOO\ LPSOHPHQWHG LQWRDEXV\FOLQLFDOVHWWLQJXQGHUWDNHQE\DQXPEHURISUDFWLWLRQHUV$GRSWLRQRI VXFKDSURWRFROHQDEOHGRYHURISDWLHQWVZLWKO\PSKQRGHPHWDVWDVHVWREH GLDJQRVHGSUHRSHUDWLYHO\ZKLOVWPLQLPLVLQJWKHQXPEHURIXQQHFHVVDU\ELRSVLHV % 3UHRSHUDWLYHVWDJLQJRIWKHD[LOOD8.DXGLWRIVFUHHQGHWHFWHG EUHDVWFDQFHUDQG 0*:DOOLV 6&KHXQJ3 '%ULWWRQ2.HDULQV&DPEULGJH8. %LUPLQJKDP8.PDWWKHZZDOOLV#DGGHQEURRNHVQKVXN 3XUSRVH$[LOODU\QRGDOVWDWXVLVVWLOOWKHPRVWSRZHUIXOSUHGLFWRURIEUHDVWFDQFHU VXUYLYDO7KH LQWURGXFWLRQ RI VHQWLQHO O\PSK QRGH ELRSV\ KDV UHVXOWHG LQ UHSHDW RSHUDWLRQVIRUGHÀQLWLYHWUHDWPHQW:HUHSRUWWKHÀUVWQDWLRQDOO\EDVHGVFUHHQLQJ DXGLWRISUHRSHUDWLYHVWDJLQJZLWKXOWUDVRXQGDQGQHHGOHELRSV\ 0HWKRGVDQG0DWHULDOV'DWDRQD[LOODU\VWDJLQJZHUHÀUVWLQFOXGHGLQWKHDQ QXDO8QLWHG.LQJGRPDXGLWRIVFUHHQGHWHFWHGFDQFHUVLQDQGUHSHDWHG LQ6FRWODQGLVXQDEOHWRSURYLGHGDWDDQG:DOHVRQO\SURYLGHGGDWDIRU 5HVXOWV2IWKHVXUJLFDOO\WUHDWHGLQYDVLYHEUHDVWFDQFHUVZHUH QRGHSRVLWLYH,QWKHUHZDVDQD[LOODU\XOWUDVRXQGUHFRUGIRURILQYDVLYH FDQFHUVWKLVURVHWRLQ2IWKHDEQRUPDOXOWUDVRXQGUHFRUGV XQGHUZHQWD[LOODU\ELRSV\2IWKHQRGHSRVLWLYHSDWLHQWVZLWK DQXOWUDVRXQGUHFRUGZHUHFRUUHFWO\VWDJHGSUHRSHUDWLYHO\,Q RIZRPHQFRQÀUPHGWREHQRGHSRVLWLYHDWVXUJHU\ZHUHFRUUHFWO\VWDJHG SUHRSHUDWLYHO\DYRLGLQJDUHSHDWRSHUDWLRQULVLQJWRLQ,QWKH RULJLQDOGDWDIDOVHSRVLWLYHQHHGOHELRSVLHVZHUHUHSRUWHG,QGLYLGXDOUHFRUGV ZHUHDYDLODEOHIRUSDWLHQWV'DWDHQWU\HUURUVDFFRXQWHGIRUFDVHVZLWK WUXHIDOVHSRVLWLYHVF\WRORJ\DQGFRUHELRSV\ &RQFOXVLRQ 'DWD HQWU\ DQG FRPSOHWHQHVV KDYH LPSURYHG EXW UHTXLUH IXUWKHU LPSURYHPHQW2XUUDWHRIVXFFHVVIXOVWDJLQJLVHTXLYDOHQWWRSXEOLVKHGGDWDZKHQ WKHXQGHUO\LQJUDWHRIQRGHSRVLWLYLW\LVWDNHQLQWRDFFRXQW&DUHQHHGWREHWDNHQ LQLQWHUSUHWLQJF\WRORJ\IURPWKHD[LOOD 6FLHQWLILF6HVVLRQ 6 &$' ( ) *+% (XURSHDQ&RQJUHVVRI 5DGLRORJ\ % 6WHUHRWDFWLFDOO\JXLGHGYDFXXPDVVLVWHGEUHDVWELRSV\GLDJQRVWLF UHOLDELOLW\DQGFRPSOLFDWLRQUDWH 6.DSVLPDODNRX$:DOGPDQQ$.DWDOLQLF,*UDQGH1DJHO $.RYDFV3 +XQROG6+ROOPDQQ-%DUNKDXVHQ) 09RJW /XHEHFN'(6PDUDJGD.DSVLPDODNRX#XNVKGH 3XUSRVH7KHXVHRIODUJHFRUHVWHUHRWDFWLFDOO\JXLGHGYDFXXPDVVLVWHGELRSV\ 9$%KDVVKRZQPXOWLSOHDGYDQWDJHVRYHUFRUHQHHGOHELRSV\3XUSRVHRIWKLV VWXG\LVWRHYDOXDWHWKHDFFXUDF\DVZHOODVWKHFRPSOLFDWLRQVRI9$% 0HWKRGVDQG0DWHULDOV9$%VZHUHSHUIRUPHGRQSDWLHQWVZLWKPLFURFDOFLÀFD WLRQVGHWHFWHGRQPDPPRJUDPDQGUDWHGDVLQWHUPHGLDWHWRVXVSLFLRXV%,5$'6 ,9RUKLJKO\VXVSLFLRXV%,5$'699$%ZDVSHUIRUPHGDFFRUGLQJWRDVWULFW TXDOLW\DVVXUDQFHSURWRFRORQDGLJLWDOSURQHWDEOHXVLQJDQGJDXJHYDFXXP SUREHV 6SHFLPHQ UDGLRJUDSKV ZHUH REWDLQHG IRU WKH GHWHFWLRQ RI SUHVHQWDEOH PLFURFDOFLÀFDWLRQV 5HVXOWV,QZRPHQZLWKDPHDQDJHRI6'\HDUVZHLGHQWLÀHG LQYDVLYH FDUFLQRPDV GXFWDO FDUFLQRPDV LQ VLWX '&,6 DW\SLFDOGXFWDOK\SHUSODVLD$'+DQGOREXODUFDUFLQRPDLQVLWX $IWHUVXUJLFDOLQWHUYHQWLRQVWKHÀQDOUHVXOWQHHGHGDQXSJUDGLQJLQ SDWLHQWVIURP $'+WR'&,6DQGLQSDWLHQWVIURP'&,6WRLQYDVLYH FDUFLQRPD+RZHYHUSDWLHQWVZLWK'&,6DIWHU9$%KDGDEHQLJQGLDJQRVLVDIWHU VXUJHU\LQGLFDWLQJWKDW'&,6ZDVFRPSOHWHO\UHPRYHGE\9$%6LGHHIIHFWVVXFK DVEOHHGLQJRFFXUUHGLQSDWLHQWVZLWK*QHHGOH YHUVXVZLWK*QHHGOH &RQFOXVLRQ9$%LVDQHIIHFWLYHWRROIRUFODULÀFDWLRQRIGLJQLW\RIPLFURFDOFLÀFDWLRQV VHHQ RQ PDPPRJUDPV DQG SURYLGHV HDUO\ FDQFHU GHWHFWLRQ 6LGH HIIHFWV ZHUH VLJQLÀFDQWO\OHVVXVLQJ*QHHGOHIRU9$% % %OHHGLQJKDHPDWRPDDQGVFDUIRUPDWLRQDIWHUYDFXXPELRSV\XQGHU VWHUHRWDFWLFJXLGDQFH0DPPRWRPH5V\VWHP**YV$7(&5 V\VWHP** -1HHOVHQ-%LHUQDWK:XHSSLQJ3 -6FKDHIHU..URM%2UGHU0+HOOHU :-RQDW) .:6FKDHIHU.LHO'(MXOLDQHHOVHQ#\DKRRFRP 3XUSRVH 7 R HYDOXDWH WKH FRUUHODWLRQ RI VFDU IRUPDWLRQV DIWHU YDFXXPDVVLVWHG ELRSV\9$%ZLWKGLIIHUHQW9$%V\VWHPVDQGQHHGOHVL]HVDQGSHULLQWHUYHQWLRQDO EOHHGLQJKDHPDWRPD 0HWKRGVDQG0DWHULDOV%HWZHHQDQGSDWLHQWVXQGHUZHQW 9$%XQGHUVWHUHRWDFWLFJXLGDQFHXVLQJWKH0DPPRWRPH5V\VWHPZLWKJDXJH DQG$7(&5V\VWHPZLWKJDXJHZKHUHDVLQFDVHVZLWKUHSUHVHQWDWLYH EHQLJQKLVWRORJ\QRVXUJLFDOELRSV\DIWHU9$%ZDVSHUIRUPHGDQGDWOHDVWDSODQH IROORZXSPDPPRJUDP DIWHU PRQWK SRVW9$% ZDV DYDLODEOH %OHHGLQJ GXULQJ LQWHUYHQWLRQKDHPDWRPDSRVWLQWHUYHQWLRQDQGVFDUWLVVXHZDVVFRUHGDVPLQLPDO DQGPRGHUDWHVHYHUH6WDWLVWLFDODQDO\VLVLQFOXGHG&KLVTXDUHWUHQGWHVWSYDOXH ZDVFRQVLGHUHGWREHVLJQLÀFDQW 5HVXOWV 6LJQLÀFDQWO\ PRUH VPDOOPRGHUDWH EOHHGLQJVSRVWLQWHUYHQWLRQDO KDH PDWRPDVIRUJDXJH0DPPRWRPH5V\VWHPYVJDXJH0DPPRWRPH5V\VWHP YV S S QR VLJQLÀFDQWGLIIHUHQFHV IRU WKH$7(& V\VWHPV YV S S JDXJH0DPPRWRPH5V\VWHP YV$7(&5JDXJHV\VWHP UHYHDOHG VLJQLÀFDQWO\ OHVV EOHHGLQJVKDHPDWRPDV YVS S QRVLJQLÀFDQWGLIIHUHQFHVIRUWKHODUJHV\VWHPV S S )ROORZXSRI0DPPRWRPH5JDXJHV\VWHPV\VWHPKDV VKRZQ PLQLPDO VFDU IRUPDWLRQ DQG PRGHUDWHVHYHUH VFDUVZKHUHDV$7(&5JDXJHV\VWHPKDVVKRZQPLQLPDOVFDU IRUPDWLRQ DQG PRGHUDWHVHYHUH VFDUV QR VLJQLÀFDQW GLIIHUHQFHV 1R VLJQLÀFDQWGLIIHUHQFHFRPSDULQJ0DPPRWRPH5JV\VWHPVYV$7(&5 JV\VWHPVS S &RQFOXVLRQ8VLQJODUJHUQHHGOHVL]HVVLJQLÀFDQWO\0DPPRWRPH5QRWVLJQLÀFDQW IRU$7(&5PRUHEOHHGLQJVDQGSRVWLQWHUYHQWLRQDOKDHPDWRPDVZHUHGHWHFWHG RQO\DWHQGHQF\FRQFHUQLQJVFDUIRUPDWLRQ RQO\XQGHUZHQWVXUJLFDOH[FLVLRQSRVWELRSV\DVDUHVXOWRISDWLHQW RUVXUJLFDOSUHIHUHQFHZLWKDOOOHVLRQVEHQLJQRQH[FLVLRQ7KHQHJDWLYHSUHGLFWLYH YDOXHRIXOWUDVRXQGDVVHVVPHQWDQG%,5$'6FDWHJRULVDWLRQRIV\PSWRPDWLFEUHDVW OHVLRQVLQDSRSXODWLRQXQGHU\UVRIDJHZDV &RQFOXVLRQ,QH[SHULHQFHGKDQGV86FRPELQHGZLWK%,5$'6VFRULQJRISDOSDEOH EUHDVWOHVLRQVVDIHO\SUHGLFWVZRPHQ\UVQRWUHTXLULQJSHUFXWDQHRXVELRSV\ ZLWKVLJQLÀFDQWÀQDQFLDOVDYLQJV % ,QFLGHQFHRIFDQFHULQFRQVHFXWLYHQHJDWLYHFRUHQHHGOHEUHDVW ELRSV\FDVHVVXEPLWWHGWRVXUJHU\ 507ULPEROL (*RPERV'6LSSR,)HUQDQGH]65D]D0LODQ,7 %RVWRQ0$86WULPEROLUP#JPDLOFRP 3XUSRVH7 RHYDOXDWHWKHLQFLGHQFHRIFDQFHULQFRQVHFXWLYHQHJDWLYHFRUHQHHGOH EUHDVWELRSV\FDVHVVXEPLWWHGWRVXUJHU\ 0HWKRGV DQG 0DWHULDOV :H UHYLHZHG FRQVHFXWLYH SDWLHQWV ZLWK QHJDWLYH FRUHQHHGOHELRSVLHVSHUIRUPHGXQGHUVWHUHRWDFWLFPDPPRJUDSKLFRUXOWUDVRXQG JXLGDQFHWKDWXQGHUZHQWVXEVHTXHQWVXUJHU\GXULQJDSHULRGEHWZHHQ-DQXDU\ DQG 0DUFK ,QGLFDWLRQV IRU VXUJHU\ ZHUH KLJKULVNERUGHUOLQH SDWKRORJLF UHVXOW +5 UDGLRORJLFSDWKRORJLF GLVFRUGDQFH 53' SDWKRORJLVWҋV UHFRPPHQGDWLRQ35ÀEURHSLWKHOLDOOHVLRQ)(/RUSDWLHQWҋVSUHIHUHQFH33 7KHLQFLGHQFHRIFDQFHULQWKHSDWKRORJ\RIVXUJLFDOH[FLVLRQVZDVFDOFXODWHGIRU HDFKJURXSDQGRYHUDOO&KLVTXDUHWHVWZDVXVHGWRFRPSDUHJURXSVZLWKDQG ZLWKRXWFDQFHUDWH[FLVLRQ 5HVXOWV )LQDO SDWKRORJLF DVVHVVPHQW UHYHDOHG DQ RYHUDOO LQFLGHQFH RI PDOLJQDQF\,QSDUWLFXODUWKHUHZHUHFDQFHUVLQWKH+5JURXS LQ WKH 53' JURXS LQ WKH 35 JURXS LQ WKH )(/ JURXSDQGLQWKH33JURXS6LJQLÀFDQWGLIIHUHQFHZDVIRXQGEHWZHHQ +5 53' 35 JURXSV FDQFHU LQFLGHQFH DQG )(/ DQG 33 JURXSV FDQFHULQFLGHQFHS &RQFOXVLRQ $QRQQHJOLJLEOHFDQFHULQFLGHQFHZDVIRXQGDPRQJQHJDWLYH FRUHQHHGOHELRSVLHVVXEPLWWHGIRUVXUJHU\6XEJURXSDQDO\VLVRILQGLFDWLRQVIRU VXUJHU\ VKRZHG WKDW WKH FDQFHU LQFLGHQFH ZDV QXOO IRU WKH SDWLHQWҋV SUHIHUHQFH DQGÀEURHSLWKHOLDOOHVLRQVJURXSVDQGPRGHUDWHIRUWKHKLJKULVNOHVLRQ UDGLRORJLFSDWKRORJLFGLVFRUGDQFHDQGSDWKRORJLVWUHFRPPHQGDWLRQJURXSV7KHUH IRUHWKHVHODWWHUWKUHHLQGLFDWLRQVVKRXOGSURPSWVXUJLFDOH[FLVLRQ % 86JXLGHG*FRUHQHHGOHELRSV\RIEUHDVWPDVVHVFDWHJRULVHG DV%,5$'6DQGFDQWKHUDGLRORJLVWSUHGLFWWKHDGHTXDF\RI WLVVXHVDPSOLQJ" 9/RQGHUR('L*DHWDQR&=XLDQL**UD]LDQL&'L/RUHWR0%D]]RFFKL 8GLQH,7ORQGHURYLYLDQD#DRXGVDQLWDIYJLW 3XUSRVH7 RLQYHVWLJDWHZKHWKHUUDGLRORJLVWFDQSUHGLFWWKHҊSUREDEO\GLDJQRVWLFҋ FRUHVDPSOHRQWKHEDVLVRIJURVVDSSHDUDQFHZKHQSHUIRUPLQJ86JXLGHGJ FRUHQHHGOHELRSV\86&1% 0HWKRGVDQG0DWHULDOV,QDSURVSHFWLYHVWXG\FRQVHFXWLYH86&1%VZHUH SHUIRUPHGRQ%,5$'6FDWHJRU\DQGEUHDVWPDVVHVLQZRPHQ$PHDQ RIÀYHFRUHVDPSOHVSHUOHVLRQUDQJHZHUHREWDLQHGDQGWKHÀUVWVSHFLPHQ VKRZLQJGHQVHPDWHULDOZDVSUHGLFWHGWREHGLDJQRVWLFDQGZDVDQDO\VHGVHSD UDWHO\7KLVZDVFRPSDUHGZLWKWKHÀQDOKLVWRORJLFDOGLDJQRVLV3RVLWLYHSUHGLFWLYH YDOXHV339VRIWKHҊSUREDEO\GLDJQRVWLFҋFRUHVDPSOHZHUHFDOFXODWHG 5HVXOWV'LDJQRVWLFPDWHULDOUHSUHVHQWDWLYHRIWKHOHVLRQZDVREWDLQHGZLWKWKH GHQVHVSHFLPHQVLQRIWKHOHVLRQV339VRIGHQVHFRUHVDPSOHV ZDVFRQÀGHQFHLQWHUYDO>&,@IRU% &,IRU%&,IRU%DQG &,IRU%OHVLRQV7KHUHPDLQLQJVSHFLPHQVFRQWDLQLQJ GHQVHEXWQRQGLDJQRVWLFPDWHULDOVKRZHGIRFDOÀEURVLVDQGKDGPLVVHGWKHOHVLRQV RIEHQLJQRI%DQGRIPDOLJQDQWOHVLRQVRI%OHVLRQV DQGRIPDOLJQDQWOHVLRQVZHUHGLDJQRVHGRQO\LQWKHGHQVHVSHFLPHQ &RQFOXVLRQ$WWKHWLPHRI86&1%VRIEUHDVWPDVVHVWKHJURVVDSSHDUDQFHRI FRUHVSHFLPHQVKHOSHGXVSUHGLFWWKHDGHTXDF\RIWLVVXHVDPSOLQJGHWHUPLQH WKHQXPEHURIFRUHVDPSOHVQHHGHGIRUDUHOLDEOHGLDJQRVLV 6FLHQWLILF6HVVLRQ $ 6&'()*+%(XURSHDQ&RQJUHVVRI 5DGLRORJ\ 6XQGD\ % &RPSDULVRQRIWKHXOWUDVRXQGÀQGLQJVRIELRSV\SURYHQWXEHUFXORXV O\PSKDGHQLWLVDQG.LNXFKLGLVHDVH ..LP6L6XK.6RQ< /HH+6HR+6HRO6HRXO.5 UXGDOV #KDQPDLOQHW 3XUSRVH7KHSXUSRVHRIWKLVVWXG\ZDVWRDQDO\VHWKHVRQRJUDSKLFIHDWXUHVWKDW FDQFRQWULEXWHLQGLIIHUHQWLDWLQJEHWZHHQWXEHUFXORXVO\PSKDGHQLWLVDQG.LNXFKL GLVHDVH 0HWKRGVDQG0DWHULDOV6RQRJUDSKLFÀQGLQJVRISDWLHQWVZLWKELRSV\SURYHQ WXEHUFXORXVO\PSKDGHQRSDWK\DQGSDWLHQWVZLWKELRSV\SURYHQ.LNXFKLGLV HDVHZHUHUHYLHZHG/\PSKQRGHVZHUHDVVHVVHGE\WKHLUVL]HVKDSHVKRUWHVW ORQJHVW D[LV UDWLR ORFDWLRQ HFKRJHQLFLW\ SUHVHQFH RI FRQJORPHUDWLRQ JURVV QHFURVLVFDOFLÀFDWLRQHFKRJHQLFQRGDOKLOXPLQFUHDVHGSHULQRGDOHFKRJHQLFLW\ DQGYDVFXODUSDWWHUQ 5HVXOWV7KHPHDQGLDPHWHURIWKHO\PSKQRGHVZDVFPIRUWXEHUFXORXVO\P SKDGHQLWLVDQGFPIRU.LNXFKLGLVHDVH0RVWWXEHUFXORXVO\PSKQRGHVZHUH ORFDWHGLQOHYHOV,,DQG9PRVW.LNXFKLGLVHDVHO\PSKQRGHVLQOHYHOV,9DQG9 3DWLHQWVZLWKWXEHUFXORXVO\PSKDGHQLWLV PDQLIHVWHGJURVVQHFURVLVLQ FDVHVDQGSDWLHQWVZLWK.LNXFKLGLVHDVHLQFDVHVO\PSKQRGHV VKRZHGFDOFLÀFDWLRQLQSDWLHQWVZLWKWXEHUFXORXVO\PSKDGHQLWLVDQGQRQHVKRZHG FDOFLÀFDWLRQ LQ SDWLHQWV ZLWK .LNXFKL GLVHDVH ,QFUHDVHG SHULQRGDO HFKRJHQLFLW\ ZDVVHHQLQRIWKHWXEHUFXORXVO\PSKQRGHVDQGRIWKH.LNXFKLO\PSK QRGHV&RQJORPHUDWLRQRIO\PSKQRGHVZDVVHHQLQRIWKHWXEHUFXORXV O\PSKDGHQLWLVFDVHVDQGRIWKH.LNXFKLGLVHDVHFDVHV2QSRZHU'RSSOHU VWXG\ QRUPDO KLODU YDVFXODULW\ ZDV VHHQ LQ RI WKH WXEHUFXORXV O\PSK QRGHVDQGRIWKH.LNXFKLO\PSKQRGHV &RQFOXVLRQ *URVV QHFURVLV FRQJORPHUDWLRQ DQG QRUPDO KLODU YDVFXODULW\ RQ SRZHU 'RSSOHU VWXG\ VKRZHG D VLJQLÀFDQW GLIIHUHQFH EHWZHHQ WKHWXEHUFXORXV O\PSKDGHQLWLVDQG.LNXFKLGLVHDVHJURXSVS % 7XEHUFXORVLV.LNXFKL &3DUN-+DQ6-R< <RXQ&KHRQDQ.5SDUNVDPI#KDQPDLOQHW 3XUSRVH7 RDVVHVVWKHGLIIHUHQWLDOLPDJLQJÀQGLQJVRIQHFURWLVLQJO\PSKDGHQLWLV LQ WXEHUFXORXV O\PSKDGHQLWLV DQG .LNXFKL GLVHDVH RQ QHFN &7 WR IDFLOLWDWH WKH GLDJQRVLVWKHGLVHDVHVZLWKRXWSHUIRUPLQJDELRSV\ 0HWKRGV DQG 0DWHULDOV :H UHWURVSHFWLYHO\ DQDO\VHG SDWLHQWV ZRPHQ PHQPHDQDJH\HDUVZLWK.LNXFKLGLVHDVHJURXS,DQGSDWLHQWV ZRPHQ PHQ PHDQ DJH \HDUV ZLWK WXEHUFXORXV O\PSKDGHQLWLV JURXS ,,SHUIRUPLQJQHFN&7IURP6HSWHPEHUWR'HFHPEHU:HHYDOXDWHG VH[DJHQRGDOLQYROYHPHQWVLWHVELODWHUDOLW\IHDWXUHVDQGVL]HRIQHFURWLFO\PSK QRGHVIDWLQÀOWUDWLRQQRGDOGLVWULEXWLRQ:%&DQG(65LQDOOSDWLHQWVDQGDQDO\VHG VWDWLVWLFDOO\WKHGLIIHUHQWLDWLRQVRIWKHLPDJLQJÀQGLQJVDQGEORRGIDFWRUVEHWZHHQ WKHWZRJURXSVXVLQJLQGHSHQGHQW6DPSOHV7WHVWIRUFRQWLQXRXVSDUDPHWHUVDQG &KLVTXDUHDQG0F1HPHUWHVWVIRUFDWHJRULFDOSDUDPHWHUV 5HVXOWV /\PSKDGHQRSDWKLHV RI JURXSL ZHUH PRUH FRPPRQ LQ OHYHOV ,, ,,, 9 FRPSDUHGZLWKWKRVHRIJURXS,,ZHUHPRUHFRPPRQLQ OHYHO,97KHLQFLGHQFHVRIIDWLQÀOWUDWLRQDURXQGO\PSKQRGHOHX NRF\WRSHQLDLQFUHDVHG(65RIJURXSLZHUHKLJKHUWKDQWKRVH RIJURXS,,7KHLQFLGHQFHRILUUHJXODUWKLFNQHFURWLFO\PSKQRGHRI JURXSLZDVKLJKHUWKDQWKDWRIJURXS,,EXWWKHLQFLGHQFHRIUHJXODU WKLQQHFURWLFO\PSKQRGHRIJURXS,,ZDVKLJKHUWKDQWKDWRIJURXSL &RQFOXVLRQ1RGDOLQYROYHPHQWVLWHIDWLQÀOWUDWLRQQHFURWLFQRGDOIHDWXUH:%& DQG(65DUHXVHIXOLQWKHGLIIHUHQWLDWLRQEHWZHHQ.LNXFKLGLVHDVHDQGWXEHUFXORXV O\PSKDGHQLWLV % 'XDOHQHUJ\&7GHULYHGLRGLQHFRQWHQWDQGLRGLQHRYHUOD\IRU FKDUDFWHULVDWLRQRIHQODUJHGFHUYLFDOO\PSKQRGHV $07 DZÀN 1($1RXU(OGLQ111DJXLE-.HUO$$$EGHO5D]HN 7 -9RJO0DQVRXUD(*)UDQNIXUW'(DKPBPBWDZÀN#KRWPDLOFRP 3XUSRVH 7 R HYDOXDWH ZKHWKHU GXDO HQHUJ\ &7 '(&7GHULYHG LRGLQH FRQWHQW DQGLRGLQHRYHUOD\FRXOGEHXVHGWRGLIIHUHQWLDWHEHWZHHQHQODUJHGPHWDVWDWLFDQG LQÁDPPDWRU\FHUYLFDOO\PSKQRGHV 0HWKRGVDQG0DWHULDOV(LJKWHHQSDWLHQWVZLWKHQODUJHGSDWKRORJLFDOO\SURYHG PHWDVWDWLFO\PSKQRGHVDQGSDWLHQWVZLWKHQODUJHGO\PSKQRGHVGUDLQLQJGHHS FHUYLFDO LQÁDPPDWLRQV XQGHUZHQW FRQWUDVWHQKDQFHG '(&7 2QO\ RQH HQODUJHG QRGHSHUSDWLHQWZDVLGHQWLÀHG'(VRIWZDUHZDVXVHGWRUHFRQVWUXFWLRGLQHRYHUOD\ LPDJHV,RGLQHFRQWHQWDQGRYHUOD\RIWKHSUHLGHQWLÀHGQRGHZDVFDOFXODWHGE\ PHDQVRIFLUFXODUUHJLRQVRILQWHUHVW,RGLQHFRQWHQWRIPXVFOHDQGLQWHUQDOMXJXODU 5RRP*+ +HDGDQG1HFN 66 /\PSKQRGHVDQGWHPSRUDOERQH 0RGHUDWRUV +3%XUPHLVWHU-HQD'( 65RELQVRQ9LHQQD$7 % 6KHDUZDYHHODVWRJUDSK\RIFHUYLFDOO\PSKQRGHVSUHOLPLQDU\ H[SHULHQFHIRUGHWHFWLRQRIPDOLJQDQF\ .66%KDWLD&7 RQJ&&KR< /HH(<XHQ-.:RQJ$7$KXMD 6KDWLQ+.GUNEKDWLD#FXKNHGXKN 3XUSRVH 6KHDU ZDYH HODVWRJUDSK\ 6:( LV D QRYHO WHFKQRORJ\ WKDW SHUPLWV UHDOWLPHGLVSOD\DQGTXDQWLWDWLYHHVWLPDWLRQRIVKHDUPRGXOXVHTXDWLQJWRWLVVXH VWLIIQHVV $VWXG\ZDVFRQGXFWHGWRHYDOXDWHLWVSRWHQWLDOIRUGLVFULPLQDWLRQEHWZHHQ PDOLJQDQWDQGEHQLJQFHUYLFDOO\PSKQRGHV 0HWKRGV DQG 0DWHULDOV 6:( ZDV SHUIRUPHG LQ FHUYLFDO O\PSK QRGHV XQGHUJRLQJ 86JXLGHG QHHGOH DVSLUDWLRQ IRU F\WRORJ\ LQ D URXWLQH XOWUDVRXQG FOLQLF6KHDUPRGXOXVLQGLFHVZHUHPHDVXUHGRQHODVWRJUDPVDQGFRUUHODWHGZLWK F\WRORJLFDOUHVXOW 5HVXOWV6KHDUPRGXOXVZLWKLQWKHVWLIIHVWPPGLDPHWHUFLUFXODUUHJLRQZLWKLQ QRGHVZDVKLJKHULQPDOLJQDQWQRGHVQ PHGLDQN3DLQWHUTXDUWLOHUDQJH N3DUDQJHN3DWKDQEHQLJQQRGHVQ PHGLDQN3D LQWHUTXDUWLOHUDQJHN3DUDQJHN3DS0DQQ:KLWQH\ 8 WHVW$FXWRIIRIN3D DWWDLQHG KLJKHVW DYHUDJH RIVHQVLWLYLW\ DQG VSHFLÀ FLW\ZLWKVHQVLWLYLW\VSHFLÀFLW\DQG$8&&, 4XDOLWDWLYHO\6:(HODVWRJUDPVRIEHQLJQQRGHVDSSHDUHGKRPRJHQHRXVZKHUHDV PDOLJQDQWQRGHVZHUHHLWKHUKRPRJHQHRXVRUPDUNHGO\KHWHURJHQHRXVLQFOXGLQJ DUHDVODFNLQJHODVWLFLW\VLJQDO7KLVVWXG\LVRQJRLQJDQGSUHVHQWHGGDWDZLOOEH XSGDWHG WR HYDOXDWH GLIIHUHQW PHWKRGV RI 6:( PHDVXUHPHQW ZLWKLQ QRGHV LQ FUHDVHGWRWDOVDPSOHVL]HH[FHHGLQJO\PSKQRGHVDQG6:(GDWDDFFRUGLQJ WRKLVWRORJLFDOVXEW\SH &RQFOXVLRQ6:(LVIHDVLEOHIRUFHUYLFDOQRGHVDOWKRXJKSUHOLPLQDU\GDWDVXJ JHVWLWRIIHUVRQO\PRGHVWGLVFULPLQDWLRQEHWZHHQPDOLJQDQWDQGEHQLJQQRGHV,W DSSHDUVXQVXLWDEOHIRUVFUHHQLQJRIQRGDOPDOLJQDQF\EXWPD\GHWHFWDVXEVHWRI PDOLJQDQWQRGHVZLWKKLJKVSHFLÀFLW\7KHFDXVHRIPDUNHGVSDWLDOKHWHURJHQHLW\ XVLQJ6:(LQVRPHPDOLJQDQWQRGHVLV\HWWREHGHWHUPLQHG % 3HUFXWDQHRXV86JXLGHGLQWHUVWLWLDOODVHUDEODWLRQRIPHWDVWDWLF O\PSKQRGHVLQWKHQHFNIURPSDSLOODU\WK\URLGFDUFLQRPDIROORZLQJ WK\URLGHFWRP\DQGO\PSKDGHQHFWRP\ *0DXUL /&RYD7 ,HUDFH7 7 RQGROR*/RPXVFLR$%DUROL &03DFHOOD/6ROELDWL0LODQ,7%XVWR$UVL]LR,7&RPR,75RPH,7 3XUSRVH :H UHSRUW RXU H[SHULHQFH ZLWK SHUFXWDQHRXV 86JXLGHG LQWHUVWLWLDO ODVHUDEODWLRQIRUPHWDFKURQRXVFHUYLFDOQRGDOPHWDVWDVHVIURPSDSLOODU\WK\URLG FDUFLQRPDIROORZLQJWRWDOWK\URLGHFWRP\DQGFHQWUDOODWHURFHUYLFDOO\PSKQRGH 0HWKRGV DQG 0DWHULDOV 7ZHQW\WKUHH PHWDFKURQRXV PHWDVWDWLF QRGHV PHDQ VL]HFPUDQJHFPLQSDWLHQWVZHUHWUHDWHG$QP1G<$* ODVHU(FKR/DVHU;(VDRWH*HQRD,WDO\ZDVXVHG$OOFDVHVZHUHQHJDWLYHDW ,ZKROHERG\VFDQEXWKDGSRVLWLYH))'*3(7DQGHOHYDWHGVHUXPOHYHOV RIWK\URJOREXOLQ8QGHUORFDODQDHVWKHVLDDPPTXDUW]ÀEHURSWLFJXLGHZDV SODFHGLQWRWKHQRGHWKURXJKD*QHHGOH1RGHVZHUHWUHDWHGZLWKRQHFDVHV RUWZRÀEUHLQVHUWLRQVHDFKRQHZLWK:SRZHUIRUVHFWRWDOHQHUJ\ MRXOHV$OOFDVHVZHUHIROORZHGDWDQGPRQWKVZLWK%PRGH86 &(86))'*3(7DQGDVVHVVPHQWRIVHUXPOHYHOVRI7J 5HVXOWV/DVHUDEODWLRQZDVWHFKQLFDOO\IHDVLEOHDQGZHOOWROHUDWHGLQDOOSDWLHQWV ZLWKQRHLWKHULPPHGLDWHRUODWHFRPSOLFDWLRQV,QQRGHVFRPSOHWH DEODWLRQODFNRIHQKDQFHPHQWDW&(86QHJDWLYH))'*3(7ZLWKQRUPDOLVD WLRQRI689DQG!GHFUHDVHRI7JVHUXPOHYHOVZDVDFKLHYHG,QFDVHV UHVLGXDOXSWDNHDW))'*3(7ZLWKDEQRUPDO689ZDVIRXQGDQGODVHUDEODWLRQ ZDVUHSHDWHG &RQFOXVLRQ3HUFXWDQHRXV86JXLGHGLQWHUVWLWLDOODVHUDEODWLRQVHHPVWREHDQ HIIHFWLYHORZFRVWDQGVDIHWKHUDSHXWLFWRROIRUWKHWUHDWPHQWRIPHWDFKURQRXVQRGDO PHWDVWDVHVIURPSDSLOODU\WK\URLGFDUFLQRPDLQWKHQHFNZKLFKZRXOGRWKHUZLVH UHTXLUHRIWHQFKDOOHQJLQJIXUWKHUUHVHFWLRQV 6FLHQWLILF6HVVLRQ 6 &$' ( ) *+% (XURSHDQ&RQJUHVVRI 5DGLRORJ\ &RQFOXVLRQ&%&7DOORZVVWXG\LQJWKHWHPSRUDOERQHDQDWRP\LQPRUHGHWDLO 0RUHRYHUWKHVHQVLWLYLW\WRGHWHFWRWRVFOHURVLVDQGHVSHFLDOO\WKHVSHFLÀFLW\WRGHWHFW 66&'LVKLJKHUFRPSDUHGWR0'&7 7KHDYHUDJHUDGLDWLRQGRVHRIDQH[DPLQDWLRQ RIWKHWHPSRUDOERQHZLWK&%&7LVOHVVWKDQKDOIWKHGRVHRIDQH[DPLQDWLRQZLWK 0'&7 PDNLQJLWWKHWHFKQLTXHRIFKRLFH % 3UHYDOHQFHRIDQWHULRULQWHUQDODXGLWRU\FDQDO´GLYHUWLFXOXPµRQ&7 LQSDWLHQWVZLWKRWRVFOHURVLV 0&+RHEHULJV--:DWHUYDO5-6WRNURRV$$56WDGOHU0DDVWULFKW1/ FKULVWLDQQHKRHEH#JPDLOFRP 3XUSRVH,QSDWLHQWVZLWKRWRVFOHURVLVDQRWRVFOHURWLFK\SRGHQVHFDYLWDWLQJSODTXH DWWKHPHGLDOPDUJLQRIWKHRWLFFDSVXOHVHHQDVDQLQGHQWDWLRQRU´GLYHUWLFXOXPµRI WKHDQWHULRUPDUJLQRIWKHLQWHUQDODXGLWRU\FDQDO,$&PLJKWEHSUHVHQW:HDLPHG WRGHWHUPLQHWKHSUHYDOHQFHRIWKLVHDVLO\LGHQWLÀDEOHDQWHULRU,$&LQGHQWDWLRQRQ &7LQSDWLHQWVZLWKRWRVFOHURVLV 0HWKRGVDQG0DWHULDOVFRQVHFXWLYHKLJKUHVROXWLRQ&7VFDQVPP RIWKHPDVWRLGERQHLQSDWLHQWVZLWKFRQGXFWLYHRUPL[HGKHDULQJORVVIURP-DQXDU\ WR'HFHPEHUZHUHUHWURVSHFWLYHO\UHYLHZHGE\QHXURUDGLRORJLVWVDQG (17VXUJHRQ$WRWDORIHDUVZHUHVFRUHGIRUWKHSUHVHQFHDQGVHYHULW\RI RWRVFOHURVLVJUDGHGDFFRUGLQJWRWKH6\PRQV)DQQLQJFODVVLÀFDWLRQIHQHVWUDO SDWFK\SHULFRFKOHDUH[WHQVLYHSHULFRFKOHDUDQGIRUWKHSUHVHQFHRIDQWHULRU ,$&GLYHUWLFXOXPSODTXHGHÀQHGDVDQREYLRXVQRWFKLQWKHDQWHULRU,$&PDUJLQH LVRGHQVHWRWKH,$&LWVHOIDIDLQWFXUYDWXUHRIWKHZDOOZDVVFRUHGQHJDWLYH 5HVXOWV$QWHULRU ,$& GLYHUWLFXOXP ZDV REVHUYHG LQ HDUV ZLWK RQO\ IHQHVWUDORWRVFOHURVLVLQRIJUDGHSDWFK\FRFKOHDURWRVFOHURVLVDQG LQZLWKJUDGHRWRVFOHURVLV2QO\SDWLHQWZLWKRXW&7VLJQVRIRWR VFOHURVLVEXWZLWKFOLQLFDOVWDSHGLDOÀ[DWLRQGHPRQVWUDWHGELODWHUDO,$&K\SRGHQVLW\ HDUVRU &RQFOXVLRQ(YDOXDWLRQRIWKHDQWHULRU,$&PLJKWDLGLQWKHGHWHFWLRQRIQRWRQO\ FRFKOHDUEXWDOVRLQWKHPRUHVXEWOHIHQHVWUDORWRVFOHURVLV % ,PSURYHGLQYLYRYLVXDOLVDWLRQDQGHYDOXDWLRQRIHQGRO\PSKDWLF K\GURSVXVLQJKLJKÀHOG05,LQ0HQLHUҋVGLVHDVHDQGFRUUHODWLRQ ZLWKDXGLRYHVWLEXODUIXQFWLRQ :+)ODW]5*XHUNRY%%(UWO:DJQHU2'LHWULFK0) 5HLVHU 0XQLFK'(ZLOKHOPÁDW]#PHGXQLPXHQFKHQGH 3XUSRVH 7 R LPSURYH GHWHFWLRQ DQG HYDOXDWLRQ RI HQGRO\PSKDWLF K\GURSV LQ 0HQLHUHҋV GLVHDVH LQ YLYR XVLQJ 05, DQG WR GHWHUPLQH ZKHWKHU WKH GHJUHH RI HQGRO\PSKDWLFK\GURSVDVLWLVGHWHFWHGLQYLYRLQSDWLHQWVZLWKGHÀQLWH0HQLHUHҋV GLVHDVHFRUUHODWHVZLWKDXGLRYHVWLEXODUIXQFWLRQV 0HWKRGVDQG0DWHULDOVSDWLHQWVVXIIHULQJIURPFOLQLFDOV\PSWRPVRI0HQLHUHҋV GLVHDVHDFFRUGLQJWR$$2+16FULWHULDZHUHH[DPLQHGLQDSURVSHFWLYHVWXG\'L OXWHGJDGROLQLXPZDVDGPLQLVWHUHGLQWUDW\PSDQLFDOO\KRXUVSULRUWRWKH05VFDQ 05,ZDVSHUIRUPHGXVLQJD7VFDQQHUXVLQJDGHGLFDWHGFKDQQHOVXUIDFHFRLO DQGDKHDGFRLODFTXLULQJD')/$,5VHTXHQFHD',576(VHTXHQFHDQGD KLJKUHVROXWLRQ7UXH),63GXDOH[FLWDWLRQVHTXHQFH&,66&RUUHODWLRQZLWKFOLQLFDO V\PSWRPVDQGDXGLRYHVWLEXODUIXQFWLRQWHVWLQJZDVSHUIRUPHGXVLQJDXGLRPHWULF KHDULQJWHVWVFDORULFVWLPXODWLRQHOHFWURFRFKOHRJUDSK\(&RFK*DQGYHVWLEXODU HYRNHGP\RJHQLFSRWHQWLDOV9(03 5HVXOWV7KHUHZDVDVLJQLÀFDQWFRUUHODWLRQEHWZHHQWKHGHJUHHRIK\GURSVRQ WKHRQHKDQGDQGWKHDYHUDJHGKHDULQJOHYHODWDQGN+]DQGWKH YHVWLEXODUHYRNHGP\RJHQLFSRWHQWLDOLQWHUDXUDODPSOLWXGHUDWLRRQWKHRWKHUKDQG $WUHQGWRZDUGVDFRUUHODWLRQZDVQRWLFHGEHWZHHQWKHK\GURSVDQGWKHFDORULF UHVSRQVHQRFRUUHODWLRQZDVQRWLFHGEHWZHHQWKHK\GURSVDQGWKH63$3UDWLR 7KHGHJUHHRIHQGRO\PSKDWLFK\GURSVFRUUHODWHVZLWKDSURJUHVVLYHORVVRIDXGLWRU\ DQGVDFFXOXVIXQFWLRQLQSDWLHQWVZLWK0HQLHUHCVGLVHDVH &RQFOXVLRQ 7KH GHJUHH RI HQGRO\PSKDWLF K\GURSV LQ SDWLHQWV ZLWK GHÀQLWH 0HQLHUHҋVGLVHDVHDVLWLVGHWHFWHGE\LQYLYR05,LPDJLQJFRUUHODWHVZLWKDORVV RIDXGLRYHVWLEXODUIXQFWLRQ7KLVXQGHUOLQHVWKHXVHIXOQHVVRIWKLVWHFKQLTXHLQWKH HYDOXDWLRQRI0HQLHUHҋVGLVHDVH YHLQZHUHDOVRREWDLQHGDVFRQWURO,RGLQHFRQWHQWDQGRYHUO\RIPHWDVWDWLFDQG LQÁDPPDWRU\O\PSKQRGHVZHUHFRPSDUHG5HFHLYHURSHUDWRUFKDUDFWHULVWLF52& FXUYHZDVXVHGWRGHWHUPLQHVHQVLWLYLW\DQGVSHFLÀFLW\RILRGLQHFRQWHQWDQGLRGLQH RYHUOD\IRUGLDJQRVLVRIPHWDVWDWLFQRGHV 5HVXOWV,RGLQHFRQWHQWZDVVLJQLÀFDQWO\ORZHUIRUPHWDVWDWLFWKDQ LQÁDPPDWRU\O\PSKQRGHVS,RGLQHRYHUOD\ZDVDOVRVLJ QLÀFDQWO\ORZHUIRUPHWDVWDWLFWKDQLQÁDPPDWRU\QRGHVS1RVLJQLÀFDQW GLIIHUHQFHVZHUHREVHUYHGEHWZHHQLRGLQHFRQWHQWIRUPXVFOHDQGLQWHUQDOMXJXODU YHLQRIERWKJURXSVS DQG52&FXUYHRILRGLQHFRQWHQWKDGODUJHU DUHDXQGHUWKHFXUYHWKDQWKDWRILRGLQHRYHUOD\GHQRWLQJKLJKHU GLDJQRVWLF DFFXUDF\ LQ GLDJQRVLV RI QRGDO PHWDVWDVHV 2SWLPDO WKUHVKROG YDOXH IRULRGLQHFRQWHQWWRGLDJQRVHQRGDOPHWDVWDVHVKDGVHQVLWLYLW\DQG VSHFLÀFLW\ &RQFOXVLRQ'(&7GHULYHGLRGLQHFRQWHQWDQGRYHUOD\PLJKWKHOSLQFKDUDFWHULVD WLRQRIHQODUJHGFHUYLFDOO\PSKQRGHV % )LUVWH[SHULHQFHZLWKWULH[SRQHQWLDODQDO\VLVRI':,VLJQDO DWWHQXDWLRQLQQRUPDOFHUYLFDOO\PSKQRGHVIHDVLELOLW\VWXG\ 05DYDQHOOL')DULQD(%RWWXUL$0DUFRQL90D]]D50DUROGL%UHVFLD,7 PDUFRUDYDQHOOL#KRWPDLOLW 3XUSRVH%LH[SRQHQWLDOPRGHO,9,0SRVWXODWHVWZRGLVWLQFWFRPSRQHQWVLQÁX HQFLQJWKH':,VLJQDODWWHQXDWLRQDYHU\VORZGLIIXVLRQDQGDIDVWFRPSRQHQW EYDOXHVVPPUHODWHGWRDUWHULDOSHUIXVLRQ:KHQ':,GDWDVHWLVDFTXLUHG ZLWKEYDOXHV!VPPWKHDFFXUDF\RIWKHELH[SRQHQWLDOPRGHOGHFUHDVHV $WKLUGFRPSRQHQWSUREDEO\UHODWHGWRVORZÁRZVFRXOGH[SODLQPRGHOLQDFFXUDF\ 7KHVWXG\SXUSRVHLVWRDVVHVVWKHIHDVLELOLW\RIWULH[SRQHQWLDODQDO\VLVRI':, VLJQDOGHFD\LQFHUYLFDOO\PSKQRGHV 0HWKRGVDQG0DWHULDOV)RXUKHDOWK\YROXQWHHUVKDGWKHQHFNH[DPLQHGE\7 05XVLQJ(3,':,VHTXHQFHVZLWKEYDOXHVVPP7KH':,VLJQDO DWWHQXDWLRQRIFHUYLFDOO\PSKQRGHVZDVDQDO\VHGE\PRQRH[SRQHQWLDO$'& ELH[SRQHQWLDO ,9,0 DQG WKH K\SRWKHVLVHG WULH[SRQHQWLDO PRGHO 7KLV PRGHO H[WUDFWV WKUHH SDUDPHWHUV IDVWSHUIXVLRQIUDFWLRQ IIDVW VORZSHUIXVLRQIUDFWLRQ IVORZ DQG VORZSVHXGRGLIIXVLRQFRHIÀFLHQW ' VORZ$OO WKUHH DQDO\VHV ZHUH SHUIRUPHGRQVPPDQGVPPLQWHUYDOVPRQRDQGELH[SRQHQWLDO DQDO\VHVZHUHDOVRSHUIRUPHGRQVPPLQWHUYDO $FFXUDF\RIÀWWLQJZDV PHDVXUHGE\5FRHIÀFLHQW 5HVXOWV7KHELH[SRQHQWLDOPRGHOÀWWHGVPP':,VLJQDOVEHWWHUWKDQ WKHPRQRH[SRQHQWLDOPRGHO5YV,QWKHVPPLQWHUYDOWKH WULH[SRQHQWLDODQDO\VLVZDVVXSHULRUWRELH[SRQHQWLDO5YV7UL H[SRQHQWLDOSDUDPHWHUVLQWKLVLQWHUYDOZHUHIIDVWIVORZ ' VORZ[PPV7KHSHUIXVLRQIUDFWLRQH[WUDFWHGE\ ELH[SRQHQWLDOPRGHOLQWKHVPPLQWHUYDOIDQGIVORZ VKRZHGKLJKSRVLWLYHFRUUHODWLRQU &RQFOXVLRQ7ULH[SRQHQWLDODQDO\VLVRIO\PSKQRGHV':,VLJQDOVLVIHDVLEOHDQG DFFXUDWH XVLQJ YHU\ KLJK EYDOXHV ,W FRXOG SURYLGH QHZ SDUDPHWHUV SUREDEO\ OLQNHGWRYHQXODUDQGO\PSKDWLFÁRZSRWHQWLDOO\YDOXDEOHLQWKHFKDUDFWHULVDWLRQRI WKHWLVVXHVPLFURVWUXFWXUHDQGIXQFWLRQDOLW\ % &RPSDUDWLYHVWXG\RI0'&7DQG&%&7RIWKHWHPSRUDOERQH DQDWRP\RWRVFOHURVLVVXSHULRUVHPLFLUFXODUFDQDOGHKLVFHQFHHDUO\ H[SHULHQFHDQGSUHOLPLQDU\UHVXOWV '9ROGHUV 13HWHUV%'H)RHU.%DFKHU-:&DVVHOPDQ%UXJHV%( $QWZHUS%(*HQW%(GDYLGYROGHUV#D]VLQWMDQEH 3XUSRVH0XOWLGHWHFWRU&70'&7LVWKHFXUUHQWVWDQGDUGIRUUDGLRORJLFH[DPLQD WLRQRIWKHWHPSRUDOERQH7KLVVWXG\ZDQWHGWRYHULI\WKHQRQLQIHULRULW\RUVXSHULRULW\ RIFRQHEHDP&7&%&7RYHU0'&7LQWKHWHPSRUDOERQHIRUGHWHFWLQJDQDWRPL FDOVWUXFWXUHVRWRVFOHURVLVDQGVXSHULRUVHPLFLUFXODUFDQDOGHKLVFHQFH66&' 0HWKRGVDQG0DWHULDOV3DWLHQWVSDWLHQWVHQUROPHQWLQSURJUHVVLQWKUHH FHQWUHVZHUHSURVSHFWLYHO\VWXGLHGDIWHULQIRUPHGFRQVHQWDQGHWKLFDOFRPPLWWHH DSSURYDO%RWK&%&7DQG0'&7 ZLWKDVSDWLDOUHVROXWLRQRIUHVSHFWLYHO\ DQG PP ZHUH SHUIRUPHG LQ HYHU\ SDWLHQW 7ZR UHDGHUV VFRUHG VPDOO DQDWRPLFDOVWUXFWXUHVVFRUHRWRVFOHURVLVVWDJHVFRUHDQG66&'VFRUH LQDEOLQGHGUDQGRPLVHGPDQQHU 5HVXOWV3UHOLPLQDU\UHVXOWVVKRZHGWKDW&%&7KDVDQRYHUDOOVXSHULRULW\IRUWKH YLVXDOLVDWLRQRIHYHU\DQDWRPLFDOVWUXFWXUHLQWKHD[LDODQGFRURQDOSODQHRIWKHWHP SRUDOERQHPRVWVLJQLÀFDQWLQWKHFRURQDOSODQH&%&7FRUUHFWHGDIDOVHQHJDWLYH GLDJQRVHRI0'&7IRURWRVFOHURVLVLQRXWRIFDVHVDQGDIDOVHSRVLWLYH GLDJQRVHRI0'&7IRU66&'LQRXWRIFDVHV7KHDYHUDJHUDGLDWLRQ GRVH&7',YRORI&%&7DQG0'&7ZDVUHVSHFWLYHO\P*\DQGP*\ 6FLHQWLILF6HVVLRQ $ 6&'()*+%(XURSHDQ&RQJUHVVRI 5DGLRORJ\ 6XQGD\ % &RPSDULVRQRIFRQWUDVWHQKDQFHG86WRURZPXOWLGHWHFWRU&7 DQG05ZLWK*G%237$LQWKHGHSLFWLRQRIGLDJQRVWLFYDVFXODULW\ SDWWHUQLQKHSDWRFHOOXODUFDUFLQRPDQRGXOHVFPLQGLDPHWHU (4XDLD/'H3DROL63XOYLUHQWL%&DELEER0&RYD7ULHVWH,7 TXDLD#XQLWVLW 3XUSRVH7 RDVVHVVFRQWUDVWHQKDQFHG86&(86LQWKHGHSLFWLRQRIWKHKHSD WRFHOOXODUFDUFLQRPD+&&GLDJQRVWLFYDVFXODULW\SDWWHUQK\SHUYDVFXODULW\GXULQJ DUWHULDOSKDVHIROORZHGE\K\SRYDVFXODULW\GXULQJSRUWDOYHQRXVODWHSKDVHLQVPDOO +&&QRGXOHVFPLQFRPSDULVRQWRFRQWUDVWHQKDQFHGURZPXOWLGHWHFWRU &7DQG05LPDJLQJZLWK*G%237$ 0HWKRGVDQG0DWHULDOV2QHKXQGUHGDQGWZHQW\FLUUKRWLFSDWLHQWVPDOHV IHPDOHV PHDQ DJH6' \HDUV ZLWK VPDOO +&&V ZHUH LQFOXGHG (DFKQRGXOHZDVVFDQQHGE\&(86DIWHUVXOSKXUKH[DÁXRULGHÀOOHGPLFUREXEEOH PXOWLSKDVH FRQWUDVWHQKDQFHG URZ PXOWLGHWHFWRU &7 DQG FRQWUDVWHQKDQFHG 05LPDJLQJDIWHU*G%237$LQMHFWLRQGD\VIURP&(86DQG&71RGXOH YDVFXODULW\DW&(86&7 DQG05LPDJLQJZDVHYDOXDWHGVLGHE\VLGHE\LQGH SHQGHQWEOLQGHGUHDGHUV 5HVXOWV&(86YV&7GLGQRWGLIIHULQWKHGHSLFWLRQRIK\SHUYDVFXODULW\IROORZHG E\K\SRYDVFXODULW\UHDGHUYV&(86 YV&7 YV QRGXOHV3!:LOFR[RQWHVWZLWKKLJKLQWHUUHDGHUDJUHHPHQWNVWDWLVWLFV IRU&(86DQGIRU&7ZKLOH05LPDJLQJUHYHDOHGWKLVSDWWHUQLQQRGXOHV IRUERWKUHDGHUV32WKHUYDVFXODULW\SDWWHUQVLQFOXGHGK\SHUYDVFXODULW\ IROORZHGE\LVRYDVFXODULW\UHDGHUYV&(86 YV&7 YV 05 QRGXOHV IRU ERWK UHDGHUV LVRYDVFXODULW\IROORZHG E\ K\SRYDVFXODULW\UHDGHUYV&(86 YV&7 YV 05 QRGXOHV DQG SHUVLVWHQW K\SRYDVFXODULW\ &(86 &7 DQG05 QRGXOHVIRUERWKUHDGHUV &RQFOXVLRQ&(86GLGQRWGLIIHUIURPPXOWLSKDVHFRQWUDVWHQKDQFHGURZPXOWL GHWHFWRU&7LQWKHGHSLFWLRQRIGLDJQRVWLFYDVFXODULW\SDWWHUQLQVPDOO+&&VZKLOH 05LPDJLQJZLWK*G%237$UHYHDOHGWKLVSDWWHUQLQDQKLJKHUQXPEHURIQRGXOHV % 6SHFWUDO&7RIK\SHUYDVFXODUOLYHUOHVLRQVLQSDWLHQWVZLWK+&& LQYHVWLJDWLRQRILPDJHTXDOLW\DQGVHQVLWLYLW\ 3 /Y ;/LQ.&KHQ-*DR< 6KHQ=KHQJ]KRX&16KDQJKDL&1 %HLMLQJ&1 3XUSRVH7 RLQYHVWLJDWHPRQRFKURPDWLFLPDJLQJIURPVSHFWUDO&7RIK\SHUYDVFXODU OLYHUOHVLRQVLQSDWLHQWVZLWK+&& 0HWKRGVDQG0DWHULDOV7ZHQW\WKUHHSDWLHQWVZLWKVPDOOKHSDWRFHOOXODUFDUFLQR PDVXQGHUZHQW6SHFWUDO&7VFDQQLQJGXULQJWKHODWHDUWHULDOSKDVH$3DQGSRUWDO YHQRXVSKDVH33%RWKFRQYHQWLRQDON9SSRO\FKURPDWLFLPDJHVSURWRFRO $ DQGDVHWRIPRQRFKURPDWLFLPDJHVZLWKHQHUJ\OHYHOUDQJLQJIURPNH9WRNH9 ZLWKNH9LQFUHPHQWVSURWRFRO%ZHUHUHFRQVWUXFWHG,PDJHQRLVHIRUQRUPDO OLYHURUWLVVXHZDVPHDVXUHGDQGWKHFRQWUDVWWRQRLVHUDWLR&15IRUWXPRXUVZDV FDOFXODWHGIRUERWKSURWRFROV7KHKLJKHVW&15DQGWKHORZHVWLPDJHQRLVHZHUH FKRVHQIURPSURWRFRO%DQGFRPSDUHGZLWKSURWRFRO $ZLWK6WXGHQWWWHVW6366 5HVXOWV 7KH KLJKHVW &15 IURP PRQRFKURPDWLF LPDJHV GLVWULEXWHG DW NH9 NH9DQGNH9HQHUJ\OHYHOVIRU$3DQGNH9 DQGNH9IRU33 7KH&15YDOXHVIURPWKHRSWLPDOPRQRFKUR PDWLFLPDJHVIRU $3DQG33ZHUHVLJQLÀFDQWO\KLJKHUWKDQ WKRVHIURPWKHSURWRFRO$DQGIRU$3DQG33 UHVSHFWLYHO\ S,QDGGLWLRQWKHORZHVWLPDJHQRLVHVLQWKHSURWRFRO%GXULQJWKHWZR SKDVHVRFFXUUHGDWNH9$3"33ORZHUWKDQWKRVHLQSURWRFRO $ &RQFOXVLRQ 7KH RSWLPDO PRQRFKURPDWLF HQHUJ\ OHYHO RI VSHFWUDO LPDJLQJ FDQ LQFUHDVH WKH VHQVLWLYLW\ LQ GHWHFWLQJ K\SHUYDVFXODU OLYHU OHVLRQV ZLWKRXW LPDJH TXDOLW\ORVV % +&&ZDVKRXWDWFRQWUDVWHQKDQFHGXOWUDVRQRJUDSK\&(86 LVRHFKRJHQLFLW\RUK\SRHFKRJHQLFLW\"$FRPSDULVRQZLWK0'&7 3 5L]]DUGL05DYDQHOOL/6RWWRFRUQROD$*LDUGLQL50DUROGL3 &DEDVVD %UHVFLD,7MDP #YLUJLOLRLW 3XUSRVH7 RFRPSDUHWKHSDWWHUQRIHQKDQFHPHQWRI+&&DW&(86DQG0'&7 IRFXVLQJRQWKH&(86ZDVKRXWIHDWXUHV 0HWKRGVDQG0DWHULDOV2QHKXQGUHGDQGWZHQW\WKUHHSDWLHQWVDIIHFWHGE\+&& XQGHUZHQW&(86DQGVXEVHTXHQW0'&7ZLWKLQPRQWK7KH+&&GLDJQRVLVZDV EDVHGRQKLVWRORJ\LQSDWLHQWVVXUJHU\ELRSV\RQLPDJLQJLQ SDWLHQWV,QWKHFDVHRIPXOWLIRFDOGLVHDVHRQHWDUJHWOHVLRQIRUHDFKSDWLHQW ZDVHYDOXDWHG&(86ZDVSHUIRUPHGXVLQJ6RQRYXH%UDFFR,PDJLQJ0LODQR % 0LGGOHHDUFKROHVWHDWRPDFRPSDUHGGLDJQRVWLFYDOXHVRI LQFUHPHQWDO05,SURWRFROVLQFOXGLQJQRQHFKRSODQDUGLIIXVLRQ ZHLJKWHGLPDJLQJSHUIRUPHGRQ7DQG7VFDQQHUV -/LQFRW 65LHKP1%DED\-) 0DWHUQ10H\HU) 9HLOORQ3DULV)5 6WUDVERXUJ)5MXOLHQOLQFRW#JPDLOFRP 3XUSRVH7 RHYDOXDWHGLDJQRVWLFYDOXHVRILQFUHPHQWDO05,SURWRFROVSHUIRUPHG RQ7DQG7VFDQQHUV 0HWKRGVDQG0DWHULDOV5HWURVSHFWLYHVWXG\FRQGXFWHGRQDFRKRUWRISDWLHQWV VXVSHFWHGZLWKDFTXLUHGRUUHVLGXDOUHFXUUHQWFKROHVWHDWRPD$OOSDWLHQWVXQGHU ZHQW7DQG7QRQ(3':,DQGSDWLHQWVKDGDGGLWLRQDOXQHQKDQFHG 7GHOD\HGJDGROLQLXPHQKDQFHG7DQGKLJKUHVROXWLRQ7ZHLJKWHGVWDQGDUG DFTXLVLWLRQV2QWKHEDVLVRILQLWLDOFOLQLFDODQGLPDJLQJÀQGLQJVSDWLHQWVZKHWKHU EHQHÀWHGIURPW\PSDQRSODVW\RUIURPDVWULFWRWRVFRSLFVXUYH\,PDJLQJVXUJLFDO DQGIROORZXSÀQGLQJVFRQFOXGHGWRDWRWDORIPLGGOHHDUOHVLRQVLQFOXGLQJ FKROHVWHDWRPDV)RUHDFKFDVHUDGLRORJLVWVUHYLHZHGLQFUHPHQWDO05,SURWR FROVGLIIHULQJRQWKHPDJQHWLFÀHOGRIWKH':,DFTXLVLWLRQVLQWHUSUHWHG7 7 77DQGFRPSULVLQJWKHWKUHHQRQ':RUGDLQHGVWDQGDUGVHTXHQFHV $WHDFK VWHSGLDJQRVWLFSHUIRUPDQFHVZHUHH[SUHVVHGDVVHQVLELOLW\VSHFLÀFLW\SRVLWLYH DQGQHJDWLYHSUHGLFWLYHYDOXHVDQGDFFXUDF\8QLYDULDWHDQGPXOWLYDULDWHDQDO\VHV DVVHVVHG UHDGHU VHTXHQFH DGGLQJ DQG PDJQHWLF ÀHOG HIIHFW XSRQGLDJQRVWLF SHUIRUPDQFHV &KROHVWHDWRPDVҋ$'& YDOXHV DQG ':, VLJQDOV ZHUH FRPSDUHG DFFRUGLQJWRPDJQHWLFÀHOGXVLQJSDLUHGWDQGELQRPLDOWHVWV 5HVXOWV8QLYDULDWHDQGPXOWLYDULDWHDQDO\VHVFRQFOXGHGWRQRVLJQLÀFDQWUHDGHU RU VHTXHQFH DGGLQJ HIIHFW RYHU GLDJQRVWLF SHUIRUPDQFHV REWDLQHG E\ QRQ(3 ':,DORQH8QLYDULDWHDQDO\VLVVKRZHGQRVLJQLÀFDQWPDJQHWLFÀHOGHIIHFWHLWKHU &KROHVWHDWRPDVҋ $'&YDOXHVDQG':,VLJQDOVGLGQRWGLIIHUVLJQLÀFDQWO\DFFRUGLQJ WRPDJQHWLFÀHOG &RQFOXVLRQ,Q7DQG705,DVHOIVXIÀFLHQWQRQ(3':,SURWRFROFRXOG EHHPSOR\HGIRUFKROHVWHDWRPDGLDJQRVLV7KLVQHHGVWREHFRQÀUPHGE\IXUWKHU VWXGLHVRYHUDZLGHUDQGOHVVKHWHURJHQHRXVFRKRUW 5RRP,. $EGRPLQDO9LVFHUD 66E +&&GLDJQRVLV 0RGHUDWRUV &$\XVR%DUFHORQD(6 $)XUODQ3LWWVEXUJK3$86 % +\SHUYDVFXODUKHSDWRFHOOXODUFDUFLQRPDVKRZLQJK\SHULQWHQVLW\RQ JDGR[HWLFDFLGHQKDQFHG05LPDJLQJDOHVVPDOLJQDQWVXEW\SHZLWK ORZSURGXFWLRQRI$)3DQG3,9.$,, $.LWDR20DWVXL1<RQHGD..R]DND6.RED\DVKL:.RGD7 *DEDWD < 1DNDQXPD6.DQHNR.DQD]DZD-3D]XVD#PHGNDQD]DZDXDFMS 3XUSRVH7 RDQDO\VHWKHFRUUHODWLRQEHWZHHQWXPRXUPDUNHUVSURGXFWLRQKLVWR ORJLFDOIHDWXUHVDQGVLJQDOLQWHQVLW\RQWKHKHSDWRELOLDU\SKDVHRIJDGR[HWLFDFLG HQKDQFHG05LPDJLQJLQKHSDWRFHOOXODUFDUFLQRPDV+&&V 0HWKRGVDQG0DWHULDOV6XUJLFDOO\UHVHFWHGRUELRSV\GLDJQRVHGK\SHUYDV FXODU+&&VZHUHFODVVLÀHGDVK\SRLQWHQVH+&&VQ RUK\SHULQWHQVH+&&V Q FRPSDUHGWRWKHEDFNJURXQGOLYHURQWKHKHSDWRELOLDU\SKDVHRIJDGR[HWLF DFLGHQKDQFHG05LPDJLQJ:HDQDO\VHGWKHDOSKDIHWRSURWHLQ$)3DQGSURWHLQ LQGXFHG E\ YLWDPLQ . DEVHQFH RU DQWDJRQLVW,, 3,9.$,, SURGXFWLRQ E\ VHUXP DQDO\VLVDQGLPPXQRKLVWRFKHPLFDOVWDLQLQJWKHQFRPSDUHGEHWZHHQK\SRLQWHQVH +&&VDQGK\SHULQWHQVH+&&V:HDOVRDQDO\VHGWKHSDWKRORJLFDOIHDWXUHVVXFK DVPDFURJURZWKSDWWHUQGLIIHUHQWLDWLRQJUDGHYHVVHOLQYDVLRQDQGLQWUDKHSDWLF PHWDVWDVLV6WDWLVWLFDODQDO\VHVZHUHSHUIRUPHGLQHDFKUHVXOW 5HVXOWV7KHVHUXPOHYHOVRIWXPRXUPDUNHUVZHUHORZHULQK\SHULQWHQVH+&&VWKDQ LQK\SRLQWHQVH+&&V7KHDYHUDJHYDOXHRI$)3ZDVQJPOWRQJPO 3 $)3/IUDFWLRQWR3 DQG3,9.$,,P$8PO WRP$8PO3 7KHLPPXQRKLVWRFKHPLFDO$)3DQG3,9.$,,H[SUHV VLRQVZHUHDOVRGHFUHDVHGLQK\SHULQWHQVH+&&VFRPSDUHGWRWKDWRIK\SRLQWHQVH +&&V3DQG3 3DWKRORJLFDOO\WKHJUDGHRIGLIIHUHQWLDWLRQZDV KLJKHU3 DQGWKHSRUWDOYHLQLQYDVLRQZDVIHZHULQK\SHULQWHQVH+&&V WKDQLQK\SRLQWHQVH+&&VYV3 &RQFOXVLRQ7KHWXPRXUPDUNHUVSURGXFWLRQZDVUHSUHVVHGLQK\SHULQWHQVH+&&V RQJDGR[HWLFDFLGHQKDQFHG05LPDJLQJZLWKKLJKJUDGHRIGLIIHUHQWLDWLRQDQGIHZ SRUWDOYHLQLQYDVLRQV,WLQGLFDWHGWKDWK\SHULQWHQVH+&&VZRXOGEHFODVVLÀHGLQWR DOHVVPDOLJQDQWVXEW\SHWKDQWKDWRIK\SRLQWHQVH+&&V 6FLHQWLILF6HVVLRQ 6 &$' ( ) *+% (XURSHDQ&RQJUHVVRI 5DGLRORJ\ 5HVXOWV+&&VKRZHGDVLJQLÀFDQWKLJKHUIUHTXHQF\DOOSRID7K\SRLQ WHQVLW\YVE7K\SHULQWHQVLW\YVFSUHVHQFHRI IDW YV G VDWHOOLWHOHVLRQV YV H ODFN RI DUWHULDO HQKDQFHPHQWYVIFRQWUDVWPHGLDZDVKRXWLQWKHHTXLOLEULXPSKDVH YV DV FRPSDUHG WR ERWK +$ DQG )1+ 6LJQLÀFDQW SUHGLFWRUV IRU GLDJQRVLVRI+&&5RGGVUDWLRSZHUH7K\SRLQWHQVLW\5 SUHVHQFH RIVDWHOOLWHOHVLRQV5 DQGFRQWUDVWPHGLDZDVKRXW5 &RQFOXVLRQ 05LPDJLQJ FKDUDFWHULVWLFV LQ SULPDU\ QRQFLUUKRWLF OLYHU WXPRXUV VKRZVLJQLÀFDQWGLIIHUHQFHV,QGHSHQGHQWSDUDPHWHUVIRUGLDJQRVLVRI+&&DUH 7K\SRLQWHQVLW\SUHVHQFHRIVDWHOOLWHOHVLRQVDQGFRQWUDVWPHGLDZDVKRXWZKLFK PLJKWKHOSWRGLIIHUWKLVHQWLWLHVLQWKHIXWXUH % &RPSDULVRQRISURVSHFWLYHO\WULJJHUHG37)/$6+ZLWK UHWURVSHFWLYHO\VHOIJDWHG56*)/$6+VHTXHQFHVIRULPDJLQJRI H[SHULPHQWDOOLYHUWXPRXUVLQUDWVDW7 3 )ULHV.0DWWKHV$0XHOOHU*'HQGD$0DVVPDQQ -6SHUOLQJ*6FKQHLGHU$%XHFNHU56HLGHO +RPEXUJ'(GUSHWHUIULHV#JRRJOHPDLOFRP 3XUSRVH7 RFRPSDUHSURVSHFWLYHO\WULJJHUHG)/$6+37XVLQJUHVSLUDWRU\VLJ QDOVPRQLWRUHGE\DQH[WHUQDOSUHVVXUHWUDQVGXFHUZLWKUHWURVSHFWLYHO\VHOIJDWHG )/$6+56*VHTXHQFHVEDVHGRQDQDYLJDWRUWHFKQLTXH,QWUD*DWH%UXNHU *HUPDQ\IRUXQHQKDQFHGDQGFRQWUDVWHQKDQFHG7ZLPDJLQJRIH[SHULPHQWDO OLYHUWXPRXUVLQUDWVDW7 0HWKRGV DQG 0DWHULDOV UDWV :$*5LM ZLWK H[SHULPHQWDOO\ LQGXFHG KHSDWLF FRORQ FDQFHU PHWDVWDVHV ZHUH VXEMHFWHG WR 05, XVLQJ D 7 DQLPDO VFDQQHU %UXNHU%LR6SHF*HUPDQ\ZLWKDFKDQQHOYROXPHFRLO:HDFTXLUHGD3775 7()$ )29[FPPDWUL[ [DQGD56*757( )$ )29 [ FP PDWUL[ [ VOLFH WKLFNQHVV PP HDFK VHTXHQFH DW LGHQWLFDO SRVLWLRQV$IWHU LQWUDYHQRXV LQMHFWLRQ RI PPRONJ %: *G'73$ ZHSHUIRUPHGDQDOWHUQDWLQJDFTXLVLWLRQRIHLWKHUVHTXHQFHVDWIRXUFRQVHFXWLYH WLPHSRLQWVXSWRPLQDIWHULQMHFWLRQ615DQG&15ZHUHFDOFXODWHGEDVHG RQ52,PHDVXUHPHQWZLWKLQWKHWXPRXUDQGDGMDFHQWQRUPDOOLYHUWLVVXHIRUERWK VHTXHQFHV$:LOFR[RQPDWFKHGSDLUVVLJQHGUDQNWHVWDQGDSDLUHGWWHVWZHUH SHUIRUPHGIRUVWDWLVWLFDODQDO\VLVS 5HVXOWV1RVWDWLVWLFDOO\VLJQLÀFDQWGLIIHUHQFHVZHUHREWDLQHGEHWZHHQWKH37DQG WKH56*VHTXHQFHDIWHU&0LQMHFWLRQUHJDUGLQJ615WXPRXU56*PHDQ6' 37 S 615OLYHU56*37 S DQG WKH&157XOLYHU56*37 S &RQFOXVLRQ37DQG56*)/$6+VHTXHQFHVSURYLGHFRPSDUDEOH615DQG&15 RIQRUPDOOLYHUWLVVXHDQGH[SHULPHQWDOO\LQGXFHGOLYHUWXPRXUV%HLQJLQGHSHQG HQWRIH[WHUQDOWULJJHUGHYLFHVWKHUHWURVSHFWLYHO\VHOIJDWHGDSSURDFKPD\EHD IDYRXUDEOHDOWHUQDWLYHIRUDEGRPLQDOLPDJLQJLQVPDOOURGHQWV % 6LQJOHHQHUJ\ORZYROWDJHDUWHULDOSKDVHVFDQQLQJLQFUHDVHV FRQVSLFXLW\RIK\SHUYDVFXODUOHVLRQVRIWKHOLYHUDQLQWUDSDWLHQWVWXG\ *$=DPERQL0&$PEURVHWWL(=LYHORQJKL53R]]L0XFHOOL9HURQD,7 J]DPERQL#KRWPDLOFRP 3XUSRVH 7 R FRPSDUH LQWUDSDWLHQW D VLQJOHHQHUJ\ ORZYROWDJH DUWHULDOSKDVH SURWRFRODQGDNYSURWRFROIRUGHWHFWLQJK\SHUYDVFXODUIRFDOOLYHUOHVLRQVK)// 0HWKRGV DQG 0DWHULDOV SDWLHQWV ZLWK FKURQLF OLYHU GLVHDVH DQG K)// XQGHUZHQWDEGRPLQDO0'&7ZLWKN9DUWHULDOSKDVHWHVWJURXSRQDURZ VFDQQHU7KLVZDVFRPSDUHGWRDSUHYLRXVN9VFDQ7KHPHDQLQWHUVFDQLQWHUYDO ZDVGD\VOHVLRQVZHUHQRWWUHDWHGEHWZHHQH[DPV6FDQVZHUHFRPSDUHG IRUDWWHQXDWLRQDQGVWDQGDUGGHYLDWLRQLQWKHOLYHUDRUWDDQGODUJHVWK)//LPDJH QRLVH &15 &7', DQG '/3 SDLUHG WWHVW (IIHFWLYH GRVH ZDV FDOFXODWHG ZLWK 7/'PHDVXUHPHQWV 5HVXOWV $OOVFDQVZHUHRIGLDJQRVWLFTXDOLW\DFFRUGLQJWRWKHUHSRUWLQJUDGLRORJLVW 0HDQDWWHQXDWLRQZDVVLJQLÀFDQWO\KLJKHULQWKHWHVWJURXSWKDQLQWKHFRQWUROJURXS LQWKHDRUWDYV+8OLYHUYV+8 DQGK)//YV+8DOOS&7',DQG'/3ZHUH VLJQLÀFDQWO\ORZHULQWKHWHVWJURXSYVP*\DQGYV P*\[FPUHVSHFWLYHO\DOOS/HVLRQFRQVSLFXLW\+8QRGXOH +8OLYHUZDVVLJQLÀFDQWO\KLJKHULQWKHWHVWJURXSYV+8 S 0HDQLPDJHQRLVHZDVVLJQLÀFDQWO\KLJKHULQWKHWHVWJURXSWKDQLQ FRQWUROJURXSYV+8S/HVLRQ&15ZDVQRWVLJQLÀFDQWO\ GLIIHUHQWEHWZHHQWKHWZRSURWRFROV7/'HIIHFWLYHGRVHZDVVLJQLÀFDQWO\ORZHUIRU WKHWHVWSURWRFROYVP6YS ,WDO\7KHHFKRJHQLFLW\RI+&&FRPSDUHGWROLYHUSDUHQFK\PDZDVDVVHVVHGLQ WKUHHSKDVHVDUWHULDOVSRUWDOVDQGODWHV7KHUHVXOWVZHUH FRPSDUHGZLWKWKRVHIURPPXOWLSKDVLF0'&7DQGPDWFKHGZLWKK,VWRORJLFDOJUDGH ZKHQ DYDLODEOH 7\SLFDO SDWWHUQ 73 ZDV GHÀQHG DV DUWHULDO LSHUHFKRJHQLFLW\ GHQVLW\DVVRFLDWHGZLWKSRUWDODQGODWHLSRHFKRJHQLFLW\GHQVLW\ 5HVXOWV$W&(86RQO\RI+&&VKRZHGD73ZHUH LVRHFKRLFLQWKHSRUWDOSKDVHDQGRIWKHVHVKRZHGLVRHFKRJHQLFLW\DOVR LQWKHODWHSKDVH&RQYHUVHO\D73ZDVGHPRQVWUDWHGLQRI+&& DW 0'&7 0XOWLYDULDWH DQDO\VLV LQFOXGLQJ VHYHUDO QRGXOH DQG SDWLHQWUHODWHG FKDUDFWHULVWLFVVKRZHGWKDWRQO\K,VWRORJLFDOJUDGHLQÁXHQFHGYDVFXODULVDWLRQSDW WHUQDW&(86ZHOOGLIIHUHQWLDWHG+&&ZHUHPRUHOLNHO\WRVKRZDVORZRUDEVHQW ZDVKRXWDWV &RQFOXVLRQ+&&VKRZVGLIIHUHQWHQKDQFHPHQWSDWWHUQDW&(86DQG0'&7 7KH SUHVHQFHRILVRHFKRJHQLFLW\LQWKHSRUWDORUERWKSRUWDODQGODWHSKDVHLVSUHYDOHQW LQZHOOGLIIHUHQWLDWHGOHVLRQV)RUWKLVUHDVRQWKHDVVRFLDWLRQRI&(86WR0'&7 FRXOGSURYLGHDGMXQFWLYHLQIRUPDWLRQLQWKHFKDUDFWHULVDWLRQRIK\SHUYDVFXODU+&& QRGXOHV % '\QDPLF&7SHUIXVLRQWHFKQLTXHLQWKHHYDOXDWLRQRI QHRDQJLRJHQHVLVWXPRXUUHODWHGSKHQRPHQRQLQGLDJQRVLVDQG WUHDWPHQWRI+&&OHVLRQLQFLUUKRWLFSDWLHQWV ',SSROLWR3 %RQDIÀQL&&DSUDUR) 0HORQL5&RUVR66LURQL0RQ]D,7 GDYLGHDWHQD#WLVFDOLQHWLW 3XUSRVH7 RGHWHUPLQHWKHYDOXHRISHUIXVLRQFRPSXWHGWRPRJUDSK\&7SLQWKH TXDQWLWDWLYHDVVHVVPHQWRIWXPRXUUHODWHGQHRDQJLRJHQHVLVIRUWKHHYDOXDWLRQRI GLDJQRVLVDQGWUHDWPHQWRI+&&OHVLRQV 0HWKRGV DQG 0DWHULDOV$ WRWDO RI &7S VWXG\ ZHUH SHUIRUPHG LQ FLUUKRWLF SDWLHQWVE\DQDO\VLQJELRSV\SURYHQ+&&OHVLRQVDQG+&&WUHDWHGOHVLRQ ZLWK7$&(RU5)$'\QDPLFVWXG\ZDVSHUIRUPHGRQPXOWLGHWHFWRU&7%ULOOLDQFH 3KLOLSV1/E\DFTXLULQJG\QDPLFVOLFHVVFDQIRUDWRWDORIVFDQVDWÀ[HG WDEOHSRVLWLRQGXULQJLQMHFWLRQRIPORIQRQLRQLFFRQWUDVWDJHQWDWÁRZUDWHRI POVHF$GHGLFDWHGSHUIXVLRQVRIWZDUHZKLFKJHQHUDWHGDTXDQWLWDWLYHPDSRI DUWHULDODQGSRUWDOSHUIXVLRQE\PHDQVRIFRORXUVFDOHZDVHPSOR\HG7KHIROORZLQJ SHUIXVLRQSDUDPHWHUVIRUWKHZKROHOLYHUDQG+&&OHVLRQVZHUHFRQVLGHUHGKHSDWLF SHUIXVLRQ+3DUWHULDOSHUIXVLRQ$3EORRGYROXPH%9KHSDWLFSHUIXVLRQLQGH[ +3,DQGWLPHWRSHDN773 5HVXOWV,Q+&&VOHVLRQVHYDOXDWHGWKHIROORZLQJTXDQWLWDWLYHGDWDZHUHREWDLQHG +3POVHFJU%9POPJ$3POPLQ +3,773VHF7KHSHUIXVLRQYDOXHVFDOFXODWHGLQOHVLRQV FRUUHFWO\ WUHDWHG ZHUH +3 POVHF JU %9 PO PJ $3POPLQ+3,DQG773VHFZKLOHLQSDUWLDOO\ RULQFRPSOHWHO\WUHDWHGOHVLRQVZHUH+3POJUVHF%9POJU $3POPLQ773VHF+3, $VWDWLVWLFDO GLIIHUHQFHZDVREWDLQHGIRUDOOWKHSHUIXVLRQSDUDPHWHUVHYDOXDWHGZLWKDVLJQLÀFDQW ORZHUSYDOXHVLQFRUUHFWO\WUHDWHGOHVLRQRULQVXUURXQGLQJSDUHQFK\PD WKDQ LQ YLDEOH +&& WLVVXH LQ UHODWLRQ WR WKH SUHVHQFH RI DUWHULDO VWUXFWXUHV WKDW GHYHORSLQYLDEOHQHRSODVWLFWLVVXH &RQFOXVLRQ2XUUHVXOWVVXJJHVWWKDW&7SWHFKQLTXHFDQKHOSLQQRQLQYDVLYH TXDQWLÀFDWLRQRIWXPRXUEORRGVXSSO\UHODWHGWRWKHIRUPDWLRQRIQHZDUWHULDOVWUXF WXUHVQHRDQJLRJHQHVLVZKLFKDUHHVVHQWLDOIRUWXPRXUJURZWKDOORZLQJDOVRWKH DVVHVVPHQWRIWKHUDSHXWLFUHVSRQVH % &DQFRQWUDVWHQKDQFHG05,GLIIHUHQWLDWHPDOLJQDQWIURPEHQLJQ KHSDWRFHOOXODUWXPRXULQWKHQRQFLUUKRWLFOLYHU" 0$) )LVFKHU'$5DSWLV2) 'RQDWL6%UHLWHQVWHLQ3 $&ODYLHQ +$ONDGKL0$3DWDN=XULFK&+PLFKDHODOH[DQGHUÀVFKHU#XV]FK 3XUSRVH7 RUHWURVSHFWLYHO\HYDOXDWHZKHWKHU05LPDJLQJÀQGLQJVFDQEHXVHGWR GLIIHUHQWLDWHKHSDWRFHOOXODUFDUFLQRPD+&&IURPKHSDWRFHOOXODUDGHQRPD+$ DQGDW\SLFDOIRFDOQRGXODUK\SHUSODVLD)1+LQQRQFLUUKRWLFSDWLHQWV 0HWKRGVDQG0DWHULDO,QWRWDOFRQVHFXWLYHSDWLHQWVPHQ\HDUV ZKRXQGHUZHQWOLYHUUHVHFWLRQIRU+&&Q +$Q DQG)1+Q ZHUH LQFOXGHG LQ WKLV LQWHUQDWLRQDOPXOWLFHQWUH VWXG\ 3UHRSHUDWLYH OLYHU05, ZDV DQDO\VHG E\ WZR LQGHSHQGHQW UDGLRORJLVWV IRU WKH IROORZLQJ,PDJLQJ )LQGLQJV OHVLRQGLDPHWHU OHVLRQGHPDUFDWLRQ SUHVHQFH RI VDWHOOLWHOHVLRQV FHQWUDOVFDU OHVLRQFDSVXOHIDWKDHPRUUKDJHVLJQDOLQWHQVLW\6,RQXQHQKDQFHG7DQG7 ZHLJKWHGLPDJHVDUWHULDOHQKDQFHPHQWDQGFRQWUDVWPHGLDZDVKRXW'LIIHUHQFHV EHWZHHQERWKUHDGHUVZHUHUHVROYHGLQDFRQVHQVXVUHDGLQJDQGLQGHSHQGHQWGLDJ QRVWLFSDUDPHWHUVIRUGLDJQRVLVRI+&&ZHUHGHWHUPLQHGE\PXOWLYDULDQFHDQDO\VLV 6FLHQWLILF6HVVLRQ $ 6&'()*+%(XURSHDQ&RQJUHVVRI 5DGLRORJ\ 6XQGD\ 5RRP/0 &RQWUDVW0HGLD 66 6DIHW\DQGGLDJQRVWLFYDOXH 0RGHUDWRUV 5/DJDOOD3DOHUPR,7 <:1LHOVHQ&RSHQKDJHQ'. % 1HSKURJHQLFV\VWHPLFÀEURVLVDUHYLHZRISXEOLVKHGFDVHVDQG UHVXOWVIURPWKUHHSURVSHFWLYHREVHUYDWLRQDOVWXGLHV *3LURYDQR -0XQOH\&6FKXOW]-3DUNHU0$.LUFKLQ .4XLQFH$6SLQD]]L3ULQFHWRQ1-860LODQ,7 JLDQSDRORSLURYDQR#GLDJEUDFFRFRP 3XUSRVH 7 R DVVHVV WKH SURÀOH RI QHSKURJHQLF V\VWHPLF ÀEURVLV 16) LQWKH PHGLFDOOLWHUDWXUHDQGHYDOXDWHWKHLQFLGHQFHRI16)LQWKUHHSURVSHFWLYHVWXGLHV 0HWKRGVDQG0DWHULDOV)RUSXEOLVKHGSHHUUHYLHZHGFDVHVRI16) ZHUHFRUGHGFRXQWU\DJHJHQGHUUHQDOLPSDLUPHQWJDGROLQLXPEDVHGFRQWUDVW DJHQW*%&$H[SRVXUHW\SHGRVHGDWHRIRQVHWDQGWLPHIURP*%&$H[SRVXUH WRRQVHW,QWKUHHSURVSHFWLYHREVHUYDWLRQDOVWXGLHVZHDVVHVVHG16)LQFLGHQFH LQ&.'SDWLHQWVH[SRVHGWRJDGRWHULGRO*JDGREHQDWHGLPHJOXPLQH*'RU ZLWKRXWJDGROLQLXPH[SRVXUHIRU\HDUV3DWLHQWVZHUHVWUDWLÀHGLQWRFRKRUWV H*)5RIP/PLQP>&RKRUW@RUP/PLQP>&RKRUW@ DQGZHUHIROORZHGIRUXSWR\HDUV 5HVXOWV SXEOLVKHG 16) FDVHV IURP FRXQWULHV 1$PHULFD (X URSH ZHUHLGHQWLÀHGLQSDWLHQWV\UFDVHVUHSRUWHGUHQDOVWDWXV &'. FDVHV $5) FDVHV7KHVSHFLÀF*%&$VDGPLQLVWHUHGZDVNQRZQ LQFDVHVLQFOXGLQJXQFRQIRXQGHGFDVHVJDGRGLDPLGH JDGRSHQWHWDWH GLPHJOXPLQH JDGRYHUVHWDPLGH JDGREXWURO ([SRVXUHWRJDGRGLDPLGH RUJDGRSHQWHWDWHGLPHJOXPLQHRFFXUUHGLQDOOFRQIRXQGHGFDVHV,QDERXWRI FDVHVV\PSWRPVGHYHORSHGZLWKLQPRQWKVRIWKHODVW*%&$H[SRVXUH1RFDVH ZDVUHSRUWHGZLWKDQ16)RQVHWGDWHRIRUODWHU,QWKHSURVSHFWLYHVWXGLHV SDWLHQWV KDYH EHHQ HQUROOHG *' * FRQWURO $W OHDVW \U IROORZXSKDVEHHQFRPSOHWHGLQVXEMHFWVDQG\ULQ1R16)FDVHKDV EHHQLGHQWLÀHGWRGDWH &RQFOXVLRQ,PSURYHGVFUHHQLQJKDVDSSDUHQWO\KDOWHGQHZ16)FDVHV,QWKH SURVSHFWLYHVWXGLHVZLWKJDGREHQDWHGLPHJOXPLQHDQGJDGRWHULGROQR16)FDVH KDVEHHQUHSRUWHG % 3UHYDOHQFHRIQHSKURJHQLFV\VWHPLFÀEURVLVLQGLDO\VLVSDWLHQWVWKH 3UR),1(67VWXG\ 6$PHW *&KRXNURXQ9/DXQD\9DFKHU&)UDQFHV$7ULFRWHO %6WHQJHO*'HUD\2&OHPHQW3DULV)5$PLHQV)56DLQW'HQLV)5 9LOOHMXLI)5VDELQHDPHW#SVODSKSIU 3XUSRVH16)LVDFXWDQHRXVDQGV\VWHPLFGLVRUGHUFKDUDFWHULVHGE\ZLGHVSUHDG WLVVXH ÀEURVLV ,W KDV EHHQ VXJJHVWHG WKDW JDGROLQLXPEDVHG FRQWUDVW DJHQWV *%&$ PD\ EH UHVSRQVLEOH IRU 16) HVSHFLDOO\ LQ GLDO\VLV SDWLHQWV 7KH 3UR ),1(67VWXG\LVDQDWLRQDOSURVSHFWLYHVWXG\HQGRUVHGE\WKH)UHQFK'UXJ $JHQF\ $IVVDSVDQGWKH)UHQFK6RFLHWLHVRI1HSKURORJ\'HUPDWRORJ\DQG5DGLRORJ\ ,WDLPVDWGHWHUPLQLQJWKHSUHYDOHQFHRI16)DIWHUDPDJQHWLFUHVRQDQFHLPDJLQJ 05,H[DPLQDWLRQ*%&$LQGLDO\VLVSDWLHQWV 0HWKRGVDQG0DWHULDOV7KHVWXG\LVEDVHGRQDVHFWLRQSDWLHQWIRUP6HFWLRQ GHPRJUDSKLFVDQGGLDO\VLV6HFWLRQ05,H[DPLQDWLRQ6HFWLRQDQ\GHU PDWRORJLFDOHYHQW'()XUWKHULQYHVWLJDWLRQVDUHSODQQHGLQFDVHRI'(:KHQ D16)GLDJQRVLVLVFRQÀUPHGDQDQFLOODU\VWXG\LVWREHSHUIRUPHGZLWKUDQGRP VHOHFWLRQRISDWLHQWVVDPHJHQGHUGLDO\VLVWHFKQLTXHFHQWUHDQGZLWKRXWDQ\ '(DIWHU05,ZLWKWKHVDPH*%&$LILQMHFWHG 5HVXOWV6LQFHSDWLHQWVKDYHEHHQLQFOXGHGFHQWUHVPHDQ DJH\HDUVPDOHVIRUPVUHFHLYHGUHFHLYHG*%&$DPRQJ ZKRPUHFHLYHG*DGRWHUDWH7ZHQW\SDWLHQWVUHSRUWHGD'('HUPDWRORJLFDO GLDJQRVHVGLGQRWUHSRUWDQ\HYLGHQFHRI16) &RQFOXVLRQ6RIDUWKXVQRFDVHRI16)KDVEHHQUHSRUWHGLQGLDO\VLVSDWLHQWV DPRQJZKRPWKHPDMRULW\UHFHLYHGD*%&$0RVWSDWLHQWVUHFHLYHGDPDFURF\FOLF JDGROLQLXPFKHODWHIRUZKLFKQRXQFRQIRXQGHGFDVHRI16)KDVEHHQREVHUYHG\HW ZRUOGZLGH*DGRWHUDWH)LQDOUHVXOWVZLOOEHDYDLODEOHDWWKHWLPHRIWKHFRQJUHVV &RQFOXVLRQ 7KH XVH RI D N9S DUWHULDO SKDVH SURWRFRO IRU DEGRPLQDO &7 LQFUHDVHV FRQVSLFXLW\ RI K)// SRVVLEO\ LPSURYLQJ LGHQWLÀFDWLRQ ZKLOH DOORZLQJ VLJQLÀFDQWGRVHUHGXFWLRQ % $FFXUDF\RIGLIIHUHQWLDWLQJKHSDWRFHOOXODUFDUFLQRPD+&&IURP G\VSODVWLFQRGXOH'1DWJDGREHQDWHGLPHJOXPLQHHQKDQFHG KHSDWRELOLDU\SKDVH*G%237$PDJQHWLFUHVRQDQFHLPDJLQJ $*DWWR $0'H*DHWDQR0*LXJD/6LFLOLDQL/5LFFDUGL ) 3L]]RODQWH) 09HFFKLR03RPSLOL/%RQRPR5RPH,73DYLD,7 3XUSRVH7 RLQYHVWLJDWHZKHWKHU*G%237$HQKDQFHGKHSDWRELOLDU\SKDVH05, FRXOGSUHGLFWWKHKLVWRORJLFJUDGHRI+&&DQGG\VSODVWLFQRGXOH'1LQSDWLHQWV ZLWKFLUUKRVLV 0HWKRGVDQG0DWHULDOV:HUHWURVSHFWLYHO\HYDOXDWHG05,RISDWLHQWVZLWK +&&VZHOOGLIIHUHQWLDWHGPRGHUDWHO\GLIIHUHQWLDWHGDQG'1VORZJUDGH KLJKJUDGHDOOKLVWRSDWKRORJLFDOO\SURYHG057Z'*5(LPDJHVZHUHDFTXLUHG EHIRUHVVVPLQDIWHUEROXVLQMHFWLRQRI*G%237$PPRONJ(DFK OHVLRQZDVGHÀQHGDVLVRK\SRK\SHULQWHQVHFRPSDUHGZLWKWKHVXUURXQGLQJOLYHU SDUHQFK\PD RQ WKH '3, GHOD\HGSKDVHLPDJLQJ7KH WXPRXUOLYHUFRQWUDVWWR QRLVHUDWLR&15RIHDFKOHVLRQRQWKH'3,ZDVFDOFXODWHGTXDQWLWDWLYHDQDO\VLV 5HVXOWV+&&QRGXOHVZHUHK\SRLQWHQVHLQDJUHDWHUSHUFHQWDJHWKDQ'1V +&&DQG'1VZHUHK\SRLQWHQVH+&&ZHOOGLIIHUHQWLDWHGDQG'1V KLJKJUDGHORZJUDGHZHUHLVRLQWHQVH7KHUHZDVDVLJQLÀFDQWVLJQDOLQWHQVLW\ GLIIHUHQFHEHWZHHQ+&&VDQG'1VRQWKH'3,PHDQ&15RIDQG UHVSHFWLYHO\S EHWZHHQORZJUDGHDQGKLJKJUDGH'1VPHDQ &15RIDQGUHVSHFWLYHO\S DQGEHWZHHQORZJUDGH '1VDQG+&&S 7KHUHZDVQRVLJQLÀFDQWGLIIHUHQFHEHWZHHQKLJKJUDGH '1VDQG+&&VDQGEHWZHHQZHOODQGPRGHUDWHO\GLIIHUHQWLDWHG+&&VPHDQ&15 RIDQGUHVSHFWLYHO\S &RQFOXVLRQ7KHUHODWLYHK\SRLQWHQVLW\RIDOHVLRQWRQRUPDOVXUURXQGLQJOLYHURQ WKH'3,LVKHOSIXOWRGLVWLQJXLVK+&&KLJKJUDGH'1IURPORZJUDGH'17KHUH LV QR VLJQLÀFDQW GLIIHUHQFH EHWZHHQ KLJKJUDGH '1 DQG +&& DQG EHWZHHQ WKH GLIIHUHQWSDWKRORJLFJUDGHVRI+&& % ,QWUDRSHUDWLYHKLJKUHVROXWLRQOLQHDUFRQWUDVWHQKDQFHGXOWUDVRXQG ,286IRUGHWHFWLRQRIPLFURYDVFXODULVDWLRQRIPDOLJQDQWOLYHU OHVLRQVEHIRUHVXUJHU\RUUDGLRIUHTXHQF\DEODWLRQ (0-XQJ0/RVV5HJHQVEXUJ'(HPMXQJ#JP[GH 3XUSRVH 7 R HYDOXDWH WKH YDOXH RI OLQHDU FRQWUDVWHQKDQFHG LQWUDRSHUDWLYH XO WUDVRXQGWRLPSURYHGHWHFWLRQRIPDOLJQOLYHUWXPRXUVOHVLRQVEHIRUHVXUJHU\RU UDGLRIUHTXHQF\DEODWLRQ5)$ 0HWKRGVDQG0DWHULDOVSDWLHQWVZHUHLQFOXGHGIRUVXUJHU\RIPDOLJQDQWOLYHU WXPRXUVPHDQDJH\HDUVPDOHQ IHPDOHQ VXIIHULQJIURP +&&Q FRORUHFWDOOLYHUPHWDVWDVLVQ &&&Q RURWKHUPDOLJQOLYHU OHVLRQVQ 3UHRSHUDWLYH&(&7Q &(05,Q RU3(7&7Q FRQ ÀUPHG KHSDWLF WXPRXU PDQLIHVWDWLRQ %HIRUH XQGHUJRLQJ VXUJHU\LQWUDRSHUDWLYH FRQYHQWLRQDO ,286 DV ZHOO DV &(,286 ZHUH SHUIRUPHG E\ RQH H[SHULHQFHG H[DPLQHU LQ DOO FDVHV XVLQJ PXOWLIUHTXHQF\ OLQHDU SUREHV 0+] 0+] /2*,4(*(&(,286ZDVSHUIRUPHGDIWHUEROXVLQMHFWLRQRIPOXSWRPO 6RQR9XH %UDFFR ,WDO\ 'LJLWDOO\ VWRUHG LPDJHV RI &(,286 ZHUH FRPSDUHG ZLWKSUHRSHUDWLYHLPDJLQJ 5HVXOWV,QRISDWLHQWVDGGLWLRQDOOHVLRQVZHUHIRXQGXVLQJ&(,286 PHDQWXPRXUVL]HPPUDQJHPP7KLVUHVXOWHGLQDFKDQJHRIVXUJLFDO VWUDWHJ\RUWKHLQWUDRSHUDWLYHDSSOLFDWLRQRI5)$LQSDWLHQWV0RGLÀFD WLRQRIWKHUDS\GXHWRDGGLWLRQDOO\IRXQGOLYHUOHVLRQVZDVVWDWLVWLFDOO\VLJQLÀFDQW S &RPSDULQJ FRQYHQWLRQDO ,286 DQG &(,286 DGGLWLRQDO OHVLRQV LQSDWLHQWVZHUHVHHQE\&(,286$OOOHVLRQVVHHQLQ%VFDQFRXOGDOVREH GHWHFWHGZLWK&(,286 &RQFOXVLRQ7KLVLVWKHÀUVWVWXG\XVLQJFRQWUDVWHQKDQFHGXOWUDVRXQGZLWKKLJK UHVROXWLRQ OLQHDU SUREHV IRU LQWUDRSHUDWLYH GHWHFWLRQ RI PDOLJQDQW OLYHU OHVLRQV &RPSDUHGWRSUHRSHUDWLYHLPDJLQJDQGDOVRFRQYHQWLRQDO,286PRUHWKDQ DGGLWLRQDOOHVLRQVZHUHIRXQGOHDGLQJWRWKHUDSHXWLFFRQVHTXHQFHVRISDWLHQWV 6FLHQWLILF6HVVLRQ 6 &$' ( ) *+% (XURSHDQ&RQJUHVVRI 5DGLRORJ\ 'HWHUPLQDWLRQRIWKHVDIHW\RIJDGREHQDWHGLPHJOXPLQHZDVWKHUHDIWHUPDGHE\ DJHJURXSFOLQLFDOLQGLFDWLRQDQGGRVHDGPLQLVWHUHG 5HVXOWV1RFOLQLFDODGYHUVHHYHQWVZHUHUHSRUWHGHLWKHUDPRQJVWSDWLHQWVZKR XQGHUZHQWRQO\DVROLWDU\05RUPXOWLSOHH[DPLQDWLRQV7KHUHZHUHQRDOWHUDWLRQV LQFUHDWLQLQHOHYHOVHYHQLQYHU\\RXQJVXEMHFWVZKRVHNLGQH\IXQFWLRQLVQRW\HW IXOO\ GHYHORSHG /LNHZLVH WKHUH ZHUH QR FKDQJHV LQ ELOLUXELQ OHYHOV GHVSLWH WKH HOLPLQDWLRQRIRIWKHLQMHFWHGGRVHWKURXJKWKHKHSDWRELOLDU\SDWKZD\ &RQFOXVLRQ*DGREHQDWHGLPHJOXPLQHLVDVDIHDQGHIÀFLHQWFRQWUDVWDJHQWIRU LPDJLQJ RI SDHGLDWULF SDWLHQWV &RQFHUQLQJ WKH FXUUHQW GLVFXVVLRQ RQ WKH VDIHW\ RI *GEDVHG 05 FRQWUDVW DJHQWV WKH ORZHU GRVH RI JDGREHQDWH GLPHJOXPLQH QHHGHGIRUGLDJQRVWLFDEGRPLQDOLPDJLQJPPRONJDQGFRQWUDVWHQKDQFHG 05DQJLRJUDSKPPRONJVHHPVEHQHÀFLDO % 3DUVWDWLQDYHUWVGHYHORSPHQWRIFRQWUDVWLQGXFHGQHSKURSDWK\LQDQ LQYLYRH[SHULPHQWDOPRGHO $'LDPDQWRSRXORV..DWVDQRV66SLOLRSRXORV$.DUDW]DV'.DUQDEDWLGLV 17 VRSDQRJORX'6LDEOLV3DWUD*5DGLDPDQWRSRXORV#JPDLOFRP 3XUSRVH7 RSUHVHQWWKHSUHOLPLQDU\UHVXOWVRIDQH[SHULPHQWDOVWXG\LQYHVWLJDW LQJWKHK\SRWKHVLVWKDWSDUVWDWLQWKH1WHUPLQDODPLQRDFLGSHSWLGHFOHDYHG E\ WKURPELQ IURP WKH SURWHDVHDFWLYDWHG UHFHSWRU PD\ KROG DSURWHFWLYH UROH DJDLQVWFRQWUDVWLQGXFHGQHSKURSDWK\&,13DUVWDWLQKDVSUHYLRXVO\EHHQVKRZQ WRSURWHFWDJDLQVWUDWP\RFDUGLDOLVFKDHPLDDQGUHSHUIXVLRQLQMXU\ 0HWKRGVDQG0DWHULDOV&,1ZDVH[SHULPHQWDOO\LQGXFHGLQ1HZ=HDODQG:KLWH 1=:UDEELWVE\LQWUDYHQRXVDGPLQLVWUDWLRQRIDKLJKGRVHPJ,NJRILRGLQDWHG FRQWUDVWPHGLXP,RSURPLGHPJ,POLQIXVHGRYHUDPLQSHULRG6XEMHFWV UHFHLYHGHLWKHUSUHWUHDWPHQWZLWKѥJNJSDUVWDWLQH[DFWO\PLQXWHVEHIRUH LQLWLDWLRQRIFRQWUDVWLQIXVLRQJURXS3RUDQHTXDOYROXPHRIQRUPDOVDOLQHFRQWURO JURXS&%ORRGVHUXPFUHDWLQLQHV&UZDVPHDVXUHGDWKRXUVLQDOOVXEMHFWV &,1ZDVGHÀQHGDVDQLQFUHDVHRIVXEMHFWҋVV&UDERYHPJGO$QLPDOVZHUH HXWKDQLVHG DW KRXUV NLGQH\V ZHUH UHPRYHG DQG VHFWLRQHG IRUKLVWRORJLFDO H[DPLQDWLRQZLWKKDHPDWR[\OLQDQGHRVLQVWDLQLQJ 5HVXOWV7KLUW\WKUHHVXEMHFWVZHUHDVVLJQHGLQHLWKHUJURXS3Q NJ RU JURXS & Q NJ$W KRXUV &,1 ZDV GHWHFWHG LQD VWDWLVWLFDOO\ VLJQLÀFDQW KLJKHU SURSRUWLRQ RI VXEMHFWV LQ WKH FRQWURO JURXS & FRPSDUHGWRWKHSDUVWDWLQSUHWUHDWHGJURXS3S+LVWRORJ\ GHPRQVWUDWHGPRUHH[WHQVLYHWXEXODUQHFURVLVLQJURXS&FRPSDUHGWRJURXS3 &RQFOXVLRQ3DUVWDWLQVXFFHVVIXOO\LQKLELWV&,1LQDQDQLPDOPRGHORIFRQWUDVW LQGXFHG QHSKURSDWK\ )XUWKHU VWXGLHV DUH QHFHVVDU\ WR YDOLGDWHWKH SURWHFWLYH UROHRISDUVWDWLQDJDLQVWFRQWUDVWQHSKURWR[LFLW\DQGÀQGWKHRSWLPDOGRVHIRUWKH EHVWSRVVLEOHUHVXOW % &OLQLFDODQGSDWKRORJLFDOHIIHFWVDQGLQYLYRVWDELOLW\RIDOOFDWHJRULHV RIJDGROLQLXPFKHODWHVRQDQHZPRGHORIUHQDOIDLOXUHLQUDWV 13DUPHQWLHU 1)UHWHOOLHU3 %UXQHYDO&:DOORQ*-HVWLQ &+ROOHQEHFN&)DFWRU-0,GHH&&RURW5RLVV\)53DULV)5 LGHHM#JXHUEHWJURXSFRP 3XUSRVH&RPSDUHWKHFOLQLFDOSDWKRORJLFDOHIIHFWVDQGWKHLQYLYRVWDELOLW\RIDOO FXUUHQWO\PDUNHWHGFDWHJRULHVRIJDGROLQLXPFKHODWHV*&LQUDWVZLWKDGHQLQH LQGXFHGUHQDOIDLOXUH 0HWKRGV DQG 0DWHULDOV :LVWDU UDWV JURXS UHFHLYHG D DGHQLQH HQULFKHGGLHWIRUGD\VDQGUHFHLYHGGDLO\LQWUDYHQRXVLQMHFWLRQVRIJDGRWHUDWH 'RWDUHPJDGREXWURO*DGRYLVWJDGRSHQWHWDWH0DJQHYLVWJDGREHQDWH 0XOWL+DQFH JDGRGLDPLGH 2PQLVFDQ DOO PPRONJGD\ RU VDOLQH IURP GD\5DWVZHUHVDFULÀFHGZHHNVDIWHUWKHÀUVWLQMHFWLRQRI*&$FOLQLFDOKLV WRSDWKRORJLFDOEOLQGHGH[DPLQDWLRQVELRFKHPLFDODQGDQDO\WLFDOPHDVXUHPHQW RI WRWDO *G FRQFHQWUDWLRQ LQ YDULRXV WLVVXHV ,&3PDVV VSHFWURPHWU\ IROORZXS ZDV FDUULHG RXW DV ZHOO DV UHOD[RPHWU\ PHDVXUHPHQWV VNLQ OLYHU DQG IHPXU 0LQLVSHF0+] 5HVXOWV*UDGXDOPRUWDOLW\ZDVIRXQGLQWKHJDGRGLDPLGHWUHDWHGJURXSRXWRI UDWV(DUO\DQGWUDQVLHQWSXQFWLIRUPVNLQOHVLRQVDSSHDUHGLQJDGRSHQWHWDWHWUHDWHG UDWVDQLPDOV0RGHUDWHGHUPLVLQÁDPPDWLRQRYHUH[SUHVVLRQRI7*)ћDQG WLVVXODULQKLELWRURIPDWUL[SURWHLQDVHZHUHIRXQGLQWKHVNLQRIWKHJDGRGLDPLGH VXUYLYRUDWVDFULÀFH*UDGXDOLQFUHDVHLQUUHOD[LYLW\YDOXHVZDVIRXQGLQWKHVNLQ RI JDGRSHQWHWDWH UDWV DQG P0VHF DW GD\V DQGUHVSHFWLYHO\H[YLYRUHIHUHQFHUDQJH P0VHFDQG JDGRGLDPLGHP0VHFIRUWKHVXUYLYRUDWVDFULÀFHYVP0VHF DWGD\DQHIIHFWFRQVLVWHQWZLWKJUDGXDOLQYLYR*&GLVVRFLDWLRQ &RQFOXVLRQ7KHDGHQLQHPRGHORIUHQDOIDLOXUHDOORZVWRGLVFULPLQDWHEHWZHHQ *&VDVUHJDUGVWKHLUVNLQWR[LFLW\DQGLQYLYRVWDELOLW\SURÀOHV % 7ROHUDELOLW\DQGGLDJQRVWLFYDOXHRIJDGRWHULFDFLGLQJHQHUDODQGLQ SDWLHQWVZLWKULVNIDFWRUVUHVXOWVLQPRUHWKDQSDWLHQWV 0+0DXUHU2+HLQH0:ROI7 'XUPXV0:DJQHU%+DPP %HUOLQ'(6XO]EDFK7 DXQXV'(3WWOLQJHQ'(PDUWLQPDXUHU#FKDULWHGH 3XUSRVH7 RUHYLHZWKHWROHUDELOLW\DQGWKHGLDJQRVWLFHIIHFWLYHQHVVRIJDGRWHULF DFLGXQGHUGDLO\SUDFWLFHFRQGLWLRQVLQWKHJHQHUDOSRSXODWLRQDQGDWULVNSDWLHQWV 0HWKRGVDQG0DWHULDOV$WRWDORISDWLHQWVPDOHIHPDOH PHDQDJH\HDUVZHUHVWXGLHGLQ*HUPDQFHQWUHV3DWLHQWVXQGHU ZHQWFRQWUDVWHQKDQFHGPDJQHWLFUHVRQDQFHLPDJLQJ05,XVLQJJDGRWHULFDFLG *G'27$'RWDUHP*XHUEHW5RLVV\&G*)UDQFHDV,9FRQWUDVWPHGLXPPHDQ YROXPHPORIWKHSDWLHQWVKDGDWOHDVWRQHULVNIDFWRUHJDOOHUJLHV SUHYLRXVDOOHUJLFUHDFWLRQWRDFRQWUDVWPHGLXPUHQDOLPSDLUPHQW)RUW\VL[SDWLHQWV UHFHLYHGDQWLDOOHUJLFSUHWUHDWPHQWEHIRUHFRQWUDVWPHGLXPDGPLQLVWUDWLRQ $GYHUVHHYHQWVZHUHGRFXPHQWHGDQGLPDJHTXDOLW\ZDVDVVHVVHG 5HVXOWV$GLDJQRVLVZDVSRVVLEOHLQRIDOOFDVHV,PDJHTXDOLW\ZDVUDWHG JRRGRUH[FHOOHQWLQ$GYHUVHHYHQWVHJQDXVHDYRPLWLQJDQGXUWLFDULD ZHUHREVHUYHGLQRIWKHH[DPLQDWLRQVDQGZHUHPRVWO\UDWHGDVPLQRU7KHUH ZHUHSDWLHQWVZLWKVHYHUHDGYHUVHHYHQWV7KHDGYHUVHHYHQWUDWHZDVVLJQLÀFDQWO\ KLJKHULQSDWLHQWVZLWKDKLVWRU\RIDOOHUJLHVSDQGLQSDWLHQWVZLWK D SUHYLRXV DOOHUJLF UHDFWLRQ WR FRQWUDVW PHGLXP S 7KHUH ZDV QRHOHYDWHGULVNIRUDGYHUVHHYHQWVLQSDWLHQWVZLWKUHQDORUKHSDWLFLPSDLUPHQW &RQFOXVLRQ*DGRWHULFDFLGZDVVKRZQWREHDZHOOWROHUDWHG05,FRQWUDVWPHGLXP LQSDWLHQWVZLWKDQGZLWKRXWULVNIDFWRUVDVVRFLDWHGZLWKDORZUDWHRIDGYHUVHHYHQWV DQGDJRRGRUH[FHOOHQWLPDJHTXDOLW\LQPRVWSDWLHQWV % 2EVHUYDWLRQDOSRVWPDUNHWLQJVWXG\RQWKHVDIHW\RIPHJOXPLQH JDGRWHUDWHLQWHULPVDIHW\DQDO\VLVRQSDWLHQWV %.UHVV)UDQNIXUW'(NUHVVERGR#NKQZGH 3XUSRVH 7 R SURVSHFWLYHO\ DVVHVV WKH JHQHUDO VDIHW\ SURÀOH RI PHJOXPLQHJ D GRWHUDWH*G'27$DQGHYDOXDWHWKHRYHUDOOLQFLGHQFHRIQHSKURJHQLFV\VWHPLF ÀEURVLV16) 0HWKRGVDQG0DWHULDOV $ZRUOGZLGHSRVWPDUNHWLQJVWXG\306ZDVFRQGXFWHG WRFROOHFWVDIHW\GDWDLQSDWLHQWVZLWKRUZLWKRXWUHQDOLQVXIÀFLHQF\ZKRKDG URXWLQHFRQWUDVWHQKDQFHGPDJQHWLFUHVRQDQFH05LPDJLQJXVLQJ*G'27$)RU HDFKSDWLHQWULVNIDFWRUVDWLQFOXVLRQLQGLFDWLRQVIRU05LPDJLQJH[DPLQDWLRQDQG FRQGLWLRQVRIXVHDQGDGPLQLVWUDWLRQRIWKHFRQWUDVWPDWHULDOZHUHUHFRUGHG)RU DQ\SDWLHQWLGHQWLÀHGDVUHQDOO\LPSDLUHGDWWKHWLPHRILQFOXVLRQLHHVWLPDWHG FUHDWLQLQHFOHDUDQFHRUHVWLPDWHGJORPHUXODUÀOWUDWLRQUDWHP/PLQPò DW OHDVW D PRQWK IROORZXS HYDOXDWLRQ ZDV SHUIRUPHG LQ RUGHUWR GHWHFW DQ\ VXVSLFLRQRURFFXUUHQFHRI16) 5HVXOWV$VRI-XO\WKHFXWRIIGDWHIRUWKHLQWHULPVDIHW\DQDO\VLVWKLV RQJRLQJ306LQFOXGHGGDWDIURPSDWLHQWVPHDQDJH\HDUVUDQJH \HDUVIHPDOH05LPDJLQJH[DPLQDWLRQVZHUHPDLQO\SHUIRUPHGWR LPDJHWKHFHQWUDOQHUYRXVV\VWHPZKROHERG\DQGPXVFXORVNHO HWDO7KHPDLQULVNIDFWRUVZHUHK\SHUWHQVLRQDQGDOOHUJLHV 0RGHUDWHWRVHYHUHLPSDLUHGUHQDOIXQFWLRQZDVUHSRUWHGLQSDWLHQWV $PRQJWKHPKDGQRVXVSLFLRQRI16)IROORZXSHYDOXDWLRQQRW\HW FRPSOHWHGDWWKHWLPHGDWDZHUHFROOHFWHGIRUSDWLHQWV7KLUW\SDWLHQWV KDGDWOHDVWRQHDGYHUVHHYHQWPDLQO\XUWLFDULDQDXVHDYRPLWLQJ &RQFOXVLRQ 7KLV LQWHULP VDIHW\ DQDO\VLV DOUHDG\ FRQÀUPV D YHU\ JRRG VDIHW\ SURÀOHRI*G'27$ % 6DIHW\DQGGLDJQRVWLFHIÀFDF\RIJDGREHQDWHGLPHJOXPLQH 0XOWL+DQFHLQ05LPDJLQJRISDHGLDWULFSDWLHQWV *.6FKQHLGHU+6FKXHUKRO]3 )ULHV$%XHFNHU +RPEXUJDG6DDU'(GUJXHQWKHUVFKQHLGHU#XNVHX 3XUSRVH7 RUHWURVSHFWLYHO\HYDOXDWHWKHVDIHW\DQGGLDJQRVWLFHIÀFDF\RIJDGR EHQDWHGLPHJOXPLQHLQ&(LPDJLQJLQGLIIHUHQWLQGLFDWLRQV 0HWKRGVDQG0DWHULDOVSDHGLDWULFVXEMHFWVDJH\HDUVXQGHUZHQW &(05,DVSDUWRIFOLQLFDOURXWLQH3DWLHQWVUHFHLYHGDGRVHRIHLWKHUPPRONJ ERG\ZHLJKWOLYHUDEGRPLQDOPXVFXORVNHOHWDOEUDLQDQGRWKHUUDUHLQGLFDWLRQVRU PPRONJERG\ZHLJKWFDUGLRYDVFXODULPDJLQJ05XURJUDSK\<RXQJSDWLHQWV XQGHUZHQW05,HLWKHULQVHGDWLRQRUJHQHUDODQDHVWKHVLDLQFDVHRI05$VWXGLHVLQ &+'SDWLHQWVJHQHUDOO\XQGHUZHQWLPDJLQJLQLQWXEDWLRQZLWKFRQWUROOHGYHQWLODWLRQ 0RQLWRULQJIRUDGYHUVHHYHQWVZDVSHUIRUPHGXSWRDWOHDVWKRXUVSRVWLQMHFWLRQ 'HSHQGLQJRQWKHFOLQLFDOQHFHVVLW\ODERUDWRU\PHDVXUHPHQWVDQGLQVRPHFDVHV YLWDOVLJQDQG(&*GHWHUPLQDWLRQVZHUHPDGHEHIRUHDQGDIWHUWKH&(H[DPLQDWLRQ 6FLHQWLILF6HVVLRQ $ 6&'()*+%(XURSHDQ&RQJUHVVRI 5DGLRORJ\ 6XQGD\ 5RRP12 9DVFXODU 66 3HULSKHUDODQGUHQDODUWHULHV 0RGHUDWRUV *&DUUDÀHOOR9DUHVH,7 ..DWVDQRV3DWUDV*5 % $FFXUDF\RIG\QDPLFFRQWUDVWHQKDQFHGXOWUDVRXQGDQGWUDQVLHQW DUWHULDORFFOXVLRQIRUGLDJQRVLVRISHULSKHUDODUWHULDOGLVHDVH ($PDUWHLÀR6:RUPVEHFKHU0.UL[6'HPLUHO6%UDXQ 6'HORUPH'%RHFNOHU+8.DXF]RU0$:HEHU +HLGHOEHUJ'(HULFNDPDUWHLÀR#PHGXQLKHLGHOEHUJGH 3XUSRVH 7 R DVFHUWDLQ WKH DFFXUDF\ RI G\QDPLF FRQWUDVWHQKDQFHG XOWUDVRXQG &(86DQGWUDQVLHQWDUWHULDORFFOXVLRQIRUGLDJQRVLVRISHULSKHUDODUWHULDOGLVHDVH 3$' 0HWKRGVDQG0DWHULDOVSDWLHQWVZLWK3$'5XWKHUIRUGFODVVLÀFDWLRQJUDGH, FDWHJRU\,,,PHDQDJH\HDUVDQGKHDOWK\YROXQWHHUVPHDQDJH\HDUV ZHUHLQFOXGHG7KHGRPLQDQWORZHUOHJZDVH[DPLQHGZLWK&(860+]0, GXULQJFRQWLQXRXVLQWUDYHQRXVLQIXVLRQRIP/PLFUREXEEOHVFRQWDLQLQJVXOSKXU KH[DÁXRULGH7UDQVLHQWDUWHULDORFFOXVLRQDWWKHWKLJKOHYHOVLPXODWHGSK\VLFDOH[ HUFLVH5HJLRQVRILQWHUHVW52,ZHUHSODFHGLQWKHVHOHFWHGPXVFOHDQGVHYHUDO SDUDPHWHUVZHUHREWDLQHGIURPWLPH&(86LQWHQVLW\FXUYHV0D[LPXP&(86VLJQDO DIWHURFFOXVLRQDQGLWVWLPHWPD[UHVXOWLQJVORSHWRPD[LPXPPDQGYDVFXODU UHVSRQVHDIWHURFFOXVLRQ$8&SRVW$FFXUDF\UHFHLYHURSHUDWLQJFKDUDFWHULVWLF 52&FXUYHVDQGFRUUHODWLRQVRIWKHVHSDUDPHWHUVZLWKDQNOHEUDFKLDOLQGH[$%, DQGZDONLQJGLVWDQFHZHUHDQDO\VHG 5HVXOWV$OO SDUDPHWHUV VLJQLÀFDQWO\ GLIIHUHG IRU SDWLHQWV FRPSDUHG WRYROXQ WHHUVSWPD[ZDVPDUNHGO\GHOD\HGLQ3$'YVV SDQGZDVVLJQLÀFDQWO\QHJDWLYHO\FRUUHODWHGZLWK $%,U +LJKHVW GLDJQRVWLFDFFXUDF\ZDVIRXQGXVLQJPZKLFKZDVVLJQLÀFDQWO\VPDOOHUIRUSDWLHQWV P/VFRPSDUHGWRYROXQWHHUVP/VSZLWKDVHQ VLWLYLW\RIDQGVSHFLÀFLW\RIIRUGHWHFWLRQRIGLPLQLVKHGPXVFXODUPLUFR SHUIXVLRQLQ3$'FXWRIIYDOXHPaP/V'LVFULPLQDQWDQDO\VLVDQGUHFHLYHU RSHUDWLQJFKDUDFWHULVWLF52&FXUYHVUHYHDOHGWKDWDSDUDPHWHUFRPELQDWLRQRI PDQG$8&SRVWLVRSWLPDOIRUGLDJQRVLVRI3$' &RQFOXVLRQ'\QDPLF&(86DQGWUDQVLHQWDUWHULDORFFOXVLRQTXDQWLI\LQJPXVFXODU PLFURSHUIXVLRQLVVXLWDEOHIRUGLDJQRVLVRI3$'SURYLGLQJDFFXUDWHVHQVLWLYLW\DQG VSHFLÀFLW\ % &RPSUHKHQVLYH05DQJLRJUDSK\RIWKHORZHUOLPEVFRPSDULVRQ RISHUIRUPDQFHRIJDGREHQDWHGLPHJOXPLQHJDGREXWURODQG JDGRIRVYHVHWWULVRGLXP 6&KDQGUDPRKDQ*5RGLWL*ODVJRZ8.GUVFKDQGUDPRKDQ#JPDLOFRP 3XUSRVH&RPSUHKHQVLYHORZHUOLPE05$SURWRFROLQFRUSRUDWLQJG\QDPLFÀUVW SDVVVWDWLRQDQGKLJKUHVROXWLRQLPDJLQJZLWKUHVXOWVFRPSDUDEOHWREORRGSRRO FRQWUDVWDJHQWV%3&$FRXOGEHDFKLHYHGZLWKQRQ%3&$V:HDLPWRHYDOXDWH WKLVLQDSURVSHFWLYHO\FRPSDULQJJDGRIRVYHVHWZLWKJDGREXWURODQGJDGHREHQDWH 0HWKRGVDQG0DWHULDOVSDWLHQWVFODXGLFDQWVQ DQGFULWLFDOOLPELVFKDHPLFV Q DUHUHFUXLWHGIRUWKLVVWXG\&(05$DFTXLUHGLQSKDVHVLQLWLDOG\QDPLF 05$7:,67RIWKHLQIUDSRSOLWHDOYHVVHOVVWDQGDUGVWDWLRQÀUVWSDVV05$WKHQ LPPHGLDWHO\IROORZHGE\LPDJLQJLQҊH[WHQGHGSKDVHҋZLWKKLJKUHVROXWLRQDFTXLVL WLRQVRIWKHWKLJKDQGFDOIYHVVHOV&ULWLFDOSDWLHQWVZHUHLPDJHGRQFHRQO\ZLWK %3&$POJDGRIRVYHVHWSDWLHQWVRUHLWKHURIWKH(&6DJHQWVJDGREHQDWH GLPHJOXPLQHRUJDGREXWUROPOSDWLHQWV&ODXGLFDQWSDWLHQWVDUHLPDJHG WZLFHRQVHSDUDWHDWWHQGDQFHVZLWK%3&$DQGHLWKHUJDGREHQDWHGLPHJOXPLQH RUJDGREXWURORUJDGREHQDWHGLPHJOXPLQHDQGJDGREXWUROWRDOORZLQWUDLQGLYLGXDO FRPSDULVRQ(YDOXDWLRQRILPDJHTXDOLW\IRUDUWHULHVDQGYHLQVXVLQJD/LNHUWVFDOH DQG52,PHDVXUHPHQWVIRU&15RQKLJKUHVROXWLRQLPDJHV 5HVXOWV )RU DUWHULDO GLDJQRVLV G\QDPLF DQG ÀUVWSDVV LPDJHV REWDLQHG ZLWK JDGREHQDWH GLPHJOXPLQH DQG JDGREXWURO DUH QRW VLJQLÀFDQWO\ GLIIHUHQW WR WKRVH REWDLQHGZLWKJDGRIRVYHVHWWULVRGLXP+LJKVSDWLDOUHVROXWLRQH[WHQGHGSKDVHLP DJHVDUHDOVRFRPSDUDEOHWRDUWHULDOGLVHDVHDOWKRXJKYHQRXVVLJQDOLVVLJQLÀFDQWO\ UHGXFHGLQQRQ%3&$V &RQFOXVLRQ&RPSUHKHQVLYHORZHUOLPEYDVFXODULPDJLQJLQFOXGLQJG\QDPLFDF TXLVLWLRQVDQGH[WHQGHGSKDVHLPDJLQJFDQEHSHUIRUPHGZLWKVLPLODUGLDJQRVWLF % 5HQDOIXQFWLRQRIRXWSDWLHQWVXQGHUJRLQJFRQWUDVWHQKDQFHG&7 ZKDWKDYHZHOHDUQHGIURPXQLYHUVDOH*)5WHVWLQJ" +&KDOLDQ+*7 RUH.*KDGMDU9<DJKPDL&KLFDJR,/86 Y\DJKPDL#QRUWKZHVWHUQHGX 3XUSRVH7 RGHWHUPLQHWKHIUHTXHQF\RIDEQRUPDOUHQDOIXQFWLRQLQDOORXWSDWLHQWV XQGHUJRLQJFRQWUDVWHQKDQFHG&7DQGWRFRUUHODWHWKLVZLWKWKHSDWLHQWVҋNQRZOHGJH RIWKHLUUHQDOIXQFWLRQ 0HWKRGVDQG0DWHULDOV7KLVUHWURVSHFWLYH+,3$$FRPSOLDQWVWXG\ZDVDSSURYHG E\RXU,5%H*)5POPLQPYDOXHVIRUFRQVHFXWLYHRXWSDWLHQWVRE WDLQHGLPPHGLDWHO\EHIRUH&7ZHUHUHFRUGHGH*)5YDOXHVZHUHREWDLQHGIRUDOO SDWLHQWVUHJDUGOHVVRIWKHLUULVNIDFWRUV5HVXOWVZHUHFRPSDUHGWRWKHSDWLHQWVҋ VHOIUHSRUWLQJRIWKHKLVWRU\RIUHQDOGLVHDVHH*)5YDOXHVZHUHDOVRFRPSDUHG WRWKHVHUXPFUHDWLQLQHPJG/OHYHOVH*)5POPLQPZDVGHÀQHG DVDEQRUPDO 5HVXOWVSDWLHQWVZHUH\RXQJHUWKDQ\HDUVSDWLHQWV KDGDEQRUPDOH*)5PHDQPOPLQP7KHDYHUDJHDQGPH GLDQDJHIRUWKRVHZLWKDEQRUPDOH*)5ZHUHDQGUHVSHFWLYHO\ SDWLHQWVZLWKDEQRUPDOH*)5UHSRUWHGQRKLVWRU\RIUHQDOGLVHDVH RIWKRVHZLWKH*)5POPLQPUHSRUWHGQRKLVWRU\RIUHQDO GLVHDVH2IWKRVHZKRLQGLFDWHGKLVWRU\RIUHQDOGLVHDVHKDG QRUPDO H*)5 SDWLHQWV ZLWK DEQRUPDO H*)5 KDG FUHDWLQLQH OHYHOV EHORZPJG/ &RQFOXVLRQ3DWLHQWVUHIHUUHGIRUHQKDQFHG&7DUHIUHTXHQWO\XQDZDUHRIWKHLU DEQRUPDOUHQDOIXQFWLRQVWDWXV&RQYHUVHO\SDWLHQWVZKRUHSRUWKLVWRU\RIUHQDO GLVHDVHFRPPRQO\KDYHQRUPDOUHQDOIXQFWLRQ8QLYHUVDOH*)5WHVWLQJPD\EH QHFHVVDU\WRGHWHUPLQHWKHUHQDOIXQFWLRQLQWKLVSRSXODWLRQ % (YDOXDWLRQRIFRQWUDVWLQMHFWLRQSURWRFROVIRUWKRUDFRDEGRPLQDO KLJKSLWFKGXDOVRXUFH&7DQJLRJUDSK\DSKDQWRPVWXG\ *'3XLSSH$:LQNOHKQHU$3ODVV7 )UDXHQIHOGHU6%DXPOOHU=XULFK&+ JLOEHUWSXLSSH#XV]FK 3XUSRVH7 RH[SHULPHQWDOO\HYDOXDWHWKUHHFRQWUDVWSURWRFROVIRUWKRUDFRDEGRPLQDO KLJKSLWFKGXDOVRXUFH&7DQJLRJUDSK\&7$ZLWKUHJDUGWROHYHODQGKRPRJHQHLW\ RIYDVFXODUHQKDQFHPHQWDWGLIIHUHQWFDUGLDFRXWSXWV 0HWKRGVDQG0DWHULDOV8QLSKDVLFELSKDVLFDQGWDLORUHGFRQWUDVWLQMHFWLRQSUR WRFROVZHUHWHVWHGXVLQJDKXPDQYDVFXODUSKDQWRP3URWRFROVZHUHVFDQQHGDW GLIIHUHQWFDUGLDFRXWSXWV/PLQVWHSV/PLQXVLQJDFHQWULIXJDOSXPS 7KRUDFRDEGRPLQDO YDVFXODU HQKDQFHPHQW ZDV PHDVXUHG HYHU\ FP 2YHUDOO PHDQ HQKDQFHPHQW RI HDFK SURWRFRO DQG PHDQ HQKDQFHPHQW IRU HDFK FDUGLDF RXWSXWZLWKLQHDFKSURWRFROZHUHFDOFXODWHG(QKDQFHPHQWKRPRJHQHLW\DORQJWKH ]D[LVZDVHYDOXDWHGIRUHDFKFDUGLDFRXWSXWDQGSURWRFRO $PRXQWVRIDGPLQLVWHUHG FRQWUDVWDJHQWZHUHQRWHG 5HVXOWV2YHUDOOPHDQHQKDQFHPHQWZDVVLJQLÀFDQWO\KLJKHULQWKHXQLSKDVLFWKDQ LQWKHRWKHUSURWRFROVDOOSZKHUHDVWKHGLIIHUHQFHEHWZHHQWKHELSKDVLFDQG WDLORUHGSURWRFROZDVQRWVLJQLÀFDQWS &DUGLDFRXWSXWLQYHUVHO\LQÁXHQFHG WKHOHYHORIYDVFXODUHQKDQFHPHQW&KDQJLQJFDUGLDFRXWSXWVOHDGWRVLJQLÀFDQWO\ GLIIHUHQWPHDQYDVFXODUHQKDQFHPHQWVDOOSZLWKWKHH[FHSWLRQDWFDUGLDF RXWSXWVRI/PLQYV/PLQ+8YV+8S DQGYV/PLQ +8YV+8S DWWKHWDLORUHGSURWRFRO+RPRJHQHRXVHQKDQFH PHQWZDVIHDVLEOHDWDOOFDUGLDFRXWSXWVZLWKWKHXQLSKDVLFDQGWDLORUHGEXWQRWZLWK WKHELSKDVLFSURWRFRO$PRXQWVRIFRQWUDVWDJHQWZHUHVLJQLÀFDQWO\ORZHUDWWKH WDLORUHGP/WKDQDWWKHXQLP/RUELSKDVLFP/SURWRFRODOOS &RQFOXVLRQ5HVXOWVVXJJHVWWKDWKRPRJHQHRXVHQKDQFHPHQWDWWKRUDFRDEGRPL QDOKLJKSLWFKGXDOVRXUFH&7$LVDFKLHYDEOHZLWKHLWKHUXQLSKDVLFRUWDLORUHGFRQWUDVW SURWRFROWKHODWWHUEHLQJIDYRXUDEOHRIQHHGLQJVLJQLÀFDQWO\OHVVFRQWUDVWDJHQW 6FLHQWLILF6HVVLRQ 6 &$' ( ) *+% (XURSHDQ&RQJUHVVRI 5DGLRORJ\ % +RZVKRXOGUHQDODUWHU\VWHQRVHVEHPHDVXUHG" 0$QGHUVVRQ.-lJHUYDOO3 (ULNVVRQ$3HUVVRQ**UDQHUXVg6PHGE\ /LQN|SLQJ6( 3XUSRVH7 RGHWHUPLQHZKLFKPRUSKRORJLFDOPHDVXUHVIURP&7$DQG05$DUHEHVW LQSUHGLFWLQJZKHWKHUDUHQDODUWHU\VWHQRVLVDIIHFWVUHQDOKDHPRG\QDPLFVRUQRW 0HWKRGVDQG0DWHULDOV)RUW\VHYHQSDWLHQWVZLWKK\SHUWHQVLRQRUDQWLK\SHUWHQ VLYHWUHDWPHQWDQGDFOLQLFDOVXVSLFLRQRIUHQRYDVFXODUK\SHUWHQVLRQZHUHH[DPLQHG ZLWKFRPSXWHGWRPRJUDSK\DQJLRJUDSK\&7$PDJQHWLFUHVRQDQFHDQJLRJUDSK\ 05$FDSWRSULOHQKDQFHGUHQRJUDSK\&(5DQGFDSWRSULOWHVW&WHVW7KH&7$ DQG05$LPDJHVRIWKHUHQDODUWHULHVZHUHDQDO\VHGE\WZRUHDGHUVXVLQJIX]]\ FRQQHFWHGQHVV VHJPHQWDWLRQ 7KH PHDVXUHV XVHG ZHUH PLQLPXP GLDPHWHU PLQLPXPDUHDGLDPHWHUUHGXFWLRQDQGDUHDUHGXFWLRQ,QDGGLWLRQWZRUDGLRORJLVWV PHDVXUHG WKH GLDPHWHU UHGXFWLRQ ZLWKRXW XVLQJ DXWRPDWHG VHJPHQWDWLRQ 7KH UHVXOWVZHUHWKHQFRUUHODWHGZLWKWKHUHVXOWVIURP&(5FRPELQHGZLWK&WHVWXVLQJ UHFHLYHURSHUDWLQJFKDUDFWHULVWLFV52&DQDO\VLV 5HVXOWV$ WRWDO RI NLGQH\V KDG DOO WKUHH LQYHVWLJDWLRQV &7$ 05$ DQG &(5&WHVWZKHUHNLGQH\VJRWDSRVLWLYHUHVXOWRQWKH&(5&WHVW $UHD UHGXFWLRQRQ05$KDGWKHJUHDWHVWDUHDXQGHU52&FXUYH$852& FRQÀGHQFHLQWHUYDO7KH $852&IRUWKHUDGLRORJLVWVҋPHDVXUHPHQWVRQ &7$DQG05$ZHUHDQGUHVSHFWLYHO\1RQHRI WKHGLIIHUHQFHVZHUHVWDWLVWLFDOO\VLJQLÀFDQW &RQFOXVLRQ 1R VLJQLÀFDQW GLIIHUHQFHV ZHUH IRXQG EHWZHHQ WKH PRUSKRORJLFDO PHDVXUHVLQWKHLUDELOLW\WRSUHGLFWSRVLWLYHUHQRJUDSKLFÀQGLQJVEXWDWHQGHQF\ RI05$KDYLQJKLJKHU$852&WKDQ&7$7KHUHZDVQRVLJQLÀFDQWGLIIHUHQFHEH WZHHQWKHPHDVXUHPHQWVPDGHE\WKHUDGLRORJLVWVDQGWKHPHDVXUHPHQWVPDGH ZLWKIX]]\FRQQHFWHGQHVVVHJPHQWDWLRQ)XUWKHUVWXGLHVDUHUHTXLUHGWRGHÀQLWHO\ LGHQWLI\WKHRSWLPDOPHDVXUHPHQW % 'XSOH[HYDOXDWLRQRIGLVWDOUHQDODUWHU\WRSUHGLFWWKHSUHVHQFHRI SUR[LPDOVLJQLÀFDWLYHDFFHOHUDWLRQDQH[SHULHQFHRIH[SORUDWLRQV -/HDO55RGULJXH]-3HLQDGR69LFHQWH&6DOJDGR$)ORUHV-*LO $2UJD]0'REODV7 ROHGR(6MBLBOHDO#ZDQDGRRHV 3XUSRVH7KHDLPRIWKLVVWXG\ZDVWRGHWHUPLQHWKHDFFXUDF\RILQGLUHFWKDHPR G\QDPLFSDUDPHWHUVREWDLQHGE\HYDOXDWLRQRIWKHVHJPHQWDORULQWHUOREDODUWHULHV ZLWKLQWKHNLGQH\DVSUHGLFWRUVRIWKHSUHVHQFHRIKDHPRG\QDPLFDOO\VLJQLÀFDWLYH SUR[LPDOUHQDODUWHU\VWHQRVLV 0HWKRGVDQG0DWHULDOV:HSHUIRUPHGDUHWURVSHFWLYHDQDO\VLVRIDOOFRQVHFX WLYHO\VWXGLHGSDWLHQWVDWRXUFHQWUHZLWKVXVSHFWHG5$6'LUHFWKDHPRG\QDPLFDO PHDVXUHV UHQDO SHDN V\VWROLF YHORFLW\5369DQG HQG GLDVWROLF YHORFLW\('9 GHWHUPLQHGLQWKHSUR[LPDODQGPLGGOHVHJPHQWVRIWKHPDLQUHQDODUWHU\ZHUH PHDVXUHG ZLWK WKH DVVRFLDWLRQ RI IRXU LQGLUHFW 'RSSOHU SDUDPHWHUV REWDLQHG LQ WKHUHQDOKLOLXP5HVLVWLYH,QGH[5,$FFHOHUDWLRQ,QGH[$,6\VWROLF$FFHOHUDWLRQ 7LPH$7DQG3XOVDWLOLW\,QGH[3,7KHSRSXODWLRQZDVFODVVLÀHGE\WKHSUHVHQFH RUDEVHQFHRIGLUHFWKDHPRG\QDPLFDOFULWHULDRI5$65369!FPVDQGWKH GLVWDOLQGLUHFWSDUDPHWHUVZHUHFRPSDUHGLQWKHVHWZRSRSXODWLRQV 5HVXOWV $WRWDORIH[SORUDWLRQVLQSDWLHQWVZHUHDQDO\VHG $SUHGLFWLYH ELQDU\ORJLVWLFUHJUHVVLRQPRGHOZDVGHYHORSHGLQRUGHUWRGHWHUPLQHWKHDFFXUDF\ RI GLVWDO LQGLUHFW SDUDPHWHUV WR SUHGLFW WKH SUHVHQFH RI D SUR[LPDO VLJQLÀFDWLYH 53697KHDUHDXQGHUWKHFXUYHRIWKHUHFHLYHURSHUDWLQJFKDUDFWHULVWLFDQDO\VLV RIWKHSUHGLFWLYHPRGHOZDVFRQÀGHQFHLQWHUYDO>&,@ LQGLFDWLQJJRRGGLVFULPLQDWLRQSRZHUEHWZHHQWKRVHZLWKDQGZLWKRXWVLJQLÀFDWLYH SUR[LPDO YDOXHV RI 5369 2QO\ 3, SUHYDOHQFH RGGV UDWLR >325@ & , DQG$7325&,ZHUHVLJQLÀFDWLYHO\DVVRFL DWHGZLWKKLJKHVW5369 &RQFOXVLRQ7KHVHUHVXOWVVXJJHVWWKDWGLVWDOLQGLUHFWKDHPRG\QDPLFSDUDPHWHUV 3,DQG7$FRXOGSURYLGHJRRGGLDJQRVWLFDFFXUDF\LQWKHSUHGLFWLRQRISUR[LPDO VLJQLÀFDWLYH 5369 YDOXHV EHLQJ XVHIXO ZKHQ PDLQYHVVHO YHORFLWLHV FDQQRW EH GHWHUPLQHGUHOLDEO\ % 1RQHQKDQFHGPDJQHWLFUHVRQDQFHDQJLRJUDSK\05$RIWKHUHQDO DUWHULHVFRPSDULVRQZLWKFRQWUDVWHQKDQFHG05$ '/XPLD0*$QJHUHWWL$&DQL$00DUHVFD($*HQRYHVH&)XJD]]ROD 9DUHVH,7GRPHQLFROXPLD#JPDLOFRP 3XUSRVH7 RDVVHVVWKHGLDJQRVWLFDFFXUDF\RIQRQHQKDQFHGVWHDG\VWDWHIUHH SUHFHVVLRQ66)3PDJQHWLFUHVRQDQFHDQJLRJUDSK\1(05$IRUGHWHFWLRQRI UHQDO DUWHU\ VWHQRVLV 5$6 LQ FRPSDULVRQ ZLWK EUHDWKKROG FRQWUDVWHQKDQFHG 05DQJLRJUDSK\&(05$DVWKHUHIHUHQFHVWDQGDUG XWLOLW\IRUDUWHULDOGLVHDVHXVLQJDOODJHQWV9HQRXVHQKDQFHPHQWLVVLJQLÀFDQWO\ OHVVFRQVSLFXRXVZLWKWKHQRQ%3&$V % (IÀFDF\RI'RWDUHPHQKDQFHGPUDLQWKHGLDJQRVLVRISHULSKHUDO DUWHU\GLVHDVHFRPSDUHGWR*DGRYLVWHQKDQFHG05$ &/RHZH -$UQDL]'.UDXVH/0DUWL%RQPDWL0$VFKDXHU$7 DUWDUR 0/RPEDUGL0%XUUHO5,]]LOOR9LHQQD$76DQWDQGHU(6'LMRQ)5 9DOHQFLD(6*UD]$7&KLHWL,73LVD,7%DUFHORQD(66DLQW'HQLV)5 FKULVWLDQORHZH#PHGXQLZLHQDFDW 3XUSRVH7 RFRPSDUHWKHGLDJQRVWLFSHUIRUPDQFHRI'RWDUHPHQKDQFHG05$ DQG*DGRYLVWHQKDQFHG05$DW7 0HWKRGVDQG0DWHULDOV,QWKLVSURVSHFWLYHPXOWLFRXQWULHVUDQGRPLVHGSDUDOOHO JURXSGRXEOHEOLQGSKDVH,9WULDOSDWLHQWV\HDUVZLWKSHULSKHUDO DUWHULDO GLVHDVH 3$2' VWDJHV ,,,9 /HULFKH DQG )RQWDLQH FODVVLÀFDWLRQ ZHUH LQFOXGHG3DWLHQWVUDQGRPO\XQGHUZHQW05$RIWKHORZHUOHJVGXULQJLQMHFWLRQZLWK PPRONJRIHLWKHU'RWDUHPP/RU*DGRYLVWP/$WRWDO RIYDVFXODUVHJPHQWVZHUHH[SORUHGIURPLQIUDUHQDODRUWDWRSHURQHDODUWHU\ 7KHSULPDU\FULWHULRQZDVWKHGHJUHHRIDJUHHPHQWZLWKLQSDWLHQWDFFXUDF\RI HDFKW\SHRI05$H[DPLQDWLRQDVFRPSDUHGWRWKHJROGVWDQGDUG'6$XVLQJD QRQLQIHULRULW\DQDO\VLVHYDOXDWHGLQDEOLQGHGPDQQHUE\RQVLWHUHDGLQJ0DLQ VHFRQGDU\FULWHULDLQFOXGHGVSHFLÀFLW\VHQVLWLYLW\SRVLWLYHQHJDWLYHSUHGLFWLYHYDOXHV 339139GLDJQRVWLFFRQÀGHQFHDQGVDIHW\ 5HVXOWV7KHDJUHHPHQWLQVWHQRVLVGHWHFWLRQEHWZHHQ'RWDUHP05$DQG'6$ ZDVVLPLODUWRWKDWRI*DGRYLVW05$YVUHVSHFWLYHO\ у DQGWKH&,H[FOXGLQJWKHQRQLQIHULRULW\OLPLWGHPRQVWUDWHGWKH QRQLQIHULRULW\7KH05$VHQVLWLYLW\IRUGHWHFWLQJVLJQLÀFDQWVWHQRVLV!ZDV ZLWK'RWDUHPDQGZLWK*DGRYLVWZKHUHDVWKHVSHFLÀFLW\ 339 YHUVXV 139 DQG GLDJQRVWLF FRQÀGHQFH YV ZHUHVLPLODULQERWKJURXSV7ZRSDWLHQWVLQHDFKJURXSH[SHULHQFHG DGYHUVHHYHQWVPRVWO\PLOGDQGXQUHODWHG &RQFOXVLRQ 'RWDUHP05$ FDQ EH XVHG ZLWK VLPLODU GLDJQRVWLF DFFXUDF\ DV *DGRYLVW05$ LQ WKH GLDJQRVLV RI 3$2' DW 7 HVOD 7KLV WULDO VXJJHVWV WKDW WKHUHLVQRGLUHFWFRUUHODWLRQEHWZHHQKLJKHULQWULQVLFUHOD[LYLW\DQGRUJDGROLQLXP FRQFHQWUDWLRQDQGLPSURYHGFOLQLFDOGLDJQRVLV % 3HULSKHUDO05$DW7 LQWUDLQGLYLGXDOFRPSDULVRQEHWZHHQ QRQHQKDQFHG7R)DQG66)3VHTXHQFHVYVFRQWUDVWHQKDQFHG05$ IRUWKHGHWHFWLRQRIFOLQLFDOO\UHOHYDQWVWHQRVLV 0$Q]LGHL $1DSROL) =DFFDJQD/6DED*&DUWRFFL /%HUWDFFLQL91RFH) %RQL&&DWDODQR5RPH,7&DJOLDUL,7 PLFKHOHDQ]LGHL#JPDLOFRP 3XUSRVH7 RFRPSDUHGLDJQRVWLFDFFXUDF\RIWZRQRQHQKDQFHG05$1(05$ VHTXHQFHV7 R)DQG66)3YVFRQYHQWLRQDOFRQWUDVWHQKDQFHG05$&(05$ DW7LQSDWLHQWVZLWKSHULSKHUDODUWHULDOREVWUXFWLYHGLVHDVH3$2'XVLQJ&7 DQJLRJUDSK\&7$DVUHIHUHQFHVWDQGDUG 0HWKRGVDQG0DWHULDOVSDWLHQWVV\PSWRPDWLFIRU3$2'XQGHUZHQW1(05$ RI WKH IHPRUDO DQG FDOI UHJLRQV ZLWK ' (&*JDWHG7 R) DQG (&*JDWHG 66)3 VHTXHQFHVIROORZHGE\&(05$ZLWK*G%237$$OOSDWLHQWVXQGHUZHQW&7$DV UHIHUHQFHVWDQGDUG7KUHHEOLQGHGREVHUYHUVVHSDUDWHO\UHYLHZHGDOO05$GDWDVHWV LQUDQGRPRUGHURQHLQGHSHQGHQWREVHUYHUHYDOXDWHG&7$LPDJHVIRUWKHDVVHVV PHQWRIUHOHYDQWVWHQRVLV!H[WHQWDQGORFDWLRQ,PDJHTXDOLW\ZDVHYDOXDWHG E\DQLQGHSHQGHQWREVHUYHUIRUDOO05$GDWDVHWV,QWUDREVHUYHUDQGLQWHUREVHUYHU DJUHHPHQWIRUWKHWKUHH05$WHFKQLTXHVZHUHDQDO\VHGXVLQJ&RKHQNVWDWLVWLFV 6HQVLWLYLW\ VSHFLÀFLW\ DFFXUDF\ SRVLWLYH SUHGLFWLYH YDOXH 339 DQG QHJDWLYH SUHGLFWLYHYDOXH139ZHUHFDOFXODWHGIRUHDFKWHFKQLTXH7KH0F1HPDU VWHVW ZDVXVHGWRDVVHVVVWDWLVWLFDOO\VLJQLÀFDQWGLIIHUHQFHVLQWKHGLDJQRVWLFDFFXUDF\ RIHDFK05$WHFKQLTXH 5HVXOWV ,QWUDREVHUYHU DQG LQWHUREVHUYHU DJUHHPHQW ZHUH VXEVWDQWLDO IRUV W H QRVLV DVVHVVPHQW 7KH VHQVLWLYLW\ VSHFLÀFLW\ DFFXUDF\ 339 DQG 139 YDOXHV RI 7 R)66)3&(05$ VHTXHQFHV IRU VWHQRVLV DVVHVVPHQW FRPSDUHG WR &7$ ZHUH UHVSHFWLYHO\ 'LDJQRVWLFSHUIRUPDQFHRI&(05$ZDVVXSHULRUWR7 R)DQG66)3VHTXHQFHV S66)3VHTXHQFHVZHUHEHWWHUIRUVWHQRVLVDVVHVVPHQWFRPSDUHGWR 7 R)VHTXHQFHVS &RQFOXVLRQ 7 &(05$ LV VXSHULRU WR 1(05$ WHFKQLTXHV IRU LPDJH TXDOLW\ DQG GLDJQRVWLF SHUIRUPDQFH 7KH GLDJQRVWLF SHUIRUPDQFH RI 66)3VHTXHQFHV LV VLJQLÀFDQWO\ KLJKHU WKDQ WKDW RI7 R) VHTXHQFHV DQG PD\ EH FRQVLGHUHG DV D SRWHQWLDODOWHUQDWLYHGLDJQRVWLFWRROLQVHOHFWHGSDWLHQWV 6FLHQWLILF6HVVLRQ $ 6&'()*+%(XURSHDQ&RQJUHVVRI 5DGLRORJ\ 6XQGD\ &RQFOXVLRQ3DWLHQWVVKRZHGDV\PPHWULFDOGLVWULEXWLRQRIDWKHURVFOHURWLFOHVLRQV LQSDUWLFXODUIRUWKHIHPRUDOSURIXQGDDQGVXSHUÀFLDOSRSOLWHDDQWHULRUWLELDODQG SHURQHDODUWHULHV3DWLHQWҋVDQDO\VLVVKRZHGDV\PPHWULFDOOHVLRQVDQGVHYHULW\ GLVWULEXWLRQ % 6WXG\RIWKHOHIWUHQDOYHLQYDULDWLRQVDQGLQIHULRUYHQDFDYD YDULDWLRQVE\PHDQVRIVSLUDOFRPSXWHGWRPRJUDSK\ $'LOOL 8< $\D]%+HNLPRJOXdDQND\D750HUVLQ75 XPLW\DVDUD\D]#JPDLOFRP 3XUSRVH$UHWURVSHFWLYHVWXG\ZDVGHVLJQHGWRHYDOXDWHWKHSHUFHQWDJHVRIWKH OHIWUHQDOYHLQYDULDWLRQVLQIHULRUYHQDFDYDYDULDWLRQVDQGWKHHIIHFWRIJHQGHURQ WKHLUIUHTXHQFLHVXVLQJVSLUDOFRPSXWHGWRPRJUDSK\&7 0HWKRGVDQG0DWHULDOV%HWZHHQ-DQXDU\DQG $XJXVWWKHVWXG\SRSX ODWLRQZDVUHFUXLWHGIURPSDWLHQWVZKRZRXOGXQGHUJRDFRQWUDVWHQKDQFHG DEGRPLQDOVSLUDO&7H[DPLQDWLRQIRUYDULRXVDEGRPLQDOSUREOHPV 5HVXOWV$VWKHOHIWUHQDOYHLQYDULDWLRQVUHWURDRUWLFOHIWUHQDOYHLQ5/59DQG FLUFXPDRUWLF OHIW UHQDO YHLQ &/59 ZHUH GHWHFWHG 7KH QXPEHU RI FDVHV ZLWK WKHFRUUHVSRQGHQWSHUFHQWDJHVRIWKHWRWDOOHIWUHQDOYHLQYDULDWLRQV5/59DQG &/59ZDVDQGUHVSHFWLYHO\ 7KHUHLVDFRUUHODWLRQEHWZHHQIHPDOHJHQGHUDQGIUHTXHQF\RIWKHOHIWUHQDOYHLQ YDULDWLRQV3 5/59LVWLPHVPRUHIUHTXHQWLQIHPDOHVWKDQLQPDOHV FRQÀGHQFHLQWHUYDO$VWKHLQIHULRUYHQDFDYD,9&YDULDWLRQV GXSOLFDWLRQRI,9&DQGWUDQVSRVLWLRQRI,9&ZHUHGHWHFWHG7KHQXPEHURIFDVHV ZLWKWKHFRUUHVSRQGHQWSHUFHQWDJHVRIWKHWRWDO,9&YDULDWLRQVGXSOLFDWLRQRI,9& DQGWUDQVSRVLWLRQRI,9&ZDV UHVSHFWLYHO\7KHUHZDVQRHIIHFWRIJHQGHURQWKHIUHTXHQFLHVRI,9&YDULDWLRQV 3 &RQFOXVLRQ$EGRPLQDO VSLUDO &7 LV XVHIXO LQ GHWHFWLQJ WKH OHIW UHQDO YHLQY D U L DWLRQV 5/59 &/59 DQG WKH ,9& YDULDWLRQV 5DGLRORJLFDO UHFRJQLWLRQ RI WKHVH YDULDWLRQVLVFUXFLDOZKHQDQ,9&VXUJHU\DQGDOHIWUHQDORUUHWURSHULWRQHDOVXUJHU\ DUHFRQVLGHUHG 5RRP3 5DGLRJUDSKHUV 66 5DGLRJUDSKHUVLQWKHFOLQLFDOVHWWLQJ 0RGHUDWRUV +++MHPO\2OVR12 :+UXE\9LHQQD$7 % 'LJLWDOPDPPRJUDSK\WUDLQLQJWHFKQLFDOFOLQLFDOSUDFWLFHVDQG ZRUNÁRZLVVXHV &5HLV/5DGX7 6DNHOODULV6&DUUDVTXHLUR$3DVFRDO5LRGH0RXUR37 FODXGLDUHLV#HVWHVOLSOSW 3XUSRVH7 RDVVHVVFXUUHQWSUDFWLFHVLQGLJLWDOPDPPRJUDSK\'0LQ3RUWXJXHVH KRVSLWDOVFOLQLFVWRLQYHVWLJDWHFRPSOLDQFHZLWK(XURSHDQVWDQGDUGVDQGWRLGHQWLI\ RSWLPLVDWLRQQHHGV 0HWKRGV DQG 0DWHULDOV 7KUHH TXHVWLRQQDLUHV WDUJHWHG DW EUHDVWUDGLRORJLVWV EUHDVWUDGLRJUDSKHUV DQG FKLHIUDGLRJUDSKHU ZHUH GHVLJQHG DQG DSSOLHG LQ LPDJLQJGHSDUWPHQWVRIIHULQJ'0,QVWLWXWLRQDQGVWDIISURÀOHVWHFKQRORJ\TXDOLW\ FRQWURO4&WHFKQLFDOFOLQLFDOSUDFWLFHVZRUNORDGDQGFHUWLÀFDWLRQPDWWHUVZHUH LQYHVWLJDWHG 5HVXOWV $SDUWLFLSDWLRQUDWHRIZDVDFKLHYHGSULYDWHSXEOLF UHSUHVHQWLQJDWRWDORIUDGLRJUDSKHUVUDGLRORJLVWVDQGFKLHIUDGLRJUDSKHUV SDUWLFLSDWLQJ 7KH WUDLQLQJ VXUYH\ UHYHDOHG RI UDGLRJUDSKHUV DQG RI UDGLRORJLVWV ZLWKRXW VSHFLÀF WUDLQLQJ LQ '0 5HJDUGLQJ SUDFWLFHV PRVW UDGLRJUDSKHUVHQTXLUHGXVH$(&IRUVWDQGDUGEUHDVWLPDJLQJ7KHH[LVWHQFHRI DQH[SRVXUHLQGLFDWRUZDVLJQRUHGE\RIUDGLRJUDSKHUV0RVWVLWHV SHUIRUPHTXLSPHQW4&5HMHFWHGDQDO\VLVZDVUDUH(85()JXLGHOLQHV ZHUHIROORZHGLQRIWKHVLWHVZLWKPDQXIDFWXUHUUHFRPPHQGDWLRQVIUHTXHQWO\ GULYLQJSUDFWLFHVRIWKHFHQWUHVVWLOOSULQWDOOLPDJHVZKLOH QHYHUGRHV2YHUDOOWKHSDUWLFLSDQWFHQWUHVUHSUHVHQWHGDQHVWLPDWHGSURGXFWLRQRI PDPPRJUDSKLFH[DPLQDWLRQVPRQWKZLWKQRWLFHDEOHYDULDWLRQVLQZRUNORDG DQG ZRUNHIÀFLHQF\ WR PDPPRJUDSK\KRXU 5DGLRORJLVWV DJUHHG ZLWKWKHQHHGIRUFHUWLÀFDWLRQLQ'0DQGWKHZRXOGMRLQDYROXQWHHUSURJUDP 0HWKRGVDQG0DWHULDOV6L[W\WKUHHSDWLHQWVPDOHVIHPDOHVZLWKVXVSHFWHG UHQRYDVFXODUK\SHUWHQVLRQZHUHH[DPLQHGZLWK1(05$XVLQJD(&*JDWHG66)3 VHTXHQFH DQG D 7 05 VFDQQHU LQ SDWLHQWV D UHVSLUDWRU\ WULJJHU ZDV XVHGLQDGGLWLRQWRFDUGLDFJDWLQJ'XULQJWKHVDPHH[DPLQDWLRQ&(05$ZDV SHUIRUPHGLQDOOSDWLHQWVDQGLWVUHVXOWVXVHGDVUHIHUHQFHVWDQGDUG0,3LPDJH TXDOLW\QXPEHURIPDLQUHQDODUWHULHVDFFHVVRU\DUWHULHVDQGSUHVHQFHRIVWHQRVHV ZHUHLQGHSHQGHQWO\DVVHVVHGE\WZRUHDGHUV6HQVLWLYLW\VSHFLÀFLW\SRVLWLYH339 DQGQHJDWLYHSUHGLFWLYHYDOXHV139RI1(05$LQWKHLGHQWLÀFDWLRQRIVLJQLÀFDQW 5$6ZHUHFDOFXODWHG 5HVXOWV0,3LPDJHTXDOLW\ZDVFRQVLGHUHGEHWWHUIRU1(05$E\ERWKUHDGHUV 1(05$LGHQWLÀHGDUWHULHVGHWHFWHGE\&(05$DFFHVVRU\PLVVHG )RXUWHHQVWHQRVHVZHUHLGHQWLÀHGE\&(05$DWKHURVFOHURWLFG\VSODVWLF ZLWK VLJQLÀFDQW 5$6 6HQVLWLYLW\ VSHFLÀFLW\ 339 DQG 139 RI1(05$ ZHUH UHVSHFWLYHO\DQGIRUUHDGHUDQG DQGIRUUHDGHU2YHUHVWLPDWLRQRIWKHVWHQRVLVJUDGHRFFXUUHGLQWZRFDVHV IRUUHDGHUYVQRUPDOLQRQHFDVHYVLQWKHRWKHUFDVH &RQFOXVLRQ1(05$KDVEHFRPHDYLDEOHDOWHUQDWLYHWR&(05$IRUWKHVWXG\RI WKHUHQDODUWHULHV,QFDVHRIVLJQLÀFDQWVWHQRVLVJLYHQWKHULVNRIRYHUHVWLPDWLRQ WKHXVHRI&(05$LVVWLOOLQGLFDWHG % (YDOXDWLRQRIUHQDODUWHU\DQHXU\VPE\QRQFRQWUDVWPDJQHWLF UHVRQDQFHDQJLRJUDSK\D6/((.VHTXHQFHFRPSDULVRQZLWK&7$ < 3HL&KDQJVKD&1WMS\J #FRP 3XUSRVH7 RGHWHUPLQHWKHSHUIRUPDQFHRIDQHZQRQFRQWUDVWPDJQHWLFUHVRQDQFH DQJLRJUDSK\1&05$VHTXHQFHVSDWLDOODEHOOLQJZLWKPXOWLSOHLQYHUVLRQSXOVHV 6/((.LQLWVDELOLW\WRSUHVHQWWKHUHQDODUWHU\DQHXU\VP5$$DQGWRLQYHVWLJDWH ZKHWKHUDVXLWDEOHPXOWLSOHEORRGVXSSUHVVLRQLQYHUVLRQWLPH%637,FDQKHOSWR LPSURYH5$$YLVLELOLW\LQ6/((. 0HWKRGVDQG0DWHULDOV5$$VFRQÀUPHGE\&7$ZDVFDUULHGRXW1&05$ XVLQJ6/((.RQD705V\VWHPZLWKYDULRXV%637,$VXLWDEOH%637,WR LQFUHDVH5$$YLVLELOLW\ZDVGHWHUPLQHGDQG5$$ZDVHYDOXDWHGIRUHDFKSDWLHQW E\WZRH[SHULHQFHGUDGLRORJLVWVLQWKHLUFRQVHQVXVDQGZHUHFRPSDUHGZLWK&7$ UHVXOWVXVLQJDMRLQWUHDGLQJSHUIRUPHGLQFRQVHQVXV 5HVXOWV5$$VFRQVLVWHGRIULJKWDQGOHIW5$$V5$$VZHUHSHUIRUPHG E\VXUJHU\LQFOXGLQJ5$$VZLWKFP5$$VZLWK!FPDQGFP 5$$VZLWK!FPDQGFP5$$VZLWK!FP7KHH[FHOOHQWFRUUHODWLRQ EHWZHHQ6/((.DQG&7$ZDVIRXQGLQSUHVHQWLQJ5$$VL]H5V S 7KHVXLWDEOH%637,ZDVPVIRUGLVSOD\LQJ5$$ZLWKFPPVIRU 5$$ZLWK!FPDQGFPPVIRU5$$ZLWK!FPDQGFP DQGPVIRU5$$ZLWK!FP &RQFOXVLRQ$VXLWDEOH%637,LQ6/((.PD\LQFUHDVHWKH5$$YLVLELOLW\6/((. UHSUHVHQWVDQRQUHQDOFRPSOLFDWLRQUHODWLYHO\LQH[SHQVLYHDQGUHOLDEOHGLDJQRVWLF PHWKRGIRUHYDOXDWLQJ5$$V,WFDQEHDVDQDOWHUQDWLYHFKRLFHRI&7$IRUHYDOXDWLQJ 5$$VHVSHFLDOO\LQVXEMHFWVZLWKUHQDOLQVXIÀFLHQF\ % 6\PPHWU\RIDWKHURVFOHURWLFOHVLRQVDWWKHORZHUH[WUHPLWLHVDUWHULHV RQPDJQHWLFUHVRQDQFHDQJLRJUDSK\05$ 91DUGHOOD) 6HFFKL$*LDUGLQR(5HVWD*'L/HR) 6DUGDQHOOL0LODQ,7 JDLDQDUGHOOD#JPDLOFRP 3XUSRVH 2XU DLP ZDV WR TXDQWLI\ WKH V\PPHWU\ EHWZHHQ ULJKW DQG OHIW ORZHU H[WUHPLWLHVDWKHURVFOHURWLFDUWHULHVOHVLRQVRQ05$ 0HWKRGV DQG 0DWHULDOV :H UHWURVSHFWLYHO\ HYDOXDWHG D FRQVHFXWLYH VHULHV RI UHSRUWVFRQFHUQLQJSDWLHQWVDJHG\HDUVIHPDOHVZKRXQGHUZHQWORZHU H[WUHPLWLHV05$:HSHUIRUPHGDWKUHHVWHS05$IURPDRUWLFELIXUFDWLRQWRWLELDO DUWHULHVXVLQJD'JUDGLHQWHFKRVHTXHQFHEHIRUHDIWHULQWUDYHQRXVDGPLQLVWUDWLRQ RIPPRONJRIJDGREHQDWHGLPHJOXPLQH'LVHDVHJUDGH'*ZDVHYDOXDWHG IRUHDFKDUWHU\XVLQJDSRLQWVFRUH QRUPDO VWHQRVLV VWHQRVLV RU DQHXULVP RFFOXVLRQ 0RUHRYHU DIWHU H[FOXVLRQ RI QRUPDO ELODWHUDO YHVVHOVGLVHDVHV\PPHWU\'6ZDVHYDOXDWHGIRUHDFKDUWHU\FRPSDUHGZLWKWKH FRQWUDODWHUDOZHFDOFXODWHG'6DVDEVROXWHGLIIHUHQFHRIOHIWDQGULJKWOHJ'*IRU HDFKYHVVHO PD[V\PPHWU\DQG PLQV\PPHWU\$EVROXWHPHGLDQ'6ZDV FDOFXODWHGIRUDUWHU\DQGIRUSDWLHQW0HGLDQ'6SHUSDWLHQWVZDVZHLJKWHGIRUWKH QXPEHURISDWKRORJLFDODUWHULHVZHLJKWHG'6:'6 PD[DQG PLQV\PPHWU\ :HFRPSDUHGWKHOHIWOHJJOREDO'*ZLWKULJKWOHJJOREDO'*WKURXJK:LOFR[RQWHVW 5HVXOWV &RPSDULQJ WKH JOREDO '* EHWZHHQ WKH WZR OHJV QR VLJQLÀFDQW GLIIHU HQFHZDVIRXQG3 0HGLDQ'6VFRUHZDVIRUWKHIHPRUDOSURIXQGDDQG VXSHUÀFLDOSRSOLWHDDQWHULRUWLELDODQGSHURQHDODUWHULHV0HGLDQSDWLHQW'6VFRUH ZDVZKLOHPHGLDQSDWLHQW:'6VFRUHZDV 6FLHQWLILF6HVVLRQ 6 &$' ( ) *+% (XURSHDQ&RQJUHVVRI 5DGLRORJ\ QXPEHURISLFWXUHVWLPHWRH[DPWHFKQLFDOLPDJHTXDOLW\VLJQLÀFDQWÀQGLQJVDQG DELOLW\WRSHUIRUPUHSRUWV 0HWKRGVDQG0DWHULDO7KHVWXG\ZDVFRQGXFWHGDVDTXDQWLWDWLYHSURVSHFWLYH FRQWUROOHGVWXG\LQFOXGLQJSDWLHQWVÀYH $35VDQGIRXUH[SHULHQFHGUDGLRORJLVWV $OOSDWLHQWVXQGHUZHQWXOWUDVRXQGH[DPLQDWLRQVE\DQ$35DQGDUDGLRORJLVW7KH $35ZHUHQRWJLYHQWKHRSSRUWXQLW\WRFRQVXOWDUDGLRORJLVWGXULQJWKHH[DPLQDWLRQV DQGWKH\ZHUHEOLQGHGIRUHDFKRWKHUVÀQGLQJV7KH\VHSDUDWHO\UHJLVWHUHGWLPH SHUH[DPLQDWLRQQXPEHURILPDJHVLQFRPSOHWHH[DPLQDWLRQVFRQÀGHQFHLQRZQ ÀQGLQJV7KHH[DPLQDWLRQVSHUIRUPHGE\WKH$35ZHUHHYDOXDWHGE\UDGLRORJLVWV IRUWHFKQLFDOLPDJHTXDOLW\WKHDELOLW\RIWKH$35WRPDNHVLJQLÀFDQWÀQGLQJVDQG DGGLWLRQDOÀQGLQJVDELOLW\WRSHUIRUPGLDJQRVWLFUHSRUWVDQGDQRYHUDOOHYDOXDWLRQ RIWKHLUH[DPLQDWLRQV6WDWLVWLFVLQWKHVWXG\&RKHQV.DSSDWHVW&KLVTXDUHWHVWV DQGSDLUHGWWHVW 5HVXOWV7KHUDGLRORJLVWDQG$35VKRZHGÀQGLQJVFRQIRUPDW,Q RIWKHH[DPLQDWLRQVWKHUDGLRORJLVWVJDYHWKH$35V´EHVWµRU´PHGLXPEHVWµVFRUH LQRYHUDOOFRQÀGHQFHRIWKHH[DPLQDWLRQVKDGDWHFKQLFDOTXDOLW\VXSHULRU RUHTXDOWRWKHH[DPLQDWLRQVSHUIRUPHGE\UDGLRORJLVWV &RQFOXVLRQ7KLVVWXG\LQGLFDWHVWKDW$35DUHTXDOLÀHGWRSHUIRUP86H[DPLQD WLRQLQXSSHUDEGRPHQLQVDIHZD\LQ1RUZD\HTXDOWRUDGLRORJLVWJLYHQWKDWWKH\ XQGHUJRDTXDOLÀHGHGXFDWLRQ % &DQUDGLRORJLFWHFKQRORJLVWVEHWUDLQHGWRWULDJH&7FRORQRJUDSK\ IRUH[WUDFRORQLFÀQGLQJV" 7 1%RHOODDUG&< 1LR3 00%RVVX\W6%LSDW-6WRNHU$PVWHUGDP1/ WQERHOODDUG#DPFXYDQO 3XUSRVH7 HFKQRORJLVWVKDYHEHHQVKRZQWREHFDSDEOH&7FRORQRJUDSK\REVHUY HUV DQG ZH HYDOXDWHG ZKHWKHU UDGLRORJLF WHFKQRORJLVWV FDQ EH WUDLQHG WR WULDJH VFUHHQLQJ&7FRORQRJUDSK\IRUH[WUDFRORQLFÀQGLQJV 0HWKRGVDQG0DWHULDOV(LJKWFRQVHQWLQJWHFKQRORJLVWVSDUWLFLSDWHGLQDVWUXFWXUHG WUDLQLQJSURJUDPWKDWFRQVLVWHGRIVWXG\DVVLJQPHQWVDQGDKRXUFRXUVHZLWK SUHVHQWDWLRQVREVHUYDWLRQRIH[SHUWUHDGLQJDQGUHDGLQJXQEOLQGHGFDVHV 6XEVHTXHQWO\ WKH\ UHSRUWHG H[WUDFRORQLF ÀQGLQJV LQ ORZGRVH &7 FRORQRJ UDSKLHVZLWKRXWLQWUDYHQRXVFRQWUDVWPHGLXP7KLVGDWDVHWFRQWDLQHGDQG VFDQVZLWKDSRVVLEO\(RUSUREDEO\LPSRUWDQW(ÀQGLQJDVKLJKHVWFODVVLÀHG ÀQGLQJ&5$'67KHÀUVWDQGODVWFDVHVZHUHLGHQWLFDOH[DPLQDWLRQFDVHV ,PPHGLDWHIHHGEDFNZDVJLYHQDIWHUHDFKFDVHIURPWKHUHIHUHQFHVWDQGDUGH[FHSW IRU H[DPLQDWLRQ FDVHV7 HFKQRORJLVWV UHSRUWHG &5$'6 FODVVLÀFDWLRQ UHSRUWLQJ WLPHDQGWKHQHHGIRUDUDGLRORJLVWWRUHDG:HFRQVWUXFWHGOHDUQLQJFXUYHVIRU FRUUHFWVFDQWULDJLQJXVLQJDPRYLQJDYHUDJHWHFKQLTXH 5HVXOWV )RU WKH ÀQDO H[DP RI VFDQV ZLWK ( RU ( ÀQGLQJV DQG ZLWKRXW(RU(ÀQGLQJVZHUHFRUUHFWO\WULDJHG7KHUHZDVLP SURYHPHQWEHWZHHQWKHÀUVWDQGÀQDOH[DPLQLGHQWLI\LQJ(VFDQV YVS7KHUHZDVQRLPSURYHPHQWIRULGHQWLI\LQJ(VFDQV ERWK 7KH WHFKQRORJLVWV DYHUDJH UHDGLQJ WLPH GHFUHDVHG IURP WRPLQXWHVS &RQFOXVLRQ7 HFKQRORJLVWVKDYHDQLQFUHDVHGFDSDELOLW\LQWULDJLQJH[WUDFRORQLF ÀQGLQJV DW &7 FRORQRJUDSK\ DIWHU WUDLQLQJ$ KLJKHU QXPEHU RI FDVHV DQGRU D PRGLÀHGWUDLQLQJSURJUDPLVQHHGHGWRGHWHUPLQHZKHWKHUWHFKQRORJLVWVFDQUHDFK VXIÀFLHQWFRPSHWHQFH % 3URSRVHG&7GLDJQRVWLFUHIHUHQFHOHYHOVIRU,UHODQG 6-)ROH\ 0) 0F(QWHH/$5DLQIRUG'XEOLQ,(6\GQH\$8 VKDQHIROH\#XFGLH 3XUSRVH&RPSXWHGWRPRJUDSK\&7LVUHFRJQLVHGDVWKHODUJHVWFRQWULEXWRUWR SRSXODWLRQGRVHIURPPHGLFDOH[SRVXUHVDFFRXQWLQJIRURIWKHWRWDOGRVH EXW RQO\ RI WKH WRWDO H[DPLQDWLRQV LQ ,UHODQG 'LDJQRVWLF UHIHUHQFH OHYHOV '5/VDUHFUXFLDOWRGRVHRSWLPLVDWLRQIDFLOLWDWLQJWKHLGHQWLÀFDWLRQRIDEQRUPDOO\ KLJKGRVHV'5/VVKRXOGEHEDVHGRQORFDOUHJLRQDORUQDWLRQDOGDWDDQGUHÁHFW ORFDOSUDFWLFHVKRZHYHUFXUUHQW,ULVKYDOXHVDUHEDVHGRQLQWHUQDWLRQDOGDWDIURP *LYHQWKHDGYDQFHVWKDWKDYHRFFXUUHGLQ&7WHFKQRORJ\VLQFHWKHQDQGLWV LQFUHDVLQJDSSOLFDWLRQWKLVUHVHDUFKSURSRVHVXSGDWHG'5/VIRUWKHPRVWFRP PRQ&7H[DPLQDWLRQV 0HWKRGVDQG0DWHULDOV)RUW\IRXU&7VFDQQHUVLQ,UHODQGIURPYDULRXVPDQXIDF WXUHUVDQGZLWKYDULRXVPXOWLGHWHFWRUFDSDELOLWLHVZHUHVXUYH\HG(DFK&7FHQWUH ZDV DVNHG WR UHFRUG &7 GRVH GDWD '/3 &7',YRO WXEH YROWDJH DQG FXUUHQW SURVSHFWLYHO\ RQ DQRQ\PLVHG DGXOW SDWLHQWV RI DYHUDJH VL]H NJ SUHVHQWLQJIRUHLJKWFRPPRQ&7H[DPLQDWLRQV0HDQUHVXOWVIURPHDFKVLWHZHUH SRROHGDQGWKHWKSHUFHQWLOHZDVXVHGWRVHW'5/VXVLQJERWK&7',YRODQG'/3 &RQFOXVLRQ 2QWKHMRE GRVLPHWU\ WUDLQLQJ DQG UHMHFW DQDO\VLV PD\ FRQWULEXWH WR LPSURYH SUDFWLFHV LQ '0 (XURSHDQ JXLGHOLQHV DUH XVHG LQ D OLPLWHG QXPEHU RIVLWHV0DQXIDFWXUHUҋVUHFRPPHQGDWLRQVGULYHFXUUHQWSUDFWLFHVLQPRVWVLWHV (IÀFLHQWÀQDQFLDOJDLQVPD\EHREWDLQHGIURPVWDQGDUGLVLQJGLJLWDOLPDJHRXWSXW % +RZWRLQFUHDVHWKHSDUWLFLSDWLRQUDWHDPRQJQRQ(XURSHDQ LPPLJUDQWVLQWKHPDPPRJUDSK\VFUHHQLQJSURJUDPPHLQ2VOR1RUZD\ (5RVWDG5*XOOLHQ+/LQQHVWDG2VOR12URHE#XXVQR 3XUSRVH7 RLQFUHDVHWKHSDUWLFLSDWLRQDPRQJQRQ(XURSHDQLPPLJUDQWVDWWKH PDPPRJUDSK\VFUHHQLQJ6WXGLHVVKRZVWKDWOHVVWKDQLQZRPDQIURPPLQRU LW\JURXSVNQRZVDERXWPDPPRJUDSK\VFUHHQLQJDQGEUHDVWFDQFHUGHVSLWHWKH IDFWWKDWEUHDVWFDQFHULVDFRPPRQFDXVHRIGHDWKDPRQJZRPHQLQWKHJURXS 1RQ(XURSHDQ LPPLJUDQWV LQ 2VOR KDYH ORZ SDUWLFLSDWLRQ UDWH LQWKH VFUHHQLQJ SURJUDPPH 0HWKRGVDQG0DWHULDOV7KHGHSDUWPHQWIRFXVHGRQWKHODUJHVWPLQRULW\JURXSV ZLWKZRPHQVSHDNLQJ8UGX$UDELFDQG6RPDOL3RVWHUVLQWKHVHODQJXDJHVDQG 1RUZHJLDQ ZLWK D VXPPDU\ DERXW PDPPRJUDSK\ VFUHHQLQJ ZHUH SULQWHG DQG VHQWWRDOOJHQHUDOSUDFWLWLRQHUVLQ2VORDQGKXQJXSLQSXEOLFSODFHVDQGKHDOWK RIÀFHVLQGLVWULFWVZLWKPDQ\ZRPHQIURPPLQRULW\JURXSV5DGLRJUDSKHUVIURPWKH GHSDUWPHQWYLVLWHGZRPHQҋVJURXSVDQGLQIRUPHGDERXWPDPPRJUDSK\VFUHHQLQJ DQGEUHDVWFDQFHU1RWDOOZRPHQFDQUHDGWKHLUQDWLYHODQJXDJHVRWKHUHZHUH EURDGFDVWHGVHYHUDOUDGLRVKRZVLQ8UGX$UDELFDQG6RPDOL 5HVXOWV7KHJHQHUDOSUDFWLWLRQHUVDUHSOHDVHGZLWKWKHSRVWHUVDQGLQIRUPWKHLU SDWLHQWV DERXW PDPPRJUDSK\ VFUHHQLQJ 7KH UHVSRQVH DW WKH PHHWLQJV LQ WKH ZRPHQҋV JURXSV KDV EHHQ VXFFHVVIXO 7KH DWWHQGDQFHV DW WKH PHHWLQJV ZHUH GRXEOHGWKHZRPHQZHUHLQYROYHGDQGDVNHGUHOHYDQWTXHVWLRQV'XULQJWKHUDGLR VKRZZRPHQFDOOHGWRFRPPHQWRQWKHWRSLF7KHUHKDVEHHQLQFUHDVHGSDUWLFLSD WLRQIURPQRQ(XURSHDQLPPLJUDQWVDWWKHPDPPRJUDSK\VFUHHQLQJ &RQFOXVLRQ,WLVLPSRUWDQWWRFRQWLQXHWKHRQJRLQJZRUNDQGLQFOXGHQHZLQLWLDWLYHV WRLQFUHDVHWKHSDUWLFLSDWLRQDPRQJQRQ(XURSHDQLPPLJUDQWVLQWKHPDPPRJUDSK\ VFUHHQLQJSURJUDPPH % (FKRHVIURP(VWRQLDLQWURGXFWLRQRIVRQRJUDSK\DVDVSHFLDOLVP IRUUDGLRJUDSKHUV -'RGJHRQ $/XNNHQ3 9DKWUDPDH6DOIRUG8.7 DUWX(( -UGRGJHRQ#VDOIRUGDFXN 3XUSRVH$Q(8IXQGHGSURMHFWZDVLQLWLDWHGE\WKH(VWRQLDQ6RFLHW\RI5DGLRJ UDSKHUV DQG7 DUWX +HDOWKFDUH &ROOHJH WR WUDLQ UDGLRJUDSKHUVLQ RQH RI WKUHH VSHFLDOLVWDUHDV5DGLRWKHUDS\QXFOHDUPHGLFLQHDQGGLDJQRVWLFXOWUDVRXQG7KLV SUHVHQWDWLRQIRFXVHVRQRQHDVSHFWRIWKHSURMHFWGHVLJQHGWRFUHDWHDQHGXFDWLRQ SURJUDPPHIRUDQHZJURXSRIUDGLRJUDSKHUVLQ(VWRQLDVRQRJUDSKHUV 0HWKRGVDQG0DWHULDOV7KHVRQRJUDSK\SURMHFWVWDUWHGLQWKHÀUVW\HDUEH LQJGHYRWHGWRFXUULFXOXPGHVLJQEDVHGRQ()680%JXLGHOLQHV,QWHUQDWLRQDOOLQNV ZHUHPDGHZLWK6ZHGHQWKH8.DQGWKH86$7KHHGXFDWLRQZDVLPSOHPHQWHG IURP)HEUXDU\DQGWKLVSUHVHQWDWLRQH[DPLQHVWKHYLVLWE\D8.XOWUDVRXQG HGXFDWLRQDOLVW $EHVSRNHHGXFDWLRQDOSURJUDPPHFRPSULVLQJOHFWXUHVDQGKDQGV RQ SUDFWLFDO WUDLQLQJ VHVVLRQV ZDV GHOLYHUHG RYHU RQH ZHHN 6XEVHTXHQWO\ WKH NQRZOHGJHRIWKHVWXGHQWVZDVWHVWHGDQGWKHWHDFKLQJHYDOXDWHG 5HVXOWV7KH VWXGHQWVҋ NQRZOHGJH DQG VNLOOV ZHUH HQKDQFHG E\ WKH LQSXW7KH (VWRQLDQVWDIIDFTXLUHGWHDFKLQJUHVRXUFHVDQGZHUHDVVLVWHGLQGHYHORSLQJXO WUDVRXQGH[DPLQDWLRQSURWRFROV6XFFHVVIXOVWXGHQWVJUDGXDWHGLQ-DQXDU\ DQGVRQRJUDSK\VSHFLDOLVPKDVEHHQDSSURYHGDVQHZRFFXSDWLRQE\WKH(VWRQLDQ 4XDOLÀFDWLRQV$XWKRULW\ &RQFOXVLRQ7KHUHLVQRZDZRUNIRUFHRIUDGLRJUDSKHUVRQRJUDSKHUVZKRFDQ ZRUNWRUHGXFHZDLWLQJOLVWWLPHVDQGHQKDQFHKHDOWKFDUHGHOLYHU\LQ(VWRQLD7KH KRVWHGXFDWLRQDOLVWVKDYHDFTXLUHGFRQVLGHUDEOHUHVRXUFHVDQGVNLOOVZKLFKZLOO HQDEOHWKHPWRGHYHORSFXUULFXODDQGFRQWLQXHWUDLQLQJUDGLRJUDSKHUVIRUDGYDQFHG SUDFWLFHUROHV % (YDOXDWLRQRIWKHÀUVWUDGLRJUDSKHUVZLWKDGGLWLRQDOGHJUHHLQ XOWUDVRXQGWRZKDWH[WHQWDUHWKHOHDUQLQJREMHFWLYHVDFKLHYHG PRQWKVDIWHUJUDGXDWLRQ" .*9LNHVWDG (1(LNHIMRUG%0+RIPDQQ2VOR12%HUJHQ12 X[YNDU#RXVKIQR 3XUSRVH7KHSXUSRVHRIWKLVVWXG\ZDVWRFRPSDUHXOWUDVRXQG86ÀQGLQJVRI DGYDQFHGUDGLRJUDSKHUSUDFWLRQHU$35DQGH[SHULHQFHGUDGLRORJLVWV7 RVHHLI $35 PDQDJH WR VHSDUDWH SRVLWLYH DQG QHJDWLYH H[DPLQDWLRQV IURPHDFK RWKHU 6FLHQWLILF6HVVLRQ $ 6&'()*+%(XURSHDQ&RQJUHVVRI 5DGLRORJ\ 6XQGD\ SHDUDQFHWKHYDVFXODULVDWLRQRIWKHPHWDVWDVHVDQGVWXGLHGKRZWKH\FKDQJHG GXULQJWKHFRXUVHRIWUHDWPHQW 5HVXOWV:HIRXQGOLYHUPHWDVWDVHVLQSDWLHQWVZLWKSDWLHQWVZKR KDGSULPDU\UHFWDOWXPRXUV:HGLYLGHGWKHPHWDVWDVHVLQWRWZRJURXSVEDVHGRQ WKHSDWWHUQRIWKHLUYDVFXODULW\K\SHUYDVFXODUDQGK\SRYDVFXODUPHWDVWDVHV$OO WKHVHSDWLHQWUHFHLYHGV\VWHPLFFKHPRWKHUDS\,QWKHK\SRYDVFXODUPHWDVWDVHVZH IRXQGUHJUHVVLRQZKHUHDVSDWLHQWVKDGXQFKDQJHGVWDWXV2Q IXUWKHUHYDOXDWLRQDQGFRUUHODWLRQRILPDJHVZHIRXQGD´W\SLFDOULQJOLNHFRQWUDVW HQKDQFHPHQWµLQOLYHUPHWDVWDVHV(YHU\SDWLHQWZLWKWKHVHPHWDVWDVHVVXIIHUHG SURJUHVVLRQLQGHSHQGHQWRIFKHPRWKHUDS\WUHDWPHQW &RQFOXVLRQ&7DQG05,VFDQKDVSURYHGWREHDQH[FHOOHQWDQGZLGHO\XVHG PRGDOLW\ IRU WKH GHWHFWLRQ RI OLYHU PHWDVWDVHV 7KH K\SHUYDVFXODULVHG OLYHU PH WDVWDVHVZLWKW\SLFDOULQJOLNHFRQWUDVWHQKDQFHPHQWDUHPRUHOLNHO\WRSURJUHVV LQGHSHQGHQWRIV\VWHPLFFKHPRWKHUDS\ 5RRP4 1HXUR 66 7XPRXUV 0RGHUDWRUV ($YGDJLF6DUDMHYR%$ ):&DUWHV=XPHO]X,QQVEUXFN$7 % 5ROHRIPXOWLPRGDO05LQEUDLQJOLRPDJUDGLQJ 3 $0DWWHL66DOLFH'7 RUWRUD93DQDUD&%ULJDQWL$5&RWURQHR 0&DXOR$7 DUWDUR&KLHWL,7SDPDWWHL#XQLFKLW 3XUSRVH7 RHYDOXDWHWKHGLDJQRVWLFDFFXUDF\RIRSWLPLVHGFXWRIIVGHWHUPLQHGLQ SUHHVWDEOLVKHGUHJLRQVRILQWHUHVW52,ZLWKDGYDQFHG05WHFKQLTXHVSHUIXVLRQ VSHFWURVFRS\GLIIXVLRQDQG'7,IRUGLIIHUHQWLDWLQJEHWZHHQJOLRPD:+2JUDGH,, YV,,,DQG,,YV,,,DQG,9 0HWKRGV DQG 0DWHULDOV FRQVHFXWLYH SDWLHQWV ZLWK FHUHEUDO JOLRPD ZHUH UHWURVSHFWLYHO\HYDOXDWHGZLWKD705VFDQQHU*ROGVWDQGDUGZDVKLVWRORJ\LQ ORZDQGKLJKJUDGH)RXU52,ZHUHDQDO\VHGDUHDRIFRQWUDVWHQKDQFH PHQW&(7VLJQDOORZHUWKDQWKDWRIOLTXRU77VLJQDOJUHDWHUWKDQRUHTXDO WROLTXRU7DQGDUHDZLWKUHGXFHGGLIIXVLRQ5'6HYHUDOSDUDPHWHUVZHUH GHWHUPLQHGIRUHDFK52,U&%9U077 &KR&U&KR1$$/LS&U/DF&U $'&DQG )$6WDWLVWLFDOGLIIHUHQFHVZHUHHYDOXDWHGZLWKWWHVWSDQG52&DQDO\VLV 5HVXOWV 7KH SDUDPHWHUV ZKLFK ZHUH FDSDEOH RI GLVWLQJXLVKLQJ EHWZHHQ WKH ORZ DQG KLJK JUDGH JOLRPDV ZHUH U&%9 LQ &( FXWRII! VHQVLELOLW\ VSHFLÀFLW\ $8& S 7 FXWRII! VHQVLELOLW\ VSHFLÀFLW\ $8& S '5 FXWRII! VHQVLELOLW\ VSHFLÀFLW\ $8& S &KR&U LQ 7 FXWRII! VHQVLELO LW\ VSHFLÀFLW\ $8& S &KR&U LQ '5 FXWRII! VHQVLELOLW\ VSHFLÀFLW\ $8& S $VWDWLVWLFDOO\VLJQLÀFDQW GLIIHUHQFHLQU&%9ZDVQRWREVHUYHGEHWZHHQJUDGHV,,2'*DQG:+2JUDGH,,, JOLRPDVRUEHWZHHQJUDGH,,2'*DQGJUDGH,,,DVWURF\WRPDV&KR&ULQ&(ZDV KLJKHUFXWRII!VHQVLELOLW\ VSHFLÀFLW\ $8& S LQ JUDGH,,,2'*FRPSDUHGWRJUDGH,, &RQFOXVLRQ7KHLQWHJUDWLRQRIDGYDQFHG05TXDQWLWDWLYHELRPDUNHUVLQWKHGLI IHUHQWLDOGLDJQRVLVEHWZHHQORZDQGKLJKJUDGHJOLRPDVFDQVLJQLÀFDQWO\LPSURYH GLDJQRVWLFDFFXUDF\ % '6&05,LQJOLREODVWRPDVFRUUHODWLRQRIZKROHWXPRXUKLVWRJUDP DQDO\VLVRIFHUHEUDOEORRGYROXPHDQGYDVFXODUSHUPHDELOLW\.WUDQV ZLWKELRPDUNHUVRIWXPRXUDJJUHVVLYHQHVV 5/LVHUUH3 /3ROLDQL0)HUUDUD6*ULVDQWL/%XWWROR 0%XJOLRQHGL0RQDOH5*DVSDURWWL%UHVFLD,7UOLVHUUH#OLEHURLW 3XUSRVH7 RH[DPLQHWKHUHODWLRQVKLSEHWZHHQU&%9DQGFRQWUDVWWUDQVIHUFRHI ÀFLHQW.WUDQVYDOXHVREWDLQHGZLWKG\QDPLFVXVFHSWLELOLW\FRQWUDVW05LPDJLQJ '6&05,DQGKLVWRSDWKRORJLFDOIHDWXUHVDVVRFLDWHGZLWKWXPRXUDJJUHVVLYHQHVV 0HWKRGVDQG0DWHULDOV'6&05LPDJLQJ6LHPHQV$YDQWR7ZDVREWDLQHG LQDFRQVHFXWLYHVHULHVRISDWLHQWVZLWKKLVWRORJLFDOO\FRQÀUPHGJOLREODVWRPD *%0 ZLWK D ZKROHEUDLQ 7 JUDGLHQWHFKR HFKR SODQDU VHTXHQFH GXULQJ ,9 LQMHFWLRQRIDEROXVRIJDGROLQLXP'73$3HUIXVLRQGDWDZHUHSURFHVVHGRIIOLQH ZLWKDGHGLFDWHGVRIWZDUH1RUGLF,FHWRFUHDWHFRORXUFRGHGPDSVRIU&%9DQG .WUDQV5HJLRQVRILQWHUHVW52,VZHUHPDQXDOO\GUDZQHQFRPSDVVLQJWKHZKROH 5HVXOWV'RVHGDWDRQSDWLHQWVZHUHFROOHFWHG7KH'5/VIRUEUDLQVLQXVHV FHUYLFDO VSLQH FKHVW +5&7 SXOPRQDU\ DQJLRJUDSK\ DEGRPHQ DQG SHOYLV DV ZHOODVWUXQNH[DPLQDWLRQVXVLQJ&7',YROZHUHDQG P*\DQGXVLQJ'/3ZHUHP*\FP UHVSHFWLYHO\7KHVHDUHXSWREHORZFXUUHQW,ULVKDQG(8UHFRPPHQGDWLRQV DQGFRPSDUHIDYRXUDEO\ZLWKRWKHULQWHUQDWLRQDOVWXGLHV &RQFOXVLRQ'5/VVKRXOGEHUHJXODUO\XSGDWHGWRIDFLOLWDWHRSWLPLVDWLRQRIUDGLD WLRQGRVHV % &RPSDULVRQRIDXWRPDWLFH[SRVXUHFRQWUROLQ&7HTXLSPHQWVOLFHV 00RQWHLUR-6DQWRV&6LOYD16DQWRV&RLPEUD37 PPRQWHLUR#HVWHVFRLPEUDSW 3XUSRVH7 RHYDOXDWHWKHLQÁXHQFHRIWKHWHFKQLFDOSDUDPHWHUVUHODWHGWRWKH $(& LQWKHGRVHUHFHLYHGE\WKHSDWLHQWVDQGGLDJQRVWLFLPDJHTXDOLW\ 0HWKRGVDQG0DWHULDOV&7VFDQVZHUHDFTXLUHGLQWZRFKHVWSKDQWRPVDGXOW DQGSDHGLDWULFLQGLIIHUHQW&7HTXLSPHQWVZLWKFKDQJHVLQWHFKQLFDOSDUDP HWHUVUHODWHGWRWKHLU$(&6L[GLIIHUHQWSURWRFROVZHUHXVHGIRUDGXOWDQGIRU SDHGLDWULFDQGFKRVHQWZRLPDJHVIURPHDFKRQHWREHHYDOXDWHGXVLQJD7 DEOH VSHFLÀHGIRUWKDW7 RHYDOXDWHWKHLULQÁXHQFHLQWKHÀQDOLPDJHTXDOLW\&7',ZDQG '/3ZHUHDQDO\VHG 5HVXOWV7KHFKDQJHVPDGHLQWKHWHFKQLFDOSDUDPHWHUVGLGQRWLQGXFHVLJQLÀFDQW FKDQJHVLQWKHGLDJQRVWLFTXDOLW\LPDJLQJ:LWKWKHXVHGSURWRFROVGRVHUHGXF WLRQZDVDFKLHYHGZLWKRXWSURGXFLQJLPDJHVHQDEOHWRGLDJQRVH &RQFOXVLRQ 7KH QRLVH DQG P$V PD\ VWLOO EH KDQGOHG LQ D PRUH PHDQLQJIXO ZD\LQRUGHUWRGHFUHDVHWKHGRVHYDOXHVZLWKRXWLQWHUIHULQJLQWKHLPDJHTXDO LW\+RZHYHUWKLVDQDO\VLVPXVWEHDSSURSULDWHIRUWKHSDWLHQWDQGWKHDQDWRPLF UHJLRQXQGHUVWXG\ % ,GHQWLÀFDWLRQRIVHQWLQHOQRGHVGXULQJUDGLRJUDSKHUSHUIRUPHG O\PSKRVFLQWLJUDSK\SULRUWRVHQWLQHOO\PSKQRGHELRSV\ *&DPLOOHUL) =DUE.%RUJ*ULPD0VLGD07IUDQFLV]DUE#XPHGXPW 3XUSRVH7KHFRQFHSWWKDWPDOLJQDQWGLVHDVHSULPDULO\DIIHFWVWKHVHQWLQHOQRGHV EHIRUHEHLQJGLVVHPLQDWHGLQWRWKHD[LOODU\QRGHV$/1VKDVGUDPDWLFDOO\HYROYHG WRZDUGVPLQLPDOO\LQYDVLYHDSSURDFKHVLQEUHDVWFDQFHUPDQDJHPHQW5DGLRJUD SKHUSHUIRUPHGO\PSKRVFLQWLJUDSK\XVLQJWKHFXWDQHRXVVXEGHUPDOSHULDUHRODU DSSURDFKSULRUWR6/1%LVUDSLGO\HPHUJLQJDVWKHWHFKQLTXHIRUD[LOODU\VWDJLQJLQ EUHDVWFDQFHUOLPLWLQJWKHGLVVHFWLRQWRWKHVHQWLQHOQRGHV617KHREMHFWLYHRI WKLVVWXG\ZDVWRGHÀQHWKHUROHRIUDGLRJUDSKHUSHUIRUPHGO\PSKRVFLQWLJUDSK\SULRU WR6/1%DQGWRHVWDEOLVKWKHFRUUHODWLRQEHWZHHQWKHQXPEHUVRI61VYLVXDOLVHG RQO\PSKRVFLQWLJUDSK\DQGWKHQXPEHURIVXUJLFDOO\LGHQWLÀHG61V 0HWKRGV DQG 0DWHULDOV$ TXDQWLWDWLYH DSSURDFK ZDV FKRVHQ IRU WKLV QRQ H[SHULPHQWDOFRUUHODWLRQW\SHRIVWXG\%HWZHHQ0D\DQG'HFHPEHUD WRWDORIIHPDOHEUHDVWFDQFHUSDWLHQWVPHDQDJH\HDUVZKRXQGHUZHQW 6/1%ZLWKSDUWLDORUWRWDOEDFNXSD[LOODU\QRGHGLVVHFWLRQ$/1'ZHUHHQUROOHGLQ WKLVVWXG\/\PSKRVFLQWLJUDSK\UHSRUWVDQGKLVWRORJ\UHVXOWVZHUHUHWURVSHFWLYHO\ HYDOXDWHG 5HVXOWV $PLQLPXPRIVHQWLQHOQRGHZDVYLVXDOLVHGRQO\PSKRVFLQWLJUDSK\LQ RXWRISDWLHQWV6XFFHVVIXOLPDJLQJZDVKLJKO\SUHGLFWLYHSRI DVXFFHVVIXO6/1%5HVXOWVVKRZHGDVLJQLÀFDQWDVVRFLDWLRQSEHWZHHQ WKHQXPEHURI61VYLVXDOLVHGRQO\PSKRVFLQWLJUDSK\DQGWKHQXPEHURIVXUJLFDOO\ LGHQWLÀHG61VGXULQJ6/1%ZLWKDFRQFRUGDQFHUDWHRI &RQFOXVLRQ/\PSKRVFLQWLJUDSK\SHUIRUPHGE\UDGLRJUDSKHUVZDVVKRZQWREH LQGLVSHQVDEOHLQWKHUHOLDEOHSHUIRUPDQFHRI6/1% % 5LQJOLNHFRQWUDVWHQKDQFHPHQWLQOLYHUPHWDVWDVHVIURPUHFWDO WXPRXUVW\SLFDOÀQGLQJV" 0.LVV%/RPED\0LVNROF+8 3XUSRVH5HFWDOFDQFHUFDQPHWDVWDVL]HWRDOPRVWDQ\ORFDWLRQLQWKHERG\PRVW FRPPRQO\WKHOLYHUOXQJDQGSHULWRQHXP7KHORQJWHUPUHVXOWVKDYHLPSURYHG EXWORQJWHUPVXUYLYDOUHPDLQVHOXVLYHIRUPRVW7KHUHDUHVHYHUDOWKHUDSHXWLFRS WLRQVVXUJLFDOORFDORUV\VWHPLFFKHPRWKHUDS\WRPDQDJHPHWDVWDVHV 0HWKRGVDQG0DWHULDOV%HWZHHQDQGZHH[DPLQHG RQFRORJLFDOSDWLHQWVZLWKDNQRZQSULPDU\WXPRXUDQGKLVWRORJLFDOO\HVWDEOLVKHG OLYHU PHWDVWDVHV7KHVH SDWLHQWV XQGHUZHQW FRQWUDVWHQKDQFHG &7 D 6LHPHQV 6RPDWRP'HÀQLWLRQ$6[GHWHFWRUURZ0'&7DQGRUDFRQWUDVWHQKDQFHG OLYHU05,D6LHPHQV0DJQHWRP6\PSKRQ\7:HDQDO\VHGWKHYLVXDODS 6FLHQWLILF6HVVLRQ 6 &$' ( ) *+% (XURSHDQ&RQJUHVVRI 5DGLRORJ\ $8& S DQG 7 FXWRII VHQVLELOLW\ VSHFLÀFLW\ $8& S &RQFOXVLRQ*LYHQWKHHOHYDWHGGLDJQRVWLFDFFXUDF\REVHUYHGIRUWKHLQGLFDWHG FXWRIIVPXOWLPRGDO05056DQG'6&3:,FDQEHDQLQVWUXPHQWDOPHWKRGIRU WKHQRQLQYDVLYHGLIIHUHQWLDWLRQEHWZHHQWXPRXUUHFXUUHQFHDQGUDGLRQHFURVLV % 1RQLQYDVLYHGLIIHUHQWLDWLRQRIKLJKDQGORZJUDGHJOLRPDDSXOVHG DUWHULDOVSLQODEHOOLQJVWXG\XVLQJEROXVDUULYDOWLPHV -)XUWQHU96FKRHSI*.DVSULDQ0:HEHU*:LGKDOP 6:ROIVEHUJHU03UHXVVHU-$+DLQIHOOQHU'3UD\HU9LHQQD$7 MXOLDIXUWQHU#PHGXQLZLHQDFDW 3XUSRVH 3XOVHG DUWHULDO VSLQ ODEHOOLQJ S$6/ LV D QRQLQYDVLYH 05, SHUIXVLRQ PHWKRGXVLQJWKHZDWHULQWKHDUWHULDOEORRGDVHQGRJHQRXVFRQWUDVWDJHQW7KH SXUSRVH RI WKLV VWXG\ ZDV WR GHWHUPLQH WKH PRVW VXLWDEOH S$6/ LQYHUVLRQ WLPH SRLQW7,IRUWKHGLIIHUHQWLDWLRQEHWZHHQKLJKJUDGHDQGORZJUDGHJOLRPDXVLQJ DPXOWL7,S$6/DSSURDFKZKLFKWUDFNVWKHODEHOOHGEROXVG\QDPLFDOO\RYHUWLPH 0HWKRGVDQG0DWHULDOV7KLUW\ÀYHSDWLHQWVZLWKJOLRPDVKLVWRORJLFDOO\FODVVLÀHG DVORZJUDGHQ RUKLJKJUDGHQ DFFRUGLQJWRWKH:+2EUDLQWXPRXU FODVVLÀFDWLRQZHUHLQFOXGHG$7 HVOD05VFDQQHU7ULR7LP6LHPHQV0HGLFDO 6ROXWLRQ(UODQJHQ*HUPDQ\ZDVXVHGWRSHUIRUPS$6/VHTXHQFHVDWHLJKWGLIIHU HQWLQYHUVLRQWLPHSRLQWVPVPVPVPVPVPV PV PV 7KH EROXV DUULYDO WLPH UHÁHFWLQJ WKH PD[LPXP RI WXPRXU SHUIXVLRQ IRU DOO À[HG LQYHUVLRQ WLPH SRLQWV ZDV FDOFXODWHG$WKUHHZD\ PL[HG $129$ZDVXVHGWRUHYHDOSRWHQWLDOGLIIHUHQFHVLQWKHEROXVDUULYDOWLPHEHWZHHQ KLJKJUDGHDQGORZJUDGHJOLRPDV 5HVXOWV7KHGLIIHUHQFHRIPHDVXUHGVLJQDOLQWHQVLWLHVEHWZHHQKLJKJUDGHDQG ORZJUDGHJOLRPDVREWDLQHGVWDWLVWLFDOO\VLJQLÀFDQWUHVXOWVH[FOXVLYHO\DWPV S )RUDOORWKHUGHWHUPLQHGLQYHUVLRQWLPHSRLQWVWKHUHZDVQRVLJQLÀFDQW GLIIHUHQFHRIVLJQDOLQWHQVLW\EHWZHHQKLJKJUDGHDQGORZJUDGHJOLRPDVSYDOXHV UDQJHGIURPWR &RQFOXVLRQ2XUÀQGLQJVVXJJHVWWKDWXVLQJS$6/IRUWKHHYDOXDWLRQRIWXPRXU SHUIXVLRQWKHPRVWVXLWDEOHLQYHUVLRQWLPHSRLQWIRUGLIIHUHQWLDWLRQRIKLJKJUDGH IURPORZJUDGHJOLRPDLVPV8VHRIWKLVS$6/7,PD\IDFLOLWDWHDQRQLQYDVLYH FKDUDFWHULVDWLRQRIVXFKWXPRXUVLQWKHIXWXUH % 6LPXOWDQHRXV>)@)(7053(7LQSDWLHQWVZLWKFHUHEUDOWXPRXUV FRPSDULVRQZLWKFRQYHQWLRQDO3(7&7 06RXYDW]RJORX6)XHUVW&.UXVFKNH61HNROOD6=LHJOHU&*DQWHU (5XPPHQ\06FKZDLJHU$'U]H]JD0XQLFK'(PVRXYDW]#\DKRRGH 3XUSRVH 7 R FRPSDUH SHUIRUPDQFH EHWZHHQ 3(7&7 DQG UHFHQWO\ LQWURGXFHG ZKROHERG\053(7FRQFHUQLQJHYDOXDWLRQRIEUDLQWXPRXUV 0HWKRGV DQG 0DWHULDOV 7ZHOYH SDWLHQWV UHIHUUHG WR > )@)(73(7 IRU EUDLQ WXPRXUGLDJQRVWLFVXQGHUZHQWDVLQJOHLQMHFWLRQGXDOLPDJLQJSURWRFROLQFOXGLQJ D3(7&7VFDQ6LHPHQV7UXHSRLQWPLQSLPLQ'DFTXLVLWLRQDQGD VXEVHTXHQW053(7VFDQ6LHPHQVP05PLQSLPLQ'DFTXLVLWLRQ DIWHULQMHFWLRQRI0%T>)@)(7 ,PDJHVZHUHUHFRQVWUXFWHGZLWKÀOWHUHG EDFNSURMHFWLRQ+DQQPP]RRPDWWHQXDWLRQFRUUHFWLRQZDVSHUIRUPHG XVLQJORZGRVH&7IRUWKH3(7&7DQG'L[RQ05VHTXHQFHVIRU053(7 ,PDJHV ZHUHLQWHUSUHWHGYLVXDOO\DQGE\VHPLTXDQWLWDWLYHDQDO\VLV7KHUHVSHFWLYHOHVLRQ DQG%J689VZHUHFRPSDUHGDVZHOODVWKHOHVLRQEDFNJURXQGUDWLRV7%JXVLQJ WKH:LOFR[RQWHVW 5HVXOWV9LVXDOLQWHUSUHWDWLRQWXUQHGRXWVXVSLFLRQRIWXPRXUWLVVXHLQVFDQV ZLWKERWK053(7DQG3(7&7 SDWLHQWVZHUHUHDGDVQHJDWLYH2YHUDOO7%J UDWLRVDVZHOODVOHVLRQDQG%J689PD[YDOXHVZHUHQRWGLIIHUHQWEHWZHHQ3(7&7 DQG053(7 +RZHYHUWKHPHDQOHVLRQDQG%J689VZHUHVLJQLÀFDQWO\KLJKHUIRU 3(7&7 DVFRPSDUHGWRWKHUHVSHFWLYH053(7YDOXHVOHVLRQVYV S %JYV S 7KHUH ZDV D VLJQLÀFDQW FRUUHODWLRQ EHWZHHQWKHUHVSHFWLYHPD[DQGPHDQOHVLRQDQG%J689VDVZHOODVEHWZHHQ WKHUHVSHFWLYH7%JUDWLRV &RQFOXVLRQ,PDJLQJRIEUDLQWXPRXUVZLWK>)@)(7LVIHDVLEOHZLWKWKHLQWHJUDWHG ZKROHERG\053(7VFDQQHUZLWKKLJKLPDJHTXDOLW\'HVSLWHWHFKQRORJLFDOGLI IHUHQFHVWKHTXDQWLWDWLYHHYDOXDWLRQRI>)@)(73(7GDWDZLWK053(7UHYHDOV FRPSDUDEOHUHVXOWVDVZLWK3(7&7 LQGLFDWLQJWKDWHVWDEOLVKHGOHVLRQEDFNJURXQG UDWLRWKUHVKROGVIRUGLVWLQJXLVKLQJPDOLJQDQWEUDLQWXPRXUWLVVXHFDQEHWUDQVIHUUHG FRQWUDVWHQKDQFLQJOHVLRQDQGQRQHQKDQFLQJSHULWXPRUDODUHD'DWDDQDO\VLVZDV SHUIRUPHGZLWKWKHKLVWRJUDPDQDO\VLVRIQRUPDOLVHG&%9VDQG.WUDQVIURPWKH HQWLUH WXPRXU YROXPH 7KH IROORZLQJ KLVWRSDWKRORJLFDO YDULDEOHV ZHUH LQFOXGHG LQWRWKHVWDWLVWLFDODQDO\VLVSUROLIHUDWLRQLQGH[0LE.LWXPRXUDQJLRJHQHVLV HQKDQFHURI=HVWH(=+HSLGHUPDOJURZWKIDFWRUUHFHSWRU(*)5DQGS 5HVXOWV)RUZKROHWXPRXUKLVWRJUDPDQDO\VLVPHDQU&%9SU DQG U&%9PD[LPXPYDOXHVSU ZHUHIRXQGWREHVLJQLÀFDQWO\DVVRFLDWHG ZLWK(*)5H[SUHVVLRQ0HDQDQGPD[LPXPU&%9YDOXHVWHQGHGWREHKLJKHULQ SDWLHQWVVKRZLQJLQFUHDVHGRYHUH[SUHVVLRQRI(*)5ZLWKVLJQLÀFDQWGLIIHUHQFHV EHWZHHQVXEJURXSVDVVKRZQE\SRVWKRFDQDO\VLVS1RVLJQLÀFDQWDVVRFLD WLRQVZHUHIRXQGEHWZHHQ.WUDQVDQGKLVWRSDWKRORJLFDOPDUNHUV &RQFOXVLRQ$FFRUGLQJ WR RXU ILQGLQJV (*)5 RYHUH[SUHVVLRQ D PROHFXODU PDUNHUDVVRFLDWHGZLWKWXPRXULQYDVLYHQHVVDQJLRJHQHVLVDQGUDGLRUHVLVWDQFH LVSRVLWLYHO\FRUUHODWHGZLWKU&%9YDOXHVZKLFKFRXOGUHSUHVHQWDQHZSRWHQWLDO SUHRSHUDWLYHSUHGLFWRURI*%0UHVSRQVHWRWKHUDS\ % +LJKGLDJQRVWLFDFFXUDF\RIG\QDPLFVXVFHSWLELOLW\FRQWUDVW'6& PDJQHWLFUHVRQDQFH05SHUIXVLRQLPDJLQJWRGLVWLQJXLVKUDGLDWLRQ QHFURVLVIURPUHFXUUHQWWXPRXULQKLJKJUDGHJOLRPDSDWLHQWV 57MLRQJ09DQGHQ%HQW06PLWV5RWWHUGDP1/ 3XUSRVH7 RDVVHVVGLDJQRVWLFDFFXUDF\DQGRSWLPDOUHODWLYHFHUHEUDOEORRGYRO XPHU&%9UDWLRWKUHVKROGVRIG\QDPLFVXVFHSWLELOLW\FRQWUDVWHQKDQFHG'6& SHUIXVLRQWRGLVWLQJXLVKUDGLDWLRQQHFURVLVIURPUHFXUUHQWKLJKJUDGHJOLRPD+** 0HWKRGVDQG0DWHULDOV)URP+**SDWLHQWVVFDQQHGDWPRQWKLQWHUYDOV EHWZHHQ$SULODQG-XO\ZLWKDVWDQGDUGLVHG05LPDJLQJSURWRFRO PDOHVPHDQDJH\ZKRKDGXQGHUJRQHUDGLRWKHUDS\DQGVKRZHGQHZO\ GHYHORSHGFRQWUDVWHQKDQFLQJOHVLRQVZHUHLQFOXGHGLQWKLVUHWURVSHFWLYHVWXG\ '6&SHUIXVLRQLPDJHVZHUHREWDLQHGDW7*(+HDOWKFDUH86ZLWKDPO SUHORDGDQGPO*DGRYLVW%D\HU3KDUPDEROXVDGPLQLVWHUHGDWPOVXV LQJJUDGLHQWHFKRHFKRSODQDULPDJLQJ75PV5DWLRVRIPD[LPXPU&%9 LQFRQWUDVWHQKDQFLQJOHVLRQVDQGFRQWUDODWHUDOZKLWHPDWWHUZHUHFDOFXODWHG7KH RXWFRPHPHDVXUHZDVWXPRXUSURJUHVVLRQGHÀQHGDVFOLQLFDODQGRUUDGLRORJLFDO SURJUHVVLRQGXULQJPRQWKIROORZXS:LWKORJLVWLFUHJUHVVLRQDQDO\VLVWKHLQÁXHQFH RISDWLHQWVҋDJHVH[WXPRXUW\SHDQGU&%9YDOXHVRQRXWFRPHZDVGHWHUPLQHG $UHFHLYHURSHUDWLQJFKDUDFWHULVWLF52&FXUYHZDVFUHDWHGXVLQJVHQVLWLYLW\DQG VSHFLÀFLW\RIGLIIHUHQWU&%9UDWLRWKUHVKROGVIRUSURJUHVVLRQ 5HVXOWV2QO\WKHU&%9UDWLRLQÁXHQFHGRXWFRPHS$WDQU&%9UDWLRRI VHQVLWLYLW\ZDVREWDLQHGZLWKVSHFLÀFLW\RI $WDQU&%9UDWLRRI VSHFLÀFLW\ZDVREWDLQHGZLWKVHQVLWLYLW\RI7KHDUHDXQGHUWKH52& FXUYHGLDJQRVWLFDFFXUDF\ZDV6( &RQFOXVLRQ'6&SHUIXVLRQ05LPDJLQJKDVKLJKGLDJQRVWLFDFFXUDF\WR GLIIHUHQWLDWHUHFXUUHQW+**IURPUDGLDWLRQQHFURVLV0D[LPXPVHQVLWLYLW\LVREWDLQHG DWDQU&%9UDWLRWKUHVKROGRI % 'LDJQRVWLFDFFXUDF\RIPXOWLPRGDO05056':,'7,DQG'6& 3:,WXPRXUUHFXUUHQFHDQGUDGLRQHFURVLV 93DQDUD3 $0DWWHL'7 RUWRUD66DOLFH&%ULJDQWL$5&RWURQHR 0&DXOR$7 DUWDUR&KLHWL,7YDOHSDQD#OLEHURLW 3XUSRVH&RQYHQWLRQDO05RIWHQIDLOVLQWKHGLIIHUHQWLDWLRQEHWZHHQWXPRXUUHFXU UHQFHDQGDOWHUDWLRQVLQGXFHGE\WKHUDS\UDGLDWLRQWKHUDS\DQGFKHPRWKHUDS\ LQSULPLWLYHEUDLQWXPRXUV7KHDLPRIWKLVVWXG\ZDVWRGHWHUPLQHWKHFXWRIIVRI SHUIXVLRQ3:,VSHFWURVFRS\'056GLIIXVLRQ':,DQGGLIIXVLRQWHQVRU'7, ZLWKDKLJKÀHOGVFDQQHU7DQGWKHUHODWLYHGLDJQRVWLFDFFXUDF\LQGHWHUPLQLQJ EHWZHHQWXPRXUUHFXUUHQFHDQGSRVWDGMXYDQWWUHDWPHQWFHUHEUDOPRGLÀFDWLRQV 0HWKRGVDQG0DWHULDOVSDWLHQWVZKRKDGXQGHUJRQHVXUJHU\DQGDGMXYDQW UDGLDWLRQWKHUDS\IRUFHUHEUDOJOLRPDVZHUHUHWURVSHFWLYHO\HYDOXDWHG([DPVZHUH DFTXLUHGZLWKD7 )RXUUHJLRQVRILQWHUHVW52,ZHUHDQDO\VHGDUHDRIFRQWUDVW HQKDQFHPHQW&(7VLJQDOORZHUWKDQWKDWRIOLTXRU77VLJQDOJUHDWHUWKDQ RUHTXDOWROLTXRU7DQGDUHDZLWKUHGXFHGGLIIXVLRQ5'6HYHUDOSDUDPHWHUV ZHUHGHWHUPLQHGIRUHDFK52,U&%9HU077 &KR&U&KR1$$/LS&U/DF&U $'&DQG)$'LIIHUHQFHVZHUHHYDOXDWHGZLWKWWHVWDQG52,DQDO\VLVIRURSWLPDO FXWRIIV*ROGVWDQGDUGIRUZDVHLWKHUKLVWRORJ\RUWZR\HDUIROORZXS 5HVXOWV3DUDPHWHUVZKLFK\LHOGHGVWDWLVWLFDOO\VLJQLÀFDQWGLIIHUHQFHVZHUHU&%9LQ &(FXWRII!VHQVLELOLW\ VSHFLÀFLW\ DUHDXQGHUFXUYH$8& S 7FXWRII!VHQVLELOLW\ VSHFLÀFLW\ $8& S DQG 7FXWRII! VHQVLELOLW\ VSHFLÀFLW\ $8& S &KR&U LQ 7 FXWRII! VHQVLELOLW\ VSHFLÀFLW\ $8& S DQG /LS&U LQ &( FXWRII VHQVLELOLW\ VSHFLÀFLW\ 6FLHQWLILF6HVVLRQ $ 6&'()*+%(XURSHDQ&RQJUHVVRI 5DGLRORJ\ 6XQGD\ 5HVXOWV7KHUHZDVDVWDWLVWLFDOO\VLJQLÀFDQWGLIIHUHQFHLQWKHGHWHFWLRQRIKDHPRU UKDJHEHWZHHQWKHFRQYHQWLRQDO05LPDJLQJDQG6:,3LQKLJKJUDGH JOLRPDVEXWQRWLQ3&16/3!7KHUHZDVDVWDWLVWLFDOO\VLJQLÀFDQWGLIIHUHQFH LQWKHKDHPRUUKDJHUDWHVRIWKHVHWZRWXPRXUVRQ6:,37KHKDHPRU UKDJLFYROXPHRIKLJKJUDGHJOLRPDVZDVVWDWLVWLFDOO\KLJKHUWKDQ3&16/RQ6:, 1RYHVVHOVZHUHIRXQGLQDOOWKHOHVLRQVRI3&16/7KHQXPEHURILQWUDOHVLRQDO YHVVHOVRIKLJKJUDGHJOLRPDVZDVVWDWLVWLFDOO\KLJKHUWKDQ3&16/RQ6:, &RQFOXVLRQ6:,LVPRUHVHQVLWLYHWKDQWKHFRQYHQWLRQDO05LPDJLQJLQGHWHFW LQJKDHPRUUKDJHLQKLJKJUDGHJOLRPDV6:,LVKHOSIXOWRGLIIHUHQWLDWHKLJKJUDGH JOLRPDVDQG3&16/ % 6XEHSHQG\PDOQRGXOHVDQGJLDQWFHOOWXPRXUSUHYDOHQFHLQ JHQHWLFDOO\VWXGLHGWXEHURXVVFOHURVLVFRPSOH[SDWLHQWV &0LFKHOR]]L ) *DOOL*'L/HR) 6LOYD%DUERVD ) 6DUGDQHOOL*&RUQDOED0LODQ,76DQ'RQDWR0LODQHVH,7 FDWHULQDPLFKHOR]]L#JPDLOFRP 3XUSRVH 7 R HVWLPDWH WKH DVVRFLDWLRQ DPRQJ WKH SUHVHQFH RI VXEHSHQG\PDO QRGXOHV 6(1 VXEHSHQG\PDO JLDQW FHOO WXPRXU 6*&7 DQG JHQH PXWDWLRQ LQ WXEHURXVVFOHURVLVFRPSOH[76&SDWLHQWV 0HWKRGVDQG0DWHULDOV&RQWUDVWHQKDQFHGEUDLQ05,VWXGLHVRI76&SDWLHQWV ZHUHUHWURVSHFWLYHO\UHYLHZHGE\WZRQHXURUDGLRORJLVWVLQFRQVHQVXV7KHQXPEHU RI6(1VZDVUHFRUGHG$Q\HQKDQFLQJ6(1FPLQGLDPHWHUDQGSODFHGQHDU WKHIRUDPHQRI0RQURZDVFRQVLGHUHGDV6*&7 7ZREUDLQ05,IROORZXSH[DPV IRUHDFKSDWLHQWZLWK6*&7ZHUHHYDOXDWHGWRDVVHVVWXPRXUJURZWKLQWHUPVRI GLDPHWHUDQGYROXPH3DWLHQWVZHUHFDWHJRULVHGLQWRWKUHHVXEJURXSVDFFRUGLQJ WRJHQHWLFDVVHVVPHQW76&76&DQGQRPXWDWLRQLGHQWLÀHG10,SDWLHQWV :LOFR[RQDQG&KLVTXDUHGWHVWVZHUHXVHG 5HVXOWV2XWRISDWLHQWVZHUH10,76&76&)LIW\VKRZHGDWOHDVW RQH6(1$KLJKHUWUHQGRI6(1DQG6*&7DPRQJ76&SDWLHQWVZDVREVHUYHG S DQGS UHVSHFWLYHO\7KHUHZDVDVLJQLÀFDWLYHDVVRFLDWLRQEHWZHHQ 6*&7DQG6(1DOORIWKH6*&7SDWLHQWVKDGDWOHDVWRQHIXUWKHU6(1ZKLOHQRQH RIWKHSDWLHQWVZLWKRXW6(1VKRZHGDQ6*&7S $WIROORZXSWKHPHGLDQ 6*&7 GLDPHWHU VLJQLÀFDQWO\ LQFUHDVHG IURP PP WR PP S ZKLOH WKHPHGLDQYROXPHVLJQLÀFDQWO\LQFUHDVHGIURPPPWRPPS &RQFOXVLRQ76&SDWLHQWVZLWK6(1VDUHPRUHOLNHO\WRSUHVHQWZLWK6*&7DQGD FORVHUIROORZXSLVVXJJHVWHGLQSDUWLFXODULIDIIHFWHGZLWK76&PXWDWLRQ9ROXPH DVVHVVPHQWLVPRUHVHQVLWLYHWKDQGLDPHWHUWRHYDOXDWHWXPRXUJURZWK % &RQWULEXWLRQRIGLIIXVLRQDQGSHUIXVLRQZHLJKWHGPDJQHWLF UHVRQDQFHLPDJLQJLQWKHGLIIHUHQWLDOGLDJQRVLVRIVHOODUDQG SDUDVHOODUWXPRXUVSUHOLPLQDU\UHSRUW -%ODGRZVND$=LPQ\3 6]HZF]\N0*X]LQVNL3 7 DEDNRZ 0.R]ED*RV]W\ãD:-DUPXQGRZLF]06DVLDGHN:URFODZ3/ PEODGRZ#ZSSO 3XUSRVH7KHPRVWFRPPRQSLWXLWDU\WXPRXUVDUHDGHQRPDVZKLFKKRZHYHUPD\ EHPLPLFNHGE\RWKHUWXPRXUVWKDWFDQVKRZYHU\VLPLODUDSSHDUDQFHLQSODLQ05, 7KHDLPRIRXUVWXG\ZDVWRHYDOXDWHXVHIXOQHVVRIGLIIXVLRQ':,DQGSHUIXVLRQ ZHLJKWHG05LPDJLQJ3:,LQWKHGLIIHUHQWLDOGLDJQRVLVRIVHOODUSDUDVHOODUWXPRXUV 0HWKRGVDQG0DWHULDOV7ZHQW\HLJKWVHOODUSDUDVHOODUWXPRXUVDGHQRPDV PHQLQJLRPDVLQWUDVHOODUKDHPDQJLREODVWRPDVXSUDVHOODUJOLRPDSLWXLWDU\ DEVFHVVDQGKDPDUWRPDXQGHUZHQWVWDQGDUG05,DVZHOODV':,DQG3:,XVLQJ 7 HVOD05XQLW,QHDFKWXPRXUPLQU$'&DQGPD[U&%9PHDVXUHPHQWVZHUH FDOFXODWHG7KHUHODWLYHSHDNKHLJKWU3+DQGWKHUHODWLYHSHUFHQWDJHRIVLJQDO LQWHQVLW\UHFRYHU\U365ZHUHDOVRHYDOXDWHG 5HVXOWV7KHPHDQYDOXHVRIPLQU$'&PD[U&%9U3+DQGU365IRUGLIIHUHQW WXPRXUW\SHVZHUHDVIROORZVDGHQRPDVPHQLQJLRPDV KDHPDQJLREODVWRPDJOLRPD DEVFHVVKDPDUWRPD UHVSHFWLYHO\7KHUHZHUHVLJQLÀFDQWGLIIHUHQFHVEHWZHHQDGHQRPDVDQGDOO RWKHUWXPRXUW\SHVLQSHUIXVLRQSDUDPHWHUVDQGDOVRLQPLQU$'&YDOXHV7KHUH ZHUHQRVLJQLÀFDQWGLIIHUHQFHVLQU3+DQGU365EHWZHHQDGHQRPDVDQGPHQLQJL RPDVZKLOHRWKHUWXPRXUVUHYHDOHGVLJQLÀFDQWO\GLIIHUHQWYDOXHVRIU3+DQGU365 FRPSDUHGWRSLWXLWDU\DGHQRPDV &RQFOXVLRQ 3:, DQG ':, VHHP WR EH YHU\ XVHIXO LQ GLIIHUHQWLDO GLDJQRVLV RI VHOODUSDUDVHOODUWXPRXUVZKDWPD\EHRIKLJKLPSRUWDQFHLQWKHFOLQLFDOSUDFWLFH HVSHFLDOO\LQSURSHUFKRLFHRIVXUJLFDODSSURDFK % ,VRODWHGFHUHEUDOVXVFHSWLELOLW\DUWHIDFWVLQSDWLHQWVZLWKPDOLJQDQW PHODQRPDPHWDVWDVLVRUQRW" &*UDPVFK6*RHULFNH) %HKUHQV$.UDVQ\/=LPPHU'6FKDGHQGRUI 0)RUVWLQJ06FKODPDQQ(VVHQ'(&DUROLQ*UDPVFK#XNHVVHQGH 3XUSRVH$WLQLWLDOVWDJLQJSDWLHQWVZLWKPDOLJQDQWPHODQRPDRIWHQVKRZLVRODWHG FHUHEUDO VXVFHSWLELOLW\ DUWHIDFWV LQ 7 ZHLJKWHG6:, VHTXHQFHV ZLWKRXW FRU UHVSRQGLQJOHVLRQLQFRQWUDVWHQKDQFHG7ZHLJKWHG05LPDJHV&DYHUQRPDV PLFURKDHPRUUKDJHVDQGPHODQLQFRQWDLQLQJPHWDVWDVHVZLWKRXWFRQWUDVWHQKDQFH PHQWUHSUHVHQWSRVVLEOHGLIIHUHQWLDOGLDJQRVHVIRUWKHVHÀQGLQJV3XUSRVHRIWKLV VWXG\ZDVWRHYDOXDWHLIWKHVHOHVLRQVDOUHDG\UHSUHVHQWPHWDVWDVHV 0HWKRGVDQG0DWHULDOV05LPDJHV7RISDWLHQWVZPZLWKPD OLJQDQWPHODQRPDDQGQRKLVWRU\RIFHUHEUDOPHWDVWDVLVEXWVLJQDOLQWHQVLW\ORVV LQ7 6:,DWLQLWLDOVWDJLQJE\05,ZHUHUHYLHZHGUHWURVSHFWLYHO\05,SURWRFRO FRQVLVWHG RI D 7 6:, D )/$,5 VHTXHQFH QRQHQKDQFHG 7Z DQGFRQWUDVW HQKDQFHG 035 3DWLHQWV ZHUH IROORZHG E\ 05, LQ PHDQ PRQWKV UDQJH PRQWKV 5HVXOWV$OOSDWLHQWVVKRZHGLQPHDQUDQJHK\SRLQWHQVHOHVLRQVLQ7 6:,1RQHRIWKHVHOHVLRQVFRXOGEHFRQÀUPHGDVFHUHEUDOPHWDVWDVHVE\IROORZXS &RQFOXVLRQ ,VRODWHG FHUHEUDO VXVFHSWLELOLW\ DUWHIDFWV LQ 7 6:, VHTXHQFHV ZLWKRXWFRUUHODWHLQFRQWUDVWZHLJKWHG7LPDJHVGRQRWVHHPWRLQGLFDWHFHUHEUDO PHWDVWDVHV % (YDOXDWLRQRIVXVFHSWLELOLW\ZHLJKWHGLPDJLQJLQGLVWLQJXLVKLQJRI KLJKJUDGHJOLRPDVIURPSULPDU\FHQWUDOQHUYRXVV\VWHPO\PSKRPDV '&DR< 'LQJ=;LQJ-/L0;LRQJ)X]KRX&1 FDRGU#\DKRRFRPFQ 3XUSRVH7 RDQDO\VHWKHÀQGLQJVRIKLJKJUDGHJOLRPDVDQG3&16/RQ6:,DQG FRQYHQWLRQDO05LPDJLQJDQGWRHYDOXDWH6:,LQGLIIHUHQWLDWLQJEHWZHHQWKHVH WZRWXPRXUV 0HWKRGVDQG0DWHULDOV7KLVVWXG\ZDVDSSURYHGE\WKHLQVWLWXWLRQDOUHYLHZERDUG DQGLQIRUPHGFRQVHQWZDVREWDLQHGIURPDOOSDWLHQWVSDWLHQWVZLWKKLJKJUDGH JOLRPDVSDWLHQWVZLWK3&16/ZKRKDGXQGHUJRQHFRQYHQWLRQDO05LPDJLQJDQG 6:,ZHUHFRQÀUPHGE\KLVWRSDWKRORJ\7KHQXPEHURIOHVLRQVZKLFKZHUHIRXQG KDHPRUUKDJHZDVVHSDUDWHO\FRXQWHGRQWKHFRQYHQWLRQDO05LPDJLQJDQG6:, WKHQKDHPRUUKDJHGHWHFWLRQUDWHZLWKLQWXPRXUVEHWZHHQWKHVHWZRVHTXHQFHV ZDVVHSDUDWHO\FRPSDUHGKDHPRUUKDJHUDWHEHWZHHQWKHVHWZRWXPRXUVRQ6:, ZDVDOVRVWDWLVWLFDOO\DQDO\VHG)XUWKHUPRUHWKHYROXPHRIKDHPRUUKDJHDQGWKH QXPEHURILQWUDOHVLRQDOYHVVHOVRIWKHVHWZRWXPRXUVZHUHVWDWLVWLFDOO\DQDO\VHG 6FLHQWLILF6HVVLRQ 6 &$' ( ) *+% (XURSHDQ&RQJUHVVRI 5DGLRORJ\ 6FLHQWLILF6HVVLRQ $ 6&'()*+%(XURSHDQ&RQJUHVVRI 5DGLRORJ\ 0RQGD\ 0RQGD\0DUFK 6FLHQWLILF6HVVLRQ 6 &$' ( ) *+% (XURSHDQ&RQJUHVVRI 5DGLRORJ\ % 3RVLWLRQDOYHQRXV05DQJLRJUDSK\DQRSHUDWRULQGHSHQGHQWWRROWR HYDOXDWHFHUHEUDOYHQRXVRXWÁRZKDHPRG\QDPLFV 3 1LJJHPDQQ 06HLIHUW$)RHUJ++6FKLOG+8UEDFK 7 .ULQJV%RQQ'($VFKKHLP'(7RURQWR21&$ SDVFDOQLJJHPDQQ#XNEXQLERQQGH 3XUSRVH&KURQLFFHUHEURVSLQDOYHQRXVLQVXIÀFLHQF\&&69,KDVEHHQSURSRVHG DVDFDXVHIRUPXOWLSOHVFOHURVLV06$FFRUGLQJWRWKLVWKHRU\VWULFWXUHVRIWKH LQWHUQDOMXJXODUYHLQV,-9DUHDPRQJVWWKHGHVFULEHGFDXVHVIRU&&69,/LWWOHLV NQRZQDERXWWKHLULQÁXHQFHRQWKHKDHPRG\QDPLFVRIWKHFHUHEUDOYHQRXVEORRG RXWÁRZ&9%2:HHPSOR\HGSRVLWLRQDO05,WRGHVFULEHWKHLQÁXHQFHRISRVLWLRQDO FKDQJHVRQWKH&9%2 0HWKRGVDQG0DWHULDOV8VLQJWKH)21$58SULJKW05,DYHQRXVWLPHRIÁLJKW DQJLRJUDSK\RIWKHFHUYLFDOUHJLRQZDVDFTXLUHGLQVXSLQHDQGVLWWLQJSRVLWLRQVLQ ÀIWHHQKHDOWK\YROXQWHHUV7KHLPDJHTXDOLW\ZDVUDWHGWKHSRVLWLRQDOÀQGLQJVDQG LQWHULQGLYLGXDOYDULDQFHVLQWKH&9%2ZHUHDQDO\VHG 5HVXOWV$YHQRXVWLPHRIÁLJKWDQJLRJUDSK\RIWKHFHUYLFDOVSLQHZDVIHDVLEOH ZLWKJRRGLPDJHTXDOLW\6WULFWXUHVRIRQHRUERWK,-9ZHUHIRXQGLQRIKHDOWK\ YROXQWHHUVLQVXSLQHSRVLWLRQKRZHYHUQRQHZDVYLVLEOHLQXSULJKWSRVLWLRQ7KH ,-9ZDVQRWWKHPDLQRXWÁRZURXWHLQWKHHUHFWSRVLWLRQ &RQFOXVLRQ,-9VWULFWXUHVDUHDFRPPRQÀQGLQJLQKHDOWK\YROXQWHHUVLQVXSLQH SRVLWLRQ7KH\VHHPWREHRIQRUHOHYDQFHLQWKHHUHFWSRVLWLRQ7KLVTXHVWLRQVWKH YDOLGLW\RIWKLVFULWHULRQIRUWKHGLDJQRVLVRI&&69,5HÁX[LQWRWKHYHQRXVV\VWHP ZDVQRWYLVXDOLVHGDQGLWUHPDLQVWREHVHHQZKHWKHULWFDQEHLGHQWLÀHGLQSDWLHQWV ZLWK063RVLWLRQDO05,HQDEOHVRSHUDWRULQGHSHQGHQWHYDOXDWLRQRIWKH&9%2 DQGPD\KHOSWRFODULI\WKHYDOLGLW\RIWKHFULWHULDIRU&&69, % 7HVOD05,RIWKHLQWUDFUDQLDODUWHULDOYDVFXODWXUHQRQHQKDQFHG YHUVXVFRQWUDVWHQKDQFHG035$*(LPDJLQJ /8PXWOX17KH\VRKQ60DGHUZDOG.:UHGH3 'DPPDQQ 0(/DGG6/*RHULFNH0)RUVWLQJ06FKODPDQQ (VVHQ'(/DOH8PXWOX#XNHVVHQGH 3XUSRVH1RQHQKDQFHG7035$*(LPDJLQJLVNQRZQWRSURYLGHDKRPRJHQHRXV K\SHULQWHQVHYHVVHOVLJQDORIWKHLQWUDFUDQLDODUWHULHV $LPRIWKLVWULDOZDVWRDVVHVV DSRVVLEOHGLDJQRVWLFEHQHÀWRIWKHDSSOLFDWLRQRIFRQWUDVWPHGLDLQDQLQWUDLQGLYLGXDO FRPSDULVRQVHWWLQJRIQRQHQKDQFHGYHUVXVFRQWUDVWHQKDQFHG035$*(LPDJLQJ 0HWKRGV DQG 0DWHULDOV VXEMHFWV ZHUH H[DPLQHG RQ D 7 ZKROH ERG\ 05 V\VWHP 0DJQHWRP 7 6LHPHQV XWLOLVLQJ D FKDQQHO KHDG FRLO1RYD )RU LQWUDFUDQLDO YHVVHO GHOLQHDWLRQ DQ 035$*( VHTXHQFH ZDV REWDLQHG SUH DQG SRVWFRQWUDVWPRODU*DGREXWURO%D\HU+HDOWKFDUH7KHIROORZLQJDUWHULHVDQG DUWHULDOVHJPHQWVZHUHDVVHVVHGXWLOLVLQJDÀYHSRLQWVFDOHDQWHULRUFHUHEUDO DUWHU\DUWHULDSHULFDOORVDLQWHUQDOFDURWLGDUWHU\PLGGOHFHUHEUDODUWHU\ VHJPHQWV0SRVWHULRUFRPPXQLFDWLQJDUWHU\SRVWHULRUFHUHEUDODUWHU\ DQGEDVLODU\DUWHU\)RUVWDWLVWLFDODQDO\VLVD:LOFR[RQUDQNWHVWZDVXVHG 5HVXOWV9LVXDODQDO\VLVGHPRQVWUDWHGDKLJKTXDOLW\DVVHVVPHQWRIQRQHQKDQFHG 035$*(LPDJLQJIRUWKHFRPSOHWHLQWUDFUDQLDODUWHULDOYDVFXODWXUHPHDQ GXH WR D KRPRJHQHRXV K\SHULQWHQVH YHVVHO VLJQDO 7KH DSSOLFDWLRQ RI FRQWUDVW PHGLD DOORZHG RQO\ IRU D PLOG LPSURYHPHQW RI WKH GHOLQHDWLRQ RI FHQWUDO YHVVHO VHJPHQWV VXFK DV WKH FDURWLG 7 PHDQ QH PHDQ FH <HW WKH FRQVSLFXLW\RIVPDOOHUYHVVHOVHJPHQWVZDVVLJQLÀFDQWO\LPSURYHGLQWKHFRQWUDVW HQKDQFHG035$*(LPDJHVHJDQWHULRUFRPPXQLFDWLQJDUWHU\PHDQQH WRPHDQFHS &RQFOXVLRQ ([FOXVLYH QRQHQKDQFHG 7 035$*( LPDJLQJ SURYLGHV D KLJK TXDOLW\DVVHVVPHQWRIWKHLQWUDFUDQLDODUWHULDOYDVFXODWXUHDQGPD\EHEHQHÀFLDO LQDVVHVVLQJWKHLQWUDFUDQLDODUWHULDOYDVFXODWXUHLQSDWLHQWVZLWKFRQWUDLQGLFDWLRQV WRWKHDSSOLFDWLRQRIFRQWUDVWPHGLDHJUHQDOLQVXIÀFLHQF\ % $V\PPHWU\RIFDURWLGDUWHU\ZDOOWKLFNQHVVEHWZHHQFDURWLGDUWHULHV /6DED66DQQLD(5D]*/HGGD&DJOLDUL,71HZ<RUN1<86 OXFDVDED#WLVFDOLLW 3XUSRVH 3UHYLRXV SXEOLFDWLRQV GHPRQVWUDWHG WKDW WKH &7 DQJLRJUDSK\ &7$ FDQHYDOXDWHWKHFDURWLGDUWHU\ZDOOWKLFNQHVV&$:77KHSXUSRVHRIWKLVZRUN ZDVWRFRPSDUHWKHDV\PPHWU\RI&$:7EHWZHHQFDURWLGVLQV\PSWRPDWLFDQG DV\PSWRPDWLFSDWLHQWV 0HWKRGVDQG0DWHULDO6L[W\FRQVHFXWLYHV\PSWRPDWLFPDOHVPHGLDQDJH SDWLHQWVDQGVL[W\QRQV\PSWRPDWLFSDWLHQWVPDWFKHGIRUJHQGHUDQGDJHZHUH DQDO\VHGXVLQJDGHWHFWRUURZ&7DQJLRJUDSK\(DFKSDWLHQWZDVDQDO\VHGE\ LQMHFWLQJPORIFRQWUDVWPDWHULDODWDPO?VHFÁRZUDWH&$:7ZDVFDOFXODWHG 5RRP$ 1HXUR 66 9DVFXODUDQGSHUIXVLRQLPDJLQJ 0RGHUDWRUV +$URQHQ7XUNX), -)UKZDOG3DOODPDU9LHQQD$7 % 7LPHUHVROYHGLPDJLQJRIFRQWUDVWNLQHWLFVGRHVQRWLPSURYH SHUIRUPDQFHRIIROORZXS05$RIHPEROLVHGLQWUDFUDQLDODQHXU\VPV =6HUDÀQ3 6WU]HŋQLHZVNL:/DVHN:%HXWK%\GJRV]F]3/ VHUDÀQ#FPXPNSO 3XUSRVH7KHXVHRIFRQWUDVWPHGLDDQGWKHWLPHUHVROYHGLPDJLQJRIFRQWUDVW NLQHWLFV75,&.6WHFKQLTXHKDVVRPHWKHRUHWLFDODGYDQWDJHVRYHUWLPHRIÁLJKW PDJQHWLFUHVRQDQFHDQJLRJUDSK\72)05$LQWKHIROORZXSRILQWUDFUDQLDODQ HXU\VPVDIWHUHQGRYDVFXODUWUHDWPHQW:HSURVSHFWLYHO\FRPSDUHGWKHGLDJQRVWLF SHUIRUPDQFHRI75,&.6DQG72)05$ZLWKGLJLWDOVXEWUDFWHGDQJLRJUDSK\'6$ LQWKHDVVHVVPHQWRIRFFOXVLRQRIHPEROLVHGDQHXU\VPV 0HWKRGV DQG 0DWHULDOV 6HYHQW\WZR FRQVHFXWLYH SDWLHQWV ZLWK DQHXU\VPV ZHUHH[DPLQHGPRQWKVDIWHUWKHHPEROLVDWLRQ7 HVWFKDUDFWHULVWLFVRI72)05$ DQG75,&.6ZHUHFDOFXODWHGIRUWKHGHWHFWLRQRIWKHUHVLGXDOÁRZ7KHUHVXOWVRI WKHTXDQWLÀFDWLRQRIWKHÁRZZHUHFRPSDUHGZLWKZHLJKWHGNDSSD,QWUDREVHUYHU DQGLQWHUREVHUYHUUHSURGXFLELOLW\ZDVGHWHUPLQHG 5HVXOWV7KHVHQVLWLYLW\RI72)05$ZDV&,DQGRI75,&.6 &,7KHVSHFLÀFLW\RIERWKPHWKRGVZDV&, $FFXUDF\RIWKHÁRZTXDQWLÀFDWLRQUDQJHGIURP72)05$WR 75,&.67KHUHZDVQRVLJQLÀFDQWGLIIHUHQFHEHWZHHQWKHPHWKRGVLQWKHDUHD XQGHUWKH52&FXUYHUHJDUGLQJERWKWKHGHWHFWLRQDQGWKHTXDQWLÀFDWLRQRIWKH ÁRZ7KHLQWUDREVHUYHUUHSURGXFLELOLW\ZDVYHU\JRRGZLWKERWKWHFKQLTXHVNDSSD 7KHLQWHUREVHUYHUUHSURGXFLELOLW\ZDVPRGHUDWHIRU72)05$DQGYHU\ JRRGIRU75,&.6NDSSD &RQFOXVLRQ,QWKLVVWXG\72)05$DQG75,&.6SUHVHQWHGVLPLODUGLDJQRVWLF SHUIRUPDQFH7KHUHIRUHWKHXVHRIWLPHUHVROYHGFRQWUDVWHQKDQFHG05$LVQRW MXVWLÀHGLQWKHIROORZXSRIHPEROLVHGDQHXU\VPV % )ROORZXSDIWHUHPEROLVDWLRQRIUXSWXUHGLQWUDFUDQLDODQHXU\VPV DSURVSHFWLYHFRPSDULVRQRIWZRGLPHQVLRQDOGLJLWDOVXEWUDFWHG DQJLRJUDSK\WKUHHGLPHQVLRQDOGLJLWDOVXEWUDFWHGDQJLRJUDSK\DQG WLPHRIÁLJKWPDJQHWLFUHVRQDQFHDQJLRJUDSK\ =6HUDÀQ3 6WU]HŋQLHZVNL:/DVHN:%HXWK%\GJRV]F]3/ VHUDÀQ#FPXPNSO 3XUSRVH7KHPRVWDSSURSULDWHPHWKRGIRUIROORZXSRILQWUDFUDQLDODQHXU\VPV DIWHU HQGRYDVFXODU WUHDWPHQW LV VWLOO EHLQJ GLVFXVVHG7KH SXUSRVH RI WKH VWXG\ ZDVDSURVSHFWLYHFRPSDULVRQRIWKHGLDJQRVWLFSHUIRUPDQFHRIGLJLWDOVXEWUDFWHG DQJLRJUDSK\ '6$ DQG WLPHRIÁLJKW PDJQHWLF UHVRQDQFH DQJLRJUDSK\ 72) 05$DWIROORZXS 0HWKRGVDQG0DWHULDOV$WRWDOQXPEHURIFRQVHFXWLYHSDWLHQWVZLWKDQHX U\VPVZHUHH[DPLQHGPRQWKVDIWHUWKHHPEROLVDWLRQ7KHLQGH[WHVWVLQFOXGHG WZRGLPHQVLRQDO'6$''6$WKUHHGLPHQVLRQDO'6$''6$DQG72)05$ 7KHUHIHUHQFHWHVWZDVDFRQVHQVXVEHWZHHQ''6$DQG''6$7KHHYDOXD WLRQLQFOXGHGGHWHFWLRQRIWKHUHVLGXDOÁRZTXDQWLÀFDWLRQRIWKHÁRZDQGYDOLGLW\ RIWKHGHFLVLRQRQWKHUHWUHDWPHQW,QWUDREVHUYHUDQGLQWHUREVHUYHUUHSURGXFLELOLW\ ZDVGHWHUPLQHG 5HVXOWV6HQVLWLYLW\DQGVSHFLÀFLW\LQWKHGHWHFWLRQRIWKHUHVLGXDOÁRZUDQJHGIURP ''6$DQG72)05$WR''6$DQGIURP72)05$WR ''6$$FFXUDF\RIWKHHYDOXDWLRQRIWKHÁRZGHJUHHUDQJHGIURP ''6$WR''6$&RKHQNDSSD''6$SUHVHQWHGORZHUSHUIRUPDQFH LQWKHGHFLVLRQRQUHHPEROLVDWLRQWKDQ''6$352&DQDO\VLV7KH LQWUDREVHUYHUUHSURGXFLELOLW\ZDVYHU\JRRGZLWKDOOWHFKQLTXHVNDSSD 7KHLQWHUREVHUYHUUHSURGXFLELOLW\ZDVPRGHUDWHIRU72)05$DQGYHU\JRRGIRU ''6$DQG''6$NDSSD &RQFOXVLRQ7KHPRVWSUHFLVHPHWKRGRIDQHXU\VPIROORZXSLV''6$''6$ VKRZV D ORZHU GLDJQRVWLF YDOXH ZLWK UHJDUG WR WKH GHFLVLRQ RQ UHHPEROLVDWLRQ &RQVLGHULQJWKHLQYDVLYHQHVVRI'6$DQGWKHPLQRUGLIIHUHQFHLQWKHGLDJQRVWLF SHUIRUPDQFH EHWZHHQ ''6$ DQG72)05$ WKH ODWWHU PHWKRG VKRXOG EH WKH EDVLFPRGDOLW\IRUIROORZXSDIWHUDQHXU\VPHPEROLVDWLRQ 6FLHQWLILF6HVVLRQ $ 6&'()*+%(XURSHDQ&RQJUHVVRI 5DGLRORJ\ 0RQGD\ % 7RWDOFHUHEUDOEORRGÁRZIURPFKLOGKRRGWRHDUO\VHQHVFHQFHDV DVVHVVHGZLWKSKDVHFRQWUDVWLPDJLQJ ,.RHUWH $3RPVFKDU53 /DXEHQGHU'6WHIÀQJHU) +HLQHQ 05HLVHU1$OSHULQ%(UWO:DJQHU0XQLFK'(0LDPL)/86 LQJDNRHUWH#PHGXQLPXHQFKHQGH 3XUSRVH&HUHEUDOEORRGÁRZFKDQJHVZLWKLQFUHDVLQJDJHKRZHYHUQRQRUPD WLYHYDOXHVLQFKLOGKRRGDQGDGROHVFHQWVDUHDYDLODEOHXQWLOSUHVHQW:HDLPHGWR LQYHVWLJDWHDQGTXDQWLI\WKHWRWDOFHUHEUDOEORRGÁRZLQSK\VLRORJLFDOGHYHORSPHQW DQGDJHLQJE\SKDVHFRQWUDVW05LPDJLQJ 0HWKRGVDQG0DWHULDOV$IWHULQIRUPHGFRQVHQWKHDOWK\VXEMHFWVPDOHV IHPDOHVDJHWR\HDUVZHUHLQYHVWLJDWHGRQD705,&LQHSKDVHFRQWUDVW VHTXHQFHVZHUHSHUIRUPHGDWDQD[LDOSODQHSHUSHQGLFXODUWRWKHQHFNYHVVHOV WR TXDQWLI\ DUWHULDO LQÁRZ WKURXJK WKH OHIW DQG ULJKW FDURWLG /&$ 5&$ DQG OHIW DQGULJKWYHUWHEUDODUWHU\/9$DQG59$7 RWDOFHUHEUDOEORRGÁRZZDVGHÀQHG DVWKHVXPRIÁRZWKURXJKWKHVHIRXUFHUYLFRFUDQLDODUWHULHV'DWDZHUHDQDO\VHG ZLWKOLQHDUUHJUHVVLRQPRGHOVUHO\LQJRQIUDFWLRQDOSRO\QRPLDOVRIVHFRQGGHJUHH 5HVXOWV 7 RWDO FHUHEUDO EORRG ÁRZ VLJQLÀFDQWO\ GHFUHDVHG ZLWK LQFUHDVLQJ DJH SLQDQRQOLQHDUIDVKLRQUDQJHGPOPLQ7KLVZDVDOVRWUXHIRU WKHTXDQWLWDWLYHÁRZWKURXJKHDFKRIWKHLQYHVWLJDWHGDUWHULHV/&$5&$/9$DQG 59$S*HQGHUKDGQRVLJQLÀFDQWHIIHFWRQDUWHULDOFHUHEUDOEORRGÁRZ &RQFOXVLRQ7 RWDOFHUHEUDOEORRGÁRZLVDJHGHSHQGHQWDQGGHFUHDVHVZLWKDJH 7KLVGHFUHDVHDOUHDG\VWDUWVLQFKLOGKRRG*HQGHUGRHVQRWKDYHDVLJQLÀFDQWLPSDFW RQFHUHEUDOEORRGÁRZ7KHVHDJHUHODWHGFKDQJHVQHHGWREHWDNHQLQWRFRQVLGHUD WLRQZKHQLQWHUSUHWLQJ05EDVHGTXDQWLÀFDWLRQVRIFHUHEUDOEORRGÁRZLQSDWLHQWV 5RRP' &KHVW 66 7LVVXHFKDUDFWHULVDWLRQ 0RGHUDWRUV 5&HVDU*ROQLN6, 0:LHOSW]+HLGHOEHUJ'( % &7ÀQGLQJVRISQHXPRQLFW\SHDGHQRFDUFLQRPDFRPSDULVRQ EHWZHHQLQYDVLYHPXFLQRXVDGHQRFDUFLQRPDDQGQRQPXFLQRXV DGHQRFDUFLQRPD 61DNDPXUD6KLPDEDUD-3VQDNDPXUD #JPDLOFRP 3XUSRVH,QYDVLYHPXFLQRXVDGHQRFDUFLQRPD,0$IRUPHUO\FODVVLÀHGDVPXFL QRXV%$&XVXDOO\SUHVHQWVFRQVROLGDWLYHRSDFLWLHVPLPLFNLQJSQHXPRQLDRQ&7 RQWKHFRQWUDU\VXFKSQHXPRQLFW\SHDGHQRFDUFLQRPDPD\RFFXULQQRQPXFLQRXV DGHQRFDUFLQRPD10$IRUPHUO\FODVVLÀHGDVQRQPXFLQRXV%$&7KHVHWXPRXUV VKRXOGEHVHSDUDWHGLQWRGLIIHUHQWFDWHJRULHVEHFDXVHWKH\KDYHFOLQLFDOSDWKRORJLF DQGJHQHWLFGLIIHUHQFHV7KHSXUSRVHRIWKLVVWXG\ZDVWRFRPSDUHWKH&7ÀQGLQJV RISQHXPRQLFW\SHDGHQRFDUFLQRPDEHWZHHQ,0$DQG10$ 0HWKRGVDQG0DWHULDOV:HUHWURVSHFWLYHO\VWXGLHGWZHQW\SDWLHQWVZLWKSDWKR ORJLFDOO\SURYHQSQHXPRQLFW\SHDGHQRFDUFLQRPDDWIRXULQVWLWXWLRQVIURPWR 7KH\FRQVLVWVRIIHPDOHVDQGPDOHVZLWKDJHVUDQJLQJIURPWR \HDUVPHDQ\HDUV&7ÀQGLQJVRI,0$Q DQG10$Q ZHUHFRPSDUHG EDVHGRQWKHFKDUDFWHULVWLFVRIFRQVROLGDWLRQSHULSKHUDOGLVWULEXWLRQORZHUOXQJ SUHGRPLQDQFHPXOWLIRFDOGLVWULEXWLRQDLUEURQFKRJUDPFDYLWDWLRQRUF\VWKHWHURJH QHLW\VXUURXQGLQJJURXQGJODVVRSDFLW\**2EXOJLQJÀVVXUHDQG&7DQJLRJUDP VLJQ$FFHVVRU\RSDFLWLHVFHQWULOREXODUQRGXOHVFDYLWLHV**2SOHXUDOHIIXVLRQ DQGO\PSKDGHQRSDWK\ZHUHDOVRDQDO\VHG 5HVXOWV&7VKRZHGSHULSKHUDOGLVWULEXWLRQFDYLWDWLRQRUF\VWEXOJ LQJÀVVXUHDQG&7DQJLRJUDPVLJQLQ,0$W\SHZKLOHWKRVHÀQGLQJV ZHUHQRWVHHQLQ10$W\SH7KHIRUPHUWKUHHÀQGLQJVZHUHVWDWLVWLFDOO\VLJQLÀFDQWO\ GLIIHUHQWEHWZHHQWKHP/RZHUOXQJSUHGRPLQDQFHPXOWLIRFDOGLVWULEXWLRQDLUEURQ FKRJUDPKHWHURJHQHLW\VXUURXQGLQJ**2DQGFHQWULOREXODUQRGXOHVZHUHVHHQ LQERWKW\SHVZLWKQRVLJQLÀFDQWGLIIHUHQFH &RQFOXVLRQ7KHDEVHQFHRI&7ÀQGLQJVVXFKDVSHULSKHUDOGLVWULEXWLRQFDYLWD WLRQRUF\VWDQGEXOJLQJÀVVXUHLQGLFDWHVWKHSRVVLELOLW\RISQHXPRQLFW\SH10$ IRUERWKFDURWLGVDQGIRUHDFKSDWLHQWWKHUDWLREHWZHHQWKHELJJHVW&$:7DQGWKH FRQWUDODWHUDOZDVFDOFXODWHGWRREWDLQDQLQGH[%ODQG$OWPDQORJLVWLFUHJUHVVLRQ DQG52&FXUYHDQDO\VLVZHUHFDOFXODWHG 5HVXOWV7KH%ODQG$OWPDQSORWGHPRQVWUDWHVDYHU\JRRGDJUHHPHQWEHWZHHQ PHDVXUHPHQWVZLWKDPHDQGLIIHUHQFHYDOXHRIRQO\DQG&,IURP WR$VWDWLVWLFDOO\VLJQLÀFDQWGLIIHUHQFHLQ$&$:7EHWZHHQV\PSWRPDWLFDQG DV\PSWRPDWLFSDWLHQWVZLWKDSYDOXHRIZDVIRXQG7KH52&DUHDXQGHU WKHFXUYHZDVS /RJLVWLFUHJUHVVLRQPRGHOLQGLFDWHGWKDW $&$:7 VWHQRVLV GHJUHH DQG IDWW\ SODTXHV ZHUH LQGHSHQGHQW YDULDEOHV DVVRFLDWHG ZLWK FHUHEURYDVFXODUV\PSWRPVSYDOXHUHVSHFWLYHO\DQG &RQFOXVLRQ 5HVXOWV RI RXU VWXG\ LQGLFDWHG WKDW WKH LQGH[ RI DV\PPHWU\ LQWKH &$:7PD\EHXVHGDVIXUWKHUSDUDPHWHUWRVWUDWLI\WKHULVNRIV\PSWRPVUHODWHG WRFDURWLGDUWHU\ % 'HWHFWLRQRIFHUHEUDOYDVRVSDVPXVLQJG\QDPLF&7 DQDO\VLVRI YROXPHSHUIXVLRQ&7PDSVDQG'&7DQJLRJUDSK\ 3 6FKUDPP .'RODWRZVNL56FKUDPP$)URHOLFK(.ORW]0.QDXWK *|WWLQJHQ'()RUFKKHLP'(SVFKUDPP#PHGXQLJRHWWLQJHQGH 3XUSRVH&HUHEUDOYDVRVSDVPZLWKDUDLVHGULVNIRUVHFRQGDU\LVFKHPLDLVDIUH TXHQWFRPSOLFDWLRQDIWHUVXEDUDFKQRLGKDHPRUUKDJH6$+:HWHVWHGZKHWKHU ´ZKROH EUDLQµ YROXPH SHUIXVLRQ &7 93&7 GHOLYHUV UHOHYDQW LQIRUPDWLRQ DERXW WKHORFDOLVDWLRQDQGFKDUDFWHULVWLFVRIDUWHULDOYDVRVSDVPDQGWKHYROXPHDWULVN RIVHFRQGDU\LQIDUFWLRQ 0HWKRGVDQG0DWHULDOVFRQVHFXWLYHSDWLHQWVZLWKVXVSLFLRQRIFHUHEUDOYDVRV SDVPGXHWR6$+XQGHUZHQW93&7RIWKHEUDLQ&7DQJLRJUDSKLFPD[LPXPLQWHQVLW\ SURMHFWLRQVZHUHJHQHUDWHGIURPWKLQVOLFHUHFRQVRIWKH93&7GDWDVHWDWSHDN DUWHULDOWLPH,PDJHVZHUHDVVHVVHGIRUWKHSUHVHQFHRIDUWHULDOYDVRVSDVPDQG FRPSDUHGZLWKFRQYHQWLRQDO&7$RU'6$7KHGLVWULEXWLRQRILVFKDHPLFOHVLRQVZDV DQDO\VHGRQ'SHUIXVLRQSDUDPHWHUPDSVRIFHUHEUDOEORRGÁRZ&%)FHUHEUDO EORRGYROXPH&%9PHDQWUDQVLWWLPH077DQGWLPHWRGUDLQ77' 5HVXOWV,QDOOSDWLHQWVIRFDODUHDVRIFHUHEUDOK\SRSHUIXVLRQZHUHGHWHFWHGRQ FRORXUFRGHG93&7SDUDPHWHUPDSV7KHKLJKHVWVHQVLWLYLW\ZDVIRXQGIRU077DQG 77')RFDOUHGXFWLRQVRI&%9VWURQJO\FRUUHODWHGZLWKLQIDUFWLRQRQIROORZXS&7 SDWLHQWVKDGYDVRVSDVWLFOHVLRQVRILQWUDFUDQLDODUWHULHVRQ0,3UHFRQVWUXF WLRQVRIWKH'&7$$OORIWKHVHVWHQRWLFOHVLRQVZHUHDOVRYLVLEOHRQFRQYHQWLRQDO &7$RU'6$UHVXOWLQJLQVHQVLWLYLW\RIWKH'&7$UHFRQVWUXFWLRQV &RQFOXVLRQ93&7LVDQRQLQYDVLYHPHWKRGWKDWDOORZVGHWHFWLQJFHUHEUDOYD VRVSDVPLQSDWLHQWVVXIIHULQJIURP6$+,WKDVWKHSRWHQWLDOWRGHPRQVWUDWHIRFDO SHUIXVLRQ GHÀFLWV DV ZHOO DV YDVRVSDVWLF DUWHULDO VHJPHQWV DQGPLJKW WKHUHIRUH LPSURYHGLDJQRVLVDQGWUHDWPHQWGHFLVLRQVLQWKRVHSDWLHQWV % 5HODWLRQVKLSEHWZHHQWKURPEXVGHQVLW\DQGGLIIHUHQWVWURNHVXEW\SHV -1LHVWHQ,9DQGHU6FKDDI*%LHVVHOV/.DSSHOOH7 9DQ6HHWHUV < 9DQ'HU*UDDI:0DOL%9HOWKXLV$+RUVFK8WUHFKW1/$UQKHP1/ MQLHVWHQ#KRWPDLOFRP 3XUSRVH7 RGHWHUPLQHWKHUHODWLRQVKLSEHWZHHQWKURPEXVGHQVLW\DQGGLIIHUHQW VWURNHVXEW\SHVLQSDWLHQWVZLWKDFXWHLVFKDHPLFVWURNH 0HWKRGVDQG0DWHULDOV:HSURVSHFWLYHO\LQFOXGHGSDWLHQWVZLWKDFXWHLVFKDH PLFDQWHULRUFLUFXODWLRQVWURNHDQGDYLVLEOHRFFOXVLRQRQ&7$WKDWZDVSUHVXPHGWR EHFDXVHGE\FDUGLRHPEROLVPQ ODUJHDUWHU\DWKHURVFOHURVLV/$$Q RU GLVVHFWLRQQ $OOSDWLHQWVXQGHUZHQWQRQFRQWUDVW&71&&7&7SHUIXVLRQ DQG &7DQJLRJUDSK\ RQ DGPLVVLRQ ZLWKLQ KRXUV DIWHU VWURNH RQVHW 3UHVHQFH RUDEVHQFHRIDGHQVHYHVVHOVLJQ'96ZDVDVVHVVHGRQ1&&7DQGWKURPEXV GHQVLW\ZDVPHDVXUHGLQ+RXQVÀHOG8QLWV+8RQ1&&7 6XEVHTXHQWO\'96V DQGWKURPEXVGHQVLW\ZHUHUHODWHGZLWKVWURNHVXEW\SHV 5HVXOWV7KHSUHVHQFHRI'96VGLIIHUHGVLJQLÀFDQWO\DPRQJVXEW\SHV'96ZDV IRXQGLQRISDWLHQWVZLWKFDUGLRHPEROLVPLQRISDWLHQWVZLWK/$$DQG LQ RI SDWLHQWV ZLWK GLVVHFWLRQ ;WHVW S 7KH PHDQ +8YDOXH ZDV VLJQLÀFDQWO\KLJKHULQGHQVHYHVVHOVWKDQLQQRQGHQVHYHVVHOVFRQÀ GHQFHLQWHUYDO&,YHUVXV&,7KHPHDQ+8YDOXH RIDOOYHVVHOVZLWKWKURPEXVZDV&,LQFDUGLRHPEROLVP &,LQ/$$DQG&,LQGLVVHFWLRQ$1&29$WHVW S:HIRXQGWKHVDPHVLJQLÀFDQWUDQNLQJRUGHULQWKHGHQVLW\RIWKURPEL ZLWK'96VPHDQ+8YDOXHFDUGLRHPEROLVP&,/$$ &,GLVVHFWLRQ&,$1&29$WHVWS &RQFOXVLRQ7KURPEXVGHQVLW\LVUHODWHGWRVWURNHVXEW\SHDQGSUREDEO\UHÁHFWV GLIIHUHQW WKURPEXV FRPSRVLWLRQ 7KH SUHGLFWLYH YDOXH RI WKURPEXV GHQVLW\ IRU UHFDQDOLVDWLRQUDWHVKRXOGEHIXUWKHULQYHVWLJDWHG 6FLHQWLILF6HVVLRQ 6 &$' ( ) *+% (XURSHDQ&RQJUHVVRI 5DGLRORJ\ % /XQJFDQFHUSHUIXVLRQFDQZHPHDVXUHSXOPRQDU\DQGEURQFKLDO FLUFXODWLRQVLPXOWDQHRXVO\" ;<XDQ*$R-=KDQJ%HLMLQJ&16KDQJKDL&1 \XDQ[LDRGRQJ]M#FRP 3XUSRVH7 RUHSRUWDQHZ&7SHUIXVLRQWHFKQLTXHDQGLWVSULPDU\ÀQGLQJVLQDV VHVVLQJGRXEOHEORRGVXSSO\LQDGYDQFHGEURQFKLDOFDUFLQRPDV$%&V 0HWKRGVDQG0DWHULDOV%DVHGRQGHWHFWRUURZ&7 DGXDOLQSXWOXQJFDQFHU SHUIXVLRQPRGHO',/&SZDVHVWDEOLVKHG3XOPRQDU\WUXQNDQGGHVFHQGLQJDRUWD UHSUHVHQWLQJEURQFKLDODUWHU\ZHUHDSSRLQWHGLQSXWDUWHULHVIRUSXOPRQDU\DQG EURQFKLDOFLUFXODWLRQUHVSHFWLYHO\SHDNWLPHSRLQWRIOHIWDWULXPVHUYHGDVERXQGDU\ EHWZHHQWKHWZR7KHQSXOPRQDU\ÁRZ3)EURQFKLDOÁRZ%)DQGSHUIXVLRQ LQGH[3, 3)3)%)ZDVÀJXUHGRXWDFFRUGLQJWRPD[LPXPVORSPHWKRG $IWHU ZULWWHQLQIRUPHGFRQVHQWVZHUHDFTXLUHGFRQVHFXWLYHVXEMHFWVZLWKDGYDQFHG EURQFKLDOFDUFLQRPDVXQGHUZHQWWKH',/&SWHVW+DHPRG\QDPLFVRI$%&VZDV FRPSDUHGZLWKORFDOLVDWLRQSHULSKHUDORUFHQWUDODQGKLVWRORJ\ 5HVXOWV+DHPRG\QDPLFVRIWKH$%&VZHUHDVIROORZV3) PO PLQPO%) POPLQPO3,%RWKFHQWUDOQ DQGSHULSKHUDOQ WXPRXUVKDYHDSUHGRPLQDQWV\VWHPLFFLUFXODWLRQ3, UHVSHFWLYHO\ ERWK VWDWLVWLFDOO\ OHVV WKDQ WKH ODWWHU LV ELJJHU WKDQ WKH IRUPHUS $OONLQGVRIKLVWRORJ\RI$%&VVKRZHG3,VOHVVWKDQZLWKRXW VLJQLÀFDQWGLIIHUHQFHEHWZHHQHDFKRWKHU &RQFOXVLRQ$QHZ&7SHUIXVLRQWHFKQLTXHZDVHVWDEOLVKHGIRUDVVHVVLQJGRX EOHEORRGVXSSO\LQOXQJFDQFHU2XUSULPDU\ÀQGLQJVVXJJHVWWKDWDGYDQFHG EURQFKLDOFDUFLQRPDLVIHGVLPXOWDQHRXVO\E\SXOPRQDU\DQGV\VWHPLFFLUFXODWLRQ WKHODWWHULVGRPLQDQWLQGHSHQGHQWRIORFDOLVDWLRQDQGKLVWRORJ\IXUWKHUPRUH WKHSURSRUWLRQRISXOPRQDU\FLUFXODWLRQZLWKSHULSKHUDOWXPRXUVLVKLJKHUWKDQWKDW ZLWKFHQWUDOWXPRXUV % &7ÀQGLQJVSUHGLFWLQJ(*)5JHQHPXWDWLRQLQSDWLHQWVZLWKQRQ VPDOOFHOOOXQJFDQFHU 03 5HYHO&%RUGRQQH+%ORQV$/XSR$&D]HV*&KDWHOOLHU3DULV)5 PDULHSLHUUHUHYHO#HJSDSKSIU 3XUSRVH 7 R FRPSDUH FRPSXWHG WRPRJUDSK\ &7 ÀQGLQJV LQ QRQVPDOO FHOO OXQJFDQFHU16&/&SDWLHQWVZLWKDQGZLWKRXWHSLGHUPDOJURZWKIDFWRUUHFHSWRU (*)5JHQHPXWDWLRQV 0HWKRGVDQG0DWHULDOV,QLWLDO&7ÀQGLQJVLQ16&/&SDWLHQWVZLWKDQG ZLWKRXW(*)5JHQHPXWDWLRQZHUHUHWURVSHFWLYHO\UHYLHZHGE\WZRUDGLRORJLVWV LQFRQVHQVXV7KHSDWLHQWJURXSPDLQO\LQFOXGHGSDWLHQWVZLWK77)DGHQRFDUFL QRPDV7KHSUHVHQFHRIJURXQGJODVVRSDFLW\**2RIWXPRXU GHQVLW\KHWHURJHQHLW\RIO\PSKQRGHHQODUJHPHQWZDVDQDO\VHGWRJHWKHUZLWKWKH SUHVHQFHRIPXOWLSOHQRGXOHV!DVVRFLDWHGZLWKWKHPDLQWXPRXU7KHPD[LPXP GLDPHWHURIWKHWXPRXUZDVDOVRPHDVXUHG 5HVXOWV1RVLJQLÀFDQWFRUUHODWLRQZDVIRXQGEHWZHHQ(*)5JHQHPXWDWLRQDQG **2LQWKHPXWDWLRQJURXSYVS WXPRXUGHQVLW\KHWHURJH QHLW\YVS RUO\PSKQRGHHQODUJHPHQWYV S 7KH PD[LPXP GLDPHWHU RI WKH WXPRXU ZDV QRW VLJQLÀFDQWO\ GLIIHUHQW LQ SDWLHQWVZLWKDQGZLWKRXW(*)5JHQHPXWDWLRQYVPPS 7KHSUHV HQFHRIPXOWLSOHVQRGXOHVDVVRFLDWHGZLWKWKHPDLQWXPRXUZDVPRUHIUHTXHQWLQ WKHPXWDWLRQJURXSYVS 0HQSURSRUWLRQZDV VLJQLÀFDQWO\ORZHULQWKH(*)5JHQHPXWDWLRQJURXSYVS &RQFOXVLRQ7KHSUHVHQFHRIPXOWLSOHQRGXOHVDVVRFLDWHGZLWKWKHPDLQWXPRXU LVWKHRQO\&7ÀQGLQJVXJJHVWLQJ(*)5PXWDWLRQDWLQLWLDOSUHVHQWDWLRQRISDWLHQWV ZLWK16&/& % 5DGLDWLRQGRVHWRWKHUDGLRORJLVWGXULQJFRQWLQXRXV&7ÁXRURVFRS\ JXLGHGOXQJELRSV\XVLQJGLIIHUHQW+DQG&$5(RSWLRQVKRZVDIHLVLW" :) 0'H:HYHU) =DQFD$-DFREV1%HUJDQV5%RJDHUWV-&RROHQ -9HUVFKDNHOHQ+%RVPDQV/HXYHQ%(ZDOWHUGHZHYHU#X]OHXYHQEH 3XUSRVH&7)OXRURVFRS\JXLGHGOXQJELRSV\&7)/%LQYROYHVGLUHFWRSHUDWRU LUUDGLDWLRQ2FFXSDWLRQDOOLPLWVVNLQH\HOHQVP6Y\HDUZHUHUHDFKHG DWRXUGHSDUWPHQW6WXG\SXUSRVHZDVWRDVVHVVRFFXSDWLRQDOERG\KDQGDQGH\H GRVHVGXULQJ&7)/%IRUURXWLQHDQGORZGRVHSURWRFROXVLQJGLIIHUHQW+DQG&$5( +& SRVLWLRQV +DQG&$5( LQWHUUXSWV [UD\ DW VHOHFWDEOH SRVLWLRQV RU RҋFORFN 0HWKRGVDQG0DWHULDOV'DWDIURP&7)/%ELRSV\SURFHGXUHVZHUHSURVSHF WLYHO\FROOHFWHG7ZHQW\ZHUHSHUIRUPHGXVLQJWKHURXWLQHSURWRFRON9P$V PPVOLFHZLWK+&SDWLHQWV+&SDWLHQWVDQG+&SDWLHQWV $ % '\QDPLFSHUIXVLRQ05,LQSDWLHQWVVXIIHULQJIURPSULPDU\OXQJ FDQFHUDQRYHODSSURDFKWRWXPRXUFKDUDFWHULVDWLRQ" 05HJLHU) 2+HQHV'6FKZDU]$/DTPDQL+.RRLMPDQ*$GDP +DPEXUJ'(PUHJLHU#XNHGH 3XUSRVH 7 R HYDOXDWH WKH DFFXUDF\ RI G\QDPLF PDJQHWLF UHVRQDQFH SHUIXVLRQ LPDJLQJ'&(05LQWKHGLIIHUHQWLDWLRQRIKLVWRORJLFDOVXEW\SHVRISULPDU\OXQJ FDQFHUDQGWRGHWHUPLQHZKHWKHUWXPRXUORFDOLVDWLRQHIIHFWVSHUIXVLRQNLQHWLFV 0HWKRGVDQG0DWHULDOV,QSDWLHQWVVXIIHULQJIURPSULPDU\OXQJFDQFHUG\QDPLF FRQWUDVWHQKDQFHG 05, ZDV SHUIRUPHG IRU VL[ PLQXWHV XVLQJ D 7Z '*5( VHTXHQFH757(PV)29PPLQSODQHUHVROXWLRQ[[PP VFDQWLPHVHFDW7 HVOD'HQVLW\WLPHFXUYHVZHUHGHWHUPLQHGE\SODFLQJ DUHJLRQRILQWHUHVW52,RQWKHHQWLUHWXPRXUDVZHOODVKLJKHQKDQFLQJDUHDV 7KHSHUIXVLRQDQGSHDNHQKDQFHPHQWZHUHFDOFXODWHGXVLQJWKHPD[LPXPVORSH PHWKRG5HVXOWVZHUHFRPSDUHGDFFRUGLQJWRKLVWRORJLFDOVXEW\SHGLIIHUHQWLDWLRQ VL]HDQGDOORFDWLRQ7KHVWDWLVWLFDODQDO\VLVLQFOXGHG:LOFR[RQWHVWDQG6SHDUPDQCV FRUUHODWLRQFRHIÀFLHQW 5HVXOWV7XPRXU SHUIXVLRQ GHWHUPLQHG IRU ERWK WKH HQWLUH WXPRXU S DQGWKHPD[LPXPHQKDQFLQJDUHDSZDVVLJQLÀFDQWO\KLJKHULQVPDOOHU WXPRXUVWKDQLQODUJHURQHV3HULSKHUDOFDUFLQRPDVUHYHDOHGDVOLJKWO\KLJKHUSHU IXVLRQWKDQFHQWUDOWXPRXUVS 7KHVPDOOFHOOFDUFLQRPDV6&/&VKRZHG DVLJQLÀFDQWO\KLJKHUSHUIXVLRQS DQGSHDNHQKDQFHPHQWS WKDQWKH DGHQRFDUFLQRPDV7KHFRPSDULVRQRI6&/&ZLWKRWKHUQRQVPDOOFHOOOXQJFDQFHUV 16&/&GLGQRWUHYHDODQ\VLJQLÀFDQWSHUIXVLRQGLIIHUHQFHV,QVL[SDWLHQWVWXPRXU VLJQDOLQWHQVLW\VKRZHGDQLQFUHDVHSULRUWRDRUWLFVLJQDOLQFUHDVHDOOXGLQJWRGLVWLQFW WXPRXUEORRGVXSSO\IURPSXOPRQDU\YHVVHOV &RQFOXVLRQ'&(05GHSLFWVNLQHWLFGLIIHUHQFHVLQSHUIXVLRQEHWZHHQFRPPRQ KLVWRORJLFDOVXEW\SHVRISULPDU\OXQJFDQFHU$GGLWLRQDOO\'&(05FDQUDLVHLQ IRUPDWLRQDERXWRULJLQRIWXPRXUEORRGVXSSO\SHUIXVLRQDQGSHDNHQKDQFHPHQW DQGPLJKWWKHUHIRUHEHFRQVLGHUHGIRUWKHUDS\UHVSRQVHPRQLWRULQJ % &RQYHQWLRQDO)'*3(7&7FRPELQHGZLWKÀUVWSDVV&7SHUIXVLRQ WHFKQLTXHLQOXQJFDQFHUSDWLHQWVFOLQLFDOVWDJLQJDQGIXQFWLRQDO LQIRUPDWLRQLQDVLQJOHVWXG\ &&DSUDUR',SSROLWR/*XHUUD('H3RQWL&0HVVD66LURQL0RQ]D,7 FULVWLQDFDSUDUR#KRWPDLOLW 3XUSRVH 7 R DVVHVV WKH DGGLWLRQDO IXQFWLRQDO LQIRUPDWLRQ DQG WKH UHODWLRQVKLS EHWZHHQ SHUIXVLRQ PHDVXUHPHQWV DQG JOXFRVH PHWDEROLVP REWDLQHG LQFOXGLQJ &7SHUIXVLRQ VWXG\ &7S LQWR ZKROH ERG\ FRQWUDVWHQKDQFHG 3(7&7 SURWRFRO IRUOXQJFDQFHUVWDJLQJ 0HWKRGVDQG0DWHULDOV$WRWDORISDWLHQWVZLWKELRSV\SURYHQOXQJFDQFHU ZKRZHUHUHIHUUHGIRUFH3(7&7VWDJLQJZHUHSURVSHFWLYHO\HQUROOHGLQRXUVWXG\ /RZGRVHXQHQKDQFHG3(7&7ZDVDFTXLUHGÀUVW7KHSRVLWLRQRI&7SVWXG\ZDV GHÀQHGRQ3(7&7 DQG&7SZDVSHUIRUPHGZLWKIROORZLQJSDUDPHWHUV.Y P$VVFDQLYLQMHFWLRQRIPOFRQWUDVWDJHQWPOVHF7KHQDQRWKHUEROXV RIFRQWUDVWPHGLDPOVHFPOVHFGHOD\ZDVDSSOLHGWRDVVXUHWKHIXOOGLDJ QRVWLFFH&7IRUFOLQLFDOVWDJLQJ&7SGDWDZHUHXVHGWRFDOFXODWHDUDQJHRIWXPRXU YDVFXODULW\SDUDPHWHUV%) %9DQG077DQGWXPRXU)'*XSWDNH689PD[ZDV XVHGDVDPHWDEROLFLQGLFDWRU4XDQWLWDWLYHDQGIXQFWLRQDOSDUDPHWHUVZHUHFRP SDUHGDQGVWDWLVWLFDOO\DQDO\VHGLQUHODWLRQWRORFDWLRQKLVWRORJ\DQGWXPRXUVL]H 5HVXOWV7KHSHUIXVLRQLPDJHVZHUHDQDO\VHGXVLQJDFRPPHUFLDOO\DYDLODEOHVRIW ZDUH3HUIXVLRQ $GYDQWDJH*(ZKLFKJHQHUDWHGDTXDQWLWDWLYHPDSRIDUWHULDO SHUIXVLRQ6LJQLÀFDQWGLIIHUHQFHVZLWKORZHUSHUIXVLRQSDUDPHWHUVZHUHQRWHGLQ WXPRXUV!PPWKDQLQWXPRXUVPPS%9YVPOJ %)YVPOPLQJ077YVVHFUHVSHFWLYHO\,QWHUHVWLQJO\KLJK HVWFRUUHODWLRQVOLQHDUUHJUHVVLRQZHUHGHWHFWHGEHWZHHQ%9DQG689PD[IRU WXPRXUVZLWKGLDPHWHU!FP1RVLJQLÀFDQWGLIIHUHQFHVZHUHQRWHGDFFRUGLQJWR ORFDWLRQDQGSDWKRORJLFDOWXPRXUW\SH7KHVHUHVXOWVPD\LQGLFDWHWKDWODUJHWXPRXUV H[KLELWVLJQLÀFDQWO\ORZHUSHUIXVLRQDQGKLJKHUPHWDEROLVPLQUHODWLRQWRWKHLUDJ JUHVVLYHQHVVVKRZLQJWKDWQRWRQO\KLVWRORJLFDOW\SHEXWDOVRVL]HDQGSUHVHQFH RIQHFURVLVFRXOGGHWHUPLQHWKHHQKDQFHPHQWFKDUDFWHULVWLFVRIOXQJFDUFLQRPDV &RQFOXVLRQ&7SFRPELQHGZLWK3(7&7LVIHDVLEOHWHFKQLTXHWKDWFDQSURYLGH DGGLWLRQDOIXQFWLRQDOLQIRUPDWLRQDERXWYDVFXODULW\DQGWXPRXUDJJUHVVLYHQHVVWKXV KHOSLQJLQDVVHVVLQJWKHSURJQRVLVDQGSURSHUWUHDWPHQWFKRLFH 6FLHQWLILF6HVVLRQ $ 6&'()*+%(XURSHDQ&RQJUHVVRI 5DGLRORJ\ 0RQGD\ % &OLQLFDODSSOLFDWLRQRIWLVVXHSHUPHDELOLW\IDFWRUIRUGLIIHUHQWLDWLRQ RIEHQLJQDQGPDOLJQDQWSXOPRQDU\PDVVRQG\QDPLFFRQWUDVW PDWHULDOHQKDQFHG'&(05, 6+%DLN*< -LQ< 0+DQ-HRQMX.5ORYHJXPDWP#KDQPDLOQHW 3XUSRVH7 R GHWHUPLQH ZKHWKHU WLVVXH SHUPHDELOLW\ IDFWRU RQ G\QDPLF FRQWUDVW PDWHULDOHQKDQFHG'&(05,FDQKHOSWRGLVFULPLQDWHEHWZHHQPDOLJQDQWDQG EHQLJQSXOPRQDU\PDVV 0HWKRGVDQG0DWHULDOV)URP-XQHWR0D\SDWLHQWVZRPHQ PHQPHGLDQDJH\HDUVDJHUDQJH\HDUVZLWKVXVSHFWHGOXQJFDQFHU DJUHHGWRXQGHUJR'&(05LPDJLQJDW7 SDWLHQWVZHUHOXQJFDQFHUDQG SDWLHQWVZHUHEHQLJQOXQJOHVLRQV$WZRFRPSDUWPHQWNLQHWLFPRGHOZDVXVHGWR FDOFXODWHWKHSHUIXVLRQSDUDPHWHUVLQFOXGLQJYROXPHWUDQVIHUFRQVWDQW.WUDQVLQ PLQH[WUDYDVFXODUH[WUDFHOOXODUVSDFHYROXPHIUDFWLRQ9HHIÁX[UDWHFRQVWDQW .HSLQLWLDODUHDXQGHUFXUYHL$8& $QXQSDLUHG7WHVWZDVXVHGWRFDOFXODWHWKH VWDWLVWLFDOVLJQLÀFDQFHRITXDQWLWDWLYHSHUIXVLRQSDUDPHWHUVEHWZHHQPDOLJQDQF\ DQG EHQLJQ OXQJ OHVLRQV 5HFHLYHU RSHUDWLQJ FKDUDFWHULVWLF 52& DQDO\VLV ZDV DOVRSHUIRUPHGIRUHYDOXDWLRQRIVHQVLWLYLW\DQGVSHFLÀFLW\RISHUIXVLRQSDUDPHWHUV 5HVXOWV0DOLJQDQWOHVLRQVKDGKLJKHU.WUDQVYDOXHWKDQEHQLJQOHVLRQVYV S %XWWKHUHZHUHQRVLJQLÀFDQWGLIIHUHQFHVLQRWKHUSDUDPHWHUVPHDQ 9HYVPHDQ.HSYVPHDQL$8&YVUHVSHFWLYHO\ $.WUDQVYDOXHRIPRUHWKDQPLQZDVRSWLPDOIRUSUHGLFWLQJPDOLJQDQF\ VHQVLWLYLW\DQGVSHFLÀFLW\ &RQFOXVLRQ.WUDQVYDOXHRISHUIXVLRQSDUDPHWHUVRQ'&(05,FDQKHOSWRGLV FULPLQDWHEHWZHHQPDOLJQDQWDQGEHQLJQOXQJOHVLRQV 5RRP' ,QWHUYHQWLRQDO5DGLRORJ\ 66 2QFRORJ\ 0RGHUDWRUV )0HOFKLRUUH0LODQ,7 75DQG9LHQQD$7 % 6HJPHQWDOUDGLRHPEROL]DWLRQXVLQJ<WWULXPDQGLWVHIIHFWRQ KHSDWLFYROXPHFKDQJHV -07KH\VRKQ60XHOOHU-) 6FKODDN66LSLODH$%RFNLVFK 7 &/DXHQVWHLQ(VVHQ'(MHQVWKH\VRKQ#XQLGXLVEXUJHVVHQGH 3XUSRVH<WWULXPLVDEHWDHPLWWHUXVHGIRUUDGLRHPEROLVDWLRQDVDQHPHUJLQJ WKHUDS\RSWLRQIRUXQUHVHFWDEOHOLYHUPDOLJQDQFLHV$IWHUUDGLDWLRQWKHUDS\RIRQH OLYHUOREHWKHRWKHUOREHLVH[SHFWHGWRFRPSHQVDWHWKHWKHUDS\LQGXFHGORVVRI OLYHUIXQFWLRQ$LPRIWKLVVWXG\ZDVWRDVVHVVWKHDPRXQWRIYROXPHJDLQLQGXFHG LQWKHXQWUHDWHGOLYHUOREH 0HWKRGVDQG0DWHULDOV7KLUW\SDWLHQWVPIPHDQDJH\VXIIHULQJIURP KHSDWRFHOOXODUFDUFLQRPDZHUHVWXGLHG$OOSDWLHQWVXQGHUZHQWUDGLRHPEROLVDWLRQ RIWKHULJKWOLYHUOREHZLWK<WWULXP$PHDQGRVHRI*\ZDVGHOLYHUHGWRWKH WDUJHW KHSDWLF YROXPH UDQJH *\$EVROXWH YROXPHV RI WKH ULJKW 5/9 DQGOHIWOLYHUOREH//9ZHUHDVVHVVHGXVLQJ&7 EHIRUHDQGPRQWKVDIWHU UDGLRHPEROLVDWLRQRIWKHULJKWOLYHUOREH)XUWKHUPRUHWKHUHODWLYHYROXPHRIWKH OHIWOLYHUOREH//9>5/9//9@ZDVFDOFXODWHG 5HVXOWV%DVHOLQHYROXPHVRIWKHULJKWDQGOHIWOLYHUOREHDPRXQWHGWRPO5/9 DQGPO//9RQDYHUDJH7KHDEVROXWH//9VKRZHGDQLQFUHDVHRQDYHUDJHO\ DIWHUPRQWKV+RZHYHUWKHDEVROXWH5/9GHFUHDVHGVLJQLÀFDQWO\GXULQJ IROORZXSPHDQFKDQJH7KHDYHUDJHUHODWLYH//9ZDVEHIRUHDQG VL[PRQWKVDIWHUUDGLRHPEROLVDWLRQ &RQFOXVLRQ&RQVWUDLQWVRIOLYHUIXQFWLRQDIWHUUDGLRHPEROLVDWLRQRIRQHOLYHUOREH FDQEHSDUWLDOO\FRPSHQVDWHVWKURXJKK\SHUWURSK\RIWKHFRQWUDODWHUDOOREH7KLV REVHUYDWLRQPD\EHWKHEDVLVWRLQWURGXFHWKHFRQFHSWRIDUDGLDWLRQOREHFWRP\ XVLQJUDGLRHPEROLVDWLRQ&RQWUDODWHUDOK\SHUWURSK\RIWKHOLYHUIROORZLQJVLQJOHOREH UDGLRHPEROLVDWLRQUHGXFHVWKHGDQJHURIOLYHUIDLOXUH ORZGRVHSURWRFRON9P$PPVOLFHZDVXVHGZLWK+&RҋFORFNIRUODVW SDWLHQWV2QHUDGLRORJLVWDWRҋFORFNSRVLWLRQRIWKH&7WDEOHZHDULQJDSURQ ÀQJHUGRVLPHWHUFROODUDQGJRJJOHSHUIRUPHGDOOLQWHUYHQWLRQV%RG\KDQGDQG H\HOHQVXQVKLHOGHGRSHUDWRUGRVHVZHUHPRQLWRUHGWRWDOÁXRURVFRSLFWLPH7)7 DQGWRWDOKDQGWLPHHQWHULQJSULPDU\EHDP7+7ZHUHUHFRUGHG 5HVXOWV0HGLDQ7)7ZDVVUDQJHVPHGLDQ7+7ZDVVUDQJH V$YHUDJHRSHUDWRUGRVHVSHUSURFHGXUHDWGLIIHUHQW+&IRUURXWLQHSURWRFRO ZHUHFRPSDUDEOHUDQJHP6YDYHUDJHP6YORZGRVHSURWRFRO VKRZHGGRVHUHGXFWLRQP6Y0D[LPXPDYHUDJHGRVHWRKDQGVDQG H\HV ZHUH P6Y DQG P6Y P6Y DQG P6Y P6YDQG P6YIRU+&DQGRҋFORFN7KH\ZHUHP6YDQGP6YIRUWKH N9SURWRFRO &RQFOXVLRQ &RPSOLDQFH ZLWK RFFXSDWLRQDO OLPLWV FDQ EH UHDFKHG E\ PDWFKLQJ UDGLRORJLVWDQG+&SRVLWLRQDQGXVLQJORZGRVHSURWRFROV % 3HUFXWDQHRXVWUDQVWKRUDFLFQHHGOHELRSV\RISXOPRQDU\QRGXOHV ZLWK;SHU&7DQG;SHUJXLGHDQHZWHFKQLFDODSSURDFK '/HQL) 9DFLUFD',SSROLWR5&RUVR0RQ]D,7GDOHQL#WLQLW 3XUSRVH7 RHYDOXDWHIHDVLELOLW\DQGHIÀFDF\RISHUFXWDQHRVWUDQVWKRUDFLFQHHGOH ELRSV\RISXOPRQDU\QRGXOHVZLWK;SHU&7DQG;SHU*XLGH 0HWKRGVDQG0DWHULDOV)URPWRSDWLHQWVZHUHVFKHGXOHG IRUSHUFXWDQHRXVWUDQVWKRUDFLFQHHGOHELRSV\RISXOPRQDU\QRGXOHVXVLQJ;SHU &7DQG;SHU*XLGHQHZVRIWZDUHDSSOLFDWLRQVSURYLGHGE\3KLOLSV$OOXUD)' $OOSURFHGXUHVZHUHSHUIRUPHGZLWKORFDODQDHVWKHVLDLQWKHDQJLRJUDSKLFDOVXLWH %HIRUHSXQFWXUHSDWLHQWVXQGHUZHQW;SHU&7VFDQWKDWDOORZVWRREWDLQLPDJHVRI VPDOOERG\YROXPHVRIFRQLFDOVKDSHGXHWRFRQHEHDPDFTXLVLWLRQ2QWKHEDVLV RI'UHFRQVWUXFWLRQXVLQJ;SHU*XLGHZHSODQQHGWKHSDWKRIWKHQHHGOHWRWKH WDUJHWOHVLRQVDPSOHVZHUHREWDLQHGLQHDFKFDVHZLWKDFRD[LDOWHFKQLTXH $IWHU WKH SURFHGXUH SDWLHQWV XQGHUZHQW DJDLQ D ;SHU&7 VFDQ WR DVVHVV DQ\ FRPSOLFDWLRQV6DPSOHVZHUHFODVVLÀHGDVDGHTXDWHLGHQWLÀFDWLRQRIKLVWRW\SH JUDGHDQGSURJQRVWLFDOIDFWRUVLQWHUPHGLDWHGLDJQRVLVRIEHQLJQLW\PDOLJQDQF\ KLVWRW\SHDQGLQDGHTXDWH&RPSOLFDWLRQVDQGPHDQWLPHRIH[HFXWLRQZHUH DOVRUHFRUGHG 5HVXOWV,QSDWLHQWVVDPSOHVZHUHDGHTXDWHLQSDWLHQWVZHUHLQWHUPHGLDWH DQGLQLQDGHTXDWH3QHXPRWKRUD[ZDVUHFRUGHGLQRISDWLHQWVEXWH[WHUQDO GUDLQDJHZDVQHYHUUHTXLUHG3HULQRGXODUKDHPRUUKDJLFVXIIXVLRQZDVREVHUYHG LQSDWLHQWVDQGLQRQO\RQHFDVHVHOIOLPLWLQJKHPRSW\VLVZDVUHJLVWHUHG0HDQ WLPHRIH[HFXWLRQZDVPLQXWHV &RQFOXVLRQ3HUFXWDQHRXVWUDQVWKRUDFLFQHHGOHELRSV\RISXOPRQDU\QRGXOHVZLWK ;SHU&WDQG;SHUJXLGHLVDVDIHDQGDFFXUDWHSURFHGXUHDQGFDQEHSHUIRUPHG LQHYHU\SDWLHQWZLWKDKLJKSHUFHQWDJHRIDGHTXDWHVDPSOHVDQGZLWKDORZULVN RIVHYHUHFRPSOLFDWLRQV % 5HVSRQVHPRQLWRULQJIRUOXQJFDQFHUWKHUDS\XVLQJG\QDPLF FRQWUDVWHQKDQFHG&7VFDQDFRUUHODWLRQZLWK3(7&7 0<RR6+ZDQJ7 .LP6.LP6HRXO.5 3XUSRVH 7 R DVVHVV WKH XVHIXOQHVV RI G\QDPLF FRQWUDVWHQKDQFHG FRPSXWHG WRPRJUDSK\'&(&7IRUSUHGLFWLRQRIWUHDWPHQWUHVSRQVHDQGWRFRPSDUHWKH UHVXOWVRI'&(&7ZLWKWKRVHRILQWHJUDWHGSRVLWURQHPLVVLRQWRPRJUDSK\FRPSXWHG WRPRJUDSK\3(7&7LQSDWLHQWVZLWKOXQJFDQFHU 0HWKRGVDQG0DWHULDOV7ZHQW\IRXUSDWLHQWVZKRKDGFKHPRWKHUDS\RUUDGLR WKHUDS\IRUOXQJFDQFHUZLWK16&/&DQGZLWK6&/&ZHUHHQUROOHGLQWRWKLV VWXG\$WRWDORIWXPRXUVPHDQVL]HFPUDQJHFPZHUHUHYHDOHG RQIROORZXS'&(&7 REWDLQHGDWDQGVHFRQGVIROORZLQJDGPLQLVWUD WLRQRIFRQWUDVWPHGLDDQG3(7&7OHVVWKDQZHHNVDSDUW:HPHDVXUHGUHODWLYH HQKDQFHPHQWUDWLR5(5DWHDFKWLPHSRLQWRQ'&(&7DQGPD[LPXPVWDQGDUGLVHG XSWDNHYDOXH689PD[RQ3(7&7 $FFRUGLQJWRWKHUHVSRQVHHYDOXDWLRQFULWHULD LQVROLGWXPRXU5(&,67WXPRXUVZHUHFODVVLÀHGLQWRJURXSVDVSURJUHVVLYH GLVHDVH3'Q VWDEOHGLVHDVH6'Q DQGSDUWLDOUHVSRQVH35Q 5HVXOWV5(5DWVHFRQGVRI3'PHDQZDVKLJKHU3 WKDQWKRVHRI6'PHDQDQG35PHDQ689 PD[UHYHDOHGVLJQLÀFDQWFRUUHODWLRQZLWK5(5DWVHFRQGVU 3 UHVSHFWLYHO\RIWXPRXUVFODVVLÀHGDV35RU6'VKRZHG689PD[ RIRUOHVVDQG5(5DWVHFRQGVRIRUOHVV &RQFOXVLRQ'&(&7FDQSURYLGHWKHLQIRUPDWLRQDERXWWUHDWHGWXPRXUIXQFWLRQDO FRPSRVLWLRQ DV ZHOO DV DQDWRPLF FKDQJH LQ WKH SRVWWUHDWPHQW HYDOXDWLRQ IRU SDWLHQWVZLWKOXQJFDQFHU 6FLHQWLILF6HVVLRQ 6 &$' ( ) *+% (XURSHDQ&RQJUHVVRI 5DGLRORJ\ % 1HZFRPELQDWLRQRIPLWRP\FLQDQGFLVSODWLQIRUWUDQVDUWHULDO FKHPRHPEROLVDWLRQ7$&(RIXQUHVHFWDEOHKHSDWRFHOOXODU FDUFLQRPDGLIIHUHQWDHWLRORJLHVDQGORFDOUHVSRQVHUDWH 7 -9RJO.$XHUEDFK.2FKV6=DQJRV7 /HKQHUW1111DJXLE )UDQNIXUW'(WYRJO#HPXQLIUDQNIXUWGH 3XUSRVH7 RHYDOXDWHWKHHIIHFWRIFRQYHQWLRQDOWUDQVDUWHULDOFKHPRHPEROLVDWLRQ 7$&(RQORFDOUHVSRQVHUDWHVRIKHSDWRFHOOXODUFDUFLQRPD+&&SDWLHQWVZLWK GLIIHUHQWDHWLRORJLHVRIOLYHUFLUUKRVLVXVLQJDQHZFKHPRHPEROLVDWLRQ 0HWKRGVDQG0DWHULDOV,QWKLVSURVSHFWLYHVWXG\SDWLHQWVPDOH IHPDOHZLWKKLVWRSDWKRORJLFDOO\SURYHQ+&&ZHUHWUHDWHGZLWKUHSHWL WLYH7$&(PLWRP\FLQFLVSODWLQOLSLRGROIURP0DUFKWR0DUFK8QGHUO\LQJ OLYHUSDWKRORJ\&KLOG3XJKVFRUHWXPRXUYROXPHQXPEHURIWXPRXUVDQGORFDO UHVSRQVHZHUHLQFOXGHG,QLWLDODQGHQGWKHUDS\ORFDOWXPRXUUHVSRQVHZDVHYDOX DWHGDFFRUGLQJWRWKH5(&,67FULWHULD05,DQG&7YROXPHWULFPHDVXUHPHQWV 5HVXOWV/RFDOWXPRXUFRQWUROVKRZHGFRPSOHWHUHVSRQVH&5LQRISD WLHQWVQ SDUWLDOUHVSRQVH35LQQ VWDEOHGLVHDVH6'LQ Q SURJUHVVLYHGLVHDVH3'LQQ /RFDOUHVSRQVHUDWHVRISDWLHQWV ZLWKXQGHUO\LQJKHSDWLWLV&+&9Q ZHUH&5LQQ 35LQ Q 6'LQQ 3'LQQ DQGRISDWLHQWVZLWKXQGHUO\LQJ KHSDWLWLV%+%9Q 35LQQ 6'LQQ 3'LQ Q ,QSDWLHQWVZLWKERWK+&9DQG+%9Q ORFDOUHVSRQVHVKRZHG35LQ Q 6'LQQ 3DWLHQWVZLWKKDHPRFKURPDWRVLVQ VKRZHG35LQ Q 6'LQQ 3'LQQ DQGSDWLHQWVZLWKQXWULWLYHWR[LFOLYHU FLUUKRVLVQ 35LQQ 6'LQQ 3'LQQ &RQFOXVLRQ7KHQHZ7$&(SURWRFRO\LHOGVUHVSHFWDEOHUHVSRQVHUDWHVLQSDWLHQWV ZLWK OLYHU FLUUKRVLVFDXVHG +&& LQGHSHQGHQW RI WKH XQGHUO\LQJ DHWLRORJ\ RI WKH OLYHUFLUUKRVLV % $QWLDQJLRJHQHVLVHIIHFWRIDUVHQLFWULR[LGHRQV\QHUJLVLQJWKH WUDQVDUWHULDOFKHPRHPEROLVDWLRQHIIHFWLQWKHWUHDWPHQWRIUDEELW9; WXPRXUV ;'DL.;X+6KDR< &KHQJ4:DQJ6KHQ\DQJ&1 GDL[XGH[#YLSVLQDFRP 3XUSRVH7 RVWXG\WKHHIIHFWDQGPHFKDQLVPRIDUVHQLFWULR[LGH$V2FRPELQHG ZLWK WUDQVDUWHULDO FKHPRHPEROLVDWLRQ 7$&( RQ WKH JURZWK DQG PHWDVWDVLV RI UDEELW9;WXPRXUV 0HWKRGVDQG0DWHULDOV $IWHUZHHNVRILQRFXODWLRQRI9;WXPRXULQWRWKHOLYHUV UDEELWVZHUHUDQGRPO\GLYLGHGLQWRJURXSV*URXS$LVFRQWUROJURXSJURXS %ZLWK8)/3HPEROLVDWLRQJURXS&ZLWK8)/3DQG$'0JURXS'ZLWK8)/3DQG $V2DQGJURXS(FRPELQHG8)/3ZLWK $'0DQG $V27ZRZHHNVDIWHUWUHDW PHQWDOOUDEELWVZHUHH[DPLQHGZLWKFRQWUDVWHQKDQFHG&7DQGWKHWXPRXUDQG QHFURWLFZHUHPHDVXUHGDQGFRPSDUHGZLWKSDWKRORJLFDOÀQGLQJV9(*)DQG09' ZHUHGHWHFWHGE\LPPXQRKLVWRFKHPLFDOVWDLQLQJDQGTXDQWLWDWLYHFRPSDULVRQRI WXPRXU9(*)P51$LQGLIIHUHQWJURXSVZDVGRQHE\573&5 5HVXOWV &RPSDUHG ZLWK FRQWURO JURXS WXPRXUV LQ WKH RWKHU IRXU JURXSVJUHZ VORZO\SDQGZLWKODUJHUQHFURVLVS&RPSDUHGZLWKQR$V2 JURXSDV%DQG&JURXS'DQG(JUHZVORZO\S7KHUHDUHOHVVLQWUDKHSDWLF DQGGLVWDQWPHWDVWDVLVIRXQGLQJURXS'DQG(ZLWK$V2WKDQWKHRWKHUJURXSV S09'DQG9(*)P51$H[SUHVVLRQLQJURXSV'DQG(ZLWK$V2DUH VLJQLÀFDQWO\UHGXFHGWKDQQR$V2JURXSVS09'LQJURXS(FRPELQD WLRQZLWK$V2DQG$'0LVVLJQLÀFDQWO\ORZHUWKDQWKHRWKHUWZRJURXSV&DQG' ZLWK$'0RU$V2UHVSHFWLYHO\S &RQFOXVLRQ &RPELQDWLRQ RI$V2 DQG URXWLQH FKHPRWKHUDSHXWLF GUXJV FDQ V\QHUJ\ WKH DQWLWXPRXU HIIHFWV RI 7$&($V2 PD\ UHGXFH WKH H[SUHVVLRQ RI 9(*)P51$DQGSUHYHQWWXPRXUJURZWKDQGPHWDVWDVLVE\LQKLELWLQJWKHDQJLR JHQHVLVSURFHVV % 7UDQVDUWHULDOFKHPRHPEROLVDWLRQ7$&(LQSDWLHQWVZLWK XQUHVHFWDEOHFKRODQJLRFDUFLQRPDUHVXOWVDQGSURJQRVWLFIDFWRUV 7 -9RJO1111DJXLE7 /HKQHUW1($1RXU(OGLQ :2%HFKVWHLQ6=HX]HP-7URMDQ7 *UXEHU5RXK )UDQNIXUWD0DLQ'(WYRJO#HPXQLIUDQNIXUWGH 3XUSRVH7 RHYDOXDWHWKHHIIHFWLYHQHVVRIWUDQVDUWHULDOFKHPRHPEROLVDWLRQ7$&( ZLWKIRXUFKHPRWKHUDSHXWLFSURWRFROVUHJDUGLQJORFDOWXPRXUFRQWURODQGVXUYLYDORI SDWLHQWVZLWKXQUHVHFWDEOHFKRODQJLRFDUFLQRPD&&&DQGWRLGHQWLI\WKHSURJQRVWLF IDFWRUVGHWHUPLQLQJWUHDWPHQWVXFFHVV % /RQJWHUPVXUYLYDOGDWDRISDWLHQWVZLWKOLYHUPHWDVWDVHVRI FRORUHFWDOFDQFHUDIWHU05JXLGHGODVHULQGXFHGWKHUPRWKHUDS\/,77 7 -9RJO$'RPPHUPXWK.(LFKOHU6=DQJRV0*0DFN )UDQNIXUW'(WYRJO#HPXQLIUDQNIXUWGH 3XUSRVH 7 R HYDOXDWH UHWURVSHFWLYHO\ ORQJWHUP VXUYLYDO RI SDWLHQWV ZLWK FRORUHFWDOOLYHUPHWDVWDVHVWUHDWHGZLWK05JXLGHGODVHULQGXFHGWKHUPRWKHUDS\ /,77GHSHQGLQJRQGLIIHUHQWIDFWRUV 0HWKRGVDQG0DWHULDOVSDWLHQWVZLWKOLYHUPHWDVWDVHVIURPFRORUHFWDOFDUFL QRPDWUHDWHGZLWK05JXLGHG/,77EHWZHHQDQGZHUHLQFOXGHG)RU VXUYLYDODQDO\VLVWXPRXUORFDOLVDWLRQ710FODVVLÀFDWLRQQXPEHURIPHWDVWDVHV GLDPHWHU DQG YROXPH RI PHWDVWDVHV DQG QHFURVLV OREXODU VSUHDG QXPEHU RI WUHDWPHQW VHVVLRQV SHUIRUPDQFH RI DGMXYDQW FKHPRWKHUDS\ DQG WUDQVDUWHULDO FKHPRHPEROLVDWLRQ ZHUH FRQVLGHUHG 7KH .DSODQ0HLHU PHWKRG ZDVXVHG WR FRQGXFWWKLVVXUYLYDODQDO\VLV 5HVXOWV /RJUDQN WHVW VKRZHG VWDWLVWLFDOO\ VLJQLÀFDQW GLIIHUHQFHV EHWZHHQ VXU YLYDOFXUYHVPXOWLYDULDWH&R[UHJUHVVLRQDQDO\VLVSVKRZHGSURJQRVWLF IDFWRUV UHJDUGLQJ RYHUDOO VXUYLYDO OLNH QXPEHU RI PHWDVWDVHV SUH LQWHUYHQWLRQ DGMXYDQWFKHPRWKHUDS\GLDPHWHURIPHWDVWDVHVUDWLRRIYROXPHVRIQHFURVLVDQG PHWDVWDVHVDQGDIIHFWHGO\PSKQRGHV0HGLDQRYHUDOOVXUYLYDOUDWHDWWKHWLPH RIÀUVW/,77ZDVPRQWKV\HDUVXUYLYDO\HDUVXUYLYDO\HDU VXUYLYDO\HDUVXUYLYDO\HDUVXUYLYDO1XPEHUVRIPHWDV WDVHVSUHLQWHUYHQWLRQPHWDVWDVHVZLWKDPHGLDQVXUYLYDOUDWHRIPRQWKV PHWDVWDVHVPRQWKVPHWDVWDVHVPRQWKV0HGLDQVXUYLYDOUDWHIRU PHWDVWDVHVPPLQGLDPHWHUPRQWKVPPPRQWKVPP PRQWKVDQG!PPPRQWKV$IIHFWHGO\PSKQRGHVPHGLDQVXUYLYDOUDWH IRUSDWLHQWVZLWK1FODVVLÀFDWLRQPRQWKV1FODVVLÀFDWLRQPRQWKV11 1FODVVLÀFDWLRQPRQWKV &RQFOXVLRQ7KHPXOWLYDULDWH&R[UHJUHVVLRQPRGHOSURYLGHGWKHPLQLPDOQXPEHU RI VLJQLÀFDQW YDULDEOHV ZLWK WKH PD[LPDO SURJQRVWLF YDOXH FRQFHUQLQJ RYHUDOO VXUYLYDOIRU05JXLGHG/,77 LHGLDPHWHUDQGQXPEHURIPHWDVWDVHVDQGSULPDU\ FODVVLÀFDWLRQRIO\PSKQRGHV % 05JXLGHGUDGLRIUHTXHQF\DEODWLRQXVLQJDZLGHERUH7V\VWHP FOLQLFDOUHVXOWVRIWUHDWHGOLYHUWXPRXUV +5HPSS 5+RIIPDQQ/:DLEHO3 3HUHLUD&'&ODXVVHQ6&ODVHQ 7ELQJHQ'(+HLOEURQQ'( 3XUSRVH7 RHYDOXDWHWKHHIIHFWLYHQHVVRI05JXLGHGUDGLRIUHTXHQF\5)DEODWLRQ RIOLYHUPDOLJQDQFLHVXVLQJDZLGHERUH705V\VWHP 0HWKRGVDQG0DWHULDOV,QSDWLHQWVIHPDOHVPDOHVDQXPEHURI OLYHUOHVLRQVZHUHWUHDWHGLQVHVVLRQVE\SHUFXWDQHRXV5)DEODWLRQ3DWLHQW PHDQDJHZDVUDQJHOHVLRQVZHUHSULPDU\OLYHUWXPRXUVOHVLRQV ZHUH OLYHU PHWDVWDVHV LQFOXGLQJ FRORUHFWDO OLYHU PHWDVWDVHV 2WKHU SULPDU\ WXPRXUVZHUHPHODQRPDEUHDVWFDQFHUDQGQHXURHQGRFULQHWXPRXUV0HDQOHVLRQ GLDPHWHUZDVPPUDQJHPP05FRPSDWLEOHELRUPXOWLSRODULQWHUQDOO\ FRROHG5)SUREHVZHUHXVHG3ODQQLQJWDUJHWLQJDQGSRVWLQWHUYHQWLRQDOFRQWURO LPDJLQJZHUHFDUULHGRXWLQDZLGHERUH705VFDQQHUERUHFP7 HFKQL FDOVXFFHVVZDVDVVHVVHGE\DFRQWUDVWHQKDQFHG05OLYHUH[DPLQDWLRQGLUHFWO\ VXEVHTXHQWWRWKHLQWHUYHQWLRQ7 HFKQLTXHHIIHFWLYHQHVVZDVDVVHVVHGE\G\QDPLF 05OLYHUVWXGLHVPHDQIROORZXSSHULRGZDVPRQWKVUDQJHPRQWKV 5HVXOWV &RPSOHWH DEODWLRQ ZDV DFKLHYHG LQ OHVLRQV ,Q OHVLRQVORFDOWXPRXUUHFXUUHQFHRFFXUUHGPRQWKVDIWHUWKHUDS\ OHVLRQVFRXOGEHWUHDWHGLQDVHFRQGVHVVLRQZLWKFRPSOHWHDEODWLRQRWKHUVZHUH UHIHUUHGWRVXUJHU\2YHUDOO5)WHFKQLTXHHIIHFWLYHQHVVUDWHZDV RYHUDOO WKHUDS\ VXFFHVV LQFOXGLQJ VXUJHU\ 6XEVHTXHQW WR LQWHUYHQWLRQVWZRPDMRUFRPSOLFDWLRQVEOHHGLQJDQGLQIHFWHGELOLRPDDQG PLQRU FRPSOLFDWLRQV RFFXUUHG ,Q SDWLHQWV QHZ LQWUD RU H[WUDKHSDWLFPDQLIHVWDWLRQVRIWKHGLVHDVHRFFXUUHGGXULQJWKHIROORZXSSHULRG &RQFOXVLRQ:LGHERUH05JXLGHG5)DEODWLRQLVDVDIHDQGHIIHFWLYHWUHDWPHQW RSWLRQIRUOLYHUOHVLRQV 6FLHQWLILF6HVVLRQ $ 6&'()*+%(XURSHDQ&RQJUHVVRI 5DGLRORJ\ 0RQGD\ $FFRUGLQJWRWKH5(&,67FULWHULDSDWLHQWVKDG´SDUWLDOUHVSRQVHµKDG´VWDEOH GLVHDVHµDQG´SURJUHVVLYHGLVHDVHµ0HDQVXUYLYDOZDVGD\VLQSDWLHQWV ZLWKFRORUHFWDOFDUFLQRPDGD\VLQEUHDVWFDQFHUGD\VLQVDUFRPDV GD\VLQUHQDOFHOOFDUFLQRPDGD\VPHODQRPDGD\VLQWK\URLGFDQFHUDQG GD\VLQRWKHUFDQFHUVXVLQJWKH.DSODQ0HLHUPHWKRG &RQFOXVLRQ $FFRUGLQJWRWKHVHÀQGLQJV73&(PLJKWEHDZHOOWROHUDWHGSURFHGXUH IRUWKHSDOOLDWLYHWUHDWPHQWRIQRQUHVHFWDEOHOXQJPHWDVWDVHV % 7UDQVDUWHULDOFKHPRHPEROL]DWLRQ7$&(XVLQJGUXJHOXWLQJ EHDGSUHORDGHGZLWKLULQRWHFDQ'(%,5,LQWKHWUHDWPHQWRI PHWDVWDVHVIURPXYHDOPHODQRPD80FRQÀQHGWRWKHOLYHU SUHOLPLQDU\DVVHVVPHQWRIWXPRXUUHVSRQVHDQGSUHGLFWLYHYDOXHRI DQJLRJUDSKLFSDWWHUQDQGGLIIXVLRQZHLJKWHGPDJQHWLFUHVRQDQFH LPDJLQJ':05, 09HQWXULQL*$JRVWLQL/3LOOD&/RVLR6&DSSLR$'HO0DVFKLR0LODQ,7 YHQWXULQLPDVVLPR#KVULW 3XUSRVH80YHU\DJJUHVVLYHUDUHWXPRXUJLYHVPHWDVWDVHVFRQÀQHGWRWKHOLYHU LQPRUHWKDQRIWKHSDWLHQWV6\VWHPLFUHJLRQDOFKHPRWKHUDS\IRWHPXVWLQH LVXVXDOO\LQHIIHFWLYH2XUSXUSRVHZDVWRDVVHVVIHDVLELOLW\FRPSOLFDWLRQVWXPRXU UHVSRQVHDQGSUHGLFWLYHYDOXHRIDQJLRJUDSKLFSDWWHUQDQG':05,LQSDWLHQWV VXEPLWWHGWR7$&(ZLWK'(%,5, 0HWKRGVDQG0DWHULDOV,QSDWLHQWVDIIHFWHGE\80PHWDVWDVHVFRQ ÀQHGWRWKHOLYHUKLVWRORJLFDOO\GLDJQRVHGZHUHHQUROOHGSDWLHQWVZLWK!OHVLRQV ZHUHVXEPLWWHGWR7$&(ZLWK'(%,5,DVVHFRQGOLQHDSSURDFKLQFDVHRIGLVHDVH SURJUHVVLRQDIWHUV\VWHPLFUHJLRQDOIRWHPXVWLQHSDWLHQWVZLWKOHVLRQVZHUH GLUHFWO\VXEPLWWHGWR7$&(ZLWK'(%,5,DVÀUVWOLQHDSSURDFK7XPRXUUHVSRQVH ZDVDVVHVVHGE\FRQWUDVWHQKDQFHG&75HFLVWDWEDVHOLQHSUHGLFWLYHYDOXHRI DQJLRJUDSKLFSDWWHUQK\SHUYDVFXODUQRGXODUYVK\SRYDVFXODULQÀOWUDWLYHSDWWHUQ DQGDSSDUHQWGLIIXVLRQFRHIÀFLHQW$'&DW':05,ZDVFRQVLGHUHG 5HVXOWV7$&(ZLWK'(%,5,WRWDOSURFHGXUHVPHDQ ZDVIHDVLEOHZLWKD ORZFRPSOLFDWLRQUDWHRQHFKROHF\VWLWLVVSRQWDQHRXVO\UHVROYHGLQDOOSDWLHQWV3' RFFXUUHGLQDOOSDWLHQWVVXEPLWWHGWRIRWHPXVWLQH7XPRXUUHVSRQVHVWR7$&(ZLWK '(%,5,ZHUHDVIROORZV&5356'3'VHFRQGOLQH'(%,5,356' 3'ÀUVWOLQH'(%,5,&5356'3'3'ZDVFRUUHODWHGZLWKK\SRYDVFXODU LQÀOWUDWLYHDQJLRJUDSKLFSDWWHUQDQGKLJKEDVHOLQH$'&YDOXHVRIOHVLRQVS &RQFOXVLRQ,QRXUSUHOLPLQDU\H[SHULHQFH7$&(ZLWK'(%,5,ZDVIHDVLEOHVDIH DQGHIIHFWLYHLQDOOSDWLHQWVLWFDQEHSURSRVHGDVÀUVWOLQHWUHDWPHQWLQSDWLHQWVDI IHFWHGE\80PHWDVWDVHVFRQÀQHGWRWKHOLYHU+\SRYDVFXODULQÀOWUDWLYHDQJLRJUDSKLF SDWWHUQDQGKLJKEDVHOLQH$'&DUHSUHGLFWLYHRIDORZUHVSRQVH % ,PSDFWRIKHSDWLFVWHDWRVLVDQGÀEURVLVRQVHJPHQWDOOLYHU K\SHUWURSK\DIWHUSUHRSHUDWLYHSRUWDOYHLQHPEROLVDWLRQ $.RRSV(5DPFLF+,WWULFK&+DEHUPDQQ*$GDP +DPEXUJ'(NRRSV#XNHXQLKDPEXUJGH 3XUSRVH3RUWDOYHLQHPEROLVDWLRQ39(DOORZVWKHLQGXFWLRQRIVHJPHQWDOOLYHU K\SHUWURSK\LQLQLWLDOO\LUUHVHFWDEOHOLYHUPDOLJQDQFLHV3XUSRVHRIWKLVVWXG\ZDV WRGHWHUPLQHWKHLPSDFWRISUHH[LVWLQJKHSDWLFVWHDWRVLVDQGSRUWDOÀEURVLVRQWKH UHODWLYHDQGDEVROXWHK\SHUWURSK\RIWKHOHIWODWHUDOVHJPHQWVLQSDWLHQWVVFKHGXOHG IRUH[WHQGHGULJKWKHSDWHFWRP\ 0HWKRGVDQG0DWHULDOV+LVWRORJ\IURPSUHLQWHUYHQWLRQDOELRSV\RUWKHUHVHF WLRQ VSHFLPHQ ZDV HYDOXDWHG LQ SDWLHQWV WKDW UHFHLYHG 39( EHFDXVH RI SUL PDULO\LUUHVHFWDEOHPDOLJQDQFLHVFRORUHFWDOPHWDVWDVHVRWKHUPHWDVWDVHV FKRODQJLRFDUFLQRPD+&&$OODFFHVVLEOHSRUWDOEUDQFKHVRIVHJPHQWV ZHUHHPEROLVHGZLWKF\DQRDFU\ODWHJOXH&7YROXPHWU\ZDVSHUIRUPHGSULRUDQG ZHHNVDIWHUHPEROLVDWLRQLIQHFHVVDU\UHSHDWHGHYHU\ZHHNVXQWLOWKHIXWXUH OLYHUUHPQDQWZHLJKWH[FHHGHGERG\ZHLJKW'LDJQRVLVRIKHSDWLFVWHDWRVLV DQGSRUWDOÀEURVLVZHUHFRPSDUHGZLWKK\SHUWURSK\UDWHVFDOFXODWLQJ/HYHQH7 WHVWVDQG6WXGHQWҋV7WHVWV 5HVXOWV6WHDWRVLVZDVIRXQGLQSDWLHQWVJUDGHGPLOGPRGHUDWH DQG VHYHUH ÀEURVLV LQ SDWLHQWV JUDGHG PLOG PRGHUDWH VHYHUHDQGFLUUKRVLV:LWKRXWVWHQRVLVYROXPHJDLQZDVDIWHUGD\V GZLWKVWHQRVLVRQO\DIWHUDPHDQRIGD\VG7KHVHDE VROXWHDQGUHODWLYHGLIIHUHQFHVUHDFKHGVWDWLVWLFDOVLJQLÀFDQFHSZKHUHDV QRVLJQLÀFDQWGLIIHUHQFHS ZDVIRXQGLQWKHOHIWODWHUDOVHJPHQWDOYROXPH LQFUHDVHEHWZHHQQRQÀEURWLFDQGÀEURWLFOLYHUV &RQFOXVLRQ+HSDWLFVWHDWRVLVUHGXFHVWKHK\SHUWURSK\FDSDELOLW\DIWHU39(+RZ HYHUWKHPRUHFKURQLFOLYHUGDPDJHRILQWKLVVWXG\PRVWO\PLOGSRUWDOÀEURVLV GLGQRWOLPLWOLYHUK\SHUWURSK\ 0HWKRGVDQG0DWHULDOVSDWLHQWVPHDQ\HDUVZLWKXQUHVHFWDEOH&&& ZHUHUHSHDWHGO\WUHDWHGZLWK7$&(,QWRWDOVHVVLRQVPHDQVHVVLRQV SDWLHQWUDQJHZHUHSHUIRUPHGLQZHHNLQWHUYDOV7KHFKHPRWKHUDSHXWLF DJHQW XVHG ZDV PLWRP\FLQ& LQ RI SDWLHQWV JHPFLWDELQH LQ PLWRP\FLQ&JHPFLWDELQHLQDQGJHPFLWDELQHPLWRP\FLQ& FLVSODWLQLQ(PEROLVDWLRQZDVSHUIRUPHGZLWKOLSLRGRODQGHPERFHSW /RFDOWXPRXUUHVSRQVHZDVHYDOXDWHGE\05,DFFRUGLQJWRWKH5(&,67FULWHULD 6XUYLYDOGDWDZHUHFDOFXODWHGDFFRUGLQJWRWKH.DSODQ0HLHUPHWKRG3URJQRVWLF IDFWRUVIRUVXUYLYDOZHUHHYDOXDWHGXVLQJORJUDQNWHVW 5HVXOWV /RFDO WXPRXU FRQWUROV ZHUH SDUWLDO UHVSRQVH VWDEOH GLVHDVHSURJUHVVLYHGLVHDVHRISDWLHQWV0HGLDQ DQGPHDQVXUYLYDOWLPHVIURPWKHVWDUWRI7$&(ZHUHDQGPRQWKV6XUYLYDO UDWHIURPWKHVWDUWRI7$&(ZDVDIWHU\HDUDIWHU\HDUVDQGDIWHU \HDUV,QLWLDOWXPRXUUHVSRQVHKLJKWXPRXUYDVFXODULW\DQG&KLOG3XJKFODVV$ ZHUHVWDWLVWLFDOO\VLJQLÀFDQWIDFWRUVIRUVXUYLYDODQGQXPEHURIWXPRXUOHVLRQVDQG ORFDWLRQLQOLYHUZHUHQRWVWDWLVWLFDOO\VLJQLÀFDQW1RVWDWLVWLFDOO\VLJQLÀFDQWGLIIHUHQFH EHWZHHQSDWLHQWVWUHDWHGZLWKGLIIHUHQWFKHPRWKHUDS\SURWRFROVZDVGRFXPHQWHG &RQFOXVLRQ7$&(LVDSDOOLDWLYHDQGVDIHWUHDWPHQWRSWLRQIRUSDWLHQWVZLWKXQ UHVHFWDEOH&&&&KLOG3XJKFODVV%WXPRXUK\SRYDVFXODULW\LQLWLDOO\SURJUHVVLYH GLVHDVHZHUHSRRUSURJQRVWLFIDFWRUVIRUVXUYLYDO % '&EHDGVFKHPRHPEROLVDWLRQRI+&&DQGHYDOXDWLRQRIWKHUHVXOWV XVLQJ&(86DQG0'&7 DWZR\HDUVWXG\ 97 VDJNRXOL7 6ROGDWRV6.DPSDQDURX67 DQWHOHV/7KDQRV.0DODJDUL 03RPRQL'$.HOHNLV$WKHQV*5PNDPSDQDURX#JPDLOFRP 3XUSRVH 7KH SXUSRVH ZDV WR FRPSDUH WKH DFFXUDF\ RI FRQWUDVWHQKDQFHG XOWUDVRXQG&(86DQGPXOWLGHWHFWRU&70'&7IRUHYDOXDWLQJWKHRXWFRPHRI WUDQVDUWHULDOFKHPRHPEROLVDWLRQZLWKGR[RUXELFLQEHDGVLQSDWLHQWVZLWK+&& 0HWKRGVDQG0DWHULDOV:HUHWURVSHFWLYHO\VWXGLHGWKHIROORZXSLPDJLQJVWXG LHV RI D WRWDO RI QRGXOHV REVHUYHG LQ SDWLHQWV PDOHVD Q G I H P D O H V WKDWUDQJHGLQDJHIURPWRZLWKELRSV\SURYHQ+&&ZKRKDGXQGHUZHQW FKHPRHPEROLVDWLRQZLWK'&EHDGV$OOSDWLHQWVZHUHH[DPLQHGZLWKPXOWLSKDVLF FRQWUDVWHQKDQFHG 0'&7 DQG &(86 DSSUR[LPDWHO\ ZHHNV DIWHU '&EHDGV FKHPRHPEROLVDWLRQ &RQWUDVW HQKDQFHPHQW DSSHDULQJ ZLWKLQ WKH WXPRXU ZDV LQWHUSUHWHG DV LQFRPSOHWH WUHDWPHQW RU WXPRXU UHFXUUHQFH 0'&7ZDV XVHG DV UHIHUHQFHVWDQGDUGDQGDQJLRJUDSK\LQFDVHDGGLWLRQDO'&EHDGVWUHDWPHQWZDV SHUIRUPHGGXHWRLQFRPSOHWHUHVSRQVH$OOH[DPLQDWLRQVZHUHLQWHUSUHWHGEOLQGO\ E\WZRUDGLRORJLVWVDQGDIWHUZDUGV&(86ÀQGLQJVZHUHFRPSDUHGZLWK0'&7E\ DQH[SHULHQFHGUDGLRORJLVWLQDEGRPLQDOLPDJLQJ 5HVXOWV,QQRGXOHVDFRPSOHWHUHVSRQVHUHYHDOHGLQQRGXOHVDQGLQFRP SOHWHLQWKHRWKHU3HUFHQWDJHRIFRPSOHWHUHVSRQVHZDV3RVW'&EHDGV FKHPRHPEROLVDWLRQ&(86ZDVDEOHWRGHWHFWRIFDVHVZLWKUHVLGXDOWXPRXU 7KH UHVXOWV REWDLQHG ZLWK &(86 DJUHHG ZLWK WKRVH REWDLQHG ZLWK0'&7 LQ DOO FDVHVUHQGHULQJDGLDJQRVWLFDFFXUDF\RI7KHUHZDVQRWDQ\VWDWLVWLFDOO\ VLJQLÀFDQWGLIIHUHQFHLQRYHUDOOGLDJQRVWLFDFFXUDF\EHWZHHQ0'&7DQG&(86LQ WKHHYDOXDWLRQRIUHVLGXDOWXPRXUS! &RQFOXVLRQ&(86UHSUHVHQWVDFRVWHIIHFWLYHDQGYDOXDEOHWRROLQWKHHYDOXDWLRQ RIWKHRXWFRPHRIFKHPRHPEROLVDWLRQZLWK'&EHDGVLQ+&& % 7UDQVSXOPRQDU\FKHPRHPEROLVDWLRQ73&(DVDUHJLRQDO RQFRORJLFDOWUHDWPHQWIRUQRQUHVHFWDEOHOXQJPHWDVWDVHV 7 -9RJO6/LQGHPD\U1(1RXU(OGLQ7 'DXGD6=DQJRV )UDQNIXUW'(WYRJO#HPXQLIUDQNIXUWGH 3XUSRVH7 RHYDOXDWHWXPRXUUHVSRQVHZLWKYROXPHWULFDVVHVVPHQWIRUWXPRXU VL]HDIWHUWUHDWPHQWRIXQUHVHFWDEOHOXQJPHWDVWDVHVZLWKUHSHWLWLYHWUDQVSXOPRQDU\ FKHPRHPEROLVDWLRQ73&(LQSDOOLDWLYHLQWHQWLRQ 0HWKRGVDQG0DWHULDOV%HWZHHQDQGSDWLHQWVPHDQ\HDUV PDOHVIHPDOHVVXIIHULQJIURPXQUHVHFWDEOHOXQJPHWDVWDVHVZHUH WUHDWHGZLWK73&(UDQJHVHVVLRQVPHDQ7KH\IHDWXUHGDPHDQRI PHWDVWDVHVRIGLIIHUHQWRULJLQVFRORUHFWDOFDUFLQRPDQ EUHDVWFDQFHUQ VDUFRPDQ UHQDOFHOOXODUFDUFLQRPDQ PHODQRPDQ WK\URLGHDOQ DQGRWKHUVQ /LSLRGROPLWRP\FLQ&DQGPLFURVSKHUHV6SKHUH[ZHUHDGPLQ LVWHUHGYLDEDOORRQSURWHFWLRQ$WZHHNLQWHUYDOVGLDJQRVLVDQGIROORZXSZHUH DFFRPSOLVKHGXVLQJXQHQKDQFHGDQGFRQWUDVWHQKDQFHGFRPSXWHGWRPRJUDSK\ 5HVXOWV$OOSDWLHQWVWROHUDWHGWKHUHSHDWHGWUHDWPHQWVZLWKRXWDGYHUVHHIIHFWV ,QQ PRGHUDWHWRKLJKOLSLRGROXSWDNHZDVIRXQGZKLOHQ RIWKHWUHDWHGWXPRXUVVKRZHGDORZVWRUDJH,QQ RIHPEROLVHGPH WDVWDVHVWXPRXUYROXPHZDVUHVROYHGWRPORQDYHUDJHLQQ LW UHPDLQHGXQFKDQJHGZKLOHLQQ LWLQFUHDVHGWRPORQDYHUDJH 6FLHQWLILF6HVVLRQ 6 &$' ( ) *+% (XURSHDQ&RQJUHVVRI 5DGLRORJ\ % ,VLWSRVVLEOHWRLGHQWLI\DSDWKRORJLFKLQGIRRWDOLJQPHQWRQQRQ ZHLJKWEHDULQJFRURQDO05LPDJHV"$QDWWHPSWXVLQJGLIIHUHQW PHDVXUHPHQWWHFKQLTXHV ) 0%XFN $+RIIPDQQ10DPLVFK0)DUVKDG1(VSLQRVD'5HVQLFN -+RGOHU=XULFK&+6DQ'LHJR&$86 3XUSRVH7 RLQYHVWLJDWHWKHDELOLW\WRGLVFULPLQDWHEHWZHHQSDWLHQWVZLWKQRUPDO DQGSDWKRORJLFKLQGIRRWDOLJQPHQW+$RQFRURQDOQRQZHLJKWEHDULQJ05LPDJHV 0HWKRGVDQG0DWHULDOV,5%DSSURYDODQGLQIRUPHGFRQVHQWRIDOOSDWLHQWVZDV REWDLQHG+$ZDVTXDQWLÀHGRQ+$YLHZUDGLRJUDSKVRISDWLHQWVPHDQDJH \HDUV UDQJH \HDUV XVLQJ WKUHH GLIIHUHQW PHDVXUHPHQW WHFKQLTXHV FDOFDQHDOD[LVPHGLDODQGODWHUDOFDOFDQHDOFRQWRXU7KHVHPHDVXUHPHQWVZHUH XVHGWRGHÀQHDJURXSRISDWLHQWVZLWKDQRUPDO+$YDOJXVDQGDJURXS ZLWKDFOHDUO\SDWKRORJLF+$!YDOJXVRUYDUXV+$ZDVWKHQPHDVXUHGRQ FRURQDO05LPDJHVXVLQJVL[GLIIHUHQWPHDVXUHPHQWWHFKQLTXHVFDOFDQHDOD[LV PHGLDO DQG ODWHUDO FDOFDQHDO FRQWRXU VXVWHQWDFXOXPWDQJHQW ÀEXORFDOFDQHDO GLVWDQFHWDODURIIVHW52&DQDO\VLVZDVSHUIRUPHGWRÀQGWKHRQH05PHDVXUH PHQWWHFKQLTXHZLWKRSWLPDOVHQVLWLYLW\DQGVSHFLÀFLW\IRUGLVFULPLQDWLRQEHWZHHQ QRUPDODQGSDWKRORJLF+$ 5HVXOWV,IRQWKH+$YLHZUDGLRJUDSKVWKHPHDVXUHPHQWVXVLQJWKHPHGLDOFDO FDQHDOFRQWRXUZHUHGHÀQLQJWKHDVVLJQPHQWRIWKHSDWLHQWVLQWRWKHQRUPDORUWKH SDWKRORJLFDOJURXSDOOPHDVXUHPHQWVRQ05LPDJHVFRXOGFOHDUO\SLGHQWLI\ WKHSDWKRORJ\05PHDVXUHPHQWZLWKWKHFDOFDQHDOD[LVKRZHYHUUHDFKHGWKHEHVW FRPELQDWLRQRIVHQVLWLYLW\DQGVSHFLÀFLW\ZLWKDFXWRIIRI!YDOJXV &RQFOXVLRQ ,W LV SRVVLEOH WR GLVFULPLQDWH EHWZHHQ SDWLHQWV ZLWK QRUPDO DQG SDWKRORJLF+$RQFRURQDOQRQZHLJKWEHDULQJ05LPDJHVZLWKDVHQVLWLYLW\RI DQGDVSHFLÀFLW\RI % 6FUHZKRPHPHFKDQLVPDQGLWVLQÁXHQFHRQWLELDOWXEHURVLW\ WURFKOHDUJURRYH777*GLVWDQFHPHDVXUHPHQWRQ05 H[DPLQDWLRQVRIWKHNQHHLQDV\PSWRPDWLFYROXQWHHUVLQIXOO H[WHQVLRQÁH[LRQDQGÁH[LRQ 7 -'LHWULFK0%HW]&:$3ÀUUPDQQ3 3 .RFK6) )XFHQWHVH=XULFK&+ WGLHW#JP[QHW 3XUSRVH ,QFUHDVHG WLELDO WXEHURVLW\WURFKOHDU JURRYH 777* GLVWDQFH OHDGV WR SDWHOODU LQVWDELOLW\ 7KH VRFDOOHG VFUHZKRPH PHFKDQLVP UHIHUV WR DQ RXWZDUG URWDWLRQRIWKHWLELDZKHQWKHNQHHUHDFKHVIXOOH[WHQVLRQ:HK\SRWKHVLVHGWKDW WKHVRFDOOHGVFUHZKRPHPHFKDQLVPRIWKHNQHHLQHQGVWDJHH[WHQVLRQLQFUHDVHV WKHGLVWDQFHRIWKH777*GLVWDQFHRIWKHNQHHRQ05, 0HWKRGVDQG0DWHULDOV7UDQVYHUVDOVSLQHFKR7ZHLJKWHG05LPDJHVRIWKH NQHHZHUHDFTXLUHGLQIXOOH[WHQVLRQDQGÁH[LRQRIWKHNQHHLQDV\PS WRPDWLFYROXQWHHUVSDWLHQWVCPHDQDJH\HDUVUDQJH\HDUV OHIWULJKWXVLQJDÁH[LEOHFRLO)ROORZLQJSDUDPHWHUVZHUHXVHGVOLFHWKLFNQHVV PPPDWUL[[)29[PP7KH777*GLVWDQFHZDVPHDVXUHG LQDOOWKUHHSRVLWLRQV7KH6WXGHQWҋVWWHVWVHUYHGIRUVWDWLVWLFV 5HVXOWV7KHPHDQ777*GLVWDQFHZDVPPUDQJHPPLQ IXOOH[WHQVLRQPPUDQJHPPLQÁH[LRQDQGPP UDQJHPPLQÁH[LRQ7KHPHDQYDOXHVZHUHVLJQLÀFDQWO\GLIIHUHQW SYDOXHEHWZHHQWKUHHSRVLWLRQV &RQFOXVLRQ7KH777*GLVWDQFHLQFUHDVHVVLJQLÀFDQWO\LQWKHHQGVWDJHH[WHQVLRQ RIWKHNQHH7KHUHIRUHWKHFRPSDUDELOLW\RISXEOLVKHG777*YDOXHVPHDVXUHGRQ UDGLRJUDSKV&7DQG05,DWYDULRXVÁH[LRQH[WHQVLRQDQJOHVRIWKHNQHHLVOLPLWHG % )HPRUDODQGWLELDOWRUVLRQPHDVXUHPHQWVXVLQJ'PRGHOVEDVHGRQ ORZGRVHELSODQDU[UD\LQFRPSDULVRQWRVWDQGDUG&7PHDVXUHPHQWV ) 0%XFN5*XJJHQEHUJHU3 3 .RFK&:$3ÀUUPDQQ=XULFK&+ 3XUSRVH7 RFRPSDUHIHPRUDODQGWLELDOWRUVLRQPHDVXUHPHQWVDQGLQWHUUHDGHU DJUHHPHQWRIPHDVXUHPHQWVXVLQJ'PRGHOVEDVHGRQORZGRVHELSODQDU[UD\ LQFRPSDULVRQWRVWDQGDUG&7PHDVXUHPHQWVDQGHYDOXDWHLQWHUFKDQJHDELOLW\RI WKHWZRPHWKRGV 0HWKRGVDQG0DWHULDOV,QVWLWXWLRQDOUHYLHZERDUGDSSURYDOZDVREWDLQHGDQGDOO SDWLHQWVVLJQHGDQLQIRUPHGFRQVHQW)HPRUDODQGWLELDOWRUVLRQZHUHPHDVXUHG EDVHGRQ'PRGHOVEDVHGRQORZGRVHELSODQDU[UD\V(26LPDJLQJV\VWHP DQG RQ D[LDO &7 LPDJHV E\ WZR LQGHSHQGHQW UHDGHUV UHVSHFWLYHO\ 7KH WZR PHDVXUHPHQW PRGDOLWLHV ZHUH FRPSDUHG E\ PHDQV RI %ODQG$OWPDQ SORWV DQG GHVFULSWLYHVWDWLVWLFV,QWHUUHDGHUDJUHHPHQWZDVTXDQWLÀHGE\RILQWUDFODVVFRU UHODWLRQFRHIÀFLHQWV,&& 5RRP( 0XVFXORVNHOHWDO 66 )URPIRRWWRKLS 0RGHUDWRUV 03$SDULVL*RPH]9DOHQFLD(6 ).DLQEHUJHU9LHQQD$7 % )HPRUDOOHQJWKDVVHVVPHQWRQSUHQDWDO05, 81HPHF6) 1HPHF0:HEHU3 &%UXJJHU'3UD\HU9LHQQD$7 XUVXODQHPHF#JPDLOFRP 3XUSRVH7KLVVWXG\VRXJKWWRGHPRQVWUDWHQRUPDOIHPRUDOOHQJWKGHYHORSPHQWRQ SUHQDWDOPDJQHWLFUHVRQDQFHLPDJLQJ05,E\FRQVWUXFWLQJDIRHWDOJURZWKFKDUW 0HWKRGVDQG0DWHULDOV7KLVUHWURVSHFWLYHVWXG\LQFOXGHGWKH05VFDQVRI IRHWXVHVWRJHVWDWLRQDOZHHNV>*:@ZLWKQRUPDODQDWRP\RUPLQRU DEQRUPDOLWLHV2QHFKRSODQDU05,IHPRUDOOHQJWKZDVPHDVXUHGIURPWKHSUR[L PDOWRWKHGLVWDOHQGRIWKHVKDIWGLDSK\VHDOOHQJWKDQGIURPWKHRXWHUPDUJLQ RIWKHSUR[LPDOWRWKHRXWHUPDUJLQRIWKHGLVWDOHSLSK\VLVWRWDOOHQJWK6WDWLVWL FDOGHVFULSWLRQ3HDUVRQFRUUHODWLRQDQGOLQHDUUHJUHVVLRQDQDO\VLVZHUHXVHGWR HYDOXDWHIHPRUDOOHQJWKLQUHODWLRQWRJHVWDWLRQ7WHVWVZHUHFDOFXODWHGWRFRPSDUH GLDSK\VHDOWRWDOIHPRUDOOHQJWKRQ05,ZLWKSXEOLVKHG86QRUPDWLYHGDWD 5HVXOWV0LQLPXPDQGPD[LPXPOHQJWKYDOXHVPHDQYDOXHVDQGFRQÀGHQFH LQWHUYDOVDQGSHUFHQWLOHVZHUHGHÀQHGIRUWKHJHVWDWLRQDODJH)HPRUDOOHQJWKDVD IXQFWLRQRIJHVWDWLRQDODJHZDVH[SUHVVHGE\WKHUHJUHVVLRQHTXDWLRQGLDSK\VHDO OHQJWK DQGWRWDOOHQJWK *:7KHFRU UHODWLRQFRHIÀFLHQWVZHUHVWDWLVWLFDOO\VLJQLÀFDQWS7KHUHZDVQRVLJQLÀFDQW GLIIHUHQFHEHWZHHQGLDSK\VHDOOHQJWKRQ05,DQG86GDWDZKHUHDVWRWDOOHQJWK ZDVVLJQLÀFDQWO\ORQJHUWKDQWKH86PHDVXUHPHQWVS &RQFOXVLRQ2XUVWXG\SURYLGHV05,UHIHUHQFHGDWDRIQRUPDOIHPRUDOOHQJWKLQ XWHURZKLFKLQDGGLWLRQWR86PD\EHKHOSIXOWRGHWHUPLQHQRUPDOORQJERQHJURZWK DVZHOODVDEQRUPDOLWLHV'LDSK\VHDOOHQJWKRQ05,DQG86DUHHTXLYDOHQWZKHUHDV WRWDOOHQJWKLQFOXGLQJWKHHSLSK\VHVLVVLJQLÀFDQWO\GLIIHUHQWIURP86ÀQGLQJV % 'KLQGIRRWDOLJQPHQWPHDVXUHPHQWVEDVHGRQORZGRVHELSODQDU [UD\VFRPSDULVRQWRVWDQGDUGUDGLRJUDSKLFPHDVXUHPHQWV 56XWWHU&:$3ÀUUPDQQ1(VSLQRVD) 0%XFN=XULFK&+ UHWRVXWWHU#EDOJULVWFK 3XUSRVH7 RHVWDEOLVKDUREXVWDQGUHSURGXFLEOHKLQGIRRWDOLJQPHQW+$PHDVXUH PHQWWHFKQLTXHEDVHGRQORZGRVHELSODQDU[UD\VDQGFRPSDUHWR+$PHDVXUH PHQWVRQVWDQGDUGUDGLRJUDSKV 0HWKRGVDQG0DWHULDOV $SKDQWRPFRQVLVWLQJRIDKXPDQIRRWVNHOHWRQHPEHGGHG LQDFU\OLFJODVVZDVLPDJHGZLWKORQJD[LDOYLHZUDGLRJUDSKVDQGLQDORZGRVH ELSODQDU[UD\VFDQQHU(26LQQHXWUDOSRVLWLRQDQGGLIIHUHQWURWDWLRQVIURP LQWHUQDOWRH[WHUQDOURWDWLRQ7ZRLQGHSHQGHQWUHDGHUVPHDVXUHG+$RQUDGLR JUDSKVDQGSHUIRUPHG'PHDVXUHPHQWVRI+$RQ(26GDWDXVLQJDFXVWRPPDGH 0DWODEFRGHLQWZRGLIIHUHQWUHDGRXWVHVVLRQV7LPHIRU'PHDVXUHPHQWVZDV GHWHUPLQHG,QWUDFODVVFRUUHODWLRQFRHIÀFLHQWV,&&ZHUHFDOFXODWHG 5HVXOWV0HDVXUHPHQWVRQUHIHUHQFHVWDQGDUGUDGLRJUDSKVDWDOOURWDWLRQVVKRZHG DODUJHYDULDWLRQLQ+$UDQJHYDOJXVWRYDUXVIRUUHDGHUUHDGHU UHVSHFWLYHO\'KLQGIRRWDQJOH(26PHDVXUHPHQWVDWDOOURWDWLRQVUHVXOWHG LQDPHDQDQJOHRIIRUÀUVWDQGVHFRQGUHDGRXWE\UHDGHU )RUUHDGHUWKHVHPHDVXUHPHQWVZHUH'LIIHUHQFHVEHWZHHQ UHSHDWHG(26PHDVXUHPHQWVZHUHRQO\IRUERWKUHDGHUV,QWHUUHDGHUDJUHH PHQWDQGDJUHHPHQWEHWZHHQGLIIHUHQWUHDGRXWVZDVKLJK,&& ,&& 0HDQGXUDWLRQRI'PHDVXUHPHQWVZDVPLQPLQIRUUHDGHUVDQG &RQFOXVLRQ '+$ PHDVXUHPHQWV EDVHG RQ ELSODQDU [UD\V DUH IDVW DQG UHOLDEOH7KH\ DUH LQGHSHQGHQW RI IRRWSRVLWLRQLQJ GXULQJ LPDJH DFTXLVLWLRQ DQG UHDGHULQGHSHQGHQW,QWKLVSKDQWRPVWXG\WKH'PHDVXUHPHQWVZHUHVXSHULRU WRPHDVXULQJ+$ZLWKWKHUHIHUHQFHVWDQGDUGUDGLRJUDSKV 6FLHQWLILF6HVVLRQ $ 6&'()*+%(XURSHDQ&RQJUHVVRI 5DGLRORJ\ 0RQGD\ &RQFOXVLRQ$OWKRXJK7PDSSLQJRIFDUWLODJHDQGWKH:2506DUHYDOXDEOHLQ NQHHRVWHRDUWKULWLVUHVHDUFKERWKRIWKHPVKRZRQO\DYHU\ZHDNLIDQ\UHODWLRQVKLS ZLWKWKHSDWLHQWVҋSDLQV\PSWRPV$'/IXQFWLRQLQVSRUWDQG42/ % &RPSDULVRQRI'63$&(YV')6(VHTXHQFHIRUWKHHYDOXDWLRQRI LQWHUQDONQHHGHUDQJHPHQWDW7 3 9DQ'\FN-/*LHOHQ.:RXWHUV) 09DQKRHQDFNHU/'RVVFKH 3 03DUL]HO(GHJHP%(SLHWHUYDQG\FN#X]DEH 3XUSRVH 7 R DVVHVV WKH GLDJQRVWLF SHUIRUPDQFH RI WKH '63$&( VDPSOLQJ SHUIHFWLRQZLWKDSSOLFDWLRQRSWLPLVHGFRQWUDVWXVLQJYDULDEOHÁLSDQJOHHYROXWLRQV IDVWVSLQHFKR)6(VHTXHQFHDVFRPSDUHGWRURXWLQH')6(LQWKHHYDOXDWLRQ RILQWHUQDONQHHGHUDQJHPHQWDW7 0HWKRGV DQG 0DWHULDOV )URP -DQXDU\ WR -XO\ D VDJLWWDO LVRWURSLF IDW VDWXUDWHG '63$&( )6( VHTXHQFH ZDV DGGHG WR D FRQYHQWLRQDO 'NQHH 05LPDJLQJSURWRFRO6HTXHQFHSDUDPHWHUVRI'63$&(ZHUH75 PV 7( PVYR[HOVL]H PP6XEVHTXHQWNQHHDUWKURVFRS\ZDVSHUIRUPHGLQ SDWLHQWV7ZRUDGLRORJLVWVEOLQGHGWRRSHUDWLYHUHVXOWVLQGHSHQGHQWO\HYDOX DWHGPXOWLSODQDU')6(DQG'63$&(GDWDVHWVZLWKDZHHNLQWHUYDOIRUWKH SUHVHQFHRIPHQLVFDOWHDUVDQWHULRUFUXFLDWHOLJDPHQW$&/DQGFDUWLODJHOHVLRQV $FFXUDFLHVZHUHFDOFXODWHGIRUHDFKUHDGHUXVLQJDUWKURVFRS\DVWKHUHIHUHQFH VWDQGDUG0F1HPDUҋVWHVWZDVXVHGWRLGHQWLI\VLJQLÀFDQWGLIIHUHQFHVS EHWZHHQ'DQG'VHTXHQFHV,QWHUREVHUYHUDJUHHPHQWZDVGHWHUPLQHGXVLQJ &RKHQ VNDSSDWHVW 5HVXOWV)RUWKHGLDJQRVLVRIWHDUVRIPHGLDODQGODWHUDOPHQLVFXVDQG$&/OH VLRQVDFFXUDF\RIERWKVHTXHQFHVUDQJHGIURPWRWRDQG WRUHVSHFWLYHO\IRUERWKUHDGHUV)RUWKHGHWHFWLRQRIFDUWLODJHOHVLRQV DFFXUDF\RIERWKVHTXHQFHVUDQJHGIURPWRIRUERWKUHDGHUV:HIRXQG QRVLJQLÀFDQWGLIIHUHQFHVLQGLDJQRVWLF\LHOGEHWZHHQ'DQG'VHTXHQFHV,QWHU REVHUYHUDJUHHPHQWZDVH[FHOOHQWIRUPHQLVFXVDQG$&/OHVLRQVNDSSD! DQGLWZDVPRGHUDWHIRUFDUWLODJHOHVLRQVNDSSD &RQFOXVLRQ7KHGLDJQRVWLFSHUIRUPDQFHRI'63$&(LVVLPLODUWRURXWLQH' )6(IRUWKHGHWHFWLRQRIPHQLVFDODQWHULRUFUXFLDWHOLJDPHQWDQGFDUWLODJHOHVLRQV RIWKHNQHHDW7 % 7KURXJKSODQHGLVWRUWLRQFRUUHFWLRQDQGYLHZDQJOHWLOWLQJIRU UHGXFWLRQRIPHWDODUWHIDFWVDW05LPDJLQJLQSDWLHQWVZLWKWRWDOKLS DUWKURSODVW\SHUIRUPDQFHRI67,5DQG7VHTXHQFHV 56XWWHU (-8OEULFK9-HOOXV01LWWND&:$3ÀUUPDQQ=XULFK&+ (UODQJHQ'(UHWRVXWWHU#EDOJULVWFK 3XUSRVH7 RGHWHUPLQHWKHSHUIRUPDQFHRIWKHQHZ:$53VHTXHQFHIRUUHGXFWLRQ RIERWKWKURXJKSODQHDQGLQSODQHDUWHIDFWVLQSDWLHQWVDIWHUWRWDOKLSDUWKURSODVW\ 7+$ 0HWKRGVDQG0DWHULDOVSDWLHQWVZLWK7+$ZHUHSURVSHFWLYHO\LQFOXGHG6OLFH HQFRGLQJPHWDODUWHIDFWFRUUHFWLRQ6(0$&YLHZDQJOHWLOWLQJ9$7DQGLQFUHDVHG EDQGZLGWKZHUHDSSOLHGE\WKH´:$53µ76(VHTXHQFHDW7 &RURQDO67,5 :$53DQGWUDQVYHUVH7:$53LPDJHVVWDQGDUGFRURQDO67,5DQGWUDQVYHUVH 7LPDJHVRSWLPLVHGZLWKKLJKEDQGZLGWK67,5KL%:7KL%:ZHUHDFTXLUHG 6LJQDOYRLGZDVTXDQWLÀHG4XDOLWDWLYHFULWHULDDQDWRP\GLVWRUWLRQEOXUULQJQRLVH ZHUHDVVHVVHGRQDÀYHSRLQWVFDOHQRDUWHIDFWVQRWYLVLEOHGXHWRVHYHUH DUWHIDFWVE\WZRUHDGHUV&OLQLFDOÀQGLQJVZHUHUHFRUGHG4XDQWLWDWLYHGDWDZHUH DQDO\VHGZLWKDWWHVWDQGTXDOLWDWLYHGDWDZLWKD:LOFR[RQVLJQHGUDQNWHVW 5HVXOWV 6LJQDO YRLG DURXQG WKH SURVWKHVLV KHDG ZDV VPDOOHU IRU 67,5:$53 WKDQ 67,5KL%: FP FP DQG IRU 7:$53 WKDQ 7KL%: FPFPS IRUDOO$QDWRPLFGLVWLQFWLRQZDVEHWWHURQ67,5 :$53FRPSDUHGWR67,5KL%:YVS DQGRQ7:$53 FRPSDUHGWR7KL%:YVS'LVWRUWLRQORFDOEOXUULQJDQG QRLVHZHUHORZHUDW:$53WKDQLQWKHVWDQGDUGVHTXHQFHVS *HQHUDOLVHG EOXUULQJZDVKLJKHUIRU67,5:$53FRPSDUHGWR67,5KL%:S DQGIRU7 :$53FRPSDUHGWR7KL%:S $OPRVWKDOIRIWKHFOLQLFDOÀQGLQJVZHUH PLVVHGRQ67,5KL%:FRPSDUHGWR67,5:$53DQGÀQGLQJVS ZKLOH7KL%:ZDVVLPLODUWR7:$53DQGÀQGLQJVS &RQFOXVLRQ67,5:$53DQG7:$53ZHUHVWDWLVWLFDOO\VLJQLÀFDQWO\EHWWHUIRU PRVWLPDJHFULWHULDEXWWKHFOLQLFDOO\UHOHYDQWDGYDQWDJHLQDUWHIDFWUHGXFWLRQZDV RQO\SUHVHQWIRU67,5LPDJHVDQGQRWIRU7LPDJHV 5HVXOWV7KHPD[LPDOPHDVXUHPHQWGLIIHUHQFHEHWZHHQWKHWZR&7UHDGHUVIHPXU 7LELDZDVVOLJKWO\ELJJHUWKDQWKHPD[LPDOPHDVXUHPHQWGLIIHUHQFHEH WZHHQWKHWZRUHDGHUVXVLQJ'PRGHOVEDVHGRQELSODQDU[UD\V)HPXU7LELD %ODQG$OWPDQSORWVVKRZHGQRUHOHYDQWGLIIHUHQFHVEHWZHHQWKHUHVXOWVRIWKH WZRPHDVXUHPHQWPRGDOLWLHV([FHSWIRURQHPHDVXUHPHQWRIWKHIHPRUDOWRUVLRQ DQGRQHPHDVXUHPHQWRIWKHWLELDOWRUVLRQDOOUHVXOWVEDVHGRQWKH'PRGHOVZHUH ZLWKLQWKHOLPLWRIDJUHHPHQWPHDQVWDQGDUGGHYLDWLRQ,QWHUUHDGHU DJUHHPHQWZDVVLJQLÀFDQWS &RQFOXVLRQ)HPRUDODQGWLELDOWRUVLRQPHDVXUHPHQWVXVLQJ'PRGHOVEDVHGRQ ELSODQDU[UD\VDUHLQWHUFKDQJHDEOHZLWK&7PHDVXUHPHQWV % ,VWKHDOSKDDQJOHDEOHWRGLVFULPLQDWHEHWZHHQV\PSWRPDWLF SDWLHQWVZLWKIHPRURDFHWDEXODULPSLQJHPHQW)$,DQGDV\PSWRPDWLF YROXQWHHUV" 56XWWHU7 -'LHWULFK&:$3ÀUUPDQQ=XULFK&+UHWRVXWWHU#EDOJULVWFK 3XUSRVH7 RDVVHVVGLDJQRVWLFFKDUDFWHULVWLFVRIGLIIHUHQWDOSKDDQJOHWKUHVKROGV LQYROXQWHHUVDQG)$,SDWLHQWV 0HWKRGVDQG0DWHULDOVLQGLYLGXDOV\HDUVZHUHLQFOXGHGSDWLHQWV ZLWKFDPGHIRUPLWLHVDQGDJHDQGJHQGHUPDWFKHGDV\PSWRPDWLFYROXQWHHUV 7KHSDWLHQWJURXSFRQVLVWHGRIFDPW\SH)$,DQGPL[HGW\SH)$,$OSKD DQJOHVZHUHPHDVXUHGRQDUDGLDOO\UHIRUPDWWHG7ZHLJKWHGWUXH),63'05, VHTXHQFHRIWKHSUR[LPDOIHPXUE\WZRLQGHSHQGHQWUHDGHUV,QWUDFODVVFRUUHODWLRQ FRHIÀFLHQWV,&&DQGUHFHLYHURSHUDWRUFKDUDFWHULVWLFV52&ZHUHFDOFXODWHG 5HVXOWV 0HDQ DOSKDDQJOHV ZHUH KLJKHVW LQ WKH DQWHURVXSHULRU VHJPHQW ZLWK IRU UHDGHU IRU SDWLHQWV DQG IRU YROXQWHHUV$OSKDDQJOHV!ZHUHPHDVXUHGLQDQGRXWRIYROXQWHHUV IRUUHDGHU0RVWHOHYDWHGDOSKDDQJOHVLQYROXQWHHUVZHUHIRXQG DQWHURVXSHULRUO\DQGVXSHULRUO\7KHPD[LPDODOSKDDQJOH LQ DQ\ VHJPHQW ZDV VLJQLÀFDQWO\ GLIIHUHQW S LQ SDWLHQWV DQG YROXQWHHUV YVIRUUHDGHUYVIRUUHDGHUDOEHLW ZLWKDODUJHRYHUODS,QWHUREVHUYHUDJUHHPHQWZDVJRRG,&& 52&VKRZHG WKHODUJHVWDUHDXQGHUWKHFXUYHDWWKHDQWHURVXSHULRUVHJPHQWDUHD IRUUHDGHUSDDOSKDDQJOHWKUHVKROGJDYHDVHQVLWLYLW\VSHFLÀFLW\ RIIRUUHDGHUDQGIRUUHDGHUZKLOHDWKUHVKROGJDYH IRUUHDGHUDQGIRUUHDGHU &RQFOXVLRQ7KHDOSKDDQJOHLVVXERSWLPDOWRGLVFULPLQDWHYROXQWHHUVDQG)$,SD WLHQWVZLWKFDPW\SHGHIRUPLWLHV'LVFULPLQDWLRQLVPRVWUHOLDEOHDWWKHDQWHURVXSHULRU VHJPHQW5DLVLQJWKHDOSKDDQJOHWKUHVKROGIURPWRUHGXFHVIDOVHSRVLWLYHV DQGPLJKWUHVXOWLQOHVVRYHUWUHDWPHQW % ,VWKHUHDUHODWLRQVKLSEHWZHHQ7PDSSLQJRINQHHFDUWLODJHRUWKH ZKROHRUJDQ05,VFRULQJPHWKRG:2506IRUNQHHRVWHRDUWKULWLV DQGWKHSDWLHQWҋVSDLQV\PSWRPVIXQFWLRQLQGDLO\OLIH$'/ IXQFWLRQLQVSRUWDQGUHFUHDWLRQ6SRUWDQGNQHHUHODWHGTXDOLW\RI OLIH42/DVJLYHQE\WKHNQHHRVWHRDUWKULWLVRXWFRPHVFRUH.226 TXHVWLRQQDLUH" *6FKHXUHFNHU&6FKHXUHFNHU$6FKHXUHFNHU-.UDPHU/LQ]$7 JHRUJVFKHXUHFNHU#LQRGHDW 3XUSRVH%RWK7PDSSLQJRIFDUWLODJHDQGWKH:2506PHWKRGDUHHVWDEOLVKHG UHVHDUFK WRROV IRU NQHH RVWHRDUWKULWLV LV WKHUH D UHODWLRQVKLS ZLWK WKH SDWLHQWV .226TXHVWLRQQDLUH" 0HWKRGVDQG0DWHULDOV$IWHULQWURGXFLQJ7PDSSLQJDQGWKH.226TXHVWLRQ QDLUHLQRXUURXWLQHSURWRFROIRUNQHH05,ZHLQFOXGHGWKHÀUVWIHPDOHVDQG PDOHV UHVSHFWLYHO\ IHPDOH PHDQDJH \ UDQJH \ PDOH PHDQDJH \ UDQJH \ :H HPSOR\HG D VDJLWWDO PXOWLHFKRVSLQHFKRVHTXHQFH IRU 7 PDSSLQJWRJHWKHUZLWKWKHURXWLQHNQHHSURWRFROVDJLWWDO7ZDQGVDJLWWDOFRURQDO D[LDO3GZIDWVDWRQD705,XQLW7KH7PDSVZHUHDQDO\VHGZLWK52,VZLWKD VWDQGDUGLVHGOHQJWKRIPPIRUWKHIXOOWKLFNQHVVFDUWLODJHRQWKUHHFRQVHFXWLYH LPDJHVRIWKHFHQWUDOPHGLDODQGODWHUDOIHPRUDOFRQG\OH0)&/)&WKHSDWHOOD DQGWKHWURFKOHD7KHUHSHDWHG7PHDVXUHPHQWVZHUHDYHUDJHGIRUHDFKUHJLRQ 5ZHUHFDOFXODWHGZLWKOLQHDUUHJUHVVLRQWRORRNIRUUHODWLRQVKLSVEHWZHHQ7YDOXHV RUWKH:2506DQGWKH.226TXHVWLRQQDLUH5JUDGHGDV!YHU\VWURQJ !VWURQJ!PRGHUDWH!ZHDN!YHU\ZHDN 5HVXOWV)RUIHPDOHVWKH:2506KDGDYHU\ZHDNUHODWLRQVKLSZLWKSDLQV\PS WRPV6SRUWDQG42/IRUPDOHVWKHUHZDVQRUHODWLRQVKLS7PDSSLQJKDGDYHU\ ZHDNUHODWLRQVKLSUHJDUGLQJWKH/)&DQGV\PSWRPVLQIHPDOHVLQPDOHVLWZDV YHU\ZHDNIRU0)&DQGV\PSWRPVSDWHOODDQGSDLQDQGWURFKOHDDQGSDLQ%HVLGH WKHVHUHODWLRQVKLSVWKHUHZHUHQRQHPRUH 6FLHQWLILF6HVVLRQ 6 &$' ( ) *+% (XURSHDQ&RQJUHVVRI 5DGLRORJ\ % 'LIIXVLRQZHLJKWHG05,DQG*D'27$72&3(7IRUHDUO\ PRQLWRULQJRIUHVSRQVHWRORFRUHJLRQDO</X'27$72& WKHUDS\LQSDWLHQWVZLWKQHXURHQGRFULQHOLYHUPHWDVWDVHV ) /*LHVHO6:XOIHUW7 .XGHU/6FKZDUW]+8.DXF]RU8+DEHUNRUQ &.UDWRFKZLO+HLGHOEHUJ'(1HZ<RUN1<86IJLHVHO#GNI]GH 3XUSRVH0RQLWRULQJUHVSRQVHWRWKHUDS\LVSUHGRPLQDQWO\EDVHGXSRQHYDOXDWLQJ WXPRXUVL]HEHIRUHDQGDIWHUWUHDWPHQWIRUH[DPSOHLQWKHUHVSRQVHHYDOXDWLRQ FULWHULDLQVROLGWXPRXUV5(&,677KHUHIRUHZHHYDOXDWHGLIGLIIXVLRQZHLJKWHG 05 LPDJLQJ ':05, DQG *D'27$72& 3(7 DUH SRWHQWLDO VXUURJDWH EL RPDUNHUVIRUSURYLGLQJHDUOLHULQIRUPDWLRQDERXWDSRVVLEOHWUHDWPHQWUHVSRQVHWR LQWUDDUWHULDO'27$72&WKHUDS\ 0HWKRGV DQG 0DWHULDOV ,Q FRQVHFXWLYH SDWLHQWV ZLWK OLYHU PHWDVWDVHV RI JDVWURHQWHURSDQFUHDWLF QHXURHQGRFULQH FDQFHU *(31(7 ZHUHHYDOXDWHG $OO SDWLHQWV XQGHUZHQW ERWK GLIIXVLRQZHLJKWHG DQG G\QDPLF FRQWUDVWHQKDQFHG PDJQHWLFUHVRQDQFHLPDJLQJ':,'&(05,LQFOXGLQJEUHDWKKROGHFKRSODQDU ':,VHTXHQFHVEYDOXHVVPPDVZHOODV*D'27$72&3(7 EHIRUHWKHUDS\EDVHOLQHDQGDIWHUODVWLQWHUYHQWLRQIROORZXS/DUJHVWGLDPHWHU /'LQWUDWXPRUDODSSDUHQWGLIIXVLRQFRHIÀFLHQW$'&DQGPD[LPDOVWDQGDUGLVHG XSWDNHYDOXH689PD[ZHUHPHDVXUHGLQDOOWDUJHWOHVLRQVDVZHOODVLQQRUPDO OLYHUSDUHQFK\PDDQGVSOHHQ 5HVXOWV7XPRXUPHWDVWDVHVZHUHVXEFODVVLÀHGEDVHGXSRQFKDQJHLQWXPRXU VL]H LQ UHVSRQGLQJ OHVLRQV 5/ Q DQG QRQUHVSRQGLQJ OHVLRQV 15/ Q ,Q 15/V EDVHOLQH PHGLDQ WXPRXU$'& LQFUHDVHG IURP [ PPVHF WR [PPVHFZKLOHWKHUHVSRQGLQJOHVLRQLQFUHDVHGIURP[PP VHFWR[PPVHFDIWHUODVWORFRUHJLRQDOLQWHUYHQWLRQSZKHUHDV WKHFKDQJHLQ689PD[RI*D'27$72&ZDVQRWVLJQLÀFDQWO\GLIIHUHQW &RQFOXVLRQ $IWHUORFRUHJLRQDO'27$72&WKHUDS\QRQUHVSRQGHUDQGUHVSRQGHU VXEJURXSVERWKSUHVHQWHGDFKDQJHLQ$'&SULRUWR665UHFHSWRUH[SUHVVLRQ FKDQJHV DQG DOWKRXJK PRUSKRORJLFDO UHVSRQVH DFFRUGLQJ WR 5(&,67 FULWHULD ZDVRQO\PHDVXUDEOHLQIHZOHVLRQV7KHUHIRUHWKLVZRUNVXJJHVWVWKDWGLIIXVLRQ ZHLJKWHGLPDJLQJLVDQHDUOLHUWXPRXULQWHJULW\VXUURJDWHIRUWKHUDSHXWLFLQWHUYHQWLRQ DQGSRVVLEOHHDUO\LQGLFDWRUIRUWUHDWPHQWUHVSRQVH % 6LPXOWDQHRXVZKROHERG\053(7LQSDWLHQWVZLWKRQFRORJLFDO GLDJQRVHVFRPSDULVRQWR3(7&7 06RXYDW]RJORX$%HHU0(LEHU6)XHUVW6=LHJOHU61HNROOD (5XPPHQ\06FKZDLJHU$'U]H]JD0XQLFK'(PVRXYDW]#\DKRRGH 3XUSRVH7 RHYDOXDWHFRPSDUDELOLW\RIWKHFOLQLFDOSHUIRUPDQFHRI3(7&7DQG 053(7LQSDWLHQWVZLWKRQFRORJLFDOGLDJQRVHV 0HWKRGV DQG 0DWHULDOV 7KLUW\WZR SDWLHQWV XQGHUZHQW D VLQJOHLQMHFWLRQGXDO LPDJLQJSURWRFROFRQVLVWLQJRID3(7&7DQGVXEVHTXHQW053(7VFDQ3(7 &7 ZDV SHUIRUPHG DFFRUGLQJ WR VWDQGDUG FOLQLFDO SURWRFROV P L Q S L R I 0%T>)@)'*PLQEHGSRVLWLRQ%36XEVHTXHQWO\PLQSL 053(7ZDVSHUIRUPHGPLQ%33(7LPDJHVRIERWKPRGDOLWLHVZHUHUHFRQ VWUXFWHGLWHUDWLYHO\26(0'DWWHQXDWLRQFRUUHFWLRQDQGUHJLRQDODOORFDWLRQZDV SHUIRUPHGXVLQJORZGRVH&7GDWDIRU3(7&7DQG'L[RQ05VHTXHQFHVIRU05 3(7 053(7DQG3(7&7ZHUHFRPSDUHGYLVXDOO\E\UDWLQJQXPEHUDQGORFDWLRQ RIVXVSLFLRXVOHVLRQVLPDJHTXDOLW\DQGDOLJQPHQW)RUTXDQWLWDWLYHFRPSDULVRQ 689EDVHGDVVHVVPHQWRIWKHGHWHFWHGOHVLRQVDQGGLIIHUHQWRUJDQVZDVSHUIRUPHG 5HVXOWV6LPXOWDQHRXV053(7DFTXLVLWLRQZDVIHDVLEOH1RVLJQLÀFDQWGLIIHUHQFH ZDVIRXQGEHWZHHQWKHQXPEHUVRIVXVSLFLRXVOHVLRQVQ RUOHVLRQSRVLWLYH SDWLHQWV Q GHWHFWHG ZLWK 053(7 RU 3(7&7 $QDWRPLFDO DOORFDWLRQ RI 3(7ÀQGLQJV REWDLQHG E\ 053(7 ZDV VXIÀFLHQWO\ IHDVLEOH RQ WKHEDVLV RI WKH QRQGLDJQRVWLF'L[RQ05VHTXHQFHVZLWKFRPSDUDEOHSHUIRUPDQFHDVZLWKORZ GRVH&7IRU3(7&7 4XDQWLWDWLYHHYDOXDWLRQUHYHDOHGDKLJKFRUUHODWLRQEHWZHHQ PHDQ689PHDVXUHGLQOHVLRQVDQGRUJDQVZLWK0537RU3(7&7ѩ ѩ UHVSHFWLYHO\ &RQFOXVLRQ6LPXOWDQHRXVZKROHERG\053(7LPDJLQJLVIHDVLEOHZLWKKLJKTXDO LW\LQVKRUWWLPHDOORZLQJWKHGHWHFWLRQRIK\SHUPHWDEROLFOHVLRQVZLWKFRPSDUDEOH UHOLDELOLW\ DV ZLWK 3(7&7 'HVSLWH GLIIHUHQW DWWHQXDWLRQFRUUHFWLRQ DSSURDFKHV WKHWUDFHUXSWDNHFRUUHODWHGZHOOEHWZHHQ053(7DQG3(7&7 7KH'L[RQ05 VHTXHQFHVDFTXLUHGIRUDWWHQXDWLRQFRUUHFWLRQPD\VHUYHIRUDQDWRPLFDODOORFDWLRQ RI3(7ÀQGLQJV % 7HVODKLSLPDJLQJLQDYDVFXODUQHFURVLVXVLQJDPXOWLFKDQQHO WUDQVPLWDUUD\DQG5)VKLPPLQJ -07KH\VRKQ2.UDII62U]DGD6/DQGJUDHEHU0(/DGG 7 &/DXHQVWHLQ(VVHQ'(MHQVWKH\VRKQ#XQLGXLVEXUJHVVHQGH 3XUSRVH 05, RI KLS MRLQWV SOD\V DQ LPSRUWDQW UROH LQ VWDJLQJ HVSHFLDOO\ \RXQJ SDWLHQWVZLWKKLSGLVHDVHLHDYDVFXODUQHFURVLV$91$LPRIWKLVVWXG\LVWKH HYDOXDWLRQRIXOWUDKLJKÀHOGLPDJLQJ7 HVODRIWKHKLSVXVLQJDQHZPXOWLFKDQQHO WUDQVPLWWHFKQRORJ\WRFRPSHQVDWHWKHLQKHUHQW%LQKRPRJHQHLWLHVRI705, LQFRPSDULVRQWR7 0HWKRGVDQG0DWHULDOV7 HQSDWLHQWVZLWK $91ZHUHLPDJHGDW70DJQHWRP7 6LHPHQVXVLQJDVHOIEXLOWHLJKWFKDQQHOWUDQVPLWUHFHLYHFRLO $IWHU5)VKLPPLQJ LGHQWLFDO VHTXHQFHV 0(',& '(66 3'7Z 76( 7Z 76( DQG 67,5 ZHUH DFTXLUHGDW7DQG76N\UD6LHPHQV5REXVWQHVVDJDLQVW%LQKRPRJHQHLWLHV SRLQWVFDOH QRVWURQJGHJUDGDWLRQDQG&15EHWZHHQFDUWLODJHFRUWLFDO ERQHDQGÁXLGZHUHHYDOXDWHG 5HVXOWV2YHUDOOUHJLRQVRILQWHUHVWFRXOGEHLPDJHGZLWKUHSURGXFLEOHKLJKTXDO LW\DW7H[FHSW67,5:KLOHDOPRVWDEVHQWDW7JUDGHDOO7VHTXHQFHV VKRZHG VLJQDO YDULDWLRQV ZLWK '(66 PRVW UREXVW JUDGH DQG67,5 OHDVW IDYRXUDEOH JUDGH )RU 0(',& 3' 7Z DQG 7Z VWURQJ VLJQDO GURSRXWV ZHUHVXIÀFLHQWO\VKLIWHGDZD\IURPWKH)297H[KLELWHGVWURQJHUFDUWLODJHÁXLG FRQWUDVWVHVSHFLDOO\IRU0(',&DQG'(663DWKRORJLHVZHUHGHSLFWHGZLWKVOLJKWO\ PRUHGHWDLODW7 &RQFOXVLRQ$SSOLFDWLRQRIQHZWUDQVPLWWHFKQRORJLHV5)6KLPPLQJDOORZVWKH KLJKUHVROXWLRQLPDJLQJRIWKHKLSVZLWK705,3DWKRORJLHVRIWKHIHPRUDOKHDG FDQEHGLVSOD\HGLQPRUHGHWDLOZKLOHVDFULÀFLQJLPDJHTXDOLW\RIWKHVXUURXQGLQJ VRIWWLVVXH7 HVOD05,RIWKHKLSMRLQWPLJKWKHOSLPSURYHGLDJQRVWLFDQGVWDJLQJ DFFXUDF\RIDYDVFXODUQHFURVLV 5RRP( 2QFRORJLF,PDJLQJ 66 3(7IRUFDQFHUSDWLHQWPDQDJHPHQW 0RGHUDWRUV -*ULPP1HZ<RUN1<86 '0LOHWLþ5LMHND+5 % $VVHVVPHQWRIWKHPHWDEROLFÁRZSKHQRW\SHRISULPDU\FRORUHFWDO FDQFHUFRUUHODWLRQVZLWKPLFURYHVVHOGHQVLW\DUHLQÁXHQFHGE\WKH KLVWRORJLFDOVFRULQJPHWKRG 9-*RK05RGULJXH]-XVWR$(QJOHGRZ06KDVWU\5(QGR]R00HDJKHU 67 D\ORU6+DOOLJDQ$*URYHV/RQGRQ8. 3XUSRVH7 RLQYHVWLJDWHKRZGLIIHUHQWPHWKRGVRIKLVWRORJLFDOVFRULQJRIPLFURYHVVHO GHQVLW\Ҋ+RWVSRWҋYHUVXV&KDONOH\DIIHFWFRUUHODWLRQEHWZHHQLQWHJUDWHG))'* 3(7SHUIXVLRQ&7SDUDPHWHUVDQG&'PLFURYHVVHOGHQVLW\ 0HWKRGV DQG 0DWHULDOV ,QVWLWXWLRQDO UHYLHZ ERDUG DSSURYDO ZDV REWDLQHG IRU WKLVSURVSHFWLYHVWXG\SDWLHQWVZHUHHQUROOHGIURP$SULOWR2FWREHU ,QWHJUDWHG))'*3(7SHUIXVLRQ&7ZDVVXFFHVVIXOLQSDWLHQWVPDOHV IHPDOHVPHDQ\HDUVRIZKRPXQGHUZHQWVXUJHU\ZLWKRXWLQWHUYHQLQJQHR DGMXYDQWWUHDWPHQW7XPRXU689PD[689PHDQDQGUHJLRQDOEORRGÁRZ%)ZHUH GHULYHGIRUWKHHQWLUHWXPRXU,PPXQRKLVWRFKHPLFDOVWDLQLQJIRU&'H[SUHVVLRQ DQGDQDO\VLVIRUKRWVSRWVKRWVSRWVDQGWKH&KDONOH\PHWKRGZHUHSHUIRUPHG &RUUHODWLRQVEHWZHHQPHWDEROLFDQGÁRZSDUDPHWHUVDQG&'H[SUHVVLRQZHUH DVVHVVHGE\6SHDUPDQUDQNFRUUHODWLRQZLWKVWDWLVWLFDOVLJQLÀFDQFHDW 5HVXOWV0HDQ6'WXPRXUVL]HZDVPP0HDQ6'IRU689PD[ 689PHDQDQG%)ZHUHDQGP/PLQJWLV VXHUHVSHFWLYHO\7KHPHDQ6'IRU&'PLFURYHVVHOGHQVLW\ZDV DQGUHVSHFWLYHO\IRUKRWVSRWKRWVSRWDQG&KDONOH\ PHWKRGV7KHSRVLWLYHFRUUHODWLRQEHWZHHQ%)DQG&'H[SUHVVLRQZDVPRGHVW EXWKLJKHUIRU&KDONOH\WKDQKRWVSRWDQDO\VLVU S U S UHVSHFWLYHO\7KHUHZDVQRFRUUHODWLRQZLWKKRWVSRWDQDO\VLVU S 7KHUHZHUHQRVLJQLÀFDQWFRUUHODWLRQVEHWZHHQPHWDEROLFSDUDPHWHUV689PD[ RU689PHDQDQG&'H[SUHVVLRQUWRS &RQFOXVLRQ7KHKLVWRORJLFDODQDO\VLVPHWKRGDIIHFWVFRUUHODWLRQVEHWZHHQWXPRXU &'H[SUHVVLRQDQG%)EXWQRW689PD[RU689PHDQ 6FLHQWLILF6HVVLRQ $ 6&'()*+%(XURSHDQ&RQJUHVVRI 5DGLRORJ\ 0RQGD\ 5HVXOWV$WRWDORI3(7SRVLWLYHOHVLRQVZHUHHYDOXDWHGLQWKHOLYHUQ ERQHQ O\PSKQRGHVQ OXQJQ *,WUDFWQ VRIWWLVVXHVQ SOHXUDQ DGUHQDOJODQGVQ SDQFUHDVQ VSOHHQQ SHULWRQHXPQ FKHVWZDOOQ DQGEUHDVWQ /HVLRQVZHUHFKDUDFWHULVHGDQGJUDGHGEDVHGRQ FRQVSLFXLW\LQ&7DQG05ZLWKJRRGѣ DQGPRGHUDWHѣ LQWHUREVHUYHU DJUHHPHQW UHVSHFWLYHO\ ,Q WKH RYHUDOO OHVLRQEDVHG FRPSDULVRQ QR VLJQLÀFDQW GLIIHUHQFHZDVIRXQG+RZHYHULQWKHRUJDQEDVHGFRPSDULVRQ05SHUIRUPHG VLJQLÀFDQWO\EHWWHUWKDQ&7LQWKHOLYHUSIRUERWKUHDGHUVZKLOH&7WHQGHG WRSHUIRUPEHWWHUWKDQ05LQGHSLFWLQJEDVDOOXQJOHVLRQVSDQGS &RQFOXVLRQ8QHQKDQFHG3(705RXWSHUIRUPVXQHQKDQFHG3(7&7LQWKHGHSLF WLRQDQGFKDUDFWHULVDWLRQRIOLYHUOHVLRQV+RZHYHULQWKHHYDOXDWLRQRIH[WUDKHSDWLF DEGRPLQDOSDWKRORJ\LQRQFRORJLFSDWLHQWVQRVLJQLÀFDQWGLIIHUHQFHEHWZHHQWKHVHV PRGDOLWLHVLVVHHQ % 6WDJLQJDQGUHVWDJLQJ+RGJNLQҋVGLVHDVHORZGRVHQRQHQKDQFHG )'*3(7&7YHUVXVIXOOGRVHFRQWUDVWHQKDQFHG)'*3(7&7 &&DSUDUR',SSROLWR/*XHUUD('H3RQWL&0HVVD66LURQL0RQ]D,7 GDYLGHDWHQD#WLVFDOLQHWLW 3XUSRVH7 RFRPSDUHWKHDJUHHPHQWEHWZHHQORZGRVHQRQHQKDQFHG3(7&7 ZLWKIXOOGRVHFRQWUDVWHQKDQFHG3(7&7LQWKHVWDJLQJDQGUHVWDJLQJ+RGJNLQҋV GLVHDVH+/ 0HWKRGVDQG0DWHULDOV$WRWDORISDWLHQWVZLWKKLVWRORJLFDOO\SURYHQ+/XQ GHUZHQWD))'*3(7&7VWXG\WKDWLQFOXGHGORZGRVHQRQHQKDQFHG&7DQG IXOOGRVHFRQWUDVWHQKDQFHG&7VWXGLHVSHUIRUPHGLQDVLQJOHVWHSSURFHGXUH VWXGLHVZHUHSHUIRUPHGIRUVWDJLQJDQGIRUWKHHYDOXDWLRQRIUHVLGXDOGLVHDVH DIWHU ÀUVW OLQH RI FKHPRWKHUDS\ UHVWDJLQJ )RU HYHU\ SDWLHQW HDFK PRGDOLW\ RI 3(7&7LPDJHVZDVHYDOXDWHGE\HLWKHURISDLUVRIH[SHUWUHDGHUVEOLQGHGDERXW WKHFOLQLFDOGDWDDQGXQDZDUHRIWKHUHVXOWVRIWKHRWKHUW\SH)LQDOO\WKHVWDJHRI WKHGLVHDVHZDVGHÀQHGDFFRUGLQJWR3(7OG&7DQG3(7FH&7IROORZLQJWKH$QQ $UERUFODVVLÀFDWLRQ)RUUHVWDJLQJVWXGLHVLPDJHVZHUHLQWHUSUHWHGFRQVLGHULQJ WKHSUHVHQFHRIUHVLGXDOPDVVZLWKRUZLWKRXWUHVLGXDODFWLYLW\DFFRUGLQJWRWKH ,QWHUQDWLRQDO+DUPRQL]DWLRQ3URMHFW 5HVXOWV 2I VLGHV FRQVLGHUHG DV SRWHQWLDOO\ LQYROYHG E\ WKH GLVHDVH 3(7 OG&7DQG3(7FH&7ZHUHFRQFRUGDQWLQVLGHVLQVWDJLQJVWXGLHV DQGLQSDWLHQWVRIUHVWDJLQJVWXGLHV3(7OG&7DQG3(7FH&7ZHUH FRQFRUGDQWZLWKVWDQGDUGUHIHUHQFHLQDQGLQSDWLHQWV UHVSHFWLYHO\ LQ VWDJLQJ VWXGLHV ,Q UHVWDJLQJ VWXGLHV ERWK 3(7OG&7 DQG 3(7 FH&7UHVXOWVZHUHFRQFRUGDQWZLWKVWDQGDUGUHIHUHQFHLQVWXGLHV &RQFOXVLRQ2XUVWXG\VKRZHGDJRRGFRUUHODWLRQEHWZHHQ3(7OG&7DQG3(7 FH&7ERWKLQVWDJLQJDQGLQSDUWLFXODULQUHVWDJLQJVWXGLHV,IWKHVHUHVXOWVDUH FRQÀUPHGLQDODUJHUSDWLHQWVҋSRSXODWLRQ3(7OG&7PLJKWVXIÀFHDVWKHRQO\LPDJ LQJWHFKQLTXHIRUVWDJLQJDQGUHVWDJLQJ+'VSDULQJDGGLFWHGUDGLDWLRQEXUGHQDQG LRGLQDWHFRQWUDVWDGPLQLVWUDWLRQWRWKHSDWLHQWDQGUHVHUYLQJFH&7IRUVHOHFWHGFDVHV % 3URJQRVWLFYDOXHRIUHVLGXDO&7PDVVHVLQ+'SDWLHQWVZLWKD QHJDWLYH)'*3(7DIWHUFKHPRUDGLRWKHUDS\ 00DJDJQROL(/RSFL05RGDUL.0DU]R/*LRUGDQR) 5/XWPDQ $$QDVWDVLD$6DQWRUR$&KLWL5R]]DQR,7HJHVWDORSFL#JPDLOFRP 3XUSRVH7 RSURSHUO\GHÀQHWKHQHJDWLYHSUHGLFWLYHYDOXHRIUHVLGXDO&7PDVVHV LQ+'SDWLHQWVZLWK3(7QHJDWLYHDWWKHHQGRIWUHDWPHQWDQGGHÀQHLWVFRUUHODWLRQ ZLWKGLVHDVHIUHHVXUYLYDO')6 0HWKRGVDQG0DWHULDOV)RURXUVWXG\ZHUHWURVSHFWLYHO\DQDO\VHGGDWDGHULYLQJ IURPSDWLHQWVQ 0) PHGLDQDJH\HDUVZKRXQGHUZHQW)'* 3(7DQG&7VFDQDWWKHHQGRIWUHDWPHQW)RUVWXG\SXUSRVHZHLGHQWLÀHGWKRVH SUHVHQWLQJDQHJDWLYH3(7VFDQDQGDUHVLGXDOPDVVRQ&7 SDWLHQWVDIWHUÀUVW OLQHWUHDWPHQWZKLOHDIWHUVDOYDJHWKHUDS\$OOSDWLHQWVZHUHIROORZHGXSIRUD PHGLDQSHULRGRIPRQWKV 5HVXOWV7KHÀYH\HDU')6IRU3(7&79V3(7&7SDWLHQWVZDVDQG UHVSHFWLYHO\S 7KHSURJQRVLVRIUHVLGXDOPDVVDW&7VFDQZDV VLJQLÀFDQWO\ZRUVHDOVRZKHQFRQVLGHULQJWKHGLPHQVLRQRIWKHPDVVHVWKHODUJHU WKHPDVVWKHORZHUWKH')6S $QRSWLPDOFXWRIISRLQWZDVLGHQWLÀHG ZLWKUHJDUGWRPD[LPDOGLDPHWHUQDPHO\FP:KHQLQWURGXFLQJWKLVFXWRIIWKH ')6LQWKLVVHWWLQJRISDWLHQWVZDVYVS$OVRRWKHUSRWHQWLDO SURJQRVWLFIDFWRUVKDYHEHHQDQDO\VHGQXPEHURIPDVVHVÀUVW9VVDOYDJHWUHDW PHQWSURJUDPVH[EXON\GLVHDVH%V\PSWRPVEXWDPRQJWKHPQRFRUUHODWLRQ ZLWK'6)RURYHUDOOVXUYLYDO26HPHUJHG &RQFOXVLRQ7KHVHGDWDVXJJHVWWKDWWKHSUHVHQFHRIUHVLGXDOPDVVLQGHSHQG HQWO\IURPWKH)'*3(7UHVXOWVKRXOGEHFDUHIXOO\IROORZHGXSDQGWKHSDWLHQWV VKRXOGEHFRQVLGHUHGDWDQLQFUHDVHGULVNIRUUHODSVHSURJUHVVLRQRIWKHGLVHDVH % 6WDJLQJRIQHXURHQGRFULQHWXPRXUVFRPSDULVRQRI*D'27$72& 3(7&7DQG05, &6FKUDPO1) 6FKZHQ]HU0.:HUQHU&%UHQGOH 00XHOOHU&'&ODXVVHQ&3IDQQHQEHUJ 7ELQJHQ'(FKULVWLQDVFKUDPO#PHGXQLWXHELQJHQGH 3XUSRVH7 RFRPSDUH*D'27$72&3(7&7DQGZKROHERG\:%05,UHJDUG LQJPHWDVWDWLFOHVLRQGHWHFWLRQLQSDWLHQWVZLWKQHXURHQGRFULQHWXPRXUV1(7 0HWKRGV DQG 0DWHULDOV ,Q SDWLHQWV ZLWK KLVWRORJLFDOO\ SURYHQ 1(7 *D '27$72&3(7&7 DQG :%05, ZHUH SHUIRUPHG 3(7&7 ZDV SHUIRUPHG DIWHU DGPLQLVWUDWLRQRI0%T*D'27$72&&7SURWRFROFRPSULVHGPXOWLSKDVLF FRQWUDVWHQKDQFHG LPDJLQJ 05, SURWRFRO VWDQGDUG VHTXHQFHV SUHSRVW *DGR OLQLXPDW7 (DFKPRGDOLW\3(7 &7 3(7&7 :%05,ZDVHYDOXDWHGLQGH SHQGHQWO\E\WZRH[SHULHQFHGUHDGHUV&RQVHQVXVGHFLVLRQEDVHGRQLPDJLQJ KLVWRORJ\VXUJHU\DQGFOLQLFDOIROORZXSVHUYHGDVVWDQGDUGRIUHIHUHQFH'HWHFWLRQ UDWHVRIHDFKPRGDOLW\ZHUHFRPSDUHGXVLQJ0F1HPDUWHVW3YDOXHVZHUH FRQVLGHUHGVLJQLÀFDQW 5HVXOWV,QRISDWLHQWVPHWDVWDWLFOHVLRQVZHUHGHWHFWHGOXQJOLYHU ERQHO\PSKQRGH/1RWKHU*D'27$72&3(7ZDVIDOVH QHJDWLYHLQSDWLHQWVGXHWRODFNRIUHFHSWRUH[SUHVVLRQ2IDOOGHWHFWHG OHVLRQV3(7LGHQWLÀHG&73(7&7DQG:%05, 2UJDQEDVHGGHWHFWLRQUDWHVRI3(7&7ZHUHVLJQLÀFDQWO\KLJKHUIRU/1 YVSDQGSXOPRQDU\OHVLRQVYVS ZKLOH :%05,KDGVLJQLÀFDQWO\KLJKHUGHWHFWLRQUDWHVIRUOLYHUYVS DQGERQHOHVLRQVYVS2IDOOOHVLRQVZHUHIRXQGRQO\ LQ3(7 RQO\LQ&7DQGRQO\LQ:%05, &RQFOXVLRQ3(7&7DQG:%05,VKRZHGFRPSDUDEOHRYHUDOOGHWHFWLRQUDWHVLQ 1(7 EXWVLJQLÀFDQWO\GLIIHUHGLQRUJDQEDVHGGHWHFWLRQUDWHVZLWKVXSHULRULW\RI3(7 &7IRU/1DQGSXOPRQDU\OHVLRQVDQGRI:%05,IRUOLYHUDQGERQHPHWDVWDVHV % &RPSDULVRQRIOHVLRQGHWHFWLRQLQSDWLHQWZLWKFUDQLDOPHQLQJLRPDV XVLQJ*D'27$72&3(7&7DQGFRQWUDVWHQKDQFHG05, $$IVKDU2URPLHK&.UDWRFKZLO+/LQKDUW8+DEHUNRUQ) /*LHVHO +HLGHOEHUJ'(IJLHVHO#GNI]GH 3XUSRVH 3(7 LPDJLQJ ZLWK VRPDWRVWDWLQ UHFHSWRU OLJDQGV VXFK DV *D '27$72&3(7&7 LVDZHOOHVWDEOLVKHGPHWKRGIRUGHWHFWLRQDQGWDUJHWYROXPH GHÀQLWLRQRIPHQLQJLRPDVSULRUWRUDGLRWKHUDS\6LQFH'27$72&3(7DSSHDUVWR GHWHFWPRUHPHQLQJLRPDVWKDQ05,ZHFRQGXFWHGDUHVWURVSHFWLYHDQDO\VLVWR FRPSDUHWKHGLDJQRVWLFDFFXUDF\RIFRQWUDVWHQKDQFHG05,&(05,ZLWK*D '27$72&3(7&7LQSDWLHQWVZLWKFUDQLDOPHQLQJLRPDVSULRUWRUDGLRWKHUDS\ 0HWKRGVDQG0DWHULDOV2YHUDSHULRGRIVL[\HDUVSDWLHQWV\R LQRXUKRVSLWDOXQGHUZHQWFUDQLDO&(05,DQG*D'27$72&3(7&7SULRU WRUDGLRWKHUDS\RIFUDQLDOPHQLQJLRPDV%RWKPHWKRGVZHUHFRPSDUHGE\DVLGH E\VLGHUHDGFRXQWLQJWKHGHWHFWHGPHQLQJLRPDVDQGUHFRUGLQJWKHORFDOLVDWLRQ DQGWKH689PD[RIWKRVHGHWHFWHGE\3(7&7RQO\ 5HVXOWV:LWKLQWKHSDWLHQWVLQYHVWLJDWHGE\ERWKPRGDOLWLHVPHQLJLRPDV ZHUHGHWHFWHGE\*D'27$72&3(7&7DQGRQO\E\&(05, 7KHUHIRUHPHQLQJLRPDVZHUHGHWHFWHGE\3(7&7RQO\0HQLQJLRPDVGHWHFWHG LQ3(7&7RQO\EXWORFDWHGFORVHWRDUHDVRISUHYLRXVFUDQLRWRP\SRVVLEOHUHODSVHV RUUHPQDQWVRIIRUPHUPHQLQJLRPDVZHUHH[FOXGHGIURPIXUWKHUDQDO\VLV &RQFOXVLRQ*D'27$72&3(7&7SUHVHQWHGZLWKDKLJKHUVHQVLWLYLW\LQGH WHFWLQJPHQLQJLRPDVZKHQFRPSDUHGWR&(05,(VSHFLDOO\WXPRXUVDGMDFHQWWR WKHIDO[FHUHEULORFDWHGLQWKHVFXOOEDVHRUWXPRXUVREVFXUHGE\LPDJLQJDUWHIDFWV DUHGLIÀFXOWWRGHWHFWE\05, % 'LDJQRVWLFSHUIRUPDQFHRI3(705YHUVXV3(7&7LQWKHDEGRPHQ ':&URRN&0DGHU) 3 .XKQ$6DPDULQ7 ) +DQ\-+RGOHU *.YRQ6FKXOWKHVV'6FKPLG=XULFK&+FDHFLOLDPDGHU#XV]FK 3XUSRVH7 RFRPSDUHWKHGLDJQRVWLFSHUIRUPDQFHRI3(705YHUVXV3(7&7LQ WKHDEGRPHQ 0HWKRGVDQG0DWHULDOV6L[W\VL[RQFRORJLFSDWLHQWVPHDQDJHZHUHH[DPLQHG RQD72)3(7&7DQG705SODWIRUP*('LVFRYHU\ UHVSHFWLYHO\LQWH JUDWHGE\DVKXWWOHV\VWHP8QHQKDQFHG&7DQG7Z/$9$'*5(LPDJHVRIWKH DEGRPHQZHUHDFTXLUHGFRUHJLVWHUHGZLWK3(7GDWDDQGDQDO\VHGLQGHSHQGHQWO\ E\WZRGRXEOHERDUGFHUWLÀHGUDGLRORJLVWVQXFOHDUSK\VLFLDQV3(7SRVLWLYHOHVLRQV ZHUHFKDUDFWHULVHGDW&7DQG05XVLQJDSRLQWVFDOHWRJUDGHLPDJHTXDOLW\DQG OHVLRQFRQVSLFXLW\&RKHQѣVWDWLVWLFVZHUHFDOFXODWHGIRULQWHUREVHUYHUDJUHHPHQW DQGWKH:LOFR[RQUDQNVXPWHVWZDVHPSOR\HGIRULQWUDREVHUYHUFRQVSLFXLW\JUDGLQJ 6FLHQWLILF6HVVLRQ 6 &$' ( ) *+% (XURSHDQ&RQJUHVVRI 5DGLRORJ\ 5RRP) *HQLWRXULQDU\ 66 7UDQVSODQWLPDJLQJDQGVSHFLDOWRSLFV 0RGHUDWRUV 3+DOOVFKHLGW+HLGHOEHUJ'( -c-DNREVHQ2VOR12 % 3UHRSHUDWLYHDVVHVVPHQWRIOLYLQJUHQDOWUDQVSODQWGRQRUVZLWK FRPSXWHGWRPRJUDSK\DQJLRJUDSK\YHUVXVPDJQHWLFUHVRQDQFH DQJLRJUDSK\LQSDWLHQWV ) (QJHONHQ) )ULHGHUVGRUII%+DPP*'LHGHULFKV %HUOLQ'(ÁRULDQHQJHONHQ#FKDULWHGH 3XUSRVH7 RFRPSDUHPRGHUQPXOWLVOLFHFRPSXWHGWRPRJUDSK\DQJLRJUDSK\&7$ ZLWKPDJQHWLFUHVRQDQFHDQJLRJUDSK\05$LQWKHSUHRSHUDWLYHHYDOXDWLRQRI YDVFXODUDQDWRP\RIOLYLQJUHQDOWUDQVSODQWGRQRUV 0HWKRGVDQG0DWHULDOVUHQDOWUDQVSODQWGRQRUVZHUHH[DPLQHGZLWKERWKD PRGHUQPXOWLVOLFH&7VFDQQHU PPVOLFHWKLFNQHVVDQGD705,VFDQQHU NLGQH\VZHUHLQFOXGHGLQWKH&7$DQG05$DQDO\VLV5HQDOYDVFXODWXUHZDV HYDOXDWHGLQGHSHQGHQWO\E\WZRUHDGHUVLQHDFKPRGDOLW\ZLWKDGHOD\RIZHHNV EHWZHHQUHDGLQJVHVVLRQV6XUJLFDOFRUUHODWLRQRQWKHRSHUDWHGVLGHZDVDYDLODEOH LQDOOSDWLHQWV*ROGVWDQGDUGZDVGHÀQHGE\VXUJLFDOFRUUHODWLRQDQGFRQVHQVXV UHDGLQJRIERWKPRGDOLWLHV 5HVXOWV7KHUHZHUHUHQDODUWHULHVDQGUHQDOYHLQVLQWRWDO6HQVLWLYLW\RI &7$IRUDUWHULHVZDVDQGIRUUHDGHUVDQGUHVSHFWLYHO\6HQVLWLY LW\RI05$IRUDUWHULHVZDV0RVWRIWKHRYHUORRNHGDUWHULHVZHUH PPGLDPHWHUUHDGHURILQ&7$DQGRILQ05$UHDGHURI LQ&7$DQGRILQ05$6HQVLWLYLW\IRUDUWHULHV! PPZDVLQ &7$DQGLQ05$6HQVLWLYLW\IRUYHLQVZDVLQ&7$DQG LQ05$%RWKUHDGHUVPLVGLDJQRVHGEHWZHHQDQGQRQSUHVHQW DUWHULHVDQGEHWZHHQDQGQRQSUHVHQWYHLQVLQERWKPRGDOLWLHV &RQFOXVLRQ 0RGHUQ PXOWLVOLFH &7 DQG 05,VFDQQHUV DOORZ KLJKO\ DFFXUDWH HYDOXDWLRQRIWKHYDVFXODUDQDWRP\RIOLYLQJUHQDOWUDQVSODQWGRQRUVHVSHFLDOO\IRU YHVVHOVRI! PPGLDPHWHU&7$PD\SURYLGHVOLJKWO\EHWWHUGHSLFWLRQRIYHU\ VPDOODUWHULHVKRZHYHUWKLVPD\EHUHDGHUGHSHQGHQW % 'LDJQRVWLFSHUIRUPDQFHRIDQRQFRQWUDVWHQKDQFHG05LPDJLQJ SURWRFROIRUSRWHQWLDOOLYLQJUHODWHGNLGQH\GRQRUV *'3XLSSH6%DXPXHOOHU+$ONDGKL7 3IDPPDWWHU5+XQ]LNHU 06FKLHVVHU53 *RHWWL=XULFK&+JLOEHUWSXLSSH#XV]FK 3XUSRVH7 RSURVSHFWLYHO\HYDOXDWHWKHSHUIRUPDQFHRIDQRQFRQWUDVWHQKDQFHG PDJQHWLFUHVRQDQFH05LPDJLQJSURWRFROIRUSUHRSHUDWLYHVFUHHQLQJRIOLYLQJ UHODWHGNLGQH\GRQRUV 0HWKRGVDQG0DWHULDOV)RUW\FRQVHFXWLYHVXEMHFWVPHDQDJH\HDUV UDQJH\HDUVXQGHUZHQW05LPDJLQJZLWK7ZHLJKWHGVHTXHQFHVFRURQDO DQGD[LDOSODQHZLWKDQRQFRQWUDVWHQKDQFHGUHVSLUDWRU\JDWHG'VWHDG\VWDWH IUHH SUHFHVVLRQ 66)3 DQJLRJUDSK\ 1&(05$ VHTXHQFH DQG ZLWKFRQWUDVW HQKDQFHGPDJQHWLFUHVRQDQFHDQJLRJUDSK\&(05$VHTXHQFHVLQWKHDUWHULDO DQG YHQRXV SKDVH 7ZR EOLQGHG UHDGHUV LQGHSHQGHQWO\ DVVHVVHG DUWHULDO DQG YHQRXVDQDWRP\DQGSRWHQWLDONLGQH\OHVLRQV5HVXOWVRIQRQFRQWUDVWHQKDQFHG LPDJHVZHUHFRPSDUHGWR&(05$DQGLQDVXEJURXSRIVXEMHFWVWRVXUJHU\ DVVWDQGDUGRIUHIHUHQFH 5HVXOWV 5HJDUGLQJ DUWHULDO DQDWRP\ 1&(05$ \LHOGHG VHQVLWLYLW\ VSHFLÀFLW\ DQGDFFXUDF\RIDQGFRPSDUHGWR&(05$7KUHHNLGQH\VZHUH IRXQGWRKDYHPRUHDFFHVVRU\UHQDODUWHULHVDW1&(05$EXWQRWDW&(05$,Q WKHVXEJURXSRIVXEMHFWVRQHVXUJLFDOO\SURYHQDFFHVVRU\DUWHU\ZDVGHSLFWHG ZLWK1&(05$EXWQRWZLWK&(05$$FFXUDF\RI7ZHLJKWHGLPDJHVUHJDUGLQJ DFFHVVRU\YHLQVRUYDULDQWYHQRXVFRXUVHZDVZLWKRQHPLVVHGFLUFXPDRUWLF YHLQDW7ZHLJKWHGLPDJHV7ZRVLPSOHF\VWVZHUHPLVVHGRQ7ZHLJKWHGDQG 1&(05$EXWQRWRQ&(05$LPDJHV &RQFOXVLRQ$QRQFRQWUDVWHQKDQFHG05LPDJLQJSURWRFROLQFOXGLQJ1&(05$ DQG7ZHLJKWHGLPDJHVDOORZVIRUWKHDFFXUDWHVFUHHQLQJRIOLYLQJUHODWHGNLGQH\ GRQRUVDQGPD\VHUYHDVDQDOWHUQDWLYHWR&(05$ % &RPSDULVRQRI053(7DQG3(7&7LQWKHDVVHVVPHQWRISXOPRQDU\ PDVVHV &6FKUDPO+6FKPLGW&%UHQGOH$6DXWHU00XHOOHU&3IDQQHQEHUJ &'&ODXVVHQ1) 6FKZHQ]HU7ELQJHQ'( 3XUSRVH&RPSDULVRQRIWKHK\EULGPRGDOLWLHV053(7DQG3(7&7LQWKHDV VHVVPHQW RI SXOPRQDU\ OHVLRQV UHJDUGLQJ )'*XSWDNH OHVLRQ FKDUDFWHULVDWLRQ DQGWXPRXUVWDJLQJ 0HWKRGVDQG0DWHULDOV7KHVWXG\ZDVDSSURYHGE\WKHORFDOHWKLFVFRPPLWWHH 7 HQSDWLHQWVZLWKVXVSHFWHGRUSURYHQEURQFKLDOFDUFLQRPDZHUHHYDOXDWHG05 3(7ZDVSHUIRUPHGZLWKDQHZK\EULGZKROHERG\V\VWHPFRQVLVWLQJRID705 VFDQQHUZLWKDQLQWHJUDWHG3(7V\VWHP5HVXOWVZHUHFRPSDUHGWRWKRVHJDLQHG E\ D GLUHFWO\ SUHFHGLQJ > )@)'*3(7&7 6HJPHQWDWLRQEDVHG DWWHQXDWLRQ FRUUHFWLRQRI3(7GDWDUHFRUGHGLQ053(7ZDVFRQGXFWHGZLWK',;21EDVHG IDWZDWHUVHSDUDWLRQ7XPRXUDQGO\PSKQRGHVWDJLQJEDVHGRQ3(7&7DQG05 3(7VWXGLHVZDVSHUIRUPHGE\WZRUHDGHUVLQFRQVHQVXV7XPRXUWROLYHU7/ UDWLRVFDOFXODWHGLQ053(7DQG3(7&7ZHUHFRPSDUHG6WDWLVWLFDOWHVWLQJZDV FDUULHGRXWXVLQJ3HDUVRQҋVFRUUHODWLRQDQG%ODQG$OWPDQDQDO\VLV 5HVXOWV,QDOOSDWLHQWVGLDJQRVWLF053(7LPDJHTXDOLW\ZLWKJRRGWXPRXUGHOLQH DWLRQZDVDFKLHYHG0RVWOHVLRQVVKRZHGDSURQRXQFHG)'*XSWDNH2QH OHVLRQZDVPRUSKRORJLFDOO\VXVSLFLRXVIRUPDOLJQDQF\LQ&7DQG05,EXWVKRZHG QR )'* XSWDNH 053(7 VKRZHG KLJKHU 7/ UDWLRV WKDQ 3(7&7 Y V KRZHYHUVLJQLÀFDQWFRUUHODWLRQUHJDUGLQJ7/UDWLRZDVIRXQGEHWZHHQ ERWKVFDQQHUVU S 710VFRUHGLVFUHSDQFLHVRFFXUUHGLQ SDWLHQWVPDLQO\GXHWRPRGDOLW\LQKHUHQWGLIIHUHQFHVLQOHVLRQVVL]HPHDVXUHPHQW &RQFOXVLRQ053(7LPDJLQJRIWKHOXQJLVIHDVLEOHDQGSURYLGHVGLDJQRVWLFLP DJHTXDOLW\LQWKHDVVHVVPHQWRIOXQJPDVVHV6LPLODUOHVLRQFKDUDFWHULVDWLRQDQG WXPRXUVWDJHZDVIRXQGFRPSDULQJ3(7&7DQG053(7LQWKHPDMRULW\RISDWLHQWV % 7KHLPSDFWRIDFTXLVLWLRQWLPHRQLPDJHLQZKROHERG\))'* 3(7&7IRUFDQFHUVWDJLQJ '+DXVPDQQ''LQWHU626FK|QEHUJ-%UDGH06DGLFN.%XHVLQJ 0DQQKHLP'(GDQLHOKDXVPDQQ#XPPGH 3XUSRVH7 RHYDOXDWHWKHLPSDFWRIDFTXLVLWLRQWLPHRQLPDJHTXDOLW\OHVLRQGHWHF WLRQUDWHVWDQGDUGXSWDNHYDOXHVDQGOHVLRQYROXPHLQ)ÁXRURGHR[\JOXFRVH SRVLWURQHPLVVLRQWRPRJUDSK\))'*3(7LQFDQFHUSDWLHQWV 0HWKRGVDQG0DWHULDOV2YHUDWLPHSHULRGRIPRQWKVFDQFHUSDWLHQWVZHUH LQFOXGHGLQWKLVVWXG\,QWKHVHSDWLHQWVDWRWDORIOHVLRQVZHUHLQGHSHQGHQWO\ HYDOXDWHGE\WZRUDGLRORJLVWVH[SHULHQFHGDQGEHJLQQHU $ZKROHERG\))'* 3(7FRPSXWHGWRPRJUDSK\VFDQZLWKPLQDQGPLQDFTXLVLWLRQWLPHSHUEHG SRVLWLRQZDVSHUIRUPHGLQHDFKSDWLHQW/HVLRQVZHUHYLVXDOO\LGHQWLÀHGDQGOHVLRQ ORFDWLRQV FRPSDUHG /HVLRQ YROXPHV DQG VWDQGDUG XSWDNH YDOXHV 689 RI WKH SULPDU\WXPRXUO\PSKQRGHVDQGPHWDVWDVHVZHUHREWDLQHGDQGFRPSDUHG)RU DOOSDUDPHWHUVLQWHUUDWHUDJUHHPHQWZDVDVVHVVHG 5HVXOWV$OO UHOHYDQW OHVLRQV ZHUH LGHQWLÀDEOH DW ERWK DFTXLVLWLRQ WLPHV ,PDJH TXDOLW\ ZDV VLJQLÀFDQWO\ UHGXFHG LQ VFDQV ZLWK DQ DFTXLVLWLRQ WLPH RI PLQ S1HYHUWKHOHVVWKHLPDJHTXDOLW\ZDVUDWHGH[FHOOHQWJRRGLQRI WKHVFDQVZLWKDQDFTXLVLWLRQWLPHRIPLQ7KHTXDOLW\RIOHVLRQYLVXDOLVDWLRQZDV H[FHOOHQWUHJDUGOHVVRIWKHDFTXLVLWLRQWLPH/HVLRQYROXPHRQ3(7LPDJHVDQG 689PD[ZHUHQRWVLJQLÀFDQWO\GLIIHUHQWEHWZHHQERWKDFTXLVLWLRQWLPHVS ,QWHUUDWHUDJUHHPHQWZDVJRRGƋ! &RQFOXVLRQ'HVSLWHVLJQLÀFDQWGHFUHDVHLQLPDJHTXDOLW\DUHGXFWLRQRIDFTXLVL WLRQWLPHSHUEHGSRVLWLRQVHHPVWREHFOLQLFDOO\IHDVLEOHZLWKRXWUHGXFWLRQRIWKH OHVLRQGHWHFWLRQUDWHHYHQIRUOHVVH[SHULHQFHGREVHUYHUV 6FLHQWLILF6HVVLRQ $ 6&'()*+%(XURSHDQ&RQJUHVVRI 5DGLRORJ\ 0RQGD\ 0HWKRGVDQG0DWHULDOV7KLVVWXG\ZDVSHUIRUPHGZLWKLQVWLWXWLRQDOUHYLHZERDUG DSSURYDOSDWLHQWVVXIIHULQJIURPDFXWHXQH[SODLQHGNLGQH\DOORJUDIWG\VIXQFWLRQ ZHUHLQFOXGHGLQWKHVWXG\$G\QDPLFPXOWLSKDVH&7DQJLRJUDSK\SURWRFRO VOLFH&7VFDQQHUSKDVHVWHPSRUDOUHVROXWLRQVLQFOXGLQJWKHHQWLUHUHQDO JUDIWZDVSHUIRUPHGWRH[FOXGHSRVWRSHUDWLYHRUYDVFXODUFRPSOLFDWLRQV'\QDPLF &7GDWDZHUHXVHGIRUWKHFDOFXODWLRQRISDUHQFK\PDOEORRGÁRZDQGSDUHQFK\PDO EORRGYROXPHXVLQJGHGLFDWHGVRIWZDUH5HQDOELRSV\Q RUFOLQLFDOIROORZXS Q VHUYHGDVWKHVWDQGDUGRIUHIHUHQFH 5HVXOWV 5HQDO SDUHQFK\PDO EORRG ÁRZ YDOXHV ZHUH VXEVWDQWLDOO\ ORZHU LQD O ORJUDIWV ZLWK DFXWH UHMHFWLRQ PO POPLQ Q FRPSDUHG WR$71 POPOPLQQ ,QDGGLWLRQUHQDOSDUHQFK\PDOEORRGYROXPHZDV UHGXFHGLQFDVHRIUHQDOJUDIWUHMHFWLRQPOPOFRPSDUHGWRVXEMHFWV VXIIHULQJIURP$71POPO &RQFOXVLRQ&7SHUIXVLRQKDVWKHSRWHQWLDOWRLPSURYHDVVHVVPHQWRIUHQDODO ORJUDIWG\VIXQFWLRQ % &RPSDULVRQRIGLIIXVLRQZHLJKWHG05,DQGKLVWRSDWKRORJLFÀQGLQJV LQNLGQH\WUDQVSODQWSDWLHQWVZLWKGHWHULRUDWLQJUHQDOIXQFWLRQ 3 6WHLJHU0,WK0*XJJHU$.UXVH-)U|KOLFK'&KRQJ+7KRHQ\ %HUQH&+ 3XUSRVH7 RGHWHUPLQHZKHWKHUGLIIXVLRQZHLJKWHG05,':05,FDQEHXVHG WR VWUDWLI\ SDWLHQWV IRU ELRSV\ %, RU IROORZXS )8 EDVHG RQ YDULRXV GLIIXVLRQ SDUDPHWHUV 0HWKRGV DQG 0DWHULDOV 7KLUW\ILYH FRQVHFXWLYH NLGQH\ WUDQVSODQW SDWLHQWV ZPZLWKGHWHULRUDWLQJUHQDOIXQFWLRQXQGHUZHQW':05,(3,VHTXHQFHWHQ EYDOXHVVPPRQD7 HVOD05VFDQQHU6LHPHQV6RQDWDZLWKLQWHQ GD\VEHIRUHRUDIWHUELRSV\':05,GDWDZHUHSURFHVVHGDSSO\LQJHLWKHUPRQR H[SRQHQWLDO\LHOGLQJ$'&YDOXHV>[PPV@RUELH[SRQHQWLDOÀWWLQJ\LHOGLQJ YDOXHVIRUSXUHGLIIXVLRQ $'&'>[PPV@DQGSHUIXVLRQIUDFWLRQ)3>@,IUHQDO ELRSV\\LHOGHGDWOHDVWRQHUHVXOWZLWKDGLUHFWLPSOLFDWLRQIRUFOLQLFDOPDQDJHPHQW HJUHMHFWLRQSDWLHQWVZHUHDVVLJQHGWRWKH%,JURXS6WDWLVWLFDOHYDOXDWLRQZDV SHUIRUPHGXVLQJ67$7$DQGYDOXHVDUHJLYHQDVPHDQ6(08QSDLUHGWWHVWVZHUH XVHGWRFRPSDUHWKH':05,SDUDPHWHUVEHWZHHQ%,DQG)8JURXS 5HVXOWV2IWKHSDWLHQWVZKRXQGHUZHQWUHQDODOORJUDIWELRSV\ZHUHFODVVLÀHG LQWRWKH%,JURXSDQGLQWRWKH)8JURXS+LVWRSDWKRORJLFÀQGLQJVLQWKH%,JURXS LQFOXGHGFHOOXODUUHMHFWLRQQ KXPRUDOUHMHFWLRQQ JORPHUXORQHSKULWLVQ ,*$QHSKURSDWK\Q %.YLUXVQHSKURSDWK\Q DFXWHWXEXODUQHFURVLVQ F\FORVSRULQHWR[LFLW\Q DQGFKURQLFDOORJUDIWQHSKURSDWK\Q ZKHUHDVÀQG LQJV LQ WKH )8JURXS LQFOXGHG FKURQLF FKDQJHV VXFK DV YDVFXODURU JORPHUXODU VFOHURVLVÀEURVLVDWURSK\RUPLQRULQWHUVWLWLDOLQÁDPPDWLRQ':05,SDUDPHWHUV RIWKH%,JURXSZHUHVLJQLÀFDQWO\ORZHUFRPSDUHGWRWKH)8JURXS $'&YV S$'&'YVSDQGSHUIXVLRQIUDFWLRQ )3YVSUHVSHFWLYHO\ &RQFOXVLRQ':05,LQNLGQH\WUDQVSODQWSDWLHQWVZLWKGHWHULRUDWHGUHQDOIXQF WLRQPLJKWLPSURYHWKHGLDJQRVWLFZRUNXSE\VWUDWLI\LQJSDWLHQWVIRUUHQDOELRSV\ % +LJKÀHOG05,LQDVVHVVPHQWRIPXULQHSODFHQWDOIXQFWLRQDO PRUSKRORJ\DQGFRPSDULVRQWRKLVWRORJ\ &&0XFK(6RODQR7 (UQVW-<DPDPXUD*$GDP3 $UFN 8:HGHJDHUWQHU+DPEXUJ'(FPXFK#XNHGH 3XUSRVH 7 R GDWH LQVLJKWV RQ SODFHQWDO DUFKLWHFWXUH DUH DFKLHYHG E\ WHGLRXV KLVWRPRUSKRORJLFDODQDO\VLV7KHSXUSRVHRIRXUVWXG\ZDVWRHYDOXDWH05,DVD WRROWRH[DPLQHSODFHQWDOPRUSKRORJ\LQDPXULQHPRGHO 0HWKRGVDQG0DWHULDOV05,,PDJLQJZDVSHUIRUPHGRQIRUPDOLQÀ[HGDQG JDGROLQLXPWUHDWHGPRXVHSODFHQWDVRQD7DQLPDOVFDQQHU&OLQ6FDQ%UXNHU XVLQJD7ZHLJKWHG'76(VHTXHQFHSODFHQWDVZHUHWDNHQIURPSUHQDWDOO\ VWUHVVHGZHOOHVWDEOLVKHGPRGHORIVRXQGFKDOOHQJHIRHWXVHVDQGSODFHQWDV VHUYHGDVFRQWUROV7 RWDOSODFHQWDOYROXPHDQGYROXPHRIIXQFWLRQDO]RQHVMXQFWLRQDO ]RQHDQGODE\ULQWKZDVFDOFXODWHG)RUFRPSDULVRQIRUPDOLQÀ[HGDQGSDUDIÀQ HPEHGGHGSODFHQWDVVWUHVVHGFRQWUROVZHUHPRUSKRORJLFDOO\DVVHVVHG IRUIXQFWLRQDO]RQHVXSRQKLVWRORJ\E\DQH[SHULHQFHGIHWRPDWHUQDOSDWKRORJLVW DFFRUGLQJWRWKHWRGDWHҊJROGVWDQGDUGSURWRFROҋIRUSODFHQWDODQDO\VHV'LIIHUHQFHV EHWZHHQJURXSVZHUHDQDO\VHGE\0DQQ:KLWQH\8WHVW 5HVXOWV3ODFHQWDOIXQFWLRQDO]RQHVFRXOGEHHDVLO\LGHQWLÀHGZLWK05,)XUWKHU SODFHQWDOIXQFWLRQDODOWHUDWLRQVFRXOGEHGHWHFWHGDVWLVVXHIURPSUHQDWDOO\VWUHVVHG PLFHGLVSOD\HGDELDVWRZDUGVDQLQFUHDVHGODE\ULQWK]RQHUDWLRYVFRQ WUROV S ZKLOVW WKH RYHUDOO SODFHQWDO YROXPH UHPDLQHGXQDOWHUHG 7KHVH REVHUYDWLRQVFRXOGEHLQGHSHQGHQWO\DSSUHFLDWHGXSRQKLVWRORJLFDODVVHVVPHQW % 'LIIXVLRQWHQVRULPDJLQJ'7,IRUIXQFWLRQDODVVHVVPHQWRI WUDQVSODQWHGNLGQH\VDW7 56/DQ]PDQ$/MLPDQL*3HQWDQJ3 .URSLO3 +HXVFK) 50LHVH '%ORQGLQ*$QWRFK+-:LWWVDFN'VVHOGRUI'(URWHPVKORPR#\DKRRGH 3XUSRVH7KHSXUSRVHRIRXUVWXG\ZDVWRLQYHVWLJDWHGLIIXVLRQWHQVRULPDJLQJ '7,IRUIXQFWLRQDODVVHVVPHQWRIWUDQVSODQWHGNLGQH\VDW7 0HWKRGV DQG 0DWHULDOV UHQDO WUDQVSODQW UHFLSLHQWV PHDQ DJH \HDUVZHUHLQFOXGHGLQWKLVVWXG\DQGH[DPLQHGRQD705VFDQQHUXVLQJDERG\ DUUD\FRLO5HFLSLHQWVZHUHGLYLGHGLQWRWZRJURXSVDFFRUGLQJWRDOORJUDIWIXQFWLRQ JURXSDSDWLHQWVZLWKJRRGDOORJUDIWIXQFWLRQ*)5!POPLQPòJURXSE SDWLHQWVZLWKSRRUDOORJUDIWIXQFWLRQ*)5POPLQPò7KH'7,VHTXHQFH ZDVDFTXLUHGLQWKHFRURQDOSODQHZLWKEYDOXHVVPP DQGGLUHFWLRQ)29PPPDWUL[VOLFHWKLFNQHVVPPVOLFHV75 7(PV)$IUDFWLRQDODQLVRWURS\DQG $'&DSSDUHQWGLIIXVLRQFRHIÀFLHQW PDSVZHUHFDOFXODWHGDQGD52,EDVHGDQDO\VLVZDVSHUIRUPHG 5HVXOWV 0HDQ )$ RI WKH UHQDO PHGXOOD ZDV VLJQLÀFDQWO\ KLJKHU LQ JURXSD DVFRPSDUHGWRJURXSE)XUWKHUPRUHPHDQ $'&YDOXHV RIWKHUHQDOFRUWH[DQGPHGXOODZHUHVLJQLÀFDQWO\KLJKHULQJURXSD DQG PPòV UHVSHFWLYHO\ WKDQ LQ JURXS E DQG PPòV UHVSHFWLYHO\ 0HGXOODU\ )$ YDOXHV FRUUHODWHG VLJQLÀFDQWO\ZLWKDOORJUDIWIXQFWLRQDVDVVHVVHGE\*)5U &RQFOXVLRQ'7,LVDSURPLVLQJQRQHQKDQFHGWHFKQLTXHIRUIXQFWLRQDOHYDOXDWLRQ RIUHQDODOORJUDIWV)$YDOXHVRIWKHUHQDOPHGXOODFRUUHODWHVLJQLÀFDQWO\ZLWKDO ORJUDIWIXQFWLRQ)XUWKHUVWXGLHVDUHUHTXLUHGWRGHWHUPLQHWKHFOLQLFDOYDOXHRI'7, IRUPRQLWRULQJWUDQVSODQWHGNLGQH\V % ':,ZLWKPRQRDQGELH[SRQHQWLDODQDO\VLVLQNLGQH\VDOORJUDIWV HDUO\DIWHUWUDQVSODQWDWLRQ 81DYDUUR05DYDQHOOL3 5L]]DUGL66DQGULQL50DUROGL%UHVFLD,7 QDYDUURXJR#JPDLOFRP 3XUSRVH 7 R HYDOXDWH LI ':,UHODWHG SDUDPHWHUV REWDLQHG E\ PRQR DQG EL H[SRQHQWLDO DQDO\VLV HDUO\ DIWHU WUDQVSODQWDWLRQ FRUUHODWH ZLWK NLGQH\ DOORJUDIWV IXQFWLRQDQGELRSV\UHVXOWV 0HWKRGVDQG0DWHULDOV7ZHQW\WZRFRQVHFXWLYHNLGQH\DOORJUDIWUHFLSLHQWVZHUH H[DPLQHGE\05EHWZHHQDQGGD\VDIWHUWUDQVSODQWDWLRQ05SURWRFROLQFOXGHG (3':,VHTXHQFHVZLWKEYDOXHVVPP':,52,PHDVXUHPHQWZHUH SHUIRUPHG E\ WZR UDGLRORJLVWV ZLWK GLIIHUHQW H[SHULHQFH LQ DEGRPLQDO 05 2QH UDGLRORJLVWDQDO\VHGWZLFHWHQGDWDVHWVWRDVVHVVWKHLQWUDREVHUYHUYDULDELOLW\':, UHODWHGSDUDPHWHUVZHUH$'&PRQRH[SRQHQWLDODQDO\VLVGLIIXVLRQFRHIÀFLHQW 'DQGSHUIXVLRQIUDFWLRQIELH[SRQHQWLDODQDO\VLV)RXUWHHQDOORJUDIWVVKRZHG QRUPDOIXQFWLRQUHFRYHU\SDWLHQWVZLWKGHOD\HGIXQFWLRQUHFRYHU\XQGHUZHQW ELRSV\ KDG DFXWH UHMHFWLRQ $5 KDG DFXWH WXEXODU QHFURVLV $71 DQG RQH SUHVHQWHG VSHFLÀF ÀQGLQJV7WHVW ZDV XVHG WR FRPSDUH PHDQ YDOXHV EHWZHHQ SDWLHQWV JURXSV ,QWHU DQG LQWUDREVHUYHU YDULDELOLW\ZDV DVVHVVHG E\ %ODQG$OWPDQWHVW 5HVXOWV $'&'DQGIYDOXHVZHUHVLJQLÀFDQWO\SKLJKHULQQRUPDOIXQFWLRQ DOORJUDIWV[PPV[PPVFRPSDUHG WRWKHLPSDLUHGIXQFWLRQJURXS[PPV[PPV &RPSDUHGZLWKWKH $71WKH $5KDGORZHU'YV[ PPV $'&YV[PPVDQGIYV 7KHWKUHHSDWLHQWVZLWKLPSDLUHGUHQDOIXQFWLRQZLWKRXW $5RU $71KDG $'&YDOXHV JUHDWHUWKDQWKH $71JURXSYV[PPV,QWUDDQGLQWHU REVHUYHUYDULDELOLW\ZDVDGHTXDWH &RQFOXVLRQ7KHVHSUHOLPLQDU\UHVXOWVVXJJHVWWKDW':,FRXOGUHSUHVHQWDUHOL DEOHQRQLQYDVLYHWRROWRHYDOXDWHWKHDOORJUDIWVWDWXVHDUO\DIWHUWUDQVSODQWDWLRQ %LH[SRQHQWLDO DQDO\VLV LV IHDVLEOH DQG XVHIXO WR FRQÀUP WKH UHVXOWV RI PRQR H[SRQHQWLDO DQDO\VLV 'LIIHUHQWLDWLRQ EHWZHHQ$5 DQG$71 FULWLFDO IRU SDWLHQWV PDQDJHPHQWVHHPVWREHIHDVLEOH % 4XDQWLWDWLYH&7LPDJLQJRIUHQDOSHUIXVLRQIRUDVVHVVPHQWRIUHQDO DOORJUDIWG\VIXQFWLRQ $+HOFN ) 6FKRHQ86FKRHQHUPDUFN0:HVVHO\0)LVFKHUHGHU (.ORW]05HLVHU.1LNRODRX&%HFNHU0XQLFK'( )RUFKKHLP'(DQGUHDVKHOFN#PHGXQLPXHQFKHQGH 3XUSRVH7 RDVVHVVWKHIHDVLELOLW\RIDTXDQWLWDWLYH&7SHUIXVLRQWHFKQLTXHIRUWKH GLIIHUHQWLDOGLDJQRVLVEHWZHHQUHQDODOORJUDIWVZLWKDFXWHWXEXODUQHFURVLV$71 DQGJUDIWUHMHFWLRQ 6FLHQWLILF6HVVLRQ 6 &$' ( ) *+% (XURSHDQ&RQJUHVVRI 5DGLRORJ\ % 'HWHFWLRQRIORFDOLVHGSURVWDWHFDQFHUXVLQJFRQWUDVWHQKDQFHG05, DQG&DFHWDWH3(7&7 ,-DPERU5%RUUD-.HPSSDLQHQ9/HSRPNL.'HDQ.$ODQHQ01XUPL +-$URQHQ+0LQQ7XUNX),LYMDPE#XWXÀ 3XUSRVH :H DVVHVVHG WKH DELOLW\ RI FRQWUDVWHQKDQFHG 05, DW 7 HVODDQG &DFHWDWH 3(7&7 WR GHWHFW ORFDOLVHG SURVWDWH FDQFHU ,Q DGGLWLRQ IXVLRQ RI &DFHWDWH3(7ZLWK05,ZDVSHUIRUPHG 0HWKRGVDQG0DWHULDOV7KLUW\VL[SDWLHQWVPHDQDJH\HDUVUDQJH \HDUVZLWKXQWUHDWHGORFDOLVHGSURVWDWHFDQFHUZHUHSURVSHFWLYHO\HQUROOHG $SHOYLF &DFHWDWH3(7&7VFDQZDVSHUIRUPHGLQDOOSDWLHQWVDQGDFRQWUDVWHQKDQFHG 05,VFDQLQSDWLHQWVH[DPLQDWLRQVXVLQJERWKHQGRUHFWDOFRLODQGVXUIDFH FRLOVDQGH[DPLQDWLRQVXVLQJVXUIDFHFRLOVRQO\2EWDLQHG3(7&7DQG05, GDWDZHUHHYDOXDWHGYLVXDOO\DQGFRPSDUHGZLWKELRSV\ÀQGLQJVRQDOREDUOHYHO,Q DGGLWLRQ3(7GDWDZHUHIXVHGZLWK05,GDWDXVLQJLQKRXVHGHYHORSHGVRIWZDUH 7KHOREHZLWKWKHKLJKHVWSHUFHQWDJHRIFDQFHULQELRSV\VDPSOHVZDVGHWHUPLQHG WREHWKHGRPLQDQWOREH 5HVXOWV7KHVHQVLWLYLW\VSHFLÀFLW\DQGDFFXUDF\IRUWKHYLVXDOGHWHFWLRQRISURVWDWH FDQFHURQDOREDUOHYHOE\FRQWUDVWHQKDQFHG05,ZHUHDQG& DFHWDWH3(7&7ZDVUHVSHFWLYHO\)XVLRQRI3(7GDWDZLWK05, LQFUHDVHGGLDJQRVWLFSHUIRUPDQFHZLWKVHQVLWLYLW\VSHFLÀFLW\DQGDFFXUDF\RI DQGUHVSHFWLYHO\7KHDFFXUDF\RIGRPLQDQWOREHGHWHFWLRQZDV DQGIRUFRQWUDVWHQKDQFHG05,3(7&7DQGIXVHG3(705,UHVSHF WLYHO\0D[LPDODQGDYHUDJH689YDOXHVQRUPDOLVHGWREHQLJQVH[WDQWVFRUUHODWHG VLJQLÀFDQWO\ZLWK36$RQO\S DQGUHVSHFWLYHO\ &RQFOXVLRQ)XVLRQRIVHTXHQWLDOO\REWDLQHG3(7&7DQG05,GDWDZDVIHDVLEOH DQGVXSHULRULQORFDOLVDWLRQRISURVWDWHFDQFHUFRPSDUHGWRERWKLPDJLQJPRGDOL WLHVDORQH 5RRP) %UHDVW 66 05,VHTXHQFHVDGYDQFHVDQGDSSOLFDWLRQV 0RGHUDWRUV (7DKHUL7HKUDQ,5 6-9LQQLFRPEH'XQGHH8. % ,QLWLDOPD[LPXPVORSHRIWKHFRQWUDVWHQKDQFHPHQWYHUVXVWLPH FXUYHIRUG\QDPLFHYDOXDWLRQRIEUHDVWOHVLRQVRQXOWUDIDVWEUHDVW05, 500DQQ5'00XV&*HSSHUW&3 0)UHQW]1.DUVVHPHLMHU ++XLVPDQ%3ODWHO1LMPHJHQ1/(UODQJHQ'(UPDQQ#UDGXPFQQO 3XUSRVH 0RGHUQ YLHZVKDULQJ VHTXHQFHV DOORZ G\QDPLF ZKROH EUHDVW 05, DW GLDJQRVWLFVSDWLDOUHVROXWLRQZLWKLQVHFRQGVVKRZLQJWKHLQÁRZRIFRQWUDVWLQ EUHDVWDEQRUPDOLWLHV:HHYDOXDWHWKHPD[LPXPVORSHRILQLWLDOFRQWUDVWHQKDQFH PHQWDVDKHXULVWLFSDUDPHWHUIRUGLIIHUHQWLDWLQJEHQLJQIURPPDOLJQDQWGLVHDVH DQGFRPSDUHLWVYDOXHWRFODVVLFWLPHSRLQWDQDO\VLV 0HWKRGVDQG0DWHULDOV:HHPSOR\HGDELWHPSRUDOEUHDVW05,SURWRFRORQD 705,XVLQJDFKDQQHOELODWHUDOEUHDVWFRLO+LJKUHVROXWLRQ9,%(DFTXLVLWLRQV PPWHPSRUDOUHVROXWLRQVZHUHLQWHUOHDYHGZLWKDVHULHVRIXOWUDIDVW 7:,67DFTXLVLWLRQV PPWHPSRUDOUHVROXWLRQVGXULQJWKHLQÁRZRIWKH FRQWUDVWDJHQW)RUW\WZRFRQVHFXWLYHSDWLHQWVZLWKHQKDQFLQJDEQRUPDOLWLHV EHQLJQDQGPDOLJQDQWSUHVHQWLQJEHWZHHQ1RYHPEHUDQG-XO\ZHUH LQFOXGHG:HPHDVXUHGWKHPD[LPXPVORSHRIWKHUHODWLYHHQKDQFHPHQWYHUVXVWLPH FXUYHRQWKH7:,67DFTXLVLWLRQVDQGUHFRUGHGFXUYHW\SHRIWKHOHVLRQVRQWKH9,%( DFTXLVLWLRQV52&DQDO\VLVZDVSHUIRUPHGWRFRPSDUHGLDJQRVWLFSHUIRUPDQFH 5HVXOWV7KHPD[LPXPVORSHRIWKHUHODWLYHHQKDQFHPHQWYHUVXVWLPHFXUYHZDV VLJQLÀFDQWO\EHWWHULQGLVFULPLQDWLQJEHWZHHQEHQLJQDQGPDOLJQDQWGLVHDVHWKDQ WKHFXUYHW\SH$]YV$]S &XWRIIYDOXHVRIVHFDQG VHF FDQ EH XVHG WR GLIIHUHQWLDWH KLJKULVN OHVLRQV ! PDOLJQDQFLHV IURPLQWHUPHGLDWHDQGORZULVNOHVLRQVPDOLJQDQFLHV7KLVVLPSOLÀFDWLRQ \LHOGVDQ$]RI &RQFOXVLRQ7KHLQLWLDOPD[LPXPVORSHSURYLGHVPRUHGLDJQRVWLFLQIRUPDWLRQWKDQ WKHFXUYHW\SHVDQGFDQWKHUHIRUHEHXVHGWRDVVHVVOHVLRQG\QDPLFV7KLVFDQ VXEVWDQWLDOO\VKRUWHQFXUUHQWVFDQSURWRFROV &RQFOXVLRQ2XUSUHOLPLQDU\UHVXOWVGHPRQVWUDWHWKDWLQYLWURLPDJLQJRIPXULQH SODFHQWDOIXQFWLRQDOPRUSKRORJ\ZLWK05,LVIHDVLEOHDQGUHVXOWVDUHFRPSDUDEOH WRWLPHFRQVXPLQJKLVWRORJLFDODQDO\VLV % 0DJQHWLFUHVRQDQFHGLIIXVLRQWHQVRULPDJLQJLGHQWLÀHV KLVWRSDWKRORJLFDOFKDQJHVLQDUDWPRGHORIGLDEHWLFQHSKURSDWK\ .+XHSHU '+DUWXQJ0*XWEHUOHW) :DFNHU+6DQQ%+XVHQ '5HLFKH+DQQRYHU'(%DUVEWWHO'(6DDUEUFNHQ'(,QJHOKHLP'( 3XUSRVH7 RLQYHVWLJDWHZKHWKHUPDJQHWLFUHVRQDQFH05GLIIXVLRQWHQVRULPDJLQJ '7,DOORZVDVVHVVPHQWRIUHQDOSDWKRORJLHVLQDUDWPRGHORIGLDEHWLFQHSKURSDWK\ 0HWKRGVDQG0DWHULDOV7ZHQW\RQH6SUDJXH'DZOH\UDWVZHUHGLYLGHGLQWRWKUHH JURXSVFRQWUROVGLDEHWHV'0GLDEHWHVZLWKXQLQHSKUHFWRP\'081;81;LV NQRZQWRDFFHOHUDWHUHQDOLPSDLUPHQW(LJKWZHHNVDIWHUGLDEHWHVLQGXFWLRQZLWK VWUHSWR]RWRFLQ05,ZDVSHUIRUPHGRQD7VFDQQHUXVLQJDQFKDQQHOZULVW FRLO0RUSKRORJLFDOLPDJHVDQGHFKRSODQDU'7,ZHUHREWDLQHGE VPP GLIIXVLRQGLUHFWLRQV5HQDO $'&DQGIUDFWLRQDODQLVWRWURSK\)$ZHUHFDOFXODWHG IRUHDFKRIWKHGLIIHUHQWOD\HUVRIWKHNLGQH\,PDJLQJUHVXOWVZHUHFRPSDUHGWR ODERUDWRU\SDUDPHWHUVDQGKLVWRORJ\ 5HVXOWV$OO GLDEHWLF DQLPDOV GHYHORSHG VLJQLÀFDQW K\SHUJO\FHPLD DQG K\SRLQ VXOLQHPLD$OEXPLQXULDDQGKLVWRSDWKRORJLFDOFKDQJHVZHUHPRUHSURQRXQFHGLQ '081;$'&YDOXHVZHUHQRWGLIIHUHQWEHWZHHQJURXSVH[FHSWIRUFRUWLFDO$'& ZKLFKZDVKLJKHULQ'081;WKDQLQFRQWUROV)$RIGLIIHUHQWOD\HUVRIWKHNLGQH\ ZDVVLJQLÀFDQWO\UHGXFHGLQ'081;ZKHQFRPSDUHGWRFRQWUROVDQGWR'0JURXS ,Q'0ZLWKRXW81;RQO\FRUWLFDO)$ZDVVLJQLÀFDQWO\ORZHUWKDQLQFRQWUROV&RUWLFDO )$QHJDWLYHO\FRUUHODWHGZLWKJORPHUXORVFOHURVLVS5 ,QDQLPDOV ZLWKWXEXORLQWHUVWLWLDOÀEURVLVDQGWXEXODUHQODUJHPHQW)$ZDVVLJQLÀFDQWO\UHGXFHG LQFRPSDULVRQWRDQLPDOVZLWKRXWWKRVHÀQGLQJV &RQFOXVLRQ 05 '7, LGHQWLÀHG UHQDO SDWKRORJLHV RI GLDEHWLF QHSKURSDWK\ VXFK DV JORPHUXORVFOHURVLV LQWHUVWLWLDO ÀEURVLV DQG WXEXODU GDPDJHE\ UHGXFWLRQ RI )$'0DQG'081;DQLPDOVUHSUHVHQWLQJGLIIHUHQWVWDJHVRIGLVHDVHFRXOGEH GLIIHUHQWLDWHG7KXV '7, PD\ EH YDOXDEOH IRU GHWHFWLRQ DQG PRQLWRULQJ RI UHQDO QHSKURSDWK\LQGLDEHWLFSDWLHQWV % 05J)86WUHDWPHQWIRUXWHULQHP\RPDVVDIHW\HIIHFWLYHQHVVDQG SDWKRJHQHVLV < .XUDVKYLOL$6WHSDQRY9%\WFKHQNR(.XODEXFKRYD2%DWDUFKLQD ,/XJLQD0RVFRZ58OHUL#PHFRP 3XUSRVH &OLQLFDO VDIHW\ HYDOXDWLRQ RI 05J)86 WUHDWPHQW IRU XWHULQH ÀEURLGV 5HWURVSHFWLYH DQG SURVSHFWLYH VWXG\ SDWLHQWV VXIIHULQJ XWHUXV ÀEURP\RPD KDGXQGHUZHQW05J)86WUHDWPHQWVLQFH0DUFKIRU0DUFK,JURXS UDQGRPLVHGLQFOXGHGSDWLHQWV,,JURXSSDWLHQWVDFFRUGLQJWRSDWLHQWVHOHFWLRQ FULWHULD)ROORZXSSHULRGXSWR\HDUV 0HWKRGVDQG0DWHULDOV6WDQGDUGDQGVSHFLI\LQJ&OLQLFDOHIIHFWZDVPHDVXUHGLQ VFRUHVXVLQJ7KH3LFWRULDO%ORRG $VVHVVPHQW&KDUW+LJKDP-DQVVHQ8)642/ FKDUWDQG0F*LOOSDLQTXHVWLRQQDLUH05J)86DEODWLRQSURFHGXUHVZHUHFRQGXFWHG XVLQJ([$EODWHV\VWHP,Q6LJKWHF ,VUDHOJXLGHGE\05,>>8QVXSSRUWHG &KDUDFWHU @@*(86$ 5HVXOWV5HVXOWVRIWKHVWXG\SURYHG05J)86WHFKQRORJ\WREHDVDIHHQRXJK PHWKRG IRU WUHDWPHQW RI XWHUXV ÀEURP\RPD &RPSOLFDWLRQV DQG DGYHUVH HIIHFWV ZHUHUHYHDOHGLQWKHFRXUVHRIÀUVWWZR\HDUVRIWKHPHWKRGҋVFOLQLFDOXVHDQG FDVHVRIWKHVHZHUHWHPSHUDWXUHLQGXFHGOHVLRQRIWKHVPDOOLQWHVWLQH WHPSHUDWXUHLQGXFHGORFDORHGHPDRIWKHDQWHULRUDEGRPLQDOZDOOZLWKRXW EXUQVFLDWLFDSDVVDJHRI)86GHWULWXVYLDXWHULQHERG\FDY LW\7KHUHZHUHQRFRPSOLFDWLRQVDIWHUZDUGVSURYLGHGSDWLHQWVHOHFWLRQ FULWHULDZHUHXVHG &RQFOXVLRQ'HVSLWHWKHIDFWWKDWWKHPHWKRGLVVXIÀFLHQWO\VDIHDQGKDVDVKRUWOLVW RIUDUHFRPSOLFDWLRQVLWVKRXOGEHUHPHPEHUHGWKDWFXUDWLYHDJHQWRIWKHWHFKQRO RJ\LVIRFXVHGFRDJXODWLQJXOWUDVRXQG3DWLHQWVHOHFWLRQFULWHULDDQGUHJXODWLRQV JRYHUQLQJWKHSURFHGXUHVKRXOGEHIROORZHGVWULFWO\LQRUGHUWRSUHYHQWFRPSOLFD WLRQVDQGDGYHUVHHIIHFWV 6FLHQWLILF6HVVLRQ $ 6&'()*+%(XURSHDQ&RQJUHVVRI 5DGLRORJ\ 0RQGD\ LQYDVLRQSUHVHQWDEVHQWJUDGLQJ***(53J5+(5H[SUHVVLRQSRVL WLYHQHJDWLYH.LDQG710VWDJLQJXVLQJDQDO\VLVRIYDULDQFH$129$ 6SHDUPDQFRHIÀFLHQWZDVXVHGWRDVVHVVFRUUHODWLRQEHWZHHQ$'&YDOXHVDQG FRQWLQXRXVYDULDEOHVDJHSHUFHQWDJHRI(53J5+(5.L 5HVXOWV 7KH$'& RI EUHDVW FDQFHU YLVLEOH RQ WKH KLJK EYDOXH LPDJH ZDV [PPVHF7KH $'&IRU7WXPRXUVZDVKLJKHUWKDQLQ7DQG7 WXPRXUVS7KH$'&IRUO\PSKQRGHSRVLWLYHWXPRXUV11ZDVORZHU WKDQO\PSKQRGHQHJDWLYHWXPRXUVS7KH$'&YDOXHIRUWULSOHUHFHSWRU QHJDWLYHWXPRXUVZDVKLJKHUWKDQRWKHUVXEW\SHVRQO\UHDFKLQJVLJQLÀFDQFHZKHQ FRPSDUHGWR/XPLQDO%S &RQFOXVLRQ 2XU UHVXOWV VKRZHG GLIIHUHQFHV LQ$'& IRU GLIIHUHQW KLVWRORJLFDO SURJQRVWLFIDFWRUVDQGJHQHWLFVXEW\SHVRIEUHDVWFDQFHU7KH$'&GLIIHUHQFHVLQ SDWLHQWVZLWKGLIIHUHQWO\PSKQRGHVVWDWXVHQFRXUDJHVIXUWKHUVWXGLHVWRH[SORUH LWVFOLQLFDOXWLOLW\DVDQDGGLWLRQDOSURJQRVWLFIDFWRUIRUEUHDVWFDQFHU % 'LIIHUHQWLDWLQJLQYDVLYHDQGQRQLQYDVLYHEUHDVWFDUFLQRPDVXVLQJ GLIIXVLRQZHLJKWHG05,DIHDVLELOLW\VWXG\ $0&KRZ9$L3 6< &KHXQJ5/HH6.<X**/R+DSS\9DOOH\+. DSULOFPN#JPDLOFRP 3XUSRVH7 RHVWDEOLVKWKUHVKROGDSSDUHQWGLIIXVLRQFRHIÀFLHQW$'&YDOXHIRUGLI IHUHQWLDWLQJLQYDVLYHDQGQRQLQYDVLYHEUHDVWFDUFLQRPDVXVLQJGLIIXVLRQZHLJKWHG LPDJLQJ':,DW7 0HWKRGVDQG0DWHULDOVIHPDOHSDWLHQWVZLWKELRSV\SURYHQPDOLJQDQWEUHDVW OHVLRQV1 ZHUHSURVSHFWLYHO\HYDOXDWHG$OO05,H[DPLQDWLRQVZHUHSHU IRUPHG RQ D 7 05, VFDQQHU 0$*1(7207ULR 6LHPHQV XVLQJ D GHGLFDWHG FKDQQHOSKDVHGDUUD\FRLO$VLQJOHVKRWHFKRSODQDULPDJLQJ':,SURWRFROZDV SHUIRUPHG WR REWDLQ LPDJHV D[LDOO\ XVLQJ EYDOXHV VPP$ FLUFXODU 52, ZDV GHÀQHG LQ WKH ': LPDJHV RYHU WKH EUHDVW OHVLRQV DQG XVHG IRU$'& PHDVXUHPHQWV7KUHVKROG$'&YDOXHVZHUHGHWHUPLQHGXVLQJUHFHLYHURSHUDWLQJ FKDUDFWHULVWLF52&DQDO\VLV 5HVXOWV3DWKRORJLFDOUHVXOWVVKRZHGWKDWOHVLRQVZHUHLQYDVLYHFDUFLQRPDV ZKLOH OHVLRQV ZHUH QRQLQYDVLYH FDUFLQRPDV$'& RI LQYDVLYHFDUFLQRPDV [PPVZDVVLJQLÀFDQWO\ORZHUSWZRWDLOHGSDLUHG 6WXGHQWҋVWWHVWWKDQWKDWRIQRQLQYDVLYHFDUFLQRPDV[PPV 7KHDUHDXQGHUWKHUHFHLYHURSHUDWLQJFKDUDFWHULVWLFFXUYHZDVLQGLFDWLQJ DJRRGGLDJQRVWLFSHUIRUPDQFHRI $'&LQGLIIHUHQWLDWLQJLQYDVLYHDQGQRQLQYDVLYH EUHDVWFDUFLQRPDV $Q $'&WKUHVKROGYDOXHRI[PPVZDVGHWHUPLQHG DOORZLQJGLIIHUHQWLDWLRQEHWZHHQLQYDVLYHDQGQRQLQYDVLYHEUHDVWFDUFLQRPDVZLWK VHQVLWLYLW\VSHFLÀFLW\DQGDFFXUDF\RIDQGUHVSHFWLYHO\ &RQFOXVLRQ':,LVDIHDVLEOHPHWKRGWRFKDUDFWHULVHEUHDVWOHVLRQVTXDQWLWDWLYHO\ RIIHULQJSURPLVHDVDUREXVWQRQLQYDVLYHWRROWRGLIIHUHQWLDWHEHWZHHQLQYDVLYHDQG QRQLQYDVLYHEUHDVWFDUFLQRPDV % ,V'SURWRQVSHFWURVFRSLFLPDJLQJDW7HVODDEOHWRGLVFULPLQDWH EHQLJQDQGPDOLJQDQWEUHDVWOHVLRQV" %%UXHFN.3LQNHU'RPHQLJ+0DJRPHWVFKQLJJ:%RJQHU+%LFNHO 7 ++HOELFK6*UXEHU9LHQQD$7EHQHGLNWEUXHFN#PHGXQLZLHQDFDW 3XUSRVH 7 R DVVHVV ZKHWKHU ' SURWRQ VSHFWURVFRSLF LPDJLQJ DW 7 HVOD 7 '+056,LVDEOHWRGLIIHUHQWLDWHEHWZHHQEHQLJQDQGPDOLJQDQWEUHDVWOHVLRQV 0HWKRGVDQG0DWHULDOVSDWLHQWVZLWKDVXVSLFLRXVEUHDVWOHVLRQZHUHLQFOXGHG LQWKLVSURVSHFWLYH,5%DSSURYHGVWXG\DQGXQGHUZHQW7'+056,XVLQJD GHGLFDWHG EUHDVW FRLO )RU 7 '+056, D SRLQWUHVROYHG VSHFWURVFRS\ VH TXHQFHZLWKWKHIROORZLQJVHTXHQFHSDUDPHWHUVZDVXVHG757( PV )29ððFPPDWUL[VL]HððLQWHUSRODWHGWRðð7$ PLQ3DWLHQWVKDGWREHH[FOXGHGGXHWRLQVXIÀFLHQWTXDOLW\RIGDWDGXHWR PRWLRQDUWHIDFWV6LJQDOWRQRLVHUDWLR615RIFKROLQH&KRZDVFDOFXODWHGXVLQJ -058,DQGDVHOIZULWWHQVRIWZDUH056,YR[HOVZHUHDVVHVVHGIRUWKHPD[LPXP 615RI&KRE\DQH[SHULHQFHGVSHFWURVFRSLVWDQGDQ615WKUHVKROGRI!ZDV GHÀQHGDVLQGLFDWLYHRIPDOLJQDQF\$OOOHVLRQVZHUHKLVWRSDWKRORJLFDOO\YHULÀHG 5HVXOWVPDOLJQDQWDQGEHQLJQOHVLRQVZHUHFRQÀUPHGLQSDWLHQWV'+ 056,KDGDVHQVLWLYLW\RIDQGDVSHFLÀFLW\RI139ZDV339ZDV DQGGLDJQRVWLFDFFXUDF\ZDV7KHPHGLDQ615RI&KRLQZDVLQ PDOLJQDQWDQGLQEHQLJQEUHDVWOHVLRQV &RQFOXVLRQ'056,DW7\LHOGVKLJKGLDJQRVWLFVHQVLWLYLW\DQGVSHFLÀFLW\IRU GLVFULPLQDWLRQ RI EHQLJQ DQG PDOLJQDQW EUHDVW OHVLRQV ZLWKLQ FOLQLFDOO\ IHDVLEOH VFDQWLPHV % 'LDJQRVWLFSHUIRUPDQFHRIDGHGLFDWHGEUHDVW05V\VWHPXVLQJ VSLUDODFTXLVLWLRQV 6(+DUPV %-+LOOPDQ*6WHYHQV56WRXJK$+ROOLQJVZRUWK ..R]ORZVNL/0RVV)D\HWWHYLOOH$5863KLODGHOSKLD3$86 %DVWURS7;862NODKRPD&LW\2.86.QR[YLOOH7186:RUFHVWHU0$86 VHKDUPV#HDUWKOLQNQHW 3XUSRVH7 RDVVHVVGLDJQRVWLFSHUIRUPDQFHRIEUHDVW05,DWGHGLFDWHGEUHDVW LPDJLQJFHQWHUVXVLQJDGHGLFDWHG7EUHDVW05V\VWHPWKDWHPSOR\HGKLJK UHVROXWLRQKLJKFRQWUDVWVSLUDOWUDMHFWRU\DFTXLVLWLRQV 0HWKRGV DQG 0DWHULDOV :H UHWURVSHFWLYHO\ DVVHVVHG GLDJQRVWLF SHUIRUPDQFH IRUFRQVHFXWLYHVFUHHQLQJQ DQGGLDJQRVWLFQ FDVHVSHUIRUPHG IURP $SULOWR'HFHPEHUIRUZRPHQDJHGIURPIRXUVLWHVIRUZKLFK GHGLFDWHGEUHDVW05,UHSRUWVDQGJURXQGWUXWKELRSV\IRUFDQFHUFDVHVRQH\HDU QHJDWLYHIROORZXSIRUQHJDWLYHFDVHV7KHVWXG\ZDV,5%DSSURYHGDQG+,3$$ FRPSOLDQW7KHVHQVLWLYLW\VSHFLÀFLW\DQG52&IRUWKHEUHDVW05,PDPPRJUDSK\ DQGXOWUDVRXQGZHUHFDOFXODWHGDQGFRPSDUHGWRHDFKRWKHUWRGHWHUPLQHLIWKHUH ZHUH VWDWLVWLFDOO\ VLJQLÀFDQW GLIIHUHQFHV EHWZHHQ WKH PRGDOLWLHV ZLWK UHVSHFW WR WKHVHSDUDPHWHUV 5HVXOWV7KHVHQVLWLYLW\DQGVSHFLÀFLW\IRUWKHGHGLFDWHGEUHDVW05,V\VWHPZHUH S DQGS)RUDOOFDVHVWKHQHJDWLYHSUHGLFWLYH YDOXH 139 ZDV IRU VFUHHQLQJ FDVHV 7KH DUHD XQGHU WKH UHFHLYHU RSHUDWLQJFKDUDFWHULVWLF52&FXUYHZDV2IWKHIDOVHSRVLWLYHVVHHQ RQGHGLFDWHGEUHDVW05,WKLUWHHQZHUHKLJKULVNKLVWRORJLHV &RQFOXVLRQ:HGHPRQVWUDWHKLJKGLDJQRVWLFDFFXUDF\LQEUHDVW05, % (YDOXDWLRQRIWKHDELOLW\RISDUDPHWULFG\QDPLFFRQWUDVWHQKDQFHG 05,DQGGLIIXVLRQWHQVRULPDJLQJWRGHWHFWEUHDVWPDOLJQDQFLHV ()XUPDQ+DUDQ 0)HLQEHUJ6KDSLUR1:HLVHQEHUJ11LVVDQ 7 =HKDYL'*UREJHOG((\DO+'HJDQL5HKRYRW,/.IDU6DED,/ HGQDKDUDQ#ZHL]PDQQDFLO 3XUSRVH7 RFRPSDUHWKHDELOLW\RISHUIXVLRQSDUDPHWHUVDQGRIGLIIXVLRQSDUDP HWHUVREWDLQHGIURPEUHDVW'&(05,DQG'7,GDWDVHWVUHVSHFWLYHO\WRLGHQWLI\ ,'&,/&DQG'&,6 0HWKRGV DQG 0DWHULDOV +LJKUHVROXWLRQ '&( DQG '7, EUHDVW GDWDVHWV RI SDWLHQWV ZLWK EUHDVW PDOLJQDQFLHV ,'& ,/& DQG '&,6 FRQÀUPHG E\ KLVWRSDWKRORJ\ ZHUH DQDO\VHG$[LDO LPDJHV RI WKH WZR EUHDVWV ZHUH UHFRUGHG DW 7 XVLQJ KLJK VSDWLDO UHVROXWLRQ '&( [ [ PPa PLQ '7, [[PPaPLQ 5HVXOWV $OOPDOLJQDQFLHVZHUHHQKDQFHGDQGZHUHFRUUHFWO\GLDJQRVHGXVLQJPRU SKRORJLFDODQGG\QDPLFIHDWXUHVRIHQKDQFHPHQW0RVWRIWKHOHVLRQVH[KLELWHGKLJK ZDVKLQUDWHLQGLFDWLQJKLJKWUDQVFDSLOODU\WUDQVIHUFRQWUDVWIROORZHGE\FRQVWDQW HQKDQFHPHQWRUUHGXFHGHQKDQFHPHQWZDVKRXW,QSDUWRIWKHOHVLRQV,'& ,/&DQG'&,6VORZHQKDQFHPHQWSDWWHUQVZHUHREVHUYHGZLWKQRZDVKRXW 7ZR'7,SDUDPHWHUVWKHSULPHGLIIXVLRQFRHIÀFLHQWDQGWKHPD[LPXPDQLVRWURS\ LQGH[ ZHUH VLJQLÀFDQWO\ ORZHU LQ WKH FDQFHUV WKDQ LQ WKH QRUPDO EUHDVW WLVVXH HQDEOLQJFDQFHUGHOLQHDWLRQ,Q,'&,/&DQG'&,6WKHWZR'7,SDUDPHWHUV GLGQRWUHYHDOFOHDUO\WKHERXQGDULHVRIWKHOHVLRQVSULPDULO\GXHWRORZ61DQG SDUWLDOYROXPHHIIHFWVLQIDWW\EUHDVWV,QSDUWRIWKHVORZHQKDQFLQJFDQFHUVWKH '7,SDUDPHWHUVKHOSHGLGHQWLI\FRUUHFWO\WKHOHVLRQ &RQFOXVLRQ7KHUHVXOWVFRQÀUPWKHKLJKVHQVLWLYLW\RI'&(05,DQGVKRZWKH SRWHQWLDORI'7,WRSURYLGHKLJKVHQVLWLYLW\DVDVWDQGDORQHPHWKRGLQGHQVHEUHDVWV )XUWKHUVWXGLHVDUHUHTXLUHGLQRUGHUWRLQFRUSRUDWH'7,LQWRWKHFOLQLFDOVHWWLQJ % &RUUHODWLRQEHWZHHQDSSDUHQWGLIIXVLRQFRHIÀFLHQWDQGPROHFXODU DQGKLVWRORJLFDOSURJQRVWLFIDFWRUVLQEUHDVWFDQFHUREVHUYDWLRQVLQ SDWLHQWV /%RQHOOR*3HWUDOLD3 6XPPHUV/3UHGD65DLPRQGL*5HQQH*%DUGR *&XULJOLDQR0%HOORPL0LODQ,7OXNHERQHOOR#LHRLW 3XUSRVH 7 R FRUUHODWH DSSDUHQW GLIIXVLRQ FRHIÀFLHQW $'& ZLWK PROHFXODU DQG KLVWRORJLFDOSURJQRVWLFIDFWRUVIRUEUHDVWFDQFHU 0HWKRGVDQG0DWHULDOVIHPDOHSDWLHQWVPHDQDJHUDQJH\HDUV ZLWK KLVWRORJLFDOO\ SURYHQ EUHDVW FDQFHU XQGHUZHQW FRQYHQWLRQDO LQFOXGLQJ 7 ZHLJKWHG DQG 7 G\QDPLF LPDJLQJ SRVWFRQWUDVW DQG GLIIXVLRQZHLJKWHG 05, EYDOXHVDQGVPP7KH$'&IRUEUHDVWFDQFHUDVGHÀQHG PDQXDOO\RQWKHKLJKHVWEYDOXHLPDJHVZDVFRUUHODWHGZLWKPROHFXODUDQGKLVWR ORJLFDOSURJQRVWLFIDFWRUV $'&YDOXHVZHUHDVVHVVHGIRUGLIIHUHQFHEHWZHHQJHQH SURÀOLQJVXEW\SHV/XPLQDO $/XPLQDO%+(5WULSOHUHFHSWRUQHJDWLYHYDVFXODU 6FLHQWLILF6HVVLRQ 6 &$' ( ) *+% (XURSHDQ&RQJUHVVRI 5DGLRORJ\ 0HWKRGV DQG 0DWHULDOV SDWLHQWV PHDQ DJH \ ZLWK HQKDQFLQJ OHVLRQ !PPRQFRQWUDVWHQKDQFHG05,7 PPRO*G'73$NJZHUHLQYHVWLJDWHG XVLQJVLQJOHYR[HO05635(6675PV7(PV5HIHUHQFHVWDQGDUG 56ZDVKLVWRSDWKRORJ\RUIROORZXSRI!PRQWKV6SHFWUDZHUHDQDO\VHGDQG SRVWSURFHVVHG E\ WZR LQGHSHQGHQW REVHUYHUV 2 2 XVLQJ 058,VRIWZDUH )RU&KROLQHZDWHUTXDQWLÀFDWLRQWKH$0$5(6DOJRULWKPZDVDSSOLHG6WDWLVWLFDO DQDO\VLV LQFOXGHG LQWHUREVHUYHU FRUUHODWLRQ FRHIÀFLHQW DQG UHFHLYHU RSHUDWLQJ FKDUDFWHULVWLFV52&DQDO\VLV 5HVXOWVPDOLJQDQWDQGEHQLJQOHVLRQVZHUHLQYHVWLJDWHG,QWHUREVHUYHUFRU UHODWLRQFRHIÀFLHQWZDVKLJKZLWK $FFXUDF\IRUGLVFULPLQDWLRQEHWZHHQEHQLJQ DQGPDOLJQDQWÀQGLQJVGHWHUPLQHGE\52&DQDO\VLVZDV26( 26(GLIIHUHQFHVQRWVLJQLÀFDQW3!$VLJQLÀFDQWRYHUODS RIFKROLQHFRQFHQWUDWLRQEHWZHHQEHQLJQDQGPDOLJQDQWÀQGLQJVZDVREVHUYHG &RQFOXVLRQ $FFRUGLQJWRWKHSUHVHQWHGUHVXOWV056TXDQWLÀFDWLRQVKRZHGKLJK LQWHUREVHUYHU FRUUHODWLRQ DQG QR VLJQLÀFDQW GLIIHUHQFHV EHWZHHQ WKH GLDJQRVWLF SHUIRUPDQFH RI ERWK REVHUYHUV$ TXDQWLWDWLYH DQG UHOLDEOH GLDJQRVWLF WRRO PD\ EHDEOHWRUHGXFHGLDJQRVWLFYDULDWLRQLQEUHDVW05,+RZHYHUHOHYDWHGFKROLQH FRQFHQWUDWLRQVHHPVQRWWREHUHVWULFWHGWRPDOLJQDQWÀQGLQJVDQGLVDOVRREVHUYHG LQEHQLJQOHVLRQVOLPLWLQJGLDJQRVWLFSRZHURI056 % ([YLYR05,RIEUHDVWVSHFLPHQDQLQQRYDWLYHWHFKQLTXHIRUWKH PDQDJHPHQWRIRQO\RUEHWWHU05,GHWHFWHGFDQFHU *7UHFDWH5$JUHVWL'9HUJQDJKL%9DOHUL&)HUUDULV6%RKP,0DXJHUL 0&DUFDQJLX'6FDUDPX]]D0LODQ,7JLR#GRJKXQWHURUJ 3XUSRVH:KHQEHWWHUVWDJHGZLWK05,EUHDVWPDOLJQDQFLHVULVHWKHUDGLRORJLFDO SUREOHPWREHORFDOLVHGDQGWKHVXUJLFDOLVVXHRIWKHLUFRPSOHWHUHVHFWLRQ7KLV PDLQO\KDSSHQVZLWKOREXODUKLVWRW\SHVZKHUHJURZWKSDWWHUQVKRZVPLQLPDORU DEVHQWGHVPRSODVWLFUHDFWLRQRUE\LQVLWXGLVHDVHHVSHFLDOO\LIQRWDVVRFLDWHG ZLWKFDOFLÀFDWLRQV7KHDLPRIRXUVWXG\ZDVWRLQYHQWDQHZVWUDWHJ\WKDWÀUVWO\ HQDEOHGWKHORFDOLVDWLRQRIFDQFHUDQGVHFRQGO\GHPRQVWUDWHGWKHLUWUXHH[FLVLRQ 0HWKRGVDQG0DWHULDOV:HHQUROOHGFDVHVRIEHWWHURURQO\05,HPSKDVLVHG OHVLRQV:HORFDOLVHGWKHGLVHDVHE\PHDQVRIDFDUHIXOWKUHHGLPHQVLRQDOUHFRQ VWUXFWLRQRIEUHDVWSDUHQFK\PDPDGHZLWKDSRVWSURFHVVLQJHODERUDWLRQRILPDJHV DQGFRPELQHGZLWKWKHPHDVXUHPHQWRIWKHGLVWDQFHVIURPWKHQLSSOHDQGVNLQ RXWOLQHV/DWHUZHLQMHFWHGFRQWUDVWPHGLXP*G'73$EHIRUHVXUJLFDOLQFLVLRQ DQGÀQDOO\SHUIRUPHGH[YLYR05,RIVXUJLFDOVSHFLPHQZLWKLQҋDIWHUUHVHFWLRQE\ PHDQVRIDVXUIDFHFRLODQG63$,5VHTXHQFHV,QIRUPHGFRQVHQWZDVUHTXHVWHG IRUERWKGLDJQRVWLFDQGH[YLYRH[DPLQDWLRQV 5HVXOWV$OOHQKDQFLQJOHVLRQVZHUHUHWULHYHGLQEUHDVWVSHFLPHQDIWHUUHVHFWLRQ 7KHQHZWHFKQLTXHUHSURGXFHVSULPDU\GLVHDVHHYHQLIDVVRFLDWHGZLWKGHQGULWLF EUDQFKHVRUVPDOOVDWHOOLWHQRGHVDQGWKHVXUIDFHFRLOPDJQLÀHVPDOLJQDQFLHVZLWK DUHSUHVHQWDWLRQWKDWLVYHU\VLPLODUWRWKHSDWKRORJLFDOJURVVH[DPLQDWLRQ &RQFOXVLRQ7 RRXUNQRZOHGJHWKLVSURFHGXUHLVWKHÀUVWWKDWUHHQKDQFHVEUHDVW OHVLRQV ZLWKLQ D VXUJLFDO VSHFLPHQ7KH WHFKQLTXH UHSURGXFHV PRUSKRORJ\ DQG H[WHQVLRQ RI WKH GLVHDVH E\ PHDQV RI WKH VDPH SURFHGXUH WKDW KDG SUHYLRXVO\ SURYLGHGWKHPRVWDFFXUDWHVWDJLQJRIFDQFHUJLYLQJWKHFHUWDLQW\RILWVWUXHUHPRWLRQ 5RRP*+ +HDGDQG1HFN 66 1HZWHFKQLFDODSSOLFDWLRQV 0RGHUDWRUV +%(JJHVE¡2VOR12 5/MXPDQRYLF$PVWHUGDP1/ % 05PLFURVFRS\RIWKHKXPDQH\HFRUUHODWLRQZLWKKLVWRORJ\ 3 &.UJHU6/DQJQHU.)DONH5*XWKRII26WDFKV1+RVWHQ *UHLIVZDOG'(5RVWRFN'( 3XUSRVH0DJQHWLFUHVRQDQFHLPDJLQJ05,DWDQG7 HVODZLWKVPDOOVXUIDFH FRLOVLVDZHOOHVWDEOLVKHGSURFHGXUHLQWKHGLDJQRVLVRIVSDFHRFFXS\LQJOHVLRQVRI WKHH\HDQGRUELWDOFDYLW\8QWLOQRZKLVWRORJLFDOH[DPLQDWLRQKDVEHHQUHTXLUHGWR UHOLDEO\DVVHVVWXPRXUH[WHQWDQGSRVVLEOHLQÀOWUDWLRQRIVXUURXQGLQJVWUXFWXUHV:LWK XOWUDKLJKÀHOG05,KRZHYHULWKDVEHFRPHSRVVLEOHWRHYDOXDWHWXPRXUPRUSKRO RJ\DVZHOODVLQÀOWUDWLRQLQWRVXUURXQGLQJVWUXFWXUHVZLWKVXEPLOOLPHWHUUHVROXWLRQ 0HWKRGVDQG0DWHULDOV7 HQKXPDQH\HVZLWKGLIIHUHQWVSDFHRFFXS\LQJPDVVHV ZHUHH[DPLQHGH[YLYRWRFRPSDUHWKHVWDQGDUGFOLQLFDOH[DPLQDWLRQXOWUDVRXQG ZLWK XOWUDKLJKÀHOG PLFUR05, XVLQJ D VPDOO VXUIDFH FRLO ,PDJLQJ SDUDPHWHUV % 5ROHRISURWRQ05VSHFWURVFRS\LQWKHKLJKÀHOGPDJQHW7LQ GLDJQRVLVRILQGHWHUPLQDWHEUHDVWPDVVHV%,5'6 10$EGHO5D]HN$2$]DE*L]D(*QDJODDEGHOUD]HN#\DKRRFRP 3XUSRVH7 RHYDOXDWHWKHUROHRI05VSHFWURVFRS\XVLQJWKHVWDWHRIDUWKLJKÀHOG PDJQHW7 HVODDVDGLDJQRVWLFPHWKRGLQLQGHWHUPLQDWHEUHDVWOHVLRQV%,5$'6 OHVLRQVDLPLQJDWGHFUHDVLQJWKHXQQHFHVVDU\EUHDVWLQWHUYHQWLRQ 0HWKRGVDQG0DWHULDOV,QWKLVVWXG\IHPDOHSDWLHQWVFODVVLÀHGDV%,5$'6 E\VRQRPDPPRJUDSK\6RQR0;ZHUHH[DPLQHGE\05,XVLQJWKHPXO WLSKDVHG\QDPLFVHTXHQFHDQGSURWRQ05VSHFWURVFRS\XVLQJDKLJKÀHOGPDJQHW 7 HVOD6LQJOHYR[HOWHFKQLTXHDIWHUDGHTXDWHVKLPPLQJZDVXVHG7KHJUDSKV ZHUHLQWHUSUHWHGIRUWKHSUHVHQFHRIFKROLQHSHDNLQWKHVSHFWUXPDQGWKHUHVXOWV ZHUHFRUUHODWHGWRWKHUHVXOWVRIWKHG\QDPLF05,$OOOHVLRQVZHUHKLVWRSDWKRORJL FDOO\SURYHQ)1%&1%9$% 2% 5HVXOWV FDVHV RI FDVHV ZHUH PDOLJQDQW EDVHG RQ WKH SUHVHQFHRI KLJKFKROLQHSHDNLQWKHVSHFWUXPDQGFDVHVZHUHEHQLJQQRFKROLQH SHDN0DOLJQDQWFDVHVZHUH'&,6,'&PHGXOODU\FROORLGDQGOREXODUFDUFLQRPDV %HQLJQ FDVHV ZHUH ÀEURDGHQRPD SDSLOORPD VFOHURVLQJ DGHQRVLV DQG EUHDVW F\VWV05VSHFWURVFRS\KDVLQFUHDVHGWKHVHQVLWLYLW\DQGVSHFLÀFLW\RIG\QDPLF 05PDPPRJUDSK\IRUGLDJQRVLVRISUREDEOHOHVLRQIURPWRWRWR )DOVHSRVLWLYHUHVXOWVZHUHIRXQGLQODFWDWLQJIHPDOHVDQGLQRQO\RQHFDVH RIDW\SLFDOÀEURDGHQRPDKRZHYHUWKHFKROLQHSHDNLQVXFKFDVHZDVVKRUWDQG ELÀG7KHUHZDVDVWURQJDJUHHPHQWEHWZHHQWKHUHVXOWVRI056DQGWKHKLVWRSD WKRORJ\SYDOXH &RQFOXVLRQ05SURWRQVSHFWURVFRS\LQWKHKLJKÀHOGPDJQHW7RIIHUHGDG GLWLRQDOLQIRUPDWLRQWKDWLQFUHDVHGWKHVHQVLWLYLW\DQGVSHFLÀFLW\RIWKHFRQYHQWLRQDO G\QDPLF05,LQHYDOXDWLQJSUREDEOHEUHDVWOHVLRQVDQGKHQFHUHGXFHGWKHQHHG IRUXQQHFHVVDU\LQWHUYHQWLRQ % 7RFRPSDUH05VSHFWURVFRS\DW7ZLWKWXPRXUW\SHDQGJUDGLQJRI EUHDVWFDQFHUV 0/XFLDQL) 3HGLFRQL07 HOHVFD) 9DVVHOOL9&DVDOL(0LJOLR&&DWDODQR 5RPH,7PDULDODXUDOXFLDQL#JPDLOFRP 3XUSRVH7 RHYDOXDWHWKHGLDJQRVWLFSHUIRUPDQFHRIPDJQHWLFUHVRQDQFH05 VSHFWURVFRS\ DW 7 WR GHWHFW GLIIHUHQW FDQFHU W\SHV DQG SURJQRVWLF IDFWRUV LQ SDWLHQWVZLWKELRSV\SURYHQEUHDVWFDQFHU 0HWKRGVDQG0DWHULDOV%UHDVW05VSHFWURVFRS\ZDVSHUIRUPHGDW7LQSDWLHQWV ZLWKELRSV\SURYHQPDOLJQDQWOHVLRQVPHDVXULQJPPRUODUJHUDW05LPDJLQJ 6LQJOHYR[HO05VSHFWURVFRS\GDWDZHUHFROOHFWHGIURPDVLQJOHUHFWDQJXODUYROXPH RILQWHUHVWWKDWHQFRPSDVVHGWKHOHVLRQ05VSHFWURVFRS\ÀQGLQJVZHUHGHÀQHG DVSRVLWLYHLIWKHVLJQDOWRQRLVHUDWLRRIWKHFKROLQHUHVRQDQFHSHDNZDVDQG DVQHJDWLYHLQDOORWKHUFDVHV05VSHFWURVFRS\ÀQGLQJVZHUHWKHQFRPSDUHGZLWK KLVWRORJLFÀQGLQJV/HVLRQVL]HKLVWRW\SHQXFOHDUJUDGHUHFHSWRUVWDWXV(53J5 DQG.LDQG+(5H[SUHVVLRQZHUHHYDOXDWHG 5HVXOWVSDWLHQWVZLWKOHVLRQVZHUHHYDOXDWHG3DWKRORJ\FRQÀUPHG,'& ,/&DQG'&,6&KROLQHSHDNRFFXUHGLQOHVLRQV,'&DQG,/&7KUHH ,'&ZLWKQRFKROLQHSHDNSUHVHQWHGZLWKODUJHFHQWUDODUHDRIQHFURVLV7KXVD FKROLQHSHDNZDVPRUHIUHTXHQWO\DVVRFLDWHGZLWK,'&WKDQZLWK,/&'&,6DQG QHFURVLV1RVWDWLVWLFDOO\VLJQLÀFDQWDVVRFLDWLRQRIFKROLQHSHDNZLWKUHFHSWRUVWD WXV(53J5.LDQG+(5ZDVIRXQGDOWKRXJKWKHFKROLQHSHDNZDVDOZD\V SUHVHQWLQWULSOHQHJDWLYHSDWLHQWV &RQFOXVLRQ3URWRQ05VSHFWURVFRS\DW7ZDVVXFFHVVIXOO\LQFRUSRUDWHGLQWR EUHDVW05LPDJLQJVWXGLHVIRUOHVLRQVPHDVXULQJPPRUODUJHU05VSHFWURVFRS\ FRXOGEHDQDGGLWLRQDOWRROWRSUHGLFWWXPRXUDJJUHVVLYHQHVV5HVXOWVQHHGWREH YDOLGDWHGLQODUJHUVFDOHVWXGLHV % 'LDJQRVWLFSHUIRUPDQFHDQGLQWHUREVHUYHUYDULDWLRQLQTXDQWLWDWLYH SURWRQPDJQHWLFUHVRQDQFHVSHFWURVFRS\RIWKHEUHDVWDW7 D SURVSHFWLYHVLQJOHFHQWUHFURVVVHFWLRQDOVWXG\ 3 $7 %DOW]HU -6FKHOKRUQ0%HQQGRUI:$.DLVHU0'LHW]HO-HQD'( :HLPDU'(SDVFDOEDOW]HU#PHGXQLMHQDGH 3XUSRVH$QLQFUHDVHRIFKROLQHPHWDEROLWHVLQSURWRQ05VSHFWURVFRS\056 LVDVVRFLDWHGZLWKPDOLJQDQF\2QHDSSURDFKIRUGLIIHUHQWLDWLRQRIEUHDVWOHVLRQV LV TXDQWLÀFDWLRQ RI WKH FKROLQH UHVRQDQFH DW SSP QRUPDOLVHG WR WKH ZDWHU UHVRQDQFH $VSRVWSURFHVVLQJLVDVXEMHFWLYHWDVNWKLVLQYHVWLJDWLRQZDVSHUIRUPHG WRLQYHVWLJDWHLQWHUREVHUYHUYDULDWLRQDQGGLDJQRVWLFSHUIRUPDQFHRITXDQWLWDWLYH 056RIEUHDVWOHVLRQV 6FLHQWLILF6HVVLRQ $ 6&'()*+%(XURSHDQ&RQJUHVVRI 5DGLRORJ\ 0RQGD\ % 5HGXFLQJWKHUDGLDWLRQGRVHIRUORZGRVH&7RIWKHSDUDQDVDO VLQXVHVXVLQJRUJDQVSHFLÀFGRVHUHGXFWLRQ;&$5(DQGLWHUDWLYH UHFRQVWUXFWLRQIHDVLELOLW\DQGLPDJHTXDOLW\ 6%XOOD*3DFKH3 %ODQNH) +DVVHSDVV0/DQJHU )UHLEXUJLP%UHLVJDX'(VWHIDQEXOOD#XQLNOLQLNIUHLEXUJGH 3XUSRVH 7 R SURVSHFWLYHO\ HYDOXDWH LPDJH TXDOLW\ RI GRVHUHGXFHG &7 RIWKH SDUDQDVDO VLQXV XVLQJ RUJDQVSHFLÀF GRVH UHGXFWLRQ ;&$5( DQG LWHUDWLYH UHFRQVWUXFWLRQWHFKQLTXH,5,6 0HWKRGV DQG 0DWHULDOV ,Q WKLV SURVSHFWLYH VWXG\ SDWLHQWV PHDQ DJH \HDUVXQGHUZHQWORZGRVH&7RIWKHSDUDQDVDOVLQXV6LHPHQV'HÀQLWLRQ )RUFKKHLP*HUPDQ\XVLQJLWHUDWLYHUHFRQVWUXFWLRQWHFKQLTXHZLWKHLWKHUVWDQGDUG VHWWLQJV$N9P$VELVPXWKH\HOHQVVKLHOGSURWHFWLRQRUZLWKWXEHYROW DJHDQGWXEHFXUUHQWWLPHSURGXFWORZHULQJXVLQJRUJDQVSHFLÀFGRVHUHGXFWLRQ ;&DUHLQJURXSVRISDWLHQWVHDFK%N9P$V&N9P$V' N9P$VDQG(N9P$V2EMHFWLYHLPDJHTXDOLW\ZDVHYDOXDWHG DQGVXEMHFWLYHLPDJHTXDOLW\ZDVLQGHSHQGHQWO\DVVHVVHGE\WZREOLQGHGREVHUYHUV XVLQJDVHPLTXDQWLWDWLYHÀYHSRLQWJUDGLQJVFDOH SRRU H[FHOOHQW(IIHFWLYHUD GLDWLRQGRVHZDVFDOFXODWHG0DQQ:KLWQH\8WHVWZDVXVHGIRUVWDWLVWLFDODQDO\VLV 5HVXOWV%HVWLPDJHTXDOLW\ZDVREVHUYHGDWN9P$VZKHUHDVVFRUHV IRUELVPXWKVKLHOGHGVWDQGDUGORZGRVH&7$DQGPD[LPXPGRVHUHGXFWLRQZLWK ;&$5((SURYLGHGQHDUO\WKHVDPHVXEMHFWLYHLPDJHTXDOLW\S 0HDQHIIHFWLYHGRVHVZHUHP6Y$P6Y%P6Y &P6Y'DQGP6YUHVXOWLQJLQDPD[LPXPGRVHUHGXFWLRQ RIZLWKRXWORVVLQGLDJQRVWLFLPDJHTXDOLW\%DFNJURXQGQRLVHZDVPRGHUDWHO\ KLJKHU LQ GRVH UHGXFHG DUHDV ZKHQ HPSOR\LQJ ;&DUH SHULQDVDO +8 YVSHULDXULFXODU+8S ,QWHUREVHUYHUDJUHHPHQWZDVH[FHOOHQW ѣYDOXHV &RQFOXVLRQ $VFRPSDUHGZLWKELVPXWKVKLHOGHG&7 DSSOLFDWLRQRILWHUDWLYHUHFRQ VWUXFWLRQDQGRUJDQVSHFLÀFGRVHUHGXFWLRQDOORZVIRUVLJQLÀFDQWGRVHUHGXFWLRQRI XSWRIRUSDUDQDVDOVLQXVORZGRVH&7ZLWKRXWORVVLQGLDJQRVWLFLPDJHTXDOLW\ % 4XDQWLÀFDWLRQRIPHWDODUWHIDFWVRQFRQHEHDPFRPSXWHG WRPRJUDSK\LPDJHV 53DXZHOV +%RVPDQV5-DFREV5%RJDHUWV+6WDPDWDNLV .7 VLNODNLV.+RUQHU/HXYHQ%($WKHQV*50DQFKHVWHU8. KLOGHERVPDQV#VFDUOHWEH 3XUSRVH7 RTXDQWLI\PHWDODUWHIDFWVREWDLQHGIURPDZLGHUDQJHRIFRQHEHDP FRPSXWHGWRPRJUDSK\&%&7GHYLFHVDQGH[SRVXUHSURWRFROVWRFRPSDUHWKHLU WROHUDQFH WR PHWDOV RI GLIIHUHQW GHQVLWLHV DQG WR SURYLGH LQVLJKWV UHJDUGLQJ WKH SRVVLEOHLPSOHPHQWDWLRQRIPHWDODUWHIDFWDQDO\VLVLQWRD4&SURWRFROIRU&%&7 0HWKRGVDQG0DWHULDOV $FXVWRPLVHGSRO\PHWK\OPHWKDFU\ODWH300$SKDQWRP FRQWDLQLQJWLWDQLXPDQGOHDGURGVZDVIDEULFDWHG,WZDVVFDQQHGRQ&%&7 GHYLFHV DQG PXOWLVOLFH FRPSXWHG WRPRJUDSK\ 06&7 GHYLFH LQFOXGLQJ KLJK GRVHDQGORZGRVHH[SRVXUHSURWRFROV$UWHIDFWVIURPWKHURGVZHUHDVVHVVHGE\ WZRREVHUYHUVE\PHDVXULQJWKHVWDQGDUGGHYLDWLRQRIYR[HOYDOXHVLQWKHYLFLQLW\RI WKHURGVDQGQRUPDOLVLQJWKLVYDOXHWRWKHSHUFHQWDJHRIWKHWKHRUHWLFDOPD[LPXP VWDQGDUGGHYLDWLRQ 5HVXOWV)RU&%&7GDWDVHWVDUWHIDFWYDOXHVUDQJHGEHWZHHQDQGIRU WLWDQLXPDQGEHWZHHQDQGIRUOHDG0RVW&%&7GHYLFHVSHUIRUPHG ZRUVHWKDQ06&7IRUWLWDQLXPDUWHIDFWVEXWDOORIWKHPSHUIRUPHGEHWWHUIRUOHDG DUWHIDFWV,QJHQHUDOQRFOHDULPSURYHPHQWRIPHWDODUWHIDFWVZDVVHHQIRUKLJK GRVHSURWRFROVDOWKRXJKFHUWDLQGHYLFHVVKRZHGVRPHDUWHIDFWUHGXFWLRQIRUODUJH )29RUKLJKP$VSURWRFROV &RQFOXVLRQ5HJLRQVLQWKHYLFLQLW\RIWKHPHWDOURGVZHUHPRGHUDWHO\RUJUDYHO\ DIIHFWHGSDUWLFXODUO\LQWKHDUHDEHWZHHQWKHURGV,QSUDFWLFHWKH&%&7XVHUKDV YHU\OLPLWHGSRVVLELOLWLHVWRUHGXFHDUWHIDFWV5HVHDUFKHUVDQGPDQXIDFWXUHUVQHHG WR FRPELQH WKHLU HIIRUWV LQ RSWLPLVLQJ H[SRVXUH IDFWRUV DQG LPSOHPHQWLQJ PHWDO DUWHIDFWUHGXFWLRQDOJRULWKPV % $FXVWRPLVHGGHQWDO&7VRIWZDUHIRUDXWRPDWLFFRUUHFWLRQRISDWLHQW SRVLWLRQLQJHUURUDQGGHWHFWLRQRIMDZPLGOLQH $/R&DVWR*3HWUXFFL3 *DOOR3 3XUSXUD) %DUUHFD*/D7 RQD 3DOHUPR,7DQWRQLRORFDVWR#KRWPDLOFRP 3XUSRVH7 RGHYHORSDGHQWDO&7UHIRUPDWWLQJVRIWZDUHIRUDXWRPDWLFFRUUHFWLRQ RISDWLHQWSRVLWLRQLQJHUURUDQGGHWHFWLRQRIMDZPLGOLQHIRUSDQRUDPLFDQGFURVV VHFWLRQDOUHIRUPDWLRQV ZHUHVOLFHWKLFNQHVVPPDWUL[VL]H[SL[HOVLQSODQHUHVROXWLRQ [[PSL[HODFTXLVLWLRQWLPHPLQSHUSODQH)LQDOO\WKHVSHFLPHQV ZHUHH[DPLQHGKLVWRORJLFDOO\DQGWKHKLVWRORJLFDODQG05,UHVXOWVZHUHFRUUHODWHG 5HVXOWV8OWUDKLJKÀHOG05,DW7 HVODSURYLGHGLPDJHVRIDQDWRPLFDOVWUXFWXUHV RIWKHEXOEDVZHOODVGLIIHUHQWEHQLJQDQGPDOLJQDQWLQWUDRFXODUPDVVHVZLWKKLJK UHVROXWLRQHQDEOLQJUHOLDEOHDVVHVVPHQWRIWXPRXUPRUSKRORJ\DQGH[WHQW6XE VHTXHQWKLVWRORJLFDOH[DPLQDWLRQFRQÀUPHG05,ÀQGLQJVUHJDUGLQJRULJLQLQWHUQDO VWUXFWXUHDQGH[WHQWRIWKHPDVVHV &RQFOXVLRQ7KLVVWXG\GHPRQVWUDWHVWKHSRWHQWLDORI05PLFURVFRS\IRULPDJLQJ VPDOODQDWRPLFDOVWUXFWXUHV7KHÀQGLQJVFRUUHODWHVWURQJO\ZLWKKLVWRORJ\PDNLQJ 05,RIFHQWUDOLPSRUWDQFHLQGHWHUPLQLQJWXPRXUPRUSKRORJ\H[WHQWDQGSRWHQWLDO LQÀOWUDWLRQRIVXUURXQGLQJVWUXFWXUHV7KLVZRUNZDVSHUIRUPHGH[YLYREXWZLWKZLGHU DYDLODELOLW\XOWUDKLJKÀHOG05PLFURVFRS\LVH[SHFWHGWREHFRPHDQHVVHQWLDOWRRO QRWRQO\LQH[SHULPHQWDOVWXGLHVEXWDOVRIRUGDLO\URXWLQH % &RQWUDVWHQKDQFHGXOWUDVRQRJUDSK\&(86XVLQJHDUO\G\QDPLFLQ PLFURFLUFXODWLRQIRUORFDOL]DWLRQRISDWKRORJLFDOSDUDWK\URLGJODQGV ÀUVWOLQHRUFRPSOLPHQWDU\GLDJQRVWLFPRGDOLW\" (0-XQJ$$JKD5HJHQVEXUJ'( 3XUSRVH &RQWUDVWHQKDQFHG XOWUDVRQRJUDSK\ &(86 UHSUHVHQWV D QHZ GLDJ QRVWLFWRROWRORFDOL]HSDWKRORJLFDOSDUDWK\URLGJODQGV7KHDLPRIWKLVVWXG\ZDV WRGLIIHUHQWLDWHWKHFDSDELOLW\RI&(86DVÀUVWOLQHRUFRPSOLPHQWDU\PRGDOLW\IRU WKHGHWHFWLRQRIK\SHUIXQFWLRQLQJSDUDWK\URLGJODQGV 0HWKRGVDQG0DWHULDOVSDWLHQWVZLWKS+37ZHUHDGPLWWHGWRWKH8QLYHUVLW\ +RVSLWDO 5HJHQVEXUJ EHWZHHQ DQG &RQYHQWLRQDO DQG FRQWUDVW HQKDQFHGXOWUDVRQRJUDSK\&(86XVLQJDOLQHDUSUREH0+]/2*,4(*( ZDVSHUIRUPHGLQDOOSDWLHQWVSUHRSHUDWLYHO\7KHVHQVLWLYLW\RI&(86ZDVDQDO\]HG WRGHWHUPLQHLWVSRWHQWLDODVÀUVWOLQHRUFRPSOLPHQWDU\GLDJQRVWLFSURFHGXUH 5HVXOWV8VLQJ&(86RIDOOSDWKRORJLFDOJODQGVFRXOGEHGHWHFWHGLQWKH FRUUHFWTXDGUDQWZKHUHDVFRQYHQWLRQDOXOWUDVRQRJUDSK\SUHYHDOHG OHVV VHQVLWLYLW\ ,Q DOO SDWLHQWV &(86 LQGLFDWHG D FRUUHFW VLGH ORFDOL]DWLRQ RI WKH K\SHUIXQFWLRQLQJ SDUDWK\URLG JODQG7KH DGYDQWDJH RI &(86 ZDV WKH GHWHFWLRQ RI WKH HDUO\ G\QDPLF RQ WKH FDSLOODU\ OHYHO LPPHGLDWHO\ DIWHU FRQWUDVW LQMHFWLRQ 2YHUDOO&(86SHUPLWPLQLPDOO\LQYDVLYHYLGHRDVVLVWHGSDUDWK\URLGHFWRP\LQ SDWLHQWVSDWLHQWVUHTXLUHGFRQYHQWLRQDOSURFHGXUHGXHWRFRQFRPLWDQWJRLWHU $OOSDWLHQWVVKRZHGQRUPDOFDOFLXPDQGSDUDWK\URLGKRUPRQHVHUXPOHYHOVWKUHH PRQWKVDIWHUVXUJHU\ &RQFOXVLRQ&(86UHSUHVHQWVDKLJKO\VHQVLWLYHGLDJQRVWLFPRGDOLW\IRUORFDOL]DWLRQ RISDWKRORJLFSDUDWK\URLGJODQGVLQSDWLHQWVZLWKS+37 1HYHUWKHOHVVLWFDQRQO\ EHUHFRPPHQGHGDVÀUVWOLQHGLDJQRVWLFSURFHGXUHLQVSHFLDOL]HGFOLQLFDOFHQWHUV ZLWKH[SHULHQFHGLQYHVWLJDWRUV % 9HQWLODWLRQLPDJLQJRIWKHSDUDQDVDOVLQXVHVXVLQJ[HQRQHQKDQFHG GXDOHQHUJ\&7 7 5&-RKQVRQ 6) 7KLHPH:0RHOOHU6%HFNHU86FKXVFKQLJ 2(LFNHOEHUJ$'+HOFN0) 5HLVHU0XQLFK'(1HXKHUEHUJ'( *UlIHOILQJ'(7KRUVWHQ-RKQVRQ#PHGXQLPXHQFKHQGH 3XUSRVH7 RVKRZWKHIHDVLELOLW\RIGXDOHQHUJ\&7'(&7DQGG\QDPLFVLQJOH HQHUJ\&7IRUWKHYLVXDOLVDWLRQRIWKHYHQWLODWLRQRIWKHSDUDQDVDOVLQXVHV 0HWKRGVDQG0DWHULDOV)RUDG\QDPLFTXDQWLÀFDWLRQDQGYLVXDOLVDWLRQRIVLQXV YHQWLODWLRQ[HQRQJDVZDVDGPLQLVWHUHGWRDQDVDOFDVWZLWKDODPLQDUÁRZRI/ PLQ5HSHDWHGG\QDPLFVLQJOHHQHUJ\&7PHDVXUHPHQWVRIWKHQDVDOFDYLW\DQG WKHVLQXVHVZHUHSHUIRUPHG7KLVSURFHGXUHZDVUHSHDWHGZLWKSXOVDWLQJ[HQRQ ÁRZ7KH[HQRQUHODWHGHQKDQFHPHQWOHYHOLQWKHGLIIHUHQWFRPSDUWPHQWVRIWKH PRGHOZDVTXDQWLÀHGDQGORFDO[HQRQFRQFHQWUDWLRQVZHUHGHWHUPLQHG $GGLWLRQDOO\ XVLQJ'(&7 &7PHDVXUHPHQWVZHUHSHUIRUPHGERWKGXULQJODPLQDUDQGSXOVDWLQJ [HQRQDGPLQLVWUDWLRQ7KH[HQRQFRQFHQWUDWLRQLQWKHGLIIHUHQWFRPSDUWPHQWVZDV TXDQWLÀHGGLUHFWO\EDVHGRQWKHVSHFWUDOLQIRUPDWLRQ 5HVXOWV1HLWKHUZLWKVLQJOHHQHUJ\&7QRUZLWK'(&7[HQRQUHODWHGHQKDQFH PHQWFRXOGEHGHWHFWHGLQWKHSDUDQDVDOVLQXVHVGXULQJODPLQDUDLUÁRZZKLOHWKH [HQRQFRQFHQWUDWLRQLQWKHQDVDOFDYLW\UHDFKHG8VLQJSXOVDWLQJDLUÁRZ WKHG\QDPLFPHDVXUHPHQWVVKRZHGD[HQRQZDVKLQDQGZDVKRXWLQWKHVLQXVHV WKDWIROORZHGDPRQRH[SRQHQWLDOIXQFWLRQZLWKWLPHFRQVWDQWVRIDIHZVHFRQGV $FFRUGLQJO\'(&7LPDJHVUHYHDOHG[HQRQHQKDQFHPHQWLQWKHVLQXVHVRQO\DIWHU SXOVDWLQJ[HQRQDGPLQLVWUDWLRQ &RQFOXVLRQ'(&7DQGG\QDPLF[HQRQHQKDQFHG&7LPDJLQJGHPRQVWUDWHGWKH VXSHULRULW\RISXOVDWLQJJDVÁRZRYHUODPLQDUÁRZVIRUWKHDGPLQLVWUDWLRQRIJDVRU DHURVROVWRWKHSDUDQDVDOVLQXVHV'(&7ZLWK[HQRQYHQWLODWLRQPD\UHSUHVHQWDQ DWWUDFWLYHRSWLRQIRUWKHUDS\SODQQLQJEHIRUHPHGLFDODHURVROWUHDWPHQWRUVXUJHU\ 6FLHQWLILF6HVVLRQ 6 &$' ( ) *+% (XURSHDQ&RQJUHVVRI 5DGLRORJ\ 5HVXOWV 3DWLHQWV KDG 7 7*DG$'& 6,5V KLJKHU WKDQ KHDOWK\ VXEMHFWV SZLWKVLJQLÀFDQWVLJQDOGHFUHDVHIURPDFWLYHLQDFWLYHGLVHDVHWRKHDOWK\ FRQWUROV H[FHSW RI$'& QRW GLIIHUHQW EHWZHHQ DFWLYHLQDFWLYHJURXSV 7 DQG 7*DG6,5VEXWQRW$'&VKRZHGJRRGFRUUHODWLRQZLWKWKHPXVFOHG\VIXQFWLRQ DQG&$6OHYHOVLQWKHDIIHFWHGVXEMHFWV,QDGGLWLRQ7DQG$'&6,5VRISDWLHQWV QRUPDOO\IXQFWLRQLQJPXVFOHVZHUHVLJQLÀFDQWO\KLJKHUWKDQWKRVHRIKHDOWK\FRQ WUROV$OO6,5VVLJQLÀFDQWO\UHGXFHGLQPXVFOHVWKDWKDGFOLQLFDOLPSURYHPHQWDIWHU WKHUDS\LQWHUHVWLQJO\HYHQLQWKHJURXSRIFOLQLFDOO\VWDEOHIXQFWLRQLQJPXVFOHVD VLJQLÀFDQWUHGXFWLRQLQ05,SDUDPHWHUVZDVGHWHFWHGRYHUWLPH &RQFOXVLRQ05,VKRZVHYHQFOLQLFDOO\VLOHQWPXVFOHLQYROYHPHQWDQGFRXOGEH PRUHVHQVLWLYHWKDQRSKWKDOPRORJLFVFRUHVWRFKDQJHVLQPXVFOHLQYROYHPHQW % (YDOXDWLRQRIDFKDQQHOYHUVXVDFKDQQHOKHDGFRLOIRU05, GLDJQRVWLFVLQJLDQWFHOODUWHULWLV 3 $)UDQNH 00DUNO6+HLQ]HOPDQQ3 9DLWK0/DQJHU-*HLJHU )UHLEXUJ'(&KLFDJR,/86SKLOLSSIUDQNH#XQLNOLQLNIUHLEXUJGH 3XUSRVH7 RHYDOXDWHWKHGLDJQRVWLFYDOXHRIDFKDQQHOKHDGFRLOLQFRPSDULVRQ ZLWKDFKDQQHOFRLOIRUHYDOXDWLRQRIVXSHUÀFLDOFUDQLDODUWHULHVҋLQÁDPPDWLRQLQ SDWLHQWVZLWKJLDQWFHOODUWHULWLV*&$ 0HWKRGVDQG0DWHULDOVSDWLHQWVZLWKVXVSHFWHG*&$XQGHUZHQW705, SDWLHQWVZHUHH[DPLQHGZLWKDFKDQQHOKHDGFRLOÀUVWDQGDFKDQQHOKHDG FRLOVHFRQGSDWLHQWVLQWKHRWKHUFRLORUGHU7ZHLJKWHGSRVWFRQWUDVWLPDJHV ZHUHHYDOXDWHGE\WZREOLQGHGUHDGHUVUHJDUGLQJLPDJHJUDGLQJDUWHIDFWOHYHODQG DUWHULHVҋLQÁDPPDWLRQ615PHDVXUHPHQWVZHUHSHUIRUPHGIRUERWKFRLOVLQWKH EUDLQVWHPWKHFHUHEHOOXPDQGWKHJDOHDOWLVVXH,QWHUREVHUYHUDJUHHPHQWZDV PHDVXUHGZLWKWKH&RKHQѣWHVW&RPSDULVRQEHWZHHQWKHWZRFRLOVZDVFDOFXODWHG ZLWK:LOFR[RQUDQNWHVWDQGWWHVW6LJQLÀFDQWOHYHOVZHUHS 5HVXOWV %RWK FRLOV LGHQWLÀHG DUWHULHVҋ LQÁDPPDWLRQ UHOLDEO\ WKH LQWHUREVHUYHU DJUHHPHQWZDVH[FHOOHQWѣ IRUFKDQQHOFRLOѣ IRUFKDQQHOFRLO :HREWDLQHGDVWDWLVWLFDOO\VLJQLÀFDQWKLJKHU615SZLWKWKHFKDQQHOFRLO LQGHSHQGHQWO\RIWKHFRLORUGHU,PDJHJUDGLQJDQGDUWHIDFWOHYHOZHUHVLJQLÀFDQWO\ KLJKHUZLWKWKHFKDQQHOFRLOLQHLWKHUH[DPLQDWLRQRUGHU5HJDUGLQJWKHLPDJH JUDGLQJWKHLQWHUREVHUYHUYDULDELOLW\ZDVPRGHUDWHѣ IRUWKHFKDQQHO FRLODQGVXEVWDQWLDOѣ IRUWKHFKDQQHOFRLO &RQFOXVLRQ7KHFKDQQHOKHDGFRLOLVVXSHULRUWRWKHFKDQQHOFRLOLQGHSLFWLQJ WKHVXSHUÀFLDOFUDQLDODUWHULHVDQGLQJHQHUDOLPDJHTXDOLW\EHFDXVHRIDKLJKHU 615ZKLFKLVLQGHSHQGHQWRIFRLORUGHUDQGGHOD\RIYHVVHOVҋFRQWUDVWHQKDQFH PHQW)RU*&$GLDJQRVLVKRZHYHUWKHFKDQQHOFRLOVHHPVWREHVXIÀFLHQW % &RPSDULVRQRIWUXHUHDOWLPH05LPDJLQJZLWKUDGLDONVSDFH VDPSOLQJWRYLGHRÁXRURVFRS\H[DPVLQWKHIROORZXSHYDOXDWLRQRI YHORSKDU\QJHDOG\VIXQFWLRQWUHDWHGE\VXUJHU\ 0&/DUVRQ 0-.HUO5:%DXHU7 %ORFN6=KDQJ5+DPPHUVWLQJO 6=DQJRV7 -9RJO0*0DFN)UDQNIXUWDP0DLQ'((UODQJHQ'( *|WWLQJHQ'(PD\FULVVODUVRQ#ZHEGH 3XUSRVH9HORSKDU\QJHDOG\VIXQFWLRQFDQKDYHPDQ\FDXVHVDQGLVRIWHQWUHDWHG E\ VXUJHU\$IWHU VXUJHU\ WKH UHVXOWLQJ LPSURYHG FORVXUH RI WKH YHORSKDU\QJHDO SRUWGXULQJVSHDNLQJDQGVZDOORZLQJLVWKHPDQRHXYUHRILQWHUHVWZKLFKLVXVXDOO\ PRQLWRUHGE\YLGHRÁXRURVFRS\7KHDLPRIRXUVWXG\ZDVWRVKRZWKDWUDSLG05, SURWRFROVXVLQJHTXDOWHPSRUDOUHVROXWLRQWRÁXRURVFRS\+]LVDVDFFXUDWHDV YLGHRÁXRUVFRS\ZLWKRXWH[SRVXUHWR[UD\V 0HWKRGVDQG0DWHULDOV:LWKWKHDSSURYDORIRXULQVWLWXWLRQDOUHYLHZERDUG SDWLHQWVPDOHVPHDQDJH\HDUVXQGHUZHQW705IXQFWLRQDOLPDJLQJ DQG YLGHRÁXRURVFRS\ H[DPV 2XU DSSURDFK FRQFHUQLQJ WKH 05, VFDQ SURWRFRO ZDV WR XVH D IDVW ORZDQJOH VKRW )/$6+ JUDGLHQWHFKR VHTXHQFH ZLWK UDGLDO NVSDFHVDPSOLQJDQGVOLGLQJZLQGRZUHFRQVWUXFWLRQVXEIUDPHVIRUDFKLHYLQJ DQLPDJHXSGDWHUDWHRI+]IUDPHVSHUVHFRQG6DJLWWDOYLHZVZLWKPP VODEVZHUHREWDLQHGGXULQJVSHHFKZLWKD7(RIPVD75RIPVDÁLS DQJOHRIDQGDPDWUL[VL]HRISL[HOV7KHFORVXUHRIWKHYHORSKDU\QJHDO SRUWGXULQJVSHDNLQJZDVFRPSDUHGE\UDGLRORJLVWVLQERWKGLDJQRVWLFPHWKRGV 5HVXOWV7KHREWDLQHGUHDOWLPH05FLQHPDWLFVZHUHHTXDOWRWKHYLGHRÁXRURVFRSLF LPDJHVWRHYDOXDWHWKHFORVXUHRIWKHYHORSKDU\QJHDOSRUWGXULQJVSHHFKWRDV VHVVWKHSRVWRSHUDWLYHUHVXOWV%RWKUDGLRORJLVWVUDWHGWKHRYHUDOOLPDJHTXDOLW\LQ FRQVHQVXVDVGLDJQRVWLF &RQFOXVLRQ)XQFWLRQDO05,LVWRFRQVLGHUHTXDOWRÁXRURVFRSLFLPDJLQJLQWKH HYDOXDWLRQRIWKHFORVXUHRIWKHYHORSKDU\QJHDOSRUWGXULQJSRVWRSHUDWLYHIROORZXS H[DPVZLWKRXWH[SRVXUHWR[UD\V 0HWKRGVDQG0DWHULDOV $[LDO&7LPDJHVRIWKHMDZVIURPDYROXPHWULFDFTXLVLWLRQ ZHUHHODERUDWHGE\DVRIWZDUHGHYHORSHGLQ0DWODEODQJXDJH7 RFRUUHFWSDWLHQW SRVLWLRQLQJHUURUVURWDWLRQVZHUHDVVLJQHGWRWKHYR[HOFRRUGLQDWHVLQRUGHUWR GLVSRVHWKHYR[HOUHODWLYHWRWKHVDJLWWDOSODQHSDUDOOHOWRWKHD[LDOSODQH7KLVLV DFFRPSOLVKHGXVLQJWKHFKDUDFWHULVWLFVRIV\PPHWU\RIWKHMDZVZLWKUHVSHFWWRWKH VDJLWWDOSODQHDOORZLQJWRGHWHUPLQHWKHFHQWUDOLQHUWLDOD[HVRIWKHMDZVWRLGHQWLI\ WKHVDJLWWDOSODQHDQGGHWHUPLQHWKHURWDWLRQDQJOHVWREHDVVLJQHGWRWKHYR[HOV 2QFHWKHSRVLWLRQLQJFRUUHFWLRQLVGRQHWKHRSWLPDOMDZPLGOLQHLVDXWRPDWLFDOO\ WUDFHGGLYLGLQJLQSDUWVDQD[LDOUHIHUUDOUHIRUPDWWHGLPDJHWRLGHQWLI\WKHPLGOLQH HTXDWLRQE\WKHRUGLQDU\OHDVWVTXDUHVPHWKRG7KHQSDQRUDPLFUHIRUPDWWHGDORQJ WKHFHQWUDOLQHUWLDOD[HVRIDOOFURVVVHFWLRQDOLPDJHVRIWKHMDZDQGFURVVVHFWLRQDO LPDJHVDUHDXWRPDWLFDOO\JHQHUDWHG 5HVXOWV7KHSDQRUDPLFDQGFURVVVHFWLRQDOUHIRUPDWWHGLPDJHVREWDLQHGZHUH MXGJHGRIJRRGTXDOLW\E\UDGLRORJLVWVZKRFRPSDUHWKHUHIRUPDWLRQVREWDLQHG ZLWKWKRVHRQHVWKH\REWDLQHGPDQXDOO\ZLWKDFRPPHUFLDOO\DYDLODEOHGHQWDO&7 UHIRUPDWWLQJVRIWZDUH &RQFOXVLRQ$QXVHIXOWRROZDVGHYHORSHGWRRYHUFRPHSDWLHQWSRVLWLRQLQJHUURUV DQGFXWWLPHFRQVXPLQJSURFHGXUHRIPDQXDOO\WUDFLQJWKHMDZPLGOLQHIRUSDQRUDPLF DQGFURVVVHFWLRQDOUHIRUPDWLRQV % 3(7&7DQG3(705LPDJHTXDOLW\LQWKHSUHVHQFHRIGHQWDOLPSODQWV 0.:HUQHU-:LHJDQG-.XSIHUVFKODHJHU&/RLV,%H]UXNRY +6FKPLGW&3IDQQHQEHUJ16FKZHQ]HU7 %H\HU7ELQJHQ'( 6DQWLDJRGH&RPSRVWHOD(60DWWKLDV:HUQHU#PHGXQLWXHELQJHQGH 3XUSRVH&RPELQHG3(705LPDJLQJKDVWKHSRWHQWLDOWRSURYLGHGLDJQRVWLFLP DJHTXDOLW\RIDQDWRPLFDOUHJLRQVDGMDFHQWWRGHQWDOLPSODQWVZKLFKFDXVHLQWHQVH DUWHIDFWVLQ3(7&7DQGRIWHQKDQGLFDSSURSHUGLDJQRVLV:HHYDOXDWHG3(705 IRUKHDGDQGQHFNLPDJLQJXVLQJDGHQWDOSKDQWRPDQGSDWLHQWLPDJHV 0HWKRGVDQG0DWHULDOV7KHSKDQWRPÀOOHGZLWKXQLIRUPEDFNJURXQGFRQWDLQHG UHDOKXPDQWHHWKVRPHZLWKGHQWDOLPSODQWVDQGRQHWRRWKJDSLQDSODVWLFFDUULHU UHVHPEOLQJWKHMDZV3KDQWRPVFDQVZHUHSHUIRUPHGRQDFOLQLFDO3(7&7%LR JUDSK+L5H]DQGLQWHJUDWHGZKROHERG\3(705%LRJUDSKP056LHPHQV ,PDJHVZHUHUHFRQVWUXFWHGZLWKDQGZLWKRXW&7DQG058OWUDVKRUW(FKR7LPH 87(EDVHGDWWHQXDWLRQFRUUHFWLRQ$&3KDQWRPGDWDDQGÀYHSDWLHQWGDWDVHWV IURPERWK3(7&7DQG3(705ZHUHHYDOXDWHGYLVXDOO\DQGTXDQWLWDWLYHO\52, EDVHGDQDO\VLV 5HVXOWV05EDVHGDWWHQXDWLRQFRUUHFWLRQXVLQJ87(VHTXHQFHV\LHOGHGVLJQLÀFDQW LQKRPRJHQHLWLHVLQ05LPDJHVDQGFRQVHTXHQWO\ELDVHGPDSVZLWKHUURQHRXV DVVLJQPHQWRIYR[HOVWRWLVVXHHOHFWURQGHQVLWLHV$QHQODUJHGSKRWRSHQLFDUHD DURXQGWKHORFDWLRQRIWKHLPSODQWVZDVGHWHFWDEOHLQ3(705UHJDUGOHVVRISULRU $&7KHUHZHUHQRDGGLWLRQDODUWHIDFWVDIWHU$&HYHQZLWKKDPSHUHGPDSV,Q FRQWUDVWVHYHUHVWUHDNLQJDUWHIDFWVLQ&7LPDJHVWUDQVODWHGLQWRQRQXQLIRUP3(7 LPDJHVLQ3(7&7DIWHU $&RQO\PLOGSKRWRSHQLDZLWKRXW $&7KHDQDO\VLVRI3(7 05 SDWLHQW LPDJHV UHYHDOHG D VLJQLÀFDQWO\ LPSURYHG YLVXDOLVDWLRQ RI VWUXFWXUHV VXFKDVWKHÁRRURIWKHPRXWKDQGWKHVXEPDQGLEXODUUHJLRQVXVXDOO\DIIHFWHGE\ 3(7&7DUWHIDFWV &RQFOXVLRQ&RPELQHG3(705KHDGDQGQHFNLPDJLQJSURPLVHVLPSURYHGYLV LELOLW\DQGGLDJQRVLVIRUVWUXFWXUHVDGMDFHQWWRGHQWDOLPSODQWVFRPSDUHGWR3(7&7 % 0DJQHWLFUHVRQDQFHSDUDPHWHUVDQGFOLQLFDOVFRUHVLQWK\URLG DVVRFLDWHGRUELWRSDWK\ZKLFKRQHWRWUXVWIRUWKHH[WUDRFXODU PXVFOHVHYDOXDWLRQ" &*RGL6%LDQFKL0DU]ROL*&DPPDUDWD$$PEURVL$)DOLQL*6FRWWL /63ROLWL0LODQ,7FODXGLDJRGL#FROOHJLRGLPLODQRLW 3XUSRVH7 RÀQGWKHPDJQHWLFUHVRQDQFHLPDJLQJ05,SDUDPHWHUEHVWUHSUH VHQWLQJH[WUDRFXODUPXVFOHVG\VIXQFWLRQDQGGLVHDVHDFWLYLW\LQWK\URLGDVVRFLDWHG RUELWRSDWK\7$2WRFRPSDUHEDVHOLQHDQGIROORZXSFOLQLFDODQG05,PHDVXUHV RI7$2SDWLHQWV 0HWKRGV DQG 0DWHULDOV SDWLHQWV ZLWK 7$2 XQGHUZHQW 05, ZLWK 763,5 SRVWJDGROLQLXP763,57*DGDQG':,E VHTXHQFHVIROORZLQJRSK WKDOPRORJLF HYDOXDWLRQ$FFRUGLQJ WR WKH &OLQLFDO$FWLYLW\ 6FRUH &$6 SDWLHQWV ZHUHGLYLGHGLQWRLQDFWLYH&$6RUDFWLYHGLVHDVH $IXQFWLRQDOVFRUH QRUPDO VHYHUHLPSDLUPHQWZDVDVVLJQHGWRHYHU\UHFWXVPXVFOH6LJQDOLQWHQVLWLHVDQG DSSDUHQWGLIIXVLRQFRHIÀFLHQW$'&PHDVXUHGRQDOOUHFWLPXVFOHVDQGQRUPDOLVHG WRWKDODPXV6,5VZHUHFRPSDUHGZLWKWKRVHIURPKHDOWK\VXEMHFWVDQGZLWK 3DWLHQWV FOLQLFDOVFRUHV7KHGDWDDIWHULQWUDYHQRXVVWHURLGWUHDWPHQWZHUHDYDLO DEOHIRUSDWLHQWV0DQQ:KLWQH\:LOFR[RQ6LJQHG5DQN7 HVWDQG6SHDUPDQ FRUUHODWLRQZHUHDSSOLHG 6FLHQWLILF6HVVLRQ $ 6&'()*+%(XURSHDQ&RQJUHVVRI 5DGLRORJ\ 0RQGD\ % &KDUDFWHULVDWLRQRIIRFDOOLYHUOHVLRQZLWKTXDQWLWDWLYHWHFKQLTXHV FRPSDULVRQRIDSSDUHQWGLIIXVLRQFRHIÀFLHQWYDOXHVDQG7 UHOD[DWLRQWLPHV $&LHV]DQRZVNL$*URG]LFND:6]HV]NRZVNL%.DF]\QVNL(0DM %*RUQLFND0*URG]LFNL0.UDZF]\N25RZLQVNL:DUVDZ3/ DQGU]HMFLHV]DQRZVNL#ZXPHGXSO 3XUSRVH7 RFRPSDUHHIÀFDF\RIWZRTXDQWLWDWLYHPHWKRGVIRUGLVFULPLQDWLRQEH WZHHQEHQLJQDQGPDOLJQDQWIRFDOOLYHUOHVLRQV)//VDSSDUHQWGLIIXVLRQFRHIÀFLHQW $'&YDOXHVDQG7UHOD[DWLRQWLPHV 0HWKRGVDQG0DWHULDOV6HYHQW\WKUHHSDWLHQWVZLWKFRQÀUPHG)//VLQFOXGLQJ EHQLJQF\VWVKDHPDQJLRPDV)1+VDEVFHVVHVF\VWDGHQRPD DQG PDOLJQDQW PHWDVWDVHV +&&V KDHPDQJLRHQGRWKHOLRPDV &&$VF\VWDGHQRFDUFLQRPDXQGHUZHQW705,ZLWKUHVSLUDWRU\WULJJHUHGVLQ JOHVKRW6(':,E DQGGXDOHFKR776(75 PV7( PV 7( PV$'&YDOXHVDQG7UHOD[DWLRQWLPHVRI)//VZHUHFDOFXODWHGDQG WKHQRSWLPDOWKUHVKROGYDOXHVDQGDFFXUDFLHVIRUHDFKPHWKRGZHUHDVVHVVHG 5HVXOWV)ROORZLQJPHDQ$'&YDOXHVZHUHREWDLQHGIRUDOOW\SHVRI)//VF\VWV [PPVKDHPDQJLRPDV[PPVDEVFHVVHV[PPV )1+V [ PPV F\VWDGHQRPD [ PPV PHWDVWDVHV [ PPV+&&V[PPVKDHPDQJLRHQGRWKHOLRPDV[PPV &&$V [ PPV F\VWDGHQRFDUFLQRPD [ PPV :LWKWKH XVH RIRSWLPDOWKUHVKROGYDOXHRIPPVVHQVLWLYLW\IRUGLDJQRVLVRIEHQLJQ OHVLRQ ZDV VSHFLÀFLW\ DFFXUDF\ 339 139 )ROORZLQJ PHDQ 7 WLPHV ZHUH FDOFXODWHG F\VWV PV KDHPDQJLRPDV PV DEVFHVVHV PV )1+V PV F\VWDGHQRPD PV PHWDVWDVHVPV+&&VPVKDHPDQJLRHQGRWKHOLRPDVPV&&$V PVF\VWDGHQRFDUFLQRPDPV$WWKHWKUHVKROGRIPVVHQVLWLYLW\ IRUWKHGLDJQRVLVRIEHQLJQOHVLRQZDVVSHFLÀFLW\DFFXUDF\ 339139 &RQFOXVLRQ7KHGLIIHUHQFHEHWZHHQVHQVLWLYLWLHVIRUWKHGLDJQRVLVRIEHQLJQOHVLRQ ZDVQRWVWDWLVWLFDOO\VLJQLÀFDQWEHWZHHQERWKTXDQWLWDWLYHWHFKQLTXHVZKHUHDVWKH DQDO\VLVRI7UHOD[DWLRQWLPHV\LHOGHGVLJQLÀFDQWO\EHWWHUVSHFLÀFLW\WKDQ $'&YDOXHV % 6HQVLELOLW\DQGVSHFLÀFLW\RI':,UHODWHGSDUDPHWHUVDSSDUHQW GLIIXVLRQFRHIÀFLHQW$'&GLIIXVLRQFRHIÀFLHQW'DQGSHUIXVLRQ IUDFWLRQ3)LQGLVWLQJXLVKLQJDPRQJEHQLJQDQGPDOLJQDQWIRFDO OLYHUOHVLRQV)OOV ) 5HJLQL ) 3DVTXLQHOOL&1DUGL/0D]]RQL*%HOOL6&RODJUDQGH )ORUHQFH,7$UH]]R,7 3XUSRVH$ZRUNÁRZDFTXLVLWLRQDQGVDPSOLQJPHWKRGVTXDQWLWDWLYHDQDO\VLV OHVVVLWHGHSHQGHQWDVSRVVLEOHLVSURSRVHGWRGHWHUPLQHWKHFRPELQDWLRQRI':, SDUDPHWHUVWKDWPD[LPLVHVVHQVLWLYLW\DQGVSHFLÀFLW\LQGLIIHUHQWLDWLQJEHQLJQDQG PDOLJQDQW)OOV 0HWKRGVDQG0DWHULDOVSDWLHQWVZLWKNQRZQ)OOKDHPDQJLRPDV)1+ PHWDVWDVLVXQGHUZHQWIUHHEUHDWK05'Z,EYDOXHVVWHSRIV PP 7ZR 52,V ZHUH GHÀQHG LQFOXGLQJ WKH )OO DQG D SDUW RI WKH VXUURXQGLQJ SDUHQFK\PDUHVSHFWLYHO\$'&3)DQG'ZHUHHVWLPDWHGLQWKH)OO$'&O3)O 'ODQGLQWKHVXUURXQGLQJSDUHQFK\PDWKHUDWLRVEHWZHHQ)OODQGSDUHQFK\PD YDOXHVZHUHFDOFXODWHG$'&U3)U'U7WHVWDQG52&DQDO\VLVZHUHSHUIRUPHG WR LGHQWLI\ WKH EHVW VHW RI 'Z,UHODWHG SDUDPHWHUV LQ GLVWLQJXLVKLQJ EHQLJQ DQG PDOLJQDQW)OOVVLJQLÀFDQFHWKUHVKROGS 5HVXOWV 7WHVW VKRZHG VLJQLÀFDQW GLIIHUHQFHV EHWZHHQ EHQLJQ DQG PDOLJQDQW )OOVYDOXHVIRU$'&O3)O'O$'&UDQG'UPRUHSURQRXQFHGIRU$'&O YVSYDOXHDQG$'&UYVS 6HQVLWLYLWLHVZLWKFRQÀGHQFHLQWHUYDO&,RI$'&ODQG$'&UFRUUHVSRQGLQJ WRDVSHFLÀFLW\RIZHUH$'&O ÃPPVDQG $'&U &RQFOXVLRQ5HVXOWVLQGLIIHUHQWLDWLQJ)OOVZLWK'Z,DUHHQFRXUDJLQJYHU\ORZS YDOXHVEXWWKH&,VRI$'&ODQG$'&UVHQVLWLYLW\HVWLPDWLRQVDUHVWLOOWRRZLGHD ODUJHUFRKRUWRI)OOVVKRXOGEHHYDOXDWHGSRVVLEO\ZLWKPXOWLFHQWULFVWXGLHVJLYHQ WKHORZGHSHQGHQF\RQWKHVLWHRIWKHZRUNÁRZSURSRVHG 5RRP,. $EGRPLQDO9LVFHUD 66 05,RIIRFDOOLYHUOHVLRQV 0RGHUDWRUV 6%RKDWD%UQR&= 3+XSSHUW'DUPVWDGW'( % 'LIIXVLRQZHLJKWHGLPDJLQJRIIRFDOOLYHUOHVLRQVOHVLRQVL]HDQG LPDJHWHFKQLTXHXVHGKDYHVLJQLÀFDQWLQÁXHQFHRQGLDJQRVWLF SHUIRUPDQFH 3 $7 %DOW]HU -6FKHOKRUQ0%HQQGRUI:$.DLVHU0'LHW]HO-HQD'( :HLPDU'(SDVFDOEDOW]HU#PHGXQLMHQDGH 3XUSRVH7 RFRPSDUHGLDJQRVWLFSHUIRUPDQFHRIWZRFRPPRQO\DYDLODEOHGLIIXVLRQ ZHLJKWHGLPDJLQJ':,WHFKQLTXHVIRUGHWHFWLRQDQGGLIIHUHQWLDWLRQRIIRFDOOLYHU OHVLRQV)//VXVSHFWIRUPHWDVWDVHV 0HWKRGV DQG 0DWHULDOV 7KLV UHWURVSHFWLYH FURVVVHFWLRQDO VWXG\ LQYHVWLJDWHG FRQVHFXWLYHSDWLHQWVZLWKVXVSHFWHGOLYHUPHWDVWDVHV$OOSDWLHQWVXQGHUZHQW*G (2%'73$HQKDQFHGOLYHU05,LQFOXGLQJWZRGLIIHUHQW':,WHFKQLTXHVDVSHFWUDOO\ IDWVDWXUDWHGEUHDWKKROG(3,VHTXHQFH':,EKWLPHRIDFTXLVLWLRQ7$PLQ DQGDIUHHEUHDWKLQJVSHFWUDOO\IDWVDWXUDWHG(3,VHTXHQFH':,IE7$PLQ ':, LPDJHV ZHUH DQDO\VHG E\ WZR UHDGHUV LQ FRQVHQVXV ,Q LGHQWLÀHG OHVLRQV VLJQDOLQWHQVLWLHV6,DWORZHVWDQGKLJKHVWEYDOXHVZHUHPHDVXUHGXVLQJDXVHU GHÀQHGUHJLRQRILQWHUHVW6XEVHTXHQWO\FDOFXODWHGDSSDUHQWGLIIXVLRQFRHIÀFLHQW $'&YDOXHVZHUHDQDO\VHGE\UHFHLYHURSHUDWLQJFKDUDFWHULVWLFV52&DQDO\VLV 7KHUHIHUHQFHVWDQGDUGLQFOXGHGKLVWRSDWKRORJ\DQGIROORZXSH[DPLQDWLRQV 5HVXOWVRILQFOXGHGSDWLHQWVSUHVHQWHGZLWK)//EHQLJQPD OLJQDQW2IWKHVH':,IEGHWHFWHGVLJQLÀFDQWO\PRUHPDOLJQDQWOHVLRQVFRPSDUHG WR':,EK3 /HVLRQVL]HPPZDVVLJQLÀFDQWO\DVVRFLDWHGZLWK)// PLVVHGE\':,EK3 EXWQRWZLWK':,IE3 52&DQDO\VLVUHYHDOHG DVLJQLÀFDQWO\KLJKHUDUHDXQGHUWKH52&FXUYHIRU$'&YDOXHVRI':,IE FRPSDUHGWR':,EK3 &RQFOXVLRQ'XHWRDKLJKHUOHVLRQGHWHFWLRQUDWH':,IESHUIRUPHGEHWWHUWKDQ ':,EK+RZHYHUERWK':,WHFKQLTXHVGLGQRWGHSLFWDOOPDOLJQDQW)//7KLVÀQGLQJ DQGRYHUODSVEHWZHHQEHQLJQDQGPDOLJQDQWOHVLRQVOLPLWVWKHDSSOLFDELOLW\RIWKHVH WHFKQLTXHVDVDVWDQGDORQHGLDJQRVWLFWRROLQLPDJLQJRIKHSDWLF)// % )RFDOOLYHUOHVLRQVLQWKHULJKWDQGOHIWKHSDWLFOREHVRQGLIIXVLRQ ZHLJKWHG05LPDJLQJLVWKHUHDGLIIHUHQFH" &6FKPLG7 DQQZDOG) 'DKL< -LDQJ,6HWKL$2WR&KLFDJR,/86 FKULVWLQHVFKPLGWDQQZDOG#PHGXQLPXHQFKHQGH 3XUSRVH7 RGHWHUPLQHSRVVLEOHGLIIHUHQFHVEHWZHHQ$'&YDOXHVRIEHQLJQDQG PDOLJQDQW)//VDQGQRUPDOOLYHUSDUHQFK\PDLQWKHOHIWYVULJKWKHSDWLFOREHV 0HWKRGV DQG 0DWHULDOV7KLUW\VL[ SDWLHQWV PDOHV IHPDOHV PHDQ DJH \HDUVZLWK)//VRIWKHVDPHDHWLRORJ\LQERWKWKHOHIWDQGULJKWOREHVRIWKH OLYHUSDWLHQWVZLWKEHQLJQ)//VDQGSDWLHQWVZLWKPDOLJQDQW)//V ZKRXQGHUZHQW705,LQFOXGLQJ':05,EYDOXHVRIDQGPPòVZHUH LQFOXGHGLQWKLV+,3$$FRPSOLDQWDQG,5%DSSURYHGVWXG\$'&YDOXHVRIQRUPDO OLYHUSDUHQFK\PDDQG)//VLQHDFKKHSDWLFOREHZHUHFDOFXODWHGDQGFRPSDUHG XVLQJ6WXGHQWҋVWWHVWIRUSDLUHGGDWD 5HVXOWV $'&YDOXHVRIQRUPDOOLYHUSDUHQFK\PDEHQLJQ)//VDQGPDOLJQDQW)//V ZHUHVLJQLÀFDQWO\KLJKHUSS DQGS UHVSHFWLYHO\LQWKHOHIW KHSDWLFOREH[[DQG[PPòVUHVSHFWLYHO\WKDQLQ WKHULJKWKHSDWLFOREH[[DQG[PPòVUHVSHFWLYHO\ &RQFOXVLRQ$'&YDOXHVRIEHQLJQDQGPDOLJQDQW)//VDQGQRUPDOOLYHUSDUHQ FK\PD DUH VLJQLÀFDQWO\ KLJKHU LQ WKH OHIW KHSDWLF OREH FRPSDUHG ZLWK WKH ULJKW KHSDWLFOREH7KLVLVOLNHO\GXHWRFDUGLDFPRWLRQDQGPD\OLPLWWKHUHOLDELOLW\DQG UHSURGXFLELOLW\RI)// $'&YDOXHHVWLPDWHVDQGWKHFOLQLFDOXVHIXOQHVVRIQRQFDUGLDF JDWHG':05,LQFKDUDFWHULVLQJ)//V 6FLHQWLILF6HVVLRQ 6 &$' ( ) *+% (XURSHDQ&RQJUHVVRI 5DGLRORJ\ 0HWKRGVDQG0DWHULDOV7ZRUDGLRORJLVWVLQFRQVHQVXVUHWURVSHFWLYHO\DVVHVVHG DVEHQLJQRUPDOLJQDQW)//VRQSDWLHQWVH[DPLQHGRQD7 7ZRGLIIHUHQW PHWKRGVZHUHXVHGLQVHSDUDWHUHDGLQJVHVVLRQVDYLVXDODQDO\VLVRIVLJQDOLQWHQ VLW\RQ':,LPDJHVDWE VHFPPDQG $'&PDSEOHVLRQ $'&PHDVXUHPHQW RQWKH $'&PDS)//VVKRZLQJDVLJQDOLQWHQVLW\SDWWHUQRIUHVWULFWHGGLIIXVLRQZHUH DVVHVVHGDVPDOLJQDQW/HVLRQVLQFOXGHGPHWDVWDVHVQ KHSDWRFDUFLQRPDV +&&Q G\VSODVWLFQRGXOHVQ IRFDOQRGXODUK\SHUSODVLDVRUKHSDWRFHO OXODUDGHQRPDV)1++$Q DQGDW\SLFDOKDHPDQJLRPDQ DVFRQÀUPHG E\KLVWRORJ\7$&(RU\HDUIROORZXS$UHFHLYHURSHUDWLQJFKDUDFWHULVWLF52& DQDO\VLV ZDV SHUIRUPHG WR GHWHUPLQH WKH VHQVLWLYLW\ DQG WR HVWDEOLVK DQ$'& WKUHVKROGIRUPDOLJQDQF\ 5HVXOWV 7KH RYHUDOO VHQVLWLYLW\ IRU PDOLJQDQF\ ZDV &, IRU 9$ DQG &, IRU$'&4 WKUHVKROG [ PP VHF$FFRUGLQJWRVWUDWLÀHGDQDO\VLV9$DQG$'&4VKRZHGDVHQVLWLYLW\RI &,DQG&,IRU+&&DQG&, DQG&,IRUPHWDVWDVHVUHVSHFWLYHO\$ODUJH RYHUODSLQ$'&DQG9$IHDWXUHVZDVIRXQGEHWZHHQEHQLJQDQGPDOLJQDQW)//V &RQFOXVLRQ$OWKRXJKWKHRYHUDOOVHQVLWLYLW\LVORZ$'&4VKRXOGEHSUHIHUUHG WR9$LQDVVHVVLQJ)//VHVSHFLDOO\+&&+RZHYHU9$LVPRUHVHQVLWLYHWKDQ $'&4IRUPHWDVWDVHV7KH7VKLQHWKURXJKSKHQRPHQRQZDVK\SRWKHVLVHGWR FDXVHWKLVGLVFUHSDQF\E\DIIHFWLQJWKH9$RI+&& % ,VZKLWHEORRGPLQSKDVHLQG\QDPLFOLYHU05,XVLQJ KHSDWRELOLDU\FRQWUDVWDJHQW*G(2%'73$UHDOO\XVHOHVV FRPSDUHGZLWKEODFNEORRGPLQSKDVH"$SUHOLPLQDU\VWXG\ 6.LP&/HH6&KRL..LP-&KRL&3DUN-/HH< 3DUN6HRXO.5 FKOHH #NRUHDDFNU 3XUSRVH7 RGHWHUPLQHWKHYDOXHRIZKLWHEORRGPLQSKDVH:%3IRUGHWHFWLRQ RIKHSDWLFPHWDVWDVLVE\FRPSDULQJZLWKEODFNEORRGPLQSKDVH%%3RIOLYHU 05,XVLQJ*G(2%'73$ 0HWKRGVDQG0DWHULDOV'XULQJ0DUFKWR)HEUXDU\SDWLHQWV PHQ ZRPHQ DJH a \HDUV ZLWK H[WUDKHSDWLF PDOLJQDQW WXPRXUV DQG OLYHU PHWDVWDVLV KDYH XQGHUJRQH OLYHU 05, 7KUHH UDGLRORJLVWV EOLQG WR SULPDU\ WXPRXUQXPEHUDQGORFDWLRQRIOLYHUOHVLRQVUHYLHZHG05,RISDWLHQWVWZLFH ZLWKDQLQWHUYDORIDWOHDVWWZRZHHNV'HWHFWLRQUDWHEHWZHHQ:%3DQG%%3 DQG LQWHUREVHUYHUYDULDELOLW\ZDVDOVRHYDOXDWHG 5HVXOWV$PRQJKHSDWLFPHWDVWDWLFQRGXOHVQRGXOHVLQSDWLHQWVZHUH FRQÀUPHGSDWKRORJLFDOO\DQGRWKHUQRGXOHVZHUHFRQVLGHUHGDVPHWDVWDVLVDIWHU UHYLHZRIIROORZXS&7RU05,6HQVLWLYLW\RI:%3DQG%%3ZDV DQGDQGDQGIRUWKUHHREVHUYHUVUHVSHFWLYHO\7KHUH ZDVQRVLJQLÀFDQWGLIIHUHQFHEHWZHHQGHWHFWLRQUDWHRIWZRSKDVHVLQDOORIWKUHH REVHUYHUV3 DQG$YHUDJHVHQVLWLYLW\ZDVLQ:%3 DQG LQ %%3 DQG QR VLJQLÀFDQW GLIIHUHQFH ZDV IRXQG 3 ,QWHUREVHUYHU DJUHHPHQWZDVJRRGRUH[FHOOHQWѣ DQGLQ:%3 DQG DQGLQ%%30RVWQRGXOHVPLVVHGLQ:%3DSSHDUHGLVRLQWHQVHWR OLYHUSDUHQFK\PD2QHQRGXOHIRXQGRQO\LQ:%3E\DOOREVHUYHUVZDVVPDOOPP DQGDGMDFHQWWREORRGYHVVHOV &RQFOXVLRQ:%3LQOLYHU05,LVQHYHULQIHULRUWR%%3LQWKHGHWHFWLRQRIKHSDWLF PHWDVWDVLVDQGPD\EHHYHQVXSHULRUIRUVPDOOQRGXOHVDGMDFHQWWREORRGYHVVHOV EHFDXVHRILWVZKLWHEORRGHIIHFW % +RZXVHIXOLVDTXDQWLÀHGDQDO\VLVRIKHSDWRELOLDU\SKDVHLPDJLQJ IRUWKHFKDUDFWHULVDWLRQRIIRFDOKHSDWLFOHVLRQV"$FRPSDULVRQRI G\QDPLFJDGR[HWLFDFLGFRQWUDVWHQKDQFHG*G(2%'73$05, YHUVXVDSSDUHQWGLIIXVLRQFRHIÀFLHQW$'& 8,$WWHQEHUJHU -0RUHOOL+0LFKDHO\7 5XVWHPHLHU626FK|QEHUJ 0DQQKHLP'(7 HPSOH7;86XOULNHDWWHQEHUJHU#XPPGH 3XUSRVH 7 R HYDOXDWH WKH YDOXH RI TXDQWLÀHG G\QDPLF *G(2%'73$ DQG DS SDUHQWGLIIXVLRQFRHIÀFLHQW$'&LPDJLQJLQWKHGLIIHUHQWLDWLRQRIKHSDWLFOHVLRQV 0HWKRGVDQG0DWHULDOVFRQVHFXWLYHSDWLHQWVUHIHUUHGIRUG\QDPLF*G(2% '73$05LPDJLQJRIWKHOLYHUZHUHLQFOXGHGLQWKLVLQVWLWXWLRQDOUHYLHZERDUG,5% DSSURYHGUHWURVSHFWLYHVWXG\$WRWDORIOHVLRQVZHUHHYDOXDWHG2IWKHVH KDHPDQJLRPDVKHSDWRFHOOXODUFDUFLQRPDVKHSDWLFDGHQRPDVDQGFDVHV RIIRFDOQRGXODUK\SHUSODVLDZHUHDVVHVVHG $OOSDWLHQWVXQGHUZHQWERWK*G(2% '73$ VFDQV DW DUWHULDO SRUWDOYHQRXV YHQRXV OLYHUVSHFLÀF SKDVH DW DQG PLQSLDQGGLIIXVLRQZHLJKWHGLPDJLQJ':,EVPPDW7 ZLWK $'&FDOFXODWLRQ7KHOHVLRQFRQWUDVWUDWLR&5ZDVFDOFXODWHGDVIROORZV&5 VLJQDOLQWHQVLW\OHVLRQSRVWFRQWUDVWVLJQDOLQWHQVLW\SDUHQFK\PDSRVWFRQWUDVW 52&DQDO\VHVZHUHSHUIRUPHGDWDOOWLPHSRLQWVDVZHOODVIRUWKH$'&YDOXHV % &RPSDULVRQRIWKUHHPHWKRGVRIDSSDUHQWGLIIXVLRQFRHIÀFLHQW HYDOXDWLRQLQDVVHVVLQJVROLGIRFDOOLYHUOHVLRQVZLWKGLIIXVLRQ ZHLJKWHGLPDJLQJ':, 5*LURPHWWL63XOOLQL/&HUHVHU0'HO3LQ*&RPR0%D]]RFFKL &=XLDQL8GLQH,7UJLURPHWWL#VLUPRUJ 3XUSRVH7 RFRPSDUHWKHSHUIRUPDQFHLQGLDJQRVLQJVROLGIRFDOOLYHUOHVLRQV)//V PDOLJQDQF\RIWKHDSSDUHQWGLIIXVLRQFRHIÀFLHQW$'&WKUHVKROGLQJ$'&7PHWKRG YVWZRYDULDQWVRIWKHOHVLRQWROLYHU$'&UDWLR$'&5 0HWKRGVDQG0DWHULDOV([DPLQDWLRQVZHUHSHUIRUPHGRQD7V\VWHP $QDO\VLV ZDVDSSOLHGWR)//VSURYHQWREHPDOLJQDQWDQGEHQLJQLQDQGFDVHV UHVSHFWLYHO\&\VWVDQGKDHPDQJLRPDVZHUHH[FOXGHGIURPWKHDQDO\VLV:HHV WLPDWHGWKHSRVLWLYHSUHGLFWLYHYDOXH339DQGQHJDWLYHSUHGLFWYDOXH139IRU PDOLJQDQF\RI $'&7DQGWZRYDULDQWVRIWKH $'&5FDOFXODWHGZLWKRXW$'&5 DQGZLWK$'&5WKHLQFOXVLRQRIWKHSDUHQFK\PDO $'&VWDQGDUGGHYLDWLRQYDOXH UHVSHFWLYHO\$Q$'&5ZDVFRQVLGHUHGDVPDOLJQDQW$UHFHLYHURSHUDWLQJ FKDUDFWHULVWLF52&DQDO\VLVZDVFDUULHGRXWWRHVWDEOLVKDWKUHVKROGIRUPDOLJQDQF\ DQGWRFRPSDUHWKHDUHDXQGHUWKHFXUYH$8&YDOXHV 5HVXOWV7KHWKUHVKROGIRUPDOLJQDQF\RI$'&7ZDV[PPVHF7KH 339DQG139ZHUH&,DQG&,IRU $'&7YV&,DQG&,IRU $'&5 YV&,DQG&,IRU $'&5UHVSHF WLYHO\0RVWIDOVHQHJDWLYH)//VZHUHUHSUHVHQWHGE\KHSDWRFHOOXODUFDUFLQRPD $'&7VKRZHGDQ$8&VLJQLÀFDQWO\KLJKHUSWKDQ$'&5 EXWQRWWKDQ$'&5 &RQFOXVLRQ 7KH 139 IRU )//V DVVHVVPHQW ZHUH ORZ UHJDUGOHVV RI WKH$'& HYDOXDWLRQPHWKRGZKLOHWKH339ZDVKLJKHVSHFLDOO\E\FRPSDULQJOHVLRQDQG SDUHQFK\PDO $'&VZLWKWKH $'&5PHWKRG+RZHYHUWKHXVHRIDQ $'&WKUHVKROG SURYLGHGKLJKHUGLDJQRVWLFSHUIRUPDQFHLQWHUPVRI$8& % &RPSDULVRQRIWKHDSSDUHQWGLIIXVLRQFRHIÀFLHQWWKUHVKROGLQJ PHWKRGYVOHVLRQWROLYHU$'&UDWLRLQGLVFULPLQDWLQJVROLGEHQLJQ DQGPDOLJQDQWIRFDOOLYHUOHVLRQV)//V 63XOOLQL5*LURPHWWL0'HO3LQ/&HUHVHU*&RPR0%D]]RFFKL &=XLDQL8GLQH,7VHUHSXO#OLEHURLW 3XUSRVH$WKUHVKROGLQGHSHQGHQWPHWKRGWRDVVHVVIRFDOOLYHUOHVLRQV)//VLV QHHGHG EHFDXVH RI WKH DSSDUHQW GLIIXVLRQ FRHIÀFLHQW $'& YDULDELOLW\ OLQNHG WR HTXLSPHQWUHODWHGIDFWRUV2XUSXUSRVHZDVWRFRPSDUHWKHGLDJQRVWLFSHUIRUPDQFH RIWKH$'&WKUHVKROGLQJ$'&7PHWKRGYVOHVLRQWROLYHU$'&UDWLR$'&5LQ GLIIHUHQWLDWLQJVROLGEHQLJQDQGPDOLJQDQW)//V 0HWKRGVDQG0DWHULDOV7KLUW\WZRSDWLHQWVZHUHHYDOXDWHGRQD7V\VWHP &RUUHVSRQGLQJ )//V LQFOXGHG KHSDWRFHOOXODU FDUFLQRPD Q PHWDVWDVHV Q KHSDWRFHOOXODUDGHQRPDQ IRFDOQRGXODUK\SHUSODVLDQ G\VSODVWLF QRGXOHVQ DQGDW\SLFDOKDHPDQJLRPDQ &\VWVDQGW\SLFDOKDHPDQJLRPDV ZHUHH[FOXGHGIURPWKHDQDO\VLV/HVLRQV$'&ZDVXVHGWRHVWDEOLVKDWKUHVKROG IRUPDOLJQDQF\ZLWKDUHFHLYHURSHUDWLQJFKDUDFWHULVWLF52&DQDO\VLV$'&7DQG WRFDOFXODWHWKH$'&5DVWKHUDWLRRIOHVLRQ$'&DQGOLYHUSDUHQFK\PD$'&$Q $'&5ZDVFRQVLGHUHGDVPDOLJQDQW%\FRPSDULQJ $'&7DQG $'&5UHVXOWV ZLWKWKHVWDQGDUGRIUHIHUHQFHZHHVWLPDWHGWKHVHQVLWLYLW\VSHFLÀFLW\SRVLWLYHDQG QHJDWLYHSUHGLFWLYHYDOXHV339139IRUPDOLJQDQF\52&DQDO\VLVZDVXVHGWR FRPSDUHWKHDUHDXQGHUWKHFXUYH$8&RIERWKPHWKRGV 5HVXOWV $'&WKUHVKROGIRUPDOLJQDQF\ZDV[APPòVHF6HQVLWLYLW\VSH FLÀFLW\339DQG139ZHUH&,&, &,DQG&,IRU$'&7YV &,&,&,DQG &,IRU$'&5UHVSHFWLYHO\$'&7VKRZHGDVLJQLÀFDQWO\ KLJKHU$8&WKDQ$'&5S0DLQVRXUFHRIIDOVHQHJDWLYH FDVHVZDVKHSDWRFDUFLQRPD &RQFOXVLRQ$'&5KDVQRWWKHFDSDELOLW\WRUHSODFH$'&7LQDVVHVVLQJ)//V % 6HQVLWLYLW\RIYLVXDODVVHVVPHQWYVDSSDUHQWGLIIXVLRQFRHIÀFLHQW TXDQWLÀFDWLRQLQGLIIHUHQWLDWLQJPDOLJQDQWDQGVROLGEHQLJQIRFDO OLYHUOHVLRQVZLWKGLIIXVLRQZHLJKWHGLPDJLQJ 5*LURPHWWL0'HO3LQ63XOOLQL/&HUHVHU*&RPR0%D]]RFFKL &=XLDQL8GLQH,7UJLURPHWWL#VLUPRUJ 3XUSRVH7 RFRPSDUHWKHVHQVLWLYLW\RIGLIIXVLRQZHLJKWHGLPDJLQJ':,YLVXDO DQDO\VLV9$YVDSSDUHQWGLIIXVLRQFRHIÀFLHQWTXDQWLÀFDWLRQ$'&4LQGLDJQRVLQJ PDOLJQDQF\RIVROLGIRFDOOLYHUOHVLRQV)//V 6FLHQWLILF6HVVLRQ $ 6&'()*+%(XURSHDQ&RQJUHVVRI 5DGLRORJ\ 0RQGD\ 5HVXOWV2ISDWLHQWVIHPDOHPHDQDJH\UVLQFXUUHGD 0$&(FDUGLDFGHDWKVQRQIDWDO0, VUHYDVFXODULVDWLRQVDQGXQVWDEOH DQJLQDGXULQJPHGLDQIROORZXSRI,45PRQWKV2QPXOWLYDULDWHDQDO\VLV WKHSUHVHQFHDQGH[WHQWRIREVWUXFWLYHGLVHDVHSUHGLFWHGVLPLODUULVNVLQPDOHVDQG IHPDOHVDOOS!KRZHYHUSUHVHQFH+5YVDQGH[WHQW+5 YVRIDQ\SODTXHZDVPRUHKD]DUGRXVLQIHPDOHVS 3ODTXHFRPSRVL WLRQDOVRSRUWHQGHGYDULDEOHULVNVS ZLWKH[WHQWRIQRQFDOFLÀHGSODTXHOHVV KD]DUGRXVLQIHPDOHVDQGSUHVHQFHRIH[FOXVLYHO\FDOFLÀHGSODTXHPRUHKD]DUGRXV &RQFOXVLRQ 7KH SUHGLFWLYH YDOXH RI FDUGLDF &7$ ÀQGLQJV LV JHQGHUVSHFLÀF :RPHQ ZLWK DQ\ DWKHURVFOHURVLV DUH DW LQFUHDVHG ULVN FRPSDUHG WR PHQ ZLWK HTXLYDOHQWGLVHDVHLQDGGLWLRQFDOFLÀHGSODTXHSRUWHQGVDKLJKHUULVNLQIHPDOHV ZKLOHPDOHVDUHDWLQFUHDVHGULVNZLWKQRQFDOFLÀHGOHVLRQVLQGLFDWLQJWKHUHPD\ EHJHQGHUGLIIHUHQFHVLQSODTXHSURJUHVVLRQVWDELOLW\ % 3URJQRVWLFYDOXHRI&7FRURQDU\DQJLRJUDSK\LQVXEMHFWVZLWK VXVSHFWHG&$'IRFXVRQVHYHULW\RIFRURQDU\DUWHU\GLVHDVHDQG WKHSUHVHQFHRIOHIWPDLQGLVHDVH5HVXOWVIURPWKH&21),50 5HJLVWU\FRURQDU\&7DQJLRJUDSK\HYDOXDWLRQIRUFOLQLFDORXWFRPHV DQLQWHUQDWLRQDOPXOWLFHQWUHUHJLVWU\ ) &DGHPDUWLUL (0DIIHL66HLWXQ-.0LQ+-&KDQJ'%HUPDQ %&KRZ6$FKHQEDFK-+DXVOHLWHU0RQDVWLHUGL7UHYLVR,7 *HQRD,7/RV$QJHOHV&$866HRXO.52WWDZD21&$*LHVVHQ'( 0XQLFK'(ÀOLSSRFDGHPDUWLUL#JPDLOFRP 3XUSRVH 7 R H[DPLQH WKH DVVRFLDWLRQ RI DOOFDXVH PRUWDOLW\ ZLWK WKH FRPSXWHG WRPRJUDSK\ FRURQDU\ DQJLRJUDSK\ &&7 HYLGHQFH RI FRURQDU\ DUWHU\ GLVHDVH &$'ZLWKIRFXVRQWKHSUHVHQFHDQGVHYHULW\RIOHIWPDLQ/0GLVHDVH 0HWKRGVDQG0DWHULDOV $WRWDORISDWLHQWVPHQDJH\HDUV ZLWKRXW NQRZQ KLVWRU\ RI &$' IURP DQ ,QWHUQDWLRQDO PXOWLFHQWUH&&7 UHJLVWU\ &21),50 5HJLVWU\ PHW WKH LQFOXVLRQ FULWHULD WRWDO GDWDEDVH SDWLHQWV FRURQDU\DUWHU\VHJPHQWVDQDO\VLVZHUHSHUIRUPHG&R[SURSRUWLRQDOKD]DUG PRGHOV ZLWK DGMXVWPHQW IRU ULVN IDFWRUV DQG DIWHU VWUDWLÀFDWLRQ DFFRUGLQJ WR /0 GLVHDVHZHUHGHYHORSHGWRSUHGLFWRXWFRPH 5HVXOWV7KHSUHYDOHQFHRIREVWUXFWLYH!&$'ZDVZKHUHDVRI SDWLHQWVKDGQRQREVWUXFWLYH&$'DQGKDGQRUPDOFRURQDU\DUWHULHV7KH SUHVHQFHRIREVWUXFWLYH!DQGQRQREVWUXFWLYH&$'LQ/0ZHUHUHVSHFWLYHO\ Q DQGQ $WRWDORIGHDWKVRFFXUUHGDIWHUDPHDQ IROORZXSRIPRQWKV0XOWLYDULDWHDQDO\VLVVKRZHGWKDW&$'VHYHULW\+5 &, S DQG WKH QXPEHU RI GLVHDVHG VHJPHQWV+5 &,S ZHUHSUHGLFWRUVRIDOOFDXVHPRUWDOLW\ZLWKLQFUHPHQWDO SURJQRVWLFYDOXHRYHU)UDPLQJKDPULVNDQGFDOFLXPVFRUH5LVNDGMXVWHGVXUYLYDO VKRZHGWKDWWKHSUHVHQFHRIHLWKHUQRQREVWUXFWLYHRUREVWUXFWLYHFXWRII! /0GLVHDVHZDVQRWDVVRFLDWHGZLWKDVLJQLÀFDQWO\ZRUVHSURJQRVLV+RZHYHUDIWHU FRQVLGHULQJDFXWRIIYDOXH!IRUREVWUXFWLYH&$'SDWLHQWVZLWK/0GLVHDVH IDUHGWKHZRUVWS &RQFOXVLRQ/0FRURQDU\DUWHU\GLVHDVHSUHVHQFHDQGVHYHULW\DVGHWHFWHGE\ &&7VHHPVWREHSRRUO\DVVRFLDWHGZLWKZRUVHSURJQRVLV % 3URJQRVWLFYDOXH&7FRURQDU\DQJLRJUDSK\LQVXEMHFWVZLWK VXVSHFWHG&$'IRFXVRQVHYHULW\RIFRURQDU\DUWHU\GLVHDVH DQGSUHVHQWLQJV\PSWRPV5HVXOWVIURPWKH&21),505HJLVWU\ FRURQDU\&7DQJLRJUDSK\HYDOXDWLRQIRUFOLQLFDORXWFRPHVDQ LQWHUQDWLRQDOPXOWLFHQWUHUHJLVWU\ (0DIIHL ) &DGHPDUWLUL66HLWXQ0+DGDPLW]N\3 .DXIPDQQ .1DVLU/-6KDZ*5DII7 9LOOLQHV0RQDVWLHUGL7UHYLVR,7 *HQRD,70XQLFK'(=XULFK&+1HZ+DYHQ&786$WODQWD*$86 5R\DO2DN0,86%HWKHVGD0'86 3XUSRVH7KHDLPRIWKLVVWXG\ZDVWRH[DPLQHWKHDVVRFLDWLRQRIDOOFDXVHPRUWDOLW\ ZLWKWKHFRPSXWHGWRPRJUDSK\FRURQDU\DQJLRJUDSK\&&7HYLGHQFHRIFRURQDU\ DUWHU\GLVHDVH&$'ZLWKIRFXVRQWKHSURJQRVWLFUROHRIV\PSWRPV 0HWKRGVDQG0DWHULDOV $WRWDORISDWLHQWVPHQDJH\HDUV ZLWKRXWNQRZQKLVWRU\RI&$'IURPWKH,QWHUQDWLRQDO&21),50&&7UHJLVWU\PHW WKH LQFOXVLRQ FULWHULD$ FRURQDU\ DUWHU\ VHJPHQWV DQDO\VLVZDV SHUIRUPHG 6XUYLYDO DQDO\VLV DQG &R[ SURSRUWLRQDO KD]DUG PRGHOV ZLWK DGMXVWPHQW IRU ULVN IDFWRUVDFFRUGLQJWRSUHVHQWLQJV\PSWRPVZHUHGHYHORSHGWRSUHGLFWRXWFRPH 5HVXOWVSDWLHQWVZHUHDV\PSWRPDWLFKDGQRQFDUGLDFRUDW\SLFDO SDLQKDGW\SLFDOSDLQDQGKDGG\VSQRHD7KHRYHUDOOSUHYDOHQFHRI REVWUXFWLYH!&$'ZDVZKHUHDVRISDWLHQWVKDGQRQREVWUXFWLYH &$'DQGKDGQR&$'$VLJQLÀFDQWKLJKHUSUHYDOHQFHRIREVWUXFWLYH&$' ZDV REVHUYHG DPRQJ SDWLHQWV ZLWK W\SLFDO SDLQ ZLWK UHVSHFW WR RWKHU V\PSWRP 7KHDUHDXQGHUHDFK52&FXUYH$8&ZDVREWDLQHG7KHDELOLW\RIOLYHUVSHFLÀF SKDVHLPDJLQJDQG $'&YDOXHVWRGLIIHUHQWLDWHEHWZHHQWKHOHVLRQVZDVFRPSDUHG 5HVXOWV,QERWKOLYHUVSHFLÀFSKDVHV)1+&5ZDVVLJQLÀFDQWO\KLJKHUWKDQWKDWRI DOORWKHUOHVLRQVS$GHQRPDVGHPRQVWUDWHGVLJQLÀFDQWO\KLJKHU&5WKDQ KDHPDQJLRPDVSEXWQRW+&&S +DHPDQJLRPDVGHPRQVWUDWHG VLJQLÀFDQWO\ ORZHU &5 S $'& YDOXHV DOORZHG DFFXUDWHGLIIHUHQWLDWLRQ EHWZHHQKDHPDQJLRPDVDQGDOORWKHUOHVLRQVSEXWWKHDFFXUDF\ZDVLQ QRFDVHJUHDWHUWKDQWKDWRIOLYHUVSHFLÀFSKDVHLPDJLQJ1HLWKHUDGHQRPDVDQG +&&QRU)1+DQG+&&FRXOGEHGLIIHUHQWLDWHGE\$'&YDOXHV &RQFOXVLRQ *G(2%'73$ RXWSHUIRUPV$'& LQ WKH GLIIHUHQWLDWLRQ RI KHSDWLF OHVLRQV % &RPSDULVRQRI05HODVWRJUDSK\DQGGLIIXVLRQZHLJKWHG05LPDJLQJ IRUGLIIHUHQWLDWLQJEHQLJQDQGPDOLJQDQWIRFDOOLYHUOHVLRQV 6.9HQNDWHVK*:DQJ.0DGKDYDQ$:HH6LQJDSRUH6* VXGKDNDUBNBYHQNDWHVK#QXKVHGXVJ 3XUSRVH &RPSDUDWLYH HYDOXDWLRQ RI 05 HODVWRJUDSK\ 05( DQG GLIIXVLRQ ZHLJKWHGLPDJLQJ':,IRUGLIIHUHQWLDWLRQRIEHQLJQDQGPDOLJQDQWOLYHUOHVLRQV 0HWKRGV DQG 0DWHULDOV 05( DQG ':, ZHUH SHUIRUPHG LQ SDWLHQWV ZLWK D WRWDORIOHVLRQVEHQLJQPDOLJQDQW7KHOHVLRQVZHUHKHSDWRPDV KDHPDQJLRPDV IRFDO QRGXODU K\SHUSODVLD FKRODQJLRFDUFLQRPD F\VW DQGJDOOEODGGHUFDUFLQRPD':,ZDVSHUIRUPHGZLWKDIUHHEUHDWKLQJWHFKQLTXH 757(PVPDWUL[[PPWKLFNQHVVE 05(ZDV SHUIRUPHGZLWKPRGLÀHGJUDGLHQWHFKRVHTXHQFH757( PVPDWUL[ [PPWKLFNQHVV7KHDSSDUHQWGLIIXVLRQFRHIÀFLHQW$'&PDSVDQG HODVWRJUDPVZHUHJHQHUDWHGRQZRUNVWDWLRQ5HJLRQVRILQWHUHVW52,ZHUHSODFHG RQWKHIRFDOOHVLRQVRQWKHHODVWRJUDPVDQG $'&PDSVH[FOXGLQJODUJHYHVVHOVOLYHU HGJHVDQGDUWHIDFWVZKHUHYHUSRVVLEOH0HDQVWLIIQHVVYDOXHVLQNLORSDVFDOVN3D DQGPHDQ $'&YDOXHVZHUHGHULYHGIRUHDFKOHVLRQDQGWDEXODWHG5HFHLYHURSHUDW LQJFXUYH52&DQDO\VLVZDVSHUIRUPHGWRGHWHUPLQHWKHDUHDXQGHUFXUYH$8& IRUDFFXUDF\RI05(DQG$'&IRUGLIIHUHQWLDWLRQRIEHQLJQDQGPDOLJQDQWOHVLRQV 5HVXOWV 52& DQDO\VLV VKRZHG WKDW$8&VHQVLWLYLW\VSHFLÀFLW\ IRU 05( FXWRII ! N3D DQG ':, FXWRII [ PPV ZHUH S DQG S UHVSHFWLYHO\ IRU GLIIHUHQWLDWLQJ PDOLJQDQWDQGEHQLJQOHVLRQV7KHDFFXUDF\RI05(ZDVVLJQLÀFDQWO\EHWWHUWKDQ ':, S 7KHUH ZDV D QHJDWLYH FRUUHODWLRQ EHWZHHQ VWLIIQHVV DQG$'& YDOXHVU S,QWHUHVWLQJO\DFRUUHODWLRQEHWZHHQVL]HDQGVWLIIQHVV RIOHVLRQVU SZDVVHHQ &RQFOXVLRQ 2XU VWXG\ UHVXOWV VKRZ WKDW 05( LV PRUH DFFXUDWH WKDQ ':, IRU GLIIHUHQWLDWLRQRIEHQLJQDQGPDOLJQDQWIRFDOOLYHUOHVLRQV 5RRP/0 &DUGLDF 66 &7DQG05,ULVNVWUDWLÀFDWLRQSURJQRVLVDQG RXWFRPH 0RGHUDWRUV $%HUQDUGLQL7HUDPR,7 03DVRZLF].UDNRZ3/ % *HQGHUGLIIHUHQFHVLQWKHSURJQRVWLFYDOXHRIFDUGLDF&7DQJLRJUDSK\ -:1DQFH-U86FKRHSI&/6FKOHWW-%DUUD]D) %DPEHUJ 0F&RQQHOOV6&86&KDUOHVWRQ6&86%RVWRQ0$86 0XQLFK'()DELDQ%DPEHUJ#PHGXQLPXHQFKHQGH 3XUSRVH7 RGHWHUPLQHJHQGHUGLIIHUHQFHVLQSUHGLFWLYHYDOXHRIFDUGLDF&7$LQ SDWLHQWVSUHVHQWLQJWRWKHHPHUJHQF\GHSDUWPHQWZLWKDFXWHFKHVWSDLQEXWZLWKRXW DFXWHFRURQDU\V\QGURPH 0HWKRGVDQG0DWHULDOV6XEMHFWVZLWKDFXWHFKHVWSDLQXQGHUZHQWFDUGLDF&7$ 7KHSUHVHQFHH[WHQWQXPEHURIDIIHFWHGYHVVHOVHJPHQWVVHYHULW\RU VWHQRVLVDQGFRPSRVLWLRQRIDWKHURVFOHURWLFOHVLRQVFDOFLÀHGQRQFDOFLÀHG RU PL[HG ZHUH GHWHUPLQHG 3DWLHQWV ZHUH IROORZHG IRU PDMRU DGYHUVH FDUGLDF HYHQWV0$&(P\RFDUGLDOLQIDUFWLRQXQVWDEOHDQJLQDUHYDVFXODULVDWLRQFDUGLDF GHDWK+D]DUGUDWLRVZHUHGHULYHGXVLQJXQLYDULDWHDQGPXOWLYDULDWHFR[UHJUHV VLRQDGMXVWLQJIRUULVNIDFWRUVDQGVWUDWLÀHGE\JHQGHULIWKHUHZDVDVWDWLVWLFDOO\ VLJQLÀFDQWLQWHUDFWLRQS 6FLHQWLILF6HVVLRQ 6 &$' ( ) *+% (XURSHDQ&RQJUHVVRI 5DGLRORJ\ &RQFOXVLRQ/$DQG/$$YROXPHVLQSDWLHQWVZLWKVXVSHFWHGFDUGLRJHQLFVWURNH DUHVLJQLÀFDQWO\LQFUHDVHG(QODUJHG/$DQGRU/$$YROXPHPHDVXUHGZLWKF&7 PD\FRQVWLWXWHDQLQGHSHQGHQWULVNIDFWRUIRUFDUGLRHPEROLFVWURNH % )UHTXHQWDQGZLGHVSUHDGYDVFXODUDEQRUPDOLWLHVLQKXPDQ67$7 GHÀFLHQF\GHWHFWHGE\ZKROHERG\05DQGFDUGLDF&7VFDQ $$$]DULQH2&KDQGHVULV&3LFDUG(0RXVVHDX[3 %RXWRX\ULH=0DOODW $)LVFKHU3DULV)5DUVKLGD]DULQH#HJSDSKSIU 3XUSRVH7 RHYDOXDWHWKHSUHYDOHQFHDQGFKDUDFWHULVWLFVRIFDUGLRYDVFXODUDE QRUPDOLWLHV LQ 67$7 GHÀFLHQF\ UHVSRQVLEOH IRU DXWRVRPDOGRPLQDQW K\SHU,J( V\QGURPH 0HWKRGV DQG 0DWHULDOV :H SURVSHFWLYHO\ VFUHHQHG DGXOW 67$7GHÀFLHQW SDWLHQWVPHGLDQDJH\HDUVUDQJHIRUYDVFXODUDEQRUPDOLWLHV7KH\ ZHUHH[SORUHGZLWKZKROHERG\PDJQHWLFUHVRQDQFHLPDJLQJDQJLRJUDSK\SURVSHF WLYHFRURQDU\PXOWLVOLFHFRPSXWHGWRPRJUDSK\DQGHFKRWUDFNLQJEDVHGLPDJLQJ RIWKHFDURWLGDUWHULHV 5HVXOWV%UDLQDEQRUPDOLWLHVZKLWHPDWWHUK\SHULQWHQVLWLHVODFXQDUOHVLRQVVXJJHV WLYHRILVFKDHPLFLQIDUFWVDWURSK\ZHUHIRXQGLQRISDWLHQWV3HULSKHUDODQG FHUHEUDODUWHU\DEQRUPDOLWLHVZHUHUHSRUWHGLQRISDWLHQWVZKHUHDVFRURQDU\ DUWHU\DEQRUPDOLWLHVZHUHGHWHFWHGLQ7KHPRVWIUHTXHQWYDVFXODUDEQRUPDOL WLHVZHUHHFWDVLDDQGDQHXU\VP7KHFDURWLGLQWLPDPHGLDWKLFNQHVVZDVPDUNHGO\ GHFUHDVHGZLWKDVXEVWDQWLDOLQFUHDVHLQFLUFXPIHUHQWLDOZDOOVWUHVVLQGLFDWLQJWKH RFFXUUHQFHRIK\SRWURSKLFDUWHULDOUHPRGHOOLQJLQWKLV67$7GHÀFLHQWSRSXODWLRQ &RQFOXVLRQ&RURQDU\DQGSHULSKHUDOYDVFXODUDEQRUPDOLWLHVDUHKLJKO\SUHYDOHQW LQ67$7GHÀFLHQWSDWLHQWV % $QRPDORXVFRURQDU\DUWHU\RULJLQDWLQJIURPRSSRVLWHFRURQDU\ VLQXVIUHTXHQWO\UHYHDOVPXOWLSOHKLJKULVNDQDWRP\IHDWXUHV 0.UXSLQVNL7 0LV]DOVNL-DPND%/DVNRZLF]%5yJ5%DQ\V 08UEDQF]\N=DZDG]ND0.RVWNLHZLF].UDNRZ3/ 3XUSRVH7KHDLPRIWKHVWXG\ZDVWRDVVHVVWKHSUHYDOHQFHRIKLJKULVNDQDWRP\ IHDWXUHVLQSDWLHQWVZLWKDQRPDORXVRULJLQRIFRURQDU\DUWHU\IURPRSSRVLWHFRURQDU\ VLQXV +LJK ULVN DQDWRP\ YDULDQWV LQFOXGH LQWHUDUWHULDO FRXUVH QDUURZHG VOLWOLNH RULÀFHDFXWHDQJOHRIWDNHRIILQWUDPXUDOFRXUVHDQGK\SRSODVLD 0HWKRGVDQG0DWHULDOVSDWLHQWVZKRZHUHVFKHGXOHGIRUVOLFHRUGXDO VRXUFH FRPSXWHG WRPRJUDSK\ FRURQDU\ DQJLRJUDSK\ &7&$ GXH WR VXVSHFWHG REVWUXFWLYH FRURQDU\ DUWHU\ GLVHDVH ZHUH VFUHHQHG IRU WKH DQRPDORXV RULJLQ RI FRURQDU\DUWHU\IURPRSSRVLWHFRURQDU\VLQXV3DWLHQWVZHUHHYDOXDWHGLQWHUPVRI FRXUVHRIDQRPDORXVVHJPHQWSUHVHQFHRIREVWUXFWLYHFRURQDU\DUWHU\GLVHDVH DQGKLJKULVNDQDWRP\ 5HVXOWV$QRPDORXV RULJLQ RI FRURQDU\ DUWHU\ DW LPSURSHU VLQXV RI 9DOVDOYD ZDVIRXQGLQSDWLHQWVPDOHVIHPDOHVPHDQDJH\HDUV (LJKWHHQSDWLHQWVSUHVHQWHGFLUFXPÁH[DUWHU\RULJLQDWLQJDWULJKWFRURQDU\DUWHU\ VLQXV$/&[SDWLHQWVULJKWFRURQDU\DUWHU\RULJLQDWLQJIURPOHIWFRURQDU\VLQXV $5&$DQGSDWLHQWVOHIWFRURQDU\DUWHU\RULJLQDWLQJIURPULJKWFRURQDU\VLQXV $/&$+LJKULVNDQDWRP\ZDVIRXQGLQRIWKHVHVXEMHFWVLQWHUDUWHULDO FRXUVHLQVOLWOLNHRULÀFHLQDFXWHDQJOHRIWDNHRIILQLQWUDPXUDOFRXUVHLQ DQGK\SRSODVLDLQLQGLYLGXDOV3DWLHQWVSUHVHQWLQJREVWUXFWLYHFRURQDU\DUWHU\ GLVHDVHLQDQRPDORXVVHJPHQWKDGDFXWHWDNHRIIDQJOHS DQGVOLWOLNHRULÀFH S PRUHIUHTXHQWO\WKDQRWKHUV &RQFOXVLRQ+LJKULVNDQDWRP\LVSUHVHQWLQWKHPDMRULW\RISDWLHQWVZLWKDQRPDORXV RULJLQRIFRURQDU\DUWHU\DWRSSRVLWHFRURQDU\VLQXVDQGLVRIWHQDFFRPSDQLHGE\ REVWUXFWLYHFRURQDU\DUWHU\GLVHDVHLQWKHDQRPDORXVVHJPHQW % ,WDOLDQFDUGLDF&7UHJLVWU\SUHOLPLQDU\UHVXOWV ) &DGHPDUWLUL 0)UDQFRQH/3DWULDUFD,&DUERQH*/LJDEXH//RYDWR ('L&HVDUH0RQDVWLHUGL7UHYLVR,75RPH,7/ҋ$TXLOD,70RGHQD,7 %RORJQD,7ÀOLSSRFDGHPDUWLUL#JPDLOFRP 3XUSRVH&DUGLDF&7&&7LVDQLPDJLQJPRGDOLW\WKDWLVEHFRPLQJDVWDQGDUG LQ FOLQLFDO FDUGLRORJ\ :H HYDOXDWHG LQGLFDWLRQV VDIHW\ DQG LPSDFW RQ SDWLHQW PDQDJHPHQWRIURXWLQH&&7LQDPXOWLFHQWUHQDWLRQDOUHJLVWU\ 0HWKRGV DQG 0DWHULDOV 'XULQJ D SHULRG RI PRQWKV FHQWUHV LQ ,WDO\ ZH HQUROOHGSDWLHQWVXQGHUJRLQJ&&7IRUDQ\LQGLFDWLRQ 5HVXOWV$WRWDORIFRQVHFXWLYHSDWLHQWVZHUHHQUROOHG&&7ZDVSHUIRUPHG PDLQO\ZLWKVOLFH&7VFDQQHUVDQGZLWKUHWURVSHFWLYH(&*JDWLQJ ,QRIWKHFDVHV&&7ZDVSHUIRUPHGZLWK,9FRQWUDVW PDWHULDO,QRIWKHFDVHVSKDUPDFRORJLFDOPDQDJHPHQWRIKHDUWUDWH ZDVSHUIRUPHGKHDUWUDWHGXULQJ&&7 ESP0HDQ'/3ZDV FDWHJRULHVS$WRWDORIGHDWKVRFFXUUHGDIWHUDPHDQ IROORZXSRIPRQWKV0XOWLYDULDWHDQDO\VLVVKRZHGWKDW&$'VHYHULW\+5 &,SDQGWKHQXPEHURIGLVHDVHGVHJPHQWVS ZHUH SUHGLFWRUVRIDOOFDXVHPRUWDOLW\ZLWKLQFUHPHQWDOSURJQRVWLFYDOXHRYHU)UDPLQJKDP ULVNDQGFDOFLXPVFRUH5LVNDGMXVWHGVXUYLYDOGLGQRWGLIIHUVLJQLÀFDQWO\EHWZHHQ V\PSWRPFDWHJRULHVKRZHYHUWKHZRUVWSURJQRVLVZDVREVHUYHGLQSDWLHQWVZLWK G\VSQRHDS &RQFOXVLRQ &&7 LV D YDOXDEOH WRRO IRU ULVN VWUDWLÀFDWLRQ 6HYHULW\ RI &$'D Q G W\SLFDOFKHVWSDLQDSSHDUWREHWKHVWURQJHVWSUHGLFWRUVRIPRUWDOLW\ZLWKLQV\PS WRPVJURXSV % &RURQDU\FRPSXWHGWRPRJUDSK\DQJLRJUDSK\LQWKHVHOHFWLRQ DQGHYDOXDWLRQRIRXWOLHUSDWLHQWVUHVXOWVIURPWKHLQWHUQDWLRQDO PXOWLFHQWUH&21),50FRURQDU\&7DQJLRJUDSK\HYDOXDWLRQIRU FOLQLFDORXWFRPHVDQLQWHUQDWLRQDOPXOWLFHQWUHUHJLVWU\ (0DIIHL ) &DGHPDUWLUL66HLWXQ-.0LQ0$O0DOODK0-%XGRII 7 4&DOOLVWHU9&KHQJ$'HODJR0RQDVWLHUGL7UHYLVR,7*HQRD,7 /RV$QJHOHV&$86'HWURLW0,86+HQGHUVRQYLOOH7186$OEDQ\1<86 VDUDVHLWXQ#\DKRRFRP 3XUSRVH7 RHYDOXDWHWKHSUHVHQFHDQGGLVWULEXWLRQRIRXWOLHUSDWLHQWVZLWKVOLFH FRURQDU\FRPSXWHGWRPRJUDSK\DQJLRJUDSK\&&7LQDODUJHLQWHUQDWLRQDOPXOWL FHQWUHUHJLVWU\&21),50 0HWKRGVDQG0DWHULDOV)URPDSRSXODWLRQRIFRQVHFXWLYHSDWLHQWV PHQPHDQDJH\HDUVXQGHUZHQW&&7 ZHDQDO\VHGSDWLHQWVZLWKVXVSHFWHG FRURQDU\DUWHU\GLVHDVH&$'IRUZKRPWKHFRPSOHWHFDUGLDFULVNSURÀOHZHUH DYDLODEOH:HVHOHFWHGSDWLHQWRXWOLHUVLQWKHÀIWKDQGVL[WKGHFDGHVRIOLIHZLWKWKH IROORZLQJFULWHULDULVNIDFWRUVDQGDEVHQFHRI&$']HURWRRQHULVNIDFWRUVDQG GLVHDVHGFRURQDU\VHJPHQWV'LDEHWHVZDVH[FOXGHGEHFDXVHRIWKHGLIIHUHQW LPSDFWRQ&$' 5HVXOWV 7KH SRSXODWLRQ FRQVLVWHG RI LQGLYLGXDOV ZLWK VXVSHFWHG&$' PHQDJH\HDUV7KHSUHYDOHQFHRIVLJQLÀFDQWVWHQRVLV &$'ZDV3DWLHQWVZLWKQRUPDOFRURQDU\DUWHULHVDFFRXQWHGIRURIWKH WRWDOPHQDJH\HDUVZHUHLQWKHÀIWKDQGLQWKHWK GHFDGHPHQDJH\HDUVRIWKHVHSDWLHQWVZLWKULVNIDFWRUV DFFRXQWHGIRURIWKHWRWDOPHQZRPHQ3DWLHQWVZLWKGLVHDVHG FRURQDU\VHJPHQWVDFFRXQWHGIRURIWKHWRWDOPHQDJH \HDUVZHUHLQWKHÀIWKDQGLQWKHVL[WKGHFDGHPHQZRPHQ RI WKHVH SDWLHQWV ZLWK ]HUR WR RQH ULVN IDFWRUV DFFRXQWHG IRU RI WKH WRWDO PHQZRPHQ &RQFOXVLRQ&&7LGHQWLÀHVRXWOLHUSDWLHQWVWKLVZLOOHQDEOHGHGLFDWHGWULDOVDLPHG DWFKDUDFWHULVLQJELRPDUNHUVDQGJHQRPLFVRISURWHFWLYHDQWLSURWHFWLYHIDFWRUVZLWK UHVSHFWWR&$' % ,QFUHDVHGOHIWDWULDORUOHIWDWULDODSSHQGDJHYROXPHDQLQGHSHQGHQW ULVNIDFWRUIRUFDUGLRHPEROLFVWURNHLQSDWLHQWVZLWKRXWDWULDO ÀEULOODWLRQ"&DUGLDFFRPSXWHGWRPRJUDSK\VWXG\ 07 DLQD59DQQLQHQ0+HGPDQ3 -DNDOD3 6LSROD.XRSLR), 0LNNR7 DLQD#NXKÀ 3XUSRVH,QWUDFDUGLDFWKURPEXVLVDQHVWDEOLVKHGKLJKULVNÀQGLQJIRUFDUGLRHP EROLFVWURNH:HVWXGLHGZKHWKHUOHIWDWULXP/$RUOHIWDWULDODSSHQGDJH/$$ YROXPHVPHDVXUHGZLWKFDUGLDFFRPSXWHGWRPRJUDSK\F&7SURYLGHDGGLWLRQDO LQIRUPDWLRQRQULVNIDFWRUVLQSDWLHQWVZLWKVXVSHFWHGFDUGLRHPEROLFVWURNHZLWKRXW DWULDOÀEULOODWLRQ 0HWKRGVDQG0DWHULDOV&RQVHFXWLYHSDWLHQWVQ PDOHVPHDQDJH \HDUV ZLWK DFXWH VWURNH RI VXVSHFWHG FDUGLRHPEROLF RULJLQ XQGHUZHQW F&7 ,Q F&7 /$DQG/$$YROXPHVZHUHFDOFXODWHGXVLQJ6LPSVRQҋVPHWKRG7KHFRQWURO SRSXODWLRQFRQVWLWXWHGRISDWLHQWVZLWKORZSUHWHVWSUREDELOLW\RIFRURQDU\DUWHU\ GLVHDVHDQGFRURQDU\DUWHU\VWHQRVLVLQF&7 $SDLUZLVHFRPSDULVRQZDV SHUIRUPHGZLWKSDWLHQWVDQGFRQWUROVPDWFKHGIRUDJHDQGJHQGHU 5HVXOWV 7ZHQW\WZR SDWLHQWV SURYHG WR KDYH HVWDEOLVKHG FDUGLRJHQLF ULVN IDF WRUVFDUGLDFRUDRUWLFWKURPEXV/9DQHXU\VPRUWXPRXUIRUVWURNH,QSDLUZLVH FRPSDULVRQVERWK/$POYVPOSDQG/$$POYVPO SYROXPHVZHUHVLJQLÀFDQWO\ODUJHULQSDWLHQWVZLWKVXVSHFWHGFDUGLRHPEROLF VWURNHWKDQLQFRQWUROVXEMHFWV7KHXSSHUOLPLWVPHDQ6'IRUQRUPDO/$DQG /$$YROXPHVZHUHPODQGPOLQFRQWUROVXEMHFWV%\WKHVHFULWHULD VWURNHSDWLHQWVKDGHQODUJHG/$$DQGSDWLHQWVKDGHQODUJHG /$6L[W\RQHRIWKHSDWLHQWVZLWK/$$GLODWDWLRQKDGQRQHRIWKHSUHYL RXVO\GHVFULEHGHVWDEOLVKHGULVNIDFWRUVIRUVWURNH 6FLHQWLILF6HVVLRQ $ 6&'()*+%(XURSHDQ&RQJUHVVRI 5DGLRORJ\ 0RQGD\ 5RRP12 (PHUJHQF\5DGLRORJ\ 66 $FXWHDEGRPHQ 0RGHUDWRUV -0$UWLJDV=DUDJR]D(6 99LHWK0QVWHU'( % 5HTXHVWLQJUDGLRORJLFDOLQYHVWLJDWLRQVGRMXQLRUGRFWRUVNQRZWKHLU SDWLHQWV" -&KR'&%RVDQTXHW1:LOOLDPV'*RZHU.*RZHU7KRPDV0+/HZLV /ODQWULVDQW8.MXQFKR #JPDLOFRP 3XUSRVH 7 R DVFHUWDLQ FOLQLFLDQVҋ NQRZOHGJH RI WKHLU SDWLHQWV ZKHQ UHTXHVWLQJ UDGLRORJLFDOLQYHVWLJDWLRQVDVUHTXLUHGOHJDOO\E\JRYHUQPHQWOHJLVODWLRQ´,RQLVLQJ 5DGLDWLRQ 0HGLFDO ([SRVXUH 5HJXODWLRQV µ ,50(5 IROORZLQJ WKH LPSOHPHQWDWLRQRI(XURSHDQ:RUNLQJ7LPH'LUHFWLYH 0HWKRGVDQG0DWHULDOV,QRXULQVWLWXWLRQDOOUDGLRORJLFDOLQYHVWLJDWLRQUHTXHVWV H[FOXGLQJSODLQÀOPVDUHUHTXLUHGWREHGLVFXVVHGZLWKDFRQVXOWDQWUDGLRORJLVW $OOVXFKUHTXHVWVUHFHLYHGHYHU\0RQGD\IROORZLQJWKHZHHNHQGRQFDOOZHUHFRO OHFWHGSURVSHFWLYHO\RYHUZHHNV'DWDLQFOXGHGJUDGHRIUHTXHVWLQJGRFWRUWKHLU VSHFLDOW\W\SHVRIPRGDOLW\UHTXHVWHGNQRZOHGJHRIWKHLUSDWLHQWDGGUHVVRJUDSK VLJQDWXUHFRQÀUPLQJLGHQWLW\DQGDSSURSULDWHQHVVRILQYHVWLJDWLRQ7KHUHZHUHQR H[FOXVLRQ FULWHULD 6WDWLVWLFDO DQDO\VLV XVLQJ D WZRWDLOHG )LVKHUҋV H[DFW WHVW ZDV SHUIRUPHGIRUDOOGDWD 5HVXOWVUHTXHVWVZHUHUHFHLYHGWKHPDMRULW\ZHUHPDGHE\)RXQGD WLRQ3URJUDPPH)3GRFWRUVDQGJHQHUDOPHGLFDOVSHFLDOWLHVDFFRXQWHGIRU WKHKLJKHVWSURSRUWLRQRIUHTXHVWV8OWUDVRXQGVFDQZDVPRVWIUHTXHQWO\ UHTXHVWHGFORVHO\IROORZHGE\FRPSXWHGWRPRJUDSK\VFDQV$OPRVW DRQHWKLUGRIUHTXHVWVZHUHPDGHE\GRFWRUVZKRKDGQRWVHHQWKHSDWLHQW WREHLQYHVWLJDWHGSUHGRPLQDQWO\E\)3GRFWRUVS DQGPRUHIUHTXHQWO\ E\JHQHUDOPHGLFDOVSHFLDOWLHVS 6LJQDWXUHVZHUHDEVHQWLQRIWKH DGGUHVVRJUDSKVDQGRYHUDOORIUHTXHVWVZHUHGHHPHGLQDSSURSULDWH &RQFOXVLRQ,QDOPRVWDRQHWKLUGRIUDGLRORJLFDOUHTXHVWVGRFWRUVKDYHQRWVHHQ SDWLHQWVWREHLQYHVWLJDWHGPRVWOLNHO\DUHVXOWRIVKLIWZRUNLQJSDWWHUQV7KLVGRHV QRWIXOÀOWKH,50(5FULWHULDDQGSRWHQWLDOO\H[SRVHVSDWLHQWVWRXQQHFHVVDU\ LQDSSURSULDWHUDGLDWLRQ % $FXWHSDQFUHDWLWLVTXDOLWDWLYHDQGTXDQWLWDWLYHHYDOXDWLRQXVLQJ': 05,ZLWKSDUDOOHOLPDJLQJWHFKQLTXHDQGPXOWLSOHEJUDGLHQWIDFWRUYDOXHV 3 %RUDVFKL) 'RQDWL5*LJRQL) 3DFFLDUGL**KHUDUGXFFL&%DUWROR]]L ) )DODVFKL3LVD,7SERUDVFKL#GRPHGXQLSLLW 3XUSRVH7 RGHWHUPLQHWKHXVHIXOQHVVRITXDOLWDWLYHDQGTXDQWLWDWLYHHYDOXDWLRQ XVLQJGLIIXVLRQZHLJKWHG05LPDJLQJ':05,ZLWKSDUDOOHOLPDJLQJWHFKQLTXHDQG PXOWLSOHEJUDGLHQWIDFWRUYDOXHVLQSDWLHQWVZLWKDFXWHSDQFUHDWLWLV$3 0HWKRGVDQG0DWHULDOV$VHULHVRIHLJKWHHQSDWLHQWVZLWKDFOLQLFDOGLDJQRVLVRI $3XQGHUZHQW05LPDJLQJDW7GHYLFH6LJQD+'[W*(+HDOWKFDUH$IWHUWKH DFTXLVLWLRQRID[LDO77ZVHTXHQFHVDQGFRURQDO05&3 ':05,ZDVSHUIRUPHG XVLQJDQD[LDOEUHDWKKROGVLQJOHVKRWVSLQHFKRHFKRSODQDU6((3,VHTXHQFH SDUDOOHOLPDJLQJIDFWRUWKHYDOXHVRIEIDFWRUZHUHVHWDW VPPò$OO':LPDJHVZHUHEOLQGO\LQWHUSUHWHG4XDOLWDWLYHHYDOXDWLRQZDV SHUIRUPHGE\FRQVHQVXVUHDGLQJRIWZRUHYLHZHUVWKDWHYDOXDWHGWKHSUHVHQFHRU DEVHQFHRI$3DQGFRPSOLFDWLRQV4XDQWLWDWLYHHYDOXDWLRQZDVSHUIRUPHGE\WZR RWKHUUDGLRORJLVWVLQFRQIHUHQFHWKDWFDOFXODWHGPHDQ$'&YDOXHVIRUHDFKSDWLHQW XVLQJDEYDOXHRIVPPò 5HVXOWV':,FRXOGGHWHFWDFXWHSDQFUHDWLWLVDVSHUVLVWHQWEULJKWVLJQDOLQWHQVLW\DW GLIIHUHQWEJUDGLHQWIDFWRUYDOXHV7KHUHYLHZHUVZHUHDEOHWRGLIIHUHQWLDWHLQÁDP PDWLRQIURPQHFURWLFDQGKDHPRUUKDJLFWLVVXHDQGLGHQWLÀHGSRVVLEOHFDXVHVRI $3 FKROHGRFKROLWKLDVLVDQGSDQFUHDVGLYLVXPRQ05LPDJHVLQFDVHV)XUWKHUPRUH WKHPHDQSDQFUHDWLF $'&YDOXHLQWKH $3JURXSZDVVLJQLÀFDQWO\ORZHUWKDQLQWKH QRUPDOFRQWUROJURXSS &RQFOXVLRQ':05,ZLWKSDUDOOHOLPDJLQJWHFKQLTXHDQGPXOWLSOHEJUDGLHQWIDF WRUYDOXHVFDQDVVHVVWKHPDQLIHVWDWLRQVRIDFXWHSDQFUHDWLWLVXVLQJQRFRQWUDVW PDWHULDODQGKDVWKHSRWHQWLDORIEHFRPLQJDSRZHUIXOWRROIRUWKHHYDOXDWLRQDQG IROORZXSRIWKHVHSDWLHQWV P6Y7KHPRVWLPSRUWDQWLQGLFDWLRQIRU&&7ZDVVXVSHFWHG&$' IROORZHGE\HYDOXDWLRQRIFRURQDU\VWHQW,QSDWLHQWV WKHUHZDVDVWUHVVWHVWSULRUWR&&7 0RVWRIWKH&&7ZHUHSHUIRUPHGLQRXWSDWLHQW VHWWLQJVDQGDPLQRULW\LQLQSDWLHQWVVHWWLQJV:HUHSRUWHG FOLQLFDOHYHQWVPDLQO\UHODWHGWRFRQWUDVWPDWHULDORIZKLFKWKHPDMRULW\ ZHUHPLOGDQGQRQHZDVVHYHUH,QRIWKHFDVHV&&7 ÀQGLQJVLPSDFWHGSDWLHQWPDQDJHPHQW &RQFOXVLRQ&&7LVSHUIRUPHGZLWKGLIIHUHQWZRUNORDGVDQGSURÀOHLQSDUWLFLSDWLQJ FHQWUHV7KHPRVWLPSRUWDQWLQGLFDWLRQIRU&&7LVGHWHFWLRQH[FOXVLRQRIVXVSHFWHG &$' &&7 LPDJLQJ LV D VDIH SURFHGXUH DQG LWV UHVXOWV KDYH VWURQJ LPSDFW RQ SDWLHQWPDQDJHPHQW % 3UHYDOHQFHRI05,GHWHFWHGXQUHFRJQLVHGP\RFDUGLDOLQIDUFWLRQDQG LWVUHODWLRQWRFHUHEUDOLVFKDHPLFOHVLRQVLQERWKJHQGHUV &(EHOLQJ%DUELHU51\ODQGHU57KHPXGR+$KOVWURP //LQG(0/DUVVRQ7 %MHUQHU/-RKDQVVRQ8SSVDOD6( &KDUORWWH(EHOLQJB%DUELHU#UDGLROXXVH 3XUSRVH 7 R LQYHVWLJDWH WKH SUHYDOHQFH RI XQUHFRJQLVHG P\RFDUGLDO LQIDUFWLRQ 80,GHWHFWHGZLWKPDJQHWLFUHVRQDQFHLPDJLQJ05,DQGZKHWKHULWLVUHODWHG WRFHUHEUDOLVFKDHPLFOHVLRQVRQ05,LQDQHOGHUO\SRSXODWLRQEDVHGFRKRUW 0HWKRGVDQG0DWHULDOV&HUHEUDO05,DQGFDUGLDFODWHHQKDQFHPHQW/(05, ZHUHSHUIRUPHGRQUDQGRPO\VHOHFWHG\HDUROGVXEMHFWVZRPHQ PHQ,PDJHVZHUHDVVHVVHGIRUFHUHEUDOLVFKDHPLFOHVLRQVDQG0,VFDUV0HGLFDO UHFRUGVZHUHVFUXWLQLVHG6XEMHFWVZLWK0,VFDUVZLWKRUZLWKRXWDKRVSLWDOGLDJQRVLV RI0,ZHUHFODVVLÀHGDV50,RU80,UHVSHFWLYHO\ 5HVXOWV80,VZHUHIRXQGLQVXEMHFWVDQG50,VLQ7KHSUHYD OHQFHRI80,VS DQG50,VS ZDVJUHDWHULQPHQWKDQLQZRPHQ 0HQZLWK50,GLVSOD\HGDQLQFUHDVHGSUHYDOHQFHRIFRUWLFDODQGODFXQDUFHUHEUDO LQIDUFWLRQVZKHUHDVZRPHQZLWK80,PRUHIUHTXHQWO\KDGFRUWLFDOFHUHEUDOLQIDUF WLRQVS &RQFOXVLRQ0,VFDUVDUHPRUHIUHTXHQWLQPHQWKDQLQZRPHQDW\HDUVRI DJH7KHSUHYDOHQFHRI50,LVUHODWHGWRWKDWRIFHUHEUDOLQIDUFWLRQV7KLVPLJKW RQO\DSSO\WRPHQZKHUHDVZRPHQZLWK80,GLVSOD\DQLQFUHDVHGSUHYDOHQFHRI FRUWLFDOFHUHEUDOLQIDUFWLRQV)XUWKHUVWXGLHVDUHQHHGHGWRFODULI\JHQGHUVSHFLÀF PRUELGLW\FRUUHODWLRQVDQGULVNV % $JHDQGVH[UHODWHGGLIIHUHQFHVLQRXWFRPHEDVHGRQFRURQDU\ FRPSXWHGWRPRJUDSK\DQJLRJUDSK\SUHOLPLQDU\UHVXOWVIURPWKH ,WDOLDQ1DWLRQDO3525(&$'5HJLVWU\ (0DIIHL &0DUWLQL00LGLUL66HLWXQ05HQJR95XVVR 0)UDQFRQH) &DGHPDUWLUL0RQDVWLHUGL7UHYLVR,73DOHUPR,7*HQRD,7 /DWLQD,7%RORJQD,75RPH,7 3XUSRVH7 RDVVHVVWKHSURJQRVWLFYDOXHRIVOLFHFRURQDU\FRPSXWHGWRPRJ UDSK\DQJLRJUDSK\&&7$LQUHODWLRQWRDJHDQGJHQGHU 0HWKRGVDQG0DWHULDOV:HHYDOXDWHGDFRKRUWRISDWLHQWVZLWKRXWNQRZQ &$'ZKRXQGHUZHQWDVOLFH&&7$7KHSULPDU\HQGSRLQWZDVWKHRFFXUUHQFHRI P\RFDUGLDOLQIDUFWLRQKRVSLWDOLVDWLRQIRUXQVWDEOHDQJLQDDQGGHDWKIURPDOOFDXVHV 8QLYDULDEOHDQGPXOWLYDULDEOH&R[SURSRUWLRQDOKD]DUGVPRGHOVZHUHGHYHORSHG WRDVVHVVSRWHQWLDOSUHGLFWRUV 5HVXOWVSDWLHQWVKDG\HDUVPDOHDQGWKHUHPDLQLQJKDG \HDUVPDOH7KHSUHYDOHQFHRIQRUPDOFRURQDU\DUWHULHVZDVQ ZKHUHDV WKH SUHYDOHQFH RI QRQVLJQLÀFDQW VWHQRVLV DQGVLJQLÀFDQW &$'ZDVUHVSHFWLYHO\Q DQGQ $WDPHDQIROORZXSRI GD\V HYHQWV KDG RFFXUUHG ,Q ULVNDGMXVWHG DQDO\VLV RE VWUXFWLYHSDQGQRQREVWUXFWLYHS &$'FRQIHUUHGLQFUHDVHGULVN FRPSDUHGZLWKSDWLHQWVZLWKRXWHYLGHQW&$'7KHQXPEHURIGLVHDVHGVHJPHQWV S DQGWKHQXPEHURIVHJPHQWVS DQGYHVVHOVS ZLWKVLJ QLÀFDQW&$'ZHUHLQGHSHQGHQWSURJQRVWLFLQGLFDWRUV1RVLJQLÀFDQWGLIIHUHQFHVLQ RXWFRPHZHUHREVHUYHGEHWZHHQPDOHDQGIHPDOHSDWLHQWVLQHDFKDJHFDWHJRULHV RU\HDUV6LJQLÀFDQW&$'ZDVDQLQGHSHQGHQWSUHGLFWRURIHYHQWVIRUERWK SDWLHQWVZLWK\HDUVDQG\HDUVDQGLQPDOHEXWQRWIRUIHPDOHSDWLHQWV )RUIHPDOHSDWLHQWVLQGHSHQGHQWSUHGLFWRUVZHUHWKHQXPEHURIYHVVHOVS DQGVHJPHQWVS ZLWKVLJQLÀFDQW&$' &RQFOXVLRQ 3UHVHQFH RI VLJQLÀFDQW &$' LV DVVRFLDWHG ZLWK D SRRU SURJQRVLV &&7$KDVWKHSRWHQWLDOWRLPSURYHULVNVWUDWLÀFDWLRQDFFRUGLQJWRDJHDQGVH[ 6FLHQWLILF6HVVLRQ 6 &$' ( ) *+% (XURSHDQ&RQJUHVVRI 5DGLRORJ\ 5HVXOWVQ RIVLJPRLGYROYXOXVKDGDQRUJDQRD[LDOFRQÀJXUDWLRQZLWK RQHWUDQVLWLRQSRLQW7KHZKLUOVLJQZDVWKHPRVWIUHTXHQWGLDJQRVWLFVLJQVHHQLQ RIWKHFDVHVXVLQJPXOWLSODQDUUHFRQVWUXFWLRQVDQGVWDFNPRGHYLHZLQJ7KHUH ZDV QR VLJQLÀFDWLYH GLIIHUHQFH EHWZHHQ WKH PHVHQWHULFRD[LDO DQG RUJDQRD[LDO IRUPLQWHUPVRIFOLQLFDOVHYHULW\PHDQDJHVLJPRLGORRSRSDFLÀFDWLRQE\HQHPD UHFLGLYHUDWHDIWHUFRQVHUYDWLYHWUHDWPHQW2QO\SDULHWDOLVFKDHPLFVLJQVODFNRI HQKDQFHPHQWSDULHWDOWKLFNHQLQJDQGSQHXPDWRVLVLQWHVWLQDOLVZHUHFRUUHODWHG ZLWKFOLQLFDOO\SURYHGLVFKDHPLDS &RQFOXVLRQ7KHPRVWIUHTXHQWFRQÀJXUDWLRQRIVLJPRLGYROYXOXVLVWKHRUJDQR D[LDO W\SH 7KH ZKLUO VLJQ LV FRQVWDQWO\ IRXQG 3DULHWDO LVFKDHPLF &7 VLJQV DUH DVVRFLDWHGZLWKSURYHGLVFKDHPLD % $EGRPLQDO&7LQHPHUJHQF\KRZWRDYRLGWKHPLVVHGGLDJQRVLVRI DSSHQGLFLWLV (3DFH$)LOLSSRQH5&LDQFL9%LDQFR*(VSRVLWR$&RWURQHR&KLHWL,7 3XUSRVH7 RHVWDEOLVKWKHFDXVHVRIPLVVHGGLDJQRVLVRIDSSHQGLFLWLVRQPXOWL GHWHFWRUURZ&70'&7 0HWKRGVDQG0DWHULDOV:HLQFOXGHGSDWLHQWVZLWKSURYHQDSSHQGLFLWLVIRU ZKRPWKHGLDJQRVLVZDVPLVVHGRQSUHRSHUDWLYH0'&7 $FRQWUROJURXSRISD WLHQWVZLWKDFRUUHFW0'&7GLDJQRVLVRIDSSHQGLFLWLVZDVVHOHFWHGIRUFRPSDULVRQ 7ZRH[SHULHQFHGUDGLRORJLVWVZKRZHUHDZDUHRIWKHGLDJQRVLVRIDSSHQGLFLWLVUH HYDOXDWHG0'&7LPDJHVRIWKHFDVHDQGWKHFRQWUROJURXSV7KHFDVHDQGFRQWURO JURXS&7IHDWXUHVZHUHFRPSDUHGXVLQJWKH)LVFKHUҋVH[DFWWHVW 5HVXOWV 6LJQLÀFDQW GLIIHUHQFHV ZHUH IRXQG UHJDUGLQJ WKH SRVLWLRQ RI FDHFDO SROHSDSSHQGLFROLWKS DSSHQGLFHDOLQÁDPPDWRU\FKDQJHV S VWUDQGLQJRISHULDSSHQGLFHDOIDWSÁXLGFROOHFWLRQDQGRUJDV EXEEOHVS VPDOOERZHOREVWUXFWLRQRUFRORQLFGLYHUWLFXORVLVS DPRXQWRISHULFDHFDOIDWS DQGFOLQLFDOKLVWRU\S &RQFOXVLRQ.QRZOHGJHRIWKHFDXVHVRILQFRUUHFWGLDJQRVLVRIDSSHQGLFLWLVDOORZV WRDYRLGIDOVHQHJDWLYH&7UHSRUWV % $FXWHERZHOLVFKDHPLDDQDO\VLVRIGLDJQRVWLFHUURUE\SULPDULO\ RYHUORRNHGÀQGLQJVDWPXOWLGHWHFWRU&7DQJLRJUDSK\ 0)LUHWWR$$/HPRV$0DULQL(&RQWHVVLQL$YHVDQL3 %LRQGHWWL0LODQ,7 FULVWLQDI #OLEHURLW 3XUSRVH7 RUHWURVSHFWLYHO\HYDOXDWHWKHIUHTXHQF\DQGW\SHRIÀQGLQJVWKDWZHUH PLVVHGLQWKHRULJLQDOUHSRUWRIPXOWLGHWHFWRU&7DQJLRJUDSK\0'&7$LQSDWLHQWV ZLWKVXVSHFWHGDFXWHERZHOLVFKDHPLD 0HWKRGVDQG0DWHULDOV)URP-DQXDU\XQWLO0DUFKSDWLHQWV PDOHVIHPDOHVPHDQDJH\HDUVZKRXQGHUZHQW0'&7$*(/LJKW 6SHHG :LVFRQVLQ 86$ DQG VXUJHU\ ZHUH LQFOXGHG LQ WKH VWXG\7KH UHSRUWV RI WKH LQLWLDO &7 ZHUH UHWURVSHFWLYHO\ FRPSDUHG WR WKH GLVFKDUJH GLDJQRVLV DQG RSHUDWLRQUHSRUWV'LVFUHSDQWRUPLVVLQJÀQGLQJVZHUHDQDO\VHGIRUWHFKQLFDODQG RUGLDJQRVWLFHUURUVE\UHHYDOXDWLQJ0'&7$LPDJHVDQGGLYLGHGLQWRUHOHYDQW DQGQRWUHOHYDQWIRUWKHGLDJQRVLV 5HVXOWV,QSDWLHQWVDOOÀQGLQJVZHUHFRUUHFWO\GLDJQRVHGLQWKHLQLWLDO 0'&7$,QWKHUHPDLQLQJSDWLHQWVOHVLRQVWKDWZHUHQRWUHSRUWHGZHUH SUHVHQWDWVXUJHU\,QSDWLHQWVRYHUORRNHGÀQGLQJVZHUHUHOHYDQWDQG VXEWOH,QSDWLHQWVZLWKERZHOGLODWLRQDQGIUHHÁXLGLQZKRPWKH0'&7$ RYHUORRNHGÀQGLQJVZHUHFODVVLÀHGDVQRQUHOHYDQWERZHOLVFKDHPLDZDVIRXQG DWVXUJHU\:LWKUHWURVSHFWLYHLPDJHLQWHUSUHWDWLRQDOPRVWDOOSDWLHQWVZLWK ERZHOLVFKDHPLDZHUHFRUUHFWO\LGHQWLÀHGZKHUHDVWKHUHPDLQLQJSDWLHQWV ZLWKQRQRFFOXVLYHLVFKDHPLDDWVXUJHU\VKRZHGQRQUHOHYDQWÀQGLQJVDW0'&7$ DOVRDWWKHUHWURVSHFWLYHDQDO\VLV &RQFOXVLRQ$ERXWRIUHOHYDQWÀQGLQJVRIERZHOLVFKDHPLDZHUHRYHUORRNHG E\WKHLQLWLDO0'&7$LQWHUSUHWDWLRQPRVWO\ZHUHVXEWOHÀQGLQJV+RZHYHUVHFRQG DU\UHDGLQJRI0'&7$VFDQVUHYHDOHGPRVWRIWKHVHÀQGLQJVDQGFDQVHUYHWR LPSURYHGLDJQRVWLFSHUIRUPDQFH % &7GLDJQRVLVRIQDWXUHRIERZHOREVWUXFWLRQVPRUSKRORJLFDO HYDOXDWLRQRIWKHWUDQVLWLRQDOSRLQW 00RVFKHWWD7 &RVPR) %LQHWWL$6FDUGDSDQH$$6WDELOH,DQRUD *$QJHOHOOL%DUL,7PDUFRPRVFKHWWD#JPDLOFRP 3XUSRVH7KLVVWXG\DLPVWRHYDOXDWHWKHPRUSKRORJ\RIWKHWUDQVLWLRQDOSRLQWLQ GHÀQLQJWKHQDWXUHRIERZHOREVWUXFWLRQV 0HWKRGVDQG0DWHULDOV&7H[DPLQDWLRQVRISDWLHQWVDIIHFWHGE\VHYHUHERZHO REVWUXFWLRQRIQHRSODVWLFRULJLQRIQRQQHRSODVWLFRULJLQZHUHUHWURVSHFWLYHO\ HYDOXDWHGDQGWKHPRUSKRORJ\RIWKHWUDQVLWLRQDOSRLQWZDVFRQVLGHUHG % (UHFWFKHVWUDGLRJUDSKLQWKHVHWWLQJRIWKHDFXWHDEGRPHQ HVVHQWLDOWRRORUZDVWHRIUHVRXUFHVDQGXQQHFHVVDU\ 6$OD]]DZL :6SUHQJHU'H5RYHU*0RUULV6WLII0+/HZLV/RQGRQ8. 1RWWLQJKDP8.&OHYHODQG2+86/ODQWULVDQW8. 3XUSRVH 7 R UHYLHZ WKH TXDQWLW\ DQG TXDOLW\ RI UHTXHVWV IRU HPHUJHQF\ FKHVW UDGLRJUDSKV&;5LQSDWLHQWVSUHVHQWLQJZLWKDEGRPLQDOV\PSWRPV7KH5R\DO &ROOHJHRI5DGLRORJ\5&5UHFRPPHQGVD&;5ZLWKVXVSHFWHGYLVFRXVSHUIRUD WLRQWRH[FOXGHDLUXQGHUWKHGLDSKUDJPEXWGRHVQRWVXSHUVHGHDWKRURXJKFOLQLFDO H[DPLQDWLRQDQGVKRXOGQRWEHGRQHURXWLQHO\ 0HWKRGVDQG0DWHULDOV$UHWURVSHFWLYHDQDO\VLVRIDOOSDWLHQWVDGPLWWHGWRWKH 5R\DO*ODPRUJDQ+RVSLWDO8.ZLWKDFXWHDEGRPLQDOSDLQZDVGRQHIRUPRQWKV LQ,QFOXVLRQFULWHULDVXUJLFDODGPLVVLRQVZLWKDEGRPLQDOSDLQDJHGRYHU 7KHUHTXHVWVDQGUHSRUWVRIWKH&;5VZHUHHYDOXDWHGDQGFRPSDUHGWRQDWLRQ DOO\DFFHSWHGJXLGHOLQHVSURGXFHGE\WKH5&5WRORRNDWWKHDSSURSULDWHQHVVRI WKHUHTXHVWV 5HVXOWVSDWLHQWVSUHVHQWHGZLWKDFXWHDEGRPLQDOSDLQKDGDQHUHFW&;5 RQDGPLVVLRQ2IWKHVHZHUHFOLQLFDOO\VLJQLÀFDQWVKRZLQJSRVVLEOHPHGLFDO FDXVHVIRUWKHSDLQDQGDOWHULQJPDQDJHPHQW2QO\ZHUHVXUJLFDOO\VLJQLÀFDQW VKRZLQJIUHHJDVXQGHUWKHGLDSKUDJP,WLVDUJXDEOHWKDWRIKDG XQQHFHVVDU\ &;5V ZKLFK FRQWULEXWHG QR QHZ LQIRUPDWLRQ WRZDUGV WUHDWLQJ WKH SDWLHQW ,Q IDFW LI QR ROG UDGLRORJ\ UHFRUGV ZHUH DYDLODEOH WKLV FRXOG KDYH EHHQ PLVOHDGLQJDVRIKDGDEQRUPDOÀQGLQJVRIZKLFKQRQHZHUHQHZ &RQFOXVLRQ 9DVW URRP WR UHGXFH XQQHFHVVDU\ &;5V EHLQJ RUGHUHG 6WULFWHU DGKHUHQFHWRWKH5&5JXLGHOLQHV/LPLWLQJWKH&;5UHTXHVWVLQWKHSUHVHQFHRI DEGRPLQDO SDLQ XQOHVV WKHUH DUH YHU\ FOHDU LQGLFDWLRQV RU XQOHVV ÀUVW UHYLHZHG E\JHQHUDOVXUJHU\%\LPSOHPHQWLQJJXLGHOLQHVDQGWUXVWLQJFOLQLFDOÀQGLQJVFDQ UHGXFHWKHÀQDQFLDOUDGLDWLRQDQGWLPHFRVWV % 3UHGLFWLRQRIERZHOQHFURVLVH[WHQWEDVLQJRQWKHGHJUHHRIERZHO GLODWDWLRQGHWHFWHGE\&7UHFRQVWUXFWLRQV 00RVFKHWWD$$6WDELOH,DQRUD) /RUXVVR07 HOHJUDIR$6FDUGDSDQH *$QJHOHOOL%DUL,7PDUFRPRVFKHWWD#JPDLOFRP 3XUSRVH7KLVVWXG\DLPVWRFRUUHODWHWKHGHJUHHRIERZHOGLODWDWLRQGHWHFWHGE\ FRPSXWHGWRPRJUDSK\&7DQGWKHH[WHQWRIERZHOQHFURVLVLQSDWLHQWVDIIHFWHG E\PHVHQWHULFLQIDUFWLRQ 0HWKRGVDQG0DWHULDOV)RUW\VHYHQSDWLHQWVDIIHFWHGE\ERZHOLQIDUFWLRQGXHWR YDVFXODUREVWUXFWLRQZHUHDVVHVVHGE\0'&7H[DPLQDWLRQVHDUFKLQJIRUSDWKRJQR PRQLFVLJQVRILVFKDHPLDDQGIRUWKHGHJUHHRIERZHOGLODWDWLRQVXEGLYLGHGLQWR JURXSVHQWLUHVPDOOERZHO6%RI6%RI6%ODUJHERZHORQO\7ZR EOLQGHGUDGLRORJLVWVHYDOXDWHGPXOWLSODQDUDQG'WUDQVSDUHQWZDOOUHFRQVWUXFWLRQV &RKHQ VNDSSDVWDWLVWLFVZDVXVHGLQRUGHUWRDVVHVVLQWHUREVHUYHUDJUHHPHQW &7ÀQGLQJVZHUHWKHQFRUUHODWHGZLWKWKHPRUWDOLW\UDWH 5HVXOWV$UWHULDO YDVFXODU REVWUXFWLRQ ZDV IRXQG LQ RI FDVHV DQG YHQRXV WKURPERVLVLQWKHUHPDLQLQJ7KHRYHUDOOPRUWDOLW\UDWHZDVZLWKD YDOXHIRUDUWHULDOIRUPVDQGLQFDVHRIYHQRXVLQIDUFWLRQV7KHHQWLUH6%GLODWD WLRQRUD6%GLODWDWLRQFRUUHODWHGZLWKSRRUSURJQRVLVLQDOOFDVHVD 6%GLODWDWLRQFRUUHODWHGZLWKJRRGSURJQRVLVLQRIFDVHV $ODUJHERZHORQO\ GLODWDWLRQGLGQRWVKRZDVLJQLÀFDQWSURJQRVWLFYDOXH$OPRVWSHUIHFWDJUHHPHQW EHWZHHQWKHWZRUHDGHUVZDVIRXQGN &RQFOXVLRQ $OWKRXJKERZHOGLODWDWLRQGRHVQRWUHSUHVHQWDVSHFLÀFVLJQRIERZHO LVFKDHPLDZKHQDVVRFLDWHGZLWKRWKHUSDWKRJQRPRQLF&7ÀQGLQJVLWFDQSURYLGH XVHIXOSURJQRVWLFLQIRUPDWLRQEHFDXVHD6%GLODWDWLRQFRUUHODWHVZLWKKLJKHU H[WHQWRIERZHOQHFURVLVDQGZLWKSRRUSURJQRVLV % )LQGLQJVRIVLJPRLGYROYXOXVDW&7 $)XVWLHU0&-XOOHV0=LQV3DULV)5DQQHIXVWLHU#JPDLOFRP 3XUSRVH7KHREMHFWLYHRIWKLVVWXG\ZDVWRDVVHVVWKHIHDWXUHVRIVLJPRLGYRO YXOXVDW&7 0HWKRGVDQG0DWHULDOV7KLVZDVDUHWURVSHFWLYHDQDO\VLVRIFDVHVRIVLJPRLG YROYXOXVLQPHQDQGIRXUZRPHQH[SORUHGE\&7ZLWKLQKRXUVEHIRUHVXUJL FDOQ RUHQGRVFRSLFQ WUHDWPHQW,QFDVHV&7ZDVDVVRFLDWHGZLWK FRQWUDVWHQHPD7ZRUDGLRORJLVWVDVVHVVHGLQFRQVHQVXVWKH&7GLDJQRVWLFVLJQV DQG WKH WRSRJUDSKLFDO W\SH RI YROYXOXV RUJDQRD[LDO RU PHVHQWHULFRD[LDO7KH FOLQLFDO UDGLRORJLFDO DQG HYROXWLYH IHDWXUHV RI WKH SDWLHQWV ZHUH FRUUHODWHG ZLWK WKHWRSRJUDSKLFDOW\SHRIYROYXOXV)LVKHUH[DFWWHVWDQG0DQQ:KLWQH\8WHVW 7KH&7VLJQVRIVHYHULW\ZHUHFRUUHODWHGZLWKLVFKDHPLFÀQGLQJVLQHQGRVFRS\RU SDWKRORJ\)LVFKHUH[DFWWHVW 6FLHQWLILF6HVVLRQ $ 6&'()*+%(XURSHDQ&RQJUHVVRI 5DGLRORJ\ 0RQGD\ 5RRP3 3K\VLFVLQ5DGLRORJ\ 66 'RVHRSWLPLVDWLRQDQGDVVHVVPHQWLQ&7 0RGHUDWRUV .%DFKHU*HQW%( -*HOHLMQV/HLGHQ1/ % 'RVHUHGXFWLRQZLWKDXWRPDWHGDWWHQXDWLRQEDVHGWXEHSRWHQWLDO VHOHFWLRQLQSDWLHQWVZLWKWHVWLFXODUFDQFHU 5*QDQQW$:LQNOHKQHU'(EHUOL$.QXWK+$ONDGKL=XULFK&+ UDOSKJQDQQW#XV]FK 3XUSRVH7 RSURVSHFWLYHO\HYDOXDWHLQSDWLHQWVZLWKWHVWLFXODUVHPLQRPDWKHUDGLD WLRQGRVHVDYLQJSRWHQWLDODQGLPDJHTXDOLW\RIDQRYHODOJRULWKPZKLFKDXWRPDWL FDOO\VHOHFWVWXEHSRWHQWLDOEDVHGRQWKHSDWLHQWVҋDWWHQXDWLRQIURPWKHWRSRJUDP 0HWKRGV DQG 0DWHULDOV )RUW\ FRQVHFXWLYH SDWLHQWV PHDQ %0, NJ P ZLWK WHVWLFXODU VHPLQRPD XQGHUZHQW FRQWUDVWHQKDQFHG WKRUDFRDEGRPLQDO VHFWLRQ&7ZLWKDXWRPDWHGWXEHSRWHQWLDOVHOHFWLRQ&DUHN9DOOKDGDIRUHJR LQJWKRUDFRDEGRPLQDO&7VWXG\DWN9DXWRPDWHGWXEHFXUUHQWPRGXODWLRQ UHIP$V7ZRLQGHSHQGHQWUHDGHUVVHPLTXDOLWDWLYHO\DVVHVVHGLPDJHTXDO LW\ WZR RWKHUV PHDVXUHG REMHFWLYH LPDJH TXDOLW\ SDUDPHWHUV 'RVH LQIRUPDWLRQ &7',YROZDVQRWHG 5HVXOWV,QWKHN9VFDQVHIIHFWLYHWXEHFXUUHQWZDVHIIP$VUDQJH HIIP$VIRUWKHFKHVWDQGHIIP$VUDQJHHIIP$VIRUWKH DEGRPHQ:LWK&DUHN9HIIHFWLYHWXEHFXUUHQWVLJQLÀFDQWO\LQFUHDVHGWRHII P$VUDQJHHIIP$VIRUFKHVWDQGHIIP$VUDQJHHIIP$V IRUDEGRPLQDOVFDQV8VHRI&DUHN9OHGWRDWXEHSRWHQWLDOUHGXFWLRQWRN9 LQFKHVWDQGDEGRPLQDODQGWRN9LQVFDQVWXEHSRWHQWLDOLQFUHDVHGWR N9LQRQHSDWLHQWERWKFKHVWDQGDEGRPHQ2YHUDOO&7',YROZDVVLJQLÀFDQWO\ ORZHUIRU&DUHN9P*\P*\FRPSDUHGWRN9P*\ P*\S1RQHRIWKHGDWDVHWVZDVRIQRQGLDJQRVWLFLPDJHTXDO LW\:LWK&DUHN9VLJQDOWRQRLVHUDWLRZDVVLJQLÀFDQWO\ORZHUIRUERWKFKHVWDQG DEGRPHQ S FRQWUDVWWRQRLVH UDWLR VLJQLÀFDQWO\ KLJKHU LQ WKH DEGRPHQ SDQGVLPLODULQWKHFKHVWS &RQFOXVLRQ$VFRPSDUHGWRDSURWRFROZLWKÀ[HGN9XVHRIWKHDXWRPDWHG WXEH SRWHQWLDO VHOHFWLRQ DOJRULWKP IRU WKRUDFRDEGRPLQDO &7 \LHOGV FRPSDUDEOH LPDJHTXDOLW\DWDUHGXFHGUDGLDWLRQGRVHE\ % 6FUHHQLQJ&7FRORQRJUDSK\ZLWKVOLFHVFDQQLQJFRPSDULVRQRI UDGLDWLRQULVNVDQGEHQHÀWV .3HULVLQDNLV ,6HLPHQLV$(3DSDGDNLV$7]HGDNLV-'DPLODNLV ,UDNOLRQ*5$OH[DQGURXSROLV*5SHULVLQD#PHGXRFJU 3XUSRVH7 RHVWLPDWHDQGFRPSDUHWKHFXPXODWLYHOLIHWLPHDWWULEXWDEOHULVN/$5 RIUDGLDWLRQLQGXFHGFDQFHUIRUSDWLHQWVHQUROOHGLQDTXLQTXHQQLDOVFUHHQLQJ&7 FRORQRJUDSK\&7&SURJUDPWRFRUUHVSRQGLQJQRPLQDOOLIHWLPHLQWULQVLFULVN/,5 RIFDQFHUDQGWKHULVNRIQRWSHUIRUPLQJDQ\VFUHHQLQJWHVW 0HWKRGVDQG0DWHULDOV $0RQWH&DUORVLPXODWLRQVRIWZDUHGHGLFDWHGIRU&7GRVLP HWU\ZDVXVHGWRGHWHUPLQHDEVRUEHGGRVHVWRSULPDULO\H[SRVHGUDGLRVHQVLWLYH RUJDQVRILQGLYLGXDOVVXEMHFWHGWRVFUHHQLQJ&7&RQDVOLFH&7VFDQQHU 2UJDQVSHFLÀFDQGWRWDO/$5VRIFDQFHUZHUHGHWHUPLQHG7KHFXPXODWLYH/$5VIRU \HDUVROGLQGLYLGXDOVVXEMHFWHGWRVFUHHQLQJ&7&HYHU\ÀYH\HDUVXQWLOWKHDJH RI\HDUVZHUHHVWLPDWHG7KHFRUUHVSRQGLQJ/,5VRIFDQFHUDQGWKHULVNRIQRW SHUIRUPLQJWKHVFUHHQLQJWHVWZHUHHVWLPDWHGXVLQJWKHODWHVWFDQFHUVWDWLVWLFVGDWD 5HVXOWV 7KH FXPXODWLYH /$5 RI UDGLDWLRQLQGXFHG FDQFHU IURP UHSHDWHG TXLQ TXHQQLDOVFUHHQLQJ&7&EHWZHHQWKHDJHVRIDQG\HDUVZDVHVWLPDWHGWR EHZLWKKDOIRIWKHUDGLDWLRQLQGXFHGFDQFHUVDVVXPHGWREHIDWDO7KH FRUUHVSRQGLQJLQFUHDVHLQWKH/,5RIFDQFHULQFLGHQFHZDVLQFUHDVHGE\OHVVWKDQ ,IQRWVFUHHQHGRIWKHHQWLUH86SRSXODWLRQEHWZHHQDQG\HDUV DUHH[SHFWHGWRGHYHORSFRORUHFWDOFDQFHUGXULQJWKHLUUHPDLQLQJOLIHDQGGLHIURP LW7KHFRUUHVSRQGLQJYDOXHIRUWKHVFUHHQHGSRSXODWLRQPD\GURSGRZQWR DWWKHH[SHQVHRIDGGLWLRQDOWKHRUHWLFDOUDGLDWLRQLQGXFHGFDQFHUGHDWKV &RQFOXVLRQ5DGLDWLRQULVNGRHVQRWFRQVWLWXWHDEDUULHUIRUDFFHSWLQJ&7&DVD ÀUVWOLQHPDVVVFUHHQLQJWRROIRUFRORUHFWDOFDQFHU 5HVXOWV7KHWUDQVLWLRQDOSRLQWZDVGHWHFWHGLQSDWLHQWVDQGLWVPRUSKRORJ\ ZDVFRQFDYHLQFDVHVOLQHDULQFRQYH[LQDVFRPSDUHG ZLWKWKHSUR[LPDOORRS$FRQFDYHPRUSKRORJ\RIWKHWUDQVLWLRQDOSRLQWLQGLFDWHGD QRQQHRSODVWLFFRQGLWLRQZLWKVHQVLWLYLW\VSHFLÀFLW\SRVLWLYHSUHGLFWLYHYDOXH339 QHJDWLYHSUHGLFWLYHYDOXH139DQGGLDJQRVWLFDFFXUDF\YDOXHVRI DQG UHVSHFWLYHO\$ OLQHDU DVSHFW SUHVHQWHG DOPRVW WKH VDPH LQFLGHQFHDPRQJQHRSODVWLFDQGQRQQHRSODVWLFFRQGLWLRQV $FRQYH[ DVSHFWFRUUHODWHGZLWKDQHRSODVWLFSDWKRORJ\ZLWKVHQVLWLYLW\VSHFLÀFLW\339139 DQGGLDJQRVWLFDFFXUDF\YDOXHVRIDQGUHVSHFWLYHO\ &RQFOXVLRQ,QFDVHRIERZHOREVWUXFWLRQWKHGHWHFWLRQRIWKHWUDQVLWLRQDOSRLQW LQGLFDWHVWKHVLWHRIREVWUXFWLRQZKLOHLWVPRUSKRORJLFDOHYDOXDWLRQFDQFRQWULEXWH WRGHÀQHWKHQDWXUH$FRQFDYHPRUSKRORJ\LQGLFDWHVDQRQQHRSODVWLFFRQGLWLRQ ZLWKDKLJKSUREDELOLW\DFRQYH[PRUSKRORJ\FRUUHODWHVZLWKDQHRSODVWLFSDWKRORJ\ ZKLOHDOLQHDULW\LVQRWVLJQLÀFDQW % $EGRPLQDOSDHGLDWULFWUDXPDUDGLRORJLFÀQGLQJVDQGPDQDJLQJLQ VROLGYLVFHUDLQMXU\ -*XLEHUQDX/LVLWDQR -,5LER*HURQD(6(VSOXJXHVGHO/OREUHJDW(6 3XUSRVH7KHVWXG\DLPHGWRLQYHVWLJDWHWKHPHWKRGRIPDQDJHPHQWDQGGLDJ QRVLVRISDHGLDWULFEOXQWWUDXPDZLWKVROLGYLVFHUDLQMXU\DQGGHWHUPLQHWKHUROHRI XOWUDVRXQGDQGFRPSXWHGWRPRJUDSK\LPDJHRQLW 0HWKRGVDQG0DWHULDOV:HXQGHUWRRND\HDUUHWURVSHFWLYHDXGLWRIFKLOGUHQ DGPLWWHGWRWKH6DQW-RDQGH'qX+RVSLWDO%DUFHORQD6SDLQZLWKDKRVSLWDOFRGHG GLDJQRVLVZKLFKLQFOXGHGKHSDWLFVSOHQLFNLGQH\SDQFUHDWLFDQGDGUHQDOLQMXU\ EHWZHHQDQG'DWDLQFOXGHGSDWLHQWGHPRJUDSKLFVUHVXOWVRIDQ\DFXWH FRPSXWHGWRPRJUDSK\DQGRUXOWUDVRXQGLPDJLQJRIWKHRUJDQVUHODWHGUHVXOWVRI DQ\VXUJLFDOÀQGLQJVDQGRXWFRPH 5HVXOWVRIWKHSDWLHQWVQ ZHUHPDOHVDQGIHPDOHVWKH PHDQDJHZDV\HDUVUDQJH8OWUDVRXQGZDVWKHÀUVWOLQHH[DPLQDWLRQ LQSDWLHQWVDQGFRPSXWHGWRPRJUDSK\LQSDWLHQWV ZHQWWRKDYHDFRPSXWHGWRPRJUDSK\DIWHUXOWUDVRXQGHYDOXDWLRQIUHHÁXLGDVWKH RQO\XOWUDVRXQGÀQGLQJPRVWRIWKHPZKLWTXHVWLRQDEOHQRLPSDFWLQWKHUDSHXWLF GHFLVLRQ7KHUDGLRORJLFÀQGLQJVLQFOXGHGVSOHHQLQMXU\LQRIFKLOGUHQ NLGQH\OLYHUSDQFUHDVDQGDGUHQDOJODQGV&RQVHUYDWLYHPDQ DJHPHQWZDVWKHFKRLFHLQFDVHVDOOWKH\KDHPRG\QDPLFDOO\VWDEOHFDVHV ZHUHXQGHUJRLQJDFXWHLQWHUYHQWLRQERWKRIWKHKDHPRG\QDPLFDOO\XQVWDEOH FDVHVKDGSRVWWUDXPDFRPSOLFDWLRQVVXFKDVXULQRPDDQGSDQFUHDWLFSVHXGRF\VWV &RQFOXVLRQ 8OWUDVRXQG LV WKH ÀUVWOLQH LPDJLQJ LQ SDHGLDWULF EOXQW DEGRPLQDO WUDXPD7KHDUHQRHVWDEOLVKHGJXLGHOLQHVWRDVVHVSDHGLDWULFFRPSXWHGWRPRJ UDSK\DQGPRVWRIWKHVWXGLHVKDYHTXHVWLRQDEOHLPSDFWLQWKHUDSHXWLFGHFLVLRQ % &(86XVHIXOQHVVLQWKHFKDUDFWHULVDWLRQRIKDHPRG\QDPLF DEQRUPDOLWLHVDVVRFLDWHGZLWKHQGROHDNIROORZLQJHQGRYDVFXODU WUHDWPHQWRIDEGRPLQDODRUWLFDQHXU\VPV ) 3LQWR&$FDPSRUD$3LQWR5)DULQD61LFRWUD/5RPDQR1DSOHV,7 ISLQWR #OLEHURLW 3XUSRVH7 RUHYHDOWKHXVHIXOQHVVRIFRQWUDVWHQKDQFHG86&(86LQWKHGH WHFWLRQDQGWKHFKDUDFWHULVDWLRQRIKDHPRG\QDPLFDEQRUPDOLWLHVDVVRFLDWHGZLWK HQGROHDNLQSDWLHQWVSUHYLRXVO\VXEPLWWHGWRHQGRYDVFXODUWUHDWPHQWRIDEGRPLQDO DRUWLFDQHXU\VPV(9$5 0HWKRGVDQG0DWHULDOV)URP-DQXDU\WR-XO\FRQVHFXWLYHSDWLHQWV PDOHV DQG IHPDOHV PHDQ DJH \HDUV ROG XQGHUZHQW WUHDWPHQW RI DEGRPLQDODRUWLFDQHXU\VPV(9$5 $WGLDJQRVWLFVXUYHLOODQFHERWKDPXOWLGHWHF WRUFRPSXWHGWRPRJUDSK\DQJLRJUDSK\0'&7$H[DPDQGD&(86H[DPZHUH SHUIRUPHGLQDOOWKHSDWLHQWVDIWHUPRQWKPRQWKVDQGPRQWKVUHVSHFWLYHO\ 5HVXOWV $W0'&7 LQSDWLHQWVQRFRPSOLFDWLRQZDVUHYHDOHGZKHUHDVLQWKH UHPDLQLQJFDVHVWKHSUHVHQFHRIDYDVFXODUFRPSOLFDWLRQZDVVKRZQDW\SH ,,HQGROHDNLQFDVHVDQGDW\SH,HQGROHDNLQWKHUHPDLQLQJFDVHV $W&(86WKHGLDJQRVLVRIDW\SH,,HQGROHDNZDVREWDLQHGLQDOOWKHFDVHV 0RUHRYHULQFDVHVZLWKW\SH,,HQGROHDN&(86RXWSHUIRUPHG0'&7$ÀQG LQJVE\HDUO\GHSLFWLQJVLQFHWKHÀUVWRUWKHVHFRQGFRQWURODQLQFUHDVHRIWKH LQÁRZRXWÁRZUDWLRRIWKHFRQWUDVWDJHQWLQWKHVDFIROORZHGE\DQHXU\VPGLDPHWHU HQODUJHPHQWDWWKHVHFRQGRUWKLUGIROORZXSH[DPV &RQFOXVLRQ&(86UHSUHVHQWVDYDOLGDOWHUQDWLYHWRROLQWKHVXUYHLOODQFHRIYDVFXODU FRPSOLFDWLRQVLQSDWLHQWVVXEPLWWHGWRHQGRYDVFXODUWUHDWPHQWRIDEGRPLQDODRUWLF DQHXU\VPV (9$5 7KLV PHWKRG FDQ EH XVHIXO IRU EHWWHU GHSLFWLQJ HQGROHDNV IHDWXUHVWKDWPD\QRWEHVHHQDW0'&7$H[DP 6FLHQWLILF6HVVLRQ 6 &$' ( ) *+% (XURSHDQ&RQJUHVVRI 5DGLRORJ\ ERWKWXEHVDWN9ZLWKWKHWRWDOP$VZDVHTXDOO\GLVWULEXWHGRQERWKWXEHV&7', DQGGRVHOHQJWKSURGXFWRIWKHVFDQZHUHHTXDOWRWKHVWDQGDUGLQVWLWXWLRQDOSURWR FRO)RU)'6DQG)',UHFRQVWUXFWLRQVGDWDRIERWKWXEHVZHUHXVHGZKHUHDV+', UHFRQVWUXFWLRQVZHUHFDOFXODWHGXVLQJRQO\GDWDIURPWXEH$RIWKH'6&7V\VWHP RIWRWDOP$V4XDQWLWDWLYHLPDJHTXDOLW\ZDVDVVHVVHGE\PHDVXULQJLPDJH QRLVHLQGLIIHUHQWWLVVXHVRIWKHQHFNWKRUD[DQGDEGRPHQ2YHUDOOGLDJQRVWLFLPDJH TXDOLW\ZDVDVVHVVHGE\WZRUDGLRORJLVWVXVLQJDSRLQW/LNHUWVFDOH'LIIHUHQFHV EHWZHHQUHFRQVWUXFWLRQWHFKQLTXHVZHUHFRPSDUHG 5HVXOWV,PDJHQRLVHVLJQLÀFDQWO\GHFUHDVHGLQDOODQDWRPLFUHJLRQVZKHQ)',DQG +',UHVSHFWLYHO\ZDVFRPSDUHGWR)'6UHFRQVWUXFWLRQVDOOS ,PDJHTXDOLW\RI)',PHGLDQDQG+',PHGLDQZDVUDWHGVLJQLÀFDQWO\KLJKHU ZKHQFRPSDUHGWR)'6PHGLDQUHFRQVWUXFWLRQVERWKS)',ZDVUDWHG DVWKHEHVWLQ+',VHFRQGEHVWLQDQG)%6DVWKHWKLUGEHVWUHFRQVWUXF WLRQWHFKQLTXHLQUHJDUGLQJLPDJHTXDOLW\DOOS &RQFOXVLRQ 6XEMHFWLYH DQG REMHFWLYH LPDJH TXDOLW\ RI )', DQG +', DSSHDU WR EHVXSHULRUWR)'6UHFRQVWUXFWLRQWKXVHQDEOLQJGRVHUHGXFWLRQLQZKROHERG\ O\PSKRPDVWDJLQJ&7 % &7HYDOXDWLRQRIFRURQDU\DUWHU\VWHQWVSRWHQWLDOIRUUDGLDWLRQGRVH UHGXFWLRQXVLQJLWHUDWLYHLPDJHUHFRQVWUXFWLRQWHFKQLTXHV +(EHUVEHUJHU ) 7ULFDULFR3 $SIDOWUHU59OLHJHQWKDUW7 $OOPHQGLQJHU *5RZH$/HEHU(+RIIPDQQ86FKRHSI&KDUOHVWRQ6&86 *URQLQJHQ1/)RUFKKHLP'(0XQLFK'(HEHUVEHUJHU#JP[QHW 3XUSRVH 3DWLHQWV ZLWK FRURQDU\ VWHQWV UHTXLUH IUHTXHQW IROORZXS VR WKDW ORZ UDGLDWLRQGRVHWHFKQLTXHVDUHGHVLUDEOH:HFRPSDUHGGLDJQRVWLFLPDJHTXDOLW\ IRUVWHQWHYDOXDWLRQLQIXOOUDGLDWLRQGRVH&7VWXGLHVUHFRQVWUXFWHGZLWKWUDGLWLRQDO ÀOWHUHGEDFNSURMHFWLRQ)%3ZLWKVWXGLHVDWKDOIWKHUDGLDWLRQGRVHXVLQJVLQRJUDP DIÀUPHGLWHUDWLYHUHFRQVWUXFWLRQ6$),5( 0HWKRGVDQG0DWHULDOVLPSODQWHGFRURQDU\VWHQWVZHUHHYDOXDWHGE\VOLFH GXDO VRXUFH &7 '6&7 ,PDJH GDWD ZHUH UHFRQVWUXFWHG DW IXOOGRVH ZLWK )%3 DQGDWKDOIGRVHZLWK6$),5(XVLQJFRUUHVSRQGLQJNHUQHOV+DOIGRVHGDWDZHUH UHFRQVWUXFWHGXVLQJSURMHFWLRQGDWDIURPRQO\RQH'6&7WXEHGHWHFWRUFRQÀJXUD WLRQ ,QVWHQW VLJQDOWRQRLVHUDWLR 615 ZDV PHDVXUHG DQG LPDJH TXDOLW\ ZDV JUDGHGRQDÀYHSRLQWVFDOH H[FHOOHQW QRQGLDJQRVWLF7 RREMHFWLYHO\DVVHVV WKHHIIHFWRQEHDPKDUGHQLQJDUWHIDFWVYROXPHVRIVWHQWVZHUHPHDVXUHGXVLQJ GHGLFDWHGYROXPHDQDO\VLVVRIWZDUH6WHQWOXPHQDWWHQXDWLRQLQFUHDVHUDWLR6$,5 ZDV FDOFXODWHG >LQVWHQW DWWHQXDWLRQYHVVHO DWWHQXDWLRQLQVWHQW DWWHQXDWLRQ@ 6WDWLVWLFDODQDO\VLVXVHGSDLUHGWDQGFKLVTXDUHWHVWLQJ 5HVXOWV0HDQIXOOHIIHFWLYHGRVHZDVP6Y6LJQLÀFDQWLQVWHQWVWHQRVHV ZHUHSUHVHQWLQVWHQWVZKLFKZHUHFRUUHFWO\LGHQWLÀHGZLWKERWKUHFRQVWUXFWLRQ PHWKRGVFRPSDUHGZLWKFRURQDU\DQJLRJUDSK\,QVWHQW615ZDVKLJKHUIRUKDOI GRVH6$),5(FRPSDUHGZLWK)%3YVSZKLOHWKH6$,5 ZDVFRQVLGHUDEO\ORZHUYVS,QDGGLWLRQLPDJHTXDOLW\ZDV IRXQGWREHVLJQLÀFDQWO\SEHWWHUZKHQLWHUDWLYHUHFRQVWUXFWLRQZDVDSSOLHG YV6WHQWYROXPHVWHQGHGWREHORZHUZKHQUHFRQVWUXFWHGZLWK KDOIGRVH6$),5(PPYVPPS &RQFOXVLRQ'HVSLWHXVLQJKDOIGRVHLPDJHGDWDLWHUDWLYHUHFRQVWUXFWLRQLPSURYHV HYDOXDWLRQRIFRURQDU\VWHQWVE\UHGXFLQJLPDJHQRLVHDQGEHDPKDUGHQLQJDUWH IDFWVDQGLPSURYLQJYLVXDOLVDWLRQRIWKHLQVWHQWOXPHQ % '1$GDPDJHUHSDLUNLQHWLFVIURPLRQLVLQJUDGLDWLRQLQWKHUDQJHRI GRVHVH[SHULHQFHGLQ&7VWXGLHV 656D[RQ0.KDWRQDEDGL0) 0F1LWW*UD\6*5XHKP.6,ZDPRWR /RV$QJHOHV&$86VURELQVD[RQ#JPDLOFRP 3XUSRVH7 RTXDQWLI\WKHNLQHWLFVRIWKHFHOOXODUUHVSRQVHWRDUDQJHRIORZ&7 UHOHYDQWGRVHVRILRQLVLQJUDGLDWLRQ,5LQPRXVHWXPRXULQÀOWUDWLQJO\PSKRF\WHV 7LOLQYLWUR 0HWKRGVDQG0DWHULDOV7LOFHOOVZHUHSODFHGLQWKHFHQWUHFKDPEHURIWKH&'7, KHDGSKDQWRPDQGLUUDGLDWHGZLWKP*\P*\P*\P*\RUP*\ UHSRUWHG&7',YROYDOXHVXVLQJD6,(0(166RPDWRP6HQVDWLRQ&7VFDQQHU &HOOXODUNLQHWLFVRI'1$GDPDJHDQGUHVSRQVHZHUHTXDQWLÀHGE\ÁRZF\WRPHWULF TXDQWLWDWLRQRIJDPPD+$;IRFLDWWKUHHWLPHSRLQWVPLQKUDQGKUVSRVW ,5DWURRPWHPSHUDWXUH$QRQLUUDGLDWHGFRQWUROZDVLQFOXGHGIRUHDFKVDPSOH &ROOHFWHGÁRZF\WRPHWU\GDWDFRUUHFWHGIRUGHEULVDQGGHDGFHOOVXVLQJVLGHDQG IRUZDUGVFDWWHUJDWLQJZHUHDQDO\VHGZLWK&HOO4XHVW3UR6RIWZDUH)OXRUHVFHQFH KLVWRJUDPVZHUHJHQHUDWHGDQGWKHPHGLDQÁXRUHVFHQFHRIHDFKWUHDWPHQWVDPSOH ZDVFRPSDUHGWRLWVUHVSHFWLYHFRQWURODQGUHSRUWHG % 5HGXFWLRQRIHIIHFWLYHDQGRUJDQGRVHWRWKHH\HOHQVLQFHUHEUDO 0'&7VFDQVXVLQJLWHUDWLYHLPDJHUHFRQVWUXFWLRQ -=L]ND--DQGXUD7 .YDVQLFND-*UHSO+UDGHF.UDORYH&= 3XUSRVH7 RFRPSDUHHIIHFWLYHUDGLDWLRQGRVHDQGGRVHWRWKHH\HOHQVLQ0'&7 EUDLQH[DPLQDWLRQVXWLOLVLQJHLWKHUVWDQGDUGÀOWHUHGEDFNSURMHFWLRQ)%3WHFKQLTXH RULWHUDWLYHUHFRQVWUXFWLRQLQLPDJHVSDFH,5,6 0HWKRGV DQG 0DWHULDOV 2I 0'&7 DGXOW EUDLQ H[DPLQDWLRQV ZHUH SHUIRUPHGXVLQJVWDQGDUG)%3DQGXVLQJ,5,6$OOVFDQVZHUHSHUIRUPHGRQ 6LHPHQV6RPDWRP'HÀQLWLRQ$6V\VWHPZLWKSDUDPHWHUVWXEHYROWDJHN9 )%3 ,5,6 UHIHUHQFH P$V YDOXH )%3 DQG ,5,6 SLWFK IDFWRU URWDWLRQWLPHVHF'RVHVZHUHFDOFXODWHGIURP&7GRVHLQGH[&7',YROP*\ DQG GRVH OHQJWK SURGXFW '/3 P*\FP YDOXHV XWLOLVLQJ ,P3$&7 VRIWZDUH WKH RUJDQ GRVH WR WKH OHQV ZDV GHULYHG IURP WKH DFWXDO WXEH FXUUHQWWLPH SURGXFW YDOXHDSSOLHGWRWKHOHQV 5HVXOWV7KHDYHUDJH&7',YROZDVLQ)%3DQGLQ,5,6UHVSHFWLYHO\ GHFUHDVH7KHDYHUDJH'/3ZDV)%3DQG,5,6UHVSHFWLYHO\ GHFUHDVH7KHDYHUDJHHIIHFWLYHVFDQGRVHZDVP6Y)%3DQG P6Y,5,6UHVSHFWLYHO\GHFUHDVH7KHDYHUDJHRUJDQGRVHWR WKHH\HOHQVGHFUHDVHGIURPP*\)%3WRP*\,5,6 GHFUHDVH1RVLJQLÀFDQWFKDQJHLQGLDJQRVWLFLPDJHTXDOLW\ZDVQRWHGEHWZHHQ ,5,6DQGVWDQGDUG)%3VFDQVS &RQFOXVLRQ ,WHUDWLYH UHFRQVWUXFWLRQ RI FHUHEUDO 0'&7 H[DPLQDWLRQV HQDEOHV UHGXFWLRQRIWKHHIIHFWLYHGRVHE\DWOHDVWRQHWKLUG&RUUHVSRQGLQJUHGXFWLRQRIWKH RUJDQGRVHWRWKHOHQVLVRIKLJKLPSRUWDQFHGXHWRERWKOHQVUDGLRVHQVLWLYLW\DQGWKH IDFWWKDWWKHOHQVLVFRPPRQO\H[SRVHGWRWKHSULPDU\EHDPLQ0'&7H[DPLQDWLRQV % 8OWUDORZUDGLDWLRQGRVHURZ0'&7 PXOWLFHQWUHFOLQLFDOWULDO WRDVVHVVWKHGLDJQRVWLFIHDVLELOLW\RIPRGHOEDVHGLWHUDWLYH UHFRQVWUXFWLRQXOWUDORZ9HRVWXG\ 5&1HOVRQ $.+DUD:')ROH\(.3DXOVRQ'6DKDQL '%+XVDULN'XUKDP1&863KRHQL[$=860LOZDXNHH:,86 %RVWRQ0$86=XULFK&+ 3XUSRVH &7 FRQWULEXWLRQ WR WKH FROOHFWLYH UDGLDWLRQ GRVH UHPDLQV D GRPLQDQW WRSLF2XUSXUSRVHLVWRFRQÀUPWKHHIIHFWLYHQHVVRIDIXOOPRGHOEDVHGLWHUDWLYH UHFRQVWUXFWLRQ9HRWHFKQLTXHGHVLJQHGWRVLJQLÀFDQWO\UHGXFHUDGLDWLRQGRVHDQG LPSURYHLPDJHTXDOLW\LQSDWLHQWV 0HWKRGVDQG0DWHULDOV7KHSLORWVWXG\LQFOXGHVSDWLHQWVIURPWKUHHLQVWLWX WLRQVLPDJHGLQRQHRIIRXUDQDWRPLFDUPVDQDWRP\SDWKRORJ\LQWKHSRVWHULRU IRVVD OXQJ FDQFHU VWDJLQJUHVWDJLQJ GHWHFWLRQFKDUDFWHULVDWLRQ RI IRFDO OLYHUOHVLRQVRUXUROLWKLDVLV)RUHDFKSDWLHQWWZRGDWDVHWVDUHDFTXLUHGRQWKH 'LVFRYHU\&7+'*(+HDOWKFDUHWULDOVSRQVRUVWDQGDUGRIFDUHUDGLDWLRQ GRVH DQG XOWUDORZ UDGLDWLRQ GRVH %RWK DFTXLVLWLRQV DUH UHFRQVWUXFWHG ZLWK ÀOWHUHGEDFNSURMHFWLRQ)%3DGDSWLYHVWDWLVWLFDOLWHUDWLYHUHFRQVWUXFWLRQ$6L5 DQG9HR7ZRUHDGHUVLQGHSHQGHQWO\DVVHVVFOLQLFDOYDOXHOHVLRQFKDUDFWHULVDWLRQ GLDJQRVWLFFRQÀGHQFHDQGUHFRPPHQGHGWUHDWPHQWIRUHDFKGDWDVHW4XDQWLWDWLYH PHDVXUHPHQWVLQFOXGH&15DQGQRLVH,QLWLDOSLORWVWXG\UHVXOWVZLOOEHSUHVHQWHG DQGZLOOFRQÀUPGHVLJQIRUWKHSDWLHQWJOREDOPXOWLFHQWUHWULDOWRIROORZ 5HVXOWV3ULRUSKDQWRPUHVXOWVTXDQWLWDWLYHDQGREVHUYHULQGLFDWHWKHDELOLW\WR PDLQWDLQURXWLQHGLDJQRVWLFLPDJHTXDOLW\DWGRVHVDVORZDVP6YXVLQJWKLV QHZUHFRQVWUXFWLRQWHFKQLTXH,QLWLDOVWXG\UHVXOWVGHPRQVWUDWHWUDQVODWLRQRIWKHVH ÀQGLQJVLQWRWKHFOLQLFDOSRSXODWLRQIRUHDFKDQDWRPLFDUPHYDOXDWHG &RQFOXVLRQ 7KH SLORW VWXG\ GHPRQVWUDWHV GLDJQRVWLF LPDJH TXDOLW\ LQ SDWLHQW GDWDVHWVUHFRQVWUXFWHGZLWK9HRXVLQJUDGLDWLRQGRVHVGRZQWRP6Y7KHVH UHVXOWVZLOOEHXVHGDVREMHFWLYHHYLGHQFHIRUWKHGHVLJQRIDFRPSUHKHQVLYHJOREDO PXOWLFHQWUHWULDOWRHQFRXUDJHDSSURSULDWHLQWURGXFWLRQLQWRFOLQLFDOSUDFWLFH % )HDVLELOLW\RIGRVHUHGXFWLRQLQZKROHERG\O\PSKRPDVWDJLQJ &7XVLQJLWHUDWLYHUHFRQVWUXFWLRQ 7 +HQ]OHU+-DIDURY00H\HU-6KL6$.OHLQ3 $SIDOWHU626FKRHQEHUJ &)LQN0DQQKHLP'(WKRPDVKHQ]OHU#PHGPDXQLKHLGHOEHUJGH 3XUSRVH3DWLHQWVZLWKO\PSKRPDDUHDWKLJKHUULVNRIVHFRQGDU\PDOLJQDQFLHV GXHWRUDGLRWKHUDS\DQGIUHTXHQWIROORZXSVWDJLQJ&7 :HDLPHGWRV\VWHPDWLFDOO\ LQYHVWLJDWHTXDQWLWDWLYHDQGVXEMHFWLYHLPDJHTXDOLW\RIIXOOGRVHVWDQGDUG)'6 IXOOGRVHLWHUDWLYH )', DQG KDOIGRVHLWHUDWLYH +', UHFRQVWUXFWLRQV LQ SDWLHQWV ZLWKO\PSKRPD 0HWKRGVDQG0DWHULDOV7 RDFTXLUHIXOOGRVHDQGKDOIGRVH&7VLPXOWDQHRXVO\ FRQWUDVWHQKDQFHGZKROHERG\VWDJLQJ&7ZDVSHUIRUPHGZLWKD'6&7 RSHUDWLQJ 6FLHQWLILF6HVVLRQ $ 6&'()*+%(XURSHDQ&RQJUHVVRI 5DGLRORJ\ 0RQGD\ % 5DGLDWLRQGRVHUHGXFWLRQZLWKPRGHOEDVHGLWHUDWLYHUHFRQVWUXFWLRQ HYDOXDWLRQLQGLIIHUHQWSDWLHQWVL]HVDQGWXEHYROWDJHVHWWLQJV$ SKDQWRPVWXG\ '%+XVDULN '0DULQ65LFKDUG(6DPHL7 $-DIIH 7 $-DIIH05%DVKLU5&1HOVRQ=XULFK&+'XUKDP1&86 GDQLHODKXVDULN#\DKRRFRP 3XUSRVH7 RFRPSDUHLPDJHTXDOLW\RIDEGRPLQDO&7VFDQVDWGLIIHUHQWUDGLDWLRQ GRVHOHYHOVUHFRQVWUXFWHGIURPWKHVDPHUDZGDWDVHWVZLWKDVWDQGDUGFRQYROX WLRQ ÀOWHUHG EDFN SURMHFWLRQ )%3 DQG D PRGHOEDVHG LWHUDWLYHUHFRQVWUXFWLRQ DOJRULWKP0%,5 0HWKRGVDQG0DWHULDOV$QDQWKURSRPRUSKLFSKDQWRPLQWKUHHVL]HVZDVXVHG ZLWKDFXVWRPEXLOWOLYHULQVHUWVLPXODWLQJODWHKHSDWLFDUWHULDOHQKDQFHPHQWDQG FRQWDLQLQJ K\SHUYDVFXODU OLYHU OHVLRQV RI YDULRXV VL]HV ,PDJLQJ ZDV SHUIRUPHG RQ D VHFWLRQ PXOWLGHWHFWRUURZ &7 0'&7 VFDQQHU 'LVFRYHU\&7 +' *(+HDOWKFDUH:DXNHVKD:,DWGLIIHUHQWWXEHYROWDJHVIRUHDFKSDWLHQWVL]H DQGLQFUHPHQWDOO\GHFUHDVLQJWXEHFXUUHQWWLPHSURGXFWVIRUHDFKWXEHYROWDJH 4XDQWLWDWLYHDQDO\VLVFRQVLVWHGRIFRQWUDVWWRQRLVHUDWLR&15FDOFXODWLRQVDQG LPDJH QRLVH DVVHVVPHQW 4XDOLWDWLYH LPDJH DQDO\VLV ZDV SHUIRUPHG E\ WKUHH LQGHSHQGHQWUDGLRORJLVWVUDWLQJVXEMHFWLYHLPDJHTXDOLW\DQGOHVLRQFRQVSLFXLW\ 5HVXOWV&15RQ0%,5LPDJHVZDVVLJQLÀFDQWO\KLJKHUDQGPHDQLPDJHQRLVH ZDVVLJQLÀFDQWO\ORZHUWKDQRQ)%3LPDJHVLQDOOSDWLHQWVL]HVDWDOOWXEHYROW DJHVHWWLQJVDQGUDGLDWLRQGRVHOHYHOV32YHUDOOLPDJHTXDOLW\DQGOHVLRQ FRQVSLFXLW\ZHUHUDWHGKLJKHUIRU0%,5LPDJHVFRPSDUHGWR)3%LPDJHVDWDOO UDGLDWLRQGRVHOHYHOV,PDJHTXDOLW\DQGOHVLRQFRQVSLFXLW\RQGRVH0%,5 LPDJHVZHUHUDWHGHTXDOWRIXOOGRVH)%3LPDJHV &RQFOXVLRQ&RPSDUHGWR)%3 0%,5DOORZVIRUDWRUHGXFWLRQLQUDGLDWLRQ GRVHIRUDEGRPLQDO&7LPDJLQJZLWKRXWFRPSURPLVLQJTXDQWLWDWLYHDQGTXDOLWDWLYH LPDJHTXDOLW\ 5RRP4 3DHGLDWULF 66 %RG\DQGERQHV 0RGHUDWRUV $'&DOGHU/RQGRQ8. +-0HQW]HO-HQD'( % $GGLWLRQDOYDOXHRI)'*3(7LQSDUWLDOUHVSRQGHUVRQ&7 GDWD GHULYLQJIURPDPXOWLFHQWULF,WDOLDQSDHGLDWULF+'VWXG\ (/RSFL 5%XUQHOOL$&LVWDUR$3LFFDUGR/*XHUUD$&KLWL 3 =XFFKHWWD6)DQWL5R]]DQR,7)HUUDUD,77RULQR,7*HQRD,7 0RQ]D,73DGXD,7%RORJQD,7HJHVWDORSFL#JPDLOFRP 3XUSRVH,QWKLVVWXG\ZHSUHVHQWRXUÀQGLQJVLQSDHGLDWULF+RGJNLQҋVGLVHDVH+' SDWLHQWVHYDOXDWHGZLWKWKHDLPWRHVWDEOLVK)'*3(7UROHLQWKHDVVHVVPHQWRI SDWLHQWVVKRZLQJDSDUWLDOUHVSRQVH35RQ&7ERWKDWLQWHULPDQGHQGWUHDWPHQW HYDOXDWLRQ 0HWKRGVDQG0DWHULDOV:HDQDO\VHGSDHGLDWULF+'SDWLHQWVPHDQDJH \HDUVXQGHUZHQW)'*3(7LQYHVWLJDWLRQVDWLQWHULPRUDIWHUFRPSOHWLRQRIWKHUDS\ DQGVKRZLQJD35RQ&7 3(7GDWDZHUHUHSRUWHGDVQHJDWLYHQRHYLGHQFHRI GLVHDVHQRSDWKRORJLFXSWDNHRUSRVLWLYHIRUGLVHDVH$OOUHVXOWVZHUHVWDWLVWLFDOO\ DQDO\VHGZLWKUHVSHFWWR3)6RQDPHDQIROORZXSRIPRQWKV 5HVXOWV$V H[SHFWHG &7 UHVSRQVH ERWK DW LQWHULP DQG DW WKH HQGWUHDWPHQW HYDOXDWLRQGLGQRWUHVXOWVLJQLÀFDQWO\FRUUHODWHGZLWK3)6S DQG UHVSHFWLYHO\2QWKHRWKHUKDQGLQWKLVVDPHSRRORISDWLHQWVDOVR)'*3(7DW LQWHULPGLGQRWUHVXOWVWDWLVWLFDOO\VLJQLÀFDQWS ZKHUHDVZKHQSHUIRUPHG DWWKHHQGRIWUHDWPHQW3(7GDWDZHUHKLJKO\SUHGLFWLYHDQGUHVXOWHGVLJQLÀFDQWO\ FRUUHODWHGZLWK3)6S 2QWKHXQLYDULDWHDQDO\VLVGDWDZHUHFRQÀUPHG DV VR GHPRQVWUDWLQJ WKDW RQO\ HQGWUHDWPHQW 3(7 ZDV SUHGLFWLYH S ZKHUHDVRQWKHPXOWLYDULDWHDQDO\VLVQRQHRIWKHLPDJLQJWHFKQLTXHVZDVVLJQLÀFDQW &RQFOXVLRQ7KHVHUHVXOWVVXJJHVWWKDWWKHPRVWUHOLDEOHYDOXHLQGLIIHUHQWLDWLQJ UHDOUHVSRQVHLQSDHGLDWULF+'SDWLHQWVSUHVHQWLQJZLWKD35RQ&7LV)'*3(7 SHUIRUPHGDIWHUFRPSOHWLRQRIWKHUDS\ 5HVXOWV,QFHOOVH[SRVHGWRP*\RUP*\JDPPD+$;VLJQDOUHDFKHGD SHDNYDOXHDWDSSUR[LPDWHO\KUDQGWKHQEHJDQWRGURS,QFRQWUDVWFHOOVH[SRVHG WRP*\P*\DQGP*\VKRZHGGLIIHUHQWUHSDLUNLQHWLFSDWWHUQV &RQFOXVLRQ 2XU UHVXOWV VXJJHVW '1$ GDPDJH PD\ EH UHSDLUHG E\ GLIIHUHQW PHFKDQLVPV LQ D GRVHGHSHQGHQW PDQQHU 7KLV DOWHUHG NLQHWLF UHVSRQVH FRXOG KDYH PDUNHG ELRORJLFDO HIIHFWV IRU FXUUHQW UDGLRGLDJQRVWLF SURFHGXUHV 2XU VWXG\WKHUHIRUHXQGHUVFRUHVWKHLPSRUWDQFHRIXQGHUVWDQGLQJWKHGLIIHUHQWUHSDLU PHFKDQLVPVDWGLIIHUHQWGRVHUHJLRQVLQRUGHUWRDFFXUDWHO\DVVHVVULVNHVWLPDWHV DQGELRORJLFDOGRVH % 2UJDQGRVHFRUUHODWLRQZLWKDQDWWHQXDWLRQEDVHGSDWLHQWVL]HPHWULF 0.KDWRQDEDGL$7XUQHU'=KDQJ*&KX$%DQROD'2ULD -'H0DUFR&&DJQRQ00F1LWW*UD\/RV$QJHOHV&$86 7XFVRQ$=86PNKDWRQDEDGL#PHGQHWXFODHGX 3XUSRVH3UHYLRXVZRUNLQFOXGLQJ$$307 DVN*URXSKDYHGHVFULEHGWKH HIIHFWRIVL]HRQSDWLHQWUDGLDWLRQGRVHIURP&7H[DPV7KHSXUSRVHRIWKLVVWXG\ ZDV WR LQYHVWLJDWH WKH UHODWLRQVKLS EHWZHHQ RUJDQ GRVH IURP &7ZLWK GLIIHUHQW SDWLHQWVL]HPHWULFVLQFOXGLQJRQHEDVHGRQSDWLHQWDWWHQXDWLRQ 0HWKRGVDQG0DWHULDOV8VLQJ0RQWH&DUORVLPXODWLRQPHWKRGVSDWLHQWUDGLDWLRQ GRVHIURPÀ[HGDQGWXEHFXUUHQWPRGXODWHGVFDQVZHUHHVWLPDWHGDQGQRUPDO LVHGE\VFDQQHUUHSRUWHG&7',YROIRUDGXOWPDOHDQGIHPDOHSDWLHQWPRGHOV 7KHVHPRGHOVZHUHJHQHUDWHGIURPWXEHFXUUHQWPRGXODWHGDEGRPHQSHOYLV&7 VFDQV 'RVHV ZHUH WDOOLHG LQ WKUHH RUJDQV OLYHU NLGQH\V DQG VSOHHQ )RU HDFK SDWLHQW VHYHUDO VL]H PHWULFV ZHUH FDOFXODWHG LQFOXGLQJ WKH VTXDUH URRW RI WKH LPDJHDWWHQXDWLRQDUHDSHULPHWHUDQGPD[LPXPODWHUDOZLGWKDQG$3WKLFNQHVV 7KHFRUUHODWLRQEHWZHHQQRUPDOLVHGRUJDQGRVHDQGHDFKRIWKHVHPHWULFVZDV FDOFXODWHGDQGFRPSDUHG 5HVXOWV)RUÀ[HGWXEHFXUUHQWVFDQVWKHFRUUHODWLRQZLWKRUJDQGRVHZDVJUHDWHVW IRULPDJHDWWHQXDWLRQDQGSHULPHWHU5 +RZHYHUIRUWXEHFXUUHQWPRGX ODWHGVFDQVLPDJHDWWHQXDWLRQVKRZHGWKHEHVWFRUUHODWLRQZLWKGRVH5 ZKHUHDVSHULPHWHU$3WKLFNQHVVDQGODWHUDOZLGWKSURGXFHGORZHUFRUUHODWLRQV 5RIDQGUHVSHFWLYHO\ &RQFOXVLRQ$QDWWHQXDWLRQEDVHGSDWLHQWVL]HPHWULFFDQEHXVHGWRHVWLPDWH GRVHIURPERWKÀ[HGDQGWXEHFXUUHQWPRGXODWHGVFDQV,WLVDEHWWHUSDWLHQWVL]H LQGLFDWRU IRU WXEH FXUUHQW PRGXODWHG VFDQV WKDQ SHULPHWHU GXH WR LWV DELOLW\ WR WDNHLQWRDFFRXQWWKHDWWHQXDWLRQRISDWLHQWVZKLFKLVDOVRXVHGLQWXEHFXUUHQW PRGXODWLQJDOJRULWKPV % 7KHHIIHFWRI&7GRVHUHGXFWLRQRQSHUIRUPDQFHRIDGLDJQRVWLFWDVN '=KDQJ0.KDWRQDEDGL&0-XGH(=DUDJR]D+.LP0/HH '$QGUHZV7 DQJ&3RRQ0'RXHN03DWHO/'RHSNH60F1LWW*UD\ &&DJQRQ-'H0DUFR00F1LWW*UD\/RV$QJHOHV&$86 VNLQWFKHQ]KDQJ#JPDLOFRP 3XUSRVH6HYHUDOVWXGLHVKDYHLQYHVWLJDWHGWUDGHRIIVEHWZHHQUDGLDWLRQGRVHDQG LPDJHTXDOLW\QRLVHLQ&7LPDJLQJ7KLVVWXG\WRRNWKHDQDO\VLVDVWHSIXUWKHUE\ LQYHVWLJDWLQJWKHWUDGHRIIVEHWZHHQUDGLDWLRQGRVHDQGGLDJQRVWLFSHUIRUPDQFHLQ DFOLQLFDOWDVNGLDJQRVLVRIDSSHQGLFLWLV 0HWKRGVDQG0DWHULDOV7KLVSUHOLPLQDU\VWXG\ZDV,5%DSSURYHGDQGXWLOLVHGGDWD IURPSDWLHQWVZKRXQGHUZHQWFOLQLFDO&7H[DPVIRULQGLFDWLRQVRIDSSHQGLFLWLV 0HGLFDOUHFRUGUHYLHZHVWDEOLVKHGWUXHGLDJQRVLVRIDSSHQGLFLWLVZLWKSRVLWLYHV DQGQHJDWLYHV2ULJLQDODQGVLPXODWHGUHGXFHGGRVHOHYHOV RIRULJLQDOZHUHFUHDWHGZLWKDYDOLGDWHGVRIWZDUHWRROXVLQJUDZSURMHF WLRQGDWDIURPHDFKVFDQ$QREVHUYHUVWXG\ZDVSHUIRUPHGZLWKUDGLRORJLVWV UHYLHZLQJHDFKFDVHDWHDFKGRVHOHYHOLQUDQGRPRUGHURYHUVHYHUDOVHVVLRQV 5HDGHUV DVVHVVHG LPDJH TXDOLW\ DQG SURYLGHG FRQÀGHQFH LQ WKHLUGLDJQRVLV RI DSSHQGLFLWLVHDFKRQDSRLQWVFDOH52&FXUYHVZHUHJHQHUDWHGIRUHDFKGRVH OHYHO$8&DUHDXQGHUFXUYHZDVFDOFXODWHGIRUHDFKGRVHOHYHO 5HVXOWV,QWHULPUHVXOWVRIWKHVWXG\VKRZHGWKDWWKH$8&IRUHDFKRIWKHGRVH OHYHOVZDVDQGIRUGRVHOHYHOVDW DQGUHVSHFWLYHO\2QO\RXWRIUHDGLQJVUHFHLYHG´XQDFFHSW DEOHµLPDJHTXDOLW\UDWLQJVSDWLHQWDWGRVHOHYHO &RQFOXVLRQ7KLVSUHOLPLQDU\VWXG\GHPRQVWUDWHGWUDGHRIIVEHWZHHQUDGLDWLRQGRVH DQGGLDJQRVWLFSHUIRUPDQFHDQGLQGLFDWHGWKDWDHYHQVPDOOGRVHUHGXFWLRQVPD\ DIIHFWGLDJQRVWLFSHUIRUPDQFHVOLJKWO\DQGEODUJHGRVHUHGXFWLRQVPD\VWLOODOORZ DFFHSWDEOHSHUIRUPDQFHOHYHOV 6FLHQWLILF6HVVLRQ 6 &$' ( ) *+% (XURSHDQ&RQJUHVVRI 5DGLRORJ\ LQÁDPPDWLRQDQGWRHYDOXDWHWKHFOLQLFDOVLJQLÀFDQFHRIWKH05(UHVXOWVRQWKH PDQDJHPHQWRISDHGLDWULF,%'SDWLHQWV 0HWKRGVDQG0DWHULDOV)RUW\SURVSHFWLYHSDHGLDWULFSDWLHQWVPHGLDQDJH \HDUVUDQJHZLWKVXVSHFWHGQ RUQHZO\GLDJQRVHGOHVVWKDQIRXU ZHHNVFRQÀUPHG,%'Q ZHUHLQFOXGHGDQGXQGHUZHQWJDVWURLOHRFRORQRVFRS\ ZLWKELRSVLHVIROORZHGE\05(PHGLDQLQWHUYDOGD\VUDQJH7KH05( UHVXOWVZHUHFRPSDUHGZLWKPDFURVFRSLFJROGVWDQGDUGEDVHG3DULVFODVVLÀFD WLRQDQGPLFURVFRSLFDVVHVVPHQWRIWKHLOHXP7KHFOLQLFDOLPSRUWDQFHRI WKH05(UHVXOWVZDVUHJLVWHUHGEDVHGRQSURVSHFWLYHDOWHUDWLRQLQGLDJQRVLVDQG PDQDJHPHQW 5HVXOWV&URKQVGLVHDVH&'ZDVGLDJQRVHGLQFDVHVXOFHUDWLYHFROLWLV8&LQ DQG,%'XQFODVVLÀHG,%'8LQWKUHH0DFURVFRSLFLOHLWLVZDVGHWHFWHGLQ RI&'FDVHVDQGLQRI8&EDFNZDVKLOHLWLV0LFURVFRSLFLQÁDP PDWLRQZDVIRXQGLQDQRWKHUIRXU&'FDVHVDQGRQH,%'8SDWLHQW7KHGLVFUHSDQF\ EHWZHHQJROGVWDQGDUGDQG05(ZDVOHVVWKDQPLFURVFRS\DQGJROGVWDQGDUG7KH VHQVLWLYLW\DQGVSHFLÀFLW\RI05,ZDVDQGUHVSHFWLYHO\05(ÀQGLQJVOHG WRFKDQJHVLQGLDJQRVLVLQDQGWUHDWPHQWLQ &RQFOXVLRQ05(LVDVSHFLÀFPHWKRGIRULPDJLQJRILQWHVWLQDOLQÁDPPDWLRQLQ SDHGLDWULF,%'DQGFDQEHVXSSRUWLYHRUHVVHQWLDOIRUFOLQLFDOWUHDWPHQWGHFLVLRQV 05(KDVORZHUVHQVLWLYLW\LQSDWLHQWVZLWKQHZO\GLDJQRVHG,%'SHUKDSVGXHWR OHVVDGYDQFHGFKDQJHV % 0XOWLSKDVHFRQWUDVWHQKDQFHG05,IRUFRQWURORIVXEDFXWHWUDXPDRI DEGRPHQDQGFKHVWLQFKLOGUHQ $3HWUDLNLQ7 $NKDGRY16HPHQRYD2.DUDVHYD,0HOQLNRY66LGRULQ 0RVFRZ58SHWUDL#UDPEOHUUX 3XUSRVH7UDXPDWLFGDPDJHRIDEGRPHQDQGFKHVWRUJDQVLQFKLOGUHQLVRODWHG DVZHOODVDSDUWRIPXOWLSOHLQMXULHVLVQRWUDUHLQUDGLRORJLFDOGHSDUWPHQWRIDQ HPHUJHQF\KRVSLWDO,QRUGHUWRFRQWUROWKHWUDXPDLQVXEDFXWHSKDVHZHVXJJHVW PXOWLSKDVHFRQWUDVWHQKDQFHG05, 0HWKRGVDQG0DWHULDOV$Q05,XQLWZLWK7ZDVXVHGLQWKHUHVHDUFK:H XVHG7VHTXHQFHH7+5,9(IRUSUHDQGSRVWFRQWUDVWVFDQV*GFRQWUDVWDJHQW EROXV7KHVFDQQLQJZDVRIEUHDWKKROGW\SHZLWKKLJKVSDWLDOUHVROXWLRQ[PP LQSODQHPPVOLFHWKLFNQHVV%HIRUHFRQWUDVWLQMHFWLRQZHXVHG7VHTXHQFHV 05&3 LQ V\QFKURQLVDWLRQ ZLWK EUHDWKLQJ 1DYLJDWRU PHWKRG SDWLHQWV ZLWK VXEDFXWHWUDXPDVFRUHGIURPWRRQLQMXU\VHYHULW\VFRUH,66ZHUHH[DPLQHG 5HVXOWV([DPLQDWLRQVRIVXEDFXWHWUDXPDWLFLQMXULHVLQFKLOGUHQUHYHDOHGGDP DJHV RI SDUHQFK\PDO RUJDQV ZLWK YDULRXV GHJUHHV RI VHYHULW\ OLYHU FDVHV NLGQH\VOXQJVVSOHHQDQGSDQFUHDV(LJKWHHQSDWLHQWVKDG PXOWLSOHLQMXULHV$OOSDWLHQWVGHPRQVWUDWHGSRVLWLYHG\QDPLFRIUHFRYHU\$ELOLW\RI WKHSDWLHQWWRKROGKLVEUHDWKLVQHHGHGFRPSULVLQJRQHRIPDMRUUHVWULFWLRQVIRU XVLQJWKLVPHWKRG7KHSDUWLFXODUVWUHQJWKRIWKLVPHWKRGLVRSSRUWXQLW\WRRYHU FRPHXOWUDVRQRJUDSK\OLPLWDWLRQVJRRGSHUIRUPDQFHLQOXQJVVXEGLDSKUDJPDWLF UHJLRQRIKHSDUHWF &RQFOXVLRQ 0XOWLSKDVH FRQWUDVWHQKDQFHG 05, LV KLJKO\ HIIHFWLYH UDGLRORJLFDO PHWKRGIRUFRQWURORIUHFRYHU\DIWHUFKHVWDQGDEGRPHQWUDXPDLQFKLOGUHQ,WUH GXFHVUDGLDWLRQH[SRVXUHDQGPD\EHVXJJHVWHGDVDPHWKRGRIFKRLFHIRUFKLOGUHQ ZLWKPDMRUWUDXPDXQGHUWDNLQJWUHDWPHQWLQDQHPHUJHQF\KRVSLWDO % 7KHLPSRUWDQFHRIDGYDQFHG05,WHFKQLTXHVDVWKHGHÀQLWLYH GLDJQRVWLFWRROLQWKHGLIIHUHQWLDWLRQEHWZHHQRVWHRP\HOLWLVDQG RVWHRQHFURVLVLQFKLOGUHQZLWKVLFNOHFHOOGLVHDVH $$ODYL-'H/D)XHQWH/RQGRQ8.DODYLBDIVKLQ#\DKRRGH 3XUSRVH$FXWHPXVFXORVNHOHWDOSDLQGXHWRPDUURZLQIDUFWLRQLVE\IDUWKHPRVW IUHTXHQWFOLQLFDOSUHVHQWDWLRQIRUVLFNOHFHOOEXWV\PSWRPVFDQEHVLPLODUWRRVWHR P\HOLWLV05,KDVWKHKLJKHVWVHQVLWLYLW\DQGVSHFLÀFLW\LQGHWHFWLRQRIPDUURZDQG H[WUDRVVHRXVFKDQJHVLQERWKLQIDUFWLRQDQGLQIHFWLRQ$OWKRXJKPXVFXORVNHOHWDO FKDQJHVDUHFRQÀGHQWO\GHWHFWDEOHZLWK05,WKH\FDQEHYHU\VLPLODU7KHSXUSRVH RIWKLVVWXG\ZDVWRLOOXVWUDWHWKHLPSRUWDQFHRI05,DQGWKHDGYDQFHGSURWRFROV LQFOXGLQJ XQHQKDQFHG G\QDPLFHQKDQFHG PXOWLSKDVH VXEWUDFWLRQDQG ZKROH ERG\':,VHTXHQFHV 0HWKRGVDQG0DWHULDOV:HH[DPLQHGFKLOGUHQZLWKVLFNOHFHOOGLVHDVHDFXWH PXVFXORVNHOHWDO SDLQ DQG QRQFKDUDFWHULVWLF V\PSWRPV ZLWK RXU FRPSOHWHG 05, SURWRFRODQGFRUUHODWHGRXUUHVXOWVZLWKWKHFOLQLFDOPLFURELRORJLFDODQGVXUJLFDO GHWDLOVLQRUGHUWRGHWHUPLQHWKHGLDJQRVWLFYDOXHRIRXUVHTXHQFHV 5HVXOWV7KHUHZDVDVLJQLÀFDQWFRUUHODWLRQEHWZHHQRXUUHVXOWVDQGWKHFOLQLFDO UHVXOWVDQGH[FHSWIHZFDVHVZLWKFOHDUGLDJQRVLVWKURXJKXQHQKDQFHGVHTXHQFHV LQPRVWFDVHVSRVWFRQWUDVWG\QDPLFVXEWUDFWLRQDQG':,VHTXHQFHVZHUHUHTXLUHG IRUWKHGLDJQRVLV % 9RLGLQJXURVRQRJUDSK\ZLWKDVHFRQGJHQHUDWLRQFRQWUDVWDJHQW DVDÀUVWVWHSVWXG\IRUWKHGLDJQRVLVDQGJUDGLQJRIYHVLFRXUHWHULF UHÁX[LQFKLOGUHQ $1WRXOLD ) 3DSDGRSRXORX) 3DSDFKULVWRX(6LRPRX.'DUJH ,RDQQLQD*57KHVVDORQLNL*53KLODGHOSKLD3$86 3XUSRVH7 RDVVHVVWKHHIÀFDF\RIYRLGLQJXURVRQRJUDSK\986ZLWKDVHFRQG JHQHUDWLRQFRQWUDVWDJHQW&$DVDÀUVWVWHSVWXG\IRUWKHGLDJQRVLVDQGJUDGLQJ RIYHVLFRXUHWHULFUHÁX[985LQFKLOGUHQ 0HWKRGVDQG0DWHULDOV7ZRKXQGUHGDQGWHQFRQVHFXWLYHFKLOGUHQER\V JLUOVPHDQDJHPRQWKVZLWKNLGQH\XUHWHUXQLWV.88ZHUHHYDOXDWHG ZLWK986WRUXOHRXWQ RUIROORZXSQ 985,QDOOFKLOGUHQ986ZDV SHUIRUPHGZLWKDFRQWUDVWVSHFLÀFKDUPRQLFLPDJLQJPRGHDQGPORIDVHFRQG JHQHUDWLRQ&$6RQRYXH%UDFFR0LODQDFFRUGLQJWR(635ZRUNLQJJURXSUHF RPPHQGDWLRQV7KH986ZDVUHFRUGHGRQGLJLWDOFOLSVDQGUHDGWZLFHE\WZREOLQGHG UDGLRORJLVWV7KHGLDJQRVLVLQGLVFRUGDQWFDVHVZDVUHDFKHGE\FRQVHQVXV7KH LQWUDREVHUYHUDQGLQWHUREVHUYHUUHSURGXFLELOLW\ZDVFDOFXODWHGE\NDSSDFRHIÀFLHQW 5HVXOWV985ZDVGLDJQRVHGLQ.88IURPSDWLHQWV ER\V DQG JLUOV 7KH UDWH RI UHÁX[ ZDV QRW VLJQLÀFDQWO\FRUUHODWHG ZLWK WKHVH[DJHFOLQLFDOLQGLFDWLRQVDQGWKHSUHVHQFHRUVLGHRIGLODWHGSHOYLV985 ZDVVLJQLÀFDQWO\PRUHFRPPRQLQGXSOH[WKDQLQVLQJOHNLGQH\VS7KH LQWUDREVHUYHUDQGLQWHUREVHUYHUUHSURGXFLELOLW\ZDVH[FHOOHQWIRUWKHGHWHFWLRQRI 985N!DQGPRGHUDWHWRH[FHOOHQWIRUWKHJUDGLQJRI985N &RQFOXVLRQ986ZLWKDVHFRQGJHQHUDWLRQ&$LVDQHIÀFLHQWÀUVWVWHSVWXG\IRU WKHGLDJQRVLVDQGJUDGLQJRI985LQFKLOGUHQDQGLWFDQUHOLDEO\EHXVHGDVDQ DOWHUQDWLYHUDGLDWLRQIUHHLPDJLQJPHWKRGIRUWKLVSXUSRVH % &RQWUDVWHQKDQFHGYRLGLQJXURVRQRJUDSK\IRUGLDJQRVLVRI YHVLFRXUHWHULFUHÁX[LQFRPSDULVRQWRFRQYHQWLRQDOPHWKRGVD PHWDDQDO\VLV ) 3DSDGRSRXORX ((YDQJHORX05LFFDERQD$1WRXOLD.'DUJH ,RDQQLQD*5*UD]$73KLODGHOSKLD3$86ISDSDGRSRXORX#KRWPDLOFRP 3XUSRVH7 RDVVHVVWKHGLDJQRVWLFSHUIRUPDQFHRIYRLGLQJXURVRQRJUDSK\986 LQYHVLFRXUHWHUDOUHÁX[985DQGXUHWKUDOSDWKRORJ\GHWHFWLRQFRPSDUHGWRFRQ YHQWLRQDOPHWKRGVSXEOLVKHGLQPHGLFDOOLWHUDWXUH 0HWKRGVDQG0DWHULDOV0HGOLQHZDVVHDUFKHGE\WZRLQGHSHQGHQWREVHUYHUVIRU DOOSRVVLEOHDUWLFOHVSXEOLVKHGXSWR0D\RQ986LQQHRQDWHVLQIDQWVFKLOGUHQ FRPSDUHGWR9&8*RU'51&DQGSHUIRUPHGZLWK/HYRYLVWRU6RQR9XH7KHELYDUL DWHKLHUDUFKLFDOPRGHOZDVFKRVHQIRUVWDWLVWLFDODQDO\VLV,QGLYLGXDOVWXG\UHVXOWV ZHUH SUHVHQWHG JUDSKLFDOO\ E\ SORWWLQJ HVWLPDWHV RI VHQVLWLYLW\ DQG VSHFLÀFLW\ LQ UHFHLYHURSHUDWLQJFKDUDFWHULVWLFV52&DQGH[WHQGHGVXPPDU\52&7KH FRQÀGHQFH LQWHUYDOV &, DQG WKH SRVLWLYH /5 DQG QHJDWLYH /5 OLNHOLKRRG UDWLRVZHUHFDOFXODWHG 5HVXOWVDUWLFOHVZHUHIRXQGFRQFHUQLQJ´XOWUDVRXQGFRQWUDVW985µFRP SDUDWLYHVWXGLHVIXOÀOOHGWKHLQFOXVLRQFULWHULD986VWXGLHVLQFRPSDULVRQZLWK 9&8*DQGZLWK'51&SHUIRUPHGZLWK/HYRYLVWDQGZLWK6RQR9XH7 RWDOO\ FKLOGUHQ ZLWK SHOYRXUHWHUDOXQLWV ZHUH LQFOXGHG IRUDQDO\VLV 986 FRPSDUHGWR9&8*DQG'51&KDGVHQVLWLYLW\&,VSHFLÀFLW\ &,/5/5986SHUIRUPDQFHZDVEHWWHUFRPSDUHGWR'51& WKDQWR9&8*VHQVLWLYLW\VSHFLÀFLW\YHUVXVUHVSHFWLYHO\ DVZHOODVZLWK6RQR9XHFRPSDUHGWR/HYRYLVWVHQVLWLYLW\VSHFLÀFLW\ YHUVXV UHVSHFWLYHO\ 5HJDUGLQJ XUHWKUDO SDWKRORJ\GHWHFWLRQ SDWLHQWV ER\V ZHUH LQFOXGHG ([FHOOHQW LPDJLQJ RI XUHWKUDO DQDWRP\ ZDV UHSRUWHGLQ!RISDWLHQWV &RQFOXVLRQ)URPWKHSXEOLVKHGGDWDWKHUHLVFRQYLQFLQJHYLGHQFHIRUWKHGLDJ QRVWLFSHUIRUPDQFHRI986LQ985GHWHFWLRQFRPSDUHGWR9&8*DQG'51&)RU XUHWKUDOSDWKRORJ\GHWHFWLRQDOWKRXJKUHVXOWVDUHYHU\SURPLVLQJPRUHFRPSDUD WLYHVWXGLHVDUHQHHGHG % 'LDJQRVWLFDFFXUDF\DQGFOLQLFDOVLJQLÀFDQFHRIPDJQHWLF UHVRQDQFHHQWHURJUDSK\RIWKHVPDOOLQWHVWLQHLQFRPSDULVRQZLWK LOHRFRORQRVFRS\LQSDHGLDWULFLQÁDPPDWRU\ERZHOGLVHDVH 8)DJHUEHUJ 057 RUN]DG/%ORPTYLVW++LOGHEUDQG 3 +HOOVWU|P88OOEHUJ9lVWHUnV6(8SSVDOD6(6WRFNKROP6( PLFKDHOWRUN]DG#UDGLROXXVH 3XUSRVH7 RVWXG\WKHGLDJQRVWLFDFFXUDF\RIPDJQHWLFUHVRQDQFHHQWHURJUDSK\ 05( LQ SDHGLDWULF LQÁDPPDWRU\ ERZHO GLVHDVH ,%' LQ GLDJQRVLQJ LQWHVWLQDO 6FLHQWLILF6HVVLRQ $ 6&'()*+%(XURSHDQ&RQJUHVVRI 5DGLRORJ\ 0RQGD\ % (YDOXDWLRQRIDUDGLDWLRQGRVHUHGXFWLRQVWUDWHJ\IRUSDHGLDWULF DEGRPHQ&7 FRPSDULVRQEHWZHHQDXWRPDWLFH[SRVXUHFRQWURODQG ZHLJKWEDVHGP$V < :.LP -< -DQJ+.LP<DQJVDQ.53XVDQ.5M\FM#GDXPQHW 3XUSRVH7KHSXUSRVHRIRXUVWXG\ZDVWRDVVHVVWKHHIIHFWRIDXWRPDWLFH[SRVXUH FRQWUROV\VWHPRQUDGLDWLRQGRVHDQGLPDJHTXDOLW\DWSDHGLDWULFDEGRPHQ&7 0HWKRGV DQG 0DWHULDOV :H UHWURVSHFWLYHO\ VHOHFWHG FKLOGUHQ ZKR XQGHU ZHQWDEGRPHQ&7 IRUVOLFHVLQJOHVRXUFH&7'HÀQLWLRQ$6DQG IRUGXDOVRXUFH&7'HÀQLWLRQ)ODVK$XWRPDWLFH[SRVXUHFRQWURO&DUHGRVH' ZDVDSSOLHGWRRIWKHSDWLHQWVDQGRIWKHUHVSHFWLYHO\)RUHDFK H[DPLQDWLRQWKHWRWDOP$VDQGWKHWRWDOGRVHOHQJWKSURGXFW'/3ZHUHUHFRUGHG DQGWKHHIIHFWLYHGRVHZDVHVWLPDWHGXVLQJWKH'/3PHWKRG['/3$WODVW VLJQDOWRQRLVHUDWLR615 52,6'DQGFRQWUDVWWRQRLVHUDWLR&15 52,DWDRUWD 52,DWSVRDVPXVFOH6'ZHUHFDOFXODWHGIURPWKRVHYDOXHV 5HVXOWV 7KH HIIHFWLYH GRVH P$V YDOXHV ZHUH KLJKHU LQ WKH JURXS ZKR ZHUH DGMXVWHG$(&WKDQWKHYDOXHLQWKHJURXSZLWKZHLJKWEDVHGÀ[HGP$VDQGORZHU WKDQWKHYDOXHLQWKHJURXSZLWKUDQGRPLVHGP$V7KHKLJKHUWKHHIIHFWLYHGRVH ZDVWKHEHWWHU615VDQG&15ZHUH6RZKHQZHSHUIRUPWKHSDHGLDWULFDEGR PHQ&7ZLWKKLJKP$VWKDWGRHVQRWFRQVLGHUWKHLUZHLJKWVWKHLPDJHTXDOLW\ZDV PRVWGHVLUHG+RZHYHUIRUPRVWRIFDVHVZLWK$(&RUZLWKZHLJKWEDVHGP$V LPDJHTXDOLW\ZDVDFFHSWDEOH &RQFOXVLRQ 6LJQLÀFDQW UDGLDWLRQ GRVH UHGXFWLRQ FDQ EH DFKLHYHG IRU URXWLQH SDHGLDWULF DEGRPHQ &7 E\ ZHLJKWEDVHG À[HG P$V 7KHUH ZDV DQ DFFHSWDEOH WUDGHRIIEHWZHHQLQFUHDVHGQRLVHDQGGHFUHDVHGGRVHDQGLPDJHTXDOLW\ZDV FRQVLGHUHGGLDJQRVWLFDOO\DGHTXDWH % ,PSURYHPHQWRILPDJHTXDOLW\LQSDHGLDWULFSDWLHQWVE\ORZHULQJWKH WXEHYROWDJHWRN9DWÀ[HGHIIHFWLYHGRVHLQGLJLWDOUDGLRJUDSK\ 6LPXODWLQJUDGLRJUDSK\RIH[WUHPLWLHV -*URQDX 81HLW]HO5+HVV5:ROI%HUQ&++DPEXUJ'( 3XUSRVH:LWKWKHDGYHQWRIGLUHFWUDGLRJUDSK\LPDJLQJFRQYHQWLRQDODGMXVWPHQWV IRUSDHGLDWULFLPDJLQJKDYHRIWHQEHHQDGRSWHGZLWKRXWFKDQJH5DGLRJUDSK\RI H[WUHPLWLHVRIYHU\\RXQJSDWLHQWVVKRZRQO\OLWWOHLQWULQVLFFRQWUDVWEHFDXVHRIWKH VWLOOLPPDWXUHERQHGHYHORSPHQW,QGLJLWDOUDGLRJUDSK\FRQWUDVWWRQRLVHUDWLRLV EHWWHUDWN9FRPSDUHGWRN9:HH[DPLQHGZKHWKHUWKHUDWHRIFRUUHFWO\GH WHFWHGVXEWOHIUDFWXUHVLPSURYHVDWN9FRPSDUHGWRN9DWÀ[HGHIIHFWLYHGRVH 0HWKRGV DQG 0DWHULDOV$V D SDWLHQW PRGHO VXEWOH JUHHQVWLFN IUDFWXUHV ZHUH JHQHUDWHGLQULEVIURPFDGDYHUVRIIRHWDODQGQHZERUQODPEV5LEVZHUHVXEPHUJHG LQDFPZDWHUVXUURXQGLQJWRVLPXODWHVXUURXQGLQJWLVVXH;UD\LPDJLQJZDV GRQHDWN9P$VDQGN9P$VEHIRUHDQGDIWHUIUDFWXULQJ3UHVHWVDW N9DQGN9OHGWRDVLPLODUHIIHFWLYHGRVHDVFDOFXODWHGE\WKH0RQWH&DUOR 6LPXODWLRQ7KHIUDFWXUHVFRXOGRQO\EHGHWHFWHGE\LUUHJXODULWLHVLQWKHVSRQJLRVD VWUXFWXUH [UD\V IURP ULEV ZLWK LUUHJXODULWLHV LQ WKHLU VKDSHOLNH DQJXODWLRQ ZHUH H[FOXGHG7KUHHUDGLRORJLVWVDQDO\VHG[UD\VHDFK 5HVXOWV7KHUDWHRIFRUUHFWGLDJQRVHVDWN9YVN9ZDVVLJQLÀFDQWO\KLJKHU ZLWKYVYVDQGYV &RQFOXVLRQ ,Q GLJLWDO UDGLRJUDSK\ WKH LPDJH TXDOLW\ FDQ EH LPSURYHG DW À[HG GRVHE\ORZHULQJWKHWXEHYROWDJHWRN9$OWHUQDWLYHO\WKLVPLJKWEHXVHGWR UHGXFHSDWLHQWGRVHPDLQWDLQLQJVXIÀFLHQWLPDJHTXDOLW\ZKLFKZLOOEHH[DPLQHG LQIROORZLQJVWXGLHV &RQFOXVLRQ :KROH ERG\ ':, VHTXHQFHV DUH WKH PRVW HIIHFWLYH IRU GHWHFWLQJ KRWVSRWVLQPXOWLIRFDOSURFHVVZKLFKLVWKHQDWXUHRIVLFNOHFHOOGLVHDVH$OWKRXJK XQHQKDQFHG VHTXHQFHV DUH KHOSIXO WR GHWHUPLQH WKH H[WHQW RI D ORFDO SURFHVV LQPRVWFDVHVWKHPXVFXORVNHOHWDODEQRUPDOLWLHVDUHHLWKHULQRVWHRP\HOLWLVRULQ PDUURZLQIDUFWLRQVLPLODUDQGG\QDPLFSRVWFRQWUDVWDQGVXEWUDFWLRQVHTXHQFHV DUHUHTXLUHGIRUWKHGHÀQLWLYHGLIIHUHQWLDWLRQ2XUUHVXOWVVKRZWKDWDGYDQFHG05, SURWRFROLVDQXOWLPDWHGLDJQRVWLFWRROIRUFRQÀGHQWO\GLIIHUHQWLDWLQJEHWZHHQPDUURZ LQIDUFWLRQDQGLQIHFWLRQLQFKLOGUHQZLWKVLFNOHFHOOGLVHDVH % 3L[HOE\SL[HODQDO\VLVRI'&(05,FXUYHVKDSHVLQNQHHVRIMXYHQLOH LGLRSDWKLFDUWKULWLVSDWLHQWV 5+HPNH&/DYLQL0$-YDQ5RVVXP0YDQGHQ%HUJ.0'ROPDQ 0YDQ9HHQHQGDDO'6FKRQHQEHUJ7 :.XLMSHUV00DDV$PVWHUGDP1/ UKHPNH#DPFQO 3XUSRVH7 RFRPSDUHWKHUHODWLYHQXPEHURIWLPHLQWHQVLW\FXUYH7,&VKDSHV DVGHULYHGIURP'&(05,LQFOLQLFDODFWLYHDQGFOLQLFDOLQDFWLYHMXYHQLOHLGLRSDWKLF DUWKULWLV-,$SDWLHQWV 0HWKRGVDQG0DWHULDOV'&(05,GDWDVHWVRINQHHVRI-,$SDWLHQWVZHUHSURVSHF WLYHO\REWDLQHGXVLQJDQRSHQERUHPDJQHW73DWLHQWVZHUHFODVVLÀHGLQWRWZR FOLQLFDOVXEJURXSVDFWLYHDUWKULWLVQ DQGLQDFWLYHGLVHDVHQ (YHU\YR[HO ZLWK LWV7,& ZDV FODVVLÀHG LQWR RQH RI VHYHQ SUHGHÀQHG7,& VKDSH FDWHJRULHV ZKLFKUHVXOWHGLQDFRORXUFRGHGVKDSHPDS6SDWLDOLQIRUPDWLRQRIWKHV\QRYLDO7,& VKDSHGLVWULEXWLRQSDWWHUQDQGUHODWLYHQXPEHURI7,&VKDSHVZHUHFDOFXODWHGRQD WKUHHGLPHQVLRQDOUHJLRQRILQWHUHVW5HODWLYH7,&VKDSHQXPEHUVZHUHFRPSDUHG XVLQJDQRQSDUDPHWULF0DQQ:KLWQH\8WHVW 5HVXOWV 1R GLIIHUHQFHV EHWZHHQ DFWLYH DQG LQDFWLYH -,$ SDWLHQWV ZHUH IRXQG UHJDUGLQJWKHUHODWLYHQXPEHURIW\SH7,&VKDSHVVORZHQKDQFHPHQWDQGW\SH 7,&VKDSHVIDVWHQKDQFHPHQWIROORZHGE\SODWHDXSKDVHS S UHVSHFWLYHO\+RZHYHUDVLJQLÀFDQWKLJKHUUHODWLYHQXPEHURIW\SH7,&VKDSHV IDVWHQKDQFHPHQWIROORZHGE\HDUO\ZDVKRXWSKDVHZDVVHHQLQFOLQLFDODFWLYH SDWLHQWVFRPSDUHGZLWKWKHLQDFWLYHJURXSYVS 7\SH7,& VKDSHVIDVWHQKDQFHPHQWIROORZHGE\VORZHQKDQFHPHQWLQFUHDVHWHQGHGWREH PRUHSUHVHQWLQFOLQLFDOLQDFWLYHSDWLHQWVFRPSDUHGZLWKDFWLYH-,$SDWLHQWV YVS &RQFOXVLRQ5HVXOWVREWDLQHGXVLQJWKHSL[HOE\SL[HO'&(05,7,&VKDSHDQDO\ VLVGLIIHULQVPDOOFRKRUWVRIDFWLYHDQGLQDFWLYH-,$SDWLHQWV % 3HUPDQHQWPXVFXODUVRGLXPRYHUORDGDQGPXVFOHRHGHPD LQ'XFKHQQHPXVFXODUG\VWURSK\DSRVVLEOHFRQWULEXWRURI SURJUHVVLYHPXVFOHGHJHQHUDWLRQ 0$:HEHU $01DJHO0%:ROI.-XUNDW5RWW :6HPPOHU+8.DXF]RU) /HKPDQQ+RUQ+HLGHOEHUJ'( 8OP'(0DUF$QGUH:HEHU#PHGXQLKHLGHOEHUJGH 3XUSRVH7 RDVVHVVWKHSUHVHQFHDQGSHUVLVWHQFHRIPXVFXODURHGHPDDQGLQ FUHDVHGP\RSODVPLFVRGLXP1DFRQFHQWUDWLRQLQ'XFKHQQHPXVFXODUG\VWURSK\ '0'SUREDEO\FRQWULEXWLQJVLJQLÀFDQWO\WRLWVSURJUHVVLYHPXVFOHGHJHQHUDWLRQ 0HWKRGV DQG 0DWHULDOV :H H[DPLQHG '0' SDWLHQWV PHDQ DJH \HDUVDQGKHDOWK\YROXQWHHUVPHDQDJH\HDUVRQD7 HVOD05 V\VWHPZLWKSURWRQ+DQG1DGHQVLW\DGDSWHG'UDGLDOVHTXHQFHV7 RHQVXUH FRQVLVWHQF\ SDWLHQWV ZHUH UHH[DPLQHG DERXW PRQWKV ODWHU:H TXDQWLÀHG PXVFOHRHGHPDRQ67,5LPDJHVZLWKEDFNJURXQGQRLVHDVUHIHUHQFHDQGIDWW\ GHJHQHUDWLRQRQ7ZHLJKWHGLPDJHVXVLQJVXEFXWDQHRXVIDWDVUHIHUHQFH1D ZDVTXDQWLÀHGE\DPXVFXODUWLVVXH1DFRQFHQWUDWLRQ76&VHTXHQFHHPSOR\ LQJDUHIHUHQFHWXEHIRUVWDQGDUGLVDWLRQFRQWDLQLQJP01DZLWKDJDURVH JHO :LWK D QRYHO LQYHUVLRQUHFRYHU\ ,5 VHTXHQFH ZKLFK XWPRVW VXSSUHVVHV H[WUDFHOOXODU1DVLJQDOVIRULQVWDQFHIURPYDVRJHQLFRHGHPDZHGHWHUPLQHG PDLQO\WKHP\RSODVPLF1D 5HVXOWV7KHQRUPDOLVHGPXVFXODU1D,5VLJQDOLQWHQVLW\ZDVKLJKHULQ'0' WKDQ LQ YROXQWHHUV S DQG SHUVLVWHG DW VHFRQG PHDVXUHPHQWQ YVS :KHQFRPSDUHGWRYROXQ WHHUVPPROO76&ZDVPDUNHGO\LQFUHDVHGLQ'0'PPROO S DQG UHPDLQHG FRQVWDQW Q PPROO YV PPROO S 2HGHPD YV S DQG PXVFXODUIDW FRQWHQW YVSZHUHHOHYDWHGLQ'0'PXVFOHVZKHQFRP SDUHG ZLWK YROXQWHHUV 7KLV FRXOG DOVR EH FRQÀUPHG GXULQJ IROORZXS S S &RQFOXVLRQ7KHSHUPDQHQWPXVFXODU1DRYHUORDGLQ'0'LVOLNHO\RVPRWLFDOO\ UHOHYDQWDQGUHVSRQVLEOHIRUWKHSHUVLVWLQJPDLQO\LQWUDFHOOXODUPXVFOHRHGHPD %RWKZHUHSUHVHQWLQDOO'0'SDWLHQWV 6FLHQWLILF6HVVLRQ 6 &$' ( ) *+% (XURSHDQ&RQJUHVVRI 5DGLRORJ\ % 9DOXHRI&7FRORQRJUDSK\DVSUHOLPLQDU\VWXG\SULRUWRODSDURVFRSLF VXUJHU\LQSDWLHQWVZLWKFRORQPDOLJQDQFLHVDQGFRPSOLFDWHG GLYHUWLFXODUGLVHDVH 55L]]DWL 67 DUWDUL&&DYDOOLQL03ULQFLYDOOH55LJKL*$QDQLD *%HQHD/DJRVDQWR)HUUDUD,7)HUUDUD,7UUL]]DWL#DXVOIHLW 3XUSRVH7 RLQYHVWLJDWHWKHFOLQLFDOYDOXHRI&7FRORQRJUDSK\&7&LQWKHGLDJQRVLV DQGVWDJLQJRIFRORUHFWDOFDQFHU&5&DQGFRPSOLFDWHGGLYHUWLFXODUGLVHDVHLQ RUGHUWRSURSHUO\SODQWKHODSDURVFRSLFVXUJHU\ 0HWKRGVDQG0DWHULDOV)URP-DQXDU\XQWLO1RYHPEHUSDWLHQWV VFKHGXOHGIRUVXUJHU\IRU&5&RUFRPSOLFDWHGGLYHUWLFXOLWLVNQRZQRUVXVSHFWHG XQGHUZHQW&7&$OOSDWLHQWVZHUHSUHYLRXVO\HYDOXDWHGZLWKRSWLFDOFRORQRVFRS\ 2&6HQVLWLYLW\LQOHVLRQORFDWLRQDQGGHWHFWLRQZDVFRPSDUHGEHWZHHQ2&DQG &7&DQGGLVFUHSDQFLHVDQDO\VHG $FFXUDF\RI&7&LQ&5&VWDJLQJZDVGHWHUPLQHG 5HVXOWV $WRWDORI&5&DQGFRPSOLFDWHGGLYHUWLFXOLWLVZHUHFODVVLÀHGE\&7& 2&ZDVLQFRPSOHWHLQFDVHV7KHUHZHUHFDVHVRIGLVFUHSDQF\RI OHVLRQORFDWLRQFRUUHFWO\LGHQWLÀHGE\&7&DQGSRO\SRLGPPOHVLRQVGHWHFWHG E\&7&DQGPLVVHGE\2&%DVLQJRQ&7&DVVHVVPHQWFDVHVRIFRPSOLFDWHG GLYHUWLFXOLWLVZHUHPDQDJHGPHGLFDOO\SDWLHQWVXQGHUZHQWFRQYHQWLRQDORSHQ VXUJHU\IRU&5&DQG&5&DQGFRPSOLFDWHGGLYHUWLFXOLWLVODSDURVFRSLF VXUJHU\ 6HQVLWLYLW\ RI &7& LQ 710 SUHRSHUDWLYH VWDJLQJ RI SDWLHQWV ZLWK &5& UHVXOWHGWREHUHVSHFWLYHO\DQG,QGLDJQRVLVRIFRPSOLFDWHG GLYHUWLFXODUGLVHDVH&7&VKRZHGDJUHHPHQWUHJDUGLQJORFDWLRQDQGH[WHQW RIWKHOHVLRQDQGVHQVLWLYLW\IRUFRPSOLFDWLRQV)XUWKHUPRUH&7&GHWHFWHG H[WUDFRORQLFÀQGLQJVRIZKRPRIPDMRUFOLQLFDOUHOHYDQFH &RQFOXVLRQ&7&SURYLGHVDFFXUDWHVWDJLQJRIFRORQFDQFHUDQGGHWDLOHGHYDOX DWLRQ RI FRPSOLFDWHG GLYHUWLFXODU GLVHDVH DOORZLQJ DQ DSSURSULDWH PDQDJHPHQW RISDWLHQWDQGPDNLQJWKHODSDURVFRSLFVXUJLFDOSODQQLQJPRUHSUHFLVHDQGVDIHU % (IIHFWLYHUDGLDWLRQGRVHLQ&7FRORQRJUDSK\GLGZHPDNHSURJUHVV" 7 1%RHOODDUG+:9HQHPD*-6WUHHNVWUD-6WRNHU$PVWHUGDP1/ WQERHOODDUG#DPFXYDQO 3XUSRVH7 RDVVHVVWKHHIIHFWLYHUDGLDWLRQGRVHXVHGIRU&7FRORQRJUDSK\DQGWR FRPSDUHWKHVHZLWKSUHYLRXVLQYHQWRULHV 0HWKRGVDQG0DWHULDOV&7FRORQRJUDSK\LQVWLWXWLRQVWKDWKDGSXEOLVKHGRQ&7 FRORQRJUDSK\ ZHUH LQYLWHG WR SDUWLFLSDWH$ TXHVWLRQQDLUH ZDV VHQW FRQFHUQLQJ &7FRORQRJUDSK\VFDQSURWRFROV0HGLDQHIIHFWLYHGRVHVZHUHFDOFXODWHGSURQH VXSLQHDQGFRPELQHGIRUGDLO\SUDFWLFHDQGVFUHHQLQJSURWRFROVDQGFRPSDUHG ZLWKHDUOLHULQYHQWRULHV6HSDUDWHDQDO\VHVZHUHSHUIRUPHGIRUWKHXVHRILQWUDYH QRXVFRQWUDVWDQGDFDGHPLFYHUVXVQRQDFDGHPLF'LIIHUHQFHVLQHIIHFWLYHGRVH ZHUHWHVWHGIRUVLJQLÀFDQFHXVLQJD:LOFR[RQUDQNVXPRU:LOFR[RQVLJQHGUDQN WHVWZKHUHDSSURSULDWH 5HVXOWV,QWRWDORILQVWLWXWLRQVUHVSRQGHGSURYLGLQJSURWRFROV 0HGLDQHIIHFWLYHGRVHIRUGDLO\SUDFWLFHSURWRFROVZDVP6YP6YDQG P6YIRUVXSLQHDQGSURQHDQGIRUVFUHHQLQJP6YP6YDQGP6YIRU VXSLQHDQGSURQHS )RUGDLO\SUDFWLFHZLWKDQGZLWKRXWFRQWUDVWPHGLDQ HIIHFWLYHGRVHVZHUHP6YQ DQGP6YQ S$FDGHPLF DQGQRQDFDGHPLFLQVWLWXWLRQVXVHGVLPLODUGRVHVGDLO\SUDFWLFHYVP6Y S!DQGVFUHHQLQJYVP6YS!)RULQVWLWXWLRQVZKLFKDOVR SDUWLFLSDWHGLQDLQYHQWRU\HIIHFWLYHGRVHIRUERWKGDLO\SUDFWLFHDQGVFUHHQ LQJSURWRFROVZHUHVLPLODUS!EXWIRUGDLO\SUDFWLFHORZHUWKDQLQD LQYHQWRU\S &RQFOXVLRQ0HGLDQHIIHFWLYHGRVHRIGDLO\SUDFWLFHSURWRFROVKDVGHFUHDVHGDV FRPSDUHGWREXWQRWWR)XUWKHUUHGXFWLRQLVGHVLUDEOHWRUHGXFHUDGLD WLRQEXUGHQLQ&7FRORQRJUDSK\DQGLQFUHDVHLWVDFFHSWDQFH % &RPSDULVRQRIVOLFH&7FRORQRJUDSK\ZLWKFRQYHQWLRQDO FRORQRVFRS\LQSDWLHQWVZLWKXOFHUDWLYHFROLWLV 13UDEKDNDU1.DOUD'.%KDVLQ65DQD56LQJK1.KDQGHOZDO &KDQGLJDUK,1 3XUSRVH&OLQLFDODQGFRORQRVFRSLFÀQGLQJVDUHXVHGIRUWKHGLDJQRVLVRISDWLHQWV ZLWKXOFHUDWLYHFROLWLVDQGWKHLUIROORZXS7KHSXUSRVHRIWKHVWXG\ZDVWRFRPSDUH WKH ÀQGLQJV RI &7 FRORQRJUDSK\ &7& ZLWK FRQYHQWLRQDO FRORQRVFRS\ && LQ SDWLHQWVZLWKXOFHUDWLYHFROLWLV 0HWKRGVDQG0DWHULDOV,QWKLVSURVSHFWLYHVWXG\FRQVHFXWLYHSDWLHQWVSURYHQ WRKDYHXOFHUDWLYHFROLWLVRQELRSV\DQGSUHVHQWO\LQFOLQLFDOO\UHPLVVLRQXQGHUZHQW &7&DQG&&ZLWKLQRQHZHHNRIHDFKRWKHU7KH&&ÀQGLQJVZHUHFRQVLGHUHG DVJROGVWDQGDUG7KHLQYHVWLJDWRUVSHUIRUPLQJ&7&DQG&&ZHUHEOLQGHGWRWKH 5RRP% *,7UDFW 66D &7FRORQRJUDSK\DQGEH\RQG 0RGHUDWRUV 3/HIHUH5RHVHODUH%( $05LGGHOO6XWWRQ8. % $FFXUDF\RIFRPSXWHUDLGHGGHWHFWLRQLQGHWHFWLQJÁDWOHVLRQVLQ&7 FRORQRJUDSK\ --1DSSL +<RVKLGD'5HJJH%RVWRQ0$867XULQ,7 MQDSSL#SDUWQHUVRUJ 3XUSRVH7 RHYDOXDWHWKHSHUIRUPDQFHRIDQLQGHSHQGHQWO\WUDLQHGFRPSXWHUDLGHG GHWHFWLRQ&$'V\VWHPLQGHWHFWLQJÁDWDGHQRPDVDQGFDUFLQRPDVIURPDODUJH PXOWLFHQWUH&7FRORQRJUDSK\&7&VFUHHQLQJSRSXODWLRQ3UHYLRXV&$'VWXGLHV KDYH UHSRUWHG ORZ GHWHFWLRQ SHUIRUPDQFH DQG LQYROYHG FRPSURPLVHG WUDLQLQJ WHVWLQJVFKHPHV 0HWKRGVDQG0DWHULDOV$WRWDORISDWLHQWVZLWKFDWKDUWLFSUHSDUDWLRQIURP PHGLFDOFHQWUHVZHUHLQFOXGHG)RU&$'WUDLQLQJSDWLHQWVZHUHFROOHFWHG IURPWZR&7&VFUHHQLQJWULDOVLQYROYLQJ86PHGLFDOFHQWUHV)DHFDOWDJJLQJZDV XVHGLQRIFDVHV7KH&$'ZDVWUDLQHGZLWKWKH&7&FDVHVWRGHWHFW OHVLRQVPPDWVHQVLWLYLW\)RU&$'WHVWLQJDV\PSWRPDWLFSDWLHQWVDW LQFUHDVHGULVNRIFRORUHFWDOFDQFHUZHUHFROOHFWHGIURPDUHFHQW&7&VFUHHQLQJ WULDO LQYROYLQJ (XURSHDQ FHQWUHV ,RGLQH WDJJLQJ ZLWKRXW RUZLWK EDULXP ZDV XVHGLQRIFDVHV1RLQWUDYHQRXVFRQWUDVWZDVDGPLQLVWHUHG7KHSUHWUDLQHG &$'V\VWHPUHYLHZHGWKHWHVWLQJFDVHV3HUOHVLRQDQGSHUSDWLHQWGHWHFWLRQ VHQVLWLYLWLHVDQGIDOVHSRVLWLYHV)3VSHUSDWLHQWZHUHDVVHVVHGZLWKERRWVWUDSSLQJ IRUELRSV\SURYHQFRORQRVFRS\FRQÀUPHGOHVLRQV 5HVXOWV7KHUHZHUHOHVLRQVLQFOXGLQJÁDWDGHQRPDVRUFDUFLQRPDV ZHUHPPDQGZHUHPP3HUOHVLRQSHUSDWLHQWVHQVLWLYLW\RI&$'ZDV IRUÁDWOHVLRQVPPLQVL]HDQGIRUÁDWOHVLRQVPP ZLWKPHGLDQRI)3VSHUSDWLHQW&$'GHWHFWHGDOOÁDWFDQFHUV &RQFOXVLRQ,QGHSHQGHQWO\WUDLQHG&$'FDQGHWHFWÁDWDGHQRPDVDQGFDUFLQR PDVIURPXQVHHQPXOWLFHQWUH&7&SRSXODWLRQVDWFOLQLFDOO\DFFHSWDEOHDFFXUDF\ FRPSDUDEOHWRWKDWIRUSRO\SRLGOHVLRQV % 3RWHQWLDOFRPSOLFDWLRQVDW&7FRORQRJUDSK\LQDV\PSWRPDWLFDQG V\PSWRPDWLFSDWLHQWVQDWLRQDOVXUYH\RI,WDO\ 0&LROLQD ) ,DIUDWH*,XVVLFK'5HJJH0,DQQLWWL3 %DOGDVVDUL $3LFKL/&RUUHDOH$/DJKL5RPH,7&DQGLROR,77RULQR,7/DWLQD,7 PDULDFLROLQD#JPDLOFRP 3XUSRVH7 RUHWURVSHFWLYHO\HYDOXDWHWKHLQFLGHQFHRIFRPSOLFDWLRQUHODWHGWR&7& SHUIRUPHGLQERWKV\PSWRPDWLFDQGDV\PSWRPDWLFSDWLHQWVXQGHUJRLQJ&7&GXULQJ WKHSHULRGUDQJLQJIURPDQG 0HWKRGVDQG0DWHULDOV:LWKDQDWLRQDOVXUYH\DQHPDLOTXHVWLRQQDLUHDERXW VHULRXV DGYHUVH HYHQWV RI YLUWXDO FRORQRVFRS\ SDUWLFXODUO\ ODUJH ERZHO SHUIRUD WLRQZDVVHQWWRDOO,WDOLDQ3XEOLF+HDOWK&HQWHUVSHUIRUPLQJDGDLO\&7&VHUYLFH 7 HFKQLFDOSDUDPHWHUVUHODWHGWRFRPSOLFDWLRQVDQGNLQGRIWUHDWPHQWQHHGHGIRU DGYHUVHHYHQWVZHUHDOVRLQYHVWLJDWHG7KHTXHVWLRQQDLUHZDVFRPSOHWHGE\FOLQL FDOGLUHFWRUIURPDOOUDGLRORJ\GHSDUWPHQWV5HVSRQVHVZHUHDQDO\VHGDQGUDZ IUHTXHQFLHVZHUHGHWHUPLQHG 5HVXOWV $OOFHQWUHVLQWHUYLHZHGDQVZHUHGSRVLWLYHO\WRWKH6XUYH\ $PRQJ FHQWHUV &7 FRORQRJUDSK\ H[DPV ZHUH SHUIRUPHG 1R GHDWKV ZHUH UHSRUWHGSDWLHQWVH[SHULHQFHGDFRPSOLFDWLRQGXULQJWKHSURFHGXUH YDVRYDJDOVHOIOLPLWLQJDWWDFNHSLVRGHVDQGSHUIRUDWLRQV ,QFDVHVWKHVLWHRISHUIRUDWLRQZDVZLWKLQWKHUHFWXPLQFDVHV ZLWKLQ WKH VLJPRLG FRORQ 1R FDVH RI SHUIRUDWLRQ ZLWKLQ WUDQVYHUVH DVFHQGLQJ FRORQ DQG FDHFXP7KUHH SDWLHQWV KDG WR XQGHUJR VXUJHU\7KH UHPDLQLQJ IRXU SDWLHQWVKDGDFRQVHUYDWLYHWUHDWPHQW)RXURXWRIVHYHQFDVHVRISHUIRUDWLRQKDG DFRQYHQWLRQDOFRORQRVFRS\LQWKHSDVWVHYHQGD\VSULRUWR&7&DQGRQWKHVDPH GD\RIWKHH[DPUHVSHFWLYHO\ &RQFOXVLRQ ,Q VXPPDU\ ZH IRXQG D ORZ UDWH RI FRORQLF SHUIRUDWLRQ WKDW ZHUH DVVRFLDWHG ZLWK &7 FRORQRJUDSK\ 7KH UDWH RI RFFXUUHQFH RI OXPLQDO SHUIRUDWLRQKRZHYHUZDVPRUHWKDQIRXUWLPHVORZHUWKDQZHUHHTXLYDOHQWUDWHV SXEOLVKHGIRUFRORQRVFRS\ 6FLHQWLILF6HVVLRQ $ 6&'()*+%(XURSHDQ&RQJUHVVRI 5DGLRORJ\ 0RQGD\ % 7KHDFFXUDF\RISUHRSHUDWLYH&7LQWKHDVVHVVPHQWRIWKHDFXWHDEGRPHQ -:HLU0F&DOO'&KULVWRGRXORX$6KDZ$$U\D$.QLJKW'+RZOHWW 'XQGHH8./RQGRQ8.(DVWERXUQH8. 3XUSRVH:KLOHWKHUHLVDORWRIGDWDRQWKHDFFXUDF\RI&7LQGLDJQRVLQJVSHFLÀF FDXVHVRIDQDFXWHDEGRPHQWKHUHLVYHU\OLWWOHLQIRUPDWLRQRQWKHDFFXUDF\RI &7LQWKHDFXWHJHQHUDOVXUJLFDODGPLVVLRQVZRUNORDG:HORRNDWWKHGLDJQRVWLF DFFXUDF\ RI &7 LQ SDWLHQWV SUHVHQWLQJ ZLWK DQ DFXWH DEGRPHQ ZKR XOWLPDWHO\ UHTXLUHGODSDURWRP\ 0HWKRGV DQG 0DWHULDOV 3DWLHQWV ZKR XQGHUZHQW HPHUJHQF\ ODSDURWRP\ IURP WRDWRXUKRVSLWDOZLWKDSUHRSHUDWLYH&7RQWKHVDPHDGPLVVLRQZHUH LQFOXGHG7KH&7UHSRUWZDVFRPSDUHGZLWKWKHODSDURWRP\DQGKLVWRORJ\ÀQGLQJV DQGZKHUHDGLVFUHSDQF\H[LVWHGWKHRULJLQDOVFDQVZHUHUHYLHZHGE\DVHQLRU FRQVXOWDQWEOLQGHGWRWKHRULJLQDOUHSRUWDQGODSDURWRP\ÀQGLQJV 5HVXOWV HPHUJHQF\ ODSDURWRPLHV ZHUH SHUIRUPHG RYHU WKH \HDU SHULRG ZLWKSDWLHQWVXQGHUJRLQJDSUHRSHUDWLYH&7 SDWLHQWVZHUHH[FOXGHGGXH WRPLVVLQJQRWHV,QWKHUHPDLQLQJSDWLHQWV&7UHSRUWVFRUUHODWHGZLWKWKH ÀQDORSHUDWLYHGLDJQRVLVJLYLQJDGLDJQRVWLFDFFXUDF\RI2IWKHVHWKHRQFDOO UHJLVWUDUZDVWKHLQLWLDOUHSRUWHULQ&7 VZLWKDGLDJQRVWLFDFFXUDF\RI2Q UHYLHZRIWKH&7VFDQE\DVHFRQGFRQVXOWDQWWKLVLQFUHDVHGWRFRUUHODWLRQV \LHOGLQJDQDFFXUDF\RI'HOD\EHWZHHQ&7VFDQDQGRSHUDWLRQGLGQRWVLJQLÀ FDQWO\DOWHUGLDJQRVWLFDFFXUDF\QRUZDVWKHUHDQ\VWDWLVWLFDOO\VLJQLÀFDQWUHGXFWLRQ LQDFFXUDF\LQUHSRUWVLVVXHGE\RQFDOOUHJLVWUDUV &RQFOXVLRQ2QÀUVWUHSRUWLQJ&7PLVVHVRIGLDJQRVLVWKDWXOWLPDWHO\UHTXLUH RSHUDWLYHLQWHUYHQWLRQ5HGXFLQJWKHWKUHVKROGIRUREWDLQLQJDVHFRQGFRQVXOWDQW UDGLRORJLVWUHYLHZVLJQLÀFDQWO\LPSURYHVWKHGLDJQRVWLFDFFXUDF\WR % 4XDQWLWDWLYHLPDJLQJELRPDUNHUVIURP3(7&7DVSRWHQWLDOFRUUHODWHV IRUDQJLRJHQHVLVDQGK\SR[LDLQFRORUHFWDOFDQFHU %*DQHVKDQ ==LDXGGLQ9-*RK05RGULJXH]-XVWR$(QJOHGRZ 67 D\ORU6+DOOLJDQ.$0LOHV$0*URYHV%ULJKWRQ8./RQGRQ8. EJDQHVKDQ#VXVVH[DFXN 3XUSRVH,QWHJUDWHG3(7&7V\VWHPVDOORZPHDVXUHPHQWVRIWUDFHUXSWDNHRQ 3(7WREHFRPELQHGZLWKTXDQWLWDWLYHLPDJLQJELRPDUNHUVIURP&77KLVVWXG\DLPV WRLGHQWLI\KLVWRSDWKRORJLFDOFRUUHODWHVIRUÁXRURGHR[\JOXFRVH)'*XSWDNH&7 DWWHQXDWLRQDQG&7KHWHURJHQHLW\LQFRORUHFWDOFDQFHU 0HWKRGVDQG0DWHULDOV)'*3(7ZDVSHUIRUPHGSURVSHFWLYHO\LQDVHULHV RISDWLHQWVZLWKFRORUHFWDOFDQFHU)'*XSWDNHPD[LPDOVWDQGDUGLVHGXSWDNH YDOXH689PD[&7DWWHQXDWLRQDQG&7KHWHURJHQHLW\IRUXQHQKDQFHGLPDJHV ZHUHTXDQWLÀHGLQDUHJLRQRILQWHUHVW52,HQFRPSDVVLQJWKHSULPDU\WXPRXU +HWHURJHQHLW\ZDVH[SUHVVHGDVWKHVWDQGDUGGHYLDWLRQ6'RISL[HOYDOXHVLQ&7 LPDJHVZLWKDQGZLWKRXWÀOWUDWLRQWRKLJKOLJKWLPDJHFKDUDFWHULVWLFVUDQJLQJIURPÀQH GHWDLOWRFRDUVHIHDWXUHVDVGHWHUPLQHGE\WKHÀOWHUYDOXH8VLQJWKH6SHDUPDQ UDQN PHWKRG DOO LPDJLQJ SDUDPHWHUV ZHUH FRUUHODWHG ZLWK WXPRXU PLFURYHVVHO GHQVLW\09'DQGH[SUHVVLRQRIYDVFXODUHQGRWKHOLDOJURZWKIDFWRU9(*)DQG *OXWRQKLVWRORJLFDOH[DPLQDWLRQRIUHVHFWHGWXPRXUV 5HVXOWV +LVWRORJLFDO GDWD ZHUH DYDLODEOH LQ FDVHV &7 KHWHURJHQHLW\ ÀOWHU YDOXHZDVWKHEHVWFRUUHODWHIRU09'UV S 689PD[FRU UHODWHGVLJQLÀFDQWO\ZLWKH[SUHVVLRQRI9(*)UV S EXWQRW*OXW UV S 7KHUDWLRRI689PD[WR&7KHWHURJHQHLW\ÀOWHUYDOXH ZDVWKHEHVWFRUUHODWHIRUH[SUHVVLRQRI9(*)UV S DQG*OXW UV S &RQFOXVLRQ$GGLWLRQRI&7EDVHGELRPDUNHUVKDVWKHSRWHQWLDOWRLQFUHDVHWKH XWLOLW\RI3(7&7E\HQKDQFLQJWKHLPDJLQJFRUUHODWHVIRUDQJLRJHQHVLVDQGK\SR[LD LQFRORUHFWDOFDQFHU ÀQGLQJVRIWKHRWKHUVWXG\&KLVTXDUHWHVWDQGNDSSDWHVWZHUHXVHGWRFRPSDUH WKH ÀQGLQJV RQ &7& DQG && 6HQVLWLYLW\ DQG VSHFLÀFLW\ RQ &7& IRU GHWHFWLQJ SVHXGRSRO\SVDQGJUDQXODULW\LQDVHJPHQWZHUHDOVRFDOFXODWHG 5HVXOWV*RRGFRUUHODWLRQZDVVHHQEHWZHHQ&7&DQG&&IRUGHWHFWLRQRIJUDQXODU DSSHDUDQFHDQGSVHXGRSRO\SV6HQVLWLYLW\DQGVSHFLÀFLW\RQ&7&IRUGHWHFWLQJ SVHXGRSRO\SVZHUHDQGUHVSHFWLYHO\DQGIRUJUDQXODUDSSHDUDQFH ZHUHDQGUHVSHFWLYHO\/RVVRIKDXVWUDOIROGVSHULFRORQLFYDVFXODULW\ SHULFRORQLFO\PSKQRGHVDQGZDOOWKLFNHQLQJVHHQRQ&7&ZHUHIRXQGWRFRUUHODWH ZLWKLQWUDOXPLQDOÀQGLQJVVHHQRQ&&7KHVHFDQEHXVHGDVDGGLWLRQDOPDUNHUV RIGLVHDVHH[WHQWLQDVVRFLDWLRQZLWKLQWUDOXPLQDOÀQGLQJVRQ&7& &RQFOXVLRQ&7&FDQEHXVHGDVDQDOOLQRQHWHFKQLTXHIRUHYDOXDWLQJSDWLHQWV ZLWKXOFHUDWLYHFROLWLVZKRDUHLQUHPLVVLRQ,WSURYLGHVLQIRUPDWLRQDERXWWKHERZHO OXPHQERZHOZDOODQGH[WUDOXPLQDODEQRUPDOLWLHVLQWKHVHSDWLHQWV % /RZGRVHFRPSXWHGWRPRJUDSK\WRGHWHFWERG\SDFNLQJVWHSZLVH GRVHUHGXFWLRQLQDQDQLPDOPRGHO 0+0DXUHU601LHKXHV'6FKQDSDXII&*ULHVHU-5RWKH66&KRSUD %+DPP7 'HQHFNH%HUOLQ'(PDUWLQPDXUHU#FKDULWHGH 3XUSRVH7 RGHWHUPLQHWKHYDOXHRIORZGRVHFRPSXWHGWRPRJUDSK\&7WRGHWHFW ERG\SDFNLQJLQJHVWHGGUXJSDFNHWVDVDQDOWHUQDWLYHWRSODLQUDGLRJUDSKVLQDQ DQLPDOPRGHOZLWKVWHSZLVH&7GRVHUHGXFWLRQ 0HWKRGVDQG0DWHULDOV7ZHOYHSDFNHWVFRQWDLQLQJFRFDLQHSXULW\!ZHUH LQWURGXFHGLQWRWKHLQWHVWLQHRIDQDQLPDOFURVVEUHGSLJNJZKLFKZDVWKHQ UHSHDWHGO\H[DPLQHGE\DEGRPLQDO&7ZLWKVWHSZLVHGRVHUHGXFWLRQWXEHYROWDJH N9 WXEH FXUUHQW P$ GHWHFWRU FROOLPDWLRQ [PP SLWFK URWDWLRQWLPHPVVFDQOHQJWKFP7KUHHEOLQGHGUHDGHUVLQGHSHQGHQWO\ HYDOXDWHGWKH&7GDWDVHWVLPDJHVUHFRQVWUXFWHGDWPPVOLFHWKLFNQHVVLQFUH PHQWVWDUWLQJZLWKWKHORZHVWWXEHFXUUHQWDQGQRWHGWKHQXPEHUVRISDFNHWV GHWHFWHGDWWKHGLIIHUHQWWXEHFXUUHQWVXVHG2QHH[SHULHQFHGUHDGHUGHWHUPLQHG WKHQXPEHURISDFNHWVGHWHFWDEOHRQSODLQDEGRPLQDOUDGLRJUDSKVDQGXOWUDVRXQG 5HVXOWV7KHWKUHVKROGIRUFRUUHFWLGHQWLÀFDWLRQRIDOOGUXJSDFNHWVZDVP$ IRUUHDGHUDQGP$IRUUHDGHUVDQG$ERYHWKHVHWKUHVKROGVDOOUHDG HUV FRQVLVWHQWO\ LGHQWLÀHG DOO SDFNHWV 7KH HIIHFWLYH GRVH RI D ORZGRVH &7 VFDQZLWKP$LQFOXGLQJVFRXWYLHZZDVP6YZKLFKZDVEHORZWKDWRI FRQYHQWLRQDODEGRPLQDOUDGLRJUDSKVP6Y7KHUHDGHULQWHUSUHWLQJWKHFRQ YHQWLRQDOUDGLRJUDSKVLGHQWLÀHGDWRWDORIGUXJSDFNHWVDQGGHWHFWHGSDFNHWV E\DEGRPLQDOXOWUDVRXQG &RQFOXVLRQ([WHQVLYHGRVHUHGXFWLRQPDNHVORZGRVH&7DYDOXDEOHDOWHUQDWLYH LPDJLQJPRGDOLW\IRUWKHH[DPLQDWLRQRIVXVSHFWHGERG\SDFNHUVDQGPLJKWUHSODFH FRQYHQWLRQDODEGRPLQDOUDGLRJUDSKVDVWKHÀUVWOLQHLPDJLQJPRGDOLW\ % 0DWHULDOGHFRPSRVLWLRQRIVSHFWUDO&7 DQHZZD\LQWKHSUHGLFWLRQ RIUHVSRQVHWRFKHPRWKHUDS\LQJDVWULFFDUFLQRPD" /7 DQJ;3 =KDQJ< 66XQ/3 4L< &XL6< *DR</L%HLMLQJ&1 WDQJOHL#EMFDQFHURUJ 3XUSRVH7 RLQYHVWLJDWHWKHXVHRIWKHLRGLQHFRQFHQWUDWLRQ,&GHULYHGIURPPDWH ULDOGHFRPSRVLWLRQRIVSHFWUDO&7DVDUHVSRQVHLQGLFDWRULQSDWLHQWVZLWKJDVWULF FDUFLQRPDWUHDWHGZLWKFKHPRWKHUDS\ 0HWKRGVDQG0DWHULDOV7ZHQW\WZRSDWLHQWVZLWKJDVWULFFDQFHUZHUHVFDQQHGRQ D*('LVFRYHU\&7+'XVLQJVSHFWUDOLPDJLQJPRGHEHIRUHDQGPRQWKV DIWHUFKHPRWKHUDS\3DWLHQWVZHUHGLYLGHGLQWRWKHJRRGUHVSRQVHJURXS*RRG5 DQGSRRUUHVSRQVHJURXS3RRU5DFFRUGLQJWR5(&,67FULWHULD7KHLRGLQHZDWHU EDVLVPDWHULDOGHFRPSRVLWLRQLPDJHVDQGPRQRFKURPDWLFLPDJHVRQDUWHULDODQG YHQRXVSKDVHFRYHULQJWKHHQWLUHVWRPDFKZHUHUHFRQVWUXFWHG $QRYDOUHJLRQVRI LQWHUHVW52,ZDVSODFHGRQWKHKLJKHVWHQKDQFHGUHJLRQRIJDVWULFFDUFLQRPD7KH LRGLQHFRQFHQWUDWLRQV,&PJFFLQ52,VZHUHUHFRUGHGDQGWKHGHFUHDVHUDWHRI ,&ZDVFRPSXWHGE\WKHIRUPXODу,& ,&EHIRUH,&DIWHU,&EHIRUHð7KH GHFUHDVHUDWHVRI,&EHWZHHQWZRJURXSVZHUHFRPSDUHGXVLQJLQGHSHQGHQWWWHVW 5HVXOWV :H UHFRUGHG D SRVLWLYH FRUUHODWLRQ EHWZHHQ у,& DQG WKH VKULQNDJH UDWHRIWXPRXUVL]HRQERWKSKDVHVDUWHULDOSKDVHU 3YHQRXV SKDVHU 37KHUHZHUHFDVHVRI*RRG5DQGFDVHVRI3RRU5 6WDWLVWLFDOGLIIHUHQFHRIу,&ZDVGHPRQVWUDWHGEHWZHHQ*RRG5DQG3RRU5DW YHQRXVSKDVH= 3 EXWQRWDWDUWHULDOSKDVH= 3! &RQFOXVLRQ2XUÀQGLQJVVXJJHVWWKDWLRGLQHFRQFHQWUDWLRQGHULYHGIURPVSHFWUDO &7LPDJLQJFRXOGSURYLGHFOLQLFDOLQIRUPDWLRQIRUWKHWUHDWPHQWHYDOXDWLRQRIJDVWULF FDUFLQRPD3URVSHFWLYHVWXGLHVZLWKODUJHVDPSOHVDUHQHHGHGWRWHVWLWVUHSURGXF LELOLW\DQGWRGHWHUPLQHWKHGLDJQRVWLFWKUHVKROG 6FLHQWLILF6HVVLRQ 6 &$' ( ) *+% (XURSHDQ&RQJUHVVRI 5DGLRORJ\ % 05,DVDQLPDJLQJVXUURJDWHWRSUHGLFWUDGLDWLRQGRVLPHWU\ERUGHUV DPHWKRGRORJ\IHDVLELOLW\VWXG\ $.RYDFV 3 2=LQQ) 3 6FKZDUP) $-ROHV],5HSD55&ROHQ .DSRVYDU+87 H[DV7;86%RVWRQ0$86NRYDFVDUSDG#JPDLOFRP 3XUSRVH 7 R GHYHORS D UREXVW PHWKRGRORJ\ XVLQJ 05, IRU SUHGLFWLQJ UDGLDWLRQ GRVLPHWU\ERUGHUVRIWKHWXPRXUEH\RQGWKHDUHDRIHQKDQFHPHQWIRUUDGLDWLRQ WUHDWPHQWSODQQLQJ 0HWKRGVDQG0DWHULDOV:HUHWURVSHFWLYHO\LGHQWLÀHGFRQVHFXWLYHJOLREODVWRPD PXOWLIRUPHSDWLHQWVZKRPKDGSUHVXUJLFDOSRVWVXUJLFDOSUHUDGLDWLRQ DQG UHODSVH 05, VWXGLHV DQG XQGHUJRQH UDGLDWLRQ WUHDWPHQW 57 ' 6OLFHU VRIWZDUHVOLFHURUJZDVXVHGIRULPDJHDQDO\VLVPDQLSXODWLRQDQGVHJPHQWD WLRQ7ZRQHXURUDGLRORJLVWV55&)$-UHYLHZHGWKHLPDJHVLQFRQVHQVXV7KUHH VWUXFWXUHVZHUHVHJPHQWHGRHGHPDLQYDVLRQHQKDQFLQJWXPRXUDQGQHFURVLV 6XEVHTXHQWO\WKHPRGHOVTXDQWLWDWLYHYROXPHVRIRHGHPDWXPRXUDQGQHFURVLV ZHUHFDOFXODWHG05SHUIXVLRQ053VFDQV1 ZHUHUHJLVWHUHGWRVHJPHQWHG LPDJHVDQGTXDQWLWDWLYHSHUIXVLRQSDUDPHWHUVREWDLQHG7KHVHZHUHWKHQUHJLVWHUHG WRWKHUDGLDWLRQSODQQLQJ&7LPDJHVDQGWKHGRVLPHWU\FXUYHVVXSHULPSRVHG 5HVXOWV$FFXUDWHUHJLVWUDWLRQZLWKLQPPRFFXUUHGDPRQJWKHLPDJHVDQGWKH UDGLDWLRQSODQQLQJ&7LPDJHVSDWLHQWVGHPRQVWUDWHGLQFUHDVHVLQSHUIXVLRQ UHÁHFWLYHRIWXPRXULQÀOWUDWLRQEH\RQGWKHERUGHURIHQKDQFHPHQWDQGFRUUHVSRQG LQJWRWKHUHJLRQVRIVXEVHTXHQWUHFXUUHQFHVXJJHVWLQJWKDWUDGLDWLRQSODQQLQJ WRLQFOXGHWKRVHDEQRUPDOUHJLRQVVHHQRQDGYDQFHLPDJLQJWHFKQLTXHVQRWRQ FRQYHQWLRQDO05,PLJKWUHVXOWLQEHWWHUWXPRXUWUHDWPHQWDQGFRQWURORIUHFXUUHQFH &RQFOXVLRQ:HSUHVHQWDUREXVWLPDJHDQDO\VLVPHWKRGRORJ\SODWIRUPIRUDF FXUDWH UHJLVWUDWLRQ RI FRQYHQWLRQDO DQG DGYDQFHG 05, VHTXHQFHVDQG ZLWK WKH UDGLDWLRQSODQQLQJ&7LPDJHV05SHUIXVLRQDEQRUPDOLWLHVVHHQRXWVLGHWKHDUHD RIHQKDQFHPHQWSUHGLFWUHJLRQVRIVXEVHTXHQWUHFXUUHQFHDQGWKXVUHJLVWHULQJDQG LQFOXGLQJWKHVHUHJLRQVLQWKH57DQGGRVLPHWU\SODQQLQJV\VWHPFDQEHH[SHFWHG WRGHFUHDVHWXPRXUUHFXUUHQFHDQGLQFUHDVHVXUYLYDO % 'LDJQRVWLFYDOXHRIIXQFWLRQDOPDJQHWLFUHVRQDQFHLPDJLQJIRU GLIIHUHQWLDWLRQRIEHQLJQRVWHRSRURVLVDQGPXOWLSOHP\HORPD 06XPNDXVNDLWH-+LOOHQJDVV&+HLVV0'RUQLVFK %6WLHOWMHV+3 6FKOHPPHU+*ROGVFKPLGW6'HORUPH +HLGHOEHUJ'(PLJOHV#JPDLOFRP 3XUSRVH 7KH DLP RI RXU VWXG\ ZDV WR DVVHVV WKH YDOXH RI G\QDPLF FRQWUDVW HQKDQFHGPDJQHWLFUHVRQDQFHLPDJLQJ'&(05,DQGGLIIXVLRQZHLJKWHGLPDJ LQJ':,RIWKHERQHPDUURZIRUGLIIHUHQWLDWLQJEHQLJQRVWHRSRURVLVDQGPXOWLSOH P\HORPD 0HWKRGVDQG0DWHULDOV%HWZHHQDQGWZHQW\SDWLHQWVZLWKXQWUHDWHG PXOWLSOH P\HORPD DQG WZHQW\ SDWLHQWV ZLWK FOLQLFDOO\ FRQÀUPHGLGLRSDWKLF RU SRVWPHQRSDXVDORVWHRSRURVLVZHUHSURVSHFWLYHO\H[DPLQHGXVLQJD7 HVOD05 VFDQQHU 0DJQHWRP 6\PSKRQ\ 6LHPHQV (UODQJHQ *HUPDQ\ ':, DQG '&( 05, RI WKH OXPEDU VSLQH ZHUH SHUIRUPHG LQ DOO SDWLHQWV '&(05, SDUDPHWHUV DPSOLWXGH$ DVVRFLDWHG ZLWK EORRG YROXPH DQG H[FKDQJH UDWH FRQVWDQW NHS DVVRFLDWHGZLWKYHVVHOSHUPHDELOLW\DVZHOOWKH':,SDUDPHWHUVDFFRUGLQJWR WKHLQWUDYR[HOLQFRKHUHQWPRWLRQ,9,0PRGHOSHUIXVLRQIUDFWLRQIDQGGLIIXVLRQ FRQVWDQW'ZHUHHYDOXDWHGIRUHDFKOXPEDUYHUWHEUDVHSDUDWHO\E\DUDGLRORJLVW EOLQGHGWRWKHSDWLHQWҋVKLVWRU\ 5HVXOWV $DQGNHSLQ'&(05,ZHUHVLJQLÀFDQWO\KLJKHULQWKHP\HORPDJURXSWKDQ LQSDWLHQWVZLWKRVWHRSRURVLV3:LOFR[RQ5DQN6XP7 HVW)XUWKHUPRUH DVLJQLÀFDQWO\LQFUHDVHGGLIIXVLRQFRQVWDQW'ZDVIRXQGLQSDWLHQWVZLWKPXOWLSOH P\HORPD3:LOFR[RQ5DQN6XP7 HVW1RVLJQLÀFDQWGLIIHUHQFHZDVIRXQG IRUWKHSHUIXVLRQIUDFWLRQI3 :LOFR[RQ5DQN6XP7 HVW &RQFOXVLRQ'&(05,DQG':,PD\DVVLVWLQGLIIHUHQWLDWLQJEHQLJQRVWHRSRURVLV IURPPDOLJQDQWERQHGLVHDVHFDXVHGE\PXOWLSOHP\HORPD % (DUO\SUHGLFWLRQRIKLVWRSDWKRORJLFDOUHVSRQVHWRSUHRSHUDWLYH FKHPRWKHUDS\LQORFDOO\DGYDQFHGJDVWULFFDQFHUE\)'*3(7&7 ) 0DJJL//HFFLVRWWL*7UHJOLD53HUVLDQL$*LRUGDQR/%RQRPR5RPH,7 IPDJJL#VLUPRUJ 3XUSRVH3UHRSHUDWLYHFKHPRWKHUDS\FDQLPSURYHWKHSURJQRVLVRISDWLHQWVZLWK ORFDOO\DGYDQFHGJDVWULFFDQFHU/$*& $LPRIWKLVSURVSHFWLYHREVHUYDWLRQDOVWXG\ LVHYDOXDWHWKHUROHRI)'*3(7&7WRHDUO\SUHGLFWKLVWRSDWKRORJLFDOUHVSRQVH GXULQJSUHRSHUDWLYHFKHPRWKHUDS\LQDJURXSRIDFFXUDWHO\VWDJHG/$*&SDWLHQWV 0HWKRGVDQG0DWHULDOV3DWLHQWVZLWKUHVHFWDEOH/$*&F7DEDQ\1RUDQ\F7 ZLWKQRGHPHWDVWDVHVZHUHLQFOXGHGLQWKHVWXG\DQGXQGHUZHQW)'*3(7&7 DWEDVHOLQHDQGGD\VDIWHULQLWLDWLRQRIFKHPRWKHUDS\3DWLHQWVZLWKQRQDYLG 5RRP& 2QFRORJLF,PDJLQJ 66 &(05,DQG':,05,IRUFDQFHUHYDOXDWLRQ 0RGHUDWRUV 6'HORUPH+HLGHOEHUJ'( 5*LURPHWWL8GLQH,7 % ,QWHUVFDQQHUFRPSDULVRQRIG\QDPLFFRQWUDVWHQKDQFHG05,LQ SURVWDWHFDQFHU7YHUVXV705 06HUWGHPLU''LQWHU'+DXVPDQQ+-0LFKDHO\66FK|QEHUJ$:HLGQHU 0DQQKHLP'(0HWLQ6HUWGHPLU#XPPGH 3XUSRVH7 RFRPSDUHWKHGLDJQRVWLFSRWHQWLDORI'&(05,WRGLIIHUHQWLDWHPDOLJ QDQWYVQRUPDOSURVWDWHDQGSURVWDWLWLVWLVVXHZLWKVSHFLDOUHJDUGWRGLIIHUHQWÀHOG VWUHQJWKVRIYV7 HVOD 0HWKRGV DQG 0DWHULDOV SDWLHQWV ZLWK ELRSV\ DQGRU SURVWDWHFWRP\ RI WKH SURVWDWHZHUHLQFOXGHGLQWKHVWXG\05,ZDVSHUIRUPHGDW7LQSDWLHQWVZLWK ELRSV\SURYHQSURVWDWHFDQFHU3&DQGLQSDWLHQWVZLWKSURVWDWLWLVDW7 05, ZDVXQGHUWDNHQLQSDWLHQWVEHIRUHSURVWDWHFWRP\DIWHUKLVWRORJLFDOO\SURYHQ3& DQGLQSDWLHQWVZLWKSURVWDWLWLV05,ZDVXQGHUWDNHQZLWKFRPELQHGERG\DQG HQGRUHFWDOFRLOSURWRFROLQDOOSDWLHQWVXVLQJD'7XUER)/$6+7:*5(VHTXHQFH WRFDOFXODWHSODVPDÁRZ3)DQGPHDQWUDQVLWWLPH077YDOXHV 5HVXOWV3&VKRZHGKLJKHU3)SDQGVKRUWHU077SDW7 DVZHOODVDW7SIRU3)DQGS IRU077FRPSDUHGWRQRUPDO WLVVXH3&GHPRQVWUDWHGKLJKHU3)WKDQSURVWDWLWLVS DQGVKRUWHU077 S DW7 EXWRQO\VKRUWHU077S DW7ZLWKRXWVLJQLÀFDQWO\ KLJKHU3)YDOXHVS ,QFRPSDULVRQZLWKQRUPDOWLVVXHSURVWDWLWLVKDGD VWDWLVWLFDOO\VLJQLÀFDQWKLJKHU3)DW7S EXWQRWDW7S DQG QRVLJQLÀFDQWO\VKRUWHU077YDOXHVERWKDW7S DQG7S &RQFOXVLRQ%RWKÀHOGVWUHQJWKVDUHFDSDEOHWRGLIIHUHQWLDWH3&YVQRUPDOWLVVXH 8VLQJ7 3&FDQEHEHWWHUGHOLQHDWHGIURPSURVWDWLWLVFRPSDUHGWR7 1HYHUWKH OHVVWKHUHVXOWVDUHHTXLYRFDOIRUGLIIHUHQWLDWLRQRISURVWDWLWLVDQGQRUPDOWLVVXH % &RQWUDVWHQKDQFHG05,IHDWXUHVRIHDUO\PLFURVFRSLFH[WUD FDSVXODUGLVHDVHLQSDWLHQWVZLWKNQRZQSURVWDWLFFDQFHU &6LW1'LNDLRV$.LUNKDP&$OOHQ$)UHHPDQ&0RRUH0(PEHUWRQ -.HOO\63XQZDQL/RQGRQ8.FKHUU\K\VLW#JPDLOFRP 3XUSRVH7 RDVVHVVFRQWUDVWHQKDQFHG05,IRUGHWHFWLRQRIPLFURVFRSLFH[WUD FDSVXODUGLVHDVHLQSDWLHQWVZLWKNQRZQSHULSKHUDO]RQHSURVWDWHFDQFHU 0HWKRGVDQG0DWHULDOV3UHELRSV\FRQWUDVWHQKDQFHG05LPDJHVRISDWLHQWV ZLWKKLVWRORJLFDOO\GLDJQRVHGSHULSKHUDO]RQHWXPRXUZLWKRXWPDFURVFRSLFH[WUD FDSVXODUGLVHDVHRQLPDJLQJZHUHUHWULHYHGIRUSURVSHFWLYHDQDO\VLV+LVWRORJLFDO FRQÀUPDWLRQRIWXPRXUZDVE\VWDQGDUGFRUH7586ELRSV\DQGRIWKH SDWLHQWVXQGHUZHQWVXEVHTXHQWUDGLFDOSURVWDWHFWRP\$QH[SHULHQFHGUDGLRORJLVW DZDUHRIWKHKLVWRORJLFDOO\FRQÀUPHGWXPRXUVLWHXQDZDUHRISUHVHQFHRUDEVHQFH RIPLFURVFRSLFH[WUDFDSVXODUH[WHQVLRQ(&(FRQWRXUHGWKHWXPRXURQFRQWUDVW HQKDQFHG LPDJHV UHFRUGLQJ L WRWDO WXPRXU YROXPH LL WRWDODUHD RI FDSVXODU DEXWPHQWLLLWXPRXUPXVFOHVLJQDOLQWHQVLW\UDWLRLYV\PPHWU\RISHULSURVWDWLF YDVFXODUHQKDQFHPHQWYV\PPHWU\RIFDSVXODUHQKDQFHPHQWYLDUHDXQGHU WXPRXUVLJQDOLQWHQVLW\WLPHFXUYHYLLLQLWLDOVORSHRIHQKDQFHPHQWRIWKHVLJQDO LQWHQVLW\WLPHFXUYHYLLLPD[LPXPHQKDQFHPHQWUDWLRL[HQKDQFHPHQWFXUYH VKDSHW\SH,,,RU,,,'LIIHUHQFHVEHWZHHQPHDQYDOXHVRIFRQWLQXRXVYDULDEOHV ZHUHDVVHVVHGXVLQJWWHVWDQG0DQQ:KLWQH\VWDWLVWLFVDQGGLIIHUHQFHVLQFDWHJRUL FDOYDULDEOHVZHUHDVVHVVHGXVLQJFKLVTXDUHDQG)LVKHUҋVH[DFWWHVWVIRUSDWLHQWV ZLWKDQGZLWKRXWKLVWRORJLFDO(&( 5HVXOWVSDWLHQWVKDGKLVWRORJLFDOO\FRQÀUPHG(&(7KHUHZDVVLJQLÀFDQWO\ LQFUHDVHGYDVFXODULW\RQWKHVDPHVLGHDVWKHSURVWDWLFWXPRXUIRUSDWLHQWVZLWK (&( S 7KHUH ZDV QR VLJQLÀFDQW GLIIHUHQFH EHWZHHQ SDWLHQWV ZLWK DQG ZLWKRXW(&(IRUDQ\RIWKHRWKHUSDUDPHWHUVS WR &RQFOXVLRQ,QFUHDVHGLSVLODWHUDOSHULSURVWDWLFYDVFXODULW\DORQHZDVDVVRFLDWHG ZLWK(&(RQFRQWUDVWHQKDQFHG05, 6FLHQWLILF6HVVLRQ $ 6&'()*+%(XURSHDQ&RQJUHVVRI 5DGLRORJ\ 0RQGD\ % 05,EDVHGOLYHUVHJPHQWDWLRQIRUTXDQWLÀFDWLRQRIIXQFWLRQDOOLYHU YROXPHHYDOXDWLRQRIDWKUHVKROGEDVHGPHWKRGIDFLOLWDWHGE\ KHSDWRELOLDU\FRQWUDVWPHGLD*G(2% -+5RWKH53DSHQGLHFN&*ULHVHU'6FKQDSDXII%+DPP7 'HQHFNH %HUOLQ'(MDQKROJHUURWKH#FKDULWHGH 3XUSRVH.QRZOHGJHRIWKHH[DFWWXPRXUYROXPHLVUHOHYDQWLQYDULRXVRQFRORJLFDO VFHQDULRVDVVHVVPHQWRIWXPRXUORDGUDGLRHPEROLVDWLRQGRVLPHWU\IXWXUHOLYHU UHPQDQW EHIRUH PDMRU VXUJHU\ 3XUSRVH ZDV WKH HYDOXDWLRQ RI WKLV DSSURDFK FRPSDUHGWRPDQXDOVHJPHQWDWLRQZLWK&7DVUHIHUHQFH 0HWKRGV DQG 0DWHULDOV$ WRWDO RI SDWLHQWV JDVWURLQWHVWLQDO SULPDU\ PDOLJQDQFLHV KHSDWLF SULPDU\ WXPRXUV ZHUH H[DPLQHG EHIRUHVHOHFWLYH LQWHUQDO UDGLRHPEROLVDWLRQ ZLWK FRPSXWHG WRPRJUDSK\ DQG *G(2%3ULPRYLVW %D\HU6FKHULQJHQKDQFHG05,RIWKHOLYHUZLWKLQRQHZHHN7Z'VHTXHQFHV 7+5,9(ZHUHDFTXLUHGLQWKHKHSDWRELOLDU\SKDVH7KHOLYHUYROXPHZDVPHDV XUHGE\PDQXDOVHJPHQWDWLRQRIWKHOLYHUVLOKRXHWWHH[FOXGLQJLQWUDKHSDWLFWXPRXU PDVVHVLQWKH&7DQG05GDWDVHWDQGE\PDQXDOO\DGMXVWHGWKUHVKROGLQJRIWKH 05GDWDVHWIROORZHGE\UHPRYDORIH[WUDKHSDWLFVWUXFWXUHV0HDQDEVROXWHHUURU UHSURGXFLELOLW\DQGGXUDWLRQRIHDFKVHJPHQWDWLRQSURFHGXUHE\DWKUHVKROGEDVHG YROXPHWU\DQGPDQXDOVOLFHVHJPHQWDWLRQZHUHTXDQWLÀHG 5HVXOWV$ 05,EDVHG OLYHU YROXPHWU\ XQGHUHVWLPDWHG WKH FDOFXODWHG YROXPH EDVHGRQ&7GDWDZLWKPHDQRIPD[LPXPIRUDPDQXDOVHJPHQWD WLRQPD[LPXPIRUWKHWKUHVKROGEDVHGPHWKRG)RUD05,EDVHG YROXPHWU\VHJPHQWDWLRQWLPHVEHWZHHQDQGPLQXWHVPHDQPLQXWHVZLWK DPDQXDOVOLFHVHJPHQWDWLRQEHWZHHQDQGPLQXWHVPHDQPLQXWHVIRU WKHWKUHVKROGEDVHGPHWKRGZHUHREVHUYHG6HJPHQWDWLRQWLPHVIRUD&7EDVHG OLYHUYROXPHWU\UDQJHGEHWZHHQDQGPLQXWHVPHDQPLQXWHV &RQFOXVLRQ:LWKDVPDOOPHDQDEVROXWHHUURUDQGWKHUHGXFHGVHJPHQWDWLRQWLPH FRPSDUHGWRPDQXDOVHJPHQWDWLRQ*G(2%YROXPHWU\RIIHUVTXLFNDQGFRQYHQLHQW VHJPHQWDWLRQRIIXQFWLRQDOOLYHUYROXPH % )XVLRQRIG\QDPLF&(05,PDPPRJUDSK\DW7HVODZLWK))' PDPPRJUDSK\SLORWVWXG\XVLQJDGHGLFDWHGVHPLDXWRPDWLF UHJLVWUDWLRQVRIWZDUH 0'LHW]HO 7 +RSS3 .UHLVHO195XLWHU+3 %XUPHLVWHU:$.DLVHU 3 $7 %DOW]HU-HQD'(.DUOVUXKH'(GLHW]HOPDWWKLDV#KRWPDLOFRP 3XUSRVH,PDJHIXVLRQRI[UD\PDPPRJUDSK\DQG05PDPPRJUDSK\;50 050DOORZVFRUUHODWLRQRISDWKRORJLFÀQGLQJVEHWZHHQWKHVHLPDJLQJPRGDOLWLHV HJPLFURFDOFLÀFDWLRQVDUFKLWHFWXUDOGLVWRUWLRQVIRFDOHQKDQFHPHQWVHWF7KXV LWKDVWKHSRWHQWLDOWRRSWLPLVHGLDJQRVWLFDFFXUDF\DQGFOLQLFDOZRUNÁRZRIEUHDVW LPDJLQJ7KLVSLORWVWXG\HYDOXDWHVWKHDFFXUDF\RIDGHGLFDWHGVHPLDXWRPDWLF LPDJHIXVLRQRI;50DQGKLJKUHVROXWLRQKLJKÀHOG050 0HWKRGVDQG0DWHULDO050ZHUHDFTXLUHGRQDKLJKÀHOGVFDQQHU7 HVOD 7ZHLJKWHG '9,%( *DGROLQLXP ;50 ZHUH REWDLQHG ZLWK VWDWHRIWKHDUW IXOOÀHOGGLJLWDOV\VWHPV3DWLHQWVZLWKFOHDUO\GHOLQHDEOHPDVVOHVLRQV!PPLQ ;50DQG050ZHUHHQUROOHGH[FOXVLRQFULWHULDSUHYLRXVEUHDVWVXUJHU\VXUJL FDOLQWHUYHQWLRQEHWZHHQ;50050;50DQG050ZHUHPDWFKHGXVLQJRXU LQKRXVHGHYHORSHGVRIWZDUHDOORZLQJVHPLDXWRPDWLFQRQOLQHDUGHIRUPDWLRQRI 050%DVHGRQWKH050DYLUWXDO'0DPPRJUDPZDVFDOFXODWHGWRLGHQWLI\ UHJLVWUDWLRQHUURUV5(ZLWKDQGZR*DGRGLDPLGH*GDQGFRPSDUHGWRWKHFRU UHVSRQGLQJ;507 RTXDQWLI\5(VWKHJHRPHWULFFHQWUHRIWKHOHVLRQVLQWKHYLUWXDO YVFRQYHQWLRQDOPDPPRJUDPZHUHVXEWUDFWHG5REXVWQHVVRIUHJLVWUDWLRQZDV TXDQWLÀHGE\UHJLVWUDWLRQRI;05VWRERWK050VZLWKDQGZR*DGRGLDPLGH 5HVXOWV ,PDJH UHJLVWUDWLRQ ZDV SHUIRUPHG VXFFHVVIXOO\ IRU DOO SDWLHQWV Q 2YHUDOO5(ZDVPPZR*GFRQÀGHQFHLQWHUYDO&,PPYVPP VWPLQXWHDIWHU*G&,PP0HDQGLIIHUHQFHEHWZHHQSUHYVSRVW FRQWUDVWVFDQVZDVPP &RQFOXVLRQ6HPLDXWRPDWLFLPDJHUHJLVWUDWLRQRIKLJKÀHOG05PDPPRJUDSK\ ZLWK [UD\ PDPPRJUDSK\ LV IHDVLEOH )RU WKLV VWXG\ DSSO\LQJ D KLJKUHVROXWLRQ SURWRFRODW7 HVODWKHUHJLVWUDWLRQZDVUREXVWDQGWKHRYHUDOOUHJLVWUDWLRQHUURU ZDVVXIÀFLHQWIRUFOLQLFDODSSOLFDWLRQ )'*WXPRXUDWEDVHOLQH3(7&7ZHUHH[FOXGHG&OLQLFDOUHVWDJLQJZDVUHSHDWHG SUHRSHUDWLYHO\7XPRUDOPHWDEROLFUHVSRQVHZDVDVVHVVHGDFFRUGLQJWR(257& FULWHULD+LVWRSDWKRORJLFDOUHVSRQVHZDVDVVHVVHGTXDOLWDWLYHO\E\7GRZQVWDJLQJ DQG TXDQWLWDWLYHO\ E\ JUDGLQJ RI WXPRXU UHJUHVVLRQ LQGXFHG E\ SUHRSHUDWLYH FKHPRWKHUDS\DFFRUGLQJWR%HFNHUҋVFULWHULD 5HVXOWV7ZHOYH/$*&UHVHFWDEOHSDWLHQWV)0PHDQDJH\HDUVZHUH LQFOXGHG)LYHSDWLHQWVZHUHFODVVLÀHGDVPHWDEROLFUHVSRQGHUVUHGXFWLRQ RI LQ WXPRUDO 689PD[ DQG VHYHQ SDWLHQWV DV PHWDEROLF QRQ UHVSRQGHUV LQFUHDVH RI LQ WXPRUDO 689PD[$OO PHWDEROLF UHVSRQGHUV VKRZHG7GRZQVWDJLQJZLWKSDUWLDOVXEWRWDODQGPLQLPDOWXPRXUUHJUHVVLRQ $OOPHWDEROLFQRQUHVSRQGHUVGLGQRWVKRZ7GRZQVWDJLQJDQGWXPRXUUHJUHVVLRQ DQDO\VLV VKRZHG PLQLPDO UHVSRQVHV DQG SDUWLDO UHVSRQVH$GGLWLRQDOO\ PHWDEROLFUHVSRQGHUVZHUH\S1ZKLOHPHWDEROLFQRQUHVSRQGHUVZHUH\S1 &RQFOXVLRQ)'*3(7&7FRXOGEHDUHOLDEOHPRGDOLW\WRSUHGLFWKLVWRSDWKRORJL FDOUHVSRQVHDWDQHDUO\VWDJHRIWKHSUHRSHUDWLYHWUHDWPHQWLQ/$*&SDWLHQWV WKXVDOORZLQJDFKDQJHLQWKHWUHDWPHQWIRUPHWDEROLFQRQUHVSRQGHUVSDWLHQWV % $'&PDSVGLIIHUHQWLDWLRQRIPHWDVWDWLFIURPQRQPHWDVWDWLFO\PSK QRGHVLQSDWLHQWVZLWKHQGRPHWULDOFDQFHU *5HFKLFKL6*DOLPEHUWL$&&DGRQLFL&7 DOHL)UDQ]HVL33HUHJR66LURQL 0RQ]D,7JLOGDUHFKLFKL#JPDLOFRP 3XUSRVH 7 R HYDOXDWH WKH XVHIXOQHVV RI GLIIXVLRQZHLJKWHG LPDJHV ZLWK ERG\ EDFNJURXQG VXSSUHVVLRQ ':,%6 DQG DSSDUHQW GLIIXVLRQ FRHIÀFLHQW $'& WR GLVFULPLQDWH EHWZHHQ PHWDVWDWLF DQG QRQPHWDVWDWLF SHOYLF O\PSK QRGHV LQ HQ GRPHWULDOFDQFHU 0HWKRGVDQG0DWHULDOV7KLVSURVSHFWLYHVWXG\LQFOXGHGSDWLHQWVZLWKKLVWR ORJLFDOO\ SURYHQ HQGRPHWULDO FDQFHU ZKR XQGHUZHQW 05 H[DPLQDWLRQ LQFOXGLQJ 7ZHLJKWHGG\QDPLF7ZHLJKWHGDQGGLIIXVLRQZHLJKWHGLPDJHVZLWKEDFNJURXQG VXSSUHVVLRQ':,%6ZLWKEYDOXHVRIDQGVPP7KHQDOOSDWLHQWVXQGHU ZHQWWRWDOK\VWHUHFWRP\DQGSHOYLFO\PSKDGHQHFWRP\ $OOLGHQWLÀDEOHO\PSKQRGHV RQ':,%6Q ZHUHHYDOXDWHGDQGIRUHDFKO\PSKQRGHPHDQ$'&YDOXHV VKRUWDQGORQJD[LVGLDPHWHUVZHUHPHDVXUHGDQGFRPSDUHG+LVWRSDWKRORJLFDO ÀQGLQJVVHUYHGDVWKHUHIHUHQFHVWDQGDUG 5HVXOWV 0HDQ 6'$'& YDOXHV PPVHF RI PHWDVWDWLF O\PSK QRGHV Q ZHUHVLJQLÀFDQWO\ORZHUWKDQWKRVHRIQRQPHWDVWDWLFO\PSK QRGHVQ SYDOXH/RQJDQGVKRUWD[LVGLDPHWHUVRI PHWDVWDWLFYVQRQPHWDVWDWLFO\PSKQRGHVZHUHPPYVPP DQGPPYVPPUHVSHFWLYHO\ &RQFOXVLRQ,QHQGRPHWULDOFDQFHUSDWLHQWV$'&PHDVXUHPHQWVRISHOYLFO\PSK QRGHVDOORZWRGLVFULPLQDWHEHWZHHQPHWDVWDWLFDQGQRQPHWDVWDWLFQRGHV % 0XOWLPRGDOLW\TXDQWLÀFDWLRQRIWXPRXUSHUIXVLRQLQGLIIXVLRQ ZHLJKWHG05,DQGG\QDPLF3(7LQDURGHQWPRGHO 10RUWD]DYL-HKDQQR'%DOYD\&%RXULOORQ&%DGRXDO0%HUQDUGLQL 0)DUDJJL&$&XHQRG2&OHPHQW/6)RXUQLHU3DULV)5 QLQDMHKDQQR#HJSDSKSIU 3XUSRVH'HYHORSPHQWRIQHZSDUDPHWHUVRIDFTXLVLWLRQDQGWUHDWPHQWIRUWKH DVVHVVPHQWRIWXPRXUSHUIXVLRQXVLQJGLIIXVLRQZHLJKWHG05,DQGG\QDPLF3(7 &7ZLWK))'*LQDURGHQWPRGHO 0HWKRGVDQG0DWHULDOV([SHULPHQWDWLRQVZHUHPDGHRQWZRPRGHOVRIHSLGHU PRLGKHDGDQGQHFNFDUFLQRPDLPSODQWHGLQQXGHUDWV)D'XDKLJKO\YDVFXODULVHG WXPRXUDQG$DSRRUO\YDVFXODULVHGWXPRXU':05,ZDVSHUIRUPHGZLWKDQ DFTXLVLWLRQRIGLIIHUHQWEYDOXHVIRUZKLFKD´FOLQLFDO$'&µXVLQJRQO\ E DPRQRH[SRQHQWLDODQGDELH[SRQHQWLDODQDO\VLVRI$'&DQGSHUIXVLRQ SDUDPHWHUVI' ZHUHFDOFXODWHG'\QDPLF3(7&7ZDVSHUIRUPHGZLWKYLVXDO DQDO\VLVRIHQKDQFHPHQWFXUYHVDQGD3DWODNDQGFRPSDUWPHQWDODQDO\VLV$OO GDWD ZHUH FRUUHODWHG SDWKRORJ\ ZLWK VHPLTXDQWLWDWLYH HYDOXDWLRQ RI YDVFXODULW\ QHFURVLVLQÁDPPDWLRQDQGKDHPRUUKDJH 5HVXOWV ':05, GDWD ZLWK ELH[SRQHQWLDO DQDO\VLV DOORZHG VHSDUDWLRQ RI WZR FRPSRQHQWVZLWKDSHUIXVLRQIUDFWLRQIJUHDWHUIRU)D'XWKDQ$YV S FRQVLVWHQW ZLWK SDWKRORJ\ 7KHUH ZDV DOVR D VLJQLÀFDQW GLIIHUHQFH LQ GLIIXVLRQEHWZHHQWKHWXPRXUW\SHV'UYVS EXWZKLFKGLGQRW FRUUHODWHDVSHFLÀFSDWKRORJLFDOFKDUDFWHULVWLF(QKDQFHPHQWFXUYHVLQG\QDPLF 3(7VKRZHGDQDFFXPXODWLRQRIWUDFHULQWKHWXPRXUVWDUWLQJIURPWKHÀUVWPLQXWH 3HUIXVLRQSDUDPHWHUVH[WUDFWHGXVLQJ3DWODNRUFRPSDUWPHQWDODQDO\VLVGLGQRW \LHOGDVLJQLÀFDQWGLIIHUHQFHEHWZHHQWKHWZRJURXSV &RQFOXVLRQ 2XU VWXG\ DOORZHG RSWLPLVDWLRQ RI GDWD DFTXLVLWLRQ DQG DQDO\VLV IRUWKHHYDOXDWLRQRIWXPRXUSHUIXVLRQXVLQJPXOWLE':05,DQGG\QDPLF3(7 6FLHQWLILF6HVVLRQ 6 &$' ( ) *+% (XURSHDQ&RQJUHVVRI 5DGLRORJ\ % 7KHKXPDQH\HDIWHUOHQVUHSODFHPHQWVXUJHU\ 3 &.UJHU6/DQJQHU26WDFKV5$OOHPDQQ5*XWKRII1+RVWHQ *UHLIVZDOG'(5RVWRFN'( 3XUSRVH7 RGD\OHQVUHSODFHPHQWLVDEDVLFPHWKRGRIFDWDUDFWWUHDWPHQW7KH HYDOXDWLRQ RI SRVWRSHUDWLYH FKDQJHV HVSHFLDOO\ LQ WKH DUHD RIWKH SRVWHULRU FLU FXPIHUHQFHLVRIWHQLQDGHTXDWHXVLQJRSKWKDOPRORJLFVWDQGDUGPHWKRGVVXFKDV XOWUDVRXQGRURSWLFDOFRKHUHQFHWRPRJUDSK\+LJKÀHOGPDJQHWLFUHVRQDQFHLPDJLQJ 05,HQDEOHVHYDOXDWLRQRIWKHVWUXFWXUHVRIWKHDQWHULRUH\HVHJPHQWEHIRUHDQG DIWHUFDWDUDFWVXUJHU\ZLWKKLJKUHVROXWLRQDQGIUHHRIGLVWRUWLRQ 0HWKRGVDQG0DWHULDOV7 HQSVHXGRSKDNLFKXPDQH\HVFDWDUDFWVXUJHU\ZHUH H[DPLQHGH[YLYRZLWKXOWUDKLJKÀHOG05,7 HVOD&OLQ6FDQ%UXNHU%LR6FDQ XVLQJDVPDOOVXUIDFHFRLODQG7ZHLJKWHGVSLQHFKRVHTXHQFHV'LIIHUHQWELR PHWULFDOGLVWDQFHVRIWKHSVHXGRSKDNLFVLWXDWLRQZHUHPHDVXUHGDQGFRUUHODWHG ZLWKWKHFU\VWDOOLQHOHQVVLWXDWLRQ 5HVXOWV8OWUDKLJKÀHOG05,DW7 HVODSURYLGHGH[FHOOHQWYLVXDOLVDWLRQRIDQWHULRU VHJPHQWGHWDLOVHVSHFLDOO\LQWKHDUHDRIWKHSRVWHULRUFLUFXPIHUHQFHRIWKHOHQV,W ZDVSRVVLEOHWRHYDOXDWHWKHSRVWRSHUDWLYHFKDQJHVDIWHUOHQVUHSODFHPHQWZLWKRXW GLVWRUWLRQDQGZLWKKLJKVSDWLDOUHVROXWLRQ &RQFOXVLRQ2XUUHVXOWVVXJJHVWWKDW05PLFURVFRS\KDVWKHSRWHQWLDOWRLPDJH VPDOODQDWRPLFDOVWUXFWXUHVDQGWRHYDOXDWHWKHUHVXOWVRIVXUJLFDOLQWHUYHQWLRQV 705,SURYLGHVDQH[WUHPHO\KLJKVSDWLDOUHVROXWLRQXQGHUDEVHQFHRIGLVWRU WLRQDUWHIDFWV:KLOHRXUVWXG\ZDVSHUIRUPHGH[YLYRZHH[SHFWWKDWZLWKZLGHU DYDLODELOLW\XOWUDKLJKÀHOG05PLFURVFRS\ZLOOHYROYHLQWRDQHVVHQWLDOWRROIRUERWK H[SHULPHQWDOVWXGLHVDQGGDLO\URXWLQH % 8VHIXOQHVVRISHUIXVLRQZHLJKWHG05LPDJLQJLQWKHDVVHVVPHQW RIWKHHIIHFWVRI+,9EUDLQLQIHFWLRQLQDV\PSWRPDWLF+,9SRVLWLYH QRQWUHDWHG+,9SRVLWLYH+$$57WUHDWHGDQG+,9+&9SRVLWLYHSDWLHQWV $.ROWRZVND-%ODGRZVND3 6]HZF]\N$=LPQ\%+HQGULFK%.Q\V] 06DVLDGHN:URFODZ3/DQQDNROWRZVND#JPDLOFRP 3XUSRVH+,9HQWHUVWKHEUDLQHDUO\DIWHULQLWLDOH[SRVXUHDQGFDQFDXVHFHQWUDO QHUYRXVV\VWHP&16G\VIXQFWLRQOHDGLQJWRQHXURSV\FKRORJLFDOLPSDLUPHQW7KH DLPRIWKHVWXG\ZDVWRHYDOXDWHWKHLPSDFWRIWKH+,9LQIHFWLRQRQWKHFHUHEUDO PLFURFLUFXODWLRQLQDV\PSWRPDWLF+,9SRVLWLYHSDWLHQWV 0HWKRGVDQG0DWHULDOV)RUW\WKUHH+,9SRVLWLYHDV\PSWRPDWLFSDWLHQWV+,9 SRVLWLYHQRQWUHDWHGPHDQDJH\UV+,9SRVLWLYH+$$57WUHDWHGPHDQ DJH\UV+,9+&9SRVLWLYHPHDQDJH\UVDQGQRUPDOFRQWURO VXEMHFWV PHDQ DJH \UV ZHUH HQUROOHG LQ WKH VWXG\ 3:, ZDV SHUIRUPHG ZLWKD705XQLWXVLQJG\QDPLFVXVFHSWLELOLW\FRQWUDVW'6&PHWKRG&HUHEUDO EORRGYROXPH&%9PHDVXUHPHQWUHODWLYHWRFHUHEHOOXPU&%9ZDVHYDOXDWHG LQWKHSRVWHULRUFLQJXODWHUHJLRQWHPSRURSDULHWDODQGIURQWDODVVRFLDWLRQFRUWLFHV DVZHOODVLQWKHZKLWHPDWWHURIIURQWRSDULHWDODUHDV 5HVXOWV6LJQLÀFDQWO\ORZHUU&%9YDOXHVFRPSDUHGWRQRUPDOVXEMHFWVZHUHIRXQG LQ WHPSRURSDULHWDO ULJKW S OHIW S DQG IURQWDO FRUWLFHV ULJKW S OHIWS LQDOO+,9SRVLWLYHSDWLHQWVZKLOHWKHUHZHUHQRVXFKGLIIHUHQFHVLQ WKHSRVWHULRUFLQJXODWHUHJLRQS DQGLQWKHZKLWHPDWWHURIIURQWRSDULHWDO DUHDVULJKWS OHIWS +,9SRVLWLYH+$$57WUHDWHGDQG+,9+&9SRVLWLYH SDWLHQWVGHPRQVWUDWHGORZHUU&%9YDOXHVLQWKHULJKWIURQWDOFRUWH[FRPSDUHGWR +,9SRVLWLYHQRQWUHDWHGVXEMHFW &RQFOXVLRQ7KHU&%9YDOXHSDUWLFXODUO\PHDVXUHGLQWHPSRURSDULHWDODQGIURQWDO FRUWLFHVFRXOGEHDQRQLQYDVLYHQHXURLPDJLQJELRPDUNHUIRUDVVHVVLQJWKHLPSDFW RI+,9LQIHFWLRQRQWKHLPSDLUPHQWRIFHUHEUDOPLFURFLUFXODWLRQLQDV\PSWRPDWLF+,9 SRVLWLYHSDWLHQWV7KHVHFKDQJHVDUHWKHPRVWVLJQLÀFDQWLQ+,9SRVLWLYH+$$57 WUHDWHGDQG+,9+&9SRVLWLYHSDWLHQWV % $VXEMHFWLYHVFRUHIRUROIDFWRU\EXOELQMXU\LQSRVWWUDXPDDQRVPLD 66HÀGEDNKW%.KDGHPL++RVHLQLDO+DVKHPL0/RWÀ==DUH5-DOOL 06HÀGEDNKW6KLUD],5VHSLGHKVHÀGEDNKW#\DKRRFRP 3XUSRVH7 RGHVLJQDVXEMHFWLYHJUDGLQJV\VWHPIRUROIDFWRU\EXOELQMXU\LQSRVW WUDXPDDQRVPLDDQGWRFRPSDUHLWZLWKREMHFWLYHPHDVXUHPHQWRIROIDFWRU\EXOE YROXPH 0HWKRGVDQG0DWHULDOV,QSDWLHQWVZLWKSRVWWUDXPDDQRVPLDROIDFWRU\EXOE YROXPHVZHUHPHDVXUHGXVLQJPDQXDOWUDFLQJRIWKHEXOELQKLJKUHVROXWLRQFRURQDO '),(67$LPDJHV7*(6LJQD([LWH,QDVHSDUDWHVHVVLRQPRQWKVODWHU WKHROIDFWRU\EXOEVZHUHVXEMHFWLYHO\DVVLJQHGWRDSRLQWVFDOHE\WZRUDGLROR JLVWVLQFRQVHQVXVLQGHSHQGHQWO\IRU7)6(DQG),(67$FRURQDOLPDJHV%XOEV ZHUHDVVLJQHGDVFRUHRILIQRUPDOORRNLQJLIVPDOOEXWRWKHUZLVHQRUPDOLI 5RRP' 1HXUR 66 1HZÀHOGVDQGGHYHORSPHQWV 0RGHUDWRUV 6-%DNNH2VOR12 -5DPDOKR/LVERQ37 % (YDOXDWLRQRIGLIIXVLYLW\LQDQWHULRUOREHRIWKHSLWXLWDU\JODQG' WXUERÀHOGHFKRZLWKGLIIXVLRQVHQVLWLVHGGULYHQHTXLOLEULXPSUHSDUDWLRQ $+LZDWDVKL7 <RVKLXUD27 RJDR.<DPDVKLWD..LNXFKL02EDUD ++RQGD)XNXRND-3 3XUSRVH ' WXUER ÀHOG HFKR 7)( ZLWK GLIIXVLRQVHQVLWLVHG GULYHQHTXLOLEULXP '6'(SUHSDUDWLRQLVDQRYHOQRQHFKRSODQDU(3,WHFKQLTXHIRUGLIIXVLRQZHLJKW HGLPDJLQJ':,ZKLFKHQDEOHVKLJKUHVROXWLRQ':,ZLWKRXWÀHOGLQKRPRJHQHLW\ UHODWHGLPDJHGLVWRUWLRQ7KHSXUSRVHRIWKLVVWXG\ZDVWRHYDOXDWHWKHIHDVLELOLW\ RIWKLVVHTXHQFHWRDVVHVVWKHQRUPDOSLWXLWDU\JODQG 0HWKRGVDQG0DWHULDOV)LUVWYDOLGDWLRQRI'6'(':,ZDVDWWHPSWHGE\FRP SDULQJZLWKFRQYHQWLRQDO(3,':,)LYHKHDOWK\YROXQWHHUVZHUHLPDJHGXVLQJD '6'(':,VHTXHQFHDQGDQ(3,VHTXHQFH)RUERWKPHWKRGVDPRWLRQSURELQJ JUDGLHQWZDVDSSOLHGLQRQHGLUHFWLRQ$3ZLWKEYDOXHVRIDQGVPP7KH LPDJLQJYR[HOVL]HZDV[[PPIRUWKH'6'(DQG[[PPIRUWKH (3,7KHDSSDUHQWGLIIXVLRQFRHIÀFLHQW$'&PHDVXUHGE\WKHWZRPHWKRGVLQ UHJLRQVLQJUH\PDWWHUDQGLQZKLWHPDWWHUZHUHFRPSDUHGXVLQJ3HDUVRQҋV FRUUHODWLRQFRHIÀFLHQW7KHQWKH$'&LQWKHSLWXLWDU\DQWHULRUOREHZDVPHDVXUHG LQYROXQWHHUVXVLQJWKH'6'(':,VHTXHQFHDQGFRPSDUHGZLWKWKRVHLQWKH SRQVDQGFHUHEHOOXPXVLQJWKHWWHVW 5HVXOWV$'&IURPWKHWZRPHWKRGVVKRZHGJRRGFRUUHODWLRQU FRQÀUP LQJWKHDFFXUDF\LQ$'&PHDVXUHPHQWZLWKWKH'6'(VHTXHQFH7KH$'&LQWKH QRUPDOSLWXLWDU\JODQGZDV[PPV7KLVZDVVLJQLÀFDQWO\KLJKHU WKDQWKDWLQWKHSRQV[PPVDQGLQWKHFHUHEHOOXP [PPV3UHVSHFWLYHO\ &RQFOXVLRQ:HGHPRQVWUDWHGWKDW'6'(':,LVIHDVLEOHWRDVVHVV$'&LQWKH SLWXLWDU\JODQG % 6RQRJUDSKLFHYDOXDWLRQRIWKHLQWUDFUDQLDOSUHVVXUHLQDGXOWEUDLQLQMXU\ 7 6ROGDWRV$.DUDELQLV97 VDJNRXOL6.DPSDQDURX67 DQWHOHV *(FRQRPRX/7KDQRV03RPRQL'$.HOHNLV$WKHQV*5 PNDPSDQDURX#JPDLOFRP 3XUSRVH7KHRSWLFQHUYHVKHDWKGLDPHWHU216'PD\EHLQFUHDVHGLQEUDLQ LQMXUHGSDWLHQWVZLWKHOHYDWHGLQWUDFUDQLDOSUHVVXUH,&3:HHYDOXDWHGZKHWKHU 216'PHDVXUHPHQWVFRUUHODWHZLWKLQYDVLYHDQGQRQLQYDVLYH,&3PHDVXUHPHQWV LQEUDLQLQMXUHGDGXOWV 0HWKRGVDQG0DWHULDOV:HH[DPLQHGEUDLQLQMXUHGSDWLHQWVDQGFRQWURO VXEMHFWVZLWKRXWLQWUDFUDQLDOSDWKRORJ\%UDLQLQMXUHGSDWLHQWVZHUHHYDOXDWHGXV LQJ*ODVJRZFRPDVFDOH*&6DQGDVHPLTXDQWLWDWLYH,9,QHXURLPDJLQJVFDOH 0DUVKDOO6FDOH06DQGZHUHGLYLGHGLQWRPRGHUDWHO\06 ,DQG*&6!Q DQGVHYHUHO\06 ,,9,DQG*&6Q EUDLQLQMXUHGVXEMHFWV0HDVXUHPHQWV RI WKH 216' DQG QRQLQYDVLYH ,&3 H,&3 XVLQJ RSWLF QHUYH VRQRJUDSK\ DQG WUDQVFUDQLDO'RSSOHUVRQRJUDSK\UHVSHFWLYHO\ZHUHSHUIRUPHGXSRQDGPLVVLRQLQ FRQWUROVDQGPRGHUDWHO\EUDLQLQMXUHGVXEMHFWVDQGWKUHHWLPHVGXULQJKRVSLWDOLVD WLRQLQVHYHUHO\EUDLQLQMXUHGSDWLHQWV8SRQDGPLVVLRQVHYHUHO\EUDLQLQMXUHG SDWLHQWVDOVRXQGHUZHQWLQYDVLYH,&3PHDVXUHPHQW 5HVXOWV ,Q VHYHUHO\ EUDLQLQMXUHG SDWLHQWV WKH 216' FRUUHODWHG ZLWK WKH 06 U DQGWKHH,&3U LQDOOWKUHHHYDOXDWLRQVZKHUHDV216' DQGH,&3ZHUHVLJQLÀFDQWO\LQFUHDVHGPPDQGPP+JDVFRP SDUHGZLWKPRGHUDWHO\EUDLQLQMXUHGVXEMHFWVPPDQGPP+JDQG FRQWUROVPPDQGPP+J3,QYDVLYH,&3PHDVXUHPHQWV DOVRFRUUHODWHGZLWK216'PHDVXUHPHQWVU 3 7KHEHVWFXWRII216' YDOXHIRUSUHGLFWLQJHOHYDWHG,&3ZDVPPVHQVLWLYLW\ VSHFLÀFLW\ &RQFOXVLRQ216'PHDVXUHPHQWVFRUUHODWHZLWKLQYDVLYHDQGQRQLQYDVLYH,&3 PHDVXUHPHQWVDQGZLWKQHXURLPDJLQJÀQGLQJVLQEUDLQLQMXUHGDGXOWV2SWLFQHUYH VRQRJUDSK\FRXOGDOHUWFOLQLFLDQVWRWKHSUHVHQFHRIHOHYDWHG,&3 ZKHQHYHULQYDVLYH ,&3HYDOXDWLRQLVFRQWUDLQGLFDWHGDQGRULVXQDYDLODEOH 6FLHQWLILF6HVVLRQ $ 6&'()*+%(XURSHDQ&RQJUHVVRI 5DGLRORJ\ 0RQGD\ &RQFOXVLRQ'LIIHUHQFHVLQWKHVLJQDOLQWHQVLW\RIWKHSRVWHULRUSLWXLWDU\JODQGEH WZHHQJHQGHUVDQGDJHVH[LVWLQWKHJHQHUDOSRSXODWLRQZLWKDSSURSULDWHPHWDEROLF VWDWHDQGÁXLGEDODQFH % 7ZHLJKWHGJUDGLHQWHFKRYVVSLQHFKRVHTXHQFHVLQJDGROLQLXP HQKDQFHGEUDLQLPDJLQJDW7 FRPSDULVRQLQWHUPVRILPDJHTXDOLW\ ÁRZDUWHIDFWVDQGGHSLFWLRQRIYHVVHOV ')ORHU\6.LUFKQHU&*LQWKRHU5:XQQ) $)HOOQHU/LQ]$7 GDQLHOÁRHU\#DNKOLQ]DW 3XUSRVH :LWK 7 05 XQLWV 7ZHLJKWHG JUDGLHQW HFKR VHTXHQFHV VXFK DV )/$6+DUHRIWHQXVHGLQVWHDGRIVSLQHFKR6(VHTXHQFHVIRUEUDLQLPDJLQJGXH WRZHOONQRZQGLVDGYDQWDJHVRI6(VHTXHQFHVDWWKLVÀHOGVWUHQJWK7KHSXUSRVH RI WKLV VWXG\ ZDV WR HYDOXDWH FRQWUDVWHQKDQFHG )/$6+ YV 6( VHTXHQFHV LQ WHUPVRILPDJHTXDOLW\ÁRZDUWHIDFWVLQDUWHULDODQGYHQRXVFHUHEUDOYHVVHOVDQG GHSLFWLRQRIVPDOOYHVVHOV 0HWKRGVDQG0DWHULDOV,QSDWLHQWVD[LDO)/$6+DVZHOODV6(VHTXHQFHV ZDVDFTXLUHGDIWHUJDGROLQLXPDGPLQLVWUDWLRQ7ZRUDGLRORJLVWVDVVHVVHGWKHIRO ORZLQJSDUDPHWHUVLQERWKVHTXHQFHV,PDJHTXDOLW\ÁRZDUWHIDFWVDQGTXDOLW\RI GHSLFWLRQLQODUJHDUWHULHVVPDOODUWHULHVDQGGXUDOVLQXVHVUHVSFHUHEUDOYHLQV HDFKDVVHVVHGZLWKDWLHUVFDOH 5HVXOWV,QDOOFDVHVRYHUDOOLPDJHTXDOLW\RI)/$6+VHTXHQFHZDVVXSHULRUWR 6( ,Q WKH GHSLFWLRQ RI ODUJHU DUWHULHV )/$6+ ZDV DVVHVVHG VXSHULRU WR 6( LQ RIFDVHVZKHUHDVLQWKHGHSLFWLRQRIVPDOOYHVVHOV6(ZDVVXSHULRULQ )ORZDUWHIDFWVZHUHFRPSOHWHO\DEVHQWLQ)/$6+ZKHUHDV6(GHPRQVWUDWHGÁRZ DUWHIDFWVLQDQGUHVSHFWLYHO\,QWKHYLVXDOLVDWLRQRIVLQXVHVDQGFHUHEUDO YHLQV)/$6+ZDVIRXQGWREHHTXDORUVXSHULRUWR6(LQ(TXDOO\WRDUWHULHV ÁRZDUWHIDFWVZHUHUDUHO\IRXQGLQ)/$6+YVRIFDVHV &RQFOXVLRQ$W7 7Z*5(VHTXHQFHVGHPRQVWUDWHLPSURYHGRYHUDOOLPDJH TXDOLW\DQGEHWWHUGHSLFWLRQRIODUJHFHUHEUDODUWHULHVDQGVLQXVHVLQFRPSDULVRQWR 6(VHTXHQFHVZKLOHVPDOOYHVVHOVDUHVLJQLÀFDQWO\EHWWHUVHHQZLWK6(VHTXHQFHV % 6RQRJUDSKLFHYDOXDWLRQRIWKHLQWUDFUDQLDOSUHVVXUHLQDGXOWEUDLQLQMXU\ 7 6ROGDWRV$WKHQV*5VROGDWRV#JPDLOFRP 3XUSRVH7KHRSWLFQHUYHVKHDWKGLDPHWHU216'PD\EHLQFUHDVHGLQEUDLQ LQMXUHGSDWLHQWVZLWKHOHYDWHGLQWUDFUDQLDOSUHVVXUH,&3:HHYDOXDWHGZKHWKHU 216'PHDVXUHPHQWVFRUUHODWHZLWKLQYDVLYHDQGQRQLQYDVLYH,&3PHDVXUHPHQWV LQEUDLQLQMXUHGDGXOWV 0HWKRGVDQG0DWHULDOV:HH[DPLQHGEUDLQLQMXUHGSDWLHQWVDQGFRQWURO VXEMHFWVZLWKRXWLQWUDFUDQLDOSDWKRORJ\%UDLQLQMXUHGSDWLHQWVZHUHHYDOXDWHGXV LQJ*ODVJRZFRPDVFDOH*&6DQGDVHPLTXDQWLWDWLYH,9,QHXURLPDJLQJVFDOH 0DUVKDOO6FDOH06DQGZHUHGLYLGHGLQWRPRGHUDWHO\06 ,DQG*&6!Q DQGVHYHUHO\06 ,,9,DQG*&6Q EUDLQLQMXUHGVXEMHFWV0HDVXUHPHQWV RI WKH 216' DQG QRQLQYDVLYH ,&3 H,&3 XVLQJ RSWLF QHUYH VRQRJUDSK\ DQG WUDQVFUDQLDO'RSSOHUVRQRJUDSK\UHVSHFWLYHO\ZHUHSHUIRUPHGXSRQDGPLVVLRQLQ FRQWUROVDQGPRGHUDWHO\EUDLQLQMXUHGVXEMHFWVDQGWKUHHWLPHVGXULQJKRVSLWDOLVD WLRQLQVHYHUHO\EUDLQLQMXUHGSDWLHQWV8SRQDGPLVVLRQVHYHUHO\EUDLQLQMXUHG SDWLHQWVDOVRXQGHUZHQWLQYDVLYH,&3PHDVXUHPHQW 5HVXOWV ,Q VHYHUHO\ EUDLQLQMXUHG SDWLHQWV WKH 216' FRUUHODWHG ZLWK WKH 06 U DQGWKHH,&3U LQDOOWKUHHHYDOXDWLRQVZKHUHDV216' DQGH,&3ZHUHVLJQLÀFDQWO\LQFUHDVHGPPDQGPP+JDVFRP SDUHGZLWKPRGHUDWHO\EUDLQLQMXUHGVXEMHFWVPPDQGPP+JDQG FRQWUROVPPDQGPP+J3,QYDVLYH,&3PHDVXUHPHQWV DOVRFRUUHODWHGZLWK216'PHDVXUHPHQWVU 3 7KHEHVWFXWRII216' YDOXHIRUSUHGLFWLQJHOHYDWHG,&3ZDVPPVHQVLWLYLW\ VSHFLÀFLW\ &RQFOXVLRQ216'PHDVXUHPHQWVFRUUHODWHZLWKLQYDVLYHDQGQRQLQYDVLYH,&3 PHDVXUHPHQWVDQGZLWKQHXURLPDJLQJÀQGLQJVLQEUDLQLQMXUHGDGXOWV2SWLFQHUYH VRQRJUDSK\FRXOGDOHUWFOLQLFLDQVWRWKHSUHVHQFHRIHOHYDWHG,&3 ZKHQHYHULQYDVLYH ,&3HYDOXDWLRQLVFRQWUDLQGLFDWHGDQGRULVXQDYDLODEOH VRPHKRZKLJKVLJQDOEXWRWKHUZLVHQRUPDOLIODUJHDQGGHIRUPHGLIVPDOODQG GHIRUPHGLIGHIRUPHGDQGKLJKVLJQDODQGLIQRWGHÀQLWHO\LGHQWLÀHG6XEMHFWLYH VFRUHZDVFRPSDUHGZLWKYROXPHXVLQJOLQHDUUHJUHVVLRQ 5HVXOWV7KHEHWWHUDQGZRUVHEXOEVZHUHFPóDQGFPóLQYROXPH UHVSHFWLYHO\6XEMHFWLYHVFRULQJLQ7)6(DQG),(67$LPDJHVGLGQRWFRUUHODWH VLJQLÀFDQWO\ZLWKWKHEHWWHUROIDFWRU\EXOEYROXPH6XEMHFWLYHVFRULQJLQ),(67$ LPDJHV FRUUHODWHV VLJQLÀFDQWO\ ZLWK WKH ZRUVH ROIDFWRU\ EXOE YROXPH S 7KHUHZHUHUHVSHFWLYHO\OHVLRQVZLWKLQFDWHJRULHVDQG &RQFOXVLRQ $VPDOOGHIRUPHGROIDFWRU\EXOELVWKHPRVWIUHTXHQWÀQGLQJVLQSRVW WUDXPDDQRVPLD6XEMHFWLYHDVVHVVPHQWRIWKHROIDFWRU\EXOEFRUUHODWHVZHOOZLWK REMHFWLYHPHDVXUHPHQWLQWKHPRUHVHYHUHO\LQMXUHGEXOE % 6LJQDOLQWHQVLW\SURÀOHDQDO\VLVRIWKHROIDFWRU\EXOEDQGWUDFWIRU HYDOXDWLRQRISDWKRORJLFROIDFWRU\EXOEFKDQJHVLQQHXURORJLFDODQG VPHOOLQJGLVRUGHUVFRPSDULVRQRI7 705PLFURVFRS\DQG KLVWRORJLFDOVHFWLRQV +3 %XUPHLVWHU 7 %LWWHU3 0+HLOHU$,ULQWFKHY5)URHEHU 3 $7 %DOW]HU-55HLFKHQEDFK2*XQWLQDV/LFKLXV:$.DLVHU -HQD'(0DQQKHLP'(KDUWPXWEXUPHLVWHU#PHGXQLMHQDGH 3XUSRVH 1HXURORJLFDO DQG VPHOOLQJ GLVRUGHUV HJ$O]KHLPHUҋV GLVHDVH VLQR QDVDO GLVHDVH QHJDWLYHO\ DIIHFW WKH PLFURVWUXFWXUDO LQWHJULW\RI ROIDFWRU\ EXOEҋV 2% SDOHRFRUWLFDO OD\HUV 5HFRYHU\ SURFHVVHV GHSHQG RQ DFWLYHUHVWRUDWLRQ RI WKLVPLFURVWUXFWXUDOLQWHJULW\HQDEOHGE\QHXURQHRJHQHVLVLQWKH2%7KHDLPRI WKLVVWXG\ZDVWRHYDOXDWHODPLQDWLRQSDWWHUQVRIWKH2%DQGDGMDFHQWWUDFW27 0HWKRGVDQG0DWHULDOV7ZHQW\IRXUKXPDQ2%VXQGHUZHQWLQYLWURVWDQGDUGDQG KLJKUHVROXWLRQ7ZDQG7ZLPDJLQJDW7 %DVHGRQVLJQDOLQWHQVLW\GLIIHUHQFHV 2%ODPLQDWLRQSDWWHUQVZHUHDVVHVVHGE\WZRREVHUYHUVLQFRQVHQVXV5HVXOWV ZHUHFRPSDUHGXVLQJ:LOFR[RQWHVW6LJQDOLQWHQVLW\SURÀOHVZHUHFRPSDUHGWR UHIHUHQFHKLVWRORJLFDOVHFWLRQVDQGLPDJLQJUHVXOWVXVLQJ705PLFURVFRS\27 ODPLQDWLRQSDWWHUQVZHUHDVVHVVHGDQGGLIIHUHQWFRQÀJXUDWLRQVRIFURVVVHFWLRQDO DUHDVZHUHFRPSDUHGWRPDFURVFRSLFUHVXOWVDQG2%ODPLQDWLRQSDWWHUQV 5HVXOWV6WDQGDUGUHVROXWLRQLGHQWLÀHGWKUHHWZRDQGRQHOD\HU LQ +LJKUHVROXWLRQ 05, OD\HUV LQ OD\HUV LQ VLJQLÀFDQWO\ SHUIRUPHG EHWWHU 3 6LJQDO LQWHQVLW\ SURÀOH DQDO\VLVD W 7 D Q G 7 \LHOGLQJXSWRGLIIHUHQWVLJQDOLQWHQVLWLHVFRUUHODWHGZLWKKLVWRORJLFDOVHFWLRQV 705,RIWKH27UHYHDOHGWZRVHSDUDWHVLJQDOLQWHQVLWLHVLQ7ZLQDK\ SHULQWHQVH FRUH DQG D K\SRLQWHQVH VKHDWK &URVVVHFWLRQDO DUHDFRQÀJXUDWLRQV FRUUHODWHGZLWKPDFURVFRSLFUHVXOWVѩ 3 DQG2%ODPLQDWLRQSDW WHUQVѩ 3 &RQFOXVLRQ6LJQDOLQWHQVLW\SURÀOHDQDO\VLVDW7LQGLFDWHVWKHSRVVLELOLW\WRGLI IHUHQWLDWH2%OD\HUV7KHUHIRUHVLJQDOLQWHQVLW\SURÀOHDQDO\VLVFRXOGEHXVHGDVD IXWXUHWRROWRDVVHVV2%UHFRYHU\SURFHVVHVLQQHXURGHJHQHUDWLYHQHXURSV\FKLDWULF DQGVPHOOLQJGLVRUGHUV % $JHDQGJHQGHUDOWHUDWLRQVLQVLJQDOLQWHQVLWLHVRISRVWHULRUSLWXLWDU\ JODQGRQGLPHQVLRQDO7ZHLJKWHGPDJQHWLFUHVRQDQFHLPDJLQJ $<DPDPRWR+2ED-.RWRNX6)XUXL7 RN\R-3 DVDNRQHPXULQRPRUL#\DKRRFRMS 3XUSRVH 7KH SRVWHULRU SLWXLWDU\ JODQG XVXDOO\ VKRZV K\SHU VLJQDO LQWHQVLW\ RQ 7ZHLJKWHG05LPDJHVLQKHDOWK\SHUVRQVEXWFKDQJHVLQWKHYDOXHVFDXVHGE\ DJHLQJRUJHQGHUGLIIHUHQFHDUHQRWZHOOUHFRJQLVHG7KLVVWXG\DLPHGWRFODULI\ WKHGLIIHUHQFHVLQWKHVLJQDOVRIWKHSRVWHULRUSLWXLWDU\JODQGDFFRUGLQJWRJHQGHU DQGDJH 0HWKRGVDQG0DWHULDOV:HUHWURVSHFWLYHO\UHYLHZHGFRQVHFXWLYHSDWLHQWV ZKRXQGHUZHQWFHUHEUDOVDJLWWDOGLPHQVLRQDO7ZHLJKWHGLPDJLQJRQD705, XQLWEHWZHHQ-XO\DQG0D\:HH[FOXGHGSDWLHQWVZLWKDQ\HQGRFULQH ÁXLGEDODQFHDEQRUPDOLW\RUF\VWVWXPRXUVKDHPRUUKDJHVDQGDWURSK\RISLWXLWDU\ JODQG:HLGHQWLÀHGWKHSRVWHULRUSLWXLWDU\JODQGEHWZHHQWKHSDUVLQWHUPHGLDRISL WXLWDU\JODQGDQGGRUVXPVHOODHDQGUHJLRQVRILQWHUHVWZHUHGUDZQRQWKHSRVWHULRU SLWXLWDU\JODQGDQGWKHSRQV7KHPD[LPXPVLJQDOLQWHQVLW\RIWKHSRVWHULRUSLWXLWDU\ JODQGDQGDYHUDJHVLJQDOLQWHQVLW\RIWKHSRQVZHUHGHWHUPLQHG:HFDOFXODWHGWKH VLJQDOUDWLRSRVWHULRUSLWXLWDU\JODQGSRQVDQGDQDO\VHGWKHFKDQJHVLQWKHVLJQDO UDWLREHWZHHQWKHJHQGHUVDQGDJHV 5HVXOWV)HPDOHJURXSVKRZHGVLJQLÀFDQWO\KLJKHUVLJQDOUDWLRWKDQPDOHJURXS IURPUGWRWKGHFDGHVU!S'LVDSSHDUDQFHRIWKHKLJKVLJQDORI WKHSRVWHULRUSLWXLWDU\JODQGZDVREVHUYHGLQSDWLHQWVPDOHVIHPDOHV \HDUV 6FLHQWLILF6HVVLRQ 6 &$' ( ) *+% (XURSHDQ&RQJUHVVRI 5DGLRORJ\ % $QJLRJUDSKLFDQGSDWKRORJLFDOFRPSDULVRQRIK\GURJHOFRDWHGFRLOV DQGÀEHUHGFRLOVLQDVKHHSPRGHO $)RKOHQ -1DPXU0:DVVHI+*KHJHGLEDQ$/DXUHQW-3 3HODJH &DHQ)53DULV)5SHODJHMS#FKXFDHQIU 3XUSRVH7 RFRPSDUHWKHDQJLRJUDSKLFDQGSDWKRORJLFDOIHDWXUHVZLWKK\GURFRLOV DQGÀEHUHGFRLOVDWKRXUVDQGGD\VLQWHUPVRIPHFKDQLVPRIRFFOXVLRQDQG LQÁDPPDWRU\UHVSRQVH 0HWKRGVDQG0DWHULDOV6L[VKHHSKDGERWKLQWHUQDOLOLDFDQGUHQDODUWHULHVUDQ GRPO\HPEROLVHGXVLQJÀEHUHGFRLOVRUK\GURFRLOV5HQDODUWHULHVZHUHHPEROLVHG XVLQJFRLOVDQGLQWHUQDOLOLDFVXVLQJFRLOV7KHQXPEHURIFRLOVDQG WLPHWRFRPSOHWHRFFOXVLRQZDVUHFRUGHG7KUHHDQLPDOVZHUHVDFULÀFHGDIWHU KRXUVDQGDIWHUGD\V3DWKRORJLFDOHYDOXDWLRQFRQVLVWHGLQFKDUDFWHULVLQJWKH PHFKDQLVPRIRFFOXVLRQSHUFHQWDJHRIWKHOXPHQRFFOXGHGE\WKHHPEROLFSODWL QXPGDFURQÀEUHVYVK\GURJHODQGWKURPEXVSUHVHQFHRILQÁDPPDWRU\FHOOV 5HVXOWV 1R GLIIHUHQFH ZDV IRXQG EHWZHHQ K\GURFRLOV DQG ÀEHUHG FRLOV IRU WKH QXPEHURIFRLOVDQGWLPHWRDFKLHYHYDVFXODURFFOXVLRQ $WDQJLRJUDSK\RILOLDF DUWHULHVHPEROLVHGZLWKK\GURFRLOVZHUHRFFOXGHGYVRIWKRVHHPEROLVHGZLWK ÀEHUHGFRLOV165HFDQDOLVDWLRQRIWKHUHQDODUWHU\ZDVREVHUYHGLQERWKJURXSV 7KHSHUFHQWDJHRIWKURPEXVZDVVLJQLÀFDQWO\ORZHUIRUK\GURFRLOVWKDQIRUÀEHUHG FRLOVDWWKHWLPHSRLQWV)RUÀEHUHGFRLOVDWSDWKRORJ\WKURPEXVDFFRXQWHGIRU RIWKHRFFOXVLRQYVIRUK\GURFRLOV7KHSUHVHQFHRILQÁDPPDWRU\FHOOV ZDVPRUHIUHTXHQWZLWKÀEHUHGFRLOVWKDQZLWKK\GURFRLOVYV &RQFOXVLRQ7KHSHUFHQWDJHRIWKURPEXVZDVVLJQLÀFDQWO\OHVVZLWKK\GURFRLOVDV FRPSDUHGWRÀEHUHGFRLOV0DUNHGO\ORZHULQÁDPPDWRU\FHOOUHVSRQVHZDVVHHQ ZLWKK\GURFRLOV%RWKGLIIHUHQFHVPD\WUDQVODWHLQWROHVVORQJWHUPUHFDQDOLVDWLRQ )XUWKHULQYHVWLJDWLRQLVQHHGHG % 0XOWLSRODUKHSDWLF5)$LQÁXHQFHRIHOHFWURGHFRQÀJXUDWLRQRQ FRDJXODWLRQYROXPH 3 %UXQHUV7 3HQ]NRIHU3 ,VIRUW$+RIPDQQ7 6FKPLW]5RGH&..XKO $+0DKQNHQ$DFKHQ'(SEUXQHUV#XNDDFKHQGH 3XUSRVH)RUPXOWLSRODUKHSDWLFUDGLRIUHTXHQF\5)DEODWLRQLWLVNQRZQWKDWWKH DPRXQWRIHQHUJ\DSSOLHGFRUUHODWHVZLWKWKHJHQHUDWHGFRDJXODWLRQYROXPH2XU JRDO ZDV WR DQDO\VH ZKHWKHU WKH FRPELQDWLRQ RI HOHFWURGHV DOVRLQÁXHQFHV WKH DEODWLRQYROXPHLIWKHDPRXQWRIDSSOLHGHQHUJ\LVNHSWFRQVWDQW 0HWKRGV DQG 0DWHULDOV ,Q WRWDO 5)DEODWLRQV ZHUH SHUIRUPHG LQ IUHVKO\ H[FLVHG ERYLQH OLYHU XVLQJ D PXOWLSRODU 5)V\VWHP &HORQ/DE3RZHU &HORQ$* 0HGLFDO,QVWUXPHQWV7 HOWRZ*HUPDQ\7 HQDEODWLRQVZHUHSHUIRUPHGZLWKHDFK RIWKHIROORZLQJ5)DSSOLFDWRUFRPELQDWLRQV[ FP[FP[FP[FP [FP[FP5)DEODWLRQVZHUHLQWHUUXSWHGDIWHUDSSOLFDWLRQRIN-'XULQJ WKHH[SHULPHQWVWLPHWLVVXHLPSHGDQFHDQGJHQHUDWRURXWSXWZHUHPRQLWRUHGXV LQJDGHGLFDWHGVRIWZDUHWRRO*HQHUDWHGFRDJXODWLRQ]RQHVZHUHGLVVHFWHGDQG PDFURVFRSLFDOO\PHDVXUHGDORQJ[\DQG]D[LVIROORZHGE\FDOFXODWLRQRIWKH DSSUR[LPDWH FRDJXODWLRQ YROXPH$Q$129$ ZDV DSSOLHG IROORZHG E\ 6WXGHQW 1HZPDQ.HXOVWHVWVWRDQDO\VHIRUVLJQLÀFDQWGLIIHUHQFHV 5HVXOWV7KHFRPELQDWLRQRI[FPUHVXOWHGLQWKHODUJHVWPHDQFRDJXODWLRQYRO XPHFPó $OORWKHUHOHFWURGHFRPELQDWLRQVOHGWRVLJQLÀFDQWVPDOOHUFRDJXODWLRQ YROXPHVUDQJLQJIURPFPó[FPWRFPó[FP([FHSWIRUWKH[FP FRPELQDWLRQPLQWKHUHZHUHQRVLJQLÀFDQWGLIIHUHQFHVZLWKUHJDUGWRWKH DSSOLFDWLRQWLPHPLQ &RQFOXVLRQ %HVLGHV WKH DPRXQW RI DSSOLHG HQHUJ\ WKH FRPELQDWLRQ RI 5) DSSOLFDWRUVVKRZVDQLQÁXHQFHRQWKHJHQHUDWHGFRDJXODWLRQYROXPHLQH[YLYR OLYHUH[SHULPHQWV % 0LGWHUPUHFDQDOLVDWLRQDIWHUHPEROLVDWLRQXVLQJK\GURFRLOVYV ÀEHUHGFRLOVLQDQDQLPDOPRGHO -3 3HODJH $)RKOHQ+*KHJHGLEDQ-1DPXU$/DXUHQW0:DVVHI &DHQ)53DULV)5SHODJHMS#FKXFDHQIU 3XUSRVH 7 R FRPSDUH WKH DQJLRJUDSKLF DQG SDWKRORJLFDO HIIHFWV FRPSOHWHR F FOXVLRQRUUHFDQDOLVDWLRQRIK\GURJHOFRDWHGFRLOVDQGÀEHUHGFRLOVLQDUWHULDO WHUULWRULHVDIWHUGD\VPRQWKDQGPRQWKV 0HWKRGV DQG 0DWHULDOV VKHHS KDG RQH LQWHUQDO LOLDF DQG RQH UHQDO DUWHU\ UDQGRPO\HPEROLVHGXVLQJÀEHUHGFRLOVRUK\GURFRLOV5HQDODUWHULHVZHUHHPERO LVHGXVLQJFRLOVDQGLQWHUQDOLOLDFVXVLQJFRLOV$OODQLPDOVKDGFRQWURO DQJLRJUDSK\SHUIRUPHGDWGD\VPRQWKDQGPRQWKVWRDVVHVVUHFDQDOLVD WLRQ$OODQLPDOVZHUHVDFULÀFHGDIWHUPRQWKV7LVVXHVDPSOHVZHUHHPEHGGHG 5RRP' ,QWHUYHQWLRQDO5DGLRORJ\ 66 ([SHULPHQWDO 0RGHUDWRUV -+3HUHJULQ3UDJXH&= 0$$-YDQGHQ%RVFK8WUHFKW1/ % ([SHULPHQWDOIHDVLELOLW\VWXG\RQUHDOWLPHXOWUDVRXQGHODVWRJUDSK\ RIKHSDWLFWKHUPDOOHVLRQVÀUVWUHVXOWV 3 :LJJHUPDQQ(0-XQJ&6WURV]F]\QVNL 5HJHQVEXUJ'(SKLOLSSZLJJHUPDQQ#JRRJOHPDLOFRP 3XUSRVH 7 R HYDOXDWH WKH UHOLDELOLW\ RI HODVWRJUDSK\ D QHZ XOWUDVRQRJUDSKLF PHWKRGIRUGHOLQHDWLQJWKHUPDOOHVLRQERXQGDULHVLQSRUFLQHOLYHUWLVVXHE\FRP SDULQJOHVLRQGLPHQVLRQVGHWHUPLQHGE\UHDOWLPHHODVWRJUDSK\ZLWKWKHÀQGLQJV DWJURVVSDWKRORJ\ 0HWKRGVDQG0DWHULDOV $WRWDORIWKHUPDOOHVLRQVZLWKGLDPHWHUVUDQJLQJIURP WRPPZHUHFUHDWHGXVLQJUDGLRIUHTXHQF\DEODWLRQ5)$7KHQHZ/2*,4( HODVWRJUDSK\LPDJLQJWHFKQRORJ\*(+HDOWKFDUH:DXZDWRVD:,ZDVXVHGZLWKD 0+]KLJKIUHTXHQF\OLQHDUWUDQVGXFHU/HVLRQVZHUHH[DPLQHGXVLQJ%PRGH DQGUHDOWLPHHODVWRJUDSK\57(/HVLRQGHWHFWLRQGHOLQHDWLRQDQGVL]HZHUHDVVHG XVLQJ%PRGHDQG57(LPPHGLDWHO\DIWHUHDFKWKHUPDODEODWLRQ0HDVXUHPHQWV RIWKHVHFWLRQVUHSUHVHQWLQJWKHVDPHLPDJHSODQHXVHGIRUHODVWRJUDSK\ZHUH WDNHQDWSDWKRORJLFH[DPLQDWLRQDQGFRPSDUHGZLWKWKHPHDVXUHPHQWVREWDLQHG IURPWKHHODVWRJUDPV 5HVXOWV,QRXUVDPSOHDVWDWLVWLFDOO\VLJQLÀFDQWFRUUHODWLRQLQYLWUREHWZHHQ57( DQG SDWKRORJLFDO PHDVXUHPHQWV ZLWK UHVSHFW WR WKH OHVLRQVҋ SULQFLSDO D[LV DQG DUHDUò ORQJD[LVUò VKRUWD[LVDQGUò DUHD2YHUDOO HODVWRJUDSK\VOLJKWO\XQGHUHVWLPDWHGWKHOHVLRQVL]HDVMXGJHGE\WKHGLJLWDOLVHG SDWKRORJLFLPDJHV &RQFOXVLRQ7KHVHUHVXOWVVXSSRUWWKDW57(RXWSHUIRUPVFRQYHQWLRQDO%PRGHXO WUDVRXQGDQGFRXOGSRWHQWLDOO\EHXVHGIRUURXWLQHDVVHVVPHQWRIWKHUPDOWKHUDSLHV % 5DGLRHPEROLVDWLRQZLWK<JODVVPLFURVSKHUHVGRZHUHDOO\QHHG 63(&7&7WRLGHQWLI\H[WUDKHSDWLFVKXQWV" 7 &/DXHQVWHLQ-7KH\VRKQ-6FKODDN-(UWOH60XHOOHU$%RFNLVFK 0)RUVWLQJ(VVHQ'(WKRPDVODXHQVWHLQ#XQLGXHGH 3XUSRVH5DGLRHPEROLVDWLRQ5(XVLQJWKHEHWDHPLWWHU\WWULXP<LVDQ HPHUJLQJWKHUDS\RSWLRQIRUXQUHVHFWDEOHOLYHUPDOLJQDQFLHV $FRPSOLFDWLRQRI5( PD\UHSUHVHQWWKHQRQWDUJHWHPEROLVDWLRQRIH[WUDKHSDWLFWLVVXHSDUWLFXODUO\WKH*, WUDFW:HDLPHGWRDVVHVVZKHWKHUH[WUDKHSDWLFVKXQWVFDQEHUHOLDEO\GLDJQRVHG EDVHGRQKHSDWLFGLJLWDOVXEWUDFWLRQDQJLRJUDSK\'6$RULIVXEVHTXHQW63(&7 &7GDWDSURYLGHDGGLWLRQDOLQIRUPDWLRQ 0HWKRGV DQG 0DWHULDOV SDWLHQWV ZLWK KHSDWRFHOOXODU FDUFLQRPD Q KHSDWLF PHWDVWDVHV Q RU FKRODQJLRFHOOXODU FDUFLQRPD Q ZHUH VWXGLHG 'XULQJKHSDWLFGLJLWDOVXEWUDFWLRQDQJLRJUDSK\DUWHULHVUHSUHVHQWLQJVKXQWVWR H[WUDKHSDWLFWLVVXHZHUHFRLOHPEROLVHGULJKWJDVWULFDUWHU\Q IDOFLIRUPDUWHU\ Q EUDQFKHV WR GXRGHQXPSDQFUHDV Q 6XEVHTXHQWO\ 7 HFKQHFWLXP PODEHOHGPDFURDJJUHJDWHGDOEXPLQP7 F0$$ZDVLQMHFWHGDQGSDWLHQWV XQGHUZHQW D 63(&7&7 63(&7&7 GDWD ZHUH XVHG WR LGHQWLI\ DQ\ DGGLWLRQDO VKXQWWRH[WUDKHSDWLFWLVVXH 5HVXOWVSDWLHQWVH[KLELWHGDQXQH[SHFWHGLQFUHDVHG0$$XSWDNH LQH[WUDKHSDWLFWLVVXHVPDOOERZHOQ DEGRPLQDOZDOOQ VWRPDFKQ 7KHVH SDWLHQWVXQGHUZHQWUHSHDWHG'6$DQGFRUUHVSRQGLQJDUWHULHVFRXOGEHLGHQWLÀHG DQGFRLOHPEROLVHGLQSDWLHQWV &RQFOXVLRQ 0RVW H[WUDKHSDWLF VKXQWV FDQ EH LGHQWLÀHG RQ '6$ SULRU WR < WKHUDS\ +RZHYHU 63(&7&7 GDWD KHOS WR LGHQWLI\ DGGLWLRQDO VKXQWV WKDW ZHUH LQLWLDOO\QRWVHHQRQ'6$ 6FLHQWLILF6HVVLRQ $ 6&'()*+%(XURSHDQ&RQJUHVVRI 5DGLRORJ\ 0RQGD\ % $QH[SHULPHQWDOVWXG\RQPXOWLPRGDOYLVLELOLW\DQJLRJUDSK\&7DQG 05,RIHPEROLVDWLRQSDUWLFOHVSHUIRUPHGLQSRUFLQHNLGQH\V &06RPPHU 86WDPSÁ1%HOOHPDQQ0+RO]VFKXK1.RUWHV $.XHOOHU-%OXHPPHO%$5DGHOHII+8.DXF]RU+HLGHOEHUJ'( 6DQ$QWRQLR7;86FPVRPPHU#JP[FRP 3XUSRVH7 RDQDO\VHPXOWLPRGDOYLVLELOLW\RIHPEROLVDWLRQSDUWLFOHVRQDQJLRJUDSK\ &7DQG05,LQSRUFLQHNLGQH\V 0HWKRGV DQG 0DWHULDOV$V DQ HYROXWLRQ RI WKH FXUUHQW DYDLODEOH HPEROLVDWLRQ SDUWLFOHV(PER]HQH0LFURVSKHUHV&HOR1RYD%LR6FLHQFHV86$WKRVHSDUWLFOHV ZHUHPRGLÀHGWKDWDGGLWLRQDOHPEHGGLQJRIGHQVH;UD\PDWHULDOVVKRXOGUHVXOW LQJRRGYLVLELOLW\RQDQJLRJUDSK\DQG&7DVZHOODVDGGLWLRQDOHPEHGGLQJRIPDJ QHWLFVXEVWDQFHVVKRXOGUHVXOWLQJRRGYLVLELOLW\RQ05,7KUHHGLIIHUHQWSURWRW\SHV ,QWHQVLW\$%DQG&DVZHOODVFXUUHQWDYDLODEOH(PER]HQ0LFURVSKHUHVZLWK VL]HVRIPDQGPZHUHWHVWHG:LWKRXWXVLQJDQ\FRQWUDVWPDWH ULDOUHQDODUWHULHVRIIRXUSLJVZHUHFDWKHWHULVHGDQGHDFKNLGQH\ZDVHPEROLVHG ZLWKRQHPLOOLOLWHURIRQHW\SHRISDUWLFOH6XEMHFWLYHDQGREMHFWLYHSDUWLFOHYLVLELOLW\ ZDVHYDOXDWHGRQDQJLRJUDSK\&7DQG05, 5HVXOWV2QDQJLRJUDSK\LQWHQVLW\ $%DQG&RIPSDUWLFOHVDVZHOODVLQ WHQVLW\%RIPSDUWLFOHVZHUHGHÀQLWHO\YLVLEOH&XUUHQWDYDLODEOH(PER]HQ 0LFURVSKHUHVJLYHQDVFRQWUROJURXSZHUHGHÀQLWHO\QRWYLVLEOH2Q&7DQG05,7 DQG7LQWHQVLW\ $%DQG&RIPSDUWLFOHVDVZHOODVPSDUWLFOHV ZHUHGHÀQLWHO\YLVLEOH2Q&7 VLJQDOWRQRLVHUDWLRIRULQWHQVLW\$%DQG&LQFUHDVHG VLJQLÀFDQWO\HJLQWHQVLW\ $PSDUWLFOHV32Q05, 7DQG7VLJQDOWRQRLVHUDWLRIRULQWHQVLW\$%DQG&GHFUHDVHGVLJQLÀFDQWO\ HJLQWHQVLW\%PSDUWLFOHV73 &RQFOXVLRQ0RGLÀFDWLRQRIWKHFXUUHQWDYDLODEOH(PER]HQH0LFURVSKHUHVZDV VXFFHVVIXOZLWKPXOWLPRGDOYLVLELOLW\RQDQJLRJUDSK\&7DQG05, % $EODWLRQWKHUDS\RIKHSDWLFPDOLJQDQF\DFRPSDUDWLYHVWXG\ EHWZHHQUDGLRIUHTXHQF\DQGPLFURZDYHDEODWLRQWHFKQLTXHV 7 -9RJO$'DUYLVKL3 )DUVKLG$$]L]L%%D]UDIVKDQ1111DJXLE 1(1RXU(OGLQ6=DQJRV-7URMDQ)UDQNIXUW'(WYRJO#HPXQLIUDQNIXUWGH 3XUSRVH 7 R FRPSDUH WKH HIIHFWV DQG RXWFRPH RI UDGLRIUHTXHQF\ 5)$ DQG PLFURZDYH 0:$ DEODWLRQ WKHUDS\ LQ WKH WUHDWPHQW RI SULPDU\ DQG VHFRQGDU\ OLYHUPDOLJQDQF\ 0HWKRGVDQG0DWHULDOV,QWKLVSURVSHFWLYHVWXG\DSSURYHGE\WKHLQVWLWXWLRQDO UHYLHZERDUGSDWLHQWVZLWKOHVLRQVZHUHWUHDWHGZLWK5)$DQG0:$,QWKH 5)$JURXSSDWLHQWVSDWLHQWVVXIIHUHGIURP+&&OHVLRQVDQGSDWLHQWV IURPOLYHUPHWDVWDVHVOHVLRQV,QWKH0:$JURXSSDWLHQWVOHVLRQV +&&DQGOLYHUPHWDVWDVHVZHUHGRFXPHQWHG5HVSRQVHFULWHULDUHFXUUHQFH UDWH55DQGVXUYLYDOLQGLFHVZHUHDVVHVVHGDIWHUERWKSURFHGXUHV 5HVXOWV,QJURXS+&&OHVLRQVVKRZHGFRPSOHWHUHVSRQVH OHVLRQVKDGUHVLGXDOWXPRXUV,QJURXS+&&OHVLRQVVKRZHG FRPSOHWHUHVSRQVHOHVLRQVKDGUHVLGXDOWXPRXUV/LYHUPHWDVWDVHV VKRZHG FRPSOHWH UHVSRQVH ZLWK QR UHVLGXDO OHVLRQV DIWHU ERWK SURFHGXUHV$OO +&& OHVLRQV FP VKRZHG FRPSOHWH UHVSRQVH ZLWK QR UHVLGXDO OHVLRQV LQ ERWKJURXSV7KHUHZDVQRVLJQLÀFDQWGLIIHUHQFHLQUDWHVRIUHVLGXDO+&&OHVLRQV !FPEHWZHHQERWKJURXSV3 /RJUDQNWHVW7LPHWRSURJUHVVLRQ773 LQDOOSDWLHQWVWUHDWHGZLWK5)$FRPSDUHGZLWK0:$ZDVYHUVXVPRQWKV DQG55DWPRQWKVZHUHYHUVXV UHVSHFWLYHO\3 &RQFOXVLRQ +&& OHVLRQV WUHDWHG ZLWK 5)$ DQG 0:$ KDG VWDWLVWLFDOO\ VLPLODU FRPSOHWHUHVSRQVHUDWHVRIUHVLGXDOWXPRXUVUHFXUUHQFHUDWHDQGVXUYLYDOLQGLFHV $OOOLYHUPHWDVWDVHVDQGDOO+&&OHVLRQVFPKDGFRPSOHWHUHVSRQVHZLWKQR UHVLGXDOWXPRXUVLQERWKJURXSV % 0LFURZDYHDEODWLRQFRPSDUHGZLWKUDGLRIUHTXHQF\DEODWLRQIRU EUHDVWWLVVXHLQDQH[YLYRERYLQHXGGHUPRGHO 3 ,VIRUW 7 7 DQDND7 3HQ]NRIHU3 %UXQHUV7 %UDXQVFKZHLJ ..LFKLNDZD7 6FKPLW]5RGH&..XKO$+0DKQNHQ$DFKHQ'( 1DUD-3LVIRUW#XNDDFKHQGH 3XUSRVH7 RFRPSDUHWKHHIIHFWLYHQHVVRIPLFURZDYH0:DEODWLRQZLWKUDGLRI UHTXHQF\5)DEODWLRQIRUWUHDWLQJEUHDVWWLVVXHLQH[YLYRERYLQHXGGHUWLVVXH 0HWKRGVDQG0DWHULDOV0:DEODWLRQVZHUHSHUIRUPHGDWSRZHURXWSXWVRI: :DQG:XVLQJD0+]IUHTXHQF\JHQHUDWRUDQGDFPDFWLYHWLSDQWHQ QD5)DEODWLRQVZHUHSHUIRUPHGZLWKDELSRODU5)V\VWHPZLWKDQGFPDFWLYH WLSHOHFWURGHV7LVVXHWHPSHUDWXUHVZHUHFRQWLQXRXVO\PRQLWRUHGGXULQJDEODWLRQ LQUHVLQVHFWLRQHGDQGVWDLQHGZLWKPHWK\OHQHDQGWROXLGLQHEOXH5HFDQDOLVDWLRQ DQGLQÁDPPDWLRQZHUHHYDOXDWHGDWSDWKRORJ\ 5HVXOWV$IWHUGD\VQRGLIIHUHQFHLQWHUPVRIUHFDQDOLVDWLRQZDVIRXQGEHWZHHQ ERWKSURGXFWV $WRQHPRQWKRIWKHDUWHULHVHPEROLVHGZLWKK\GURFRLOVZHUH RFFOXGHGYVRIWKRVHHPEROLVHGZLWKÀEHUHGFRLOVS $WPRQWKV RIWKHDUWHULHVHPEROLVHGZLWKK\GURFRLOVZHUHRFFOXGHGYVRIWKRVHHPEROLVHG ZLWKÀEHUHGFRLOVS $WRWDORIRIUHQDODUWHULHVHPEROLVHGZLWKK\GURFRLOV ZHUHRFFOXGHGYVRIWKRVHHPEROLVHGZLWKÀEHUHGFRLOV &RQFOXVLRQ $IWHUPRQWKVRIWKHDUWHULHVHPEROLVHGZLWKÀEHUHGFRLOVZHUH UHFDQDOLVHGYVRIWKRVHHPEROLVHGZLWKK\GURFRLOV,WPD\EHK\SRWKHVLVHGWKDW WKHGLIIHUHQFHLVH[SODLQHGE\WKHPHFKDQLVPRILQLWLDORFFOXVLRQPRUHWKURPEXV ZLWKÀEHUHGFRLOV % 3RUWDOYHLQOLJDWLRQDORQHFRPSDUHGZLWKSRUWDOYHLQDQGKHSDWLF DUWHU\OLJDWLRQLQDURGHQWPRGHO *-HRQ %/HH6&KXQJ-<RRQ-.LP-/HH6HRQJQDP.5 6HRXO.5%XVDQ.5 3XUSRVH2XUVWXG\FRPSDUHGWKHYROXPHFKDQJHDQGUHJHQHUDWLYHFDSDFLW\RI SRUWDO YHLQ OLJDWLRQ HPEROLVDWLRQ 39/ DQG KHWHURFKURQRXV 39/ ZLWK KHSDWLF DUWHU\OLJDWLRQ+$/LQDURGHQWPRGHO 0HWKRGVDQG0DWHULDOV$QLPDOVZHUHVHSDUDWHGLQWRWKUHHJURXSV)RUJURXS ,OLJDWLRQRIWKHOHIWODWHUDODQGPHGLDQSRUWDOYHLQEUDQFKHVZDVSHUIRUPHG)RU JURXS,,OLJDWLRQRIWKHSRUWDOYHLQZDVFRPSOHWHGIROORZHGE\OLJDWLRQRIWKHVDPH EUDQFKHVRIWKHKHSDWLFDUWHU\DIWHUK)RUJURXS,,,FRQWUROJURXSDODSDURWRP\ ZLWKRXWOLJDWLRQVKDPRSHUDWLRQZDVSHUIRUPHG$WOHDVWUDWVIURPHDFKJURXS ZHUHVDFULÀFHGDWDQGGDIWHUVXUJHU\/LYHUYROXPHFKDQJHZDVPHDVXUHG DQGDOLYHUIXQFWLRQWHVWSHUIRUPHG8VLQJH[FLVHGUDWOLYHUVZHSHUIRUPHGLPPX QRKLVWRFKHPLFDODQDO\VHVRIFNLWDQG0,%+LVWRORJLFIHDWXUHVZHUHDQDO\VHG 5HVXOWV7KHYROXPHRIWKHQRQOLJDWHGOREHLQFUHDVHGPRVWLQJURXS,,LQLWLDOO\EXW WKHUHZDVQRVLJQLÀFDQWGLIIHUHQFHDWGD\VDQG0HDQ$67DQGWRWDOELOLUXELQ OHYHOVZHUHVLJQLÀFDQWO\KLJKHULQJURXS,,DQGDOEXPLQOHYHOVZHUHKLJKLQJURXS, &NLWSRVLWLYHFHOOVZHUHPRUHSUHVHQWHGRQGD\VDQGLQJURXSLYHUVXVJURXS ,,ZKLFKZDVVWDWLVWLFDOO\VLJQLÀFDQW0,%VWDLQHGFHOOVZHUHPRUHQXPHURXVLQ JURXSLRQGD\VDQG1HFURWLFFKDQJHVLQWKHOLJDWHGOREHVZHUHVKRZQLQ ODUJHQXPEHURIJURXS,, &RQFOXVLRQ39/DORQHLVVDIHDQGHIIHFWLYHIRUFRPSHQVDWRU\OLYHUUHJHQHUDWLRQ 3HUIRUPLQJERWK39DQG+$OLJDWLRQGRHVQRWUHVXOWLQDGGLWLRQDOEHQHÀW % 0LFURZDYHDEODWLRQRIWKHNLGQH\HYDOXDWLRQRIFRROHGDQWHJUDGH S\HORSHUIXVLRQIRUSURWHFWLRQRIWKHFROOHFWLQJV\VWHPLQDQLQYLYR SRUFLQHPRGHO 3 ,VIRUW 7 3HQ]NRIHU7 7 DQDND3 %UXQHUV7 6FKPLW]5RGH&..XKO $+0DKQNHQ$DFKHQ'(1DUD-3LVIRUW#XNDDFKHQGH 3XUSRVH7 RHYDOXDWHWKHHIIHFWRIDQWHJUDGHFRROHGS\HORSHUIXVLRQIRUWKHSURWHF WLRQRIWKHUHQDOFROOHFWLQJV\VWHPGXULQJPLFURZDYHDEODWLRQ 0HWKRGVDQG0DWHULDOV&7JXLGHGQHSKURVWRP\ZDVSHUIRUPHGLQRQHNLGQH\LQ HDFKRIIHPDOHKRXVHSLJVXVLQJD)SLJWDLOQHSKURVWRP\FDWKHWHU3\HORSHU IXVLRQZDVSHUIRUPHGXVLQJDFRROHGJOXFRVHVROXWLRQWKDWZDVLQIXVHGYLDWKH QHSKURVWRP\FDWKHWHUDWPOVHFGURSVVHF0HDQZKLOHPLFURZDYHDEODWLRQ ZDVSHUIRUPHGDWZDWWVIRUPLQXWHVLQWKHLUULJDWHGDQGWKHQRQLUULJDWHG NLGQH\VFUHDWLQJDFHQWUDODQGSHULSKHUDOOHVLRQ0D[LPXPDEODWLRQGLDPHWHUVZHUH PHDVXUHG DQG DEODWLRQ YROXPHV ZHUH FDOFXODWHG DIWHU VDFULÀFH RI WKH DQLPDOV 7KHDIIHFWLRQRIWKHUHQDOFROOHFWLQJV\VWHPZDVDVVHVVHGLQWKHVOLFHRIPD[LPDO WKHUPDOLQMXU\LQWHUYDOV 5HVXOWV 3HULSKHUDO OHVLRQ VL]HV LQ WKH LUULJDWHG QRQLUULJDWHG NLGQH\V ZHUH POPO&HQWUDOOHVLRQVL]HVLQWKHLUULJDWHGQRQLUULJDWHGNLG QH\VZHUHPOPO0D[LPXPWKHUPDOGDPDJHRIWKHFROOHFWLQJ V\VWHPLQSHULSKHUDOOHVLRQVLQLUULJDWHGQRQLUULJDWHGNLGQH\VZHUH 0D[LPXPWKHUPDOGDPDJHRIWKHFROOHFWLQJV\VWHPLQFHQWUDOOHVLRQVLQ LUULJDWHGQRQLUULJDWHGNLGQH\VZHUH1RVWDWLVWLFDOO\ VLJQLÀFDQWGLIIHUHQFHLQDEODWLRQYROXPHDQGDIIHFWLRQRIWKHFROOHFWLQJV\VWHPZDV REVHUYHGLQFHQWUDODQGSHULSKHUDOOHVLRQVZLWKRUZLWKRXWFRROHGS\HORSHUIXVLRQ &RQFOXVLRQ ,Q PLFURZDYH DEODWLRQ FRROHG DQWHJUDGH S\HORSHUIXVLRQ GRHV QRW SURWHFWWKHFROOHFWLQJV\VWHPIURPWKHUPDOGDPDJH7KHUHIRUHDEODWLRQRIFHQWUDO UHQDOVWUXFWXUHVGRHVQRWVHHPDGYLVDEOHXVLQJPLFURZDYHDEODWLRQ 6FLHQWLILF6HVVLRQ 6 &$' ( ) *+% (XURSHDQ&RQJUHVVRI 5DGLRORJ\ FLW\DQGDFFXUDF\RQ'LVRWURSLF9,%(ZHUHDQG7KHVHQVLWLYLW\ ZDVGLIIHUHQWEHWZHHQ'VWDQGDUGDQG'LVRWURSLF9,%(LQERWKUHDGHUV7KH DUHDVXQGHUWKH52&FXUYHVZHUHVWDWLVWLFDOO\GLIIHUHQW'VWDQGDUGYV'9,%( YVIRUUHDGHUYVIRUUHDGHU,QWHUREVHUYHUDJUHHPHQWZDV VXEVWDQWLDOѣ ZLWK'VWDQGDUGVHTXHQFHVѣ ZLWK'LVRWURSLF9,%( &RQFOXVLRQ7VKRXOGHU05DUWKURJUDSK\XVLQJD'LVRWURSLF9,%(KDVOHVV GLDJQRVWLFSHUIRUPDQFHIRU6/$3WHDUVFRPSDUHGZLWK'VWDQGDUG05VHTXHQFHV % 3UHRSHUDWLYHDVVHVVPHQWRIDQWHULRUVKRXOGHULQVWDELOLW\ FRPSDUDWLYHVWXG\RI05DUWKURJUDSK\DQG&7DUWKURJUDSK\ 6.KHGU-LGGDK6$ 3XUSRVH7 RFRPSDUHGLUHFW05DUWKURJUDSK\DQG&7DUWKURJUDSK\LQDVVHVVPHQW RIDQWHULRUVKRXOGHULQVWDELOLW\ 0HWKRGV DQG 0DWHULDOV FRQVHFXWLYH SDWLHQWV ZRPHQ DQG PHQ DJH UDQJH \HDUV ZKR XQGHUZHQW GLUHFW 05$ IROORZHG E\ &7$ ZLWKLQ KRXU EHIRUHDQWHULRUVKRXOGHULQVWDELOLW\UHSDLUZHUHSURVSHFWLYHO\LQFOXGHGLQWKLVVWXG\ 05$DQG&7$LPDJHVZHUHDQDO\VHGE\PXVFXORVNHOHWDOUDGLRORJLVWDQGFRPSDUHG ZLWKDUWKURVFRSLFUHVXOWV 5HVXOWV,QGHWHFWLRQRIJOHQRLGULPIUDFWXUHVHQVLWLYLW\DQGVSHFLÀFLW\ZHUH DQGIRU&7$DQGDQGIRU05$IRU+$*/OHVLRQVGLDJQRVLV VHQVLWLYLW\VSHFLÀFLW\ZHUHDQGIRU&7$DQGIRU05$,Q GHWHFWLRQRIJOHQRLGDUWLFXODUFDUWLODJHOHVLRQVHQVLWLYLW\DQGVSHFLÀFLW\ZHUH DQGIRU&7$DQGDQGIRU05$1RGLIIHUHQFHZDVREVHUYHG IRUGHWHFWLRQRIURWDWRUFXIIWHQGRQVWHDU &RQFOXVLRQ&7$ZDVVXSHULRUWR05$LQGHWHFWLRQJOHQRLGRVVHRXVOHVLRQVWKDW DUHNQRZQWREHGHFLVLRQDOHOHPHQWLQWKHVXUJLFDOVWUDWHJ\&7$DQG05$:(5( HTXLYDOHQWLQGHPRQVWUDWLQJODEUROLJDPHQWRXVDQGFDUWLODJHQRXVOHVLRQVDVVRFL DWHGZLWKDQWHULRUVKRXOGHULQVWDELOLW\&7$PD\EHFRQVLGHUHGPHWKRGRIFKRLFH LQSUHRSHUDWLYHHYDOXDWLRQRIDQWHULRUVKRXOGHULQVWDELOLW\ % &7DUWKURJUDSK\&7$RIWKHKLSDQGVKRXOGHURSWLPLVDWLRQRI WHFKQLTXHDQGRIUDGLDWLRQEXUGHQLQYLWURDQGLQFDGDYHUV /6FDUFLROOD &0DUpFKDO$7URPED0(O+DFKHPL7 7KLULRQ %%HRPRQWH=REHO3 6LPRQL5RPH,7/LHJH%(%HDXID\V%( 3XUSRVH7 RRSWLPLVHWKHDFTXLVLWLRQSDUDPHWHUVRI&7$RIWKHKLSDQGVKRXOGHU LQRUGHUWRPLQLPLVHWKHUDGLDWLRQEXUGHQ 0HWKRGVDQG0DWHULDOV&DUWLODJHGHIHFWVZHUHDUWLÀFLDOO\FUHDWHGRQDERYLQH IHPRUDOFRQG\OH7KHVSHFLPHQZDVVFDQQHGLQDEDWKRILRGLQDWHGFRQWUDVWPH GLXPPHJOXPLQLHVRGLXPLR[DJDOWHPJGOFKDQJLQJSDUDPHWHUVRQHDWDWLPH N9P$6.9YDOXHVVSDQQHGIURPWRN9DQGP$VIURPWR8VLQJ WKHVDPHSURFHGXUHPXOWLSOHDFTXLVLWLRQVZHUHFDUULHGRXWIRUWKHKLSVDQGWKH VKRXOGHUVRIIUHVKFDGDYHUV$IWHULPDJLQJFDGDYHUVZHUHIUR]HQDQGPXOWLSOH PPVOLFHVZHUHREWDLQHGLQWKHFRURQDODQGD[LDOSODQHVZLWKWKHEHQFKVDZ $QDWRPLFVSHFLPHQVZHUHFRPSDUHGWRPXOWLSODQDUUHFRQVWUXFWLRQPPVHFWLRQ &7$LPDJHV(DFKVHWRIYDOXHVZDVTXDOLWDWLYHO\VFRUHGE\WZRLQGHSHQGHQWUD GLRORJLVWVRQWKHEDVLVRIWKHYLVLELOLW\RIFDUWLODJHDVIROORZLQJSRRU GLDJQRVWLF TXDOLW\ YHU\JRRG 5HVXOWV&7$UHIRUPDWWHGLPDJHVRQD[LDOSODQHZHUHMXGJHGRIGLDJQRVWLFYDOXH HYHQZKHQN9DQGP$VZHUHGHFUHDVHGWRDWRWDOGRVHUHGXFWLRQRIIRUWKHKLS DQGRIIRUWKHVKRXOGHUFRPSDUHGWRWKHVWDQGDUGWHFKQLTXHV+RZHYHU035 FRURQDOLPDJHVREWDLQHGZLWKDUHGXFHGGRVHJDYHDSRRUGHSLFWLRQRIFDUWLODJH &RQFOXVLRQ$UHGXFWLRQRIWKHVWDQGDUGGRVHFXUUHQWO\XVHGWRSHUIRUP&7$GLG QRWLQÁXHQFHWKHTXDOLW\RIUHIRUPDWWHGD[LDO035EXWZDVLQHIIHFWLYHWRJHQHUDWH 035LPDJHVRIGLDJQRVWLFTXDOLW\LQRWKHUSODQHV % &DSVXODUOD[LW\RIWKHKLSÀQGLQJVDW05DUWKURJUDSK\ 20DJHUNXUWK -$-DFREVRQ< 0RUDJ(0&DRLOL')HVVHOO-6HNL\D %DVOH&+$QQ$UERU0,86 3XUSRVH7 RUHWURVSHFWLYHO\GHVFULEH05$ÀQGLQJVDVVRFLDWHGZLWKFDSVXODUOD[LW\ RIWKHKLSMRLQWIRXQGDWVXUJHU\ 0HWKRGV DQG 0DWHULDOV ,5% DSSURYDO ZDV REWDLQHG 3DWLHQWV ZLWK 05$ DQG VXUJLFDOO\DVVHVVHGSUHVHQFHRUDEVHQFHRIOD[LW\RIWKHKLSMRLQWZHUHLQFOXGHG $[LDO7Z,PDJHVZHUHUDQGRPLVHGDQGUHYLHZHGWZLFHE\LQGHSHQGHQWEOLQGHG UHDGHUV7KHZLGWKVRIWKHDQWHULRUMRLQWVSDFHODWHUDOWRWKH]RQDRUELFXODULVDQG RIWKHSRVWHULRUMRLQWVSDFHZHUHDVVHVVHG7KHDQJOHEHWZHHQIHPRUDOQHFNDQG LVFKLXPZDVPHDVXUHGWRDVVHVVKLSURWDWLRQ6WDWLVWLFDOGLIIHUHQFHVZHUHFDOFXODWHG 5HVXOWV7KHPHDQVKRUWD[LVGLDPHWHUVRIWKHFRDJXODWLRQ]RQHVZHUH DQGFPIRU0:DEODWLRQDW::DQG:)RU 5)DEODWLRQWKHFRUUHVSRQGLQJYDOXHVZHUHDQGFPZLWK HOHFWURGHV KDYLQJ DQG FP DFWLYH WLSV UHVSHFWLYHO\ 7KH PHDQ FRDJXODWLRQ YROXPHVZHUHDQGFPIRU0:DEODWLRQRI ::DQG:DQGDQGFPIRU5)DEODWLRQZLWK DQGFPHOHFWURGHVUHVSHFWLYHO\0:DEODWLRQVDW:DQG:DFKLHYHG VLJQLÀFDQWO\ORQJHUVKRUWD[LVGLDPHWHUVWKDQ5)DEODWLRQVS7KHKLJKHVW WLVVXHWHPSHUDWXUHZDVDFKLHYHGZLWK0:DEODWLRQDW:S2QKLVWR ORJLFDOH[DPLQDWLRQWKHDEODWLRQ]RQHLQ0:DEODWLRQVZDVOHVVDIIHFWHGE\WLVVXH KHWHURJHQHLW\WKDQLQ5)DEODWLRQV &RQFOXVLRQ0:DEODWLRQDSSHDUVWREHDGYDQWDJHRXVZLWKUHVSHFWWRWKHYROXPH RIDEODWLRQDQGWKHVKDSHRIWKHPDUJLQRIQHFURVLVFRPSDUHGZLWK5)DEODWLRQLQ DQH[YLYRERYLQHXGGHU 5RRP( 0XVFXORVNHOHWDO 66D $UWKURJUDSK\DQGDGYDQFHG05WHFKQRORJ\ 0RGHUDWRUV 6*'DYLHV/ODQWULVDQW8. 05XSUHKW0DULERU6, % 05DUWKURJUDSK\RIWKHVKRXOGHUSURVSHFWLYHWROHUDQFHHYDOXDWLRQ RIIRXUGLIIHUHQWLQMHFWLRQWHFKQLTXHV (3HUGLNDNLV$.DUDQWDQDV,UDNOLRQ*5SHUGLNDNLVBHY#\DKRRJU 3XUSRVH7 RSURVSHFWLYHO\HYDOXDWHSDWLHQWGLVFRPIRUWDQGWHFKQLFDOVXFFHVVRIIRXU GLIIHUHQWDUWKURJUDSKLFWHFKQLTXHVIRUSHUIRUPLQJ05DUWKURJUDSK\RIWKHVKRXOGHU 0HWKRGV DQG 0DWHULDOV FRQVHFXWLYH SDWLHQWV PDOHV DQG IHPDOHV DJHUDQJH\HDUVPHDQDJHZHUHUHIHUUHGIRU05DUWKURJUDSK\RIWKH VKRXOGHU7KHSDWLHQWVZHUHUDQGRPO\LQMHFWHGXQGHUÁXRURVFRSLFJXLGDQFHQ ZLWK&7JXLGDQFHXVLQJDQDQWHULRUQ RUDSRVWHULRUURXWHQ DQGZLWK XOWUDVRXQGJXLGDQFHQ )RUHDFKSDWLHQWDEVROXWHSHULSURFHGXUDOSDLQRQD QXPHULFDOUDWLQJSDLQVFDOH µQRSDLQµ µLQWROHUDEOHSDLQµWHFKQLFDOVXFFHVV RIWKHPHWKRGXVHGDQGUHDVRQIRU05DUWKURJUDSK\UHIHUUDOZHUHUHFRUGHG7KH XQSDLUHG6WXGHQWWWHVWZDVXVHGWRFRPSDUHWKHSDWLHQWҋVGLVFRPIRUWLQWKHIRXU DUWKURJUDSKLFWHFKQLTXHV 5HVXOWV7KHWHFKQLFDOVXFFHVVUDWHZDVIRUDOOPHWKRGVRILQMHFWLRQ 7KHUHVXOWVUHJDUGLQJWKHDEVROXWHSHULSURFHGXUDOSDLQZHUH DVIROORZLQJÁXRURVFRSLFJXLGDQFHVKRZHGDPHDQQXPHULFDOUDWLQJSDLQVFRUH RI&7JXLGDQFHXVLQJDQDQWHULRUDSSURDFKGHPRQVWUDWHGDPHDQSDLQ VFRUHRI&7JXLGDQFHXVLQJDSRVWHULRUURXWHRILQMHFWLRQVKRZHGDPHDQ SDLQVFRUHRIDQGXOWUDVRXQGJXLGLQJLQMHFWLRQVDPHDQQXPHULFDOUDWLQJ SDLQVFRUHRI$VLJQLÀFDQWGLIIHUHQFHLQDEVROXWH3SDLQZDVRE VHUYHGIRUWKHSRVWHULRUURXWHXQGHU&7JXLGDQFHFRPSDUHGZLWKWKHRWKHUPHWKRGV &RQFOXVLRQ1RGLIIHUHQFHVZHUHIRXQGIRUWKHWHFKQLFDOVXFFHVVUDWHRISHUIRUP LQJ05DUWKURJUDSK\XVLQJHLWKHURIWKHDIRUHPHQWLRQHGWHFKQLTXHV$&7JXLGHG SRVWHULRUDSSURDFKVHHPVWREHWKHPRVWFRPIRUWDEOHPHWKRGIRUWKHSDWLHQW % 6/$3WHDUVDW7VKRXOGHU05DUWKURJUDSK\GLDJQRVLVZLWKD' LVRWURSLF9,%(VHTXHQFHYHUVXV'VWDQGDUGVHTXHQFHV +6RQJ:+-HH-< -XQJ< 6.LP6HRXO.5K\XQ#JPDLOFRP 3XUSRVH7 RUHWURVSHFWLYHO\GHWHUPLQHWKHUHOLDELOLW\DQGDFFXUDF\RIVKRXOGHU05 DUWKURJUDSK\ ZLWK D ' LVRWURSLF 7ZHLJKWHG JUDGLHQWHFKR VHTXHQFH YROXPH LQWHUSRODWHGEUHDWKKROGH[DPLQDWLRQ9,%(IRUGLDJQRVLQJ6/$3WHDUVFRPSDUHG ZLWK'VWDQGDUGVHTXHQFHVDW7 0HWKRGV DQG 0DWHULDOV 6HYHQW\QLQH SDWLHQWV ZKR XQGHUZHQW VKRXOGHU 05 DUWKURJUDSK\XVLQJ7LPDJHUVDQGVXEVHTXHQWDUWKURVFRS\ZHUHLQFOXGHG,Q DGGLWLRQWR'VWDQGDUGVHTXHQFHV'9,%(ZDVREWDLQHGWRSURGXFHPXOWLSODQDU LPDJHV ZLWK D PP LVRWURSLF UHVROXWLRQ (DFK VHW RI 05 LPDJHV IURP HDFK PHWKRGZDVLQGHSHQGHQWO\VFRUHGIRUWKH6/$3WHDUDQGFDWHJRULVHG'LDJQRVWLF SHUIRUPDQFHVEHWZHHQ'VWDQGDUGDQG'LVRWURSLF9,%(ZHUHFRPSDUHGZLWK 52&FXUYHV,QWHUREVHUYHUDJUHHPHQWVZHUHDVVHVVHGZLWKNDSSDYDOXH 5HVXOWV$WDUWKURVFRS\WKHUHZHUH6/$3WHDUVW\SH,,Q W\SH,,,Q DQGW\SH,9Q 9Q 0HDQVHQVLWLYLW\VSHFLÀFLW\DQGDFFXUDF\RQ' VWDQGDUGVHTXHQFHVZHUHDQGZKHUHDVPHDQVHQVLWLYLW\VSHFLÀ 6FLHQWLILF6HVVLRQ $ 6&'()*+%(XURSHDQ&RQJUHVVRI 5DGLRORJ\ 0RQGD\ % 7KHDFFXUDF\RIG\QDPLFPDJQHWLFUHVRQDQFHLPDJLQJLQHYDOXDWLRQ RILQWHUQDOGHUDQJHPHQWRIWKHWHPSRURPDQGLEXODUMRLQWFRPSDULVRQ ZLWKDUWKURVFRSLFÀQGLQJV 0) $PLQ$0+DVVDQ.,%DUDNDW(OPLQ\D(* 0RKDPPHGBDPLQ #\DKRRFRP 3XUSRVH 7 R HYDOXDWH WKH FRUUHODWLRQ EHWZHHQ G\QDPLF 05, DQG DUWKURVFRSLF ÀQGLQJVLQLQWHUQDOGHUDQJHPHQWRIWKHWHPSRURPDQGLEXODUMRLQW 0HWKRGVDQG0DWHULDOV7KHFXUUHQWSURVSHFWLYHVWXG\ZDVFRQGXFWHGRQWZHQW\ ÀYHSDWLHQWVRI70-VHLJKWHHQIHPDOHVDQGVHYHQPDOHVWKHLUDJHUDQJLQJ IURPWR\HDUVPHDQ\HDUV$FRQWUROJURXSRIDGXOWYROXQWHHUV IHPDOHVDQGPDOHVWKHLUDJHUDQJHGIURPWR\HDUVZDVXVHGWRVWXG\ WKHQRUPDODQDWRPLFDOIHDWXUHVRIWKH70-DVZHOODVWKHG\QDPLFVRIWKHMRLQW 05,ZDVXVHGWRDVVHVVGLVFSRVLWLRQGLVFPRUSKRORJ\GLVFPRELOLW\ERQHPDUURZ RHGHPDFRQG\ODUWUDQVODWLRQDQGMRLQWHIIXVLRQ0DLQRXWFRPHPHDVXUHV4XDOLWD WLYHGDWDZHUHSUHVHQWHGDVIUHTXHQFLHVDQGSHUFHQWDJHV 5HVXOWV&RQFHUQLQJGLVFSRVLWLRQ05H[DPLQDWLRQUHYHDOHG70-VRXWRI ZLWKDQWHULRUO\GLVSODFHGGLVFVZKLOH70-VVKRZHGQRUPDOGLVF SRVLWLRQ:KHQW\SHRIGLVSODFHPHQWZDVFRQVLGHUHG05,UHYHDOHG70-V ZLWK$'':5 ZKLOH 70-V ZLWK$'':25 05, DVVHVVPHQW RI GLVF PRELOLW\UHYHDOHGRXWRI70-VZLWKOLPLWHGDV\QFKURQRXVPRYHPHQWV ZKLOH70-VZLWKVWXFNGLVFDQG70-VZLWKQRUPDOPRELOLW\ &RQFOXVLRQ%RWKDUWKURVFRS\DQGG\QDPLF05,DUHVWDWLVWLFDOO\FRUUHODWHGWRHDFK RWKHULQGHWHFWLQJ70-LQWHUQDOGHUDQJHPHQW1HYHUWKHOHVVUHYLHZLQJWKHUHVXOWV KLJKOLJKWHGWKHDGYDQWDJHVRI05,DXJPHQWHGE\G\QDPLFSURWRFRORYHUDUWKURVFRS\ LQGLDJQRVLQJGLVFSRVLWLRQDQGPRELOLW\DQGKHQFHZHUHFRPPHQGXVLQJ05,DVD ÀUVWOLQHGLDJQRVWLFPRGDOLW\ZKHQLQWHUQDOGHUDQJHPHQWLVVXVSHFWHG % $VVHVVPHQWRIDUWLFXODUFDUWLODJHUHSDLUWLVVXHDIWHUPDWUL[ DVVRFLDWHGDXWRORJRXVFKRQGURF\WHWUDQVSODQWDWLRQRUWKH PLFURIUDFWXUHWHFKQLTXHLQWKHDQNOHMRLQWXVLQJGLIIXVLRQZHLJKWHG LPDJLQJDW7HVOD 65$SSULFK 67UDWWQLJ*+:HOVFK,01RHEDXHU+XKPDQQ 6'RPD\HU9LHQQD$7(UODQJHQ'(VHEDVWLDQDSSULFK#PHGXQLZLHQDFDW 3XUSRVH7KHSXUSRVHZDVWRFRPSDUHSDWLHQWVDIWHUPDWUL[DVVRFLDWHGDXWRORJRXV FKRQGURF\WHWUDQVSODQWDWLRQ0$&7DQGPLFURIUDFWXUHWKHUDS\0);RIWKHWDOXV XVLQJGLIIXVLRQZHLJKWHGLPDJLQJ':,ZLWKPRUSKRORJLFDODQGFOLQLFDOVFRULQJ 0HWKRGV DQG 0DWHULDOV 7ZHQW\ SDWLHQWV WUHDWHG ZLWK 0$&7 RU 0); WHQ SHU JURXSZHUHH[DPLQHGXVLQJ705,DWDQGPRQWKVDIWHUVXUJHU\ UHVSHFWLYHO\)RUFRPSDUDELOLW\SDWLHQWVIURPHDFKJURXSZHUHPDWFKHGE\DJH ERG\PDVVLQGH[DQGIROORZXS$2)$6VFRUHVHUYHGDVFOLQLFDODVVHVVPHQWWRRO SUHDQGSRVWRSHUDWLYHO\':,ZDVREWDLQHGXVLQJDSDUWLDOO\EDODQFHGVWHDG\ VWDWH JUDGLHQWHFKR SXOVH VHTXHQFH DV ZHOO DV WKH 02&$57 VFRUH EDVHG RQ D '3'Z76(VHTXHQFH DQG D 'LVR7UXH)LVSVHTXHQFH 6HPLTXDQWLWDWLYH GLIIXVLRQ TXRWLHQWV ZHUH FDOFXODWHG DIWHU 52, DQDO\VLV RI UHSDLU WLVVXH 57 DQG KHDOWK\FRQWUROFDUWLODJHDQGFRPSDUHGDPRQJERWKJURXSV 5HVXOWV7KHPHDQ $2)$6VFRUHLPSURYHGVLJQLÀFDQWO\3 IRUERWKJURXSV 0$&7 WR0);WR1RGLIIHUHQFHVLQWKH $2)$63 DQG02&$573 VFRUHZHUHREVHUYHGEHWZHHQ0$&7 DQG0);SRVWRSHUDWLYHO\':,GLVWLQJXLVKHGEHWZHHQKHDOWK\FDUWLODJHDQGFDUWLODJH 57LQWKH0);JURXS3 EXWQRWDIWHU0$&7WUHDWPHQW3 &RU UHODWLRQZDVIRXQGEHWZHHQ02&$57VFRUHDQG':,3HDUVRQ3 DQGDWUHQGIRUDFRUUHODWLRQEHWZHHQ%0,DQG':,3HDUVRQ3 &RQFOXVLRQ:KHUHDVFRQYHQWLRQDOVFRUHVUHYHDODVLPLODURXWFRPHDIWHU0$&7 RU0);WUHDWPHQWLQWKHDQNOHMRLQW':,ZDVDEOHWRGLVWLQJXLVKEHWZHHQGLIIHU HQW57TXDOLWLHVDVUHSRUWHGKLVWRORJLFDOO\IRUWKHVHGLYHUVHVXUJLFDOSURFHGXUHV % )HDVLELOLW\RIJDJ&(67LPDJLQJRQDFOLQLFDO705,V\VWHPLQLWLDO UHVXOWVDQGFRPSDULVRQZLWKVRGLXPLPDJLQJDW7HVOD %6FKPLWW*+:HOVFK6=E\Q6*RHG67UDWWQLJ9LHQQD$7 EHQMDPLQVFKPLWW#PHGXQLZLHQDFDW 3XUSRVH(YDOXDWLRQRIIHDVLELOLW\WRSHUIRUPJDJ&(67LPDJLQJRQDFOLQLFDO7 05,V\VWHPLQQLQHSDWLHQWVZLWKNQHHSDLQDQGWKUHHKHDOWK\YROXQWHHUV 0HWKRGV DQG 0DWHULDOV 0RUSKRORJLFDO 05, DQG JDJ&(67 LPDJLQJ ZHUH SHU IRUPHGRQDFOLQLFDO77LP7ULR6RGLXPLPDJLQJZDVFDUULHGRXWRQD6LHPHQV 7ZKROHERG\V\VWHPXVLQJDPRGLÀHG*5(VHTXHQFH6LJQDOGLVWULEXWLRQVLQ KHDOWK\FDUWLODJHRIYROXQWHHUVZHUHGHWHUPLQHGDVDUHIHUHQFHIRUSDWKRORJLFDO FKDQJHV6RGLXPLPDJLQJDQGJDJ&(67SHUIRUPHGLQSDWLHQWVZHUHFRPSDUHG ZLWKDWWHVW,QWHUDQGLQWUDUHDGHUDJUHHPHQWDVZHOODVFRUUHODWLRQRIZLGWKVRI MRLQWVSDFHVZLWKDQJOHVDQGYROXPHRIFRQWUDVWZDVHYDOXDWHGZLWKD3HDUVRQWHVW 5HVXOWV7KHVWXG\JURXSFRQVLVWHGRIVXEMHFWVRIZKLFKZHUHSRVLWLYHDQG QHJDWLYHIRUKLSOD[LW\DWVXUJHU\7KHPHDQZLGWKRIWKHDQWHULRUMRLQWVSDFH ZDVVLJQLÀFDQWO\GLIIHUHQWSLQWKHOD[LW\JURXSPPDQGLQWKHJURXS ZLWKRXWOD[LW\PP7KHPHDQZLGWKRIWKHSRVWHULRUMRLQWVSDFHZDVVLJQLÀFDQWO\ GLIIHUHQWS LQWKHOD[LW\JURXSPPDQGLQWKHJURXSZLWKRXWOD[LW\PP 7KHUHZDVQRGLIIHUHQFHLQPHDQIHPRUDOQHFNLVFKLXPDQJOHVEHWZHHQWKHJURXSV S PHDQYROXPHRIFRQWUDVWS 7KHUHZDVQRFRUUHODWLRQEHWZHHQWKH DQJOHYROXPHWRWKHZLGWKVRIWKHMRLQWVSDFHVU,QWHUDQGLQWUDUHDGHU DJUHHPHQWZDVKLJKU &RQFOXVLRQ'LVWHQWLRQRIWKHDQWHULRUDQGSRVWHULRUMRLQWVSDFHZDVJUHDWHUZLWK KLSOD[LW\LQGHSHQGHQWRILQWUDDUWLFXODUFRQWUDVWYROXPHDQGKLSURWDWLRQ % 05WUDFWLRQDUWKURJUDSK\RIWKHKLSLQIHPRURDFHWDEXODULPSLQJHPHQW (6FKPDUDQ]HU0.RJOHU05HLFKNHQGOHU3 9DYURQ6W-RKDQQ$7 VFKPDUDQ]HU#NKVMDW 3XUSRVH7KHFHQWUDOFRPSDUWPHQWRIWKHKLSLVXVXDOO\GLIÀFXOWWRDVVHVVE\GLUHFW 05 DUWKURJUDSK\ 0RVWO\ D VXIÀFLHQW LQWHUIDFH EHWZHHQ DFHWDEXODU DQG IHPRUDO FDUWLODJH LV QRW DFKLHYDEOH ZLWK WUDFWLRQ SURFHGXUHV GHVFULEHGLQ WKH OLWHUDWXUH :HWKHUHIRUHGHYHORSHGDGHGLFDWHGGHYLFHLQDQDORJ\WRWKHWUDFWLRQV\VWHPIRU KLSDUWKURVFRS\ 0HWKRGVDQG0DWHULDOV7KLVGHGLFDWHGWUDFWLRQGHYLFHFRQVLVWVRIDPRELOHDLG PDGHRIFKURPLXPQLFNHOVWHHOQRWGLUHFWO\FRQQHFWHGWRWKH05WDEOHSURYLGHG ZLWKDQLQWHJUDWHGGHÁHFWLRQSXOOH\IRUDFDEOHZLQFKZHLJKWWRNJDQGD VXSSRUWLQJ SODWH IRU WKH FRQWUDODWHUDO ORZHU H[WUHPLW\$ WRWDO RI FRQVHFXWLYH SDWLHQWV PHDQ DJH \HDUV ZRPHQ ZHUH LQYHVWLJDWHG DIWHUDUWKURJUDSK\ ZLWKRXWDQGZLWKWUDFWLRQRQD7 HVODXQLW 5HVXOWV :LWKRXW WUDFWLRQ WKH ODEUXP ZDV VXIÀFLHQW DVVHVVDEOH LQ SDWLHQWV WKHDFHWDEXODUDQGIHPRUDOFDUWLODJHRQO\LQSDWLHQWV8VLQJ WUDFWLRQDQDGHTXDWHVHSDUDWLRQRIIHPRUDODQGDFHWDEXODUFDUWLODJHZLWKDQDYHU DJHFRQWLQXRXVLQWHUIDFHRIPPUDQJHIURPWRPPZDVDFKLHYHGLQ SDWLHQWV$QGWKHUHIRUHWKHODEUXPIHPRUDODQGDFHWDEXODUFDUWLODJHZHUHVXI ÀFLHQWGHWHFWDEOH2QO\LQRQHFDVHZHZHUHXQDEOHWRGLIIHUHQWLDWHIHPRUDOIURP DFHWDEXODU FDUWLODJH ([FOXGLQJ WKLV SDWLHQW FKRQGUDO GHIHFWV DQG ODEUDO OHVLRQV ZHUHDFFXUDWHO\DVVHVVDEOH &RQFOXVLRQ7KHVHSUHOLPLQDU\UHVXOWVVKRZWKDWWKHXVHRIWKLVWUDFWLRQV\VWHP PDUNHGO\LPSURYHVGLDJQRVWLFVWXGLHVRIWKHKLS7KHH[DFWORFDWLRQRIODEUXPDQG FDUWLODJHOHVLRQVLVYHU\VLJQLÀFDQWDVUHJDUGVSURJQRVLVDQGRIGHFLVLYHLPSRUWDQFH IRUVHOHFWLRQRIWKHUDS\ % 0HWDODUWHIDFWUHGXFWLRQLQ05LPDJLQJDW7HVODLQFRPSDULVRQWR 7HVODXVLQJLQQRYDWLYHVHTXHQFHVWUDWHJLHV 05HLFKHUW $7 DR07UHOOHV5.5DR01LWWND$3DGXD 626FKRHQEHUJ905XQJH8,$WWHQEHUJHU0DQQKHLP'(7 RQJLM&1 *DOYHVWRQ7;86(UODQJHQ'(0DOYHUQ3$860LULDP5HLFKHUW#XPPGH 3XUSRVH7KHDLPRIWKLVVWXG\LVWRVKRZWKHIHDVLELOLW\RIPHWDODUWHIDFWUHGXF WLRQLQ05,DW7LQFRPSDULVRQWR7XVLQJLQQRYDWLYHVHTXHQFHVWUDWHJLHV 0HWKRGVDQG0DWHULDOV6WDWHRIWKHDUWWHFKQLTXHVIRUPHWDODUWHIDFWUHGXFWLRQ LQFOXGLQJ9$7DQG6(0$&ZHUHHYDOXDWHG773'DQG67,5LPDJHVZHUH DFTXLUHGRQD7V\VWHPDVZHOODVRQD7V\VWHP$JDURVHSKDQWRPVZLWK VWDLQOHVVVWHHOLPSODQWVWLVVXHSKDQWRPVZLWKPHWDOLPSODQWVDQGYROXQWHHUVZHUH LPDJHGZLWKWKHVHWHFKQLTXHV$UWHIDFWUHGXFWLRQZDVDVVHVVHGE\PHDVXUHPHQW RIWKHDUWHIDFWYROXPHDQGE\EOLQGHGUHDG 5HVXOWV &RPSDUHG WR FRQYHQWLRQDO DFTXLVLWLRQV ZLWK D KLJK EDQGZLGWK PHWDO DUWHIDFWVMXGJHGE\YROXPHRIDUWHIDFWZHUHUHGXFHGE\RQ79$7 6(0$&DQG6(0$&9$7DW7DQGDQGRQ79$7 6(0$&DQG 6(0$&9$7DW7 73'DQG67,5GHPRQVWUDWHGVLPLODUDUWHIDFWUHGXFWLRQ)RU DUWHIDFWVL]HGLVWRUWLRQRIQRUPDOVWUXFWXUHVDQGDELOLW\WRYLVXDOLVHWKHERQHPDUURZ ERQHFRUWH[DQGVRIWWLVVXHV6(0$&9$7ZHUHUDQNHGVXSHULRUWRFRQYHQWLRQDO DFTXLVLWLRQVDVHYDOXDWHGRQWKHEOLQGHGUHDG)RURYHUDOOLPDJHTXDOLW\LPDJHV ZHUHUDQNHGDVIROORZV6(0$&9$7!9$7!6(0$&!FRQYHQWLRQDODFTXLVLWLRQ NDSSD 615YDOXHVZHUHUDQNHG6(0$&!6(0$&9$7!FRQYHQWLRQDO DFTXLVLWLRQ!9$7 &RQFOXVLRQ6(0$&9$7VXEVWDQWLDOO\UHGXFHGPHWDODUWHIDFWVIRU7DQG7 VFDQVIRUDOOHYDOXDWHGLPDJHFRQWUDVWV7KHDUWHIDFWYROXPHLVLQFUHDVHGRQ7 EXWVWLOOVXEVWDQWLDOO\UHGXFHGE\6(0$&9$7 6FLHQWLILF6HVVLRQ 6 &$' ( ) *+% (XURSHDQ&RQJUHVVRI 5DGLRORJ\ 5HVXOWV&'7,VZHUHP*\P$VLQDOOVFDQV&XUUHQWUHGXFWLRQRYHUWKH H\HVZDVPHDQDQGRYHUDOOPHDQZLWKWKH QHRQDWHHTXLYDOHQWVFDQVEHQHÀWLQJPRVWIURP$7&01RLVHH[KLELWHGDVWDWLVWL FDOO\VLJQLÀFDQWLQFUHDVHZKHQ$(&ZDVHPSOR\HGFRPSDUHGWRÀ[HGP$ZLWKRU ZLWKRXWVKLHOGLQJ1RLVHH[KLELWHGIXUWKHUVLJQLÀFDQWLQFUHDVHZKHQVKLHOGVZHUH SRVLWLRQHGDIWHUVFRXWDFTXLVLWLRQ &RQFOXVLRQ$7&0LVDUHTXLVLWHGXULQJSDHGLDWULFKHDG&7DQGZKHQHPSOR\HG WXEHFXUUHQWLVQRWDIIHFWHGE\ELVPXWKVKLHOGSODFHPHQW6KLHOGVFDXVHLQFUHDVH LQLPDJHGHQVLW\RYHUWKHH\HVHVSHFLDOO\LQQHRQDWHVLUUHVSHFWLYHO\RIÀ[HGRU UHGXFHGFXUUHQW%UDLQGHQVLW\LVPLQLPDOO\DIIHFWHGE\VKLHOGSODFHPHQW % $ORFDOGRVHVXUYH\RIFUDQLDO&7LQFKLOGUHQFRPSDULVRQZLWK GLIIHUHQW(XURSHDQ'5/OHYHOVDQGSRVVLELOLWLHVIRUGRVHRSWLPLVDWLRQ 7 +(0XONHQV3 %HOOLQFN56DOJDGR/LHU%(WRPPXONHQV#VFDUOHWEH 3XUSRVH7 RFRPSDUHWKHGRVHOHYHORIRXUFUDQLDO&7SURWRFROVLQFKLOGUHQZLWK UHFHQW(XURSHDQ'5/OHYHOVRIGLIIHUHQW(XURSHDQFRXQWULHVDQGSURSRVHREMHF WLYHVIRUGRVHRSWLPLVDWLRQ 0HWKRGV DQG 0DWHULDOV &UDQLDO &7 LV WKH PRVW FRPPRQ &7 H[DPLQDWLRQ LQ FKLOGUHQ $OWKRXJKGRVHUHGXFWLRQDQGRSWLPLVDWLRQRI&7LQFKLOGUHQLVPDQGDWRU\ WKHUHDUHFRPSDUHGZLWKDGXOW&7 QRHVWDEOLVKHG(XURSHDQGRVHUHIHUHQFHOHYHOV '5/:HUHYLHZHGWKHGRVHYDOXHVRIRXUFUDQLDO&7SURWRFROVLQFKLOGUHQRI Q DFFRUGLQJWRDJH7KH\ZHUHFRPSDUHGZLWKWKHPHDQ'5/OHYHOVRI GLIIHUHQW(XURSHDQFRXQWULHVSXEOLVKHGLQWKHODVW\HDUV 5HVXOWV)ROORZLQJPHDQFUDQLDOGRVHOHYHOVRI&7LQFKLOGUHQZHUHREWDLQHG \HDUQ &7',YRORIP*\'/3RIP*\FPDQGHIIHFWLYHGRVH P6Y\HDUQ &7',YRORIP*\'/3RIP*\FPDQGHIIHFWLYH GRVHP6Y\HDUQ &7',YRORIP*\'/3RIP*\FP DQGHIIHFWLYHGRVHRIP6YDQG\HDUQ &7',YRORIP*\ '/3RIP*\FPDQGHIIHFWLYHGRVHRIP6Y&RPSDUHGZLWKWKHPHDQ '5/OHYHORIGLIIHUHQW(XURSHDQFRXQWULHVRXUSURWRFROVVKRZHGIROORZLQJGRVH UHGXFWLRQ\HDU\HDU\HDUDQG &RQFOXVLRQ 2XU ORFDO GRVH VXUYH\ VKRZHG WKDW GRVH UHGXFWLRQ LV SRVVLEOH LQ FUDQLDO&7RIFKLOGUHQHVSHFLDOO\LQ\RXQJHUFKLOGUHQ % (YDOXDWLQJWKHGLDJQRVWLFDFFXUDF\RIXOWUDVRXQGLQ FUDQLRV\QRVWRVLVDPRQJLQIDQWVXQGHU\HDU 11DMPL7 HKUDQ,5 3XUSRVH9DULRXVLPDJLQJPRGDOLWLHVKDYHEHHQVWXGLHGIRUDFFXUDWHGLDJQRVLV RI FUDQLRV\QRVWRVLV 8OWUDVRXQG LV D QRQLQYDVLYH DYDLODEOH ORZFRVW PRGDOLW\ DQGDERYHDOOLVIUHHRIVLGHHIIHFWVFRPSOLFDWLRQV7KHFXUUHQWVWXG\KDVEHHQ SHUIRUPHGWRDVVHVVWKHGLDJQRVWLFDFFXUDF\RIXOWUDVRXQGFRPSDUHGWR&7VFDQ DVDJROGVWDQGDUGLQWKHGLDJQRVLVRIFUDQLRV\QRVWRVLV 0HWKRGV DQG 0DWHULDOV )RUW\ IRXU LQIDQWV XQGHU \HDU ZHUH LQFOXGHG LQ WKH VWXG\$OO RI WKH LQIDQWV ZHUH FOLQLFDOO\ VXVSHFWHG WR KDYH FUDQLRV\QRVWRVLV DQG ZHUHUHIHUUHGWRGHSDUWPHQWRIUDGLRORJ\LQ7 HKUDQFKLOGUHQPHGLFDOFHQWUH'DWD ZHUHJDWKHUHGIURPWR,QIDQWVZHUHÀUVWVRQRJUDSKLFDOO\H[DPLQHGE\ DSDHGLDWULFUDGLRORJLVWDQGZHUHODWHUUHIHUUHGWRDQRWKHUSDHGLDWULFUDGLRORJLVWWR H[DPLQH&7VFDQZLWK'UHFRQVWUXFWHGLPDJHVRIVNXOODVJROGVWDQGDUGPRGDOLW\ 7KHVHFRQGUDGLRORJLVWZDVEOLQGHGWRUHVXOWVRIWKHXOWUDVRXQG 5HVXOWV6HYHQWHHQJLUOVDQGER\VZHUHLQFOXGHGLQWKHVWXG\7KHUHZDVQR GLIIHUHQFH LQ KHDG FLUFXPIHUHQFH DQG DJH EHWZHHQ ER\V DQG JLUOV 6HQVLWLYLW\ VSHFLÀFLW\SRVLWLYHDQGQHJDWLYHSUHGLFWLYHYDOXHVRIXOWUDVRXQGYHUVXV&7VFDQ ZHUHDQGUHVSHFWLYHO\7KHUHZDVQRVLJQLÀFDQWGLI IHUHQFHLQGLDJQRVWLFDFFXUDF\RIXOWUDVRXQGEHWZHHQJLUOVDQGER\VDQGEHWZHHQ LQIDQWVXQGHUPRQWKVDQGLQIDQWVROGHUWKDQPRQWKV &RQFOXVLRQ7KHKLJKVSHFLÀFLW\RIXOWUDVRXQGKHOSVWRFRUUHFWO\UXOHRXWFUDQLRV\Q RVWRVLVLQFOLQLFDOO\VXVSHFWHGFDVHVDQGWKXVFDQSUHYHQWXQQHFHVVDU\H[SRVXUH RIKHDOWK\LQIDQWVWR&7VFDQLRQLVLQJUDGLDWLRQ % 0DJQHWLFUHVRQDQFHLPDJLQJRIGLIIXVHD[RQDOLQMXU\LQDFXWHSHULRG RISDHGLDWULFFUDQLRFHUHEUDOWUDXPD ,0HOQLNRY7 $NKDGRY16HPHQRYD$3HWU\DLNLQ66LGRULQ6*XUҋ\DNRY 0RVFRZ58 3XUSRVH7KHWUXHGHJUHHRIEUDLQLQMXU\ZLWK'$,FDQEHIXOO\DVVHVVHGZLWK05, ZKLFK LV PRUH VHQVLWLYH WR DFXWH GDPDJHV WKDQ RWKHU PHWKRGV RI UDGLRORJLFDO GLDJQRVWLFV ZLWKUHVSHFWWRFDUWLODJHVLJQDOLQWHQVLWLHVIURP52,VLQKHDOWK\FDUWLODJH17DQG 52,VDGMDFHQWWRDSSDUHQWPRUSKRORJLFDOOHVLRQV$7 PLQLPXPGLVWDQFHPP (YDOXDWLRQZDVSHUIRUPHGVHSDUDWHO\E\WZRUHDGHUV6WDWLVWLFDOUHODWLRQVEHWZHHQ WHFKQLTXHVZHUHDVVHVVHGXVLQJQRQSDUDPHWULFWHVWV 5HVXOWV$EVROXWHJDJ&(67YDOXHVIURP52,VLQYDULRXVFDUWLODJHDUHDVRIWKH YROXQWHHUV VLJQLÀFDQWO\ IROORZHG *DXVVLDQ GLVWULEXWLRQV DQG H[KLELWHG SRVLWLYH PHDQYDOXHVLQWKHRUGHURIWR3DWLHQWVH[KLELWHGFRQVLVWHQWO\ORZHUDYHU DJHJDJ&(67VLJQDOVLQ$7FRPSDUHGWR177KHVH UHVXOWV ZHUH FRQÀUPHG E\ VRGLXP LPDJLQJ ZKHUH D PHDQ VLJQDO LQWHQVLW\ RI ZDVPHDVXUHGLQ17DQGLQ$7 ,QWUDFODVVFRU UHODWLRQEHWZHHQUHDGHUV\LHOGHG5ò IRUJDJ&(67YDOXHVDQG5ò IRUVRGLXPVLJQDOLQWHQVLWLHV &RQFOXVLRQ:HGHPRQVWUDWHGWKDWLWZDVSRVVLEOHWRREWDLQ'JDJ&(67GDWDVHWV LQUHDVRQDEOHVFDQWLPHZLWKWKHSUHVHQWHGWHFKQLTXH7KHUHVXOWVRIWKLVVWXG\ HVSHFLDOO\WKHVWURQJFRUUHODWLRQRIJDJ&(67ZLWKVRGLXPLPDJLQJFOHDUO\VXJJHVW WKHIHDVLELOLW\RIJDJ&(67LPDJLQJLQDURXWLQHFOLQLFDOVHWWLQJ 5RRP( 3DHGLDWULF 66 1HXURDQGIHWDOLPDJLQJ 0RGHUDWRUV -)&KDWHLO%RUGHDX[)5 -*HLJHU)UHLEXUJ'( % (IIHFWRI[UD\WXEHSDUDPHWHUVDQGLRGLQHFRQFHQWUDWLRQRQ UDGLDWLRQGRVHDQGLPDJHTXDOLW\LQSDHGLDWULFDQGDGXOWEUDLQ&7 DQJLRJUDSK\DSKDQWRPVWXG\ $(3DSDGDNLV.3HULVLQDNLV05DLVVDNL-'DPLODNLV,UDNOLRQ*5 3XUSRVH7 RDVVHVVWKHHIIHFWRI[UD\WXEHSDUDPHWHUVDQGLRGLQHFRQFHQWUDWLRQ RQUDGLDWLRQGRVHDQGLPDJHTXDOLW\LQSDHGLDWULFDQGDGXOWEUDLQ&7DQJLRJUDSK\ 0HWKRGVDQG0DWHULDOV$QHZW\SHRIEUDLQYDVFXODUOHVLRQSKDQWRPVZDVGH YLVHGLQRXUODE&\OLQGULFDOYHVVHOVZHUHERUHGDORQJWKHEUDLQHTXLYDOHQWSOXJVRI SK\VLFDODQWKURSRPRUSKLFKHDGSKDQWRPVWKDWVLPXODWHWKHDYHUDJHLQGLYLGXDODV QHRQDWH\HDU\HDU\HDUROGFKLOGDQGDGXOW7 RVLPXODWHYDVFXODUOHVLRQV RIGLIIHUHQWGLDPHWHUYHVVHOVRIPPPPPPDQGPPZHUHFUHDWHG 7KHVHYHVVHOVZHUHÀOOHGZLWKLRGLQHVROXWLRQVRIGLIIHUHQWFRQFHQWUDWLRQ3KDQWRP KHDGVZHUHVFDQQHGXVLQJVWDQGDUGN9SDQGP$VVHWWLQJVSUHVFULEHGE\WKHURXWLQH H[DPLQDWLRQSURWRFROIRUHDFKDJHDQGDWUHGXFHGN9SDQGP$VH[SRVXUHVHWWLQJV $FTXLVLWLRQVZHUHSHUIRUPHGRQDVOLFH&7VFDQQHUXVLQJLÀ[HGP$VDQGLL DXWRPDWLFH[SRVXUHFRQWURO$(&&RQWUDVWWRQRLVHUDWLR&15ZDVFDOFXODWHG EDVHG RQ WKH +RXQVÀHOG 8QLW YDOXHV PHDVXUHG ZLWKLQ FRQWUDVWHQKDQFHG DQG XQHQKDQFHGUHJLRQVRILQWHUHVW 5HVXOWV &15 YDOXHV YDULHG IURP IRU WKH \HDUROG FKLOG WR IRUDGXOWDWVWDQGDUGH[SRVXUHVHWWLQJV&15YDOXHVLQFUHDVHGOLQHDUO\ZLWKP$V VHWWLQJVYHVVHOGLDPHWHULRGLQHFRQFHQWUDWLRQ3DQGZHUHRSWLPXPDW N9S$(&DFWLYDWLRQUHGXFHGGRVHE\XSWRZLWKRXWVLJQLÀFDQWGHJUDGD WLRQRI&153! &RQFOXVLRQ([SRVXUHVHWWLQJVDQGLRGLQHFRQFHQWUDWLRQFDQEHIXUWKHUUHGXFHG GXULQJSDHGLDWULFDQGDGXOW&7DQJLRJUDSK\ZLWKRXWVLJQLÀFDQWO\DIIHFWLQJ&15 2XU ÀQGLQJV FDQ EH XVHG WR GHWHUPLQH WKHVH PLQLPXP H[SRVXUH VHWWLQJV DQG LRGLQHFRQFHQWUDWLRQ % %LVPXWKVKLHOGLQJDQGDXWRPDWLFWXEHFXUUHQWPRGXODWLRQGXULQJ SDHGLDWULFKHDG&7 05DLVVDNL$3DSDGDNLV.3HULVLQDNLV-'DPLODNLV,UDNOLRQ*5 PUDLVVDNL#\DKRRJU 3XUSRVH7 RVWXG\WKHHIIHFWRIRUELWDOELVPXWKVKLHOGLQJFRPELQHGZLWK$7&0RQ WXEHFXUUHQWDQGLPDJHQRLVH 0HWKRGVDQG0DWHULDOV)RXUDQWKURSRPRUSKLFSKDQWRPV$720SKDQWRPV&,56 ,QF1RUIRONUHSUHVHQWLQJWKHDYHUDJHKHDGRIQHZERUQDQG\HDUROG ZHUHVFDQQHGRQD6LHPHQV6RPDWRP6HQVDWLRQVFDQQHUDZLWKÀ[HGWXEH FXUUHQWEZLWK$7&0FZLWK$7&0DQGDVKLHOGRQRUELWVEHIRUHVFRXWDFTXLVLWLRQ GZLWK$7&0DQGDVKLHOGRQRUELWVDIWHUVFRXWDFTXLVLWLRQ1RLVHZDVPHDVXUHG DV6'RI+8E\GUDZLQJFPUHJLRQVRILQWHUHVWLQKRPRJHQHRXVDSSHDULQJ DUHDVDWERWKRUELWVWHPSRUDOIURQWDOSDULHWDOOREHVIRUHDFKVFDQ 6FLHQWLILF6HVVLRQ $ 6&'()*+%(XURSHDQ&RQJUHVVRI 5DGLRORJ\ 0RQGD\ 5HVXOWV$VLJQLÀFDQWSRVLWLYHFRUUHODWLRQEHWZHHQJHVWDWLRQDODJH*$DQG) $ ZDVIRXQGU SEXWQRVLJQLÀFDQWFRUUHODWLRQZDVIRXQGEHWZHHQ*$ DQG$'&U S &RQFOXVLRQ:HFRXOGVKRZDVLJQLÀFDQWSRVLWLYHFRUUHODWLRQRI*$ZLWK)$EXWQRW ZLWK $'&LQWKHIRHWDOPLGEUDLQ,QFUHDVLQJ)$GXULQJJHVWDWLRQFDQEHH[SODLQHGE\ LQFUHDVLQJP\HOLQDWLRQ7KHUHIRUH)$PHDVXUHPHQWVDUHFDSDEOHRIGHPRQVWUDWLQJ SUHQDWDOP\HOLQDWLRQLQIRHWXVHVZLWKQRUPDO&16GHYHORSPHQWDQGPLJKWVHUYHWR LQYHVWLJDWHDEQRUPDOP\HOLQDWLRQRUEUDLQVWHPFRPSUHVVLRQLQK\GURFHSKDOXV RU&KLDUL,,PDOIRUPDWLRQV % 5ROHRIIRHWDO05,LQWKHHYDOXDWLRQRIFHUHEHOODUPRUSKRVWUXFWXUH DQGELRPHWU\ /0DQJDQDUR$7 RPHL) )LHUUR6%HUQDUGR99LQFL3 6ROOD]]R0(6HUJL (6LOYHVWUL00DULQL5RPH,7VLYYLD#JPDLOFRP 3XUSRVH2XUVWXG\DLPHGWRLQYHVWLJDWHWKHUROHRIIRHWDO05,LQWKHHYDOXDWLRQ RIFHUHEHOODUPRUSKRVWXFWXUHLQRUGHUWRGHÀQHPDLQELRPHWULFDOSDUDPHWHUVZKLFK DOORZFHUHEHOODUSDWKRORJLHVGHWHFWLRQ 0HWKRGVDQG0DWHULDOV)URP-XQHWR $SULOZHHQUROOHGZRPHQZLWK SUHYLRXV86VXVSHFWRISRVWHULRUFUDQLDOIRVVDDOWHUDWLRQZHSHUIRUPHGIRHWDO 05,H[DPVRIFHUHEUDOUHJLRQ:HH[FOXGHGFDVHVZLWKGLDJQRVLVRI$UQROG&KLDUL 0DOIRUPDWLRQDQGRIVSDFHRFFXS\LQJQRWF\VWLFOLNHOHVLRQ:HHYDOXDWHGPDLQ ELRPHWULFDOSDUDPHWHUVRIWKHFHUHEHOOXPYHUPLVPRUSKRORJ\DQGELRPHWU\,9YHQ WULFOHEUDLQVWHPFHUHEHOODUSRQWLQHDQJOHFLVWHUQDPDJQDDQGWHQWRULXPLQVHUWLRQ 5HVXOWV )RHWDO 05, GHWHFWHG DOWHUDWLRQ RI WKH SRVWHULRU FUDQLDO IRVVDLQ FDVHVWKXVH[FOXGLQJWKH86VXVSHFWRISDWKRORJLHVLQWKHUHPDLQLQJFDVHV :HGLDJQRVHGLQFDVHV'DQG\:DONHUPDOIRUPDWLRQLQFDVHVSDUWLDO YHUPLVDJHQHVLVLQYHUPLVK\SRSODVLDVHFRQGDU\WRF\VWLFOLNHOHVLRQV LQFDVHVPDOURWDWLRQLQFDVHVFLVWHUQDPDJQDGLODWDWLRQLQFDVHV SRQWRFHUHEHOODUK\SRSODVLDLQLVFKDHPLFKDHPRUUKDJLFOHVLRQVRIWKHFHU HEHOOXPDWODVWLQFDVHVZHGLDJQRVHGDUHGXFWLRQRIWKHFUDQLDOFHUHEHOODU ELRPHWU\05,UHVXOWVZHUHFRPSDUHGZLWKDXWRSV\LQFDVHVRXUUHVXOWVZHUH FRQÀUPHGLQFDVHV71DQG73ZHUHPLVFRQÀUPHG &RQFOXVLRQ)RHWDO05,RIWKHFHUHEUDOUHJLRQUHYHDOHGXVHIXODVWKLUGOHYHOGLDJ QRVWLFWHFKQLTXHLQFDVHVRISRVWHULRUFUDQLDOIRVVDSDWKRORJLHVLQRUGHUWRFRQÀUP DQGFKDUDFWHULVHWKHYDULRXVPDOIRUPDWLRQWKDQNVWRWKHPXOWLSODQHVRULHQWDWLRQ ZKLFKDOORZVWRVWXG\ELRPHWU\DQGPRUSKRORJ\RIDOOWKHVWUXFWXUHVLQYROYHG % 05OXQJYROXPHDVVHVVPHQWDWGLIIHUHQWWLPHVRIJHVWDWLRQIRU SUHGLFWLRQRIVXUYLYDOQHHGIRU(&02WKHUDS\DQGGHYHORSPHQWRI FKURQLFOXQJGLVHDVHLQIHWXVHVZLWKFRQJHQLWDOGLDSKUDJPDWLFKHUQLD $:DOOH\R$'HEXV6.HKO&:HLVV626FK|QEHUJ7 6FKDLEOH .$%XHVLQJ.:1HII0DQQKHLP'(DQQDZDOOH\R#XPPGH 3XUSRVH3XUSRVHRIWKHVWXG\ZDVWRLQYHVWLJDWHWKHSUHGLFWLRQRIVXUYLYDOQHHG IRUH[WUDFRUSRUHDOPHPEUDQHR[\JHQDWLRQ(&02DQGGHYHORSPHQWRIFKURQLFOXQJ GLVHDVH&/'LQSDWLHQWVZLWKFRQJHQLWDOGLDSKUDJPDWLFKHUQLD&'+UHJDUGLQJD FODVVLÀFDWLRQLQWKUHHGLIIHUHQWWLPHVRIJHVWDWLRQ!ZHHNVJHVWD WLRQE\DVVHVVLQJWKHREVHUYHGH[SHFWHG05IHWDOOXQJYROXPHRH05)/9 0HWKRGVDQG0DWHULDOVIRHWXVHVZLWK&'+ZHUHLQFOXGHGIRUGDWDDQDO\VLV 05,ZDVSHUIRUPHGDWGLIIHUHQWWLPHVRIJHVWDWLRQIRHWXVHVIRHWXVHV IRHWXVHV!ZHHNVJHVWDWLRQXVLQJ7ZHLJKWHGKDOI)RXULHUDFTXLUHG VLQJOHVKRWWXUERVSLQHFKR+$67(LPDJLQJ5HFHLYHURSHUDWLQJFKDUDFWHULVWLF FXUYH52&DQDO\VLVZDVDSSOLHGWRLQYHVWLJDWHWKHSURJQRVWLFTXDOLW\RIWKHDV VHVVPHQWRIWKHRH05)/9DWGLIIHUHQWWLPHVRIIHWDOJURZWK 5HVXOWV )RU DOO UHYLHZHG WLPHV RI JHVWDWLRQ WKH RH 05 )/9 \LHOGHG DOPRVW HTXLYDOHQW VWDWLVWLFDOO\ VLJQLÀFDQW GLIIHUHQFHV IRU QHRQDWDO VXUYLYDO DQG QRQVXU YLYDO S QHHG IRU (&02 WKHUDS\ S DQG GHYHORSPHQW RI &/' SRUQRW&RPSOHPHQWHGZHUHWKHVHUHVXOWVE\KLJKSURJQRVWLFDFFXUDF\ IRUHDUO\OLNHZLVHIRUODWHWLPHVRIJHVWDWLRQ52&DQDO\VLVVKRZHGWKHKLJKHVWDUHD XQGHUWKHFXUYH$8&IRUQHRQDWDOVXUYLYDO &RQFOXVLRQ,QSDWLHQWVZLWK&'+WKHRH05)/9LVDYDOXDEOHSURJQRVWLFSD UDPHWHUWRSUHGLFWQHRQDWDOPRUWDOLW\PRUELGLW\UHSUHVHQWHGE\WKHGHYHORSPHQW RI&/'DQGQHHGIRU(&02WKHUDS\DOUHDG\LQHDUO\ZHHNVJHVWDWLRQZJ DVZHOODVLQODWHUWLPHVRIJHVWDWLRQZLWKQRVWDWLVWLFDOO\VLJQLÀFDQWGLIIHUHQFHV 0HWKRGVDQG0DWHULDOV:HKDYHUHWURVSHFWLYHO\DQDO\VHGPHGLFDOUHFRUGVDQG LPDJLQJÀQGLQJVRIFKLOGUHQZLWK'$,DJHGIURPWR\HDUVZKRDGPLWWHG WRRXUKRVSLWDOLQ$FFRUGLQJWR*&6LQFDVHVZHFODVVLÀHGWUDXPDDVPLOG LQFDVHVDVPRGHUDWHDQGLQFDVHVDVVHYHUH7KHDYHUDJH*&6VFRUHRIDOO SDWLHQWVRQDGPLVVLRQZDV,QDOOFDVHV05,ZDVSHUIRUPHGLQDSHULRGIURP VHYHUDOKRXUVWLOOGD\VIURPWKHPRPHQWRILQMXU\)RUWKLVVWXG\ZHXVHGWKHIROORZ LQJSURWRFROVD[LDO776(7)/$,5DQG7))(VDJLWWDO7)/$,5DQG7))( FRURQDO7)/$,5'LIIXVLRQZHLJKWHGLPDJLQJ':(3,ZLWKHQFRGLQJGLUHFWLRQV E VPPDQGE VPPLQD[LDOSURMHFWLRQZDVSHUIRUPHGLQSDWLHQWV 5HVXOWV6PDOOKDHPRUUKDJLFOHVLRQVRQZKLWHPDWWHURIEUDLQKHPLVSKHUHVZHUH FODVVLÀHGDVJUDGH,OHVLRQVSDWLHQWVLQFDVHZKHQDGGLWLRQDOOHVLRQVLQFRUSXV FDOORVXPZHUHSUHVHQWWKH\ZHUHFODVVLÀHGDVJUDGH,,SDWLHQWVFRPELQDWLRQRI DERYHPHQWLRQHGOHVLRQVZLWKRQHVORFDWHGLQEUDLQVWHPZDVFODVVLÀHGDVJUDGH,,, SDWLHQWV3DWKRORJLFDOFKDQJHVUHYHDOHGZLWK':,LQSDWLHQWVZHUHW\SLFDO K\SHULQWHQVHVLJQDORQ':PDSVDQGK\SRLQWHQVHVLJQDORQ$'&PDSV &RQFOXVLRQ ,Q SDWLHQWV ZLWK VHYHUH FOLQLFDO GHFRPSHQVDWLRQ 05, PRUH RIWHQ UHYHDOVOHVLRQVLQFRUSXVFDOORVXPDQGEUDLQVWHPZKLFKLQGLFDWHVWKDWJUDGH,,, '$,LVSUHVHQW'LIIXVLRQZHLJKWHGLPDJLQJSHUIRUPHGLQDFXWHSHULRGRISDHGLDWULF FUDQLRFHUHEUDOWUDXPDFDQUHYHDOHLWKHUWKHSUHVHQFHRISHULIRFDORHGHPDRUWKH SUHVHQFHRILVFKDHPLFIRUPRI'$,LQFDVHVZKHUHWKHKDHPRUUKDJHLQWKHOHVLRQV DUHQRWGHWHFWHG % ,PSDLUPHQWRIWKHEUDQFKHVRIWKHGHHSFHUHEUDOYHLQVRQQHRQDWDO JHUPLQDOPDWUL[KDHPRUUKDJHXVLQJVXVFHSWLELOLW\ZHLJKWHGLPDJLQJ 7 1LZD1$LGD< )XMLL7 2NDEH.1R]DZD< 7 DFKLEDQD-6KLEDVDNL <RNRKDPD-3WQLZD#NFPFMS 3XUSRVH*HUPLQDOPDWUL[KDHPRUUKDJH*0+RFFXUVZLWKDK\SR[LFLVFKDHPLF LQVXOWLQSUHWHUPLQIDQWV7KHSXUSRVHRIWKLVVWXG\ZDVWRDVVHVVWKHUHODWLRQVKLS EHWZHHQ*0+JUDGHDQGWKHYLVXDOLVDWLRQRIWKHEUDQFKHVRIWKHGHHSYHLQVLQ LQIDQWVXVLQJVXVFHSWLELOLW\ZHLJKWHGLPDJLQJ6:, 0HWKRGVDQG0DWHULDOV7KLUW\WKUHHLQIDQWVJHVWDWLRQDODJHZHHNVFRUUHFW HGDJHDW05,ZHHNVZLWK*0+ZKRXQGHUZHQW6:,ZHUHUHWURVSHFWLYHO\ DVVHVVHG*0+ZDVJUDGHGZLWKDVVRFLDWHGÀQGLQJJUDGH,QRLQWUDYHQWULFXODU KDHPRUUKDJH,,*0+H[WHQGLQJLQWRWKHYHQWULFOH,,,LQWUDYHQWULFXODUKDHPRUUKDJH ZLWKYHQWULFXODUHQODUJHPHQW9,SDUHQFK\PDOKDHPRUUKDJH9LVXDOLVDWLRQRIHDFK EUDQFK RI WKH GHHS YHLQV LH DQWHULRU VHSWDO DQWHULRU FDXGDWH WKDODPRVWULDWH PHGLDO DQG ODWHUDO DWULDO LQWHUQDO FHUHEUDO DQG EDVDO YHLQVRQ 6:, ZDV UDWHG XVLQJ D IRXUSRLQW VFDOH E\ WZR H[SHULHQFHG SDHGLDWULF QHXURUDGLRORJLVWV *0+ JUDGHZDVFRPSDUHGWRWKHVFRUHRIWKHYLVXDOLVDWLRQRIWKHHDFKGHHSYHLQEUDQFK ,QWHUREVHUYHUDJUHHPHQWZDVDOVRDVVHVVHG 5HVXOWV7KHJUDGHRI*0+LQFOXGHG,LQ,,LQ,,,LQDQG,9LQ7KHUH ZDV D VLJQLÀFDQW GLIIHUHQFH LQ WKH VFRUH RI YLVXDOLVDWLRQ RI WKH WKDODPRVWULDWH YHLQDPRQJWKHLQIDQWVDFFRUGLQJWRWKH*0+JUDGHVUHDGHUS UHVSHFWLYHO\WKHYLVXDOLVDWLRQRIWKHYHLQLQLQIDQWVZLWK*0+JUDGH,9ZDVVLJ QLÀFDQWO\LPSDLUHGFRPSDUHGWRWKDWZLWK*0+JUDGH,UHDGHUS UHVSHFWLYHO\ ,QWHUREVHUYHU DJUHHPHQW ZDV PRGHUDWH WR H[FHOOHQW LQWUDFODVV FRUUHODWLRQFRHIÀFLHQW &RQFOXVLRQ *0+ ZLWK SDUHQFK\PDO KDHPRUUKDJH PD\ EH DFFRPSDQLHG ZLWK PRUHIUHTXHQWLPSDLUPHQWRIWKHEUDQFKHVRIWKHGHHSYHLQV % )UDFWLRQDODQLVRWURS\RIWKHIRHWDOPLGEUDLQDQGP\HOLQDWLRQ 5:RLWHN*.DVSULDQ0:HEHU3 &%UXJJHU'3UD\HU9LHQQD$7 UDPRQDZRLWHN#PHGXQLZLHQDFDW 3XUSRVH,QUDWSXSVGLIIXVLRQDQLVRWURS\LPDJLQJKDVEHHQVKRZQWRGHPRQVWUDWH SRVWQDWDOO\LQFUHDVLQJZKLWHPDWWHUP\HOLQDWLRQRIWKHEUDLQVWHPPRUHVHQVLWLYHO\ WKDQRWKHUFRQYHQWLRQDOLPDJLQJPRGDOLWLHV3UD\HU'1HXURUDGLRORJ\:H LQYHVWLJDWHGZKHWKHUGLIIXVLRQWHQVRULPDJLQJ'7,LQIRHWXVHVZLWKQRUPDO&16 GHYHORSPHQWLVFDSDEOHRIVKRZLQJFKDQJHVLQIUDFWLRQDODQLVRWURS\)$RUDS SDUHQWGLIIXVLRQFRHIÀFLHQW$'&LQWKHPLGEUDLQFRUUHODWHGZLWKJHVWDWLRQDODJH $QLQFUHDVLQJ)$ZRXOGSRLQWWRRQJRLQJSUHQDWDOP\HOLQDWLRQDVP\HOLQFRQVWUDLQV GLIIXVLRQSHUSHQGLFXODUEXWQRWSDUDOOHOWRÀEUHV 0HWKRGV DQG 0DWHULDOV 'XULQJ FOLQLFDOO\ LQGLFDWHG 05, 7 LQ IRHWXVHV *:QRUPDO&16GHYHORSPHQW7:)6(VHTXHQFHVLQWKUHHRUWKRJRQDO SODQHVRIWKHIRHWDOEUDLQDQGDQD[LDOVLQJOHVKRWHFKRSODQDUGLIIXVLRQWHQVRU VHTXHQFHQRQFROOLQHDUGLIIXVLRQJUDGLHQWHQFRGLQJGLUHFWLRQVSHUSHQGLFXODU WRWKHORQJD[LVRIWKHIRHWDOEUDLQVWHPZHUHDFTXLUHG $IWHUFRUHJLVWHULQJ7:)6( D[LDOLPDJHVZLWKD[LDO)$FRORXUFRGHGPDSVDUHJLRQRILQWHUHVW52,ZDVGUDZQ LQWKHPLGEUDLQWRFDOFXODWH)$DQG$'& 6FLHQWLILF6HVVLRQ 6 &$' ( ) *+% (XURSHDQ&RQJUHVVRI 5DGLRORJ\ % 'LIIXVLRQZHLJKWHGPDJQHWLFUHVRQDQFHLPDJLQJLQSDWLHQWVVHOHFWHG IRUUDGLFDOF\VWHFWRP\GHWHFWLRQUDWHRISHOYLFO\PSKQRGHPHWDVWDVHV 5&D]]DWR5'HO9HVFRYR()DLHOOD) 'ҋ$JRVWLQR5)UDQFHVFR*UDVVR %%HRPRQWH=REHO5RPH,7 3XUSRVH 7 R HYDOXDWH ZKHWKHU ':05, LPSURYHV WKH GHWHFWLRQ UDWH RI SHOYLF O\PSKQRGHPHWDVWDVHVLQDFRKRUWRISDWLHQWVZLWKPXVFOHLQYDVLYHEODGGHUFDQFHU VHOHFWHGIRUUDGLFDOF\VWHFWRP\ 0HWKRGV DQG 0DWHULDOV 1LQHWHHQ FRQVHFXWLYH SDWLHQWV ZLWK PXVFOH LQYDVLYH EODGGHU FDQFHU ZHUH HQUROOHG EHWZHHQ$SULO DQG 6HSWHPEHU 3DWLHQWV SU HRSHUDWLYHO\XQGHUZHQW705,XVLQJFRQYHQWLRQDOVHTXHQFHVFRPELQHGZLWK ':05,5DGLFDOF\VWHFWRPLHVZLWKH[WHQGHGO\PSKDGHQHFWRP\ZHUHSHUIRUPHGLQ DOOSDWLHQWV'LDJQRVWLFDFFXUDF\RI':05,ZDVFRPSDUHGZLWKWKHKLVWRSDWKRORJLF ÀQGLQJVDFFRUGLQJWRDFKDUWZKHUHWKHIROORZLQJQRGDOVWDWLRQVZHUHUHFRUGHG ULJKWDQGOHIWVLGHFRPPRQLQWHUQDODQGH[WHUQDOLOLDFYHVVHOVULJKWDQGOHIWVLGH REWXUDWRU\VWDWLRQSUHVDFUDOVWDWLRQ 5HVXOWV7KHPHDQ$'&YDOXHZDVRI APPVHFLQWKHQRGDOPHWD VWDWLFJURXSDQG APPVHFLQWKHQRGDOQRQPHWDVWDWLFJURXS3 VWDQGDUGHUURU&,WR7KH$'&FXWRIIYDOXHREWDLQHG E\WKH52&FXUYHLQRUGHUWRVKRZWKHEHVWVHSDUDWLRQEHWZHHQPHWDVWDWLFDQG QRQPHWDVWDWLFO\PSKQRGHVZDV APPVHF:LWKWKLVWKUHVKROGYDOXH WKHSDWLHQWEDVHGVHQVLWLYLW\VSHFLÀFLW\339DQG139RIWKH'Z05,ZHUH DQGUHVSHFWLYHO\ &RQFOXVLRQ':05,PD\EHXVHGWRGLIIHUHQWLDWHPHWDVWDWLFIURPQRQPHWDVWDWLF O\PSKQRGHVLQSDWLHQWVZLWKKLJKJUDGHEODGGHUFDQFHU % 'RHV863,2HQKDQFHGGLIIXVLRQZHLJKWHG05,HQKDQFHWKH GLDJQRVWLFDFFXUDF\RIO\PSKQRGHVWDJLQJLQQRUPDOVL]HGO\PSK QRGHVRISDWLHQWVVXIIHULQJSURVWDWHRUEODGGHUFDQFHU" -0)URHKOLFK07ULDQWDI\OORX'&KRQJ$)OHLVFKPDQQ) '%LUNKDHXVHU +&7KRHQ\%HUQH&+IURHKOLFK#NOXVDSRWKHNHFK 3XUSRVH7 RSURVSHFWLYHO\GHWHUPLQHZKHWKHUGLIIXVLRQZHLJKWHG05,':05, DIWHUWKHDGPLQLVWUDWLRQRIXOWUDVPDOOVXSHUSDUDPDJQHWLFLURQR[LGHQDQRSDUWLFOHV 863,2LQFUHDVHVWKHGLDJQRVWLFDFFXUDF\IRUWKHGHWHFWLRQRIPHWDVWDVHVLQQRUPDO VL]HGO\PSKQRGHVLQSDWLHQWVZLWKEODGGHUDQGRUSURVWDWHFDQFHU 0HWKRGVDQG0DWHULDOV6HYHQW\ÀYHSDWLHQWVIPPHDQDJHZLWKEODGGHU Q SURVWDWHFDQFHUQ RUERWKQ ZHUHH[DPLQHGSHURSHUDWLYHO\RQD 705XQLWEHIRUHDQGDIWHUDGPLQLVWUDWLRQRI863,26LQHUHP*XHUEHW7DQG 7ZHLJKWHG'76(6SDFHVHTXHQFHVRIWKHHQWLUHSHOYLVZHUHSHUIRUPHGEHVLGHV D[LDO(3,':05,ZLWKEYDOXHVVHFPPDIWHUVSDVPRO\VLVZLWK PJLYJOXFDJRQ6XVSLFLRXVK\SHULQWHQVLYHVWUXFWXUHVRQWKHSRVWFRQWUDVWKLJKE LPDJHVZHUHFRUUHODWHGZLWKPRUSKRORJLFDOSUHFRQWUDVWLPDJHVWRFKHFNZKHWKHU WKH\FRUUHVSRQGHGWRO\PSKQRGHV(DFKYLVXDOLVHGO\PSKQRGHGHSHQGLQJRQLWV PRUSKRORJ\ZDVUDWHGDVPDOLJQDQWRUEHQLJQ5HDGLQJVZHUHSHUIRUPHGE\WKUHH LQGHSHQGHQWEOLQGHGUHDGHUVDQGFRPSDUHGWRKLVWRSDWKRORJ\ 5HVXOWV,QSDWLHQWVO\PSKQRGHVPHDQQXPEHUSDWLHQWZHUHUH VHFWHGSRVLWLYHO\PSKQRGHPHWDVWDVHVZHUHGHWHFWHGLQSDWLHQWVZLWK QRGHVEH\RQGDVKRUWD[LVGLDPHWHURIPP5HDGLQJVRQDSDWLHQWOHYHO\LHOGHG DPHDQVHQVLWLYLW\RIVSHFLÀFLW\RISRVLWLYHSUHGLFWLYHYDOXHRI QHJDWLYHSUHGLFWLYHYDOXHRIDQGGLDJQRVWLFDFFXUDF\RI1RPHWDVWDVLV DERYHDVKRUWD[LVGLDPHWHURIPPZDVPLVVHG &RQFOXVLRQ863,2HQKDQFHG':05,DOORZVIRUKLJKHUGLDJQRVWLFDFFXUDF\LQ WKHGHWHFWLRQRIPHWDVWDVHVLQQRUPDOVL]HGO\PSKQRGHVLQSDWLHQWVZLWKEODGGHU DQGRUSURVWDWHFDQFHU % 8OWUDVPDOOSDUWLFOHVRILURQR[LGHHQKDQFHG05LPDJLQJRILVFKDHPLF DFXWHUHQDOIDLOXUHLQDUDWPRGHORQDFOLQLFDO7VFDQQHU +-0LFKDHO\8%HQFN8*RHWWPDQQ7 5XQJH%..UDHPHU6+DQHGHU 626FK|QEHUJ0DQQKHLP'(KHQULNPLFKDHO\#XPPGH 3XUSRVH7 R DVVHVV LI WKH QRYHO XOWUDVPDOOSDUWLFOHRILURQR[LGH 3 FDQ EH XVHGWRYLVXDOLVHLVFKDHPLFDFXWHUHQDOIDLOXUH,$5)LQDUDWPRGHO 0HWKRGV DQG 0DWHULDOV ,Q WKLV ,5%DSSURYHG VWXG\ /HZLVUDWV XQGHUZHQW WUDQVLHQWVXUJLFDOFOLSSLQJRIWKHOHIWUHQDODUWHU\IRUPLQKDIWHUWKHVXUJLFDO SURFHGXUHWKHUDWVZHUHLQMHFWHGPRONJ3*XHUEHWDQG05LPDJLQJ ZDVSHUIRUPHGDQRWKHUKDIWHUWKH3LQMHFWLRQ,PDJLQJZDVSHUIRUPHGRQD FOLQLFDO7VFDQQHU6LHPHQV7LP7ULRZLWKDGHGLFDWHGHOHPHQWUDWFRLO5DSLG %LRPHGLFDOZLWK7Z76(VHTXHQFHVLQFRURQDO757(PVDFTXLVLWLRQ WLPHPLQDQGD[LDOPVPLQRULHQWDWLRQZLWKLGHQWLFDODFTXLUHG % 8WLOLVDWLRQRIQHRQDWDOEUDLQ05,H[SHULHQFHYDULDWLRQDQG LPSOLFDWLRQVDVXUYH\VWXG\RI8.OHYHOQHRQDWDOXQLWV &6D\HU /9LWWD%ULJKWRQ8.+RYH8. 3XUSRVH7 RFRPSDUHWKHXVHH[SHULHQFHDQGYDULDWLRQRI05,IRUQHRQDWDOEUDLQ LPDJLQJLQOHYHOQHRQDWDOXQLWVLQ(QJODQG8. 0HWKRGVDQG0DWHULDOV$QHOHFWURQLFTXHVWLRQQDLUHZDVVHQWWRQHRQDWRORJLVWV ZRUNLQJLQDOOOHYHOXQLWV3DUWLFLSDQWVZHUHDVNHGTXHVWLRQVUHODWLQJWRWKHLU H[SHULHQFHRI05,LQGLFDWLRQVIRULWVXVHSUDFWLFDODVSHFWVVHTXHQFHVWLPLQJ DFFHVVDQGZDLWSURFHGXUHIRUUHSRUWLQJLPDJHVDQGXVHRI05,LQFRPSDULVRQ WRRWKHUWHVWV 5HVXOWVQ RIWKHVXUYH\SRSXODWLRQUHSUHVHQWLQJDOOVHSDUDWHXQLWV UHVSRQGHGKDGQRORFDOUHJLRQDOJXLGHOLQHV$VLJQLÀFDQWQXPEHU FODLPHGWKDWODFNRIFOHDUJXLGHOLQHVFRQWULEXWHVWRSURORQJHGZDLWIRU05,8OWUD VRXQGLVVWLOOXVHGDVWKHÀUVWOLQHLQWKHPDMRULW\RIXQLWV05,LVIUHTXHQWO\VHFRQG OLQHEDVHGRQVFDQQHUORFDWLRQVWDIÀQJLVVXHVDQGFRVWFRQVLGHUSURORQJHG ZDLWLQJ WLPHV WR EH D SUREOHP 7KHUH LV D VLJQLÀFDQW DVVRFLDWLRQ EHWZHHQ 05, DYDLODELOLW\DQGODFNRIJXLGHOLQHVZLWKDIDLOXUHWRXWLOLVHWKHRSWLPDOVHTXHQFHV DQGWLPLQJDVUHFRPPHQGHGLQWKHOLWHUDWXUH &RQFOXVLRQ7KLVLPSRUWDQWVXUYH\KLJKOLJKWVDFRQVLGHUDEOHYDULDWLRQLQSUDFWLFH DQG DYDLODELOLW\ 7KLV PD\ EH UHVXOWLQJ LQ GHOD\HG LPDJLQJ LQ FDVHV ZKHUH 05, LVYLWDOIRUGLDJQRVWLFDQGSURJQRVWLFLQIRUPDWLRQDVZHOODVVXERSWLPDOXVHRID PRGDOLW\WKDWKDVEHHQZHOOHVWDEOLVKHGLQWKHUHVHDUFKOLWHUDWXUH,WLVYLWDOWRHV WDEOLVKDPRUHXQLIRUPDQGUREXVWQHRQDWDOQHXURLPDJLQJSDWKZD\DQGWKLVZRUN LVDSRZHUIXOWRROIRUXQGHUVWDQGLQJFXUUHQWSUDFWLFHDQGZRUNLQJWRZDUGVDVHWRI QDWLRQDOJXLGHOLQHVIRUWKH8. 5RRP) *HQLWRXULQDU\ 66 *8JHPVDQGMHZHOV 0RGHUDWRUV 0$&RYD7ULHVWH,7 '<DNDU1LMPHJHQ1/ % 7HVWLVFDQFHU0'&7VWDJLQJZLWKKLVWRSDWKRORJLFDOFRUUHODWLRQ $02VERUQH'+DOSHQQ\3 %XUNH':*RRG:&7 RUUHJJLDQL 'XEOLQ,(/LPHULFN,(RVERUQHD#WFGLH 3XUSRVH7 R DVVHVV ZKHWKHU WHVWLV FDQFHU PHWDVWDVLVHV WR VSHFLÀF VLWHVXVLQJ 0'&7DFFRUGLQJWRVSHFLÀFSULPDU\KLVWRSDWKRORJLFDOGLDJQRVLV 0HWKRGVDQG0DWHULDOV $WHQ\HDUUHWURVSHFWLYHGDWDEDVHZDVFUHDWHGLQFOXGLQJ SDWLHQWVZKRXQGHUZHQWRUFKLHFWRP\IRUWHVWLFXODUWXPRXULQDVLQJOHLQVWLWXWLRQ $OO SDWLHQWVXQGHUZHQW0'&7WKRUD[DEGRPHQSHOYLV7KHKLVWRORJ\RIWKHSULPDU\ WXPRXUDQGWKHORFDWLRQRIDQ\PHWDVWDVHVSUHVHQWRQ0'&7ZHUHFDWHJRULVHG DQGUHFRUGHG'DWDDUHSUHVHQWHGDVPHGLDQLQWHUTXDUWLOHUDQJH,45DQGORJLVWLF UHJUHVVLRQDQDO\VLVZDVXVHGWRLGHQWLI\ULVNIDFWRUV 5HVXOWVSDWLHQWVZHUHLGHQWLÀHG7KHPHGLDQ,45DJHZDV\HDUV RISDWLHQWVKDGQRGDOPHWDVWDVLVDWWKHWLPHRIGLDJQRVLVZLWK DQG KDYLQJ SHOYLF DEGRPLQDO DQG VXSUDGLDSKUDJPDWLF QRGDO PHWDVWDVLV UHVSHFWLYHO\KDGVROLGRUJDQPHWDVWDVLVDWGLDJQRVLV,QGHSHQGHQWULVNIDF WRUVIRUDEGRPLQDOQRGDOPHWDVWDVLVLQFOXGHGKDYLQJDWHUDWRPD+5 &,3 DQGKDYLQJDQ/'+RYHUDWGLDJQRVLV+5 &,3 ,QGHSHQGHQWULVNIDFWRUVIRUVXSUDGLDSKUDJPDWLFQRGDO PHWDVWDVLVLQFOXGHGKDYLQJDPL[HGWXPRXU+53 DQGKDYLQJDћ+&*RYHUP/P/DWGLDJQRVLV+5&, 3 &RQFOXVLRQ5HVXOWVLQGLFDWHWKDWWKHSDWWHUQRIPHWDVWDVLVFDQYDU\DFFRUGLQJ WRKLVWRORJLFDOVXEW\SHDQGVWDJLQJRIWXPRXU5HVXOWVVXJJHVWWKDWSDWLHQWVZKR SUHVHQWZLWKPL[HGWHVWLVWXPRXUVDQGSDWLHQWVZLWKDVHUXPћ+&*RYHUP/,8 P/VKRXOGXQGHUJR&7WKRUD[DVSDUWRIVWDJLQJRIGLVHDVH 6FLHQWLILF6HVVLRQ $ 6&'()*+%(XURSHDQ&RQJUHVVRI 5DGLRORJ\ 0RQGD\ % 5HDOWLPHFRPSUHVVLRQHODVWRJUDSK\RIWKHSHULSKHUDO]RQHSURVWDWLF FDQFHUWKHLPSDFWLQLPSURYLQJWKHGLDJQRVWLFDSSURDFK *=DFKDURSRXORV6<DUPHQLWLV0DURXVVL*5VS\URV\DUPHQLWLV#JPDLOFRP 3XUSRVH 7 R HYDOXDWH WKH SHUIRUPDQFH RI UHDOWLPH FRPSUHVVLRQ HODVWRJUDSK\ 57&(LQWKHGLDJQRVWLFDSSURDFKRIWKHSHULSKHUDO]RQHSURVWDWLFFDQFHU 0HWKRGVDQG0DWHULDOV6L[W\WKUHHPDOHLQGLYLGXDOVZHUHH[DPLQHGZLWKERWKE PRGH7UDQV5HFWDO8OWUDVRXQG7586DQG57&(XVLQJD+LWDFKL3UHLUXVPDFKLQH (ODVWLFSURSHUWLHVRIWKH3HULSKHUDO]RQHZHUHFODVVLÀHGDVQRUPDOWLIIQHVV LQKRPRJHQHRXVLQFRQFOXVLYHIRFDOOHVLRQVRI,QFUHDVHGVWLIIQHVV7KH7586 ÀQGLQJVZHUHFDWHJRULVHGDVQRIRFDOOHVLRQLOOGHÀQHGIRFDOOHVLRQDQG GHÀQLWHIRFDOOHVLRQ,QSDWLHQWVFRUHELRSVLHVZHUHWDNHQ7KHUHVW SDWLHQWVKDGFRUHELRSVLHV8OWUDVRXQGÀQGLQJVZHUHFRPSDUHGWRWKHUHVXOWV RIWKHFRUHELRSVLHV 5HVXOWV1LQHWHHQRISDWLHQWVZHUHIRXQGZLWKSRVLWLYHVSHFLPHQVIRU SURVWDWLFFDQFHU6HQVLWLYLW\RISURVWDWHFDQFHUGHWHFWLRQZDVIRUWKH 57&(DQGIRUEPRGH758657&(VFRUHZDVIRXQGLQSDWLHQWV RIZKRPQRQHIRXQGZLWKFDQFHUVFRUHZDVGHWHFWHGLQSDWLHQWVRIZKRP KDGFDQFHUDQGVFRUHZDVDVVHVVHGLQSDWLHQWVRIZKRPKDGFDQFHU,Q GHWHUPLQDWHVFRUH7586FDVHVZHUHIRXQGLQSDWLHQWVRIZKRPKDG57&( VFRUHDQGQHJDWLYHFRUHELRSV\IRUFDQFHU &RQFOXVLRQ57&(FRQVLGHUDEO\LPSURYHVWKHGLDJQRVWLF\LHOGRI7586LQGHWHFWLQJ SHULSKHUDO]RQHSURVWDWLFFDQFHU % 'LDJQRVWLFUROHRI&7SHUIXVLRQLQWKHPDQDJHPHQWRISDWLHQWV DIIHFWHGE\SURVWDWHFDQFHU 02VLPDQL'%HOOLQL'&DUXVR'*LDQVDQWH$/DJKL/DWLQD,7 3XUSRVH 7 R GHÀQH WKH UROH RI &7 SHUIXVLRQ LQ WKH HYDOXDWLRQ RI SDWLHQWV ZLWK SUREDEOHSURVWDWHFDQFHU 0HWKRGVDQG0DWHULDOV$OOSDWLHQWVHQUROOHGXQGHUZHQW&7SHUIXVLRQH[DP IROORZHG E\ UDGLFDO SURVWDWHFWRP\ DQG KLVWRSDWKRORJLFDO DQDO\VLV RI SURVWDWH ,Q SURVWDWLFDUHDVDYDLODEOHZHFDOFXODWHGQXPHULFDOYDOXHVRISHUIXVLRQLQGLFHV EORRGÁRZEORRGYROXPHPHDQWUDQVLWWLPHDQGSHUPHDELOLW\VXUIDFHDUHDSURGXFW E\SHUIXVLRQDQDO\VLVDQGWKHW\SHRIOHVLRQLQHDFKDUHDVE\LPPXQRKLVWRORJLFDO DVVHVVPHQW7KHQZHKDGFRUUHODWHGWKHGDWDZHKDGGHÀQHGWKHWKUHVKROGYDO XHVIRUHDFKSHUIXVLRQLQGH[DQGZHKDGREWDLQHGYDOXHVRIGLDJQRVWLFDFFXUDF\ 5HVXOWV$PRQJWKHDUHDVDIIHFWHGE\FDQFHUDQGQRQQHRSODVWLFDUHDVZHRE WDLQHGVWDWLVWLFDOO\VLJQLÀFDQWGLIIHUHQFHVLQ%9DQG36S7KHDQDO\VLVUH YHDOHGWKDWIRUWKHWKUHVKROGYDOXHVFRQVLGHUHG&7SKDVERXJKWKLJKVSHFLÀFLW\6S DQGQHJDWLYHSUHGLFWLYHYDOXH1396SRIDQG139RIIRU36!P/ PLQJ6SRIDQG139RIIRU%)!P/PLQJ6SRIDQG 139RIIRU%9!P/J6SRIDQG139RIIRU077!VHF &RQFOXVLRQ5HVXOWVREWDLQHGGHPRQVWUDWHGWKDW&7SFDQEHXVHGIRUWKHH[FOX VLRQRISURVWDWHFDQFHULQGRXEWIXODUHDVKLJK139DQG6S % 6HOHFWLYHDUWHULDOHPEROLVDWLRQRIV\PSWRPDWLFJLDQWUHQDO DQJLRP\ROLSRPDHIÀFDF\FRPSOLFDWLRQVDQGORQJWHUPRXWFRPHV 0$ERX(O*KDU$(O$VVP\+5HIDLH7 (O'LDVW\0DQVRXUD(* PDERHOJKDU#\DKRRFRP 3XUSRVH7 RDVVHVVWKHHIÀFDF\FRPSOLFDWLRQVDQGORQJWHUPRXWFRPHRIVHOHFWLYH DUWHULDOHPEROLVDWLRQ6$(IRUWUHDWPHQWRIJLDQWDQJLRP\ROLSRPD$0/!FP 0HWKRGVDQG0DWHULDOV7KHVXUJLFDOUHFRUGVRISDWLHQWVZLWKJLDQW$0/PDQ DJHG E\ 6$( EHWZHHQ DQG ZHUH UHYLHZHG 'DWD FROOHFWHG LQFOXGHG SUHDQGSRVWWUHDWPHQW $0/VL]HFUHDWLQLQHOHYHOWHFKQLFDOVXFFHVVFRPSOLFDWLRQV DQGORQJWHUPFOLQLFDOVXFFHVV 5HVXOWV2XUVWXG\LQFOXGHGPHQDQGZRPHQRIWKHPKDGWXEHU RXVVFOHURVLV76FRPSOH[7KHWXPRXUZDVELODWHUDOLQDQGPHDQVL]HRI $0/OHVLRQVZDVFP,QGLFDWLRQVRI6$(ZHUHSUHRSHUDWLYHWRDYRLGULVNRI KDHPRUUKDJHGXULQJQHSKUHFWRP\LQSDWLHQWVDQGWRVWRSVHYHUHKDHPDWXULDLQ WKH UHPDLQLQJ $PRQJ SDWLHQWV ZLWK SUHVHUYHG NLGQH\V HDUO\ FRPSOLFDWLRQV RFFXUUHGLQLQFOXGLQJSRVWHPEROLVDWLRQ V\QGURPHLQSDWLHQWUHFXUUHQW KDHPDWXULDQHFHVVLWDWLQJQHSKUHFWRP\LQDQGDFXWHUHQDOIDLOXUHLQ(YHQWX DOO\SDWLHQWVSUHVHUYHGWKHLUNLGQH\VZLWKPHDQIROORZXSSHULRGRI \HDUV'XULQJIROORZXSUDGLRORJ\VKRZHGGHFUHDVHLQVL]HRIWKHOHVLRQVLQ RIFDVHVUHPDLQHGVWDEOHLQDQGLQFUHDVHGLQDQRWKHU'XULQJIROORZXS RISDWLHQWVKDGUHFXUUHQWKDHPDWXULDZKLFKPDQDJHGFRQVHUYDWLYHO\DQGDOO SDWLHQWVKDGDVWDEOHVHUXPFUHDWLQLQH VSDWLDOUHVROXWLRQRI[[PPó6LJQDOWRQRLVHPHDVXUHPHQWV615ZHUH SHUIRUPHGLQWKHFRUWH[PHGXOODDQGS\HORQRIWKH,$5)NLGQH\DQGWKHFRQWUDODWHUDO NLGQH\DVLQWHUQDOFRQWURO,PPHGLDWHO\DIWHUWKH05H[DPWKHUDWVZHUHVDFULÀFHG IRUKLVWRORJ\DQGLPPXQRODEHOOLQJ 5HVXOWV$SSDUHQWGLIIHUHQFHVEHWZHHQWKH,$5)NLGQH\VDQGFRQWUROVZHUHHQ FRXQWHUHG6LJQDOGURSZDVPDLQO\VHHQLQWKHPHGXOODRIWKH,$5)NLGQH\V7KH 615RIWKH,$5)YVFRQWUROFRUWH[YVS PHGXOODYV SDQGS\HORQYVS ,QDOO,$5)NLGQH\VWKHKLVWRORJ\ FRQÀUPHGWKHSUHGRPLQDQWO\PHGXOODU\SUHVHQFHRIDEXQGDQWLURQDQG('SRVLWLYH PDFURSKDJHVDQGW\SLFDOFKDQJHVRI,$5)ZKLOHEHLQJQRUPDOLQWKHFRQWUROJURXS &RQFOXVLRQ 3 VHHPV WR EH D VXLWDEOH FRQWUDVW DJHQW WR QRQLQYDVLYHO\ GHWHFW,$5)LQDUDWPRGHOZLWKJRRGFRUUHODWLRQWRKLVWRORJ\7KLVVXJJHVWVWKDW 3HQKDQFHG05LPDJLQJKROGVSURPLVHIRUQRQLQYDVLYHDVVHVVPHQWRIUHQDO SDUHQFK\PDOGLVHDVHV % 6RQRHODVWRJUDSK\LQSDWLHQWVZLWKHQGRPHWULRVLVRIGLIIHUHQWORFDWLRQ 1$9RURQWVRYD9(*D]KRQRYD62&KXUNLQD(%6DYLQRYD ,$3RQRPRUHQNR$9=XEDUHY0RVFRZ58YRUQDG#ENUX 3XUSRVH7KHDLPRIWKLVVWXG\ZDVWRDVVHVVWKHXVHIXOQHVVRI6(VRQRHODVWRJ UDSK\IRUHYDOXDWLRQRISDWLHQWVZLWKHQGRPHWULRVLV 0HWKRGVDQG0DWHULDOVFRQVHFXWLYHSWVZLWKSHOYLFSDLQG\VPHQRUUKRHD XULQDU\V\PSWRPVUDQJH\HDUVZLWKVXVSHFWHGGLDJQRVLVRIHQGRPHWULRVLV ZHUH UHIHUUHG IRU 6($OO SDWLHQWV XQGHUZHQW FRQYHQWLRQDO 86 DQG 6( RQ +, 9,6,21 3UHLUXV ZLWK DQ HQGRFDYLW\ WUDQVGXFHU 0+] IUHTXHQF\ DQG OLQHDU WUDQVGXFHUIUHTXHQF\0+]:HXVHGPRGLÀHG7 VXNXED6(FODVVLÀFDWLRQ IRUHYDOXDWLRQRIWKH6(GDWDGLDJQRVWLFELRSV\GLDJQRVWLFODSDURVFRSLHV VHSDUDWHGLDJQRVWLFVFUDSLQJZHUHSHUIRUPHGZLWKPRUSKRORJLFDOVWXG\RIWKH UHFHLYHGPDWHULDO86GDWDFRQYHQWLRQDO%PRGH86DQJLRJUDSK\DQG6(ZHUH DVVHVVHGE\FRPSDULQJWKHÀQGLQJVZLWKVXUJHU\UHVXOWVDQG05,GDWD86GDWD ZHUHUHWURVSHFWLYHO\UHYLHZHGE\UDGLRORJLVWV,QWHUREVHUYHUDJUHHPHQWIRUHQ GRPHWULRVLV6(VFRUHORFDWLRQRIHQGRPHWULRVLVXWHULQHRYDULXPFHUYL[XULQDU\ EODGGHUҋVZDOOVRIWWLVVXHHQGRPHWULRVLVORFDWLRQE\ZDOOVRIWKHXWHUXV05,GDWD 5HVXOWV 3DWKRPRUSKRORJLFDO H[DPLQDWLRQ UHYHDOHG HQGRPHWULRWLF F\VWV HQGRPHWULRVLVWKHXWHULQHZDOOHQGRPHWULDOSRO\SVHQGRPHWULRVLVRIXULQDU\ EODGGHUҋVZDOODQGHQGRPHWULDOLQÀOWUDWLRQVRISHOYLFVRIWWLVVXH(QGRPHWULRVLV ZDVFKDUDFWHULVHGE\UHYHUVHGVFRUHVFRUHDQGVFRUHRI7VXNXEDFODVVLÀFD WLRQIRUOHVLRQVRQ6(6(VKRZHGJRRGWRPRGHUDWHLQWHUREVHUYHUDJUHHPHQWIRU HQGRPHWULRVLVHYDOXDWLRQE\VFRULQJN IRUHQGRPHWULRVLVORFDWLRQVE\ ZDOOVRIWKHXWHUXVN IRUORFDWLRQVRIHQGRPHWULRVLVE\RUJDQVN SRRUWRPRGHUDWHLQWHUREVHUYHUDJUHHPHQWIRUHQGRPHWULRVLVHYDOXDWLRQ E\05,GDWDN &RQFOXVLRQ86ZLWK6(RIIHUVDQHZSRVVLELOLW\IRUGHÀQLWLRQRIHQGRPHWULRVLV % 3RVVLELOLWLHVRIUHDOWLPHVRQRHODVWRJUDSK\LQORFDOVWDJLQJRI HQGRPHWULDOFDQFHU ,6%HOR]HURYD9(*D]KRQRYD62&KXUNLQD$//R]RYDWRU 7 6.XUJDQVND\D$9=XEDUHY0RVFRZ58QLEHOR]HURY#\DQGH[UX 3XUSRVH3RVVLELOLWLHVRIVRQRHODVWRJUDSK\6(LQORFDOVWDJLQJRIHQGRPHWULDO FDQFHU 0HWKRGVDQG0DWHULDOVSWVZLWKSURYHQ(&XQGHUZHQWUHDOWLPHVRQRHODV WRJUDSK\EHIRUHVXUJHU\DJHUDQJH\R86H[DPVZHUHSHUIRUPHGRQ+, 9,6,213UHLUXVDQG+,9,6,21+LWDFKL0HGLFDO&RUSRUDWLRQ:HXVHG),*2 FODVVLÀFDWLRQIRUORFDOVWDJLQJ(&86GDWDZHUHFRPSDUHGZLWKÀQDOKLVWRSDWKRORJ\ 7KHVWXG\ZDVUHFRUGHGDQGHYDOXDWHGE\LQGHSHQGHQWUHDGHUV,QWHUREVHUYHU DJUHHPHQWIRUWXPRXUҋVORFDWLRQE\ZDOOVDQWHULRUSRVWHULRUIXQGXVULJKWOHIW P\RPHWULDOLQYDVLRQOHVVWKDQôPRUHWKDQôFHUYLFDODQGFDSVXODULQYROYHPHQW ZHUHVWXGLHG6HQVLWLYLW\RI6(LQORFDOVWDJLQJZDVHVWDEOLVKHG 5HVXOWV$OO SDWLHQWV KDYH EHHQ RSHUDWHG WRWDO K\VWHUHFWRPLHV UDGLFDO K\VWHUHFWRPLHV ZLWK O\PSK QRGH GLVVHFWLRQ +LVWRSDWKRORJ\ UHYHDOHG VWDJH ,$VWDJH,%VWDJH,,$,,%VWDJH,,,$VWDJH7KHVHQVLWLYLW\RI6(IRUORFDO VWDJLQJRI(&VWDJH,$VWDJH,%VWDJH,,$VWDJH,,% VWDJH,,,$7KH.DSSDYDOXHEHWZHHQ6(DQGORFDWLRQE\ZDOOVZDVSRRU NUDQJHGWREHWZHHQ6(DQGP\RPHWULDOLQYDVLRQZDVJRRGNUDQJHG WRDQGEHWZHHQ6(DQGFHUYLFDOLQYDVLRQZDVSRRUWRRN6( LQFUHDVHGWKHVHQVLWLYLW\RI86IURPWRDQGVSHFLÀFLW\IURPWR LQORFDOVWDJLQJ(& &RQFOXVLRQ,QFOXVLRQRI6(LQFRPSOH[XOWUDVRXQGVFDQQLQJPD\KHOSWRHYDOXDWH P\RPHWULDOLQYDVLRQLQSWVZLWK(& 6FLHQWLILF6HVVLRQ 6 &$' ( ) *+% (XURSHDQ&RQJUHVVRI 5DGLRORJ\ DSSO\LQJSUHGHÀQHG05PDPPRJUDSK\GHVFULSWRUV2XWRIWKLVGDWDEDVHDOO SDWLHQWV VKRZLQJ ,3 Q RU PDOLJQDQW EUHDVWOHVLRQV Q XSRQ VXUJLFR SDWKRORJLFDOYHULÀFDWLRQZHUHIXUWKHUHYDOXDWHGVWDWLVWLFDOO\8QLYDULDWHDVVRFLDWLRQ RIVLQJOHGHVFULSWRUVZLWK,3EUHDVWFDQFHUFRQWLQJHQF\WDEOHVVWDWLVWLFVDVZHOODV PXOWLYDULDWHDQDO\VHVZHUHSHUIRUPHGWRLGHQWLI\DFFXUDWHGHVFULSWRUFRPELQDWLRQV &KLVTXDUHG$XWRPDWLF,QWHUDFWLRQ'HWHFWLRQ >&+$,'@ DQG RYHUDOODFFXUDF\ RI 05PDPPRJUDSK\ IRU GLIIHUHQWLDOGLDJQRVLV RI ,3 YV PDOLJQDQW EUHDVWOHVLRQV ORJLVWLFUHJUHVVLRQ UHFHLYHURSHUDWLQJFKDUDFWHULVWLFV >52&@ DUHDXQGHUWKH 52&FXUYH>$8&@ 5HVXOWVRI05PDPPRJUDSK\GHVFULSWRUVZHUHVLJQLÀFDQWO\DVVRFLDWHG ZLWK,3Q 3$FFXUDF\RIVLQJOHGHVFULSWRUVRGGҋVUDWLR>25@ FRXOG EH IXUWKHU LQFUHDVHG E\ GHVFULSWRUFRPELQDWLRQV GRXEOHFRPELQDWLRQ 25WULSOHFRPELQDWLRQ25:LWK $8& FRQÀGHQFHLQWHUYDOO 3ORJLVWLFUHJUHVVLRQLGHQWLÀHGKLJKRYHUDOODFFXUDF\RI05 PDPPRJUDSK\IRUWKHGLIIHUHQWLDOGLDJQRVLVRI,3 &RQFOXVLRQ 'HWDLOHG DVVHVVPHQW RI 05PDPPRJUDSK\ DOORZV SUHFLVH FKDU DFWHULVDWLRQ RI EHQLJQ LQWUDGXFWDOSDSLOORPDV DQG DFFXUDWH GLIIHUHQWLDWLRQ IURP PDOLJQDQWEUHDVWOHVLRQV % 5HDGLQJ05PDPPRJUDSK\EHWZHHQWKHOLQHVLVWKH´FRQVWDQW VKDUSQHVVµDXVHIXOWRROIRUSUHGLFWLRQRIEHQLJQLW\",QWURGXFWLRQ GLDJQRVWLFDFFXUDF\DQGVXEJURXSDQDO\VLVRIDQHZGHVFULSWRU 0'LHW]HO5=RXEL7 *URHVFKHO+3 %XUPHLVWHU0*DMGD,%5XQQHEDXP :$.DLVHU3 $7 %DOW]HU-HQD'(GLHW]HOPDWWKLDV #KRWPDLOFRP 3XUSRVH$FFXUDWHFODVVLÀFDWLRQRIEHQLJQOHVLRQVLQ05PDPPRJUDSK\050 FDQEHFKDOOHQJLQJDQGIXUWKHUGHVFULSWRUVPLJKWKHOSWRVROYHWKLVSUREOHP:H SHUIRUPHGDUHWURVSHFWLYHFDVHUHYLHZDQGLGHQWLÀHG´FRQVWDQWVKDUSQHVVµ&6DV DXVHIXOQHZ050GHVFULSWRUWRSUHGLFWEHQLJQLW\3RVLWLYH&6LVGHÀQHGDVDOHVLRQ ZLWKVPRRWKDQGVKDUSPDUJLQVZKLFKDUHFRQVLVWHQWO\SUHVHQWGXULQJWKHZKROH G\QDPLFVHULHVIURPWKHÀUVWWRWKHODVWVFDQ7KHQZHFRQGXFWHGDSURVSHFWLYH FURVVVHFWLRQDOLQYHVWLJDWLRQWRDQDO\VHGLDJQRVWLFDFFXUDF\RI&6IRUGLIIHUHQWLDO GLDJQRVLVRIEHQLJQYVPDOLJQDQWOHVLRQV 0HWKRGV DQG 0DWHULDOV FRQVHFXWLYH SDWLHQWV H[FOXVLRQ EUHDVWWKHUDS\ PRQWKV EHIRUH 050 ZLWK KLVWRORJLFDOO\ YHULÀHG EUHDVWOHVLRQV LPDJHG E\ 050DFFRUGLQJWRVWDQGDUGSURWRFROVG\QDPLF*5(7ZVFDQVDIWHUFRQWUDVW DJHQW>PPRONJEZ*G'73$@DWPLQXWHLQWHUYDOVRYHUPLQXWHV$OO050 ZHUHUHDGSURVSHFWLYHO\E\WZRH[SHULHQFHG!050DQGEOLQGHGUHDGHUVLQ FRQVHQVXV)LQDOO\&6ZDVFRUUHODWHGZLWKKLVWRORJ\UHVXOWVFURVVWDEOHVѯWHVW 5HVXOWV&6ZDVDVLJQLÀFDQWSUHGLFWRURIEHQLJQLW\3!,WZDVW\SLFDOO\ DVVRFLDWHGZLWKÀEURDGHQRPDVDQGSDSLOORPDV)DOVHQHJDWLYH FDVHVZHUHUDUHDQG&6DFFXPXODWHGZLWKLQLQYDVLYHSDSLOODU\DQGLQYDVLYH PXFLQRXV FDQFHUV DV ZHOO DV ORZJUDGH WXPRXUV * 2YHUDOO DFFXUDF\UHYHDOHGVHQVLWLYLW\RIFRQÀGHQFHLQWHUYDO&, KLJK VSHFLÀFLW\ &, 2GGVUDWLR &, DQG SRVLWLYHOLNHOLKRRGUDWLR/&, &RQFOXVLRQ´&RQVWDQWVKDUSQHVVµVL[IROGLQFUHDVHVWKHOLNHOLKRRGRIEHQLJQLW\LQ 0507KLVDFFXUDWH050GHVFULSWRULVW\SLFDOO\VHHQLQÀEURDGHQRPDVDQGSDSLO ORPDVZKHUHDVIDOVHSRVLWLYHVDUHXQFRPPRQDQGLQFOXGHUDUHKLVWRSDWKRORJLHV LQYDVLYHSDSLOODU\PXFLQRXVFDUFLQRPDDQGORZJUDGHFDQFHUV* % 0DJQHWLFUHVRQDQFHLPDJLQJIRUDVVHVVLQJD[LOODU\O\PSKQRGH VWDWXVLQEUHDVWFDQFHUSDWLHQWV (%XÀ0&RVWDQWLQL3 %HOOL***LDUGLQD3 5LQDOGL*)UDQFHVFKLQL 50DVHWWL/%RQRPR5RPH,7UHDJDQGXV#DOLFHLW 3XUSRVH $OWKRXJKPDJQHWLFUHVRQDQFHLPDJLQJ05,LVLQGLFDWHGIRUSUHRSHUDWLYH EUHDVWFDQFHUVWDJLQJDVVHVVPHQWRIWKHD[LOODHLVQRWURXWLQHO\SHUIRUPHG2XU DLPZDVWRLQYHVWLJDWHWKHDELOLW\RI05,LQSUHGLFWLQJD[LOODU\O\PSKQRGHVWDWXV LQEUHDVWFDQFHUSDWLHQWV 0HWKRGVDQG0DWHULDOV:ULWWHQLQIRUPHGFRQVHQWDQGERDUGDSSURYDOZHUHRE WDLQHG$UHWURVSHFWLYHDQDO\VLVRIEUHDVWFDQFHUSDWLHQWVXQGHUJRLQJ05,EHIRUH VXUJHU\IURP-DQXDU\WR-XQHZDVSHUIRUPHG7ZRH[SHULHQFHGUDGL RORJLVWVEOLQGHGWRWKHKLVWRSDWKRORJLFÀQGLQJVDQDO\VHGVL]HVKRUWD[LVORQJHVW D[LVWRVKRUWHVWD[LVUDWLRDQGPRUSKRORJLFDOIHDWXUHVSUHVHQFHDEVHQFHRIIDWW\ KLOXPDEQRUPDOFRUWH[RID[LOODU\O\PSKQRGHV3DWLHQWVZHUHGLYLGHGLQWRWZR JURXSVDFFRUGLQJWRWKHÀQDOSDWKRORJLFD[LOODU\VWDWXVSUHVHQFHDEVHQFHRIO\PSK QRGHVPHWDVWDVHV6HQVLWLYLW\VSHFLÀFLW\SRVLWLYHDQGQHJDWLYHSUHGLFWLYHYDOXHRI 05,LQSUHGLFWLQJO\PSKQRGHVWDWXVZHUHREWDLQHG 5HVXOWV2XWRIEUHDVWFDQFHUSDWLHQWVZHUHHQUROOHG+LVWRSDWKRORJLFUH VXOWVUHYHDOHGQRGHSRVLWLYHSDWLHQWV/\PSKQRGHLQYROYHPHQWZDVVXVSHFWHG &RQFOXVLRQ6$(RIJLDQWUHQDO $0/VFDQEHGRQHVDIHO\WRVWRSEOHHGLQJLQPDQ\ FDVHV$GGLWLRQDOWUHDWPHQWPD\EHQHFHVVDU\LQRISDWLHQWVDQGSUHVHUYDWLRQ RILQYROYHGNLGQH\VLVDPHQDEOHLQRIFDVHV % (YDOXDWLRQRIG\QDPLFFRQWUDVWHQKDQFHG05XURJUDSK\'&( 058IRUWKHGHWHUPLQDWLRQRIWKHVSOLWUHQDOIXQFWLRQLQFKURQLF DQGLQWHUPLWWHQWXULQDU\REVWUXFWLRQLQFRPSDULVRQWRGLXUHWLFUHQDO VFLQWLJUDSK\'56UHVXOWVRIDSURVSHFWLYHPXOWLFHQWUHVWXG\ 0&ODXGRQ ('XUDQG) *XLOOHPLQ(0LFDUG1*UHQLHU 3 &KDXPHW5LIIDXG&3DVTXLHU*6HEDJ.&KDXPRLWUH 9DQGRHXYUHOHV1DQF\)56WUDVERXUJ)5%RUGHDX[)5 /H.UHPOLQ%LFHWUH)53DULV)50DUVHLOOH)5PFODXGRQ#FKXQDQF\IU 3XUSRVH7 RFRPSDUHG\QDPLFFRQWUDVWHQKDQFHG05XURJUDSK\'&(058DQG UHQDOVFLQWLJUDSK\IRUGHWHUPLQDWLRQRIWKHVSOLWUHQDOIXQFWLRQ65)LQFKURQLFDQG LQWHUPLWWHQWXULQDU\REVWUXFWLRQ82 0HWKRGV DQG 0DWHULDOV FKLOGUHQ DQG DGXOWV SUHVHQWLQJ ZLWK FKURQLF RU LQWHUPLWWHQW82ZHUHLQFOXGHGLQFHQWUHV'&(058FRQVLVWHGRIDG\QDPLF FRURQDO 7ZHLJKWHG VHTXHQFH UHSHDWHG IRU PLQXWHV DIWHU DGPLQLVWUDWLRQ RI GLXUHWLFVDQG*GFKHODWHPONJ'LXUHWLFUHQDOVFLQWLJUDSK\ZDVSHUIRUPHG ZLWKLQ WZR PRQWKV 058 DQG VFLQWLJUDSK\ GDWD IURP SDWLHQWVZHUH MXGJHG LQDEOLQGUHYLHZE\DSDQHORISUDFWLWLRQHUVWKHQH[SHUWVRIHDFKVSHFLDOW\ UDGLRORJ\DQGQXFOHDUPHGLFLQH)RU'&(058VLJQDOLQWHQVLW\WLPHFXUYHVZHUH REWDLQHGIURP52,VRQUHQDOSDUHQFK\PDDQGDRUWD65)ZDVFDOFXODWHGVXFFHV VLYHO\E\WKHDUHDXQGHUWKHFXUYH$8&DQG3DWODN5XWODQG35PHWKRGVDIWHU QRUPDOLVDWLRQE\SDUHQFK\PDOYROXPH5HSURGXFLELOLW\ZDVDVVHVVHGIRULQWUDDQG LQWHUREVHUYHUDJUHHPHQW 5HVXOWV5HSURGXFLELOLW\ZDVJRRGWRH[FHOOHQWIRUERWKPHWKRGVZLWKѣYDOXHV UDQJLQJIURPWRIRUVFLQWLJUDSK\DQGWRIRU'&(058DQGLP SURYHGZLWKWKHH[SHUWUHYLHZ $WWKHJURXSOHYHOHTXLYDOHQFHEHWZHHQ'&(058 DQGVFLQWLJUDSK\ZDVGHPRQVWUDWHGIRUFDOFXODWLRQRI65)ZLWKERWK35S DQG$8&S PHWKRGV7KHGLVWULEXWLRQRIGLIIHUHQFHVIROORZHGD*DXVVLDQ ODZ&,>@8QGHUHVWLPDWLRQRI65)E\'&(058ZDVREVHUYHGLQ VHYHUHK\GURQHSKURVLV &RQFOXVLRQ65)HVWLPDWHGE\'&(058LQREVWUXFWHGNLGQH\VZDVUHSURGXF LEOHDQGHTXLYDOHQWWRWKDWRQHPHDVXUHGE\ZLWKUHQDOVFLQWLJUDSK\DWWKHJURXS OHYHOEXWZLWKLQGLYLGXDOGLIIHUHQFHV'&(058SURYLGHVERWKPRUSKRORJLFDQG IXQFWLRQDOLQIRUPDWLRQLQ82 5RRP) %UHDVW 66 05,GLDJQRVLVDQGVXUJLFDOVHWWLQJV 0RGHUDWRUV 0/REEHV0DDVWULFKW1/ 56DOYDGRU%DUFHORQD(6 % 3RWHQWLDORI05PDPPRJUDSK\IRUWKHGLIIHUHQWLDOGLDJQRVLVRI LQWUDGXFWDOSDSLOORPDV 0'LHW]HO5=RXEL+3 %XUPHLVWHU7 *URHVFKHO 05*DMGD,%5XQQHEDXP:$.DLVHU3 $7 %DOW]HU -HQD'(GLHW]HOPDWWKLDV #KRWPDLOFRP 3XUSRVH (YHQ XSRQ FRUH ELRSV\ DFFXUDWH FODVVLÀFDWLRQ RI EHQLJQ LQWUDGXFWDO SDSLOORPDV,3FDQEHGLIÀFXOW $FFRUGLQJO\,3DUHVWLOOIUHTXHQWO\VXUJLFDOO\UHVHFWHG 7KHUHIRUH DFFXUDWH DVVHVVPHQW RI ,3 E\ 05PDPPRJUDSK\ ZRXOG SRWHQWLDOO\ RSWLPLVH SDWLHQW PDQDJHPHQW +RZHYHU WKH IHZ LQYHVWLJDWLRQV DVVHVVLQJ 05 PDPPRJUDSK\RI,3LQFOXGHGVPDOOSDWLHQWFROOHFWLYHVDQGRYHUDOODFFXUDF\RIWKLV PRGDOLW\UHJDUGLQJWKHGLIIHUHQWLDOGLDJQRVLVRI,3LVVWLOOXQNQRZQ:HSHUIRUPHG WKLV LQYHVWLJDWLRQ WR DQDO\VH PRUSKRORJLF DQG G\QDPLF 05PDPPRJUDSK\ SUR ÀOHVRI,3LQGHSWKDQGWRLGHQWLI\WKHRYHUDOODFFXUDF\RI05PDPPRJUDSK\IRU GLIIHUHQWLDOGLDJQRVLVRI,3IURPPDOLJQDQWEUHDVWOHVLRQV 0HWKRGVDQG0DWHULDO&RQVHFXWLYHSDWLHQWVUHFHLYLQJVWDQGDUGLVHG05PDPPRJ UDSK\VWDQGDUGLVHGVFDQQLQJSURWRFROVG\QDPLF7Z*5(EHIRUHDIWHU*G'73$ > PPRONJ%:@ 7Z76( ZLWK VXEVHTXHQW VXUJLFRSDWKRORJLFDOYHULÀFDWLRQ ZHUHHQUROOHG)RUWKHGHWDLOHGDVVHVVPHQWRIPRUSKRORJLFDQGG\QDPLFSURÀOHV WZRH[SHULHQFHGUDGLRORJLVWV!H[DPLQDWLRQVEOLQGHGWRVXUJLFRSDWKRORJLFDO YHULÀFDWLRQSHUIRUPHGSURVSHFWLYHHYDOXDWLRQRI05PDPPRJUDSK\LQFRQVHQVXV 6FLHQWLILF6HVVLRQ $ 6&'()*+%(XURSHDQ&RQJUHVVRI 5DGLRORJ\ 0RQGD\ % 'HWHFWLRQRILQFLGHQWDOYHUWHEUDOIUDFWXUHVE\05ORFDOLVHULQEUHDVW LPDJLQJ $%D]]RFFKL3 6SLQQDWR**DU]LOOR) &LFFDUHVH) )X]]L/0LJOLR /6DQWLOOL60LJQDQL%RORJQD,7JJDU]LOOR#\DKRRLW 3XUSRVH9HUWHEUDOIUDFWXUHV9)VDUHWKHKDOOPDUNRIRVWHRSRURVLVDQGWKHGLDJ QRVLVRID9)PD\EHHVVHQWLDOLQWKHDVVHVVPHQWRIZRPHQERQHKHDOWKVWDWXV 2XUSXUSRVHZDVWRUHWURVSHFWLYHO\HYDOXDWH05ORFDOLVHU05ORFRIEUHDVW05, H[DPLQDWLRQVDVDSRWHQWLDOWRROLQWKHGHWHFWLRQRIRVWHRSRURWLF9)V 0HWKRGVDQG0DWHULDOV05ORFVDJLWWDOLPDJHVRIEUHDVW05,ZHUHUHYLHZHG E\WKUHHH[SHUWVNHOHWDOUDGLRORJLVWVZLWKDVHPLTXDQWLWDWLYHGLDJQRVWLFDSSURDFK WR GHWHFW 9)V$QDPQHVLV DQG GDWD RI SDWLHQWV ZHUH FROOHFWHG DV ZHOO DV 05, RULJLQDO UHSRUWV ZHUH UHDG DW WKH HQG RI WKH 05ORF HYDOXDWLRQ 2WKHU DYDLODEOH LPDJLQJH[DPVZHUHLQYHVWLJDWHGWRDVVHVVSRWHQWLDOPHWDVWDWLFLQYROYHPHQWRI ERQHLQDOOSDWLHQWV 5HVXOWVIHPDOHSDWLHQWVXQGHUJRLQJ05,IRURQFRORJLFUHDVRQV DQGIRUQRQRQFRORJLFDLPVZHUHUHFUXLWHGLQWKHVWXG\DJH \HDUROG05ORFZHUHFRQVLGHUHGWREHLQDGHTXDWHIRUGLDJQRVWLF SXUSRVHDQGWKHVHZHUHH[FOXGHGIURPWKHDQDO\VLV,QSDWLHQWV 05ORFDOORZHGWKHHYDOXDWLRQRIYHUWHEUDOERGLHVEHWZHHQ7DQGWKHXSSHUOXP EDUVSLQH//05ORFZDVDEOHWRGHWHFW9)VLQSDWLHQWV9)V ZHUHQHLWKHUUHSRUWHGQRUSUHYLRXVO\NQRZQLQWKHFOLQLFDOKLVWRU\RI SDWLHQWV0RUHRYHUQRPHQWLRQRI9)VZDVIRXQGLQDOO05,EUHDVWUHSRUWV,Q SDWLHQWV05ORFFRXOGDOVRLGHQWLI\YHUWHEUDOPHWDVWDVHVDVGRFXPHQWHG E\RWKHUDSSURSULDWHLPDJLQJPHWKRGV &RQFOXVLRQ,QWKHIHPDOHSRSXODWLRQVXEPLWWHGWREUHDVW05,DV\VWHPDWLFHYDOX DWLRQRI05ORFFDQEHSURSRVHGWRRIIHUDGGLWLRQDOFOLQLFDOLQIRUPDWLRQLQRUGHUWR SUHYHQWXQUHFRJQLVHG9)V % $UHPDPPRJUDSKLFIROORZXSÀQGLQJVLQGHHGPRUHSURQRXQFHG DIWHULQWUDRSHUDWLYHUDGLRWKHUDS\IRUEUHDVWFDQFHU"6XEJURXS DQDO\VLVRIDUDQGRPLVHGWULDO7$5*,7$ '%(QJHO$6FKQLW]HU8.UDXV7LHIHQEDFKHU (%ODQN-%UDGH) :HQ]626FK|QEHUJ.:DVVHU 0DQQKHLP'(GRURWKHHHQJHO#PHGPDXQLKHLGHOEHUJGH 3XUSRVH ,QWUDRSHUDWLYH UDGLRWKHUDS\ ,257 LV LQFUHDVLQJO\ XVHG IRU EUHDVW FRQVHUYLQJ WKHUDS\ %&7 RIIHULQJ D VDIH DOWHUQDWLYH WR FRQYHQWLRQDO %&7 IRU VHOHFWHGSDWLHQWVZLWKEUHDVWFDQFHU$VXVLQJ,257LQFUHDVHVVWUXFWXUDOFKDQJHV LQWKHWXPRXUEHGDVSUHYLRXVO\REVHUYHGLQQRQUDQGRPLVHGSDWLHQWJURXSVZH DLPHGWRIXUWKHUYDOLGDWHWKHVHUHVXOWVIRUWKHÀUVWWLPHLQDUDQGRPLVHGVXEJURXS RISDWLHQWVIURPWKHLQLWLDOLQWHUQDWLRQDO7$5*,7$WULDO 0HWKRGV DQG 0DWHULDOV ,QFOXGLQJ SDWLHQWV SDWLHQWV UHFHLYHG %&7 ZLWK ,257ORZHQHUJ\[UD\VDQGSDWLHQWVKDG%&7ZLWKVWDQGDUGZKROHEUHDVW UDGLRWKHUDS\VHUYHGDVFRQWUROVIROORZXSVRISRVWRSHUDWLYHPDPPRJUDPV PHGLDQ IROORZXS \HDUV UDQJH ZHUH UHWURVSHFWLYHO\ HYDOXDWHG E\ WZR UDGLRORJLVWVLQFRQVHQVXVIRFXVLQJRQFLUFXPVFULEHGFKDQJHVDQGFDOFLÀFDWLRQV LQWKHWXPRXUEHG 5HVXOWV,QSDWLHQWVDIWHU,257IDWQHFURVLVZDVVLJQLÀFDQWO\PRUHIUHTXHQW YVSYDOXHDQGODUJHUYVVTFPPHGLDQWKDQLQFRQWUROV +DHPDWRPDDQGVHURPDDSSHDUHGLQWKH,257JURXSLQVTFPPHGLDQ YHUVXVLQFRQWUROV6FDUFDOFLÀFDWLRQVZHUHDOVRVLJQLÀFDQWO\PRUHIUHTXHQWDIWHU ,257YVSYDOXHDQGVSHFLÀHGDVG\VWURSKLFLQYV DQGHJJVKHOOOLNHLHW\SLFDOIRURLOF\VWLQYV &RQFOXVLRQ7KHVWXG\FRQÀUPVWKHKLJKLQFLGHQFHRIFLUFXPVFULEHGÀQGLQJVDIWHU ,257 VSHFLDOO\ ODUJH IDW QHFURVLV 7KH KLJKHU LQFLGHQFH RI FDOFLÀFDWLRQV LQ WKH WXPRXUEHGDIWHU,257UHSUHVHQWVDQHZÀQGLQJZKLFKUHTXLUHVIXUWKHUDWWHQWLRQ % 5DGLRORJLFDOÀQGLQJVLQPDPPDU\DXWRORJRXVIDWLQMHFWLRQVD PXOWLPRGDOLW\HYDOXDWLRQ 3 %HOOL$&LSULDQL(%XÀ5)XEHOOL3 5LQDOGL0&RVWDQWLQL05RPDQL /%RQRPR5RPH,7 3XUSRVH $XWRORJRXVIDWLQMHFWLRQOLSRÀOOLQJKDVUHFHQWO\EHHQHPSOR\HGLQEUHDVW SODVWLFVXUJHU\2XUDLPLVWRHYDOXDWHPDPPRJUDSKLFVRQRJUDSKLFDQGPDJQHWLF UHVRQDQFHLPDJLQJQRUPDODQGSDWKRORJLFDOÀQGLQJVLQEUHDVWOLSRÀOOLQJ 0HWKRGV DQG 0DWHULDOV ,QIRUPHG FRQVHQW DQG LQVWLWXWLRQDO UHYLHZ ERDUG DS SURYDOZHUHREWDLQHGSDWLHQWVXQGHUZHQWEUHDVWOLSRÀOOLQJIURP-DQXDU\ WR'HFHPEHUDWRXULQVWLWXWLRQ6LWHDQGDPRXQWRIDXWRORJRXVIDWLQMHFWLRQV ZHUHNQRZQ0DPPRJUDSK\0;XOWUDVRQRJUDSK\86DQGPDJQHWLFUHVRQDQFH LQRXWRIFDVHV7KHUHZHUHWUXHSRVLWLYHREVHUYDWLRQVIDOVHSRVLWLYH IDOVHQHJDWLYHDQGWUXHQHJDWLYH7KH05,VHQVLWLYLW\VSHFLÀFLW\SRVLWLYH SUHGLFWLYH YDOXH DQG QHJDWLYH SUHGLFWLYH YDOXH LQ SUHGLFWLQJ D[LOODU\ PHWDVWDVHV ZHUHDQGUHVSHFWLYHO\7KH05,SRVLWLYHSUHGLFWLYH YDOXH UHDFKHV LI ZH FRQVLGHU WKH DVVRFLDWLRQ RI DW OHDVW WZR ÀQGLQJV DV VXVSLFLRXVIRUQRGDOLQYROYHPHQW &RQFOXVLRQ$OWKRXJKSDWKRORJLFHYDOXDWLRQRIO\PSKQRGHVVWLOOUHPDLQVPDQGD WRU\LQDOOSDWLHQWVDWULVNIRUQRGDOLQYROYHPHQW05,PD\EHXVHIXOLQSUHGLFWLQJ D[LOODU\O\PSKQRGHPHWDVWDVHV % 3RWHQWLDOUROHRI05,LQDVVHVVLQJWKHQHHGIRUVHQWLQHOO\PSKQRGH ELRSV\LQSDWLHQWVXQGHUJRLQJFRQWUDODWHUDOSURSK\ODFWLFPDVWHFWRP\ 9)UHLWDV6.XONDUQL$6FDUDQHOR.%XNKDQRY6*KDL3 &U\VWDO 7 RURQWR21&$ 3XUSRVH 7 R HYDOXDWH DFFXUDF\ RI 05, LQ GHWHFWLQJ RWKHUZLVH RFFXOW EUHDVW PDOLJQDQF\LQZRPHQXQGHUJRLQJFRQWUDODWHUDOSURSK\ODFWLFPDVWHFWRP\&30 0HWKRGV DQG 0DWHULDOV :LWK ,5% DSSURYDO ,QVWLWXWLRQDO GDWDEDVH UHYLHZ ZDV SHUIRUPHGWRLGHQWLI\SDWLHQWVZLWKQHZO\GLDJQRVHGXQLODWHUDOEUHDVWFDUFLQRPD ZKRXQGHUJR&30LQ6L[W\SDWLHQWVPHWLQFOXVLRQFULWHULDWKDWZHUH UHVWULFWHGWRFDVHVZLWKPDPPRJUDSK\DQGEUHDVW05,SHUIRUPHGQRWPRUHWKDQ VL[PRQWKVEHIRUH&305HWURVSHFWLYHUHYLHZRI05,VWXGLHVZDVSHUIRUPHGE\ WZR H[SHULHQFHG UHDGHUV$FFXUDF\ RI 05, LQ GHWHFWLQJ RWKHUZLVH RFFXOW EUHDVW PDOLJQDQF\ZDVHYDOXDWHG05,VSHFLÀFLW\DQGQHJDWLYHSUHGLFWLYHYDOXHV139 ZHUHFDOFXODWHG 5HVXOWV7KHPHGLDQSDWLHQWDJHDWWKHWLPHRISURSK\ODFWLFPDVWHFWRP\ZDV \HDUVUDQJH\HDUV%UHDVWFDUFLQRPDZDVGLDJQRVHGLQRISDWLHQWV RI7KHUHZDVRQHFDVHRILQYDVLYHGXFWDOFDUFLQRPDDQGWZRFDVHVRIGXFWDO FDUFLQRPDLQVLWX'&,67KHLQYDVLYHFDQFHUZDVPP71WXPRXUDQGLWZDV FRQÀGHQWO\LGHQWLÀHGUHWURVSHFWLYHO\E\ERWKUHYLHZHUV05,LQERWKFDVHVRI'&,6 ZDVQHJDWLYH6SHFLÀFLW\RI05,IRUGHWHFWLRQRIPDOLJQDQF\ZDVDQG139 ZDV05,139IRULQYDVLYHGLVHDVHZDV &RQFOXVLRQ05,PD\EHDUHOLDEOHWHVWLQH[FOXGLQJFRQWUDODWHUDOLQYDVLYHEUHDVW FDUFLQRPDLQSDWLHQWVXQGHUJRLQJ&30%DVHGRQWKHYHU\KLJK139RI05,LQ RXU VHULHV DQ \LHOG RI VHQWLQHO O\PSK QRGH ELRSV\ LQ SDWLHQWVXQGHUJRLQJ &30 VKRXOGEHUHHYDOXDWHG % %UHDVW05,DVDSRWHQWLDOQHZELRPDUNHUWRDVVHVVWKHD[LOODU\ WXPRXUORDGLQSDWLHQWVZLWKQHZO\GLDJQRVHGEUHDVWFDQFHULQLWLDO GDWDXVLQJFRPSXWHUDVVLVWHGGLDJQRVLV&$'[ 0'LHW]HO++DEUHFKW5=RXEL+3 %XUPHLVWHU0*DMGD,%5XQQHEDXP :$.DLVHU3 $7 %DOW]HU-HQD'(GLHW]HOPDWWKLDV #KRWPDLOFRP 3XUSRVH7 RVWUDWLI\WKHLQGLYLGXDOULVNRISDWLHQWVZLWKQHZO\GLDJQRVHGEUHDVW FDQFHU QXPHURXV SURJQRVWLFIDFWRUV KDYH EHHQ SURSRVHG 3UHVHQFH RI D[LOODU\ O\PSKQRGHV PHWDVWDVHV KDV EHHQ VKRZQ WR EH RQH RI WKH PRVW LPSRUWDQW SURJQRVWLFIDFWRUV<HWLWFDQEHIXUWKHULPSURYHGLIWKHWRWDOQXPEHURIPHWDVWDWLF O\PSKQRGHVLVDGGUHVVHG7KLVLVXVXDOO\GRQHXVLQJWKHD[LOODU\O\PSKQRGHUDWLR $/15EHLQJGHÀQHGDVWKHTXDQWLW\RIPHWDVWDWLFQRGHVGLYLGHGE\WKHTXDQWLW\ RI UHVHFWHGQRGHV$FFRUGLQJO\ ZH GHVLJQHG WKLV SURVSHFWLYHFURVVVHFWLRQDO LQYHVWLJDWLRQWRLQYHVWLJDWHWKHSRWHQWLDORIEUHDVW05,WRQRQLQYDVLYHO\DVVHVVHV D[LOODU\WXPRXUORDGDQGWRSUHGLFW $/15XVLQJGHGLFDWHGVHPLDXWRPDWLFVRIWZDUH 0HWKRGVDQG0DWHULDOV&RQVHFXWLYHSDWLHQWVZLWKSULPDU\LQYDVLYHEUHDVWFDQFHU UHFHLYLQJSUHRSHUDWLYHEUHDVW05,DWRXULQVWLWXWLRQZHUHHQUROOHG,5%DSSURYDO 5HIHUHQFHVWDQGDUGZDVVXUJLFRSDWKRORJLFDOVWDJLQJEUHDVWD[LOODDQG $/15ZDV LGHQWLÀHG%UHDVW05,SURWRFROVZHUHVWDQGDUGLVHGDFFRUGLQJWR(862%,UHFRP PHQGDWLRQV7ZJUDGLHQWHFKREHIRUHDQGDIWHU>Q @DSSOLFDWLRQRI*G'73$ÁRZ POVGRVDJHPPRONJ)RUEUHDVW05,DQDO\VHVDFRPPHUFLDOO\DYDLODEOH &$'V\VWHPZDVXVHGFRPSXWHUDVVLVWHGGLDJQRVLVSURYLGLQJVHPLDXWRPDWLF VHPLTXDQWLWDWLYHDQDO\VLVRIEUHDVWFDQFHUHQKDQFHPHQWSURÀOHV0XOWLSOHUHJUHV VLRQZDVXVHGWRDVVHVVSRVVLEOHFRUUHODWLRQRIVXFKHQKDQFHPHQWSURÀOHVZLWK WKHUHIHUHQFHVWDQGDUG$/15 5HVXOWVSDWLHQWVZHUHHQUROOHGPHDQDJH\HDUVUDQJH\HDUV0HDQ $/15ZDVUDQJH0XOWLSOHUHJUHVVLRQLGHQWLÀHGVLJQLÀFDQWSRWHQWLDO RIEUHDVW05,WRSUHGLFWD[LOODU\WXPRXUORDG3U &RQFOXVLRQ$FFRUGLQJ WR RXU GDWD &$'[EDVHG LQWHUSUHWDWLRQ RI EUHDVW 05, FRUUHODWHVZLWKD[LOODU\WXPRXUORDG$VWKHODWWHULVDPRQJVWWKHPRVWSRZHUIXO SURJQRVWLF IDFWRUV LQ EUHDVWFDQFHU VXFK ÀQGLQJV DGG IXUWKHU NQRZOHGJH WR WKH DSSOLFDWLRQRIEUHDVW05,DVDQRQLQYDVLYHSURJQRVWLFELRPDUNHU 6FLHQWLILF6HVVLRQ 6 &$' ( ) *+% (XURSHDQ&RQJUHVVRI 5DGLRORJ\ ZDVFDOFXODWHGLQFOXGLQJPPPDUJLQV $IWHUZDUGVWKHUDWLREHWZHHQWKHYROXPHV ZDVFDOFXODWHG 5HVXOWVSDWLHQWVZHUHLQFOXGHGLQRXUVWXG\SDWLHQWVKDGEUHDVWSUHVHUYLQJ VXUJHU\DQGSDWLHQWVXQGHUZHQWPDVWHFWRP\ $YHUDJHWXPRXUWREUHDVWYROXPH UDWLRLQWKHPDVWHFWRP\JURXSZDV,QWKHOXPSHFWRP\JURXSDYHUDJH WXPRXUWREUHDVWYROXPHUDWLRZDV &RQFOXVLRQ7XPRXUWREUHDVWYROXPHUDWLRDVPHDVXUHGRQ05,LVDQDFFXUDWH PHDVXULQJWRROWKDWFDQKHOSWKHVXUJHRQLQWKHGHFLVLRQZKHWKHUWRSHUIRUPEUHDVW FRQVHUYLQJVXUJHU\RUPDVWHFWRP\7KLVWRROVKRXOGEHLQWURGXFHGLQWKHVXUJLFDO SODQQLQJRISDWLHQWVGLDJQRVHGZLWKEUHDVWFDQFHU 5RRP*+ 0XVFXORVNHOHWDO 66E 7UDXPDDQGYHUWHEURSODVW\ 0RGHUDWRUV -5DSRVR/LVERQ37 $9LHLUD3RUWR37 % 7KHWLELRÀEXODUV\QGHVPRWLFLQMXU\LQDFXWHDQNOHIUDFWXUH&7HYDOXDWLRQ < .LP< &KRL0,P./HH< /HH-.LP6HRXO.5\XQQL#HXOMLDFNU 3XUSRVH7 RPHDVXUHQRUPDOWLELRÀEXODUV\QGHVPRVLVE\&7DQGLGHQWLI\&7SDUDP HWHUVWKDWFRXOGDLGLQWKHGLDJQRVLVRIV\QGHVPRWLFLQMXU\DIWHUDFXWHDQNOHIUDFWXUH 0HWKRGVDQG0DWHULDOV7KHVWXG\JURXSFRPSULVHGSDWLHQWVZLWKDFXWHDQNOH IUDFWXUHPHDQDJH\HDUVZKRXQGHUZHQWDQNOH&7DQGKDGV\QGHVPRWLFWHDU DORQJZLWKQRUPDOVXEMHFWVPHDQDJH\HDUV7KHWLELRÀEXODUFOHDUVSDFH 7)&6DQGWLELRÀEXODURYHUODS7)2RQWKH $3UDGLRJUDSKZHUHPHDVXUHG,QWKH D[LDO&7LPDJHIRXUSDUDPHWHUVZHUHPHDVXUHGLQFOXGLQJWKHDQWHULRUWLELRÀEXODU ZLGWK $7): SRVWHULRU WLELRÀEXODU ZLGWK 37): WLELRÀEXODU DQJOH 7)$ DQG WLELRÀEXODULQWHUYDO7),:HFRPSDUHG&7PHDVXUHPHQWVEHWZHHQERWKJURXSV DQGGHWHUPLQHGWKHRSWLPDOFXWRIIYDOXHVIRUGHWHFWLQJV\QGHVPRWLFLQMXU\ 5HVXOWV 7KH PHDQ 7)&6 DQG 7)2 ZHUH PP DQG PP IRU WKH QRUPDO JURXSPPDQGPPIRUWKHSDWLHQWJURXSUHVSHFWLYHO\7KHPHDQ$7): ZDVPPWKH37):ZDVPPWKH7)$ZDVGHJUHHVDQGWKH7),ZDV PPIRUWKHQRUPDOJURXSZKLOHWKH\ZHUHPPPPGHJUHHVDQG PPIRUWKHSDWLHQWJURXS7KHRSWLPDOFXWRIIYDOXHVIRUV\QGHVPRWLFLQMXU\ZHUH $7):PPVHQVLWLYLW\VSHFLÀFLW\37):PPVHQVLWLYLW\ VSHFLÀFLW\7)$GHJUHHVVHQVLWLYLW\VSHFLÀFLW\DQG7),PP VHQVLWLYLW\VSHFLÀFLW\UHVSHFWLYHO\S &RQFOXVLRQ&7PHDVXUHPHQWVRI37):DQG7)$DLGLQWKHGLDJQRVLVRIV\QGHPRW LFGLVUXSWLRQZKLFKLVGLIÀFXOWWRGHWHFWE\SODLQUDGLRJUDSK\LQDFXWHDQNOHIUDFWXUH % 'HWHFWLRQRIERQHPDUURZOHVLRQVZLWKGXDOHQHUJ\&7YLUWXDO QRQFDOFLXPWHFKQLTXHLVQRWDIIHFWHGE\GRVHUHGXFWLRQ *3DFKH6%XOOD3 %ODQNH7 %DXPDQQ0/DQJHU )UHLEXUJ'(JUHJRUSDFKH#XQLNOLQLNIUHLEXUJGH 3XUSRVH7 RHYDOXDWHLIGRVHUHGXFWLRQDOWHUVGHWHFWDELOLW\RISRVWWUDXPDWLFERQH PDUURZOHVLRQV%0/RIWKHNQHHZLWKGXDOHQHUJ\'(&7YLUWXDOQRQFDOFLXP WHFKQLTXH91&D 0HWKRGVDQG0DWHULDOV,QWKLVSURVSHFWLYHLQVWLWXWLRQDOUHYLHZERDUGDSSURYHG VWXG\SDWLHQWVZLWKDQDFXWHNQHHWUDXPDXQGHUZHQW'(&76RPDWRP'HÀQLWLRQ 6LHPHQVZLWKHLWKHUVWDQGDUGJURXS $RUZLWKDGRVHHTXDOWRWKDWRIDVLQJOHHQ HUJ\&7VFDQJURXS%GRVHUHGXFWLRQDQG05,DVWKHVWDQGDUGRIUHIHUHQFH &DOFLXPZDVYLUWXDOO\VXEWUDFWHGIURPWKHLPDJHV/LYHU91&6\QJR'XDO(QHUJ\ 6LHPHQV3UHVHQFHRIIUDFWXUHVZDVQRWHGDQGSUHVHQFHRIDEQRUPDOVRIWWLVVXH OLNH DWWHQXDWLRQ LQ WKH ERQH PDUURZ ZDV UDWHG RQ D SRLQW VFDOH IRU IHPRUDO DQGWLELDOUHJLRQVHDFKE\UDGLRORJLVWV+8PHDVXUHPHQWVZHUHSHUIRUPHGLQ WKHVDPHUHJLRQV,PDJHUDWLQJVDQG+8YDOXHVZHUHVXEMHFWHGWR52&DQDO\VLV 5HVXOWV0HDQDJHQXPEHURIIUDFWXUHVDQGDWWHQXDWLRQYDOXHVZHUHQRWVLJQLÀ FDQWO\GLIIHUHQWEHWZHHQERWKJURXSV05,UHYHDOHG%0/IHPRUDOWLELDO $%S 9LVXDOUDWLQJUHYHDOHGRYHUDOO$8&YDOXHVRI DQGIRUREVHUYHUVDQGUHVSHFWLYHO\9LVXDOMXGJHPHQWZDVVXSHULRURYHU DWWHQXDWLRQPHDVXUHPHQWVIRUIHPRUDOUHJLRQVUHJDUGOHVVRIWKHGRVDJHDSSOLHG $QRYDDQDO\VLVRIDOO&7YDOXHVUHYHDOHGDVLJQLÀFDQWLQÁXHQFHIRUWKHSUHVHQFH RIRHGHPDSEXWQRGLIIHUHQFHVIRUWKHUDGLDWLRQGRVHXVHGS ,QWHUREVHUYHUDJUHHPHQWZDVH[FHOOHQWѣYDOXH LPDJLQJ 05, ZHUH SURVSHFWLYHO\ REWDLQHG SUHRSHUDWLYHO\ DQG PRQWKV DIWHU OLSRÀOOLQJ 86 DQG 05, ZHUH UHSHDWHG PRQWKV DIWHU SURFHGXUH1RUPDO DQG SDWKRORJLFDOÀQGLQJVZHUHGHVFULEHG 5HVXOWVSDWLHQWVEHWZHHQDQG\HDUVROG06'ZHUHHQ UROOHGLQWKHVWXG\EUHDVWVXQGHUZHQWOLSRÀOOLQJDIWHUPDVWHFWRP\DIWHU OXPSHFWRP\DIWHU',(3ÁDSUHFRQVWUXFWLRQIRUDV\PPHWU\DQGIRU3RODQGҋV V\QGURPHWUHDWPHQW $XWRORJRXVIDWLQMHFWLRQVDPRXQWUDQJHGEHWZHHQDQGPO 06'1RVHYHUHFRPSOLFDWLRQDIWHUWUHDWPHQWZDVREVHUYHG$WWKH HQGRIWKHVWXG\OLSRÀOOLQJQRUPDORXWFRPHV´RLOF\VWVµZHUHLGHQWLÀHGWLPHV RQ86DQGRQ05,/LSRQHFURVLVZDVGHWHFWHGWLPHVRQ86DQGRQ05, ,QMHFWHGIDWDYHUDJHDPRXQWZDVPOLQSDWLHQWVZLWKIDWQHFURVLVPO LQSDWLHQWVZLWKRXWS 2QHFDQFHUUHFXUUHQFHZDVGLDJQRVHGDW\HDU IROORZXSE\86JXLGHGEUHDVWELRSV\ &RQFOXVLRQ/LSRÀOOLQJQRUPDORXWFRPHVDUHEHVWLGHQWLÀHGE\86SDWKRORJLFDO DUHE\05,/LSRQHFURVLVRFFXUVZKHQODUJHDPRXQWVRIIDWDUHLQMHFWHG/LSRÀOOLQJ GRHVQRWMHRSDUGLVHFDQFHUUHFXUUHQFHGLDJQRVLV % %UHDVWFRQVHUYLQJVXUJHU\IRUQRQSDOSDEOHEUHDVWFDQFHU UHODWLRQVKLSRIOXPSHFWRP\UHVHFWLRQPDUJLQVPHDVXUHPHQWV EHWZHHQUHPRWHSHULRSHUDWLYHXOWUDVRXQGDQGSRVWRSHUDWLYH KLVWRSDWKRORJ\ &/XWFKPD\D)OLFN) %HFFH/$ODPR-) 'HODOR\H50HXOL-< 0HXZO\ /DXVDQQH&+OLQRXÁLFN#JP[GH 3XUSRVH7XPRXUIUHHUHVHFWLRQPDUJLQV50VDUHPDQGDWRU\LQEUHDVWFRQVHUYLQJ VXUJHU\2QVLWHLQWUDRSHUDWLYHXOWUDVRXQG86JXLGHGWXPRXUUHVHFWLRQZLWKH[ WHPSRUDQHRXVKLVWRSDWKRORJLFDODVVHVVPHQWRI50VKDVEHHQGHVFULEHG5HPRWH LQWUDRSHUDWLYH86DVVHVVPHQWRI50VLVDQDOWHUQDWLYH7KHSXUSRVHRIWKLVVWXG\ ZDV WR HYDOXDWH WKH UHODWLRQVKLS RI OXPSHFWRP\ 50V PHDVXUHPHQWV EHWZHHQ UHPRWHLQWUDRSHUDWLYH86DQGSRVWRSHUDWLYHKLVWRSDWKRORJ\ 0HWKRGVDQG0DWHULDOV,QDUHWURVSHFWLYH,5%DSSURYHGUHYLHZRIFRQVHFX WLYHOXPSHFWRPLHVSHUIRUPHGEHWZHHQ2FWREHUDQG$SULOIRUSUHVXPHG QRQSDOSDEOH EUHDVW FDQFHU ZRPHQ PHDQ DJH \HDUV ZHUHLQFOXGHG 7ZHQW\QLQH SDWLHQWV ZHUH H[FOXGHG EHFDXVH RI DEVHQFH RI FDQFHU DW KLVWRSD WKRORJ\DQGRULQFRPSOHWHGDWD0HDVXUHPHQWVRIOXPSHFWRP\PLQLPDO50VDQG WXPRXUPD[LPDOGLDPHWHUREWDLQHGRQUHPRWHLQWUDRSHUDWLYH86DQGSRVWRSHUDWLYH KLVWRSDWKRORJ\ZHUHFRPSDUHG 5HVXOWV0LQLPDO50VZHUHPHDQ6'DQGFPRQUHPRWH LQWUDRSHUDWLYH 86 DQG SRVWRSHUDWLYH KLVWRSDWKRORJ\ UHVSHFWLYHO\ 1R VLJQLÀFDQW GLIIHUHQFH ZDV IRXQG EHWZHHQ WKHVH PHDVXUHPHQWV S 7XPRXU PD[LPDO GLDPHWHU ZDV PHDQ6' DQG FP RQ UHPRWH LQWUDRSHUD WLYH86DQGSRVWRSHUDWLYHKLVWRSDWKRORJ\UHVSHFWLYHO\86PHDVXUHPHQWVZHUH VLJQLÀFDQWO\ VPDOOHU S 7KH EUHDVW FDUFLQRPD &$FRQVLVWHG RI LQYDVLYHFDQDODUQ LQYDVLYHOREXODUQ LQVLWXQ DQGRWKHUW\SHVRI &$Q 7ZHQW\QLQHSDWLHQWVKDGLQWUDRSHUDWLYHUHH[FLVLRQZLWKRXWUHVLGXDO &$ZKLOHSDWLHQWVZHUHUHRSHUDWHGGXHWRLQVXIÀFLHQWKLVWRSDWKRORJLFDO50V ZLWKRXWUHVLGXDO&$ &RQFOXVLRQ*RRGFRUUHODWLRQRIPLQLPDO50VEHWZHHQUHPRWHLQWUDRSHUDWLYH86 DQGSRVWRSHUDWLYHKLVWRSDWKRORJ\ZDUUDQWVXVHRIERWKWHFKQLTXHVLQDFRPSOH PHQWDU\PDQQHU5HPRWHLQWUDRSHUDWLYH86LVKHOSIXOLQWDNLQJUDSLGGHFLVLRQRI UHH[FLVLRQDQGPDLQWDLQLQJORZUHRSHUDWLRQUDWHDIWHUEUHDVWFRQVHUYLQJVXUJHU\ IRUQRQSDOSDEOHFDQFHU % 7XPRXUWREUHDVWYROXPHUDWLRDVPHDVXUHGRQ05,DSRVVLEOH SUHGLFWRURIEUHDVWFRQVHUYDWLRQVXUJHU\YHUVXVPDVWHFWRP\ 5)DHUPDQQ) 6SHUEHU66FKQHHEDXP'%DUVXN7 HO$YLY,/ UIDHUPDQQ#JPDLOFRP 3XUSRVH7KH VXUJLFDO DSSURDFK WR EUHDVW FDQFHU KDV FKDQJHG GUDPDWLFDOO\ LQ WKHSDVW\HDUV1RZDGD\VWKHVXUJLFDOREMHFWLYHLVWRUHPRYHWKHWXPRXUZLWK QHJDWLYHPDUJLQVDQGJRRGFRVPHWLFUHVXOWV05,RIWKHEUHDVWKDVEHFRPHDQ LPSRUWDQW LPDJLQJ WRRO EHIRUH VXUJHU\ SURYLQJ WR GLDJQRVH DGGLWLRQDO WXPRXUV DQGWRDVVHVVWKHWXPRXUH[WHQW7XPRXUWREUHDVWYROXPHUDWLRLVDQLPSRUWDQW SUHGLFWRURIEUHDVWFRQVHUYDWLRQEXWZDVQHYHUDFFXUDWHO\PHDVXUHG05,HQDEOHV WKLVUDWLRWREHPHDVXUHG2XUSXUSRVHZDVWRPHDVXUHWKLVUDWLRDQGWRDQDO\VH LILWFDQKHOSLQWKHSODQQLQJRIEUHDVWFDQFHUVXUJHU\ 0HWKRGVDQG0DWHULDOV:HFRQGXFWHGDUHWURVSHFWLYHKRVSLWDOEDVHGVWXG\RI ZRPHQ GLDJQRVHG ZLWK EUHDVW FDQFHU ZKR XQGHUZHQW SUHVXUJHU\ 05, %UHDVW YROXPH ZDV FDOFXODWHG ZLWK WKH$: VRIWZDUH DSSOLFDWLRQ 7XPRXUYROXPH ZDV FDOFXODWHGZLWKWKHKHOSRI&$'VRIWZDUHDQGWKH$:DSSOLFDWLRQ7XPRXUYROXPH 6FLHQWLILF6HVVLRQ $ 6&'()*+%(XURSHDQ&RQJUHVVRI 5DGLRORJ\ 0RQGD\ % 2SHUDWLYHPDQDJHPHQWRILQWUDFDSVXODUIHPRUDOIUDFWXUHLVWKH UHTXLUHPHQWIRUDGGLWLRQDOLPDJLQJDEDUULHUWRRSHUDWLQJZLWKLQWKH KRXUWDUJHW" 5*(&OHPHQW='DYLV) 3HUNV(GLQEXUJK8. UK\VFOHPHQW#JRRJOHPDLOFRP 3XUSRVH'HOD\LQPDQDJHPHQWRISDWLHQWVZLWKDIHPRUDOQHFNIUDFWXUHRIRYHU KRXUVGRXEOHVPRUWDOLW\7KHLQFLGHQFHRIRFFXOWIUDFWXUHVWKDWDUHQRWHYLGHQW RQ SODLQ UDGLRJUDSK\ LV XS WR (LWKHU &7 RU 05, FDQ EH XVHG IRU IXUWKHU LPDJLQJ EXW LW KDV EHHQ VXJJHVWHG WKDW ZDLWLQJ IRU WKHVH LV WKH SULQFLSOH FDXVH IRUGHOD\LQJVXUJHU\ 0HWKRGVDQG0DWHULDOV3DWLHQWVXQGHUJRLQJ&7RU05,IRUVXVSHFWHGRFFXOWKLS IUDFWXUHVDWDPDMRU8QLYHUVLW\KRVSLWDOZHUHLGHQWLÀHGGXULQJDRQH\HDUSHULRG 7LPLQJRIWKHSDWLHQWDGPLVVLRQ&705,UHTXHVWLPDJLQJDQGVXUJHU\ZHUHDOO UHFRUGHG 5HVXOWVSDWLHQWVZLWKVXVSHFWHGRFFXOWKLSIUDFWXUHZHUHUHIHUUHGIRUIXUWKHU LPDJLQJGXULQJWKHVWXG\SHULRGXQGHUZHQW&7DQGWKHRWKHUXQGHUZHQW 05,7KHDYHUDJHZDLWIURPDGPLVVLRQWR05,ZDVGD\VZLWKDGHOD\IURPWKH UHTXHVWRIGD\V%\FRPSDULVRQWKHDYHUDJHZDLWIRU&7IURPDGPLVVLRQZDV GD\VZLWKWKHDYHUDJHGHOD\IURPUHTXHVWRIGD\V05,LGHQWLÀHGIHPRUDO IUDFWXUHVRIZKLFKZHUHRSHUDWHGRQZLWKLQWKHKRXUWDUJHW&7LGHQWLÀHG IHPRUDOIUDFWXUHVRIZKLFKZHUHRSHUDWHGRQZLWKLQKRXUV &RQFOXVLRQ 2YHU RI SDWLHQWV UHTXLULQJ DGGLWLRQDO LPDJLQJ IRU VXVSHFWHG IHPRUDO IUDFWXUH IDLOHG WR EH RSHUDWLYHO\ PDQDJHG ZLWKLQ KRXUV 5DGLRORJ\ GHSDUWPHQWGHOD\LVQRWRIWHQWKHFDXVHIRUWKLVDQGWKHUHIRUHFOLQLFLDQVVKRXOGEH HQFRXUDJHGWRUHTXHVWDGGLWLRQDOLPDJLQJSURPSWO\ % &7JXLGHGPLQLPDOO\LQYDVLYHPXVFXORVNHOHWDOSURFHGXUHV DXJPHQWHGE\DQRYHORSWLFDOQDYLJDWLRQV\VWHP < $SSOEDXP $+LUVFKHQEHLQ/$SSHOEDXP< /LEVRQ-6RVQD -HUXVDOHP,/5DҋDQDQD,/DYLYK#KDGDVVDKRUJLO 3XUSRVH:HHPSOR\HGDQRSWLFDOQDYLJDWLRQV\VWHPZKLFKXVHVYLGHRDQGGL PHQVLRQDO VRIWZDUH WR SURYLGH UHDOWLPH QHHGOH SRVLWLRQ JXLGDQFH GXULQJ ERQH ELRSVLHV5)$:HDLPHGDWDVVHVVLQJV\VWHPDFFXUDF\DQGVDIHW\LQRUWKRSDHGLF &7JXLGHGSURFHGXUHV 0HWKRGVDQG0DWHULDOV,5%ZDVREWDLQHGDQGHDFKSDWLHQWVLJQHGLQIRUPHGFRQ VHQW(LJKWSHUFXWDQHRXVELRSVLHVDQG5)$RIRVWHRLGRVWHRPDVZHUHFRQGXFWHG RQSDWLHQWVZLWKOHVLRQVLQWKHSHOYLVVSLQHIHPXUDQGVKRXOGHU 7KH$FWL6LJKW$FWL9LHZV+DLID,VUDHOJXLGDQFHV\VWHPZDVXVHGIRUDOOFDVHV 7KHV\VWHPLVDVWHUHRWDFWLFDFFHVVRU\IRU&7JXLGHGSURFHGXUHVZKLFKGHWHUPLQHV QHHGOHORFDWLRQLQUHODWLRQWRWKH'VSDFHRIWKH&7LPDJHVE\UHJLVWHULQJDYLGHR LPDJHZLWKWKH&7LPDJH3URFHGXUHUHODWHGGDWDLQFOXGLQJDFFXUDF\WLPHWRUHDFK OHVLRQQXPEHURIVFDQVDQGFRPSOLFDWLRQUDWHVZHUHFRPSLOHG 5HVXOWV3DWLHQWVZHUHRIDJHPHGLDQ7 HFKQLFDOVXFFHVVZDVDFKLHYHG LQRIFDVHV/HVLRQGLDPHWHUUDQJHGPPPPPHDQPP$YHUDJH GLVWDQFH VNLQWDUJHW ZDV PP 67' PP DQG QDYLJDWLRQEDVHG DFFXUDF\ UDQJHGEHWZHHQDQGPPDYHUDJHPP0HDQWLPHIRUFRUUHFWQHHGOH SODFHPHQWZDVPLQXWHVPLQIRU5)$DQGPLQIRUELRSV\7 RWDOQXPEHU RI&7VFDQVIRUQHHGOHSODFHPHQWDYHUDJHGUDQJH1RFRPSOLFDWLRQV RFFXUUHG &RQFOXVLRQ7KHXVHRIWKHRSWLFDOQHHGOHJXLGDQFHV\VWHPLQ&7JXLGHGERQH SURFHGXUHVLVVDIHDQGDFFXUDWH&OLQLFDOUHOHYDQFH7KHXVHRIDVWHUHRWDFWLFJXLG DQFHV\VWHPPD\LPSURYHWKHVXFFHVVUDWHLQ&7JXLGHGSURFHGXUHVRIERQHV UHGXFHWLPHFRPSOLFDWLRQVDQGUDGLDWLRQDVVRFLDWHGZLWKWKLVSURFHGXUH % ,VWKHUHDQ\SUHRSHUDWLYH05,SUHGLFWRULQSDWLHQWVZLWKGHJHQHUDWLYH OXPEDUVWHQRVLV" %$OLFLRJOX %<LOPD]1%XODNEDVL&&RSXURJOX(<DOQL]%$\NDF /HINRVD1RUWK&\SUXV75(GLUQH75DOLFLRJOXE#JPDLOFRP 3XUSRVH 7 R LGHQWLI\ DQ\ 05, SUHGLFWRU IRU VXUJLFDO RXWFRPHV RI SDWLHQWV ZLWK GHJHQHUDWLYH OXPEDU VSLQDO VWHQRVLV '/66 KDYLQJ LQVWUXPHQWHGSRVWHULRU GH FRPSUHVVLRQ,3'VXUJHU\ 0HWKRGV DQG 0DWHULDOV SDWLHQWV ZLWK '/66 ZKR XQGHUZHQW ,3' ZHUH UHYLHZHGUHWURVSHFWLYHO\7KHFOLQLFDOVFRUHRIHDFKSDWLHQWZHUHDVVHVVHGXVLQJ -DSDQHVH2UWKRSHGLF$VVRFLDWLRQ6FRULQJ-2$6V\VWHPZKLFKLVPDLQO\EDVHG RQWKHVXEMHFWLYHV\PSWRPVDQGSK\VLFDOVLJQVRIWKHSDWLHQWVEHIRUH-2$6,DQG DIWHU-2$6,,VXUJHU\+HDOLQJUDWHZDVFDOFXODWHGDV>-2$6,,-2$6,@[ >-2$6,@7KH+5JUHDWHUWKDQZDVFRQVLGHUHGDVFOLQLFDOLPSURYHPHQW &RQFOXVLRQ'RVHUHGXFWLRQGRHVQRWDIIHFWGHWHFWDELOLW\RISRVWWUDXPDWLF%0/ ZLWKGXDOHQHUJ\&7YLUWXDOQRQFDOFLXPWHFKQLTXHWKHUHE\SURYLGLQJSRWHQWLDODG GLWLRQDOLQIRUPDWLRQDVFRPSDUHGWRDVLQJOHHQHUJ\&7VFDQZLWKRXWDGGLWLRQDO UDGLDWLRQGRVH % &RQHEHDP&7IRUTXDQWLWDWLYHDVVHVVPHQWRIERQHGHIHFWKHDOLQJ DQDQLPDOVWXG\ 3 .URHSLO$5+DNLPL&5LHJJHU&5XEEHUW56/DQ]PDQ $6FKHUHU3 -XQJEOXWK*$QWRFK0+DNLPL 'VVHOGRUI'(3DWULF.URHSLO#PHGXQLGXHVVHOGRUIGH 3XUSRVH &RQH EHDP &7 &%&7 LV D UDSLGO\ H[SDQGLQJ LPDJLQJ PRGDOLW\ IRU YLVXDOLVLQJ RVVHRXV VWUXFWXUHV LQ WKH RUDO DQG PD[LOORIDFLDO 20) UHJLRQ 7KLV VWXG\ZDVGRQHWRHYDOXDWH&%&7EH\RQGWKH20)UHJLRQIRUPRQLWRULQJRIWLELDO ERQHGHIHFWKHDOLQJLQDQDQLPDOPRGHO 0HWKRGVDQG0DWHULDOV&LUFXPVFULEHGWLELDOERQHGHIHFWVZHUHFUHDWHGLQPLQL SLJV,PDJLQJRIWKHWLELDZDVSHUIRUPHGRQGD\XVLQJDPRGHUQ&%&7VFDQQHU ZLWK ÁDWSDQHO GHWHFWRU 3D;'XR' 9DWHFK .RUHD 7KH H[WHQWRI RVVHRXV FRQVROLGDWLRQZDVPHDVXUHGTXDQWLWDWLYHO\E\D&%&7YROXPHWU\WRROXVLQJFRP PHUFLDOO\DYDLODEOHLPDJLQJVRIWZDUH2VLUL;3L[PHR6ZLW]HUODQG9ROXPHVRIWKH HQWLUHGHIHFWLQFOXGLQJDOOSL[HOVDUHDVRIRVVHRXVFRQVROLGDWLRQGHQVLW\YDOXHV !DQGQRQFRQVROLGDWHGDUHDVGHQVLW\YDOXHVRIWKHGHIHFWZHUH GHWHUPLQHG7KH H[WHQW RI ERQH FRQVROLGDWLRQ ZDV FDOFXODWHG DQG D FRUUHODWLRQ ZLWK KLVWRPRUSKRPHWULFDO UHIHUHQFH VWDQGDUG ZDV SHUIRUPHG ,QGHSHQGHQWO\ D YLVXDOVHPLTXDQWLWDWLYH&%&7VFRUHZDVDSSOLHGWRDVVHVVERQHGHIHFWKHDOLQJ 5HVXOWV 7KH PHDQ H[WHQW RI RVVHRXV FRQVROLGDWLRQ LQ &%&7YROXPHWU\ ZDV UDQJH$VLJQLÀFDQWSRVLWLYHFRUUHODWLRQZDVIRXQGEHWZHHQ WKHH[WHQWRIRVVHRXVFRQVROLGDWLRQRQ&%&7YROXPHWU\DQGKLVWRORJLFDOO\YLVLEOH QHZO\ IRUPHG ERQH U S 7KHUH ZDV VLJQLÀFDQWQHJDWLYH FRU UHODWLRQEHWZHHQERQHFRQVROLGDWLRQRQ&%&7DQGKLVWRORJLFDODUHDVRISHUVLVWLQJ GHIHFWU S7KHYLVXDOVFRUHPDWFKHGZLWKWKHYROXPHWULFUHVXOWV LQRIWKHFDVHV &RQFOXVLRQ&%&7YROXPHWU\DOORZVIRUUHOLDEOHQRQLQYDVLYHTXDQWLWDWLYHPRQLWRU LQJRIERQHGHIHFWKHDOLQJDQGFRUUHODWHVVLJQLÀFDQWO\ZLWKKLVWRORJLFDOUHIHUHQFH VWDQGDUG&%&7LVDSURPLVLQJWHFKQLTXHIRULPDJLQJRISHULSKHUDOERQHVEH\RQG WKH20)UHJLRQ % 6HHPLQJO\LVRODWHGJUHDWHUWURFKDQWHUIUDFWXUHVGRQRWH[LVW ''XQNHU -+*RWKOLQ0*HLMHU*RWKHQEXUJ6(/XQG6( GHQQLVGXQNHU#YJUHJLRQVH 3XUSRVH 7 R DVVHVV WKH IUHTXHQF\ DQG H[WHQW RI VHHPLQJO\ LVRODWHG JUHDWHU WURFKDQWHULFIUDFWXUHVDVZHOODVREVHUYHUDJUHHPHQWVLQUDGLRJUDSK\FRPSXWHG WRPRJUDSK\&7DQGPDJQHWLFUHVRQDQFHLPDJLQJ05,RIVXFKIUDFWXUHV 0HWKRGVDQG0DWHULDOV $UHYLHZZLWKLQWHUREVHUYHUYDULDQFHZDVSHUIRUPHGLQ SDWLHQWVZLWKVXVSHFWHGKLSIUDFWXUHZLWKLQLWLDOHTXLYRFDORUQHJDWLYHUDGLRJUDSK\ IROORZHG E\ &7 Q RU 05, Q 7KUHH UHYLHZHUV VFRUHG H[WUDFDSVXODU IUDFWXUHVDVHLWKHUFRPSOHWHWURFKDQWHULFDYXOVLRQRIWKHJUHDWHUWURFKDQWHUZLWK LQFRPSOHWHWURFKDQWHULFH[WHQVLRQRULVRODWHGDYXOVLRQIURPWKHJUHDWHUWURFKDQWHU 2EVHUYHUYDULDWLRQZDVTXDQWLÀHGXVLQJOLQHDUZHLJKWHG.DSSDVWDWLVWLFV 5HVXOWV7KHUHZDVWRWDODJUHHPHQWEHWZHHQWKUHHREVHUYHUVLQRIWKHFDVHV IRUUDGLRJUDSK\IRU&7 DQGIRU05,LQFODVVLI\LQJWKHFDVHVDVGHÀQLWH IUDFWXUHVXVSHFWRUHTXLYRFDORUQRWURFKDQWHULFIUDFWXUH:KHQFODVVLI\LQJWKH FDVHVDVKDYLQJDJUHDWHUWURFKDQWHULFDYXOVLRQIUDFWXUHZLWKRUZLWKRXWDWURFKDQWHULF H[WHQVLRQWKHUHZDVDJUHHPHQWIRUUDGLRJUDSK\IRU&7 DQGIRU 05,$JUHHPHQWVEHWZHHQWKHPRGDOLWLHVUDQJHGIRUWKHWKUHHREVHUYHUVEHWZHHQ VXEVWDQWLDODQGQHDUSHUIHFWN :KHQFODVVLI\LQJFDVHVDVLVRODWHG WURFKDQWHULFDYXOVLRQVWKHUHZDVDJUHHPHQWRQQRIUDFWXUHVZLWK05, &RQFOXVLRQ 6HHPLQJO\ LVRODWHG DYXOVLRQ IUDFWXUHV RI WKH JUHDWHU WURFKDQWHU DOZD\VKDYHDWURFKDQWHULFH[WHQVLRQ&7DQGUDGLRJUDSK\DUHRIWHQDGHTXDWHLQ GLDJQRVLQJIUDFWXUHVRIWKHJUHDWHUWURFKDQWHUEXWQRWDOZD\VWKHH[WHQVLRQ05, UHYHDOVWKHLQWHUWURFKDQWHULFFRPSOH[LW\EXWZLWKXQFHUWDLQFOLQLFDOYDOXHDVLWPD\ RYHUHVWLPDWHWKHQHHGIRULQWHUQDOÀ[DWLRQDQGWKXVDQXQQHFHVVDU\SURFHGXUH 6FLHQWLILF6HVVLRQ 6 &$' ( ) *+% (XURSHDQ&RQJUHVVRI 5DGLRORJ\ % 'XDOHQHUJ\&7P\HORJUDSK\LQSDWLHQWVZLWKVSLQDORVWHRV\QWKHVLV $(*UDPV-6HQGHU50RULW]7 6FKPLGW06WHLQ02HUWHO *$.URPEDFK(5*L]HZVNL*LHVVHQ'(DVWULGJUDPV#JRRJOHPDLOFRP 3XUSRVH7KHSXUSRVHZDVWRHYDOXDWHEHQHÀWVRI&7P\HORJUDSK\LQGXDOHQHUJ\ '(WHFKQLTXHLQSDWLHQWVZLWKSUHYLRXVOXPEDURVWHRV\QWKHVLV 0HWKRGVDQG0DWHULDOVSDWLHQWVZHUHLQFOXGHG$IWHULQWUDWKHFDOLQMHFWLRQRI LRGLQH FRQWUDVW DJHQW D '(&7 VFDQ 6RPDWRP 'HÀQLWLRQ 6LHPHQV ZLWK WXEH YROWDJHVRIN9DQGN9ZDVSHUIRUPHGDQGDYLUWXDOVHULHVRIN9ZDV JHQHUDWHG,QDOOVHULHVLPSDFWRIPHWDODUWHIDFWVRQWKHYLVXDOLVDWLRQRIWKHVSLQDO FDQDO DQG WKH VSLQDO IRUDPLQD ZHUH HYDOXDWHG ,Q DGGLWLRQ D 957 VHULHV RI WKH GXUDOVDFZDVJHQHUDWHGZLWK´ERQHUHPRYDOµZKLFKZDVFRPSDUHGWRFRQYHQWLRQDO P\HORJUDSK\GDWD 5HVXOWV:LWKWXEHYROWDJHVRIN9DUWHIDFWVZHUHOHDVWSURQRXQFHGDQGGLGQRW OLPLWHYDOXDWLRQRIWKHVSLQDOFDQDODQGWKHQHXUDOIRUDPLQD:LWKN9DUWHIDFWV OLPLWHGWKHHYDOXDWLRQPRGHUDWHO\,QWKHYLUWXDON9VHULHVLPDJLQJTXDOLW\ZDV RQO\VOLJKWO\GLPLQLVKHGFRPSDUHGWRN99LVXDOLVDWLRQRIWKHGXUDOVDFLQWKH 957 ZDV FRPSDUDEOH WR WKH ´JROG VWDQGDUGµ FRQYHQWLRQDO P\HORJUDSK\ ,Q RQH SDWLHQW ZLWK DGGLWLRQDO LQWHUYHUWHEUDO PDWHULDO YLUWXDO P\HORJUDSK\ ZDV EHWWHU LQ YLVXDOLVDWLRQRIWKHGXUDOVDFLQDQWHULRUSRVWHULRUYLHZ &RQFOXVLRQ&7LQ'(WHFKQLTXHSURYLGHVPLQLPDODUWHIDFWGLVWXUEDQFHZLWKWKH N9WXEHYROWDJHLQSDWLHQWVDIWHURVWHRV\QWKHVLV,WSURYLGHVWKHSRVVLELOLW\RI ´YLUWXDOP\HORJUDSK\µZKLFKVHHPVDGYDQWDJHRXVLQSDWLHQWZLWKFRPSOH[VWDEL OLVDWLRQ7KLVFRXOGUHGXFHWKHQHHGRIH[WHQVLYHFRQYHQWLRQDOUDGLRJUDSK\DIWHU WKHLQMHFWLRQRIFRQWUDVWDJHQWDQGPD\VKRUWHQWKHHQWLUHH[DPLQDWLRQWLPHXQ QHFHVVDU\SDLQIXOPRYHPHQWVIRUWKHSDWLHQWVDQGVKRUWHQWKHUDGLDWLRQH[SRVXUH IRUWKHUDGLRORJLVW 5RRP,. $EGRPLQDO9LVFHUD 66E $EGRPHQ 0RGHUDWRUV )$$UUHGRQGR*XDWHPDOD&LW\*7 2%XFNOH\'XEOLQ,( % 7KHDPRXQWRIUHVHFWHGOLYHUWLVVXHGHWHUPLQHVYHORFLW\DQG FRPSOHWHQHVVRIOLYHUUHJHQHUDWLRQDIWHUSDUWLDOKHSDWHFWRP\ 3 *.HOH07 'H%RHU(-9DQGHU-DJW-$/LVPDQ5-3RUWH *URQLQJHQ1/SJNHOH#UDGXPFJQO 3XUSRVH7 RHYDOXDWHOLYHUUHJHQHUDWLRQIROORZLQJSDUWLDOKHSDWHFWRP\E\FRPSXWHG WRPRJUDSKLF&7YROXPHWU\ 0HWKRGVDQG0DWHULDOV1LQHW\RQHSDWLHQWVXQGHUJRLQJSDUWLDOKHSDWHFWRP\IRU GLIIHUHQWLQGLFDWLRQVZHUHLQFOXGHG9ROXPHWU\ZDVSHUIRUPHGVHPLDXWRPDWLFDOO\ RQ&7VFDQVE\GUDZLQJIUHHKDQGUHJLRQVRILQWHUHVWVLQWKHSRUWDOYHQRXVSKDVH RQPPWKLFNQHVVVOLFHV7 RWDOOLYHUWKHSDUWWREHUHVHFWHGWXPRXUVIXWXUH OLYHUUHPQDQW)/5DQGOLYHUUHPQDQWV/5ZHUHPHDVXUHG7KUHHUHJHQHUDWLRQ YHORFLW\LQGLFHV59,VZHUHFDOFXODWHG59,GD\VSRVWRSHUDWLYHO\59,HDUO\ GHÀQHG DV 9/5GD\V9)/59)/5 ZKHUH 9/5GD\V LV WKH GD\S R V W VXUJHU\/5YROXPHDQG9)/5LVWKH)/5YROXPH59,EHWZHHQWKHSRVWRSHUDWLYH DQGVXEVHTXHQWVFDQ59,ODWHFDOFXODWHGDV9/50RQWKV9/5GD\V9)/5 ZKHUH9/5PRQWKVLVWKHPRQWKV/5YROXPH59,PRQWKVSRVWVXUJLFDOO\ 59,WRWDOFDOFXODWHGDV9/5PRQWKV9)/59)/5 3DWLHQWVZHUHFODVVLÀHG LQWRJURXSVSDWLHQWVZLWKDQG UHVHFWLRQRIWKHWRWDOSUHRSHUDWLYHOLYHUYROXPH 5HVXOWV7KH59,HDUO\UDQJHGIURPDPHGLDQRILQJURXSWRLQJURXS 7KH59,ODWHUDQJHGIURPDPHGLDQRILQJURXSWRLQJURXS7KH 59,WRWDOUDQJHGIURPDPHGLDQLQJURXSWRLQJURXS $WSRVWRSHUDWLYH GD\WKH/5UHSUHVHQWHGDQGRIWKHWRWDOSUHRSHUDWLYH OLYHUYROXPHIRUJURXSVDIWHUDPHGLDQRIPRQWKVWKLVZDV DQGUHVSHFWLYHO\ &RQFOXVLRQ5HJHQHUDWLRQLVSURSRUWLRQDOWRWKHUHVHFWHGYROXPHZLWKKLJKHU59,V DIWHUODUJHUUHVHFWLRQV3RVWVXUJLFDOO\WKHOLYHUGRHVQRWUHJHQHUDWHWRLWVRULJLQDO YROXPHLQPRVWSDWLHQWV $WWKHODPLQHFWRP\OHYHOWKHGHJUHHRIGLVFGHJHQHUDWLRQWKHFDOVDFFRPSUHV VLRQQHUYHURRWFRPSUHVVLRQIRUDPLQDOVWHQRVLVIDFHWGHJHQHUDWLRQZHUHJUDGHG IURPWRWKHSUHVHQFHRIDOLJQPHQWGLVRUGHUVÁDYDOOLJDPHQWWKLFNHQLQJZHUH GHWHUPLQHGE\05,7KHUHVXOWVRISDWLHQWVZLWKZLWKRXWFOLQLFDOLPSURYHPHQWZHUH FRPSDUHG 5HVXOWV0HDQDJHZDVWKHGXUDWLRQRIV\PSWRPVZDV\HDUV -2$6,ZDVVLJQLÀFDQWO\GLIIHUHQWIURP-2$6,,S 0HDQ +5 RI WKH LPSURYHG SDWLHQWV Q ZDV +5 RI WKH XQLPSURYHG SDWLHQWVQ ZDVWKHGLIIHUHQFHZDVVWDWLVWLFDOO\VLJQLÀFDQW7KHUH ZDVQRVWDWLVWLFDOGLIIHUHQFHEHWZHHQWKHWZRJURXSVE\PHDQVRIVH[WKHSUHV HQFHRIDOLJQPHQWGLVRUGHUVDJHDQGGXUDWLRQRIFRPSODLQWVEHIRUHWKHVXUJHU\ DQGUDGLRORJLFVWHQRVLVSDUDPHWHUV &RQFOXVLRQ $OWKRXJKWKHGHJUHHRIUDGLRORJLFVWHQRVLVGLGQRWVKRZDQ\SUHGLFWLRQ DERXWWKHVXUJLFDORXWFRPHVRISDWLHQWVKDYLQJ,3'LWGRHVQRWPHDQWKDWSDWLHQWV ZLWKVHYHUHVWHQRVLVZLOOQRWEHQHÀWIURPGHFRPSUHVVLRQVXUJHU\ % 3HUFXWDQHRXVYHUWHEURSODVW\ZLWK'URWDWLRQDOÁXRURVFRS\LPDJLQJ YV&7ZLWKPRELOH&DUPÁXRURVFRS\JXLGDQFH $&DQQDYDOH) )DQHOOL0&RURQD0$OOHJULWWL3 /XFDWHOOL53DVVDULHOOR 5RPH,7DOHVVDQGURFDQQDYDOH#KRWPDLOFRP 3XUSRVH7KHGHYHORSPHQWRIURWDWLRQDODQJLRJUDSKLFXQLWV5$8ZLWKÁDWGHWHF WRUVKDVPDUNHGO\LQFUHDVHGDQDWRPLFYLVXDOLVDWLRQFDSDELOLWLHVIRULQWHUYHQWLRQDO UDGLRORJ\SURFHGXUHV:HHYDOXDWHGWKHUHOLDELOLW\RI5$8DVDVLQJOHWHFKQLTXH WRJXLGHSHUFXWDQHRXVYHUWHEURSODVW\393YV&7ZLWKPRELOH&DUPÁXRURVFRS\ &7&DUP 0HWKRGV DQG 0DWHULDOV )LIW\ FRQVHFXWLYH SDWLHQWV YHUWHEUDO ERGLHV OXPEDUDQGWKRUDFLFZHUHWUHDWHGXQGHU5$8$UWLV]HHZLWK''URWDWLRQDO DFTXLVLWLRQV1 DQG&7FRXSOHGZLWKPRELOH&DUPÁXRURVFRS\1 :H FRPSDUHGWKHWZRWHFKQLTXHVDERXWLPDJLQJTXDOLW\ÁXRURVFRS\WLPHSDWLHQWDQG RSHUDWRUH[SRVXUHGRVHWHFKQLFDOVXFFHVVPHDQSURFHGXUHWLPHPHDQQXPEHU RIURWDWLRQDODFTXLVLWLRQVDQGFRPSOLFDWLRQV 5HVXOWV5$8DOORZHGDVDIHDFFHVVDQGDQDFFXUDWHFRQWURORIWKHERQHFHPHQW LQMHFWLRQLQDOOFDVHVHYHQDWWKHWKRUDFLFOHYHOVDQGLQFDVHRIYHUWHEUDSODQD1R FHPHQWOHDNDJHVZHUHHQFRXQWHUHG7KHPHDQSURFHGXUHWLPHZDV5$8 YVPLQXWHV&7&DUPS 0HGLDQÁXRURVFRS\WLPHZDV5$8DQG PLQ&7&DUPS 0HDQQXPEHURIURWDWLRQDODFTXLVLWLRQVZDV5$8 DQG&7&DUP0HDQSDWLHQWGRVHZDVP6Y5$8YVP6Y&7&DUP 0HDQRSHUDWRUGRVHERG\KDQGVZDVP6Y5$8YVP6Y &7&DUPS &RQFOXVLRQ 5RWDWLRQDO ÁXRURVFRS\ FRPELQHV WKH PRVW YDOXDEOH LQWHUYHQWLRQDO IHDWXUHVRI&7DQGÁXRURVFRS\LQWRRQHWHFKQRORJ\,WDOORZVUHDOWLPHYLVXDOLVDWLRQ RILQWHUYHQWLRQDOSURFHGXUHVXVLQJ'&7OLNHLPDJHV393ZLWK'ÁXRURVFRS\ ZLWKURWDWLRQDODFTXLVLWLRQVLVDUHOLDEOHDQGIHDVLEOHWHFKQLTXHUHGXFLQJWLPHRIWKH SURFHGXUHDQGDOORZLQJIDVWDQGFRVWHIIHFWLYHSURFHGXUHVZLWKKLJKUDWHRIVXFFHVV % &REODWLRQYHUWHEURSODVW\DVDPHDQVRIWUHDWLQJKLJKULVNSDLQIXO YHUWHEUDOFRPSUHVVLRQIUDFWXUHV '-:LOVRQ6(2ZHQ5$&RUNLOO2[IRUG8.GMZLOVRQ#KHUDOGR[DFXN 3XUSRVH,WKDVEHFRPHDSSDUHQWWKDWWKHUHDUHPDQ\FDQFHUSDWLHQWVZKRZRXOG EHQHÀWIURPVSLQDOFHPHQWDXJPHQWDWLRQWRSUHYHQWSDLQDQGDOVRWRSUHYHQWFDWD VWURSKLFFROODSVHGHVSLWHWKHULVNDVVRFLDWHGZLWKSRVWHULRUZDOOGHIHFW $WHFKQLTXH KDVEHHQGHYHORSHGDOORZLQJWKHGHVWUXFWLRQRIWKHWXPRXULWVHOIE\FROGDEODWLRQ YDSRULVLQJWKHWXPRXUWLVVXHDQGFUHDWLQJDFDYLW\7KLVFDYLW\FDQWKHQEHÀOOHG ZLWKFHPHQWDWORZSUHVVXUHUHGXFLQJWKHULVNRIGLVSODFLQJWKHWXPRXUSRVWHULRUO\ 0HWKRGVDQG0DWHULDOV:HKDYHQRZFRPSOHWHGWZHQW\VHYHQSURFHGXUHV7KHVH LQFOXGHSDWLHQWVZLWKP\HORPDZLWKPDOLJQDQF\ZLWKRVWHRSRURVLVDQG ZLWKWUDXPD5HYLHZRIWKHRXWFRPHPHDVXUHVZDVEDVHGRQURXWLQHEDVHOLQHDQG SRVWSURFHGXUHSDLQDQGGLVDELOLW\VFRUHVXVLQJYLVXDODQDORJXHSDLQVFDOHDQGWKH 5RODQG0RUULVSRLQWGLVDELOLW\VFRUH 5HVXOWV7KHWHFKQLTXHDGGVWRPLQXWHVWRWKHSURFHGXUHWLPH7KHHTXLSPHQW LVPRUHFRPSOH[DQGFRVWVDURXQG(XURVPRUH:HKDYHQRWVHHQDQLQFUHDVH LQFRPSOLFDWLRQVXVLQJWKLVWHFKQLTXHHYHQWKRXJKWKHSDWLHQWVDUHPRUHGLIÀFXOW DQGFRPSOH[2XURXWFRPHPHDVXUHVDUHQRWDVVXFFHVVIXODVWKRVHREWDLQHGE\ FRQYHQWLRQDOYHUWHEURSODVW\LQWKHVLPSOHUSDWLHQWVZKHUHXVLQJRXUORFDODQDHVWKHWLF DQGYHUWHEURSODVW\SURWRFROZHZRXOGH[SHFWLPSURYHPHQWLQRYHU2YHUDOO REWDLQHGVRPHLPSURYHPHQWXVLQJFREODWLRQYHUWHEURSODVW\ &RQFOXVLRQ7KLVWHFKQLTXHLQFUHDVHVWKHVDIHW\RISHUIRUPLQJFHPHQWDXJPHQWD WLRQLQSDWLHQWVZLWKSRWHQWLDOO\FDWDVWURSKLFWXPRXULQYDVLRQDQGWUHDWVSDWLHQWV ZKRZRXOGRWKHUZLVHEHXQVXLWDEOHIRUWUHDWPHQWE\YHUWHEURSODVW\ 6FLHQWLILF6HVVLRQ $ 6&'()*+%(XURSHDQ&RQJUHVVRI 5DGLRORJ\ 0RQGD\ ZDVDVVHVVHGXVLQJFRHIÀFLHQWRIYDULDWLRQ&9UHSHDWDELOLW\FRHIÀFLHQW5&DQG LQWUDFODVVFRUUHODWLRQFRHIÀFLHQW,&& 5HVXOWV+))PHDVXUHGXVLQJ3'DQG056IRUDOOVXEMHFWVZHUHDQG UHVSHFWLYHO\U S&9IRU+))XVLQJ3' ZDV VLJQLÀFDQWO\ ORZHU S WZRWDLOHG :LOFR[RQ PDWFKHG SDLUV WHVW WKDQ WKDWXVLQJ0566LPLODUO\5&RI3'+))ZDVVLJ QLÀFDQWO\ORZHUSWKDQWKDWRI056+))0RUHRYHU,&&IRU 3'ZDVVLJQLÀFDQWO\KLJKHUSWKDQWKDWIRU056 &RQFOXVLRQ3'VKRZVKLJKHUUHSURGXFLELOLW\WKDQ056LQPHDVXULQJ+))QRQ LQYDVLYHO\:LWKRXWH[WHQVLYHSRVWSURFHVVLQJDQDO\VLV3'PD\RIIHUSURPLVHDVD UREXVWWRROWRPHDVXUH+))IRUWKHHQWLUHOLYHUUHSURGXFLEO\LQGLDJQRVLVWUHDWPHQW DQGIROORZXSRIKHSDWLFVWHDWRVLVDWFOLQLFDOÀHOGVWUHQJWKZLWKLQDVLQJOHEUHDWKKROG % (DUO\KHSDWLFDUWHU\WKURPERVLVDIWHUOLYHUWUDQVSODQWDWLRQWKH LPSDFWRIRQVHWDQGDGGLWLRQDOULVNIDFWRUVLQDPDWFKHGFDVHFRQWUROVWXG\ -%HNNHU9)LGOHU.3 GH-RQJ5RWWHUGDP1/*URQLQJHQ1/ MDVEHNNHU#KRWPDLOFRP 3XUSRVH,QWKLVVWXG\ZHWHVWHGWKHK\SRWKHVLVWKDWHDUO\GHWHFWLRQRIH+$7DQG UHYDVFXODULVDWLRQRIWKHJUDIWLVDVVRFLDWHGZLWKDEHWWHUJUDIWVXUYLYDO:HDQDO\VHG JUDIWDQGSDWLHQWVXUYLYDOLQSDWLHQWVZLWKLQWUDRSHUDWLYH+$7+$7GHWHFWHGDQG WUHDWHGGXULQJWUDQVSODQWDWLRQYHUVXVWKRVHZLWKSRVWRSHUDWLYH+$7 $GGLWLRQDOO\ ZH LGHQWLÀHG ULVN IDFWRUV IRU H+$7 E\ FRPSDULQJ H+$7 SDWLHQWV ZLWK QRQH+$7 SDWLHQWVDQGE\SHUIRUPLQJDFDVHFRQWUROVWXG\LQZKLFKSDWLHQWVZHUHPDWFKHG IRUWKHWZRPRVWLPSRUWDQWULVNIDFWRUVIRUH+$7 WUDQVSODQWDWLRQLQFKLOGUHQDQG UHWUDQVSODQWDWLRQ 0HWKRGVDQG0DWHULDOV%HWZHHQ-DQXDU\DQG$XJXVWGDWDRI OLYHUWUDQVSODQWDWLRQVLQSDWLHQWVZHUHUHWULHYHGIURPRXUSURVSHFWLYHGDWDEDVH +$7ZDVSUHVHQWLQRIWUDQVSODQWDWLRQV 5HVXOWV7KHVXFFHVVUDWHRIUHYDVFXODULVDWLRQDWWHPSWVZDVFRPSDUDEOHLQWKH LQWUDRSHUDWLYH+$7JURXSDQGWKHSRVWRSHUDWLYH+$7JURXS 3 0XOWLYDULDWHULVNIDFWRUVDVVRFLDWHGZLWKDQLQFUHDVHGLQFLGHQFHRIHDUO\ KHSDWLFDUWHU\WKURPERVLVDIWHUOLYHUWUDQVSODQWDWLRQZHUHFKLOGUHQUHWUDQVSODQWDWLRQ DQGUHGXFHGVL]HJUDIWV,QGHSHQGHQWULVNIDFWRUVIRUH+$7ZHUH&09PLVPDWFK GRQRUUHFLSLHQWFRPELQDWLRQDORZHUSURWKURPELQWLPHDQGDKLJKHUOHYHORI KDHPRJORELQ &RQFOXVLRQ7KLVVXJJHVWVWKDWHDUO\GHWHFWLRQGRHVQRWUHVXOWLQDEHWWHURXWFRPH RIH+$7LQWHUPVRIDORZHUUHWUDQVSODQWDWLRQUDWH$VDQDGGLWLRQDOSRWHQWLDOULVN IDFWRUIRUH+$7 ZHLGHQWLÀHGDKLJKKDHPRJORELQOHYHOLQWKHLPPHGLDWHSRVWRS HUDWLYHSHULRG % %RG\FRPSRVLWLRQFKDQJHVDIWHUOLYHUWUDQVSODQWDWLRQ $%D]]RFFKL 3 6SLQQDWR$&HQQL3 =DSSROL) )X]]L*)LORQ]L *%LDQFKL&5RVVL%RORJQD,73DUPD,7IHGHULFDIX]]L#JPDLOFRP 3XUSRVH 7KH DLP RI WKH VWXG\ ZDV WR HYDOXDWH ERG\ FRPSRVLWLRQ FKDQJHVLQ SDWLHQWVXQGHUJRLQJRUWKRWRSLFOLYHUWUDQVSODQWDWLRQ2/7 0HWKRGVDQG0DWHULDOV7ZHQW\WKUHHSDWLHQWVPDOHVDQGIHPDOHVPHDQ DJHUDQJH\HDUVVXEPLWWHGWR2/7ZHUHSURVSHFWLYHO\HQUROOHGLQWKH VWXG\3DWLHQWVVWDUWHGLPPXQRVXSSUHVVLYHWKHUDS\ZLWKGLIIHUHQWFRPELQDWLRQVRI WUDFUROLPXVD]DWKLRSULQHDQGVWHURLGV,QDOOSDWLHQWVDERG\FRPSRVLWLRQDQDO\VLV ZDVSHUIRUPHGE\DQHZGXDOHQHUJ\[UD\DEVRUSWLRPHWU\HTXLSPHQW/XQDUL';$ *(+HDOWKFDUHEHIRUHDQGDIWHUWUDQVSODQWDWLRQDQGPRQWKV)DW PDVV )0 QRQERQH OHDQ PDVV /0 ERQH PLQHUDO FRQWHQW DQG GHQVLW\ ZHUH DVVHVVHGLQDWKUHHFRPSDUWPHQWZKROHERG\DQGUHJLRQDOPRGHO 5HVXOWV$OO SDWLHQWV FRQFOXGHG WKH IROORZXS SURJUDP )RXU RXW RI SDWLHQWV SUHVHQWHG ZLWK GLDEHWHV EHIRUH 2/7 DQG ZHUH GLDEHWLF DIWHUVXUJHU\7 RWDODQGDQGURLG)0/0VKRZHGDVOLJKWGHFUHDVHDWPRQWKVEXW UDWLRVURVHXSLQWKHVXEVHTXHQWPRQWKVZLWKVWDWLVWLFDOO\VLJQLÀFDQWGLIIHUHQFHV EHWZHHQPRQWKYDOXHVDQGEDVHOLQHS IRUWRWDOERG\IRUDQGURLG UHJLRQ $QGURLGJ\QRLGLQGH[RIIDWGLVWULEXWLRQGLGQRWVKRZDQ\VLJQLÀFDQWFKDQJH DIWHUWUDQVSODQW,QVXOLQWUHDWPHQWGLGQRWVLJQLÀFDQWO\DIIHFWDQ\ERG\FRPSRVL WLRQSDUDPHWHUZKLOHVWHURLGGRVDJHZDVLQYHUVHO\FRUUHODWHGZLWKDQGURLG)0 /0UDWLRS &RQFOXVLRQ%RG\FRPSRVLWLRQDVVHVVPHQWLVHVVHQWLDOLQWKHXQGHUVWDQGLQJRI SK\VLRSDWKRORJ\DQGPHWDEROLFUHODWHGGLVRUGHUVDQG';$LVDYDOLGWRRODWWKLVDLP 3DWLHQWVVXEPLWWHGWR2/7VKRZHGVLJQLÀFDQWFKDQJHVRIWKHLUERG\FRPSRVLWLRQ WKDWPLJKWEHUHODWHGWRGLIIHUHQWPHWDEROLFGHVWLQLHV % /LYHULURQFRQFHQWUDWLRQTXDQWLÀFDWLRQE\05,DUHUHFRPPHQGHG SURWRFROVDFFXUDWHHQRXJKIRUFOLQLFDOSUDFWLFH" -0$OXVWL]D $&DVWLHOOD-,(PSDUDQ]D(=DSDWD%&RVWHUR0,'H] (6DOYDGRU6DQ6HEDVWLDQ(60HQGDUR(6$OFDODGH+HQDUHV(6 MPDOXVWL]D#RVDWHNHV 3XUSRVH7 RDVVHVVWKHTXDQWLÀFDWLRQRIOLYHULURQFRQFHQWUDWLRQ/,&E\05,XVLQJ WKH5HQQHV8QLYHUVLW\85HQQHVPRGHO 0HWKRGVDQG0DWHULDOV7KH/,&FDOFXODWHGE\WKH85HQQHVPRGHOLQSD WLHQWVZHUHFRPSDUHGWR/,&REWDLQHGE\FKHPLFDOPHDVXUHPHQWLQOLYHUELRSVLHV 5HVXOWV$FFRUGLQJWRWKHELRSV\SDWLHQWVKDGQRRYHUORDGPRO)HJ KDGPRGHUDWHRYHUORDGPRO)HJDQGKDGKLJKLURQRYHUORDG+,2 !PRO)HJ7KHUHLVDFRUUHODWLRQEHWZHHQWKH/,&HVWLPDWHGZLWK05,DQG WKH PHDVXUHPHQW REWDLQHG ZLWK D ELRSV\ U 05, FRUUHFWO\FODVVLÀHG SDWLHQWVLQWKHYDULRXVOHYHOVRI/,&'LDJQRVWLFDFFXUDF\LVZLWKDWHQGHQF\ WRRYHUHVWLPDWHRISDWLHQWVZLWKQRRYHUORDGZHUHGLDJQRVHGDVRYHUORDGHG DQGRISDWLHQWVZLWKPRGHUDWHRYHUORDGZHUHGLDJQRVHGDVKDYLQJ+,27KH VHQVLWLYLW\RIWKH85HQQHVPHWKRGIRU+,2LVDQGWKHVSHFLÀFLW\IRUDEVHQFH RIRYHUORDGLV7KHHVWLPDWHGFRQFHQWUDWLRQV!PRO)HJUHYHDOHGD 339IRU+,2RIHVWLPDWHGYDOXHVPRO)HJKDGD139RIIRU +,27KHSDWLHQWVZLWKLQWHUPHGLDWHYDOXHVUHPDLQLQXQFHUWDLQW\ &RQFOXVLRQ7KH85HQQHVPRGHOLVDEOHWRFRUUHFWO\GLDJQRVHDQGUXOHRXW+,2LQ DERXWRISDWLHQWVZLWKYHU\VSHFLÀFFXWRIISRLQWVRIDQGPRO)HJ)RU LQWHUPHGLDWHYDOXHVWKHGLDJQRVLVLVQRWDVFOHDUDQGDQDGGLWLRQDOWHVWWRPHDVXUH /,&RUDQHPSLULFDOWUHDWPHQWVKRXOGEHHYDOXDWHG % 1HZUHJLRQVRILQWHUHVWLQERG\FRPSRVLWLRQDQDO\VLVE\GXDOHQHUJ\ [UD\DEVRUSWLRPHWU\OLYHU´DGLSRVLW\µ ''LDQR$$QGUHRQH**DU]LOOR*)LORQ]L&6DVVL8$OELVLQQL*%DWWLVWD (6DOL]]RQL$%D]]RFFKL%RORJQD,7JLDFRPRÀORQ]L#JPDLOFRP 3XUSRVH +HSDWLF VWHDWRVLV LV DQ LQFUHDVLQJ ZRUOGZLGH PHWDEROLF GLVHDVHD Q G WKHHDUOLHVWELRPDUNHUIRUWKHOLYHUÀEURVLVGHYHORSPHQW7KXVLWVGHWHFWLRQDQG TXDQWLÀFDWLRQGXULQJQRQLQYDVLYHH[DPLQDWLRQVVKRXOGEHDOZD\VFRQVLGHUHGDV FOLQLFDOO\UHOHYDQW2XUDLPZDVWRWHVWQHZGHVLJQHGUHJLRQVRILQWHUHVW52,V RQ ZKROH ERG\ LPDJHV DFTXLUHG E\ GXDO HQHUJ\ [UD\ DEVRUSWLRPHWU\ ';$ LQ FRPSDULVRQ ZLWK ';$ FRQYHQWLRQDO 52,V DQG XOWUDVRQRJUDSK\ 86LQ RUGHU WR HYDOXDWHSUHGLFWLYHYDOXHVRQOLYHUVWHDWRVLVGHWHFWLRQDQGJUDGLQJ 0HWKRGVDQG0DWHULDOV1LQHW\QLQHVXEMHFWVGLUHFWHGWRERG\FRPSRVLWLRQDVVHVV PHQWE\';$ZHUHSURVSHFWLYHO\HQUROOHG $OOSDWLHQWVZHUHVXEPLWWHGWRZKROHERG\ ';$VFDQ/XQDUL';$VRIWZDUHHQ&25(DQGXQGHUZHQW86HYDOXDWLRQRQ WKHVDPHGD\WRDVVHVVKHSDWLFVWHDWRVLVPLOGPRGHUDWHVHYHUH2QHYHU\';$ LPDJHWKUHHQHZOLYHUVXLWHG52,VZHUHPDQXDOO\FUHDWHGE\DVNLOOHGUDGLRORJLVW )DWPDVV)0DQG)0SHUFHQWDJH)0SZHUHLQYHVWLJDWHGRQZKROHERG\DQG UHJLRQDOO\DQGURLGDQGQHZ52,V)0DQG)0SUHVXOWVZHUHFRUUHODWHGZLWK86 5HVXOWV2XWRISDWLHQWVUHVXOWHGDIIHFWHGE\OLYHUVWHDWRVLVRQ86 HYDOXDWLRQïPLOGïPRGHUDWHDQGïVHYHUH )0DQG)0SRIDOO52,VZHUHVLJQLÀFDQWO\FRUUHODWHGZLWKSUHVHQFHDQGJUDGLQJRI VWHDWRVLVSKRZHYHUWKH\ZHUHDEOHWRSUHGLFWDQGWRGLVWLQJXLVKVWHDWRVLV DEVHQFHIURPPRGHUDWHDQGVHYHUHJUDGHEXWQRWPLOG)0SRIRQHDPRQJWKHQHZ OLYHUVXLWHG52,VVKRZHGWKHEHVWSUHGLFWLYHYDOXHIRUOLYHUVWHDWRVLV &RQFOXVLRQ1HZ52,VVKRXOGEHLQFOXGHGLQZKROHERG\';$H[DPLQDWLRQVWR SURYLGHDGGLWLRQDOLQIRUPDWLRQDQGKLJKHUSUHGLFWLYHYDOXHRQOLYHUVWHDWRVLV % 5HSURGXFLELOLW\RIWZRSRLQW',;21WHFKQLTXHIRUPHDVXULQJKHSDWLF IDWIUDFWLRQ $0&KRZ**/R-.) &KDQ6/DX(:RQJ6.<X+DSS\9DOOH\+. DSULOFPN#JPDLOFRP 3XUSRVH7 RHYDOXDWHWKHUHSURGXFLELOLW\RIWZRSRLQW',;213'WHFKQLTXHIRU PHDVXULQJKHSDWLFIDWIUDFWLRQ+))LQKHDOWK\VXEMHFWV 0HWKRGVDQG0DWHULDOVKHDOWK\VXEMHFWV0)DJH \HDUV%0, NJPZHUHLQFOXGHG $OO05,H[DPLQDWLRQVZHUHSHUIRUPHGRQD7 VFDQQHU0$*1(720$HUD6LHPHQV%UHDWKKROG3'ZDVSHUIRUPHGD[LDOO\ XVLQJDJUDGLHQWHFKRVHTXHQFHZLWK7( PVRXWRISKDVH23DQGLQ SKDVH,3UHVSHFWLYHO\+))PDSVZHUHFDOFXODWHGDV6,LQ6,RXW[6,LQ[ 3URWRQPDJQHWLFUHVRQDQFHVSHFWURVFRS\056ZDVDOVRSHUIRUPHGXVLQJEUHDWK KROG67($0RYHUD[[FPYR[HOZLWK757( PVDQGDYHUDJHV $IWHU7FRUUHFWLRQ+))ZDVWKHQFDOFXODWHGDVDUHDOLSLGDUHDZDWHUDUHDOLSLG ['XSOLFDWHPHDVXUHPHQWVZHUHDFTXLUHGDIWHUUHSRVLWLRQLQJ5HSURGXFLELOLW\ 6FLHQWLILF6HVVLRQ 6 &$' ( ) *+% (XURSHDQ&RQJUHVVRI 5DGLRORJ\ JHQHUDWHGZKLFKDOORZGLUHFWPHDVXUHPHQWRISUHDQGSRVWFRQWUDVWGHQVLW\RQD VLQJOHSKDVHDFTXLVLWLRQ'LDJQRVLVRIDGUHQDODGHQRPDZDVPDGHLI&7GHQVLW\ LQ WKH YLUWXDO QRQHQKDQFHG LPDJH ZDV ORZHU WKDQ +8 /RQJWHUP IROORZXS QRQFRQWUDVW&7LQDQGRSSRVHGSKDVH05,VHUYHGDVWKHVWDQGDUGRIUHIHUHQFH 5HVXOWV%DVHGRQIROORZXSLPDJLQJRIWKHDGUHQDOPDVVHVZHUH EHQLJQDGUHQDODGHQRPDV $WDFXWRIIYDOXHRI+8YLUWXDOQRQHQKDQFHGLPDJHV DOORZHGIRUFRUUHFWGLDJQRVLVLQRIFDVHVZKHUHDVDGUHQDODGHQRPDV ZHUHOLSLGSRRUZLWKDGHQVLW\KLJKHUWKDQ+8 &RQFOXVLRQ9LUWXDOQRQHQKDQFHGLPDJHVIURPGXDOHQHUJ\&7DOORZIRUDFFXUDWH FKDUDFWHULVDWLRQRIDGUHQDOPDVVHV'(&7WKHUHIRUHKHOSVWRDYRLGXQQHFHVVDU\ IROORZXSLPDJLQJQRQFRQWUDVW&7 05, 5RRP/0 &RQWUDVW0HGLD 66 $SSOLFDWLRQVLQ86&7DQG05, 0RGHUDWRUV &8+HUERUQ+DPEXUJ'( 35HLPHU.DUOVUXKH'( % &RQWUDVWHQKDQFHGXOWUDVRXQGHUURUVDQGDUWHIDFWV 0-HGU]HMF]\N.7 6]RSLQVNL:DUVDZ3/NV]RSLQVNL#ZXPHGXSO 3XUSRVH&RQWUDVWHQKDQFHGXOWUDVRXQG&(86LVWHFKQLFDOO\GHPDQGLQJDQG PDQ\IDFWRUVFDQLQÁXHQFHWKHTXDOLW\RIWKHH[DPLQDWLRQ $UHWURVSHFWLYHDQDO\VLV ZDV SHUIRUPHG WR DVVHVV WKH IUHTXHQF\ DQG VHYHULW\ RI HUURUV DQG DUWHIDFWV LQ &(86H[DPLQDWLRQV 0HWKRGVDQG0DWHULDOV7KHÀOPVRI&(86H[DPLQDWLRQVRIWKHOLYHUNLG QH\VERZHOEUHDVWWK\URLGO\PSKQRGHVVRIWWLVVXHWXPRXUVDQGPXVFOHVZHUH UHYLHZHGUHWURVSHFWLYHO\7KHH[DPLQDWLRQVZHUHSHUIRUPHGZLWKORZPHFKDQLFDO LQGH[WHFKQLTXHXVLQJWKH6RQR9XH%UDFFR$OWDQDFRQWUDVWDJHQW&$7KHHUURUV DQGDUWHIDFWVZHUHVXEGLYLGHGLQWRPDFKLQHVHWWLQJVUHODWHGLQFRUUHFWPDFKLQH VHWWLQJV &$UHODWHG SUHSDUDWLRQ DQG DGPLQLVWUDWLRQ RI WKH FRQWUDVW PHGLXP SDWLHQWUHODWHG ODUJH ERG\ KDELWXV SDWLHQW SUHSDUDWLRQ FRRSHUDWLRQ ZLWK WKH SDWLHQWH[DPLQDWLRQWHFKQLTXHUHODWHGDQGDUFKLYLQJDQGLQWHUSUHWDWLRQHUURUV$ VHULRXVHUURUZDVGHÀQHGDVWKHRQHZKLFKFRXOGDGYHUVHO\DIIHFWWKHGLDJQRVLV RUUHTXLUHDUHSHDWH[DPLQDWLRQ 5HVXOWV ,Q UHYLHZHG ÀOHV HUURUV ZHUH GHWHFWHG RI H[DPLQD WLRQV$PRQJWKHHUURUVZHUHVHULRXVRIWKHH[DPLQDWLRQVRI DOOHUURUV0RVWHUURUVZHUHPDFKLQHVHWWLQJVUHODWHGDQGSDWLHQWUHODWHG +RZHYHUWKHJUHDWHVWSHUFHQWDJHRIVHULRXVHUURUVZDVQRWHGLQ&$UHODWHG DQGH[DPLQDWLRQWHFKQLTXHUHODWHGHUURUV &RQFOXVLRQ7KHHUURUVDQGDUWHIDFWVDUHFRPPRQLQ&(862IWHQWKH\FDQLPSDLU WKHÀQDOGLDJQRVLV7KH\KDYHWREHUHFRJQLVHGDQGWDNHQLQWRDFFRXQWVLQFHWKH SURSRUWLRQRIVHULRXVHUURUVLVVXEVWDQWLDO % %ROXVYHUVXVFRQWLQXRXVLQIXVLRQRIPLFUREXEEOHFRQWUDVWDJHQWIRU OLYHU86XVLQJDQDXWRPDWLFSRZHULQMHFWRU (4XDLD%&DELEER63XOYLUHQWL:7 RVFDQR0&RYD7ULHVWH,7 TXDLD#XQLWVLW 3XUSRVH7 RSURVSHFWLYHO\DVVHVVLIFRQWLQXRXVLQIXVLRQRIVXOSKXUKH[DÁXRULGH ÀOOHGPLFUREXEEOHVFDQSURORQJWKHGXUDWLRQRIKHSDWLFHQKDQFHPHQWDWXOWUDVRQRJ UDSK\RYHUEROXVLQMHFWLRQ 0HWKRGVDQG0DWHULDOVSDWLHQWVPDOHVDQGIHPDOHVPHDQDJH6' UHFHLYHGWZRLQMHFWLRQVRQHEROXVLQMHFWLRQP/VHFDQGRQHFRQWLQXRXV LQIXVLRQP/PLQZLWKWKHVDPHGRVHP/RIVXOSKXUKH[DÁXRULGHÀOOHG PLFUREXEEOHVLQMHFWHGWKURXJKDIRUHDUPRUDQWHFXELWDOYHLQWKURXJKDQJDXJH LQWUDYHQRXVFDWKHWHUXVLQJDQDXWRPDWLFSRZHULQMHFWRU2QHXQHQKDQFHGEDVHOLQH VZHHSVFDQPHFKDQLFDOLQGH[RIRIWKHULJKWOLYHUOREHZDVDFTXLUHGRQWKH ORQJLWXGLQDOSODQHIROORZHGE\FRQWUDVWHQKDQFHGVZHHSVDIWHUEROXVLQMHFWLRQDQG FRQWLQXRXVLQIXVLRQ(DFKVZHHSZDVVDYHGDV',&20FLQHFOLSVDQGDQDO\VHG E\ D GHGLFDWHG VRIWZDUH ZKLFK FDOFXODWHG WKH JUDGH RI FRQWUDVWHQKDQFHPHQW H[SUHVVHGDVWKHSHUFHQWDJHLQFUHDVHRIHFKRVLJQDOLQWHQVLW\LQJUD\VFDOHOHYHOV RYHUEDVHOLQHVFDQ 5HVXOWV 'XUDWLRQ RI HQKDQFHPHQW ZDV SURORQJHG E\ FRQWLQXRXV LQIXVLRQ IURP PLQXWHVDWEROXVLQMHFWLRQWRPLQXWHV31RGLIIHUHQFH LQWKHPD[LPDOSDUHQFK\PDOHQKDQFHPHQWZDVREVHUYHGRQEROXVYVFRQWLQXRXV % 3UHRSHUDWLYHO\PSKQRGHVWDJLQJLQSDWLHQWVZLWKUHFWDOFDQFHUXVLQJ G\QDPLFPDJQHWLFUHVRQDQFHLPDJLQJLQLWLDOUHVXOWV 7 9DJ-6ORWWD+XVSHQLQD81LWVFKH55RVHQEHUJ(5XPPHQ\-*DD 0XQLFK'(WLERUYDJ#KRWPDLOFRP 3XUSRVH7 RHYDOXDWHWKHDFFXUDF\RIG\QDPLF05,IRUSUHRSHUDWLYHO\PSKQRGH VWDJLQJLQUHFWDOFDQFHUXVLQJFRPSXWHULVHGDQDO\VLV 0HWKRGVDQG0DWHULDOVSDWLHQWVUHFHLYHGSUHRSHUDWLYHG\QDPLF05,7 V\VWHP9,%(VHTXHQFHVLQPLQXWHLQWHUYDOVIRUDWRWDORIPLQXWHVLGHQWLI\LQJ O\PSKQRGHVORFDWHGLQWKHPHVRUHFWDOIDW&RQWUDVWHQKDQFHPHQWFKDUDFWHULVWLFV RILGHQWLÀHGO\PSKQRGHVZHUHHYDOXDWHGXVLQJFRPSXWHUDLGHGDQDO\VLVVRIWZDUH 7KHSURJUDPDQDO\VHVWLPHLQWHQVLW\FXUYHVYR[HOZLVHZLWKLQDPDQXDOO\VHWYROXPH RILQWHUHVWDQGVXPPDULVHVWKHSHUFHQWXDOGLVWULEXWLRQRIWKHGLIIHUHQWHQKDQFH PHQWSDWWHUQVLQDSURÀOHPDS$OOSDWLHQWVXQGHUZHQWUHFWDOUHVHFWLRQZLWKWRWDO PHVRUHFWDOH[FLVLRQ,GHQWLÀHGO\PSKQRGHVRQ05,ZHUHFRPSDUHGWKRVHIURP KLVWRSDWKRORJLFH[DPLQDWLRQV 5HVXOWV O\PSK QRGHV GHPRQVWUDWHG PHWDVWDWLF LQYROYHPHQW DW KLVWRSDWKR ORJLFDOH[DPLQDWLRQO\PSKQRGHVZHUHIUHHRIPHWDVWDVLV0HDQSHUFHQWXDO GLVWULEXWLRQRIHQKDQFHPHQWSDWWHUQVLQPDOLJQDQWO\PSKQRGHVVKRZHGUDSLGLQLWLDO HQKDQFHPHQWIROORZHGE\GHFUHDVHLQWKHODWHSKDVH´ZDVKRXWµLQDQG UDSLGHQKDQFHPHQWIROORZHGE\ÁDWWHQLQJ´SODWHDXµRUE\LQFUHDVHLQWKHGHOD\HG SKDVH´SHUVLVWHQWµLQDQGUHVSHFWLYHO\,QFRPSDULVRQGLVWULEXWLRQ RI HQKDQFHPHQW SDWWHUQV LQ QHJDWLYH O\PSK QRGHV GHPRQVWUDWHG ZDVKRXW SDW WHUQLQ3SODWHDXSDWWHUQLQ3 DQGSHUVLVWHQWSDWWHUQ LQ3 &RQFOXVLRQ'\QDPLFPDJQHWLFUHVRQDQFHLPDJLQJZLWKFRPSXWHULVHGHYDOXDWLRQ RIHQKDQFHPHQWFKDUDFWHULVWLFVPLJKWLQFUHDVHGLDJQRVWLFDFFXUDF\LQGLIIHUHQWLDWLQJ SRVLWLYHIURPQHJDWLYHO\PSKQRGHVLQUHFWDOFDQFHU % 6WDQGDUGLVHGFLQHORRSLQDEGRPLQDOXOWUDVRXQG\LHOGVKLJKUHOLDELOLW\ RIVRQRJUDSKLFÀQGLQJV -'RUPDJHQ0*DDUGHU$'UROVXP2VOR12MREDGRU#IULVXUIQR 3XUSRVH 7 R FRPSDUH DEGRPLQDO JUH\VFDOH XOWUDVRXQG ÀQGLQJV RI LPPHGLDWH EHGVLGHUHDGLQJE\SHUIRUPLQJUDGLRORJLVWZLWKLQGHSHQGHQWRIÁLQHUHDGLQJE\D QRQSHUIRUPLQJUDGLRORJLVW 0HWKRGVDQG0DWHULDOV2YHUDVL[PRQWKSHULRGWKUHHUDGLRORJLVWVSHUIRUPHG G\QDPLFXOWUDVRXQGH[DPLQDWLRQVLQRXWGRRUSDWLHQWV([DPLQDWLRQSURWRFROV ZHUHVWDQGDUGLVHGZLWKSUHGHÀQHGSUREHSRVLWLRQDQGVHTXHQFHVRIVKRUWFLQHORRSV RIWKHOLYHUJDOOEODGGHUSDQFUHDVNLGQH\VDQGXULQHEODGGHUFRYHULQJWKHRUJDQV FRPSOHWHO\LQWZRSODQV7KHVWXGLHVZHUHUHYLHZHGDQGUHDGRXWLPPHGLDWHO\E\ WKHSHUIRUPLQJUDGLRORJLVW2IÁLQHUHDGLQJZDVSHUIRUPHGEOLQGHGE\DUDGLRORJLVW ZKRKDGQRWSHUIRUPHGWKHH[DPLQDWLRQ,PDJHTXDOLW\ZDVUHJLVWHUHGIURPQR GLDJQRVWLFYDOXHWRH[FHOOHQWFLQHORRSTXDOLW\%HGVLGHDQGRIÁLQHUHDGLQJZHUH FRPSDUHGZLWKHDFKRWKHUDQGZLWKFRQVHQVXVUHVXOWV 5HVXOWV,QH[DPLQDWLRQVFRQVHQVXVUHDGLQJUHYHDOHGFDVHVZLWKUHQDO GLVRUGHUVFDVHVZLWKOLYHUDQGELOHSDWKRORJ\DQGFDVHVZLWKEODGGHUSDWKRO RJ\2YHUDOOLQWHUREVHUYHUDJUHHPHQWZDV&,ZLWKORZHVW DJUHHPHQWIRUÀQGLQJVRIWKHXULQHEODGGHUDQGKLJKHVWDJUHHPHQWLQOLYHU H[DPLQDWLRQV'LVDJUHHPHQWVEHWZHHQWKHWZRUHDGLQJVZHUHVHHQLQQLQH NLGQH\VWKUHHEODGGHUH[DPLQDWLRQVWZRSDQFUHDVDQGELOHV\VWHPH[DPLQDWLRQV HDFKDQGLQRQHOLYHUJLYLQJDQXPEHURIPLVPDWFKHVRI1HDUO\DOOFDVHV RIPLVPDWFKZHUHRIPLQRUFOLQLFDOVLJQLÀFDQFH7KHPHGLDQLPDJHTXDOLW\ZDV %HGVLGHFRQVHQVXV GLVFUHSDQFLHV GLG QRW GLIIHU VLJQLÀFDQWO\ IURP RIÁLQH FRQVHQVXVGLVFUHSDQFLHV &RQFOXVLRQ6WDQGDUGLVHGG\QDPLFFLQHORRSWHFKQLTXHLQDEGRPLQDOXOWUDVRXQG \LHOGVKLJKUHOLDELOLW\RIÀQGLQJV,PDJHLQWHUSUHWDWLRQFDQEHSHUIRUPHGLQGHSHQG HQWO\IURPSHUIRUPLQJEHGVLGHH[DPLQDWLRQ % &KDUDFWHULVDWLRQRIDGUHQDOPDVVHVXVLQJVLQJOHSKDVHGXDOHQHUJ\&7 $+HOFN1+XPPHO7 -RKQVRQ05HLVHU$*UDVHU 0XQLFK'(DQGUHDVKHOFN#PHGXQLPXHQFKHQGH 3XUSRVH7 RHYDOXDWHWKHGLDJQRVWLFDFFXUDF\RIGXDOHQHUJ\&7EDVHGDWWHQXDWLRQ PHDVXUHPHQWVLQWKHFKDUDFWHULVDWLRQRIDGUHQDOPDVVHV 0HWKRGV DQG 0DWHULDOV :H UHWURVSHFWLYHO\ LGHQWLÀHG SDWLHQWV ZLWK DGUHQDO PDVVHVZKRKDGXQGHUJRQHVLQJOHSKDVHDEGRPLQDOFRQWUDVWHQKDQFHGGXDOHQ HUJ\&7RUN9SN9SRQDGXDOVRXUFHVFDQQHU6LHPHQV6RPDWRP 'HÀQLWLRQ'HÀQLWLRQ)ODVKIRUYDULRXVLQGLFDWLRQV8VLQJGHGLFDWHGSRVWSURFHVVLQJ WHFKQLTXHV YLUWXDO QRQHQKDQFHG DQG FRORXUFRGHG LRGLQH RYHUOD\ LPDJHV ZHUH 6FLHQWLILF6HVVLRQ $ 6&'()*+%(XURSHDQ&RQJUHVVRI 5DGLRORJ\ 0RQGD\ DQ\%:À[HGVFDQWLPLQJZHUHXVHG(QKDQFHPHQWRIWKHDRUWDDQGOLYHUDQG WXPRXUWROLYHUFRQWUDVW7/&DW $3DQGDWHTXLOLEULXPSKDVH(3ZHUHFRPSDUHG EHWZHHQWKHVHSURWRFROV 5HVXOWV7KUHHKXQGUHGDQGIRUW\RISDWLHQWVKDGK\SHUYDVFXODU+&&7KHUDWH DVVHVVHG´JRRGRUEHWWHUµDV7/&DW $3ZHUH $%&DQG' ,QSDWLHQWVZLWKKLJKHU%:!NJTXDOLWDWLYH7/&DW $3DQGTXDQWLWDWLYH DRUWLFHQKDQFHPHQWLQSURWRFRO $&ZHUHVLJQLÀFDQWO\KLJKHUWKDQWKRVHLQSURWRFRO 'ZKHUHDVTXDQWLWDWLYH7/&DW $3LQSURWRFRO $&ZDVVLJQLÀFDQWO\ORZHUWKDQWKDW LQSDWLHQWVZLWKORZHU%:NJ(QKDQFHPHQWRIOLYHUDQG7/&DW(3VKRZHG QRVLJQLÀFDQWGLIIHUHQFHEHWZHHQSURWRFROV &RQFOXVLRQ,QSDWLHQWVZLWKKLJKHU%:!NJSURWRFROVRI%:WDLORUHGGRVH RI&0DQGRUÀ[HGLQMHFWLRQGXUDWLRQVKRXOGEHHPSOR\HGWRGLDJQRVHK\SHUYDV FXODU+&&V % 'LDJQRVWLFXWLOLW\RIGRXEOHFRQWUDVW05,'&05,IRUHYDOXDWLRQ RIWUHDWPHQWUHVSRQVHRIKHSDWRFHOOXODUFDUFLQRPDWRDEODWLYH WUHDWPHQWV7$&(3(,5)$ $&HQWROD/3 6WRSSLQR&%ULVWRJLDQQLV*6DQWDQJHOR3 0LOLOOR3 /XSR 59LQFL/0DFDULQL)RJJLD,7DQQDULWDFHQWROD#IDVWZHEQHWLW 3XUSRVH7 RDVVHVVUHFXUUHQFHRIGLVHDVHLQKHSDWRFHOOXODUFDUFLQRPD+&&QRG XOHVDIWHUORFRUHJLRQDOWUHDWPHQWE\VHTXHQWLDOXVHRIVXSHUSDUDPDJQHWLFLURQR[LGH 63,2DQGWKHJDGROLQLXPGLHWK\OHQHWULDPLQHSHQWDDFHWLFDFLG*G'73$FRQWUDVW DJHQWVFRPSDUHGZLWKXQHQKDQFHG05,DQG63,2HQKDQFHG05,63,205, 0HWKRGVDQG0DWHULDOV:HHQUROOHGFRQVHFXWLYHSDWLHQWVDIIHFWHGE\KHSDWLF FLUUKRVLV ZLWK D WRWDO RI +&& QRGXOHV WUHDWHG E\ ORFRUHJLRQDO WUHDWPHQWV SDWLHQWVZHUHWUHDWHGZLWKWUDQVDUWHULDOFKHPRHPEROLVDWLRQ7$&(SDWLHQWVZLWK UDGLRIUHTXHQF\ DEODWLRQ 5)$ DQG SDWLHQWV ZHUH WUHDWHG ZLWK SHUFXWDQHRXV HWKDQROLQMHFWLRQ3(,'&05,VWXG\ZDVSHUIRUPHGRQHPRQWKDIWHUWUHDWPHQW 5HVXOWV$YLDEOH+&&ZDVIRXQGLQRIQRGXOHVWUHDWHGE\7$&(LQ RIQRGXOHVWUHDWHGE\3(,DQGLQRIQRGXOHVWUHDWHGE\ 5)$,QDOOWKHVHFDVHV'&05,WHFKQLTXHFODULÀHGWKH05SLFWXUHLPSURYLQJWKH SRVVLELOLW\WRGLDJQRVHWKHSUHVHQFHRUDEVHQFHRIYLDEOH+&&ZLWKLQSRVWWUHDWPHQW OLYHUÀEURVLVDVZHOODVDQHDUO\GHWHFWLRQRIG\VSODVWLFQRGXOHVE\FRPSDULQJ XQHQKDQFHG05,63,2HQKDQFHGDQG'&05LPDJHV &RQFOXVLRQ7KH FRPELQHG XVH RI WZR FRQWUDVW DJHQWV QHJDWLYH DQG SRVLWLYH LPSURYHG WKH GLDJQRVLV RI YLDEOH WXPRXU LQ WUHDWHG +&& ZLWKLQ SRVWWUHDWPHQW OLYHUÀEURVLV % 0DJQHWLFUHVRQDQFHLPDJLQJFRQWUDVWRIEUDLQWXPRXUVDW7HVOD FRPSDUHGWR7HVODHQKDQFHPHQWDIWHUKDOIDQGIXOOURXWLQH FRQWUDVWDJHQWGRVH ,01RHEDXHU+XKPDQQ3 6]RPRODQ\L9-XUDV&.URQQHUZHWWHU 06FKPRRN'3D\HU67UDWWQLJ9LHQQD$7LULVQRHEDXHU#PHGXQLZLHQDFDW 3XUSRVH7 RFRPSDUHWKHGLDJQRVWLFHIÀFDF\RIDKDOIDQGDIXOOGRVHRIJDGROLQLXP EDVHG05FRQWUDVWDJHQWLQSULPDU\EUDLQWXPRXUVDW7 HVOD05YHUVXV7 HVOD 0HWKRGVDQG0DWHULDOVSDWLHQWVPIPHDQDJH\HDUVUDQJH ZLWK PDOLJQDQW SULPDU\ EUDLQ WXPRXUV ZHUH H[DPLQHG RQ ERWK D 7 HVOD DQG D7 HVOD05ZKROHERG\XQLW%HIRUHDQGDIWHULQWUDYHQRXVDGPLQLVWUDWLRQRI *DGREHQDWH GLPHJOXPLQH LQ D GRVDJH RI PPRONJ DQG PPRONJ ERG\ ZHLJKWDVDJLWWDO'*5(VHTXHQFHZLWKPDJQHWLVDWLRQSUHSDUDWLRQ035$*( ZLWK757(7,PVHFDW7 HVODDQG757(7,PV DW7 HVODZHUHSHUIRUPHG6LJQDOLQWHQVLWLHVE\UHJLRQRILQWHUHVWPHDVXUHPHQWV LQWKHOHVLRQDQGWKHFRQWUDODWHUDOQRUPDOZKLWHDQGJUH\PDWWHUZHUHDVVHVVHG DQGWKHEDFNJURXQGQRLVHZDVPHDVXUHG7KHWXPRXUWREUDLQFRQWUDVWZDVFDO FXODWHG)RUVWDWLVWLFDODQDO\VLVWZRZD\$129$WHVWVIRUUHSHDWHGPHDVXUHVDQG SDLUHGWWHVWVZHUHXVHG 5HVXOWV7KHPHDQWXPRXUWREUDLQFRQWUDVWDIWHUFRQWUDVWDJHQWDGPLQLVWUDWLRQ ZDVVLJQLÀFDQWO\KLJKHUDW7 HVODWKDQDW7 HVODIRUERWKKDOIWKHGRVH YVDQGWKHIXOOURXWLQHGRVHYVS 7KHGLIIHUHQFHEHWZHHQKDOIDQGIXOOGRVHDWHDFKÀHOGVWUHQJWKZDVDOVRVWDWLVWL FDOO\VLJQLÀFDQWS7KHUHZDVQRGLIIHUHQFHEHWZHHQKDOIWKHGRVHDW 7 HVODDQGWKHIXOOGRVHDW7 HVODS &RQFOXVLRQ7KHUHVXOWVVXJJHVWWKDWLWLVSRVVLEOHWRUHGXFHWKHFRQWUDVWDJHQW GRVHLQWKHH[DPLQDWLRQRIEUDLQWXPRXUVDW7 HVOD PLFUREXEEOHLQIXVLRQLQFUHDVHRYHUEDVHOLQHEROXVLQMHFWLRQDQG LQFUHDVHRYHUEDVHOLQHLQIXVLRQ3 &RQFOXVLRQ &RQWLQXRXV LQIXVLRQ RI VXOSKXU KH[DÁXRULGHÀOOHG PLFUREXEEOHV SHUIRUPHGWKURXJKDXWRPDWLFSRZHULQMHFWRUSURORQJVWKHKHSDWLFHQKDQFHPHQW ZLWKRXWPRGLI\QJWKHPD[LPDOSDUHQFK\PDOHQKDQFHPHQWRYHUWKHEDVHOLQH % 3URVSHFWLYHHYDOXDWLRQRIYDVFXODUDOWHUDWLRQVLQOLYHUWUDQVSODQWDWLRQ E\LQWUDRSHUDWLYH&(86FRPSDUHGWRFRQYHQWLRQDO'RSSOHU86D SLORWVWXG\ 1/HR(9LEHUW2&LDFLR/5LFFD5$GDP'&DVWDLQJ0/HZLQ 9LOOHMXLI)5XVWUH#\DKRRLW 3XUSRVH 7 R HYDOXDWH GLDJQRVWLF SHUIRUPDQFH RI LQWUDRSHUDWLYH PLFUREXEEOH FRQWUDVWPDWHULDOHQKDQFHGXOWUDVRQRJUDSK\&(86IRUDVVHVVPHQWRIYDVFXODU DOWHUDWLRQVLQOLYHUWUDQVSODQWDWLRQ/7FRPSDUHGZLWKLQWUDRSHUDWLYHFRQYHQWLRQDO 'RSSOHUXOWUDVRQRJUDSK\86 0HWKRGV DQG 0DWHULDOV7ZHQW\ SDWLHQWV ZHUH LQFOXGHG PDOHV IHPDOHV DYHUDJHDJH\HDUVROG/7SDWLHQWVXQGHUZHQWERWKLQWUDRSHUDWLYHFRQYHQWLRQDO 'RSSOHU86DQG&(86YDVFXODUH[DPLQDWLRQVXVLQJDQ$ORND$OSKDGHYLFHDQG LQWUDYHQRXVPLFUREXOOHVDVDFRQWUDVWDJHQW 5HVXOWV,QWZRSDWLHQWV'RSSOHU86ZDVQRUPDOZKLOHWKH&(86ZDVQRWLQRQH FDVH&(86VKRZHGÁRZUHGXFWLRQLQKHSDWLFYHLQVDQGWKHRWKHUVKRZHGDUWHU\ ÁRZDOWHUDWLRQGXHWRDV\PSWRPDWLFDUFXDWHOLJDPHQW7KHVHUHVXOWVKDGLPPHGL DWHPHGLFDODQGVXUJLFDOLPSOLFDWLRQV,QDQRWKHUWZRSDWLHQWV'RSSOHU86IDLOHG WRYLVXDOLVHKHSDWLFDUWHU\ÁRZZKLOHWKLVÁRZZDVVKRZQE\&(867KXV'RSSOHU 86ZDVZURQJLQRISDWLHQWV &RQFOXVLRQ ,QWUDRSHUDWLYH &(86 FOHDUO\ LPSURYHV WKH UHOHYDQFH RI YDVFXODU LPDJHU\LQ/7SDWLHQWVDVFRPSDUHGWRFRQYHQWLRQDO'RSSOHU867KLVWHFKQLTXH VKRXOGEHUHFRPPHQGHGIRUDEHWWHUPDQDJHPHQWRIWKHVHSDWLHQWV % (YDOXDWLRQLQYLWURRIQHZSRO\PHULFFRQWUDVWPLFUREXEEOHVXVLQJ 4RQWUDVWVRIWZDUH 90LJDOHGGX96DQQD'6FDQX*3LQWXV'6LULJX68]]DX00DU]R 06HFKL*9LUJLOLR6DVVDUL,7PLJDOHGGX#VPLUJRUJ 3XUSRVH7 RHYDOXDWHLQYLWURXVLQJXOWUDVRXQGWKHUHÁHFWLYLW\RIQHZSURWRW\SHV RIPLFUREXEEOHV0%VFRQWDLQLQJDLUZLWKWKHVKHOORIGLIIHUHQWELRFRPSDWLEOHDQG ELRGHJUDGDEOHFRSRO\PHUVSRO\ODFWLFDFLG3/$SRO\JO\FROLFODFWLFDFLG3*/$ DQG3*/$FRQMXJDWHGZLWKSRO\HWK\OHQHJO\FRO3*/$3(* 0HWKRGVDQG0DWHULDOV8VLQJDQH[SHULPHQWDOPRGHORIGHJDVVHGDQGGHLRQLVHG ZDWHUHDFKVDPSOHRI0%VZDVHYDOXDWHGZLWKD0+]FRQYH[SUREH6HTXRLD $FXVRQ6LHPHQV8OWUDVRXQGLPDJLQJZDVREWDLQHGXVLQJDFRQWUDVWVSHFLÀFVRIW ZDUH&DGHQFH&RQWUDVW3XOVH6HTXHQFLQJ $TXDQWLWDWLYHDQDO\VLVRIWKHHFKRHV LQWHQVLW\ZDVSHUIRUPHGWKURXJKWKHVSHFLÀF4RQWUDVWVRIWZDUH$GYDQFHG0HGL FDO,PDJLQJ'HYHORSPHQW%UDFFR,WDO\VHOHFWLQJPDQXDOO\DUHJLRQRILQWHUHVW 5HVXOWV7KHLQWHQVLW\RIVLJQDOSURGXFHGE\WKHGLIIHUHQW0%VKDVEHHQFRPSDUHG WR WKDW RI ZDWHU (DFK 0%V SURWRW\SH GHPRQVWUDWHG D VLJQDO UHODWHG WR FRDWLQJ FRPSRVLWLRQ6LJQDOLQWHQVLW\LQFUHDVHGLQWKHRUGHU3/$3/*$3/*$3(* LQSDUWLFXODUHUHVSHFWLYHO\REWDLQLQJDVLJQLÀFDQW VWDWLVWLFDOFRUUHODWLRQS &RQFOXVLRQ0%VZLWKVKHOORI3/*$3(*UHVXOWHGWKHPRVWHIIHFWLYHLQWHUPVRI UHÁHFWLYLW\DIWHUH[SRVXUHWRXOWUDVRXQG6RWKH\PLJKWEHIXUWKHURSWLPLVHGDQG XVHGDVSRWHQWLDOFDUULHUVIRUVHOHFWLYHGUXJGHOLYHU\ % 7KHHIÀFDF\RIFRQWUDVWSURWRFROLQOLYHUG\QDPLF&7 PXOWLFHQWUH SURVSHFWLYHVWXG\LQFRPPXQLW\KRVSLWDOVLQ-DSDQ 02NDGD +.RQGR+6RX7 0XUDNDPL0.DQHPDWVX7 ,FKLNDZD .$ZDL.<RVKLPLWVX< <DPDVKLWD2VDND6D\DPD-3*LIX-3.RIX-3 +LURVKLPD-3)XNXRND-3.XPDPRW-3 3XUSRVH 7 R FRPSDUH WKH HIIHFWV RI FRQWUDVW PDWHULDO &0 ZLWK IRXU GLIIHUHQW LQMHFWLRQWHFKQLTXHVRQWKHFRQVSLFXLW\RIK\SHUYDVFXODUKHSDWRFHOOXODUFDUFLQRPD +&&LQSDWLHQWVZLWKOLYHUGDPDJH 0HWKRGVDQG0DWHULDOV7KHVXUYH\ZDVFRQGXFWHGLQLQVWLWXWLRQVDVSRVWPDU NHWLQJVXUYHLOODQFHDQGOLYHUG\QDPLF&7GDWDRISDWLHQWVZLWK+&&FP ZHUHREWDLQHG)RXULQMHFWLRQSURWRFROV$ERG\ZHLJKW%:WDLORUHGGRVHRI&0 PJ,P/RI,RKH[ROÀ[HGLQMHFWLRQGXUDWLRQVÀ[HGDUWHULDOSKDVH$3 VFDQWLPLQJ%%:WDLORUHGGRVHRI&0À[HGLQMHFWLRQGXUDWLRQV$3VFDQ WLPLQJDGMXVWHGE\EROXVWUDFNLQJ&%:WDLORUHGGRVHRI&0À[HGLQMHFWLRQÁRZ UDWH$3 VFDQ WLPLQJ DGMXVWHG E\ EROXV WUDFNLQJ ' P/ FRQVWDQW RI &0 DW 6FLHQWLILF6HVVLRQ 6 &$' ( ) *+% (XURSHDQ&RQJUHVVRI 5DGLRORJ\ 0HWKRGV DQG 0DWHULDOV :H SURGXFHG D SK\VLRORJLFDO SKDUPDFRNLQHWLF PRGHO RI D FRQWUDVW HQKDQFHPHQW VLPXODWLRQ RI WKH DRUWD EDVHG RQ D FRPSDUWPHQW PRGHO XVLQJ VRIWZDUH :H À[HG WKH FDUGLDF LQGH[ DV OPLQP 6LPXODWHG WLPHHQKDQFHPHQWFXUYHVRI&7$DQGSHDN&7DWWHQXDWLRQYDOXHVIRUERG\ZHLJKWV NJZHUHDQDO\VHGXVLQJWKUHHGLIIHUHQWSURWRFROVÀ[HGLRGLQHÁX[J VHFLRGLQHÁX[EDVHGRQERG\ZHLJKWPJVHFNJDQGLRGLQHÁX[EDVHG RQ %6$ PJVHFP$ FRQWUDVW DJHQW DW PJPO ZDV SRVWXODWHG WR EH LQMHFWHGIRUVHFRQGVLQWKHVHWZRH[DPLQDWLRQV 5HVXOWV8QOLNHSDVWVWXGLHVZHH[FOXGHGWKHHIIHFWVRIYDULDEOHFDUGLDFIXQFWLRQE\ À[LQJWKHFDUGLDFLQGH[,QWKLVPHWKRGWKHSURWRFRODGMXVWHGWR%6$GHPRQVWUDWHG WKHOHDVWXQHYHQWLPHDWWHQXDWLRQFXUYHDWGLIIHUHQWERG\ZHLJKWVDQGWKHOHDVWYDUL DWLRQLQHQKDQFHPHQWSHDNRIWKHWKUHHSURWRFROVVKRZLQJVWDWLVWLFDOGLIIHUHQFHV &RQFOXVLRQ7KH FRQWUDVW PDWHULDO LQMHFWLRQ SURWRFRO DGMXVWHG WR %6$ SURYLGHG DRUWLFHQKDQFHPHQWLQSDWLHQWVZLWKDZLGHYDULHW\RIERG\ZHLJKWVPRUHFRQVLVW HQWO\WKDQWKHRWKHUWZRSURWRFROV 5RRP12 9DVFXODU 66 &DURWLGDUWHULHV 0RGHUDWRUV ((VWHEDQ$O]LUD(6 $6SLQHOOL5RPH,7 % &KDUDFWHULVDWLRQRIQHRYDVFXODULVDWLRQLQFDURWLGDWKHURVFOHURWLF SODTXHVZLWKFRQWUDVWHQKDQFHGXOWUDVRXQG '$&OHYHUW$+HOFN:6RPPHU7 6DDP05HLVHU 0XQLFK'('LUN&OHYHUW#PHGXQLPXHQFKHQGH 3XUSRVH7 RHYDOXDWHWKHXVHRIFRQWUDVWHQKDQFHGXOWUDVRXQGLQWKHQHRYDVFX ODULVDWLRQZLWKLQFDURWLGDWKHURVFOHURWLFSODTXHV 0HWKRGVDQG0DWHULDOVSDWLHQWVZLWKNQRZQDWKHURVFOHURWLFSODTXHVLQWKH FDURWLGDUWHU\ZHUHH[DPLQHGZLWKFRQWUDVWHQKDQFHGXOWUDVRXQGWRUROHRXWWKH IHDWXUHVRIQHRYDVFXODULVDWLRQZLWKLQWKLVSODTXH$GGLWLRQDOO\WKHVHSODTXHVZHUH DQDO\VHGDQGFRUUHODWHGZLWKSODTXHVL]HDQGHFKRJHQLFLW\)RUFRQWUDVWHQKDQFHG XOWUDVRXQGZHLQMHFWHGFFRI6RQR9XH%UDFFR,WDO\LY7KHH[DPLQDWLRQVZHUH SHUIRUPHGXVLQJWKH6RU6HTXRLD6LHPHQV$FXVRQ0RXQWDLQ9LHZ ZLWKDQ0+]RU0+]SUREHXVLQJWKH&36VRIWZDUH 5HVXOWV7KHUHZHUHDWKHURVFOHURWLFSODTXHVRIZKLFKVRIWDQGPL[HG HQKDQFHGDIWHULQMHFWLRQRI6RQR9XH7KHHQKDQFHPHQWRFFXUUHGIURPWKHFDURWLG ZDOOWRWKHFHQWHURIWKHSODTXHZLWKDVKRUWOLQHSDWWHUQLQSODTXHVZKHUHDV SODTXHVHQKDQFHGIURPERWKWKHFDURWLGZDOODQGWKHFDURWLGOXPHQZLWKMXVWD OLWWOHVSRWSDWWHUQ7KHDUULYDOWLPHRIFRQWUDVWZDVODWHULQWKHSODTXHVWKDQLQWKH FDURWLGDUWHU\DQGWKHWLPHWRSHDNZDVORQJHULQWKHSODTXHVWKDQLQWKHFDURWLG OXPHQ$PRQJWKHXQHQKDQFHGSODTXHVZHUHKDUGZHUHFDOFLÀHGZHUH VRIWDQGZHUHPL[HG7KHXQHQKDQFHGSODTXHVKDGDWKLFNQHVVRIPP &RQFOXVLRQ,QRXUVPDOOSDWLHQWSRSXODWLRQFRQWUDVWHQKDQFHGXOWUDVRXQGDOORZV WKHG\QDPLFHYDOXDWLRQRIQHRYDVFXODULVDWLRQZLWKLQFDURWLGSODTXHVDQGQHRYDV FXODULVDWLRQPD\FRUUHODWHZLWKSODTXHPRUSKRORJ\ % &KDUDFWHULVDWLRQRIDWKHURVFOHURWLFSODTXHRIFDURWLGDUWHULHV KLJKUHVROXWLRQPXOWLVHTXHQFH05LPDJLQJYVFRORXU'RSSOHU XOWUDVRQRJUDSK\86 67 DUWDUL 55L]]DWL03ULQFLYDOOH.&DSHOOR*%HQHD/DJRVDQWR,7 /HJQDUR,7VWDUWDUL#DOLFHLW 3XUSRVH7 RLQYHVWLJDWHZKHWKHUKLJKUHVROXWLRQPXOWLVHTXHQFH05,PDJLQJRIWKH YHVVHOZDOOFDURWLGDUWHULHVFDQGLIIHUHQWLDWHDWULVNVRIWSODTXHIURPVROLGÀEURXV SODTXHPRUHDFFXUDWHO\WKDQFRORXU'RSSOHUXOWUDVRQRJUDSK\86 0HWKRGVDQG0DWHULDOV7KLVVWXG\LQFOXGHGFDURWLGDUWHULHVLQFRQVHFXWLYH SDWLHQWVZKRXQGHUZHQWFDURWLGHQGDUWHUHFWRP\05,7ZLWKQHXURYDVFXODU DUUD\FRLOZDVSHUIRUPHGXVLQJPXOWLSOHVHTXHQFHVGLIIXVLRQZHLJKWHGLPDJLQJ IDWVXSSUHVVHG7ZHLJKWHGÀUVWSDVV&(05$VWHDG\VWDWH'7KLJKUHVROXWLRQ +5 &DURWLG SODTXHV ZHUH JURXSHG LQWR WKUHH FDWHJRULHV EDVHGRQ 05 VLJQDO LQWHQVLW\DQG86SDWWHUQDWULVNVRIWSODTXHZLWKODUJHOLSLGQHFURWLFFRUH/1& JURXS$FRPSOH[ÀEURWLFFDOFLÀHGLQFOXGLQJDVHJPHQWRIOLSLGOLTXLGFRPSRQHQW % KDUG SODTXH ZLWKRXW VRIW FRQWHQW &$GGLWLRQDO YXOQHUDEOH SODTXH IHDWXUHV OLNH,QWUDSODTXHKDHPRUUKDJH,3+DQGXOFHUDWLRQZHUHUHJLVWHUHG05DQG86 % 'RHVKLJKHUJDGROLQLXPFRQFHQWUDWLRQSOD\DUROHLQWKH PRUSKRORJLFDVVHVVPHQWRIEUDLQWXPRXUV"5HVXOWVRIDPXOWLFHQWUH LQWUDLQGLYLGXDOFURVVRYHUFRPSDULVRQRIJDGREXWUROYHUVXV JDGREHQDWHGLPHJOXPLQHWKH0(5,7VWXG\ -9\PD]DO =6HLGO00HFKO0*R\DO0+HUPDQ03DVRZLF] *6FKQHLGHU6%DVWLDQHOOR-5XVFDOOHGD3UDJXH&=%UQR&= &DOJDU\$%&$2ORPRXF&=.UDNRZ3/+RPEXUJ6DDU'(3DYLD,7 %DUFHORQD(6MRVHIY\PD]DO#KRPRONDF] 3XUSRVH7 RLQWUDLQGLYLGXDOO\FRPSDUHDSSURYHGPPRONJGRVHVRIWKHKLJK UHOD[LYLW\05FRQWUDVWDJHQWJDGREHQDWHGLPHJOXPLQH0XOWL+DQFHZLWKWKHKLJK FRQFHQWUDWLRQ DJHQW JDGREXWURO *DGRYLVW IRU FRQWUDVWHQKDQFHG 05, RI EUDLQ WXPRXUV 0HWKRGVDQG0DWHULDOV$GXOWSDWLHQWVZLWKVXVSHFWHGRUNQRZQEUDLQWXPRXUV XQGHUZHQWWZRLGHQWLFDO05,H[DPVDW7 RQHZLWKJDGREHQDWHGLPHJOXPLQHDQG WKHRWKHUZLWKJDGREXWUROERWKDWDGRVHRIPPRONJERG\ZHLJKW7KHDJHQWV ZHUHLQMHFWHGLQUDQGRPLVHGRUGHUVHSDUDWHGE\GD\V,PDJLQJVHTXHQFHV DQG DFTXLVLWLRQ WLPLQJ ZHUH LGHQWLFDO IRU WKH WZR H[DPV7KUHHEOLQGHG UHDGHUV HYDOXDWHGLPDJHVTXDOLWDWLYHO\IRUGLDJQRVWLFLQIRUPDWLRQOHVLRQH[WHQWGHOLQHD WLRQPRUSKRORJ\HQKDQFHPHQWJOREDOSUHIHUHQFHDQGTXDQWLWDWLYHO\IRUOHVLRQ HQKDQFHPHQWFRQWUDVWWRQRLVHUDWLR&15DQGOHVLRQWREDFNJURXQGUDWLR/%5 5HVXOWVRIHQUROOHGSDWLHQWVVXFFHVVIXOO\XQGHUZHQWERWKH[DPLQDWLRQV )LQDOGLDJQRVHVZHUHLQWUDD[LDOWXPRXUVPHWDVWDVHVH[WUDD[LDOWXPRXUVҊRWKHUҋ WXPRXUVDQGҊQRQWXPRXUҋDQGVXEMHFWVUHVSHFWLYHO\5HDGHUV DQGGHPRQVWUDWHGSUHIHUHQFHIRUJDGREHQDWHGLPHJOXPLQHLQ DQGSDWLHQWVUHVSHFWLYHO\FRPSDUHGZLWKDQGSDWLHQWV IRUJDGREXWUROSDOOUHDGHUV+LJKO\VLJQLÀFDQWSDOOUHDGHUV SUHIHUHQFHIRUJDGREHQDWHGLPHJOXPLQHZDVGHPRQVWUDWHGIRUDOORWKHUTXDOLWDWLYH HQGSRLQWV,QWHUUHDGHUDJUHHPHQWZDVJRRGIRUDOOHYDOXDWLRQV. ï 6LJQLÀFDQWO\VXSHULRUOHVLRQHQKDQFHPHQW&15DQG/%5ZDVGHWHUPLQHGIRU JDGREHQDWHGLPHJOXPLQHSDOOUHDGHUV &RQFOXVLRQ+LJKUHOD[LYLW\UDWKHUWKDQKLJKJDGROLQLXPFRQFHQWUDWLRQUHVXOWVLQ VLJQLÀFDQWO\JUHDWHUPRUSKRORJLFLQIRUPDWLRQDQGOHVLRQHQKDQFHPHQWZKHQJDGR EHQDWHGLPHJOXPLQHDQGJDGREXWURODUHFRPSDUHGDWHTXLYDOHQWPPRONJGRVHV % ,URQR[LGHQDQRSDUWLFOHVIRUPDJQHWLFSDUWLFOHLPDJLQJ03, -+DHJHOH) 09RJW-%DUNKDXVHQ7 0%X]XJ./XHGWNH%X]XJ /EHFN'(KDHJHOH#UDGLRORJLHXQLOXHEHFNGH 3XUSRVH0DJQHWLFSDUWLFOHLPDJLQJ03,LVDQHZWRPRJUDSKLFLPDJLQJPHWKRG PHDVXULQJ WKH VSDWLDO FRQFHQWUDWLRQ RI VXSHUSDUDPDJQHWLFLURQR[LGHSDUWLFOHV 63,2V 'XH WR WKH KLJK VHQVLWLYH DQG IDVW GDWD DFTXLVLWLRQ FDSDELOLWLHV 03, LV SHUIHFWO\VXLWHGIRUPROHFXODULPDJLQJDQGG\QDPLFPHDVXUHPHQWVHJTXDQWLWDWLYH DVVHVVPHQWRIP\RFDUGLDOSHUIXVLRQ+RZHYHUVSDWLDOUHVROXWLRQDVZHOODVVHQVL WLYLW\KLJKO\GHSHQGRQWKHSHUIRUPDQFHRIWKHQDQRSDUWLFOHV7KHUHIRUHRXUVWXG\ DLPHGWRFKDUDFWHULVHGLIIHUHQW63,2VZLWKUHJDUGWRWKHLUDSSOLFDELOLW\DV03,WUDFHU 0HWKRGVDQG0DWHULDOV7KHVSHFWUDOVLJQDOVWUHQJWK666DQGWKHWRWDOKDUPRQLF GLVWRUWLRQ7+'RIIRXUGLIIHUHQWFRPPHUFLDOO\DYDLODEOH63,2V5HVRYLVW6LQHUHP (QGRUHPDQG/XPLUHPDQGVHOIV\QWKHVLVHGGH[WUDQFRDWHG63,2VZHUHHYDOX DWHGXVLQJDPDJQHWLFSDUWLFOHVSHFWURPHWHU0367KHPDJQHWLFDPSOLWXGHZDV VHWWRP7 WKHH[FLWDWLRQIUHTXHQF\ZDVN+] 5HVXOWV7KHVHOIV\QWKHVLVHG63,2VSHUIRUPHGEHVWEXWWKHUHZDVQRVLJQLÀFDQW GLIIHUHQFHWR5HVRYLVW7+'YVG%DYHUDJH666[(YV[( $P+]S 6LQHUHP7+'G%666[(DQG(QGRUHP7+' G%666[(VKRZHGVLJQLÀFDQWO\LQIHULRUUHVXOWVZKHUHDV/XPLUHP VKRZHGQRVLJQDODWDOO7KHGLIIHUHQFHVLQSHUIRUPDQFHFDQEHH[SODLQHGE\GLI IHUHQWLURQFRUHVL]HVDQGWKHSUHVHQFHRI63,2DJJUHJDWHV &RQFOXVLRQ 5HVRYLVW DQG WKH VHOIV\QWKHVLVHG 63,2V DUH ZHOO VXLWHG IRU 03, DQGPD\EHDSSOLHGLQGLIIHUHQWFOLQLFDOVFHQDULRV+RZHYHUFRPSDUHGWRDSHUIHFW FRPSRXQGWKHUHLVVWLOOURRPIRULPSURYHPHQWDQGWKHUHVXOWVRIWKLVVWXG\ZLOOJXLGH WKHGHYHORSPHQWRIQHZDJHQWVZLWKRSWLPLVHGLURQFRUHVL]HDQGDJJUHJDELOLW\ % &RQWUDVWPHGLXPLQMHFWLRQSURWRFROIRU&7DQJLRJUDSK\ZLWK&7 FRQWUDVWPHGLXPGRVHDGMXVWHGWRERG\VXUIDFHDUHDZLWKVLPXODWLRQ .$PDNDZD)XNXRND-3ND]XWRVKLBDPDNDZD#\EEQHMS 3XUSRVH7KHSXUSRVHRIWKLVVWXG\ZDVWRHYDOXDWHWKHHIÀFLHQF\RIDFRPSXWHG WRPRJUDSK\DQJLRJUDSK\&7$SURWRFROZLWKWKHFRQWUDVWPHGLXPGRVHDGMXVWHG WRERG\VXUIDFHDUHD%6$XVLQJDVLPXODWLRQPRGHO 6FLHQWLILF6HVVLRQ $ 6&'()*+%(XURSHDQ&RQJUHVVRI 5DGLRORJ\ 0RQGD\ % 7LPHRIÁLJKWLPDJHVDYLDEOHDOWHUQDWLYHWRFRQWUDVWHQKDQFHG05 DQJLRJUDSK\DQGIDWVXSSUHVVHG7ZLPDJHVIRUWKHGLDJQRVLVRI FHUYLFDODUWHU\GLVVHFWLRQ" (0&RSSHQUDWK1/XPPHO-/LQQ.1LNRODRX0) 5HLVHU0'LFKJDQV 7 3IHIIHUNRUQ7 6DDP0XQLFK'((YD&RSSHQUDWK#PHGXQLPXHQFKHQGH 3XUSRVH7 RFRPSDUHWKHGLDJQRVWLFSHUIRUPDQFHRIDQRQHQKDQFHGWLPHRIÁLJKW VHTXHQFH72)05$ZLWKIDWVXSSUHVVHGD[LDOFRURQDO7ZHLJKWHGLPDJHVDQG FRQWUDVWHQKDQFHGDQJLRJUDSK\VWDQGDUG05,IRUWKHGLDJQRVLVRIFHUYLFDODUWHU\ GLVVHFWLRQ&$' 0HWKRGVDQG0DWHULDOVFRQVHFXWLYHSDWLHQWVZRPHQPHQDJH \HDUVZLWKSURYHQ&$'RQVWDQGDUG05,KDGDQDGGLWLRQDO72)05$76LH PHQV9HULRXVLQJGHGLFDWHGVXUIDFHFRLOV0DFKQHW1HWKHUODQGVZLWKLQGD\V 6HQVLWLYLW\6(VSHFLÀFLW\63SRVLWLYHDQGQHJDWLYHSUHGLFWLYHYDOXH339139 DQGDFFXUDF\RI72)05$ZHUHFDOFXODWHGXVLQJWKHVWDQGDUGSURWRFRODVJROG VWDQGDUG,PDJHTXDOLW\DQGGLDJQRVWLFFRQÀGHQFHZHUHDVVHVVHGE\WZRUDWHUV LQ FRQVHQVXV GHFLVLRQ RQ D SRLQW VFDOH$ SYDOXH RI ZDV FRQVLGHUHG VWDWLVWLFDOO\VLJQLÀFDQW 5HVXOWV7KHUHZDVH[FHOOHQWDJUHHPHQWEHWZHHQ72)LPDJHVDQGWKHVWDQGDUG SURWRFROIRUWKHSUHVHQFHDEVHQFHRI&$'ZLWKD&RKHQVNDSSDYDOXHRI S2Q72)LPDJHV&$'LQWKH9VHJPHQWRIWKHYHUWHEUDODUWHU\ZDV PLVVHG,QDGGLWLRQ&$'ZDVIRXQGRQ72)LPDJHVZKLFKZHUHQRWVHHQZLWKWKH VWDQGDUGSURWRFRO7KLVUHVXOWHGLQD6(63 339139DQGDFFXUDF\RI DQGUHVSHFWLYHO\,PDJHTXDOLW\GLGQRWGLIIHUVLJQLÀFDQWO\EHWZHHQ WKHWZRPHWKRGV+RZHYHUGLDJQRVWLFFRQÀGHQFHRIWKH72)VHTXHQFHZDVUDWHG VLJQLÀFDQWO\KLJKHUFRPSDUHGWRWKHVWDQGDUGSURWRFROYVS &RQFOXVLRQ)LQGLQJVRIWKLVVWXG\VXJJHVWWKDW72)LPDJLQJLVDYLDEOHDOWHUQDWLYH WRWKHVWDQGDUGFRQWUDVWHQKDQFHGSURWRFROIRUWKHGLDJQRVLVRI&$' % +HDGWRKHDGFRPSDULVRQRI&7$DQG7EODFNEORRG05,IRU LGHQWLÀFDWLRQRIV\PSWRPDWLFFDURWLGSODTXHV -0*ULPP$6FKLQGOHU) 6FKZDU]&&&\UDQ 0'LFKJDQV7 )UHLOLQJHU0) 5HLVHU.1LNRODRX7 6DDP 0XQLFK'(MRFKHQJULPP#PHGXQLPXHQFKHQGH 3XUSRVH7KHSXUSRVHRIWKLVSURVSHFWLYHVWXG\ZDVWRFRPSDUHPXOWLGHWHFWRU &7DQJLRJUDSK\0'&7$ZLWKEODFNEORRG705,EE05,ZLWKUHVSHFWWRWKHLU DELOLW\WRLGHQWLI\V\PSWRPDWLFFDURWLGSODTXHV 0HWKRGVDQG0DWHULDOVSDWLHQWVZLWKXQLODWHUDOV\PSWRPDWLFFDURWLGGLVHDVH ZKRXQGHUZHQWH[WHQVLYHFOLQLFDOZRUNXSDWRXUVWURNHXQLWWRH[FOXGHRWKHUFDXVHV RILVFKDHPLFVWURNHXQGHUZHQWVWDQGDUG0'&7$DQGEE05,ZLWK72) SUHDQG SRVWFRQWUDVW IV7Z IV7Z DQG IV3'Z VHTXHQFHV ZLWKLQ GD\V RI V\PSWRP RQVHW%RWKV\PSWRPDWLFDQGFRQWUDODWHUDODV\PSWRPDWLFVLGHVZHUHHYDOXDWHG%\ 05,SODTXHPRUSKRORJ\DQGFRPSRVLWLRQDQGSUHYDOHQFHRIFRPSOLFDWHGW\SH9, OHVLRQV$+$/7ZLWKKDHPRUUKDJHWKURPEXVDQGRUUXSWXUHGÀEURXVFDSZHUH HYDOXDWHG%\0'&7$SODTXHW\SHVRIWPL[HGKDUGSODTXHGHQVLW\LQ+8DQG SUHVHQFHRIXOFHUDWLRQDQGWKURPEXVZHUHHYDOXDWHG6HQVLWLYLW\6(VSHFLÀFLW\ 63SRVLWLYHDQGQHJDWLYHSUHGLFWLYHYDOXH339139ZHUHFDOFXODWHGXVLQJD IRXUE\IRXUWDEOH 5HVXOWV7 RGLVWLQJXLVKEHWZHHQV\PSWRPDWLFDQGDV\PSWRPDWLFSODTXHV $+$/7 ZDVWKHEHVW05,YDULDEOHDQGSUHVHQFHDEVHQFHRISODTXHXOFHUDWLRQZDVWKHEHVW &7YDULDEOHUHVXOWLQJLQD6(63 339DQG139RIDQGIRU $+$/7DVDVVHVVHGE\EE05,DQGIRUSODTXHXOFHUDWLRQ DVDVVHVVHGE\0'&7$DQGDQGIRUWKHFRPELQDWLRQRIERWK 0'&7$DQGEE05, &RQFOXVLRQ %E05, GHOLYHUHG D EHWWHU VHQVLWLYLW\ 139 DQG 339 FRPSDUHG WR 0'&7$ DW LGHQWLI\LQJ WKH V\PSWRPDWLF VLGH ZKLOH 0'&7$ RIIHUHGDQ H[FHOOHQW VSHFLÀFLW\%HVWUHVXOWVZHUHREWDLQHGXVLQJERWKWHFKQLTXHV % 3XOVHSUHVVXUHDVULVNIDFWRUIRU05,GHWHFWHGLQWUDSODTXH KDHPRUUKDJHLQWKHFDURWLGDUWHULHVWKH5RWWHUGDPVWXG\ 06HOZDQHVV4YDQGHQ%RXZKXLMVHQ*&9HUZRHUW$'HKJKDQ 09HUQRRLM$+RIPDQ--:HQW]HO-&0:LWWHPDQ$YDQGHU/XJW 5RWWHUGDP1/PVHOZDQHVV#HUDVPXVPFQO 3XUSRVH,QWUDSODTXHKDHPRUUKDJH,3+DKLJKULVNFKDUDFWHULVWLFRIWKHYXOQHU DEOHSODTXHLVFRQVLGHUHGWREHDQLPSRUWDQWSUHGLFWRUIRULVFKDHPLFVWURNH<HW ULVNIDFWRUVOHDGLQJWRSODTXHYXOQHUDELOLW\DQGLQVSHFLÀF,3+DUHXQNQRZQ:H VWXGLHGZKHWKHUKDHPRG\QDPLFSDUDPHWHUVDUHDVVRFLDWHGZLWKSUHVHQFHRI,3+ ÀQGLQJVZHUHFRPSDUHGZLWKÀQGLQJVRIHQGDUWHUHFWRP\VSHFLPHQVFRQVLGHUHG DVJROGVWDQGDUG 5HVXOWV)RXUSDWLHQWVZHUHH[FOXGHGIURPWKHVWXG\GXHWR05DUWHIDFWVRUEH FDXVHQRW86DVVHVVDEOH,QWUDRSHUDWLYHÀQGLQJVDQGPDFURVFRSLFH[DPLQDWLRQ RIHQGDUWHUHFWRP\VSHFLPHQVUHYHDOHGDWULVNVRIWSODTXHVFRPSOH[DQG KDUGSODTXHV+505,FRUUHFWO\FODVVLÀHGDQGRISODTXHVRIJURXS $%DQG&86LGHQWLÀHGDQGRIJURXS$%DQG&UHVSHFWLYHO\ ,QSDWLHQWV05SLQSRLQWHGXOFHUDWHGSODTXHVRIWKHPLGHQWLÀHGE\86 DQGFDVHVRI,3+ &RQFOXVLRQ,QSDWLHQWVXQGHUJRLQJ&(05$05SODTXHFKDUDFWHULVDWLRQFRXOG KDYHDSRWHQWLDOWRPRUHDFFXUDWHO\GLDJQRVHVRIWSODTXHZLWKODUJH/1&RUSODTXH ZLWKIHDWXUHVRIYXOQHUDELOLW\LQFRPSDULVRQZLWKFRORXU'RSSOHU86 % 8OWUDORZGRVHGXDOVRXUFHFRPSXWHGWRPRJUDSK\DQJLRJUDSK\RI WKHVXSUDDRUWLFDUWHULHVXVLQJN9WXEHYROWDJHDKLJKSLWFKDQG LWHUDWLYHUHFRQVWUXFWLRQSUHOLPLQDU\UHVXOWV '%HLW]NH51RO]*(GHOKDXVHU5(6FKHUQWKDQHU) :ROI&3ODQN -/DPPHU&/RHZH9LHQQD$7GLHWULFKEHLW]NH#PHGXQLZLHQDFDW 3XUSRVH 7 R HYDOXDWH LPDJH TXDOLW\ GLDJQRVWLF FRQÀGHQFH DQG UDGLDWLRQGRVH XVLQJN9WXEHYROWDJHDQGLWHUDWLYHLPDJHUHFRQVWUXFWLRQIRUKLJKSLWFKGXDO VRXUFH&7DQJLRJUDSK\'6&7$RIWKHVXSUDDRUWLFDUWHULHVLQFRPSDULVRQWRD N9VWDQGDUGSURWRFRO 0HWKRGVDQG0DWHULDOV'6&7$RIWKHVXSUDDRUWLFDUWHULHVZDVSHUIRUPHGLQ SDWLHQWV UDQGRPO\ XVLQJ HLWKHU N9 SLWFK DQG LWHUDWLYHUHFRQVWUXFWLRQ RU N9SLWFKDQGÀOWHUHGEDFNSURMHFWLRQ&RQWUDVWWRQRLVHUDWLR&15DQG VLJQDOWRQRLVH UDWLR 615 FDOFXODWLRQV ZHUH SHUIRUPHG WR REMHFWLYHO\ HYDOXDWH LPDJHTXDOLW\LQYDVFXODUVHJPHQWV)RUVXEMHFWLYHLPDJHTXDOLW\DIRXUSRLQW VFDOHZDVDSSOLHGWRYDVFXODUVHJPHQWVLQHDFKSDWLHQWE\WZRUHDGHUV(IIHFWLYH GRVHZDVXVHGWRFRPSDUHWKHGLIIHUHQFHVLQUDGLDWLRQGRVH 5HVXOWV 7KH XVH RI N9 DQG LWHUDWLYH UHFRQVWUXFWLRQ VKRZHG VLJQLÀFDQWO\ KLJKHU YHVVHO RSDFLÀFDWLRQ DQG UHGXFHG LPDJH QRLVH LQ DOO VHJPHQWV UHVXOWLQJ LQVLJQLÀFDQWO\KLJKHU&15DQG615YDOXHVDWWKHOHYHORIWKHFDURWLGELIXUFDWLRQ S DQGVLJQLÀFDQWO\KLJKHU&15YDOXHVDWWKHOHYHORIWKHLQWHUQDOFDURWLG DUWHU\S FRPSDUHGWRN9DQGÀOWHUHGEDFNSURMHFWLRQ7KHUHZDVQR GLIIHUHQFHLQWKHVXEMHFWLYHLPDJHTXDOLW\LQDOOYDVFXODUVHJPHQWV7KHHIIHFWLYH GRVHZDVVLJQLÀFDQWO\ORZHUXVLQJN9YVP6YS &RQFOXVLRQ7KHXVHRIN9WXEHYROWDJHDKLJKSLWFKDQGLWHUDWLYHUHFRQVWUXF WLRQLQ'6&7$RIWKHVXSUDDRUWLFDUWHULHVDOORZVIRUUDGLDWLRQGRVHUHGXFWLRQGRZQ WRP69ZLWKRXWLQÁXHQFLQJGLDJQRVWLFFRQÀGHQFH % &RPSDULVRQRIGLIIHUHQWHYDOXDWLRQFULWHULDRIFDURWLGDUWHU\ VWHQRVLVZLWKVOLFH&7 UROHRIFURVVVHFWLRQDODUHDYHUVXVSHUFHQW GLDPHWHUVWHQRVLV $'$QQRQL*3RQWRQH$)RUPHQWL'$QGUHLQL(1RELOL)%HVDQD *%DOOHULQL03HSL3 0RQWRUVL0LODQ,7DQGUHDDQQRQL#FFIPLW 3XUSRVH$LPRIWKHVWXG\LVWRYHULI\ZKLFKRIWKHGDLO\XVHGTXDQWLWDWLYHPHWKRG RI FDURWLG VWHQRVLV HYDOXDWLRQ >&RPPRQ FDURWLG DUWHU\ &&$ 1$6&(7 (&67@ EHWWHUFRUUHODWHVZLWKFDURWLGVWHQRVLVDUHDLQGH[HGWRERG\VXUIDFHDUHD$LRIWKH SDWLHQWWKDWLVWKHUHDOSDUDPHWHURIWKHEORRGÁRZLQWKHFDURWLGYHVVHOV 0HWKRGVDQG0DWHULDOVSDWLHQWVXQGHUZHQWVOLFH&7*(9&7ZLWKHYDOX DWLRQRIGLDPHWHUDQGDUHDUHVSHFWLYHO\RIFRPPRQFDURWLGDUWHU\&&FDURWLG EXOEDQGLQWHUQDOFDURWLG&,DWWKHVLWHRIVWHQRVLVDQGEH\RQGWKHEXOE6WHQRVLV GHJUHHZDVPHDVXUHGXVLQJUHVSHFWLYHO\DVUHIHUHQFHGLDPHWHUDQGDUHDRI&& &&G&&$(&67PHWKRG(&67G(&67$DQG1$6&(7PHWKRG1$6&(7 G1$6&(7$DQGFRUUHODWHGZLWK$LXVLQJ3HDUVRQWHVW 5HVXOWVFDURWLGSODTXHVZHUHGHWHFWHG4XDQWLWDWLYHDQDO\VLVVKRZHGPHDQ $L PP6WHQRVLVGHJUHHXVLQJWKHGLIIHUHQWPHWKRGZDVUHVSHFWLYHO\ &&G&&$(&67G(&67$1$6&(7G 1$6&(7$7KHDJUHHPHQWEHWZHHQ$LDQGHDFKRIWKHWKUHH GLIIHUHQWPHWKRGVZDV&&$U(&67$U1$6&(7$U &RQFOXVLRQ &&$ PHWKRG DQG 1$6&(7$ PHWKRG EHWWHU FRUUHODWHV ZLWK$L /HVVDJUHHPHQWUHVXOWVEHWZHHQ$LDQG(&67PHWKRGPD\EHEHFDXVHRIORZHU UHSURGXFLELOLW\RIWKHPHDVXUHPHQWVDWWKHVLWHRIFDURWLGEXOEGXHWRDQDWRPLFDO FKDQJHVUHODWHGWRDWKHURVFOHURVLV 6FLHQWLILF6HVVLRQ 6 &$' ( ) *+% (XURSHDQ&RQJUHVVRI 5DGLRORJ\ DUWHULHVLQWRHLWKHUDWKHURVFOHURVLVGLVVHFWLRQYDVFXOLWLVRUQRGLVHDVH)LQDOO\D FRQVHQVXVUHDGLQJZDVSHUIRUPHG 5HVXOWV2QDSHUYHVVHOOHYHODJUHHPHQWEHWZHHQERWKUHDGHUVZDVH[FHOOHQW ZLWK D .DSSD RI S &RPSDUHG WR WKH JROG VWDQGDUGERWK UHDGHUV PLVVHGRQHSDWLHQWZLWKPRGHUDWHDWKHURVFOHURVLVEXWFRUUHFWO\LGHQWLÀHGDOOFDVHV RI VHYHUH DWKHURVFOHURVLV GLVVHFWLRQ DQG YDVFXOLWLV %\ FRQVHQVXV UHDGLQJ WKH FRUUHFWGLDJQRVLVZDVPDGHLQRIFDVHV2QO\RQHSDWLHQWZLWKPRGHUDWH DWKHURVFOHURVLVZDVFODVVLÀHGDVGLVHDVHIUHH)RUWKHSUHVHQFHRIGLVHDVHWKLV UHVXOWHGLQDVHQVLWLYLW\VSHFLÀFLW\335DQG135RIDQG &RQFOXVLRQ 7KLV VWXG\ GHPRQVWUDWHV WKDW KUEEF05, LV DEOH WR GLIIHUHQWLDWH EHWZHHQWKHPRVWFRPPRQFHUYLFDODUWHULRSDWKLHVQRQLQYDVLYHO\ZLWKH[FHOOHQW LQWHUUHDGHUUHSURGXFLELOLW\ 5RRP3 3K\VLFVLQ5DGLRORJ\ 66 1HZWHFKQRORJLHVDQGDOJRULWKPV 0RGHUDWRUV 2&LUDM%MHODF%HOJUDGH56 -19DVVLOHYD6RILD%* % &7LPDJHTXDOLW\LPSURYHPHQWXVLQJDGDSWLYHLWHUDWLYHGRVH UHGXFWLRQZLWKZLGHYROXPHDFTXLVLWLRQRQGHWHFWRU&7 $*HUYDLVH %2VHPRQW6/HFRFT$1RHO(0LFDUG-)HOEOLQJHU $%OXP0HW])51DQF\)59DQGRHXYUH/HV1DQF\)5 DOEDQJHUYDLVH#KRWPDLOIU 3XUSRVH7 RHYDOXDWHWKHLPSDFWRIDGDSWLYHLWHUDWLYHGRVHUHGXFWLRQ$,'5RQ LPDJHTXDOLW\DQGUDGLDWLRQGRVHLQSKDQWRPDQGSDWLHQWVWXGLHV 0HWKRGV DQG 0DWHULDOV$ SKDQWRP ZDV H[DPLQHG LQ YROXPHWULF PRGH RQ D GHWHFWRU&7DWGLIIHUHQWWXEHFXUUHQWVIURPWRP$V&7LPDJHVZHUH UHFRQVWUXFWHG ZLWK$,'5 DQG ZLWK )%3 UHFRQVWUXFWLRQ DOJRULWKP,PDJH QRLVH FRQWUDVWWRQRLVH UDWLR &15 VLJQDOWRQRLVH UDWLR 615 DQGVSDWLDO UHVROXWLRQ ZHUHFRPSDUHGEHWZHHQ)%3DQG$,'5LPDJHV$,'5ZDVWKHQWHVWHGRQ&7 H[DPLQDWLRQVRIWKHOXPEDUVSLQHLQDSURVSHFWLYHVWXG\$JDLQ)%3DQG$,'5 LPDJHVZHUHFRPSDUHG,PDJHQRLVHDQG615ZHUHDQDO\VHGXVLQJD:LOFR[RQ VLJQHGUDQNWHVW 5HVXOWV ,Q WKH SKDQWRP VSDWLDO UHVROXWLRQ DVVHVVPHQW VKRZHG QR VLJQLÀFDQW GLIIHUHQFHEHWZHHQ)%3DQG$,'5UHFRQVWUXFWLRQV,PDJHQRLVHZDVORZHUZLWK $,'5WKDQZLWK)%3LPDJHVZLWKDPHDQUHGXFWLRQRI&15DQG615ZHUH DOVRLPSURYHGZLWK $,'5,QSDWLHQWVTXDQWLWDWLYHDQGVXEMHFWLYHHYDOXDWLRQVKRZHG WKDWLPDJHQRLVHZDVVLJQLÀFDQWO\ORZHUZLWK$,'5WKDQZLWK)%3615ZDVDOVR JUHDWHUZLWK$,'5WKDQZLWK)%3 &RQFOXVLRQ&RPSDUHGWRWUDGLWLRQDO)%3UHFRQVWUXFWLRQWHFKQLTXHV$,'5VLJ QLÀFDQWO\LPSURYHVLPDJHTXDOLW\DQGKDVWKHSRWHQWLDOWRGHFUHDVHUDGLDWLRQGRVH % )UHTXHQF\FRPELQHGH[WHQGHG'UHFRQVWUXFWLRQIRUPXOWLSOH FLUFXODUFRQHEHDP&7VFDQV 5*ULPPHU -%DHN13HOF0.DFKHOULHVV(UODQJHQ'( 3DOR$OWR&$86UDLQHUJULPPHU#LPSXQLHUODQJHQGH 3XUSRVH ,Q FLUFXODU FRQHEHDP &7 D VLQJOH FLUFOHVFDQ RIWHQ GRHV QRW FRYHU WKHFRPSOHWH]UDQJHRILQWHUHVW,IWKLVLVWKHFDVHWZRRUPRUHFLUFOHVFDQVDUH DFTXLUHG7KHVWDQGDUGFRPELQDWLRQRIWKHVHSDUDWHUHFRQVWUXFWLRQVKDVWZRGLV DGYDQWDJHV7KHUHFRQVWUXFWDEOHYROXPHLVVPDOOHUWKDQSRVVLEOHWKXVGRVH UHPDLQVXQXVHGDQGWKHQRLVHOHYHOLVKLJKHUWKDQQHFHVVDU\7KHFRQHEHDP DUWHIDFWV DUH LQFUHDVHG DW WKH HGJHV RI WKH SDUWLDO YROXPHV ZKLFK KDYH D ODUJH GLVWDQFHWRWKHPLGSODQHV 0HWKRGV DQG 0DWHULDOV 7 R RYHUFRPH WKHVH GLVDGYDQWDJHV ZH GHYHORSHG D PHWKRGWKDWVLPXOWDQHRXVO\UHFRQVWUXFWVDOOFLUFOHVFDQVDQGWKHUHE\LVDEOHWRUH FRQVWUXFWODUJHUVHJPHQWVIURPHDFKFLUFOHVFDQDQGIXUWKHUPRUHWKDWUHGXFHVFRQH EHDPDUWHIDFWVE\FRPELQLQJWKHVHJPHQWVLQIUHTXHQF\GRPDLQ7KHSURSRVHG PHWKRGZDVHYDOXDWHGXVLQJDVLPXODWLRQVWXG\DVZHOODVPHDVXUHGGDWDIURP GLIIHUHQWÁDWSDQHOFRQHEHDP&7VFDQQHUVDVIRUH[DPSOHWKH9DULDQ2%,VFDQQHU 5HVXOWV,QWKHH[DPSOHJHRPHWU\WKHPD[LPDOUHFRQVWUXFWDEOH]UDQJHFDQEH LQFUHDVHG E\ DQG RXU DSSURDFK DGGLWLRQDOO\ OHDGV WR D QRLVH UHGXFWLRQ RI DERXWLQWKHRYHUODSUHJLRQ5HJDUGLQJWKHFRQHEHDPDUWHIDFWVZHZHUH DEOHWRUHGXFHWKHDUWHIDFWOHYHOWRDYDOXHDVORZDVDFKLHYDEOHE\PRUHFRPSOH[ 0HWKRGVDQG0DWHULDOV:LWKLQWKHIUDPHZRUNRIWKH5RWWHUGDPVWXG\WKHFDURWLG DUWHULHVRIKHDOWK\SDUWLFLSDQWV\HDUVDQGROGHUDQGZLWKZDOOWKLFNHQLQJ !PPRQXOWUDVRXQGZHUHLPDJHGZLWKD705,VFDQQHU,3+KDVEHHQ GHÀQHGDVDK\SHULQWHQVHVLJQDORQWKH'7Z*5(05VHTXHQFH*HQHUDOLVHG HVWLPDWLRQHTXDWLRQDQDO\VLVDGMXVWHGIRUVH[DJHLQWLPDPHGLDWKLFNQHVVDQG RWKHUFDUGLRYDVFXODUULVNIDFWRUVVPRNLQJGLDEHWHVFKROHVWHURO%0,ZDVXVHG WRDVVHVVWKHDVVRFLDWLRQEHWZHHQWKHPDLQEORRGSUHVVXUHSDUDPHWHUVDQG,3+ 5HVXOWV05LPDJLQJRIWKHFDURWLGDUWHULHVUHYHDOHGSUHVHQFHRI,3+LQ SODTXHV$GMXVWHGIRUDJHDQGVH[,3+ZDVVLJQLÀFDQWO\DVVRFLDWHGZLWK V\VWROLFEORRGSUHVVXUH6%3DQGSXOVHSUHVVXUH33$IWHUDGMXVWPHQWIRURWKHU FDUGLRYDVFXODUULVNIDFWRUV33\LHOGHGWKHVWURQJHVWDVVRFLDWLRQ7KHULVNRI,3+ LQFUHDVHGZLWKSHU6'LQFUHDVHLQ33&,S YHUVXV SHU6'LQ6%3&,S )XUWKHUPRUHRQO\33UHPDLQHG VLJQLÀFDQWDIWHUDGGLWLRQDODGMXVWPHQWIRURWKHUEORRGSUHVVXUHFRPSRQHQWV &RQFOXVLRQ3XOVHSUHVVXUHSURYHGWREHWKHVWURQJHVWGHWHUPLQDQWIRULQWUDSODTXH KDHPRUUKDJH LQGHSHQGHQW RI RWKHU EORRG SUHVVXUH SDUDPHWHUV DQGWUDGLWLRQDO FDUGLRYDVFXODUULVNIDFWRUV7KLVDVVRFLDWLRQEHWZHHQSXOVDWLOHÁRZDQG,3+PLJKW SURYLGHQRYHOLQVLJKWVLQWRWKHDHWLRORJ\RIWKHYXOQHUDEOHSODTXH % 05,EDVHGTXDQWLÀFDWLRQRIDGYHQWLWLDOFRQWUDVWG\QDPLFVIRUWKH FDURWLGDUWHU\DVDPDUNHUIRUQHRYDVFXODUL]DWLRQLQDWKHURVFOHURVLV FRPSDULVRQRIV\PSWRPDWLFDQGDV\PSWRPDWLFSDWLHQWV ) 6FKZDU] 0,QJULVFK0+DUWPDQQ666RXUEURQ&&&\UDQ -*ULPP.1LNRODRX0) 5HLVHU7 6DDP0XQLFK'(/HHGV8. ÁRULDQVFKZDU]#PHGOPXGH 3XUSRVH 7 R FRPSDUH FRQWUDVW G\QDPLFV LQ DGYHQWLWLDO WLVVXH RI WKH FRPPRQ DQGLQWHUQDOFDURWLGDUWHU\EHWZHHQV\PSWRPDWLFDQGDV\PSWRPDWLFSDWLHQWVZLWK DWKHURVFOHURVLVFDOFXODWHGIURPWLPHUHVROYHGFRQWUDVWHQKDQFHG05,GDWDVHWV 0HWKRGV DQG 0DWHULDOV V\PSWRPDWLF SDWLHQWV LVFKDHPLF VWURNH ZLWK ':, UHVWULFWLRQRQEUDLQ05,ZLWKDWKHURVFOHURWLFSODTXHVRQFDURWLGXOWUDVRXQGZHUH LQFOXGHG ZLWKLQ K RI V\PSWRP RQVHW DV\PSWRPDWLF SDWLHQWVZLWK IDPLOLDO K\SHUFKROHVWHUROHPLDVHUYHGDVDFRQWUROJURXS$OOSDWLHQWVZHUHVFDQQHGRQD 705,V\VWHPXVLQJDGHGLFDWHGVXUIDFHFRLO&RQWUDVWNLQHWLFVZHUHUHFRUGHG RQUHSUHVHQWDWLYHD[LDOVOLFHVDWWKHOHYHORIWKHFRPPRQDQGLQWHUQDOFDURWLG DUWHU\ZLWKDWHPSRUDOUHVROXWLRQRIVIRUDWRWDORIPLQ52,VZLWKDWKLFNQHVV RISL[HOVZHUHSRVLWLRQHGDURXQGWKHYHVVHOZDOO\LHOGLQJWLPHGHSHQGHQWIXQF WLRQVRIVLJQDO7KHVHZHUHWKHQÀWWHGWRDFRPSDUWPHQWH[FKDQJHPRGHODQG WKHSDUDPHWHUVSODVPDÁRZSODVPDYROXPHSODVPDPHDQWUDQVLWWLPH3077 H[WUDFWLRQÁRZ()DQGLQWHUVWLWLDOPHDQWUDQVLWWLPH,077FDOFXODWHG 5HVXOWV&RQWUDVWG\QDPLFVZHUHDQDO\VHGIRUDQGFDURWLGVHJPHQWVLQWKH V\PSWRPDWLFDQGDV\PSWRPDWLFJURXSUHVSHFWLYHO\7KHUHPDLQLQJZHUHH[FOXGHG GXHWRLQVXIÀFLHQWLPDJHTXDOLW\)RUV\PSWRPDWLFSDWLHQWVVLJQLÀFDQWO\KLJKHUYDO XHVIRUSODVPDYROXPHYVSH[WUDFWLRQÁRZYVS DQG,077YVVS ZHUHREVHUYHG7KHUHZDVDVWURQJWHQGHQF\IRU KLJKHU3077YVS DQGKLJKHUSODVPDÁRZYVS &RQFOXVLRQ 05,EDVHG TXDQWLWDWLYH DVVHVVPHQW RI FRQWUDVW G\QDPLFV LQ WKH DGYHQWLWLDOOD\HURIWKHFDURWLGDUWHU\UHYHDOVKLJKO\VLJQLÀFDQWGLIIHUHQFHVEHWZHHQ V\PSWRPDWLFDQGDV\PSWRPDWLFSDWLHQWV)XUWKHUVWXGLHVDUHQHHGHGWRDQDO\VH WKHSUHGLFWLYHYDOXHIRUIXWXUHLVFKDHPLFFHUHEUDOHYHQWV % 5HSURGXFLELOLW\DQGGLIIHUHQWLDWLRQRIFHUYLFDODUWHULRSDWKLHVXVLQJLQ YLYRKLJKUHVROXWLRQ05, ) 6FKZDU].1LNRODRX&&&\UDQ0+DUWPDQQ -*ULPP0) 5HLVHU0'LFKJDQV03IHIIHUNRUQ7 6DDP 0XQLFK'(ÁRULDQVFKZDU]#PHGOPXGH 3XUSRVH7 RHYDOXDWHWKHSRWHQWLDORIKLJKUHVROXWLRQEODFNEORRGFHUYLFDOPDJ QHWLFUHVRQDQFHLPDJLQJKUEEF05,WRGLIIHUHQWLDWHWKHPRVWFRPPRQFHUYLFDO DUWHULRSDWKLHVDQGWRHYDOXDWHLQWHUREVHUYHUUHSURGXFLELOLW\ 0HWKRGV DQG 0DWHULDOV SDWLHQWV XQGHUZHQW KUEEF05, DW 7 HVOD ZLWK IDWVDWXUDWHG SUH DQG SRVWFRQWUDVW 7Z 3'Z 7Z DQG 72)LPDJHV XVLQJ VSHFLÀFVXUIDFHFRLOVSDWLHQWVSUHVHQWHGZLWKFHUYLFDODUWKULWLVDVFRQÀUPHGE\ 3(7&7 DQG FOLQLFDO UHVSRQVH WR VWHURLG WUHDWPHQW SDWLHQWVVKRZHG DWKHUR VFOHURWLFGLVHDVHFDXVLQJKLJKJUDGHVWHQRVHVLQFRQÀUPHGKLVWRORJLFDOO\DIWHU HQGDUWHUHFWRP\ZKLOHWKHUHPDLQLQJVKRZHGQRPRUHWKDQPRGHUDWHVWHQRVLV FRQÀUPHGE\XOWUDVRXQGSDWLHQWVKDGDUWHULDOGLVVHFWLRQFRQÀUPHGFOLQLFDOO\ DQGE\IROORZXSLPDJLQJDIWHUPRQWKV)XUWKHUPRUHFRQWUROVXEMHFWVZLWKQR HYLGHQFHRIGLVHDVHZHUHLQFOXGHG7ZRH[SHULHQFHGUHDGHUVEOLQGHGWRDOOFOLQL FDOLQIRUPDWLRQUHYLHZHGDOO05,VHULHVDQGFODVVLÀHGERWKFDURWLGDQGYHUWHEUDO 6FLHQWLILF6HVVLRQ $ 6&'()*+%(XURSHDQ&RQJUHVVRI 5DGLRORJ\ 0RQGD\ % 5DGLDWLRQGRVHDQGLPDJHTXDOLW\DWKLJKSLWFK&7DQJLRJUDSK\ RIWKHDRUWDLQWUDLQGLYLGXDODQGLQWHULQGLYLGXDOFRPSDULVRQZLWK FRQYHQWLRQDO&7DQJLRJUDSK\ 3 $SIDOWUHU (+DQQD86FKRHSI-6SHDUV*5RZH'+DUULV 66FKRHQEHUJ&)LQN59OLHJHQWKDUW0DQQKHLP'(&KDUOHVWRQ6&86 &KDUOHVWRQ6&860DQQKHLP'(*URQLQJHQ1/&KDUOHVWRQ6&86 SDXODSIDOWUHU#XPPGH 3XUSRVH/DWHVWJHQHUDWLRQ&7V\VWHPVHQDEOHDFTXLULQJWKHHQWLUHWRUVRDWKLJK SLWFK:HHYDOXDWHGUDGLDWLRQGRVHDQGTXDQWLWDWLYHLPDJHTXDOLW\SDUDPHWHUVDW KLJKSLWFK&7DQJLRJUDSK\&7$RIWKHHQWLUHDRUWDFRPSDUHGWRFRQYHQWLRQDO&7$ 0HWKRGVDQG0DWHULDOVSDWLHQWVPDOHVPHDQDJH \HDUVZLWK &7$RIWKHHQWLUHDRUWDZHUHUHWURVSHFWLYHO\LQFOXGHG$OOSDWLHQWVXQGHUZHQW&7$ RQDQGJHQHUDWLRQGXDOVRXUFH&7V\VWHPRIZKLFKLQKLJKSLWFKPRGH0DLQ LQGLFDWLRQVZHUHVXVSHFWHGDRUWLFV\QGURPHQ IROORZXSRIDQHXU\VPQ RUGLVVHFWLRQQ RUSRVWDRUWLFUHSDLUQ 0HDQDUWHULDODWWHQXDWLRQVLJQDO WRQRLVHUDWLR 615 FRQWUDVWWRQRLVHUDWLR &15 DQG ÀJXUHRIPHULW )20 ZHUHFDOFXODWHGDWPXOWLSOHDRUWLFOHYHOV$ÀJXUHRIPHULW)20ZDVFRPSXWHG WRQRUPDOLVHWKHQRLVHDQG&15IRUHDFKSURWRFROWRHIIHFWLYHGRVH$GGLWLRQDOO\ UDGLDWLRQH[SRVXUHZDVFRPSDUHG 5HVXOWV $OOVWXGLHVZHUHFRQVLGHUHGRIGLDJQRVWLFTXDOLW\ $WKLJKVSHHG&7$PHDQ N9DQGP$VZHUHDQGFRPSDUHGWRDQGIRUFRQ YHQWLRQDO&7$S0HDQYROXPH&7GRVHLQGH[GRVHOHQJWKSURGXFWDQG HIIHFWLYHGRVHZHUHP*\P*\ FPDQGP6YDWKLJKSLWFK &7$YHUVXVP*\P*\ FPDQGP6YDWFRQYHQWLRQDO &7$S $WWHQXDWLRQZDVVLPLODUIRUERWKSURWRFROVZKLOHVLJQLÀFDQWO\OHVV FRQWUDVW PHGLXP ZDV LQMHFWHG IRU KLJKSLWFK&7$ P/ YV P/ S 615 DQG &15 ZHUH VLJQLÀFDQWO\ ORZHU LQ WKH KLJKSLWFK&7$ JURXS ZKLOHWKH)20ZDVQRQVLJQLÀFDQWO\KLJKHUSDWLHQWVXQGHUZHQWERWK KLJKSLWFKDQGFRQYHQWLRQDO&7$UDGLDWLRQGRVHZDVUHGXFHGE\S &RQFOXVLRQ+LJKSLWFK&7$RIWKHDRUWD\LHOGVXSWRUHGXFWLRQRIUDGLDWLRQ H[SRVXUHDVZHOODVFRQWUDVWPHGLXPVDYLQJVZLWKPDLQWDLQHGYHVVHODWWHQXDWLRQ % $WHPSRUDOUHVROXWLRQLPSURYHPHQWPHWKRGIRUFDUGLDF&7XVLQJ RISURMHFWLRQVLQLWLDOSDWLHQWH[SHULHQFH 3 $SIDOWUHU +6FKRHQGXEH8-6FKRHSI$6FKLQGOHU7 $OOPHQGLQJHU 69RJW.6WLHUVWRUIHU+%UXGHU+8(EHUVEHUJHU&KDUOHVWRQ6&86 )RUFKKHLP'(0DOYHUQ3$86GUDSIDOWUHU#JPDLOFRP 3XUSRVH 7 R HYDOXDWH WKH HIIHFW RI D WHPSRUDO UHVROXWLRQ LPSURYHPHQW PHWKRG 75,0IRUFDUGLDF&7RQGLDJQRVWLFLPDJHTXDOLW\IRUFRURQDU\DUWHU\DVVHVVPHQW 0HWKRGV DQG 0DWHULDOV 7KH 75,0DOJRULWKP HPSOR\V DQ LWHUDWLYH DSSURDFK WR UHFRQVWUXFW LPDJHV IURP OHVV WKDQ RI SURMHFWLRQV DQG XVHV D KLVWRJUDP FRQVWUDLQWWRSUHYHQWWKHRFFXUUHQFHRIOLPLWHGDQJOHDUWHIDFWV7KLVDOJRULWKPZDV DSSOLHGLQREHVHSDWLHQWVPHQ\UVZKRKDGXQGHUJRQHQGJHQ HUDWLRQGXDOVRXUFHFDUGLDF&7ZLWKN9P$VDQGPVHFJDQWU\ URWDWLRQWLPH$OOGDWDZHUHUHFRQVWUXFWHGZLWKDWHPSRUDOUHVROXWLRQRIPVHF XVLQJWUDGLWLRQDOÀOWHUHGEDFNSURMHFWLRQ)%3DQGRIPVHFXVLQJWKH75,0 DOJRULWKP&RQWUDVWDWWHQXDWLRQDQGFRQWUDVWWRQRLVHUDWLR&15ZHUHPHDVXUHG LQWKHDVFHQGLQJDRUWD7KHSUHVHQFHDQGVHYHULW\RIFRURQDU\PRWLRQDUWHIDFWV ZDVUDWHGRQDSRLQWVFDOH QRPRWLRQ QRQGLDJQRVWLF 5HVXOWV 0HDQ ERG\PDVVLQGH[ ZDV NJP$YHUDJH KHDUW UDWH ZDV ESP 0HDQ HIIHFWLYH GRVH ZDV P6Y:KHQ FRPSDULQJ )%3DQG 75,0UHFRQVWUXFWHGVHULHVWKHDWWHQXDWLRQZLWKLQWKHDVFHQGLQJDRUWD YV+8S DQG&15YVS!ZDVQRW VLJQLÀFDQWO\GLIIHUHQW $WRWDORIFRURQDU\VHJPHQWVZHUHHYDOXDWHG $OOVWXGLHV ZHUHGHHPHGRYHUDOOGLDJQRVWLFKRZHYHUWKHUHZDVDVLJQLÀFDQWS GLIIHU HQFHLQWKHRFFXUUHQFHDQGVHYHULW\VFRUHVRIFRURQDU\PRWLRQDUWHIDFWVEHWZHHQ )%3PHDQ DQG75,0PHDQ UHFRQVWUXFWLRQV &RQFOXVLRQ7KH75,0DOJRULWKPHYDOXDWHGKHUHDOORZVFOLQLFDOO\DFFHSWDEOHLPDJ LQJRIWKHFRURQDU\DUWHULHVGHVSLWHPVHFJDQWU\URWDWLRQ3RVVLEOHDSSOLFDWLRQV LQFOXGHLPSURYHPHQWRIFDUGLDFLPDJLQJRQVORZHUJDQWU\URWDWLRQV\VWHPVRUPLWLJD WLRQRIWKHWUDGHRIIEHWZHHQWHPSRUDOUHVROXWLRQDQGLPDJHQRLVHLQREHVHSDWLHQWV DOJRULWKPV WKDW SHUIRUP D YR[HOZLVH ZHLJKWHG EDFNSURMHFWLRQ WR IDYRXU YR[HOV VHHQXQGHUVPDOOFRQHDQJOHV &RQFOXVLRQ7KHSURSRVHGDOJRULWKPLVDEOHWRVLJQLÀFDQWO\LPSURYHWKHUHFRQ VWUXFWLRQ RI VHTXHQFH VFDQV ZKLOH WKH UHFRQVWUXFWLRQ WLPH LV NHSW HTXLYDOHQW WR WKHVWDQGDUGDSSURDFK:HIXUWKHUGHPRQVWUDWHWKDWWKHPHWKRGFDQEHXVHGLQ FOLQLFDOSUDFWLFH % %HDPKDUGHQLQJDQGVFDWWHUUHPRYDOZLWKHPSLULFDOFXSSLQJ FRUUHFWLRQIRUSULPDU\PRGXODWLRQ(&&3 5*ULPPHU 5)DKULJ:+LQVKDZ+*DR0.DFKHOULHVV(UODQJHQ'( 3DOR$OWR&$86UDLQHUJULPPHU#LPSXQLHUODQJHQGH 3XUSRVH[5D\&7PHDVXUHVWKHDWWHQXDWLRQRISRO\FKURPDWLF[UD\VWKURXJKDQ REMHFW7KH[UD\VSHFWUXPPD\YDU\DVDIXQFWLRQRIWKHGHWHFWRUSRVLWLRQHJ GXHWRWKHKHHOHIIHFWRUDERZWLHRUDSULPDU\PRGXODWRULVXVHGWRPRGXODWHWKH SULPDU\LQWHQVLW\:HSURSRVHDQHZDSSURDFKWKDWDOORZVKDQGOLQJDOOWKHVHHIIHFWV 0HWKRGVDQG0DWHULDOV2XU(&&3FRUUHFWVIRUDUWHIDFWVVXFKDVFXSSLQJDU WHIDFWVRUULQJDUWHIDFWVWKDWDUHLQGXFHGE\QRQOLQHDULWLHVLQWKHSURMHFWLRQGDWD GXHWRVSDWLDOO\YDU\LQJÀOWUDWLRQRIWKH[UD\V7 RGRVR(&&3UHTXLUHVQRWKLQJ EXWDVLPSOHVFDQRIDKRPRJHQHRXVSKDQWRPRIDUELWUDU\VKDSH%DVHGRQWKLV LQIRUPDWLRQFRHIÀFLHQWVRIDSRO\QRPLDOVHULHVDUHFDOFXODWHGDQGVWRUHGIRUODWHU XVHWRSUHFRUUHFWSDWLHQWGDWD:HFRPELQH(&&3ZLWKWKHSULPDU\PRGXODWLRQ VFDWWHUFRUUHFWLRQ306&>,(((70,@WRGHPRQVWUDWHWKH (&&3VDELOLW\RIFRUUHFWLQJIRUVSDWLDOO\YDU\LQJ[UD\VSHFWUDDQGWRVKRZWKDW 306&(&&3LVDKLJKO\HIÀFLHQWPHWKRGWRFRUUHFWIRUVFDWWHUDUWHIDFWV 5HVXOWV (&&3 LV DSSOLHG WR PHDVXUHPHQWV DQG FRPSOHWHO\ UHPRYHV FXSSLQJ DQGULQJDUWHIDFWV,WIXUWKHUJXDUDQWHHVZHOOFDOLEUDWHG&7YDOXHVHYHQLQFDVHV RIVWURQJSULPDU\PRGXODWLRQ2XUFRPELQDWLRQRI(&&3306&VXFFHVVIXOO\SHU IRUPHGVFDWWHUDQGEHDPKDUGHQLQJFRUUHFWLRQ5LQJDUWHIDFWVZHUHQRPRUHYLVLEOH DIWHUFRPELQLQJWKHVHWZRPHWKRGVDUWHIDFWVGXHWRVFDWWHURUEHDPKDUGHQLQJ ZHUHUHPRYHG &RQFOXVLRQ(&&3LVDKLJKO\HIIHFWLYHSUDJPDWLFDSSURDFKWRFRPSHQVDWHIRU VWURQJ GHWHFWRU FKDQQHOGHSHQGHG FKDQJHV RI WKH GHWHFWHG VSHFWUXP ,Q FRP ELQDWLRQZLWK306&ZHDFKLHYHLPDJHUHVXOWVQHDUO\IUHHRIVFDWWHUDQGEHDP KDUGHQLQJDUWHIDFWV % ([SRVLWLRQLQ&7DQJLRJUDSK\WKHLPSDFWRIWKHQHZ23(' DOJRULWKPLQ&7DQJLRJUDSK\&7$DSKDQWRPVWXG\ 7 :HUQFNH %5HQJHU27LVFKHQNR) :DFNHU%0H\HU%HUOLQ'( 0XQLFK'(1HXKHUEHUJ'(+DQQRYHU'(WKRPDVZHUQFNH#FKDULWHGH 3XUSRVH7KHDLPRIWKLVSKDQWRPVWXG\ZDVWRFRPSDUHWKHTXDOLW\RIVWHQRVLV TXDQWLÀFDWLRQIRUWKHQRYHO23('RUWKRJRQDOSRO\QRPLDOH[SDQVLRQRQWKHGLVN FRPSXWHGWRPRJUDSK\UHFRQVWUXFWLRQDOJRULWKPZKLFKRYHUFRPHVWKHUDGLDOGH FUHDVHRILPDJHTXDOLW\RIWKHÀOWHUHGEDFNSURMHFWLRQDOJRULWKP)%3ZLWK)%3 0HWKRGVDQG0DWHULDOV7 RPLPLFVWHQRVHGDEGRPLQDOYHVVHOVDFU\OLFWXEHVLQ QHUGLDPHWHUVPDOO ODUJH PPZHUHÀOOHGZLWKSODTXHPDWHULDOWRFUHDWH GLIIHUHQWGHJUHHVRIVWHQRVLVDQGSODTXHFRPSRVLWLRQFDOFLÀHG>!+8@VRIW >a+8@LQKRPRJHQHRXV>+8@/XPHQZDVÀOOHGZLWKZDWHUGLOXWHGFRQ WUDVWPDWHULDO,RPHSURO%UDFFRWRHQKDQFHWKHOXPHQWR+89HVVHOSKDQWRPV ZHUHLQVHUWHGLQDQDQWKURSRPRUSKLF $OGHUVRQSKDQWRPDQGLPDJLQJZDVFRQGXFWHG RQDVOLFH0'&76HQVDWLRQ6LHPHQVFROOLPDWLRQ[PPWXEHYROWDJH N9HIIHFWLYHWXEHFXUUHQWP$V,PDJHVZHUHUHFRQVWUXFWHGXVLQJ23(' DQGWKHVWDQGDUGNHUQHO%I$JUHHPHQWRIPHDVXUHGUHDGHUVLQFRQVHQVXV VWHQRVLVDUHDZDVFRUUHODWHGWRWKHNQRZQYDOXHXVLQJ.DSSD/LQ7 HVWѣ/LQ 5HVXOWV $WRWDORIVWHQRVLVPHDVXUHPHQWVZHUHSHUIRUPHG&RUUHODWLRQRIWKH 23('DOJRULWKPZDVVXSHULRUWR)%3 ,QODUJHYHVVHOVFRUUHODWLRQZDVSHUIHFWIRU ERWKUHFRQVWUXFWLRQDOJRULWKPV23(')%3,QFRPSDULVRQFRUUHODWLRQ ZDV LQIHULRU LQ VPDOO YHVVHOV 23(' )%3 VXEVWDQWLDO 2YHUDOO EHVW FRUUHODWLRQZDVREVHUYHGLQFDOFLÀHGSODTXHV23('ѣ/LQ )%3ѣ/LQ FRPSDUHG WR VRIW 23('ѣ/LQ )%3ѣ/LQ DQG LQKRPRJHQHRXV 23('ѣ/LQ )%3ѣ/LQ SODTXHV &RQFOXVLRQ,QODUJHYHVVHOSKDQWRPVUHSUHVHQWLQJSHOYLFDQGUHQDODUWHULHVWKH GRVHHIÀFLHQF\LVKLJKHUZLWKWKH23('UHFRQVWUXFWLRQFRPSDUHGWRWKHVWDQGDUG ÀOWHUHGEDFNSURMHFWLRQ,QVPDOOHUYHVVHOSKDQWRPVUHSUHVHQWLQJLQWHVWLQDODUWHU LHVTXDOLW\RIOXPLQDOGHOLQHDWLRQLVDOUHDG\OLPLWHGGXHWRWKHVSDWLDOUHVROXWLRQ 6FLHQWLILF6HVVLRQ 6 &$' ( ) *+% (XURSHDQ&RQJUHVVRI 5DGLRORJ\ &RPSDUDWLYH UHFRQVWUXFWLRQV ZHUH SURGXFHG XVLQJ WKH VWDQGDUG ÀOWHUHG EDFN SURMHFWLRQ)%3DOJRULWKP 5HVXOWV (67 UHFRQVWUXFWLRQ ZLWK SURMHFWLRQV KDV D VLJQDOWRQRLVHUDWLR FRPSDUDEOHWR)%3UHFRQVWUXFWLRQZLWKSURMHFWLRQV1RUHVROXWLRQRUFRQWUDVW GHJUDGDWLRQEHWZHHQWXPRXUDQGQRUPDOJODQGXODUWLVVXHLVREVHUYHG5DGLRORJLVW DVVHVVPHQWVEOLQGHGWRWKHUHFRQVWUXFWLRQSDUDPHWHUVFRQÀUPHGWKDWWKH(67 UHFRQVWUXFWLRQLVVXSHULRUWR)%3 7KHPHDQJODQGXODUGRVHZDVHVWLPDWHGWREH P*\IRUWKHIXOOYROXPH(67UHFRQVWUXFWLRQZKLFKLVOHVVWKDQWKHDYHUDJH GRVHLQDGXDOYLHZVFUHHQLQJURXWLQHH[DP &RQFOXVLRQ 2XU UHVXOWV VXJJHVW WKDW WKH (67 PHWKRG HQDEOHV WR UHGXFH WKH UDGLDWLRQGRVHLQSKDVHFRQWUDVW&7E\ZLWKRXWVDFULÀFLQJLPDJHTXDOLW\7KLV VWXG\LVDQLPSRUWDQWVWHSWRZDUGVWKHFOLQLFDOLPSOHPHQWDWLRQ % +XPDQPHGLFDOLPDJLQJZLWKUHIRUPHG[UD\LQWHUIHURPHWU\XVLQJD SUDFWLFDO[UD\WXEHDSUHOLPLQDU\VWXG\ZLWKQRUPDOYROXQWHHUV -7 DQDND01LLWVX$0RPRVH..LGR01DJDVKLPD ) 7KLHOH,UXPDJXQ-3.DVKLZDFLW\-3+DFKLRXMLFLW\7 RN\R-3 MWDQDND#VDLWDPDPHGDFMS 3XUSRVH7 RHYDOXDWHWKHLPDJHFKDUDFWHULVWLFVLQQRUPDOYROXQWHHUVREWDLQHGE\ UHIRUPHG[UD\LQWHUIHURPHWU\ZKLFKXVHVDSUDFWLFDO[UD\WXEH 0HWKRGVDQG0DWHULDOV5HIRUPHG[UD\7 DOERWLQWHUIHURPHWU\IROORZLQJWKHWKHRU\ RI/DXLQZKLFKDSUDFWLFDOLQFRKHUHQW[UD\VRXUFHLVXVHGLH7 DOERW/DXLQWHUIHU RPHWU\ZDVFUHDWHGEDVHGRQDGHVLJQZLWKZDYHRSWLFVLPXODWLRQ,QWKLVV\VWHP VRXUFHJUDWLQJZKLFKFRQVLVWVRIPXOWLSOHVOLWVRIѥPRUOHVVLQZLGWKDUUDQJHG SHULRGLFDOO\LVSODFHGLPPHGLDWHO\DIWHUDQLQFRKHUHQW[UD\VRXUFH(DFKVOLWHPLWV FRKHUHQW[UD\DQGLIWKHSLWFKRIWKHJUDWLQJLVVHWDSSURSULDWHO\DQ[UD\VRXUFH ZLWKFRKHUHQWOLJKWDQGHQRXJKSRZHUFDQEHDFKLHYHGGXHWRWKH/DXHIIHFW6LQFH WKLVV\VWHPGRHVQRWUHTXLUHHLWKHUDV\QFKURWURQRUDPLFURIRFXV[UD\WXEHWKH PHGLFDODSSOLFDWLRQRI[UD\LQWHUIHURPHWU\PD\EHIHDVLEOH$IWHUFRQÀUPLQJWKDW WKH V\VWHP ZRUNHG ZLWK SDUWV RI KXPDQ FDGDYHULF ERGLHV ZH VWDUWHG WR LPDJH SDUWV RI QRUPDO YROXQWHHUV VXFK DV WKH ÀQJHU DQG KDQG XQGHU WKH DSSURYDO RI WKHXQLYHUVLW\HWKLFVFRPPLWWHH7KHUHVXOWLQJLPDJHVZHUHFRUUHODWHGZLWKNQRZQ PDFURVFRSLFDQDWRPLFDOÀQGLQJV 5HVXOWV&HUWDLQFRPSRQHQWVRIWKHÀQJHUDQGKDQGVXFKDVOLJDPHQWVWHQGRQV DQGFDUWLODJHZKLFKDUHVFDUFHO\VHHQE\FRQYHQWLRQDO[UD\LPDJLQJZHUHFOHDUO\ GHSLFWHGE\WKLVQHZV\VWHPDVH[SHFWHGWKURXJKWKHRQJRLQJZRUNZLWKKXPDQ FDGDYHUV &RQFOXVLRQ 7KLV QHZ LPDJLQJ WHFKQRORJ\ PD\ EHFRPH FOLQLFDOO\ DSSOLFDEOH )XUWKHUWULDOVVKRXOGVWXG\PRUHQRUPDOYROXQWHHUVDQGSDWLHQWVDVZHOO 5RRP4 &DUGLDF 66 &DUGLDFLPDJLQJPLVFHOODQHRXV 0RGHUDWRUV 7/HLQHU8WUHFKW1/ 1+6WULFNODQG/RQGRQ8. % ,QFLGHQWDOGHWHFWLRQRIFRURQDU\DUWHU\FDOFLÀFDWLRQVRQQRQJDWHG FKHVW&7 GRUDGLRORJLVWVUHSRUWWKHP" *5LQDOGL*0LQHR3 6SLQQDWR95XVVR//RYDWR0=RPSDWRUL%RORJQD,7 3XUSRVH&RURQDU\DUWHU\FDOFLÀFDWLRQV&$&UHSUHVHQWDFDUGLDFULVNIDFWRUZLWK UHOHYDQWSURJQRVWLFLPSOLFDWLRQVRFFDVLRQDOO\GLVFRYHUHGRQQRQJDWHGPXOWLGHWHFWRU FKHVW&7 'HVSLWHWKHLUFOLQLFDOLPSRUWDQFHWKH\DUHYHU\RIWHQQRWUHFRJQLVHGDQG FRUUHFWO\UHSRUWHGE\UDGLRORJLVWV7KHDLPRIWKLVVWXG\LVWRHYDOXDWHWKHSRVVLEOH GHWHFWLRQRI&$&RQQRQJDWHGFKHVW&7VWXGLHVQRWSHUIRUPHGIRUFRURQDULHVRU FDUGLDFHYDOXDWLRQDQGDOVRWRDQDO\VHWKHLUUHSRUWLQJUDWH 0HWKRGVDQG0DWHULDOV:HUHWURVSHFWLYHO\UHYLHZHGQRQJDWHGFKHVW&7 PXOWLGHWHFWRU&7XQLWFRQYHQWLRQDOGRVHSURWRFROSHUIRUPHGIURP-DQXDU\WR 'HFHPEHULQRXUKRVSLWDO$VDÀUVWDSSURDFKWKHIRXUPDLQFRURQDU\DUWHU LHVZHUHHYDOXDWHGZLWKDYLVXDOVFRUHWRDVVHVVWKHSUHVHQFHDQGVLWHRI&$& 7KHQUDGLRORJLFDOUHSRUWVZHUHFKHFNHGWRHYDOXDWHLI&$&ZHUHUHSRUWHGDQGLI WKHFRUUHFWOHVLRQVVLWHZDVLQGLFDWHG 5HVXOWV,QDOOSDWLHQWVIHPDOHVDQGPDOHVPHDQDJH\HDUVROG WKHHYDOXDWLRQRI&$&ZDVIHDVLEOH:HUHFRJQLVHGWKHSUHVHQFHRI&$&LQ % )XOOÀHOGLPDJHUHFRQVWUXFWLRQLQKLJKSLWFKGXDOVRXUFH&7 $+0DKQNHQ7 $OOPHQGLQJHU06HGOPDLU65HLQDUW]&.XKO7 )ORKU $DFKHQ'()RUFKKHLP'(DQGUHDVPDKQNHQ#UZWKDDFKHQGH 3XUSRVH7KHÀHOGRIYLHZ)29LQKLJKSLWFK'6&7LVOLPLWHGE\WKHVL]HRIWKH VHFRQGGHWHFWRU7KHJRDORIWKLVVWXG\LVWRGHYHORSDQGHYDOXDWHDIXOO)29LPDJH UHFRQVWUXFWLRQWHFKQLTXHIRUKLJKSLWFK'6&7 0HWKRGVDQG0DWHULDOV)RUUHFRQVWUXFWLRQEH\RQGWKH)29RIWKHVHFRQGGHWHF WRUUDZGDWDRIWKHVHFRQGV\VWHPDUHH[WHQGHGWRWKHIXOOGLPHQVLRQVRIWKHÀUVW V\VWHPXWLOLVLQJWKHSDUWO\H[LVWLQJGDWDRIWKHÀUVWV\VWHPLQFRPELQDWLRQZLWKD YHU\VPRRWKWUDQVLWLRQZHLJKWIXQFWLRQFRYHULQJGHWHFWRUFKDQQHOV'XULQJWKH ZHLJKWHGÀOWHUHGEDFNSURMHFWLRQWKHGDWDRIWKHVHFRQGV\VWHPDUHDSSOLHGZLWKDQ DGGLWLRQDOZHLJKWLQJIDFWRU7KLVZDVWHVWHGIRUGLIIHUHQWSLWFKYDOXHVIURPWR RQDVLPXODWHGSKDQWRPDQGRQKLJKSLWFK'6&7GDWDVHWVDFTXLUHGDWSLWFK YDOXHVRIDQG'HÀQLWLRQ6LHPHQV)RUFKKHLP*,PDJHV ZHUHUHFRQVWUXFWHGZLWK)29VL]HVUDQJLQJIURP[PPWR[PP ,PDJHTXDOLW\ZDVDVVHVVHGE\WZRUDGLRORJLVWVXVLQJDSRLQW/LNHUWVFDOH 5HVXOWV,QSKDQWRPDQGSDWLHQWGDWDIXOO)29LPDJHTXDOLW\GHSHQGHGRQSLWFK :KHUHFRPSOHWHSURMHFWLRQGDWDIURPWKHVHFRQGWXEHGHWHFWRUV\VWHPZDVDYDLO DEOHLPDJHTXDOLW\ZDVXQDIIHFWHGE\SLWFKFKDQJHV)XOO)29LPDJHTXDOLW\ZDV QRWFRPSURPLVHGDWSLWFKYDOXHVRIDQGUHPDLQHGIXOO\GLDJQRVWLFXSWRDSLWFK RI$WKLJKHUSLWFKYDOXHVDSURJUHVVLYHGHSUHVVLRQRILPDJHTXDOLW\RFFXUUHG &RQFOXVLRQ:LWKWKLVQHZLPDJHUHFRQVWUXFWLRQWHFKQLTXHIXOO)29LPDJHVVKRXOG EHXVHGXSWRDSLWFKRI % 'HWHFWLRQRIYDVFXODUPDSDV\PPHWU\LQEUHDVWFDQFHUXVLQJQRYHO IXQFWLRQDOLQIUDUHGLPDJLQJWHFKQLTXH ',]KDN\ 06NODLU/HY\$0D\HU< 3IHIIHU(/LEVRQ7 6HOOD $LU3RUW&LW\,/5DPDW*DQ,/-HUXVDOHP,/ 3XUSRVH,QFUHDVHGYDVFXODULW\RIWKHEUHDVWGHWHFWHGE\05,KDVEHHQVXJJHVWHG DVDPDUNHUIRUPDOLJQDQF\2EWDLQLQJDEUHDVWYDVFXODUPDSUHTXLUHVFRQWUDVWHQ KDQFHGLQMHFWLRQGXULQJWKHH[DPLQDWLRQ+HUHZHH[DPLQHGDQRQLQYDVLYHPHWKRG IRUDVVHVVLQJYDVFXODUPDSGHQVLW\XVLQJDQRYHOLQIUDUHGLPDJLQJWHFKQLTXH 0HWKRGVDQG0DWHULDOV7 HQSDWLHQWVZLWKFOLQLFDOO\SURYHQFDQFHUDQGKHDOWK\ YROXQWHHUVZHUHH[DPLQHGXVLQJDSURWRW\SHV\VWHP587+,PDJHU5HDO,PDJLQJ /WG 0XOWLSOH ' LPDJH VHULHV ZHUH DFTXLUHG &RPSXWHULVHG LPDJH SURFHVVLQJ JHQHUDWHG'YDVFXODUPDSV $VSHFLDODOJRULWKPZDVGHYHORSHGWRDVVLJQDVFRUH EDVHGRQQXPEHUOHQJWKDQGGHQVLW\RIWKHYLVXDOLVHGEORRGYHVVHOV7KHVHVFRUHV ZHUHQRUPDOLVHGIRUEUHDVWGLPHQVLRQV&RPSDULVRQEHWZHHQJURXSVZDVGRQH XVLQJD6WXGHQWҋVWWHVW 5HVXOWV7KHUHZDVQRVLJQLÀFDQWGLIIHUHQFHLQDJHDQGDYHUDJHEUHDVWVL]HEH WZHHQWKHWZRJURXSV)RULQYDVLYHFDQFHUWKHPHDQYDVFXODUPDSGHQVLW\VFRUH ZDVZLWKWKHDIIHFWHGEUHDVWVKRZLQJLQFUHDVHGRYHUDOOYDVFXODULW\PHDQ WXPRXUVL]HPP)RUKHDOWK\YROXQWHHUVWKHPHDQYDVFXODUPDSGHQVLW\ VFRUH ZDV S $YHUDJH LPDJH DFTXLVLWLRQ WLPH RQ WKH 587+ VFDQQHUZDVVHFRQGV &RQFOXVLRQ7KHQRYHO587+LPDJHUVKRZVLQFUHDVHGYDVFXODUPDSDV\PPHWU\LQ SDWLHQWVZLWKPDOLJQDQWEUHDVWFDQFHUZLWKUHODWLYHO\IDVWQRQLQYDVLYHDFTXLVLWLRQ )XUWKHUVWXG\VKRXOGEHSHUIRUPHGWRHYDOXDWHWKHUROHRIPRQLWRULQJRIYDVFXODU PDSDV\PPHWU\XVLQJWKLVWHFKQRORJ\IRUHDUO\GHWHFWLRQRIEUHDVWFDQFHU % /RZGRVH[UD\SKDVHFRQWUDVWFRPSXWHGWRPRJUDSK\IRUEUHDVW FDQFHUGLDJQRVLV (%UXQ < =KDR$6]WURND\3 'LHPR]=+XDQJ$0LWWRQH 0) 5HLVHU-0LDR3 &RDQ*UHQREOH)5:HVWZRRG&$86 0XQLFK'(*DUFKLQJ'(HPPDQXHOEUXQ#HVUIIU 3XUSRVH0DPPRJUDSK\LVWKHVWDQGDUGLPDJLQJPRGDOLW\IRUHDUO\EUHDVWFDQFHU GHWHFWLRQEXWVHQVLWLYLW\LVVWLOOOLPLWHGLQSDUWLFXODULQGHQVHEUHDVWV&RPSXWHG WRPRJUDSK\ &7 KDV QRW \HW EHHQ FOLQLFDOO\ LPSOHPHQWHG EHFDXVH RI WKH KLJK UDGLRVHQVLWLYLW\RIEUHDVW,QYLWURSKDVHFRQWUDVW&7KDVEHHQSURYHQFDSDEOHRI SURGXFLQJKLJKFRQWUDVWLPDJHVSRWHQWLDOO\RYHUFRPLQJPDPPRJUDSK\OLPLWDWLRQV :HGHPRQVWUDWHWKDWGRVHUHGXFWLRQIRUDJLYHQFRQWUDVWUHVROXWLRQFDQEHDFKLHYHG XVLQJDQHZUHFRQVWUXFWLRQDOJRULWKPNQRZQDVHTXDOO\VORSHGWRPRJUDSK\(67 5HVXOWVRIFRPSDUDWLYHH[SHULPHQWVWRH[SORUHUDGLDWLRQGRVHUHGXFWLRQLQSKDVH FRQWUDVWPDPPRJUDSK\DUHUHSRUWHG 0HWKRGVDQG0DWHULDOV([SHULPHQWVZHUHSHUIRUPHGDW(XURSHDQ6\QFKURWURQ 5DGLDWLRQ)DFLOLW\7KUHHIRUPDOLQÀ[HGIXOOKXPDQEUHDVWVDPSOHVZHUHLPDJHG XVLQJ SKDVH FRQWUDVW &7 [UD\ HQHUJ\ NH9 YR[HO VL]H PLFURQ 6FLHQWLILF6HVVLRQ $ 6&'()*+%(XURSHDQ&RQJUHVVRI 5DGLRORJ\ 0RQGD\ % )XOO\DXWRPDWHGDVVHVVPHQWRIULJKWYHQWULFXODUIXQFWLRQDO SDUDPHWHUVIURP(&*JDWHGFRURQDU\&7DQJLRJUDSK\GDWD HYDOXDWLRQRISURWRW\SHVRIWZDUH 5:%DXHU $:U]HVQLDN'%HUQKDUGW7 /HKQHUW ) 9HJD+LJXHUD7 -9RJO-0.HUO)UDQNIXUWD0DLQ'( )RUFKKHLP'(UDOIZEDXHU#DROFRP 3XUSRVH(QODUJHPHQWRIWKHULJKWYHQWULFOHLVDVLJQRI59G\VIXQFWLRQSUHVVXUH RUYROXPHRYHUORDGRUDUUK\WKPRJHQLF59G\VSODVLDDQGDOVRDVXUYLYDOSUHGLFWRU LQFKURQLFSXOPRQDU\GLVHDVHDQGSXOPRQDU\HPEROLVP:HHYDOXDWHGWKHSHU IRUPDQFHRISURWRW\SHVRIWZDUHIRUIXOO\DXWRPDWHGVHJPHQWDWLRQDQGYROXPHWU\ RIWKHULJKWYHQWULFOH 0HWKRGVDQG0DWHULDOV,QUHWURVSHFWLYHO\(&*JDWHGFRURQDU\&7DQJLRJUDSK\ VFDQVWKHHQGV\VWROLF599PLQDQGHQGGLDVWROLF599PD[YROXPHRIWKHULJKW YHQWULFOH ZDV FDOFXODWHG IXOO\ DXWRPDWLFDOO\ E\ SURWRW\SH VRIWZDUH 0DQXDO VOLFH VHJPHQWDWLRQE\WZRLQGHSHQGHQWUDGLRORJLVWVVHUYHGDVWKHUHIHUHQFHVWDQGDUG 0HDVXUHPHQWSHULRGVZHUHFRPSDUHGIRUWKHVHPHWKRGV 5HVXOWV5LJKWYHQWULFXODUYROXPHVFDOFXODWHGZLWKWKHSURWRW\SHVRIWZDUHZHUH LQH[FHOOHQWDJUHHPHQWZLWKWKHUHVXOWVIURPPDQXDOVOLFHVHJPHQWDWLRQ%ODQG $OWPDQ U S /LQ V FRUUHODWLRQ 5KR S IRU599PD[DQG599PLQZLWKH[FHOOHQWLQWHUREVHUYHUDJUHHPHQWEHWZHHQERWK UDGLRORJLVWVU S7KHUHZDVQRQHHGIRUPDQXDOFRUUHFWLRQRIWKH 59ERUGHUVDVVHJPHQWHGE\WKHVRIWZDUHLQDVLQJOHFDVH0HDVXUHPHQWSHULRG ZDVVLJQLÀFDQWO\VKRUWHUZLWKWKHVRIWZDUHVWKDQZLWKPDQXDOVOLFHVHJ PHQWDWLRQV &RQFOXVLRQ7KHSURWRW\SHVRIWZDUHZDVDEOHWRGHPRQVWUDWHH[FHOOHQWSHUIRUP DQFHLQFRPSDULVRQWRWKHUHIHUHQFHVWDQGDUG,WSURPLVHVQRWRQO\WRPLQLPLVH SRVWSURFHVVLQJWLPHEXWDOVRWRHOLPLQDWHVXEMHFWLYHVHOHFWLRQRIVOLFHVDQGFDUGLDF SKDVHV % 7UXHUHDOWLPHFDUGLDF05,LQIUHHEUHDWKLQJZLWKRXW(&* V\QFKURQLVDWLRQXVLQJUDGLDONVSDFHVDPSOLQJLQLWLDOUHVXOWV 5:%DXHU ,5DGWNH6=KDQJ7 %ORFN-0.HUO0*0DFN7 **UDI 7 -9RJO0&/DUVRQ)UDQNIXUW'(*|WWLQJHQ'(UDOIZEDXHU#DROFRP 3XUSRVH:HLQYHVWLJDWHGDQRYHO7UXH),63VHTXHQFHEDVHGRQUDGLDONVSDFH VDPSOLQJ U7UXH),63 WKDW GRHV QRW UHTXLUH (&*V\QFKURQLVDWLRQRU EUHDWKKROG IRUFLQHFDUGLDF05, 0HWKRGV DQG 0DWHULDOV KHDOWK\ YROXQWHHUV KHDUW UDWH ESP UDQJH ESP XQGHUZHQW 7 FDUGLDF 05, 6LQJOHVKRW VKRUW D[LV YLHZV ZHUH DFTXLUHGZLWKDUHWURVSHFWLYHO\(&*JDWHGVHJPHQWHGEUHDWKKROGFLQHEDODQFHG VWHDG\VWDWHIUHHSUHFLVLRQE66)3DQGEZLWKU7UXH),63VHTXHQFHVZLWKVOLGLQJ ZLQGRZDFTXLVLWLRQVXEIUDPHVZLWKDWHPSRUDOUHVROXWLRQRIIUVDQGIUV U7UXH),63ZHUHDFTXLUHGGXULQJIUHHEUHDWKLQJZLWKRXW(&*V\QFKURQLVDWLRQ/HIW YHQWULFXODUIXQFWLRQDOSDUDPHWHUV('9(69()ZHUHGHWHUPLQHGDFFRUGLQJWR WKH6LPSVRQ VUXOHZLWKE66)3UHSUHVHQWLQJWKHUHIHUHQFHVWDQGDUG&RQWUDVWWR QRLVHUDWLR&15RIP\RFDUGLXPEORRGSRROZDVFDOFXODWHG4XDOLW\RIZDOOPRWLRQ GHSLFWLRQZDVDVVHVVHGE\WZRUDGLRORJLVWV JRRG IDLU QRQGLDJQRVWLF 5HVXOWV()VKRZHGVWURQJFRUUHODWLRQU SEHWZHHQE66)3 DQGIUVU7UXH),63EXWRQO\PRGHUDWHFRUUHODWLRQU ZLWKIUV U7UXH),637KHUHDVRQIRUWKDWZDVWKDW(69ZDVVLJQLÀFDQWO\S RYHUHVWLPDWHGZLWKIUVU7UXH),63IUVPOIUVPOE66)3 PO 0HDQ &15 ZDV VLJQLÀFDQWO\ ORZHU S ZLWK IUV U7UXH),63 FRPSDUHGWRIUVU7UXH),63DQGE66)3YVYV+RZHYHUGXH WRWKHIDVWHUWHPSRUDOUHVROXWLRQLPDJHTXDOLW\IRUZDOOPRWLRQDVVHVVPHQWZDV UDWHGVLJQLÀFDQWO\EHWWHUIRUIUV &RQFOXVLRQ/HIWYHQWULFXODUIXQFWLRQDODQDO\VLVZLWKUHDOWLPHQRQ(&*V\QFKUR QLVHGIUHHEUHDWKLQJU7UXH),63LVLQJRRGDJUHHPHQWZLWKVWDQGDUG(&*JDWHG EUHDWKKROGFLQHE66)3VHTXHQFHV % (YLGHQFHRIFRQWLQXRXVKHOLFDOVWUXFWXUHRIWKHFDUGLDFYHQWULFXODU DQDWRP\DVVHVVHGE\GLIIXVLRQWHQVRULPDJLQJPDJQHWLFUHVRQDQFH PXOWLUHVROXWLRQWUDFWRJUDSK\ $+LGDOJR ) 3RYHGD(0DUWL'*LO$$QGDOX]) &DUUHUDV 0%DOOHVWHU%DUFHORQD(6/OHLGD(6DOKLGDOJRS#JPDLOFRP 3XUSRVH'HHSXQGHUVWDQGLQJRIP\RFDUGLDOVWUXFWXUHOLQNLQJPRUSKRORJ\DQGIXQF WLRQRIWKHKHDUWZRXOGXQUDYHOFUXFLDONQRZOHGJHIRUPHGLFDODQGVXUJLFDOFOLQLFDO SURFHGXUHVDQGVWXGLHV'LIIXVLRQWHQVRU05,SURYLGHVDGLVFUHWHPHDVXUHPHQW RIWKH'DUUDQJHPHQWRIP\RFDUGLDOÀEUHVE\WKHREVHUYDWLRQRIORFDODQLVRWURSLF SDWLHQWVUDGLRORJLVWVUHSRUWHG&$&RQO\LQSDWLHQWVDQG LQQRQHRIWKHPWKHFRURQDU\DUWHULHVLQYROYHGZHUHLQGLFDWHG &RQFOXVLRQ1RQJDWHGFKHVW&7LVDYDOLGWRROIRUWKHHYDOXDWLRQRI&$&1RZD GD\VUDGLRORJLVWVDUHQRWFRQÀGHQWLQUHSRUWLQJWKLVLQFLGHQWDOÀQGLQJ:KHQWKH FRURQDULHVDUHQRWWKHDLPRI&7VWXG\WKHUHSRUWLQJUDWHRI&$&LVYHU\ORZ$ V\VWHPDWLFHYDOXDWLRQRI&$&FRXOGEHSURSRVHGLQDOOFKHVW&7VWXGLHVWRRIIHU DGGLWLRQDOFOLQLFDOLQIRUPDWLRQFRQFHUQLQJKHDUWGLVHDVHULVN % 3URJUHVVLRQRIFRURQDU\DUWHU\FDOFLÀFDWLRQVGXULQJWKHÀUVW\HDU DIWHUUHQDOWUDQVSODQWDWLRQ /9)RU]HQLJR'&UHVVHUL&$OÀHUL//RQJKL0*5DFLWL0*DUDYDJOLD 0LODQ,7ODXUDYI#OLEHURLW 3XUSRVH&DUGLRYDVFXODUGLVHDVH&9'LVWKHPRVWFRPPRQFRPSOLFDWLRQDIWHU NLGQH\WUDQVSODQW.7[DQGFRURQDU\DUWHU\FDOFLÀFDWLRQV&$&DUHFODLPHGWR SOD\DNH\UROH6FDQW\DQGFRQWUDGLFWRU\UHVXOWVKDYHEHHQSURGXFHGRQWKLVWRSLF ,QWKHSUHVHQWVWXG\ZHORRNHGDWWKH&$&SURJUHVVLRQHYDOXDWHGDFFRUGLQJWR 6HYUXNRYҋVFULWHULDGXULQJWKHÀUVW\HDUDIWHU.7[ 0HWKRGV DQG 0DWHULDOV FRQVHFXWLYH .7[ SDWLHQWV ZHUH HYDOXDWHG ZLWKLQ PRQWKV DIWHU .7[ IRU &$& HYDOXDWLRQ ZLWK &7 ,Q SDWLHQWV ZHUHSHDWHG WKH &$&HYDOXDWLRQDIWHU\HDU,QSDWLHQWVZKRGLGQRWSHUIRUPWKHVHFRQGFRQWURO EHFDXVH RI DQ\ FOLQLFDO UHDVRQ7KH$JDWVWRQH VFRUH $6 YDOXHV DQG FKDQJHV ZHUHSXWLQWRUHODWLRQVKLSZLWKWKHPDLQELRFKHPLFDODQGFOLQLFDOYDULDEOHVXVLQJ XQLYDULDWH8$DQGPXOWLYDULDWHDQDO\VLV0$ 5HVXOWV $WEDVDOHYDOXDWLRQKDGVLJQLÀFDQW $6YDOXHV7KHEDVDO $6 YDOXHVZHUHUHODWHGRQO\WRWKHDJHRIWKHSDWLHQWDWHLWKHU8$RU0$S $IWHU\HDUSDWLHQWVVLJQLÀFDQWO\ZRUVHQWKHLU$6YDOXHVZKLOHWKH UHPDLQLQJGLGQRW1RVLJQLÀFDQWUHODWLRQVKLSZDVIRXQGEHWZHHQDQ\FOLQLFDO LQVWUXPHQWDORUODERUDWRU\GDWDDQGZRUVHQLQJRI $6QRUWKHUHZDVDQ\UHODWLRQVKLS RIZRUVHQLQJLQ$6ZLWKDQ\FKDQJHLQUHQDOIXQFWLRQ &RQFOXVLRQ7KHSUHVHQFHRI&$&VLVDIUHTXHQWÀQGLQJDWWLPHRI.7[ $ZRUVHQLQJ RI&$&LVDOVRREVHUYHG+RZHYHUWKHFOLQLFDOPHDQLQJRIWKLVÀQGLQJLVHTXLYR FDODQGZHQHHGODUJHUVWXGLHVEHIRUHGHFLGLQJZKHWKHUWKH&$&DVVHVVPHQWLV ZRUWKGRLQJRQDURXWLQHEDVLV % 6SRUWFDWHJRU\LVDQLPSRUWDQWGHWHUPLQDQWRIFDUGLDFDGDSWDWLRQDQ 05,VWXG\ 7 /XLMN[0-&UDPHU1+-3UDNNHQ&) %XFNHQV) -*%DFN[ :3 7 00DOL%.9HOWKXLV8WUHFKW1/WOXLMN[#JPDLOFRP 3XUSRVH3K\VLRORJLFFDUGLDFDGDSWDWLRQLQDWKOHWHVLVLQÁXHQFHGE\ERG\VXUIDFH DUHDJHQGHUDJHWUDLQLQJLQWHQVLW\DQGVSRUWW\SH7KLVVWXG\DVVHVVHVWKHLQÁX HQFHRIVSRUWFDWHJRU\DQGSURYLGHVDUHIHUHQFHIUDPHZRUNIRUSK\VLRORJLFOLPLWV E\VSRUWFDWHJRU\DQGJHQGHU 0HWKRGVDQG0DWHULDOVVXEMHFWVPHDQDJH\HDUVUDQJH PHQXQGHUZHQWDFDUGLDF05,&05LQYHVWLJDWLRQKHDOWK\QRQDWKOHWHV KRXUVZHHNO\H[HUFLVHDQGKHDOWK\HOLWHDWKOHWHVPHDQKRXUVZHHNO\ H[HUFLVH$WKOHWHVSHUIRUPHGHLWKHUORZG\QDPLFKLJKVWDWLF/'+6Q KLJK G\QDPLFORZ VWDWLF +'/6 Q RU KLJK G\QDPLFKLJK VWDWLF VSRUWV +'+6 Q 5HVXOWV 7KH OHIW YHQWULFXODU /9 HQGGLDVWROLF YROXPH ('9 POP IRU QRQ DWKOHWHV/'+6+'/6+'+6 UHVSHFWLYHO\ ZDV LQ PDOHV DQG LQ IHPDOHV 7KH /9 HQGGLDVWROLF PDVV ('0JP IRU QRQDWKOHWHV/'+6+'/6+'+6 ZDV IRU PDOHV DQG IRU IHPDOHV$WKOHWHVҋ /9 ('9('0 UDWLRV ZHUH QRW ODUJHU WKDQ LQ QRQDWKOHWHV GLVSURYLQJVHOHFWLYHYHQWULFXODUZDOOWKLFNHQLQJ/959('9UDWLRVZHUHVLPLODULQ DOOJURXSVPDOHVIHPDOHVUDQJH0XOWLYDULDWHOLQHDUUHJUHVVLRQ GHPRQVWUDWHGDKLJKO\VLJQLÀFDQWFRQWULEXWLRQRIVSRUWFDWHJRU\ZLWKFRHIÀFLHQWV ODUJHUWKDQWKDWRIWUDLQLQJKRXUVJHQGHUDQGDJHS/9('9('0FRHI ÀFLHQWVIRUVSRUWFDWHJRU\/'+6+'/6+'+6 &RQFOXVLRQ7KLVVWXG\GHPRQVWUDWHVEDODQFHGFDUGLDFDGDSWDWLRQIRUDOOVSRUW FDWHJRULHVZLWKSUHVHUYHGUDWLRVRI/9YROXPH/9ZDOOPDVVDQG/959YROXPH 6SRUWFDWHJRU\KDVDODUJHLPSDFWRQFDUGLDFDGDSWDWLRQ+'+6VSRUWVVKRZWKH ODUJHVWFKDQJHVZKHUHDV/'+6VSRUWVVKRZGLPHQVLRQVVLPLODUWRQRQDWKOHWHV 7KLVVWXG\ҋVUHVXOWVFDQVHUYHDVDUHIHUHQFHLQFOLQLFDOSUDFWLFH 6FLHQWLILF6HVVLRQ 6 &$' ( ) *+% (XURSHDQ&RQJUHVVRI 5DGLRORJ\ 5HVXOWV&DUGLDF05LPDJLQJZDVSRVVLEOHLQDOOH[DPLQDWLRQVXVLQJWKH 'RSSOHUXOWUDVRXQGGHYLFHDQGXVLQJ(&*WULJJHULQJ8VLQJ'RSSOHUXOWUDVRXQG IRUWULJJHULQJLPDJHTXDOLW\ZDVFRPSDUDEOHWR(&* $OODQDWRPLFDOVWUXFWXUHVFRXOG EHFOHDUO\HYDOXDWHG)RUIXQFWLRQDOHYDOXDWLRQWKH/9DQGWKH()ZHUHDVVHVVHG 7KHUHZDVQRVLJQLÀFDQWGLIIHUHQFHEHWZHHQERWKPHWKRGV/9PODQG() IRU'RSSOHUXOWUDVRXQGDQG/9DQGIRU(&* &RQFOXVLRQ7KH05FRPSDWLEOH'RSSOHUXOWUDVRXQGGHYLFHLVDQHZWULJJHULQJ PHWKRGIRUFDUGLDF05,,WPLJKWEHIDVWHUDQGHDVLHULQWKHDSSOLFDWLRQFRPSDUHG WR(&* % 1RQLQYDVLYHFDUGLDFYHLQPDSSLQJUROHRI0'&7&$ 50DODJR$3H]]DWR&%DUELDQL8$OIRQVL*6DOD53R]]L0XFHOOL 9HURQD,7UREHUWRPDODJ#\DKRRLW 3XUSRVH&RURQDU\YHQRXVDQDWRP\LVRISULPDU\LPSRUWDQFHZKHQLPSODQWLQJD SDFHPDNHURUDGHÀEULOODWRUGHYLFHEHFDXVHFRURQDU\VLQXVFDQEHHQODUJHGRU VWHQRWLFGHSHQGLQJRQFKURQLFKHDUWIDLOXUH7KHDLPRIWKLVVWXG\LVWRHYDOXDWHWKH XVHIXOQHVVRI0'&7&$LQGHVFULELQJWKHFRURQDU\YHQRXVWUHHDQGLQSDUWLFXODU WKHFRURQDU\VLQXVDQGGHWHFWLQJPDLQYHQRXVV\VWHPYDULDQWV 0HWKRGV DQG 0DWHULDOV FRQVHFXWLYH SDWLHQWV PHDQ DJH <2 VWXGLHGIRUFRURQDU\DUWHU\GLVHDVHZLWKVOLFH0'&7&$ZHUHUHWURVSHFWLYHO\ H[DPLQHG7KHFDUGLDFYHQRXVV\VWHPZDVGHSLFWHGXVLQJ'035F035DQG 0,3SRVWSURFHVVLQJUHFRQVWUXFWLRQVRQDQRIIOLQHZRUNVWDWLRQ)RUHDFKSDWLHQW LPDJHTXDOLW\SUHVHQFHDQGFDOLEUHRIWKHFRURQDU\VLQXV&6JUHDWFDUGLDFYHLQ *&9PLGGOHYHLQ09DQWHULRULQWHUYHQWULFXODUYHLQ$,9ODWHUDOFDUGLDFYHLQ /&9SRVWHULRUFDUGLDFYHLQ3&9VPDOOFDUGLDFYHLQ6&9DQGSUHVHQFHRI YDULDQWRIWKHQRUPDODQDWRP\ZHUHUHFRUGHG 5HVXOWVDQG&RQFOXVLRQ&6*&909DQG$,9ZHUHYLVXDOLVHGLQRIWKH FDVHV7KH/&9ZDVYLVXDOLVHGLQSDWLHQWVWKH3&9LQ SDWLHQWVDQGWKH6&9LQSDWLHQWV0HDQGLDPHWHURIWKH&6 ZDVPPLQSDWLHQWVZLWKRXWFKURQLFKHDUWIDLOXUHDQGPP LQSDWLHQWVFKURQLFKHDUWIDLOXUH % $FFHOHUDWHGFLQHLPDJLQJRIWKHKHDUWLQPLFHDW7 FRPSDULVRQRI UHWURVSHFWLYHO\VHOIJDWHGDQGSURVSHFWLYHO\WULJJHUHG)/$6+VHTXHQFHV 3 )ULHV-6WURHGHU$0XHOOHU$0DVVPDQQ56HLGHO*6FKQHLGHU $%XHFNHU+RPEXUJ'(GUSHWHUIULHV#JRRJOHPDLOFRP 3XUSRVH 7 R FRPSDUH SURVSHFWLYHO\ WULJJHUHG )/$6+ 37 ZLWK UHWURVSHFWLYHO\ VHOIJDWHG56*DQGDFFHOHUDWHGUHWURVSHFWLYHO\VHOIJDWHG)/$6+DFF56*FLQH VHTXHQFHVIRUWKHDVVHVVPHQWRIFDUGLDFIXQFWLRQLQPLFHDW7 0HWKRGV DQG 0DWHULDOV &%/ PLFH ZHUH H[DPLQHG RQ D 7 DQLPDO VFDQQHU %UXNHU %LR6SHF *HUPDQ\ :H DFTXLUHG FRQVHFXWLYH PP VKRUW D[LV VOLFHV FRYHULQJ WKH OHIW YHQWULFOH /9 XVLQJ D 37 757( њ )29 [ FP PDWUL[ [ IUDPHV 3, D 56* 757( њ )29 [ FP PDWUL[ [ IUDPHV 3, DQG DQ DFF56* 757( њ )29 [ FP PDWUL[ [ FDUGLDFIUDPHV 3,*5$33$ 7ZRUHDGHUVLQGHSHQGHQWO\HYDOXDWHGWKHGLIIHUHQWGDWDVHWVLQD EOLQGHGPDQQHUWZLFHVHSDUDWHGE\ZHHNVUHJDUGLQJ/9('9/9(6969() FDUGLDF RXWSXW &2 DQG P\RFDUGLDO PDVV 0\R07 RWDO DFTXLVLWLRQ WLPHV 7$ IRU WKH FRPSOHWH H[DPLQDWLRQ RI WKH KHDUW ZHUH DVVHVVHG IRU HDFK VHTXHQFH 6WDWLVWLFDODQDO\VHVLQFOXGHGDRQHZD\$129$ZLWK%RQIHUURQLPXOWLFRPSDULVRQ WHVWSDQG%ODQG$OWPDQDQDO\VHVIRUWKHDVVHVVPHQWRILQWUDDQGLQWHU REVHUYHUYDULDELOLW\ 5HVXOWV7KHUHZHUHQRVWDWLVWLFDOO\VLJQLÀFDQWGLIIHUHQFHVEHWZHHQWKHGLIIHUHQW LPDJLQJDSSURDFKHVIRUDOOFDUGLDFSDUDPHWHUV/9('93756*DFF56*PHDQ O S /9(69 O S 69 OS ()S &2PO PLQS DQG0\R0PJS 7$ZDVVLJQLÀFDQWO\VKRUWHU IRUDFF56*PLQS FRPSDUHGWR37PHDQ6'PLQ DQG56*PLQ &RQFOXVLRQ&LQH05,ZLWKDFF56*DOORZVIRUDQDVVHVVPHQWRIFDUGLDFIXQFWLRQ LQPLFHZLWKLQPLQZKLOHSURYLGLQJWKHVDPHTXDQWLWDWLYHGDWDDVFRQYHQWLRQDO37 DQG56*)/$6+VHTXHQFHV7KLVDSSURDFKDOORZVDQH[SHGLWLRQRI05VWXGLHV LQFDUGLRYDVFXODUGLVHDVHPRGHOV GLIIXVLRQRIZDWHUPROHFXOHVLQELRORJLFDOWLVVXHV,QWKLVZRUNZHSUHVHQWDPXOWL VFDOHYLVXDOLVDWLRQWHFKQLTXHEDVHGRQ'705,VWUHDPOLQLQJFDSDEOHRIXQFRYHULQJ DGGLWLRQDOSURSHUWLHVRIWKHDUFKLWHFWXUDORUJDQLVDWLRQRIWKHKHDUW 0HWKRGVDQG0DWHULDOV:HVHOHFWHGWKH-RKQ+RSNLQV8QLYHUVLW\-+8&DQLQH +HDUW'DWDVHWZKHUHWKHORQJD[LVFDUGLDFSODQHLVDOLJQHGZLWKWKHVFDQQHUҋV= D[LV7KHLUHTXLSPHQWLQFOXGHGDHOHPHQWSDVVHGDUUD\FRLOHPLWWLQJD7 )RU '7,DFTXLVLWLRQD')6(VHTXHQFHLVDSSO\:HXVHGVHHGVIRUIXOOVFDOH WUDFWRJUDSK\ZKLOHZHDSSOLHGD0,3PDSSLQJWHFKQLTXHIRUVLPSOLÀHGWUDFWRJUDSKLF UHFRQVWUXFWLRQ,QWKLVFDVHZHUHGXFHGHDFK'7,'YROXPHGLPHQVLRQVE\RUGHU WZRPDJQLWXGHEHIRUHVWUHDPOLQLQJ 5HVXOWV 2XU VLPSOLÀHG WUDFWRJUDSKLF UHFRQVWUXFWLRQ PHWKRG NHHSV WKH PDLQ JHRPHWULF IHDWXUHV RI ÀEUHV DOORZLQJ IRU DQ HDVLHU LGHQWLÀFDWLRQ RI WKHLU JOREDO PRUSKRORJLFDO GLVSRVLWLRQ LQFOXGLQJ WKH YHQWULFXODU EDVDO ULQJ 0RUHRYHU ZH QRWLFHGDFOHDUO\YLVLEOHKHOLFDOGLVSRVLWLRQRIWKHP\RFDUGLDOÀEUHVLQOLQHZLWKWKH KHOLFDOP\RFDUGLDOEDQGYHQWULFXODUVWUXFWXUHGHVFULEHGE\7 RUUHQW*XDVS)LQDOO\ RXUVLPSOLÀHGYLVXDOLVDWLRQZLWKVLQJOHWUDFWVLGHQWLÀHVWKHPDLQVHJPHQWVRIWKH KHOLFDOYHQWULFXODUDUFKLWHFWXUH &RQFOXVLRQ '705, PDNHV SRVVLEOH WKH LGHQWLÀFDWLRQ RI D FRQWLQXRXV KHOLFDO DUFKLWHFWXUH RI WKH P\RFDUGLDO ÀEUHV ZKLFK YDOLGDWHV 7 RUUHQW*XDVSҋV KHOLFDO P\RFDUGLDOEDQGYHQWULFXODUDQDWRPLFDOPRGHO % ,QDFFXUDFLHVLQFLQH66)305/9YROXPHWULFPHDVXUHPHQWV LQSDWLHQWVZLWK/9K\SHUWURSK\FRUUHFWLRQDSSO\LQJWKHPDVV FRQVHUYDWLRQSULQFLSOH .8%DXQHU0'XUDQG$&UHDQ(1JX\HQ6/H\5:DOG +5DNRZVNL13DXO%:LQWHUVSHUJHU7 RURQWR21&$ .HUVWLQ%DXQHU#PHGXQLPXHQFKHQGH 3XUSRVH7KHVWXG\DLPZDVWRHYDOXDWHGLIIHUHQFHVRI/9PDVVDQG(69DVVHVV PHQWLQSDWLHQWVZLWK/9K\SHUWURSK\E\FRPSDULQJVWDQGDUGFRQWRXULQJPHWKRGV ZLWKDWRWDO/9YROXPHDSSURDFKZKLFKLQFOXGHVDSSOLFDWLRQRIWKH´FRQVHUYDWLRQ RIPDVVµSULQFLSOHIRUP\RFDUGLDOYROXPH 0HWKRGVDQG0DWHULDOVSDWLHQWVGLDJQRVHGZLWK+&0'&0Q XQGHU JRLQJFDUGLDF05DW77ZHUHLQFOXGHG $OOSDWLHQWVXQGHUZHQWVWDQGDUGFLQH 66)3LQVKRUWD[LVRULHQWDWLRQIRU/9YROXPHWULFV[[PP75PV )RUWKHWRWDO/9YROXPHDSSURDFKGDWDVHWVZHUHHYDOXDWHGXVLQJVHPLDXWRPDWHG SRVWSURFHVVLQJ ZLWK HSL DQG HQGRFDUGLDO FRQWRXULQJ DW HQGGLDVWROH (' DQG HSLFDUGLDO FRQWRXULQJ RQO\ DW HQGV\VWROH (6 &DOFXODWLRQ RI(69 ZDV EDVHG RQWRWDO/9YROXPHDQGWKHP\RFDUGLDOYROXPHDVDVVHVVHGDW('DSSO\LQJWKH PDVVFRQVHUYDWLRQSULQFLSOH0&3$QDO\VLVZDVSHUIRUPHGIRU'&0DQG+&0 SDWLHQWVDQGFRPSDUHGWRVWDQGDUG/9YROXPHWULFDVVHVVPHQW67'ZLWKHSLDQG HQGRFDUGLDOFRQWRXULQJDW('(6IRU('9(69DQGP\RFDUGLDOPDVV 5HVXOWV7KH+&0JURXSVKRZHGVPDOOHU(69XVLQJ67'DVFRPSDUHGWR0&3 POYVPOS ZKLOHQRGLIIHUHQFHVZHUHIRXQGIRUWKH '&0JURXSPOYVPOS $YHUDJH+&0()GHFOLQHG IURP67'WR0&3S /9PDVVXVLQJ67'DSSURDFKGLIIHUHG E\J&,JEHWZHHQ('DQG(6LQ'&0SDWLHQWV S EXWE\J&,JLQWKH+&0JURXS S &RQFOXVLRQ(69DQGHQGV\VWROLFPDVVDVVHVVPHQWLVFKDOOHQJLQJLQ+&0GXH WR SUREOHPDWLF HQGV\VWROLF HQGRFDUGLDO FRQWRXULQJ DQG XQGHUHVWLPDWLRQ RI WUXH (698WLOLVDWLRQRIWKH/9PDVVFRQVHUYDWLRQSULQFLSOHPD\LQFUHDVHDFFXUDF\ % &DUGLDF05,XVLQJDQHZWULJJHUPHWKRG05FRPSDWLEOH'RSSOHU XOWUDVRXQGGHYLFHWRWULJJHUWKHKHDUWIUHTXHQF\LQFRPSDULVRQWR(&* %6FKRHQQDJHO&0XFK-<DPDPXUD.7 RUQTXLVW*$GDP 8:HGHJlUWQHU+DPEXUJ'(ZHGHJDHU#XNHXQLKDPEXUJGH 3XUSRVH 7KH DLP ZDV WR DVVHVV D 05 FRPSDWLEOH 'RSSOHUXOWUDVRXQG GHYLFH DVDQHZPHWKRGWRWULJJHUWKHKHDUWUDWHIRUFDUGLDF05,LQFRPSDULVRQWR(&* WULJJHULQJ 0HWKRGVDQG0DWHULDOV05LPDJLQJZDVSHUIRUPHGRQVKHHSRQD705 VFDQQHU7KH'RSSOHUXOWUDVRXQGVHQVRUZDVSODFHGRQWKHFKHVWDERYHWKHKHDUW DQGÀ[HGJHQWO\ZLWKDEHOW7KHUHFRUGHGVLJQDOZDVWUDQVIHUUHGWRWKH(&*WULJJHU XQLWRIWKH05,VFDQQHUDQGXVHGIRUFDUGLDFWULJJHULQJ$GGLWLRQDOO\FRQYHQWLRQDO (&*WULJJHULQJZDVUHFRUGHG&DUGLDF05,ZDVSHUIRUPHGXVLQJERWKWULJJHULQJ PHWKRGV FRQVHFXWLYHO\ )RU FDUGLDF 05, JUDGLHQW HFKR VHTXHQFHVLQ DQG FKDPEHUYLHZDQGLQVKRUWD[LVYLHZZLWKFLQHVHTXHQFHVSKDVHVWRGHWHUPLQH OHIWYHQWULFXODUYROXPHV/9DQGHMHFWLRQIUDFWLRQ()ZHUHJHQHUDWHG05LPDJHV DFTXLUHGZLWK'RSSOHUXOWUDVRXQGDQGFRQYHQWLRQDO(&*WULJJHULQJZHUHHYDOXDWHG VHSDUDWHO\E\WZRUDGLRORJLVWVFRQFHUQLQJLPDJHTXDOLW\DQGIXQFWLRQDODVVHVVPHQW 6FLHQWLILF6HVVLRQ $ 6&'()*+%(XURSHDQ&RQJUHVVRI 5DGLRORJ\ 0RQGD\ &RQFOXVLRQ7KLV DOVR RSHQV QHZ RSSRUWXQLWLHV IRU WKH LPSOHPHQWDWLRQ RI QHZ EXVLQHVVSURFHVVHVVHUYLFHVVXFKDVWHOHUDGLRORJ\%\WKHVHPHDQVWKHH[HUFLVH RIUHDOÀOPOHVVUDGLRORJ\FDQEHPRUHZLGHO\DFKLHYHG % $UH\RXNHHSLQJXSWRGDWH"2YHUKDOIRILPSRUWDQWUDGLRORJLFDO UHVHDUFKLVSXEOLVKHGLQQRQUDGLRORJLFDOMRXUQDOV < .ZRQJ./DWLHI1RWWLQJKDP8.GU\XQH#KRWPDLOFRP 3XUSRVH,WLVLPSRUWDQWIRUUDGLRORJLVWVWRSUDFWLFHHYLGHQFHEDVHGPHGLFLQHDQG LGHQWLI\LQJWKHODWHVWUHVHDUFKLVFUXFLDO:LWKWKHJURZWKLQPHGLFDOMRXUQDOVDQG WKHERG\RINQRZOHGJHUDGLRORJLVWVQHHGWREHDZDUHRIVWUDWHJLHVWRLGHQWLI\XS WRGDWHSXEOLFDWLRQV:HSHUIRUPDELEOLRPHWULFDQDO\VLVWRGHWHUPLQHWKHUDQJHRI MRXUQDOVZKHUHUDGLRORJLFDOUHVHDUFKLVSXEOLVKHG 0HWKRGVDQG0DWHULDOV7KHUDGLRORJLFDOMRXUQDOVZLWKWKHKLJKHVWLPSDFWIDFWRUV ZHUHLGHQWLÀHGWKURXJKWKH-RXUQDO&LWDWLRQ5HSRUWV6\VWHPDWLFUHYLHZVRYHU D\HDUSHULRGZHUHUHWULHYHGDQGWKHSULPDU\VWXGLHVFRQVWLWXWLQJWKHV\VWHPDWLF UHYLHZVZHUHFRPSLOHGWRSURYLGHDGDWDEDVHRIKLJKTXDOLW\XQLTXHSXEOLFDWLRQV 7KHVH ZHUH FODVVLÀHG LQWR IRXU FDWHJRULHV UDGLRORJ\ MRXUQDOV FOLQLFDO VXE VSHFLDOW\MRXUQDOVJHQHUDOPHGLFDOMRXUQDOVRWKHUV 5HVXOWVV\VWHPDWLFUHYLHZVZHUHDQDO\VHGDQGSULPDU\VWXGLHVUHWULHYHG 7KHVHZHUHFODVVLÀHGDVIROORZVZHUHSXEOLVKHGLQUDGLRORJLFDOMRXUQDOV LQFOLQLFDOVXEVSHFLDOLW\MRXUQDOVLQJHQHUDOPHGLFDOMRXUQDOV DQGLQRWKHUMRXUQDOV$PRQJVWUDGLRORJLFDOMRXUQDOVUDGLRORJ\KDGWKH KLJKHVWQXPEHURIRULJLQDOVWXGLHVFLWHGZLWK &RQFOXVLRQ 0RUH WKDQ KDOI RI LPSRUWDQW UDGLRORJLFDO UHVHDUFK LV SXEOLVKHGL Q QRQUDGLRORJLFDOMRXUQDOV7KLVFDQEHH[SODLQHGE\VRPHFOLQLFDOVSHFLDOW\MRXUQDOV KDYLQJLPSDFWIDFWRUVKLJKHUWKDQUDGLRORJ\MRXUQDOVFROODERUDWLRQEHWZHHQUHIHUULQJ SK\VLFLDQVDQGUDGLRORJLVWVDQGLQFUHDVLQJLQYROYHPHQWRIUHIHUULQJSK\VLFLDQVLQ GLUHFWO\DFTXLULQJLPDJLQJVWXGLHV7KHVFDWWHURIUDGLRORJLFDOUHVHDUFKDFURVVD EURDGUDQJHRIMRXUQDOVPHDQVWKDWEURZVLQJVHOHFWHGUDGLRORJLFDOMRXUQDOVLVQRW VXIÀFLHQWWRNHHSXSWRGDWH % (YDOXDWLRQRISXOPRQDU\QRGXOHVRQFKHVW&7XVLQJL3DG SUHOLPLQDU\H[SHULHQFH /)DJJLRQL(1HUL3 6EUDJLD6$QJHOL/&LQL'/DXUHWWL'&DUDPHOOD &%DUWROR]]L3LVD,7OIDJJLRQL#VLUPRUJ 3XUSRVH7 RHYDOXDWHWKHHIIHFWLYHQHVVRIWKHL3DGDVDPRELOHGHYLFHIRU' UHDGLQJRIFKHVW&7GDWDVHWVIRUWKHDVVHVVPHQWRISXOPRQDU\QRGXOHV 0HWKRGVDQG0DWHULDOV:HUHWURVSHFWLYHO\UHYLHZHGFKHVW&7H[DPLQDWLRQV SHUIRUPHG LQ SDWLHQWV ZLWK SXOPRQDU\ QRGXOHV IRU D WRWDO RI QRGXOHV VL]HG EHWZHHQPPDQGPP&7LPDJHVKDGEHHQDFTXLUHGXVLQJDURZ&7DQG ZHUHZLUHOHVVO\LPSRUWHGLQ',&20IRUPDWRQDQL3DG*%$SSOH,QF&XSHU WLQR&$UXQQLQJ2VLUL;+'ZZZRVLUL[YLHZHUFRPIURPD0DFLQWRVKGHVNWRS FRPSXWHUL0DF*+]FRQQHFWHGWRRXUKRVSLWDO3$&6DQGUXQQLQJ2VLUL; 7ZRH[SHULHQFHGUDWHUVUHDG&7GDWDVHWVLQGHSHQGHQWO\RQWKHL0DFDQGRQ WKHL3DG'HWHFWLRQUDWHDQGVHJPHQWDOORFDOLVDWLRQRIOHVLRQVZHUHUHFRUGHGIRU HDFKGDWDVHWDVZHOODVWKHWLPHQHHGHGIRUFRPSOHWHUHDGLQJRIHDFKFKHVW&7 H[DPLQDWLRQ,PDJHTXDOLW\ZDVDOVRYLVXDOO\DVVHVVHGXVLQJDWKUHHSRLQWVFDOH SRRU IDLU JRRG 5HVXOWV $OOQRGXOHVGHWHFWHGRQWKHL0DFZHUHDOVRLGHQWLÀHGRQWKHL3DGDQG WKHLUVHJPHQWDOORFDOLVDWLRQZDVFRUUHFWO\DVVHVVHGLQRIFDVHV,PDJHTXDOLW\ ZDVJRRGZLWKERWKGHYLFHVDQGLPDJHUHDGLQJWLPHZDVFRPSDUDEOHEHWZHHQWKHP PLQXWHVIRUWKHL0DFYVPLQXWHVIRUWKHL3DGS! &RQFOXVLRQ7KHL3DGFDQEHVXFFHVVIXOO\XVHGIRUSUHOLPLQDU\'UHDGLQJRI FKHVW&7GDWDVHWVLQSDWLHQWVZLWKSXOPRQDU\QRGXOHVDVZHOODVIRULPDJHVKDULQJ ZLWKQRQUDGLRORJ\VSHFLDOLVWVDQGIRUWHDFKLQJSXUSRVHV % $QRQWRORJ\RIPDJQHWLFUHVRQDQFHLPDJLQJVHTXHQFHV -/DVEOHL]$%XUJXQ5'XYDXIHUULHU+6DLQW-DOPHV5HQQHV)5 -HUHP\ODVEOHL]#ODSRVWHQHW 3XUSRVH7KHJRDORIWKLVRQWRORJ\LVWRLPSURYHWKHVHPDQWLFLQWHURSHUDELOLW\IRU 05,VHTXHQFHV,QGHHGHYHU\FRQVWUXFWRUKDVKLVRZQVHTXHQFHQDPHWKDWFRXOG EHXQNQRZQE\UDGLRORJLVWVRUHYHQ3$&6 0HWKRGVDQG0DWHULDOV&RQFHSWVDQGGHÀQLWLRQVRI05,VHTXHQFHVKDGEHHQ H[WUDFWHGIURPGRPDLQH[SHUWV',&20VWDQGDUG',&20KHDGHUVDQGOLWHUDWXUH ',&20KHDGHUVKDGEHHQH[WUDFWHGZLWK26,5,; $OOWKRVHGDWDKDGEHHQRUJDQLVHG ZLWK3URWpJpRZO7KHOLQNDJHEHWZHHQFRQFHSWVKDGEHHQPDGHZLWKUHODWLRQV DQGIRUPDOGHÀQLWLRQV 5RRP= &RPSXWHU$SSOLFDWLRQV 66 ,PDJLQJLQIRUPDWLFV 0RGHUDWRUV 0)DWHKL7HKUDQ,5 30F/DXJKOLQ&RUN,( % &RPELQDWLRQRIPDFKLQHOHDUQLQJDQGFRPSXWHUDVVLVWHGGLDJQRVLV LQEUHDVW05,V\VWHPDWLFLQYHVWLJDWLRQLGHQWLÀHVKLJKSRWHQWLDOWR VWUDWLI\VXUYLYDORXWFRPHLQSULPDU\EUHDVWFDQFHU 0'LHW]HO $'LHW]HO5=RXEL2&DPDUD0%RJGDQ:$.DLVHU 3 $7 %DOW]HU-HQD'(7ELQJHQ'(GLHW]HOPDWWKLDV#KRWPDLOFRP 3XUSRVH$SSOLFDWLRQRIEUHDVW05,DVDSURJQRVWLFELRPDUNHUUHPDLQVFKDOOHQJ LQJ GXH WR WKH PXOWLWXGH DQG FRPSOH[LW\ RI LQIRUPDWLRQ SURYLGHG E\ RQH VLQJOH H[DPLQDWLRQ 0DFKLQHOHDUQLQJ LV D SRWHQWLDO PHWKRG WR FODVVLI\ VXFK GDWD$F FRUGLQJO\ZHGHVLJQHGWKLVLQYHVWLJDWLRQWRV\VWHPDWLFDOO\HYDOXDWHWKHSRWHQWLDO RIPDFKLQHOHDUQLQJDOJRULWKPVWRSUHGLFWRYHUDOOVXUYLYDORIEUHDVWFDQFHUSDWLHQWV EDVHGRQEUHDVW05,ÀQGLQJV 0HWKRGV DQG 0DWHULDOV 3DWLHQWV UHFHLYLQJ EUHDVW05, VWDQGDUGLVHG SURWR FRO 7Z)/$6+ PPRONJ%: *G'73$ EHIRUH VXUJHU\ %,5$'6 ,99, QR VHFRQGDU\UHFXUUHQWFDQFHU ZHUH HQUROOHG WUHDWHG DQG IROORZHGXS DW RXU EUHDVWFDQFHUFHQWUH´'LVHDVHUHODWHGGHDWKµZDVGHÀQHGDVHQGSRLQW$FRP PHUFLDOO\DYDLODEOH&$'V\VWHPFRPSXWHUDVVLVWHGGLDJQRVLVZDVXVHGWRVHPL DXWRPDWLFDOO\HYDOXDWHHQKDQFHPHQWSDUDPHWHUVRIWKHSULPDU\EUHDVWFDQFHU XSRQ EUHDVW05,7KUHH PDFKLQHOHDUQLQJ DOJRULWKPV DUWLÀFLDOQHXUDOQHWZRUNV NQHDUHVWQHLJKERXU VXSSRUWYHFWRUPDFKLQHV ZHUH RSWLPLVHG WR SUHGLFW WKH HQGSRLQW EDVHG RQ VXFK HQKDQFHPHQWSDUDPHWHUV 3UHGLFWLRQV RI WKH HQGSRLQW ZHUHFRPSDUHGZLWKFRQYHQWLRQDOVWDWLVWLFVORJLVWLFUHJUHVVLRQ7 RDXWRPDWLFDOO\ RSWLPLVH DQG YDOLGDWH IROGFURVVYDOLGDWLRQ WKHVH FODVVLÀFDWLRQDOJRULWKPV DQ LQKRXVHGHYHORSHGIUDPHZRUNZDVXVHG 5HVXOWVSDWLHQWVZLWKSULPDU\LQYDVLYHEUHDVWFDQFHUZHUHHQUROOHGPHDQDJH \HDUV'XULQJDPHDQIROORZXSLQWHUYDORIPRQWKV´GLVHDVHUHODWHGGHDWKµ RFFXUUHGLQSDWLHQWV&RPSDUHGWRFRQYHQWLRQDOVWDWLVWLFVORJLVWLFUHJUHVVLRQ DOO PDFKLQHOHDUQLQJ DOJRULWKPV VKRZHG KLJKHU GLDJQRVWLF DFFXUDF\ ZLWK VXSSRUWYHFWRUPDFKLQHV DFKLHYLQJ WKH KLJKHVW YDOXH 0DFKLQHOHDUQLQJ VKRZHG SDUWLFXODUO\ KLJK VSHFLÀFLW\ DUWLÀFLDOQHXUDOQHWZRUNV NQHDUHVWQHLJKERXU VXSSRUWYHFWRUPDFKLQHV DQG QHJDWLYHSUHGLFWLYHYDOXHWRVWUDWLI\WKHHQGSRLQWDUWLÀFLDOQHXUDOQHWZRUNV NQHDUHVWQHLJKERXUVXSSRUWYHFWRUPDFKLQHV &RQFOXVLRQ0DFKLQHOHDUQLQJLVDSURPLVLQJPHWKRGIRUWKHLQGLYLGXDOULVNVWUDWLÀ FDWLRQRISDWLHQWVZLWKSULPDU\EUHDVWFDQFHU $FFRUGLQJWRRXUUHVXOWVLWLVVXSHULRU WRFRQYHQWLRQDOVWDWLVWLFVDQGVKRZVKLJKVSHFLÀFLW\DQGQHJDWLYHSUHGLFWLYHYDOXH WRVWUDWLI\WKHHQGSRLQW´GLVHDVHUHODWHGGHDWKµ % 5,63$&6DQGDUFKLYLQJRILPDJHVVHUYLFHVDQGEH\RQGGHOLYHUHG IURPWKHFORXGWKHJUHDWHU3DULVDUHDH[SHULPHQWDWLRQ 9$'XVVDX[3 %RLURQ3DULV)5YDOHUHGXVVDX[#JFVGVLVLIIU 3XUSRVH7KH´5pJLRQ6DQV)LOPµ´)LOPOHVV5HJLRQµSURJUDPPHZDVODXQFKHG LQE\WKH)UHQFK0LQLVWU\RI+HDOWKLQRUGHUWRKHOSWKHJHQHUDOLVDWLRQWRDOO KHDOWKFDUHVWUXFWXUHVVXFKDVKRVSLWDOVRUJHQHUDOSK\VLFLDQSUDFWLFHVRI3$&6 5,6DQGV\VWHPVRIDUFKLYLQJRIPHGLFDOLPDJHV5HFHQWDFKLHYHPHQWVSURYHWKH FRQFHSWRIWKHGHOLYHULQJRIVXFKVHUYLFHVIURPWKHFORXGDIWHUWKDWERWKEXLOGLQJRI WKHSODWIRUPRIVHUYLFHVDQGSLORWSKDVHVRIWKHSURJUDPZHUHFRPSOHWHG0RUHRYHU QHZVHUYLFHVRIVKDULQJRILQIRUPDWLRQDUHSURYHGSRVVLEOH 0HWKRGVDQG0DWHULDOV7KHVHUYLFHVDUHGHOLYHUHGE\PHDQVRIDSODWIRUPZKRP EXLOGLQJDQGUXQQLQJKDVEHHQFRQÀGHGWRDQLQGXVWULDOFRQVRUWLXP7KLVSODWIRUP LPSOHPHQWV WKH ODWHVW WHFKQRORJLHV RI PHGLFDO LPDJH SURFHVVLQJDQG RI FORXG FRPSXWLQJ,WLVEXLOWLQRUGHUWRVXSSRUWVHUYLFHRULHQWHGHQWHUSULVHDUFKLWHFWXUH 5HVXOWV7KHSODWIRUPLVLQQRYDWLYHEHLQJWKHÀUVWRQHFRQWDLQLQJDOOWKHPDWHULDOV IRUWKHLPSOHPHQWDWLRQRI3$&6VHUYLFHVLQWKHFORXGDOORZLQJIRUHDFKKHDOWKFDUH VWUXFWXUHWRRSHQWKHVHVHUYLFHVEH\RQGLWVERUGHUV7KHSODWIRUPKDVMXVWEHHQ YDOLGDWHGE\WKHKHDOWKVWUXFWXUHVLQYROYHGLQWKHSLORWSKDVHDQGWKHSURJUDPPHKDV HQWHUHGLQGXVWULDOGHSOR\PHQWSKDVH$GGLWLRQDOO\QHZ6XSHU3$&6OLNHVHUYLFHV DUHSURSRVHGLQFOXGLQJDFFHVVWRWKHLPDJHVSURGXFHGLQKRVSLWDOVWRWKH*3V DQGVKDULQJRIUDGLRORJLFDODGYLFHVVHUYLFHVZRUNOIRZV 6FLHQWLILF6HVVLRQ 6 &$' ( ) *+% (XURSHDQ&RQJUHVVRI 5DGLRORJ\ % 0DQDJLQJ,7VHUYLFHVLQDFRPSOHWHO\GLJLWLVHGUDGLRORJLFDO GHSDUWPHQWZLWKDQLQKRXVHGHSDUWPHQWDO,7JURXSD\HDU IROORZXSH[SHULHQFH +6WUXEH6:LUWK0) 5HLVHU07UHLWO 0XQLFK'(KDQQDVWUXEH#PHGXQLPXHQFKHQGH 3XUSRVH7 RHYDOXDWHWKHSHUIRUPDQFHRIDGHSDUWPHQWDOLQIRUPDWLRQWHFKQRORJ\ ,7JURXSFRPSDUHGWRKRVSLWDO,7DQGV\VWHPPDQXIDFWXUHUҋVVXSSRUWLQDFRP SOHWHO\GLJLWLVHGUDGLRORJLFDOGHSDUWPHQWEDVHGRQVHYHQ\HDUVRIH[SHULHQFH7KH SRWHQWLDOWRUHGXFHPDQXIDFWXUHUҋVVHUYLFHDQGWRPDQDJHXQNQRZQ,7SUREOHPV ZHUHLQYHVWLJDWHG 0HWKRGVDQG0DWHULDOV7KHGHSDUWPHQWDO,7JURXSPDLQWDLQVWKHUDGLRORJ\LQ IRUPDWLRQV\VWHP5,6DQGSLFWXUHDUFKLYLQJDQGFRPPXQLFDWLRQV\VWHP3$&6 XVLQJDQLQWUDQHWEDVHGUHSRUWLQJV\VWHP,7SUREOHPVDUHVSHFLÀHGDFFRUGLQJWR XUJHQF\UHVSRQVLELOLW\DQGDIIHFWHGV\VWHP $QHZ5,63$&6DQGDVSHHFKUHFRJ QLWLRQV\VWHPZHUHLQVWDOOHG7KHSHUIRUPDQFHDQGPHDQWLPHIRUWURXEOHVKRRWLQJ E\WKHGLIIHUHQWSURYLGHUVZHUHHYDOXDWHG 5HVXOWV,QPRQWKV,7SUREOHPVHPHUJHGZHUHVROYHGE\WKH GHSDUWPHQWDO ,7JURXS ZLWKLQ WKH WLPH OLPLW ZLWK KLJKVROXWLRQ UDWHV IRU EUHDNGRZQVRIWKHFOLQLFDOLQIRUPDWLRQV\VWHPVVWDQGDUGKDUG DQGVRIWZDUHLQFOXGLQJ5,6DQGDFFHSWDEOHVROXWLRQUDWHIRU3$&6 DQG LPDJLQJ GHYLFHV FDVHV UHTXLUHG D WURXEOHVKRRWLQJ ZLWKLQKVROYHGZLWKLQPLQE\GHSDUWPHQWDO,7JURXS,QRIWKH FDVHVPDQXIDFWXUHUҋVVXSSRUWZDVLQGLVSHQVDEOH2YHUWLPHWKHWRWDODPRXQWRI ,7SUREOHPVGHFUHDVHGE\XSWRIRUHPHUJHQF\DQGYHU\XUJHQWSUREOHPV EXWLQFUHDVHGIRUSUREOHPVRIORZHUXUJHQF\7KHLPSOHPHQWDWLRQRIQHZ5,63$&6 OHGWRDVKRUWLQFUHDVHLQWKHWRWDOQXPEHURI,7SUREOHPVWKRXJKWKRVHSUREOHPV PRVWO\ZHUHRIORZSULRULW\ &RQFOXVLRQ$ GHSDUWPHQWDO ,7JURXS SURYLGHV IDVW WURXEOHVKRRWLQJ VROYLQJD FRQVLGHUDEOH SURSRUWLRQ RI RFFXUULQJ DQG HYHQ QHZ ,7SUREOHPVQHFHVVLWDWLQJ PDQXIDFWXUHUҋVVXSSRUWRQO\LQDVPDOOQXPEHURIFDVHV % ,WHPLVHGRUSURVHUDGLRORJ\UHSRUWV"$VXUYH\RIKRVSLWDOFOLQLFLDQV DQGUDGLRORJLVWVҋSUHIHUHQFHV /:*RK+67 HK6LQJDSRUH6*/LQ:DK*RK#PRKKFRPVJ 3XUSRVH 7 R GHWHUPLQH FOLQLFLDQVҋ DQG UDGLRORJLVWVҋ SUHIHUHQFHV UHJDUGLQJ WKH IRUPDWRIWKHUDGLRORJ\UHSRUWDQGFRQWHQWV 0HWKRGVDQG0DWHULDOV4XHVWLRQQDLUHVZHUHVHQWRXWWRDOOFOLQLFLDQVIURPYDULRXV GHSDUWPHQWVDQGUDGLRORJLVWVSUDFWLFLQJZLWKLQ.KRR7 HFN3XDW+RVSLWDO6LQJDSRUH 7KHSDUWLFLSDQWVZHUHLQYLWHGWRUDQNDYDULHW\RIK\SRWKHWLFDOXOWUDVRXQGDQGFRP SXWHGWRPRJUDSK\VFDQUHSRUWVDFFRUGLQJWRWKHLUOHYHORIVDWLVIDFWLRQDQGSURYLGHG UHDVRQVIRUWKHLUFKRLFHV'HPRJUDSKLFLQIRUPDWLRQUHJDUGLQJWKHSDUWLFLSDQWVZDV REWDLQHGLQWKHTXHVWLRQQDLUH 5HVXOWV$WRWDORIUDGLRORJLVWVDQGFOLQLFLDQVUHVSRQGHGRIFOLQLFLDQV YV RI UDGLRORJLVWV ZHUH VDWLVÀHG ZLWK WKH LWHPLVHG UHSRUW IRU DQ DEQRUPDO XOWUDVRXQGVFDQSRIUDGLRORJLVWVYVRIFOLQLFLDQVZHUHVDWLVÀHG ZLWKWKHSURVHUHSRUWIRUDQDEQRUPDOXOWUDVRXQGVFDQS,QJHQHUDOPRVW UDGLRORJLVWVVWLOOSUHIHUUHGWKHSURVHUHSRUWLQJVW\OHFLWLQJIDPLOLDULW\ZLWKWKLVVW\OH RIUHSRUWLQJ0RVWFOLQLFLDQVSUHIHUUHGLWHPLVHGUDGLRORJ\UHSRUWVDVWKH\IHOWWKDW WKHVHUHSRUWVZHUHFOHDUHUDQGHDVLHUWRFRPSUHKHQG &RQFOXVLRQ,WHPLVHGUHSRUWVDUHPRUHSRSXODUZLWKUHIHUULQJFOLQLFLDQVGXHWRWKHLU FODULW\3URVHUHSRUWVIRVWHUDODFNRIVWDQGDUGLVDWLRQRIFRQWHQWDPRQJGLIIHUHQW UDGLRORJLVWV$VKLIWLQSDUDGLJPWRLWHPLVHGUHSRUWLQJZLOOPDNHIRUIDVWHUPRUH FRQVLVWHQWUDGLRORJ\UHSRUWVWKDWIDFLOLWDWHFRPSOHWHGRFXPHQWDWLRQRILQIRUPDWLRQ DQGPHDVXUHPHQWV&KDQJLQJWKHZD\UDGLRORJ\UHSRUWVDUHVWUXFWXUHGUHTXLUHV DGDSWDWLRQDPRQJUDGLRORJLVWV,PSURYHGWUDLQLQJLQUHSRUWLQJGXULQJWKHUDGLRORJ\ UHVLGHQF\LVGHULJXHXUWRIDPLOLDULVHUDGLRORJLVWVZLWKDQHZVW\OHRIUHSRUWLQJ % $ZHEEDVHGGRFXPHQWDWLRQV\VWHPZLWKH[FKDQJHRI',&2057 GDWDIRUPXOWLFHQWHUFOLQLFDOVWXGLHVLQSDUWLFOHWKHUDS\ .$.HVVHO 1%RXJDWI&%RKQ'2HW]HO8(QJHOPDQQ 5%HQGO-'HEXV6(&RPEV+HLGHOEHUJ'('RVVHQKHLP'( +HLOEURQQ'(.HUVWLQ.HVVHO#PHGXQLKHLGHOEHUJGH 3XUSRVH&RQGXFWLQJFOLQLFDOVWXGLHVLVUDWKHUGLIÀFXOWEHFDXVHRIWKHODUJHYDULHW\ RIYROXPLQRXVGDWDVHWVGLIIHUHQWGRFXPHQWDWLRQVW\OHVDQGYDULRXVLQIRUPDWLRQ V\VWHPVHVSHFLDOO\LQUDGLDWLRQRQFRORJ\ 0HWKRGV DQG 0DWHULDOV :H GHYHORSHG D ZHEEDVHG GRFXPHQWDWLRQ V\VWHP IRUWUDQVQDWLRQDODQGPXOWLFHQWHUFOLQLFDOVWXGLHVLQSDUWLFOHWKHUDS\SDWLHQWV 5HVXOWV(YHU\VHTXHQFHLVGHÀQHGE\LWVVHTXHQFHIDPLO\DQFHVWRUWLPLQJGLDJUDP DQGGHVFULSWLRQSDUDPHWHUVDUWHIDFWVDQGSUREOHPVFOLQLFDODSSOLFDWLRQVGXUDWLRQ PDWKHPDWLFDOPRGHOOLQJDQGSRVVLEOHUHVXOWVDFURQ\PVDQG',&20GHVFULSWLRQ :HFDQLQWHUDFWZLWKWKHRQWRORJ\PDNLQJTXHU\7KHRQWRORJ\FRXOGEHPRGLÀHG DWDQ\PRPHQWDFFRUGLQJWRWKHODVWRXWFRPHV &RQFOXVLRQ7KHREWDLQHGRQWRORJ\JLYHVDUHSUHVHQWDWLRQRI05,VHTXHQFHVWKDW FDQEHXVHGIRUHGXFDWLRQRUFOLQLFDOH[SORLWDWLRQ % &RQVLGHUDWLRQVIRUVKDULQJUDGLRORJ\UHSRUWVDQGLPDJHVRQD QDWLRQDOOHYHOLQ/X[HPERXUJ 85RWK10DFN%6FKURHGHU+=LPPHUPDQQ/X[HPERXUJ/8 XZHURWK#WXGRUOX 3XUSRVH7KHH[FKDQJHRIUDGLRORJ\UHSRUWVDQGLPDJHVRQDQDWLRQDOOHYHOGH PDQGVLQFRPSDULVRQWRWKHH[FKDQJHLQRUGLQDU\LQKRXVHV\VWHPVDGGLWLRQDO DQG KLJKHU VHFXULW\ UHTXLUHPHQWV FRQFHUQLQJ GDWD SURWHFWLRQ ,Q DQ\ FDVH WKH FRPPXQLFDWLRQ VKRXOG UHO\ RQ FXUUHQW VWDQGDUGV 7KH SUREOHP WKDW KDV WR EH IDFHGLVWKHLGHQWLÀFDWLRQRIJDSVLQWKHVHVWDQGDUGVWKDWDULVHIURPWKHVKLIWLQWR WKHQDWLRQDOFRQWH[W 0HWKRGVDQG0DWHULDOV&RPPXQLFDWLRQZLWKWKHQDWLRQDOSODWIRUPZLOOEHPDLQO\ EDVHGRQ,+(;'6;'6,DQG3,;SURÀOHVXVLQJGRFXPHQWUHSRVLWRULHVIRUWKH VWRUDJHRIWKHUHSRUWVDQGLPDJHPDQLIHVWÀOHVDQGDUHJLVWU\VHUYLFHIRUWKHVWRU DJHRIGRFXPHQWUHIHUHQFHVSOXVDGGLWLRQDOPHWDGDWD7 RSURWHFWGDWDLQVLGHWKH UHSRVLWRU\DJDLQVWLQWHQWLRQDORUDFFLGHQWDOPLVXVHLWQHHGVWREHVWRUHGHQFU\SWHG )RUWKHSURWHFWLRQRIWKHGRFXPHQWUHIHUHQFHVDQGPHWDGDWDWKLVLQIRUPDWLRQKDV WREHVWRUHGGHLGHQWLÀHG 5HVXOWV7 RGD\,+(GRHVQRWVXSSRUWGHLGHQWLÀFDWLRQDQGHQGWRHQGGRFXPHQW HQFU\SWLRQ$VDUHVXOWWKHLQKRXVHLQIUDVWUXFWXUHLVDWWDFKHGWRWKHQDWLRQDOSODW IRUPYLDDFRQQHFWRUWKDWFRYHUVDOODVSHFWVRIGHLGHQWLÀFDWLRQDQGHQFU\SWLRQ$ WUXVWHGWKLUGSDUW\SURYLGHVWKHGHLGHQWLÀFDWLRQ,WDOORZVWKHVHSDUDWLRQRIGHPR JUDSKLFGDWDIURPLWVSVHXGRQ\PZKLFKLVQHYHUNQRZQLQWKHLQKRXVHV\VWHPV ,IGDWDDUHDFFHVVHGWKHWUXVWHGWKLUGSDUW\ZLOODOVRDFWDVDUHNH\VHUYLFHIRUWKH LQGLYLGXDOO\XVHGHQFU\SWHGHQFU\SWLRQNH\V &RQFOXVLRQ7KHSURSRVHGQDWLRQDOH[FKDQJHSODWIRUPFRPELQHVWKHXVHRI,+( SURÀOHVZLWKDGGLWLRQDOVHFXULW\IHDWXUHVOLNHGHLGHQWLÀFDWLRQDQGHQFU\SWLRQWKURXJK WKHXVHRIDQDGGLWLRQDOFRQQHFWRUFRPSRQHQW % 'HGLFDWHGZRUNÁRZVROXWLRQWRIDFLOLWDWHFRQVLVWHQWUHSURGXFLEOH DQGHIÀFLHQWSDWLHQWPRQLWRULQJLQRQFRORJLFDOWULDOVDQGURXWLQH 0%DXPKDXHU06HLWHO+HLGHOEHUJ'(PEDXPKDXHU#GNI]KHLGHOEHUJGH 3XUSRVH:HLQWURGXFHDQHZDQGGHGLFDWHGVRIWZDUHV\VWHPWRPDQDJHRQFRORJLF ZRUNÁRZV7KHZRUNLQJFRQFHSWKDVEHHQGHYHORSHGIURPJURXQGXSDQGRSWLPLVHG WRPHHWWKHLQFUHDVLQJO\FRPSOH[UHTXLUHPHQWVRIFDQFHUWKHUDS\PRQLWRULQJ2XU ZRUNLVPRWLYDWHGE\WKHLQFUHDVLQJDPRXQWDQGFRPSOH[LW\RILPDJLQJFULWHULDLQ RQFRORJLFUDGLRORJ\DQGWKHODFNRIVRIWZDUHWKDWSURYLGHVDYDLODELOLW\DQGHDV\ DFFHVVWRSUHFHGLQJLPDJHDVVHVVPHQWVDXWRPDWLFDOO\XSGDWHGVWDWLVWLFVDQGD GHÀQHGZRUNLQJFRQFHSWWRHQVXUHFRQVLVWHQF\ 0HWKRGV DQG 0DWHULDOV %DFNJURXQG RI WKH VRIWZDUH LV D JHQHUDO UHTXLUHPHQW DQDO\VLVIRURQFRORJLFDOSDWLHQWPDQDJHPHQWZRUNÁRZVFRQGXFWHGLQ6WDUW LQJ ZLWK DQ LQKRXVH GHYHORSPHQW LGHQWLÀHG GHÀFLWV RI FRPPHUFLDOO\ DYDLODEOH VRIWZDUH ZDV DGGUHVVHG$PRQJ WKHP DUH $Q RSWLPLVHG GDWD PRGHO LQFOXGH UHOHYDQWFRQWH[WLQIRUPDWLRQOLNHSDWLHQWWKHUDS\VFKHPHFOLQLFDOWULDODIÀOLDWLRQ LPDJLQJFULWHULDOHVLRQFKDUDFWHULVWLFV)OH[LELOLW\LQTXDQWLWDWLYHOHVLRQDVVHVVPHQW FRQGXFWXQOLPLWHGFRUUHODWHGPHDVXUHPHQWVLQXQOLPLWHG05&73(7VWXGLHVDQG VHULHVIRUXQOLPLWHGIROORZXSV&RQVLVWHQF\E\DXWRPDWLQJURXWLQHSURFHGXUHV FOLQLFDO WULDO PDQDJHPHQW DXWRPDWHG RYHUDOO UHVSRQVH HYDOXDWLRQ DQG FULWHULD FRQIRUPDQFHYDOLGDWLRQ 5HVXOWV6LQFHEHJLQQLQJRIWKHVRIWZDUHLVDYDLODEOHXQGHUWKHODEHORIPLQW /HVLRQDV&(PDUNHGSURGXFWLQ(XURSHE\DQHZO\IRXQGHGVSLQRIIFRPSDQ\ RI*HUPDQ&DQFHU5HVHDUFK&HQWUH0LGWHUPIHHGEDFNRIRXUUHIHUHQFHXVHUV DWWHVWWKHV\VWHPҋVIHDVLELOLW\DQGVKRZWKHKLJKSRWHQWLDOIRUDDSSOLFDWLRQLQWULDOV DQGURXWLQHSDWLHQWFDUH &RQFOXVLRQ:KLOHLPSURYLQJFRQVLVWHQF\TXDOLW\DQGVDIHW\PLQW/HVLRQDLPV DWOHYHUDJLQJWKHURXWLQHZRUNORDG)XWXUHUHVHDUFKZLOODVVHVVWKHHIIHFWLYHQHVV RIPLQW/HVLRQLQSUDFWLFDOURXWLQH 6FLHQWLILF6HVVLRQ $ 6&'()*+%(XURSHDQ&RQJUHVVRI 5DGLRORJ\ 0RQGD\ KDYH EHHQ WUHDWHG DW WKH +HLGHOEHUJ ,RQ 7KHUDS\ +,7 FHQWUH IURP 1RYHPEHU WR$XJXVW3URWRQVFDUERQLRQVRUDFRPELQDWLRQRIERWKDVZHOODVD FRPELQDWLRQZLWKSKRWRQVZHUHDSSOLHG7 RGDWHVWXGLHVKDYHEHHQLQLWLDWHG DQGPRUHDUHLQSUHSDUDWLRQ 5HVXOWV,WLVSRVVLEOHWRLPPHGLDWHO\DFFHVVDOOSDWLHQWLQIRUPDWLRQDQGH[FKDQJH VWRUHSURFHVVDQGYLVXDOLVHWH[WGDWDDQ\',&20LPDJHVDQGPXOWLPHGLDGDWD $FFHVVLQJ WKH V\VWHP DQG VXEPLWWLQJ FOLQLFDO GDWD DUH SRVVLEOHIRU LQWHUQDO DQG H[WHUQDOXVHUV6HFXULW\DQGSULYDF\SURWHFWLRQLVHQVXUHGZLWKWKHHQFU\SWHGKWWSV SURWRFROFOLHQWFHUWLÀFDWHVDQGDQDSSOLFDWLRQJDWHZD\)XUWKHUPRUHDOOGDWDFDQ EHSVHXGRQ\PLVHG,QWHJUDWHGLQWRWKHKRVSLWDOHQYLURQPHQWGDWDDUHLPSRUWHGYLD LQWHUIDFHVRYHU+/PHVVDJHVDQG',&206HYHUDOIXUWKHUIHDWXUHVUHSODFHPDQXDO LQSXWDQGHQVXUHGDWDTXDOLW\DQGHQWLUHW\6WXGLHVFDQEHLQGLYLGXDOO\GHVLJQHG WRÀWVSHFLÀFQHHGV%\LQFOXGLQJDOOWUHDWHGSDWLHQWVDOVRQRQVWXG\SDWLHQWVZH JDLQWKHSRVVLELOLW\IRURYHUDOOODUJHVFDOHUHWURVSHFWLYHDQDO\VHV &RQFOXVLRQ+DYLQJUHFHQWO\EHJXQGRFXPHQWDWLRQRIRXUÀUVWSDWLHQWVLQVL[ FOLQLFDOVWXGLHVLWKDVEHFRPHDSSDUHQWWKDWWKHEHQHÀWVOLHLQWKHVLPSOLÀFDWLRQRI UHVHDUFKZRUNEHWWHUVWXG\DQDO\VHVTXDOLW\DQGXOWLPDWHO\WKHLPSURYHPHQWRI WUHDWPHQWFRQFHSWVE\HYDOXDWLQJWKHHIIHFWLYHQHVVRISDUWLFOHWKHUDS\

Text is read by the "Ask this paper" AI Q&A widget below. Extraction quality varies by source — PMC NXML preserves structure cleanly, OA-HTML may include some navigation residue, and OA-PDF can have broken hyphenation. The publisher copy (via DOI) is the canonical version.

My notes (saved in your browser only)

⚙ Ask this paper AI returns verbatim quotes from the full text · source: oa-pdf ⓘ

Answers must be backed by verbatim quotes from this paper's full text. Hallucinated quotes are dropped automatically; if no verbatim passage answers the question, we say so. How this works

Citation neighborhood (no data yet)

We don't have any in-corpus citations linked to this paper yet. The paper's references may be in our DB but unresolved to ``paper_id`` (resolution happens at ingest when the cited DOI matches a row we already have). Run the cross-source citation reconcile pass to retry.

Source provenance

europepmc: last seen: 2026-10-25T09:32:14.900964+00:00
pubmed: last seen: 2026-10-12T06:15:36.921538+00:00

License: CC-BY-4.0 · commercial use OK · attribution required
Per Europe PMC