The importance of predictor variables for individual classes in SVM

! " # ! $ % & ' ( ) * & # ! # & * + , - . & ( % * & * /,+&! ,(",%,0&"! 1234 1565 !"#$%& '()*+",- ! !

"#$!%&'()"*+,$!(-!')$.%,"()!/*)%*01$2!

-()!%+.%/%.3*1!,1*22$2!%+!2/&!!

!

*4567896: #78 9:;8< :=>?@A8; BC:9 *DEE:C> '8F>:C 0?F7@A8G GDBB8CG BC:9 >78 <?FH :B @A>8CEC8>?>@:AI &> @G DGD?<<J K8CJ 7?C; >: 8L>C?F> >78 HA:M<8;N8 ?=:D> >78 ?A?<JO8; E78A:98A:A BC:9 >78 F<?GG@B@F?>@:A 9:;8< :=>?@A8; =J DG@AN *'0G =8F?DG8 >78 F<?GG@B@F?>@:A >?GH @G C8?<@O8; @A ? 7@N7 ;@98AG@:A?< B8?>DC8 GE?F8I !<>7:DN7 >78 98>7:; @;8A>@B@8G >78 :=G8CK?>@:AG M7@F7 ?C8 FCDF@?< B:C >78 B:C9 :B >78 ;8F@G@:A BDAF>@:A4 @> ;:8G A:> G7:M M7@F7 K?C@?=<8G ?C8 C8<8K?A> ?A; M7@F7 ?C8 C8;DA;?A> 8@>78C B:C >78 M7:<8 F<?GG@B@F?>@:A >?GH :C B:C 8?F7 F<?GG G8E?C?>8<JI

,AF8 >78 9:;8< @G =D@<>4 @> @G K8CJ K?<D?=<8 >: C8F:NA@O8 >78 C8<?>@K8 @9E:C>?AF8 :B EC8;@F>:C K?C@?=<8G B:C >78 G7?E8 :B 8K8CJ F<?GGI #78 98>7:; M8 EC:E:G8 DG8G >78 G?9E<@AN >8F7A@PD8G4 =?FHM?C; 8<@9@A?>@:A ?A; )?A; @A;8L B:C 8K?<D?>@AN M78>78C >78 E?C>@FD<?C K?C@?=<8 @G C8;DA;?A> :C A:>I !G ? C8GD<>4 M8 :=>?@A >78 C?AH@AN :B >78 EC8;@F>:C K?C@?=<8G C8B<8F>@AN >78 C8<8K?A> @9E:C>?AF8 :B >78 @AED>G B:C 8?F7 F<?GG G8E?C?>8<JI

;<=!>?7@5A *DEE:C> '8F>:C 0?F7@A8G4 C8<8K?A> K?C@?=<8G4 =?FHM?C; 8<@9@A?>@:AI

! !

%:!%+")(.3,"%(+!

*DEE:C> '8F>:C 0?F7@A8G Q*'0GR ?C8 F:AG@;8C8; ?G ? K8CJ E:M8CBD< >::< @A S?>>8CA )8F:NA@>@:AI #78J ?C8 7@N7<J F:9E8>@>@K8 @A >8C9G :B ?FFDC?FJ M@>7@A >78 NC:DE :B F<?GG@B@F?>@:A 98>7:;G TG88 !=8 Q1553RUI ! AD9=8C :B C8G8?CF78CG ?C8 M:CH@AN >: 9:;@BJ ?A; @9EC:K8 >78 E8CB:C9?AF8 :B *'0GI ,A8 :B >78 B@8<;G :B *'0 ;8K8<:E98A> @G ?GG:F@?>8; M@>7 >78 ?A?<JG@G :B >78 @9E:C>?AF8 :B @AED> K?C@?=<8G :C4 9:C8 N8A8C?<<J4 M@>7 >78 HA:M<8;N8 8L>C?F>@:AI

#78 B8?>DC8 G8<8F>@:A EC:=<89 @G K8CJ @9E:C>?A> G@AF8 >78 EC8G8AF8 :B C8;DA;?A> K?C@?=<8G 7?G ? G@NA@B@F?A> A8N?>@K8 @AB<D8AF8 :A >78 >C?@A@AN >@984 9:;8< G>:C?N8 C8PD@C898A>G4 @A>8CEC8>?=@<@>J ?A; G:98>@98G 8K8A >78 N8A8C?<@O?>@:A ?=@<@>J :B >78 9:;8< TG88 V8G>:A Q1556RUI #78 @A>8CEC8>?>@:A?< @GGD8G F:AA8F>8; M@>7 >78 *'0G 9:;8<G4 8GE8F@?<<J M78A EC8G8A>@AN >78 9:;8< ?A; >78 C8GD<>G :B F<?GG@B@F?>@:A >: ;8F@G@:A 9?H8CG4 M?G >78 9?@A 9:>@K?>@:A B:C >7@G E?E8CI V8 >C@8; >: DG8 G@9E<8 @A>D@>@K8 >8F7A@PD8G >: ;8K8<:E ? EC:F8;DC8 B:C 8K?<D?>@AN M7@F7 EC8;@F>:C 7?G ? G@NA@B@F?A> @9E?F> :A >78 G7?E8 :B ? E?C>@FD<?C F<?GG @A >78 *'0G F<?GG@B@F?>@:A 9:;8<I #7DG4 >78 9?@A N:?< :B >78 E?E8C M?G >: ;8K8<:E >78

W

0@F7?Y #COZG@:H

6[\

98>7:; B:C :=>?@A@AN >78 EC:B@<8 ;8GFC@E>@:A :B >78 F<?GG8G Q?B>8C B@A@G7@AN <8?CA@AN *'0GR C?>78C >7?A >: EC:E:G8 ?A ?;;@>@:A?< 8<898A> :B <8?CA@ANI

!G EC8G8A>8; @A ]DJ:A ./ %01 Q155\R4 >78C8 ?C8 >7C88 ?EEC:?F78G @A B8?>DC8 G8<8F>@:A^ B@<>8CG4 MC?EE8CG ?A; 89=8;;8; 98>7:;GI #78 B@CG> NC:DE :B 98>7:;G 8K?<D?>8G >78 @9E:C>?AF8 :B ? K?C@?=<8 @A;8E8A;8A><J BC:9 >78 F<?GG@B@8C DG@AN ;@BB8C8A> ;8E8A;8AFJ 98?GDC8G4 GDF7 ?G S8?CG:A F:CC8<?>@:A4 1 :C :>78CGI #78 M7:<8 EC:F8;DC8 @G E8CB:C98; ?> >78 EC8_EC:F8GG@AN G>?N8I VC?EE8CG ?C8 9DF7 9:C8 :B>8A DG8; B:C B8?>DC8 G8<8F>@:A >7?A B@<>8CG G@AF8 >78J @AK:<K8 >78 F<?GG@B@8C >: ?GG8GG B8?>DC8 GD=G8>G Q>78 :C@N@A?< <8?CA@AN 98>7:; @G ?EE<@8; B:C >78 8K?<D?>@:A :B >78 N8A8C?>8; B8?>DC8 GD=G8>GRI (9=8;;8; 98>7:;G ?C8 F<:G8 >: MC?EE8CG =D> >78 <8?CA@AN 98>7:; @G 9:;@B@8; @A >78 M?J >7?> >78 B8?>DC8 G8<8F>@:A @G @AF:CE:C?>8; @A>: >78 ?<N:C@>79I *@AF8 M8 ?C8 @A>8C8G>8; @A ;8GFC@=@AN >78 9:;8< =D@<> :A >78 M7:<8 G8> :B EC8;@F>:CG N@K8A =J >78 8LE8C>G4 M8 F7::G8 MC?EE8CG ?G >78 9:G> ?EEC:EC@?>8 ?EEC:?F7I V@>7@A >78 MC?EE8CG4 M8 DG8 >78 =?FHM?C; 8<@9@A?>@:A EC:F8;DC8I &> @G ?A @>8C?>@K8 EC:F8;DC8 M78C8 M8 G>?C> M@>7 ?<< >78 B8?>DC8G ?A; ;8<8>8 :A8 B8?>DC8 ?> ? >@98I V8 ;8<8>8 >78 B8?>DC8 M7@F7 ;8>8C@:C?>8G >78 EC8K@:DG<J F7:G8A G8<8F>@:A FC@>8C@:A >78 <8?G>I #78 ?<>8CA?>@K8 98>7:; _ >78 B:CM?C; G8<8F>@:A _ ?<G: N8A8C?>8G >78 A8G>8; B8?>DC8 GD=G8>G =D> @A >7@G ?EEC:?F7 M8 G>?C> M@>7 ?A 89E>J G8> ?A; ?;; @A>: >78 9:;8< >78 EC8;@F>:C >7?> @9EC:K8G >78 E8CB:C9?AF8 98?GDC8 >78 9:G>I `:>7 EC:F8;DC8G ?C8 <:F?< :E>@9@O?>@:A >8F7A@PD8G ?A; J@8<; ;@BB8C8A> K?C@?=<8 C?AH@ANGI `?FHM?C; 8<@9@A?>@:A @G DGD?<<J G<:M8C =D> 9:C8 G>?=<8 >7?A B:CM?C; G8<8F>@:A TG88 !=8 Q1553RUI!!

! !

%%:!"#$!(/$)/%$B!(-!"#$!2/&!*1C()%"#&

&A >7@G G8F>@:A M8 =C@8B<J EC8G8A> >78 9?@A @;8?G :B *DEE:C> '8F>:C 0?F7@A8GI &A >78 F?G8 :B >78 >M:_F<?GG F<?GG@B@F?>@:A4 B@CG> M8 >C?AGB:C9 ;?>? E:@A>G BC:9 >78 >C?@A@AN G8> >: ? 7@N78C ;@98AG@:A?< B8?>DC8 GE?F8 =J A:A_<@A8?C 9?EE@AN TG88 '?EA@H Q6aa[RUI #78A M8 B@A; >78 :E>@9?< 7JE8CE<?A8 Q9?L@9@O@AN >78 9?CN@AR G8E?C?>@AN >78 @9?N8G :B >78 ;?>? @A >78 B8?>DC8 GE?F8I #7@G 7JE8CE<?A8 Q<@A8?C =:DA;?CJR @A >78 B8?>DC8 GE?F8 F:CC8GE:A;G M@>7 >78 A:A<@A8?C F<?GG@B@8C @A >78 :C@N@A?< ;?>? GE?F8I

/:<<:M@AN *F7b<H:EB ?A; *9:<? Q1551R M8 EC8G8A> >78 B:C9?<@G9 :B >78 *'0G ?<N:C@>79I V8 ?C8 N@K8A >78 >C?@A@AN G8> 4%

#

!

ED436

" !

4 4 E+432

"

$

4 M78C8

5

)

EF_{& @G >78 K8F>:C :B EC8;@F>:CGc K?<D8G ?A; 3}"_&

#

_'646

$

_{;8B@A8G >78 F<?GG >78}

">7 :=G8CK?>@:A =8<:ANG >:4 "&

#

64 42

$

I #78A >78 N:?< :B GDE8CK@G8; <8?CA@AN @G >: B@A; ? dN::;e EC8;@F>@K8 F<?GG@B@F?>@:A BDAF>@:A 3 % 6QER4 =?G8; :A >78

#78 &9E:C>?AF8 :B SC8;@F>:C '?C@?=<8G B:C &A;@K@;D?< "<?GG8G @A *'0 _6[f ?K?@<?=<8 >C?@A@AN G8>I &A :C;8C >: :=>?@A ? 9:;8< M@>7 ? N::; N8A8C?<@O?>@:A ?=@<@>J *'0G DG8 >78 +/(7#/7(%0 ("+- 8"9"8")%/",9 :("9#":0. TG88 '?EA@H Q6aa[RU ?G ? FC@>8C@:A B:C B@A;@AN ? dN::;e ;8F@G@:A BDAF>@:AI #: 7?A;<8 ? F?G8 :B <@A8?C<J A:AG8E?C?=<8 F<?GG8G4 >78 >C?@A@AN G8> @G >C?AGB:C98; >: G:98 7@N78C ;@98AG@:A?< B8?>DC8 GE?F8 =J A:Ag<@A8?C 9?EE@AN )^) (5 GI #78C8 M8 F:AG>CDF> >78 :E>@9?< G8E?C?>@AN 7JE8CE<?A8 Q@I8I >78 7JE8CE<?A8 M@>7 >78 <?CN8G> 9?CN@AR^

4 5 R Q * ₅ % +) E , H Q6R

M78C8 H&G4,₅&)I #7@G 7JE8CE<?A8 G8E?C?>8G >78 F<?GG8G ?A; ;8B@A8G >78 ;8F@G@:A BDAF>@:A^

!

Q R

"

I G@NA R QE % H+) E *,₅ 6 Q1R

#78 G>CDF>DC?< C@GH 9@A@9@O?>@:A EC@AF@E<8 @G ?EE<@8; M@>7@A *'0G =J >78 B?F> >7?> M8 G88H B:C >78 :E>@9?< G8E?C?>@AN 7JE8CE<?A8 Q>78 :A8 M@>7 >78 <?CN8G> 9?CN@AR4 A:> hDG> ?AJ G8E?C?>@AN 7JE8CE<?A8I #78 EC:=<89 :B B@A;@AN >78 :E>@9?< G8E?C?>@AN 7JE8CE<?A8 Q@I8I B@A;@AN >78 A:C9?< K8F>:C

H

! ?A; >78 @A>8CF8E>

,

₅R F?A =8 B:C9D<?>8; ?G >78 B:<<:M@AN :E>@9@O?>@:A EC:=<89^

!

"

#

64 4

$

4 4 5 4 5 ?A; 4 R Q >: GD=h8F> 4 6 1 6 9@A@9@O8 5 6 1 4 4 4 5 2 " 3 2 " " " 2 " " 2 & -' -* + * '

.

% & & & / 0 / 0 , ) / 10 0 , F ) I ) G H E H H Q2R M78C8 >78 G<?FH K?C@?=<8G /₆4 4/₂ -5 ?C8 @A>C:;DF8; >: ?<<:M G:98 :=G8CK?>@:AG BC:9 >78 >C?@A@AN G8> >: =8 9@GF<?GG@B@8; Q>: ?<<:M A:@G8 @A >78 >C?@A@AN G8>R4 0 @G ?A ?;;@>@:A?< K?C@?=<8 >: =8 :E>@9@O8; ?A;

1

C8E<?F8G C8ND<?C@O?>@:A E?C?98>8C ; @A >78 >78 :C@N@A?< *'0 B:C9D<?>@:AI S?C?98>8C

U 6 4 5 Q &

1 @G GE8F@B@8; =8B:C87?A; ?A; F:A>C:<G >78 >C?;8g:BB =8>M88A >78 N8A8C?<@O?>@:A ?=@<@>J :B >78 9:;8< ?A; >78 B@>>@AN :B >78 >C?@A@AN ;?>?I V8 F?A G:<K8 EC:=<89 Q2R DG@AN >78 +?NC?AN8 9D<>@E<@8CG 98>7:;I #78 ;D?< B:C9 :B >78 +?NC?AN@?A @G^

0@F7?Y #COZG@:H 6[[ 4 R 4 Q X 1 6 9?L@9@O8 6 6

..

% % & ' 2 " < " < 2 < " 3 3 2 J F ) K 22 E E QiR

.

% % 3 3 2 " " " " 3 24 ₆ 5 6 5 >: GD=h8F> 2 2 QiR ?A; 4

#

64 4

$

4 6 2 " 2 " "- &

.

% 1 2 M78C8 XQM4LR%)QMR+)QLR ?<C8?;J ;8A:>8G >78 -.(9.0 679#/",9 C8EC8G8A>@AN >78 ;:> EC:;DF> @A >78 7@N7 ;@98AG@:A?< B8?>DC8 GE?F8

G

I V@>7@A *'0G :A8 :B >78 H8CA8< BDAF>@:AG @G DG8; >: ;8B@A8 >7@G ;:> EC:;DF>I #78 9:G> E:ED<?C H8CA8<G B:C *'0G ?C8^

4 )?;@?< `?G@G /DAF>@:A XQM4LR%8LEQ'5 M'L 1R4 4 ->7 ;8NC88 E:<JA:9@?< XQM4LR%5QM+L*6R-4

M78C8 546 -54-&+ ?C8 E?C?98>8CGI #78 DG8 :B >78 H8CA8< BDAF>@:A @9E<@8G >7?> M8 F:AG>CDF> >78 :E>@9?< G8E?C?>@AN 7JE8CE<?A8 @A >78 7@N7 ;@98AG@:A?< B8?>DC8 GE?F8

G

Q?A; >7DG >78 :E>@9?< ;8F@G@:A BDAF>@:AR M@>7:D> 8LE<@F@><J E8CB:C9@AN F?<FD<?>@:AG @A >7@G GE?F8I &> F?A =8 G7:MA TG88 *F7b<H:EB ?A; *9:<? Q1551RU >7?> >78A >78 ;8F@G@:A BDAF>@:A >?H8G >78 B@A?< B:C9^

77 8 9 :: ; < * %

.

% 2 " " "3 6 6 5 R 4 Q X G@NA R QE 2 EF E , I Q3R

0?AJ :B >78 +?NC?AN8 9D<>@E<@8CG

2

_" @A >78 G:<D>@:A :B >78 :E>@9@O?>@:A >?GH QiR ?C8 8PD?< O8C: TG88 '?EA@H Q6aa[RUI *@AF8 >78 ;8F@G@:A BDAF>@:A Q3R DG8G >78 <@A8?C F:9=@A?>@:A :B >78 @9?N8G :B >78 :=G8CK?>@:AG4 :A<J >78 :=G8CK?>@:AG F:CC8GE:A;@AN >: A:AO8C: +?NC?AN8 9D<>@E<@8CG 7?K8 ;@GFC@9@A?>@K8 E:M8CI #78G8 :=G8CK?>@:AG ?C8 F?<<8; +7::,(/ =.#/,(+I

&A >78 F?G8 :B 8 F<?GG8G Q8-2R4 >78 F:99:A ?EEC:?F7 @G >: =D@<; 8Q '8₁ 6R =@A?CJ F<?GG@B@8CG Q:A8_?N?@AG>_:A8 9D<>@_F<?GG *'0GR ?A; DG8 >78 9?h:C@O?>@:A GF7898 >: ?GG@NA >78 :=G8CK?>@:A >: ? E?C>@FD<?C F<?GGI

! !

#78 &9E:C>?AF8 :B SC8;@F>:C '?C@?=<8G B:C &A;@K@;D?< "<?GG8G @A *'0 _6[a

%%%:!/*)%*01$!%&'()"*+,$!$/*13*"%(+! 0MFN@FOP!6Q<!)8ORFOP!?S!'7<@F96?75!

S8CB:C9@AN ?A 8L7?DG>@K8 G8?CF7 >7C:DN7 ?<< K?C@?=<8 GD=G8>G @G DGD?<<J A:> B8?G@=<8 ;D8 >: >78 F:9ED>?>@:A?< F:G>GI #78C8B:C84 M8 ;8F@;8 >: ;8K8<:E ?A:>78C =?G@F EC:F8;DC8 DG@AN >78 NC88;J >8F7A@PD8 _ >78 =?FHM?C; 8<@9@A?>@:AI #78 F:9ED>?>@:A?< F:G>G B:C >7@G ?EEC:?F7 ?C8 9DF7 <:M8C >7?A B:C >78 8L7?DG>@K8 G8?CF74 ?<>7:DN7 @> @G G>@<< 8LE8AG@K8 >: F:9ED>8 @B 5 _ >78 AD9=8C :B EC8;@F>:CG _ @G <?CN8I

V8 G>?C> M@>7 >78 G8> :B ?<< K?C@?=<8G ?A; C8FDCG@K8<J ;8<8>8 :A8 EC8;@F>:C @A 8K8CJ G>8EI #78 B8?>DC8 M7@F7 ;8>8C@:C?>8G >78 EC8K@:DG<J F7:G8A G8<8F>@:A FC@>8C@:A >78 <8?G> @G ;8<8>8;I &A >78 <@>8C?>DC8 T]DJ:A ./ %01 Q155\R4 )?H:>:9?9:AhJ Q1552RU4 >JE@F?<<J >78 9@A@9D9 8LE8F>8; EC8;@F>@:A 8CC:C @G DG8; ?G >78 G8<8F>@:A FC@>8C@:A4 =D> G@AF8 @> @G DAHA:MA M8 A88; >: 8G>@9?>8 @> 8INI =J FC:GG_K?<@;?>@:A Q"'RI #7@G G@NA@B@F?A><J @AFC8?G8G >78 F:9ED>?>@:A?< F:G> :B >78 M7:<8 EC:F8;DC8I V8 EC:E:G8 ? G@9E<8 9:;@B@F?>@:AI #78 F<?GG@B@F?>@:A C8GD<>@AN BC:9 >78 9:;8< =D@<> :A >78 G8> :B ?<< EC8;@F>:CG F?A =8 >C8?>8; ?G ? E?>>8CAI &> G7:D<; =8 A:>@F8; >7?> ?> >7@G G>?N8 >78 *'0G 7JE8CE?C?98>8CG ?C8 >DA8; ?A; >78A >78 =8G> H8CA8< ?A; 7JE8CE?C?98>8C K?<D8G ?C8 DG8; B:C =D@<;@AN 8K8CJ 9:;8< M@>7 C8;DF8; AD9=8C :B EC8;@F>:CGI V8 ;: G: =8F?DG8 M8 :A<J M?A> >: :=G8CK8 >78 @AB<D8AF8 :B ;8<8>@AN K?C@?=<8G @A >78 >C?@A@AN G8> _ A:> >78 F7?AN8G ?GG:F@?>8; M@>7 :>78C ?GE8F>G :B >78 <8?CA@AN EC:F8GGI #78A M8 F?A F:9E?C8 >78 E?>>8CA M@>7 >78 F<?GG@B@F?>@:A C8GD<>G :=>?@A8; BC:9 >78 9:;8< M@>7 :A8 :B >78 EC8;@F>:CG 8LF<D;8;I V8 DG8 >78 9?L@9D9 F<?GG@B@F?>@:A ?NC8898A> =8>M88A >78 E?>>8CA ?A; >78 9:;8< M@>7 ? C8;DF8; AD9=8C :B EC8;@F>:CG ?G >78 FC@>8C@:A B:C F7::G@AN >78 K?C@?=<8 >: =8 ;8<8>8;I !G ? F<?GG@B@F?>@:A ?NC8898A> 98?GDC8 M8 DG8 >78 )?A; @A;8L4 M7@F7 @G 9:C8 N8A8C?< =8F?DG8 @> F?A =8 DG8; B:C F:9E?C@AN F<DG>8C@AN C8GD<>G4 =D> @G ?<G: GD@>?=<8 B:C >7@G EDCE:G8I V8 GD99?C@O8 >78 EC:F8;DC8 @A >78 ?<N:C@>79 EC8G8A>8; @A #?=<8 6I

#?=<8 6I !<N:C@>79 B:C 8K?<D?>@AN >78 C?AH@AN :B EC8;@F>:C K?C@?=<8G DG@AN =?FHM?C; 8<@9@A?>@:A ?A; >78 )?A; @A;8L

26<T!D:! #DA8 >78 *'0G 9:;8< :A >C?@A@AN G8> 4 DG@AN ?<< >78 EC8;@F>:CG Q>78 =8G> 9:;8< @G DG8; ?G >78 E?>>8CARI #?H8 >78 M:CH@AN ;?>? G8> > 8PD?< >: >78 >C?@A@AN G8> 41 26<T!U: ]8A8C?>8 ;@BB8C8A> 9:;@B@F?>@:AG :B ;?>? G8> > =J 8LF<D;@AN :A8 :B >78 @AED>

K?C@?=<8G BC:9 ;?>? G8> > ?> ? >@98 ?A; =D@<; *'0G 9:;8<G :A >78G8 ;?>? G8>G DG@AN >78 G?98 E?C?98>8CG ?G @A *>8E 6I

26<T!V: ":9E?C8 >78 )?A; @A;8L8G :B >78 F<?GG@B@F?>@:A C8GD<>G BC:9 *>8E 1 M@>7 >78 E?>>8CA QEC8;@F>@:A BC:9 *>8E 6RI

26<T!W: -8<8>8 BC:9 >78 ;?>? G8> > >78 @AED> K?C@?=<8 ?GG:F@?>8; M@>7 >78 <?CN8G> )?A; @A;8L Q;8<8>@AN >7@G EC8;@F>:C F7?AN8G >78 C8GD<>G :B >78 F<?GG@B@F?>@:A >78 <8?G>RI ":9ED>8 >78 K?<D8 :B >78 EC8;@F>@:A 8CC:C 8G>@9?>:C DG@AN FC:GG_K?<@;?>@:A B:C >78 9:;8< M@>7 ? C8;DF8; AD9=8C :B EC8;@F>:CGI

26<T!X: ]: >: *>8E 1 ?A; C8E8?> >78 EC:F8;DC8 Q:A >78 ;?>? G8> > M@>7 >78 C8;DF8; AD9=8C :B EC8;@F>:CGR DA>@< :A<J :A8 @AED> K?C@?=<8 @G <8B>I

0@F7?Y #COZG@:H

6a5

&A >78 B@CG> B8M @>8C?>@:AG :B >78 EC:F8;DC8 M8 @;8A>@BJ >78 <8?G> @9E:C>?A> K?C@?=<8G ?A; >78A M8 F:A>@AD8 DA>@< M8 8A; DE M@>7 :A<J :A8 _ >78 9:G> @9E:C>?A> K?C@?=<8I #7DG4 M8 C8?; >78 K?C@?=<8 <?=8<G @A >78 C8K8CG8 :C;8C >: B@A; >78 C?AH@AN :B EC8;@F>:CGI

!

)<@MO@8O6!/87F84N<5!%@<O6FSF986F?O!

,AF8 >78 C?AH@AN :B EC8;@F>:CG @G =D@<> M8 F?A DG8 ;@BB8C8A> FC@>8C@? >: @A;@F?>8 M7@F7 @AED> K?C@?=<8G ?C8 C8;DA;?A>4 8INI^

4 GE8F@BJ@AN >78 >7C8G7:<; K?<D8 B:C >78 )?A; @A;8L4

4 GE8F@BJ@AN >78 >7C8G7:<; K?<D8 B:C >78 EC8;@F>@:A 8CC:C Q8G>@9?>8; =J "'_ 8CC:CRI

V78A 8G>@9?>@AN >78 EC8;@F>@:A 8CC:C =J FC:GG_K?<@;?>@:A M8 F?A ?<G: F:9ED>8 >78 G>?A;?C; 8CC:CI V8 M:D<; A88; >: ;: @> B:C 8?F7 8G>@9?>8; EC8;@F>@:A 8CC:CI #78A M8 F?A DG8 >78 G9?<<8G> EC8;@F>@:A 8CC:C @AFC8?G8; =J @>G G>?A;?C; 8CC:C ?G >78 >7C8G7:<; T?G EC:E:G8; @A j?G>@8 ./ %01 Q1556RU4 @I8I M8 F7::G8 >78 <8?G> F:9E<8L 9:;8< M@>7@A :A8 G>?A;?C; 8CC:C :B >78 =8G>I

#78 M7:<8 EC:F8;DC8 :B 8K?<D?>@AN >78 @9E:C>?AF8 :B EC8;@F>:CG @G E8CB:C98; B:C 8?F7 F<?GG G8E?C?>8<J @A :C;8C >: :=>?@A >78 EC:B@<8 ;8GFC@E>@:A :B >78 F<?GG8GI &A :>78C M:C;G M8 DG8 >78 :A8_?N?@AG>_?<< G>C?>8NJ4 >C8?>@AN ?<< >78 :=G8CK?>@:AG A:> =8<:AN@AN >: ? N@K8A F<?GG ?G >78 G8F:A; F<?GG ?A; 8K?<D?>@AN >78 @AB<D8AF8 :B @AED> K?C@?=<8G :A >78 ;8F@G@:A BDAF>@:A :=>?@A8; BC:9 >M:_F<?GG *'0GI #78 EC:F8;DC8 @G C8E8?>8; B:C 8K8CJ F<?GG @A ;?>?G8>I

! !

%/:!*+!$Y*&'1$!%1132")*"%+C!"#$!')(,$.3)$!

V8 DG8; >78 =8AF79?CH C8?<_M:C<; ;?>? G8> ?0%++ >?H8A BC:9 >78 d !"#$%&e E?FH?N8 BC:9 >78 G>?>@G>@F?< <?AND?N8 @A M7@F7 ?<< >78

F:9ED>?>@:AG M8C8 E8CB:C98;I !G >78 =8AF79?CH ;?>?G8> ;:A:CG G>?>84 >78 G>D;J :B >78 F<?GG@B@F?>@:A :B >JE8G :B N<?GG M?G 9:>@K?>8; =J FC@9@A:<:N@F?< @AK8G>@N?>@:AI !> >78 GF8A8 :B >78 FC@984 >78 N<?GG <8B> F?A =8 DG8; ?G 8K@;8AF8 @B @> @G F:CC8F><J @;8A>@B@8;I #78 G8> ?0%++ F:AG@G>G :B 16i :=G8CK?>@:AG4 ;8GFC@=8; =J a AD98C@F?< EC8;@F>:CG^ 'I6 _ C8BC?F>@K8 @A;8L ?A; K?C@?=<8G^ 'I14III4'Ia _ C8EC8G8A>@AN ? M8@N7> E8CF8A>?N8 :B ? E?C>@FD<?C 8<898A> @A F:CC8GE:A;@AN :L@;8 @A >78 N<?GG >JE8I #78 8<898A>G ?C8^ %?4 0N4 !<4 *@4 X4 "?4 `? ?A; /84 C8GE8F>@K8<JI ,A8 A:9@A?< K?C@?=<8 ;8B@A8G >78 F<?GGI #78C8 ?C8 G@L F<?GG8G :B :=h8F>G @A >7@G ;?>? G8> C8EC8G8A>@AN G@L >JE8G :B N<?GG^ =D@<;@AN M@A;:MG B<:?> EC:F8GG8;4 =D@<;@AN M@A;:MG A:A B<:?> EC:F8GG8;4 K87@F<8 M@A;:MG B<:?> EC:F8GG8;4 F:A>?@A8CG4 >?=<8M?C8 ?A; 78?;<?9EGI

#78 &9E:C>?AF8 :B SC8;@F>:C '?C@?=<8G B:C &A;@K@;D?< "<?GG8G @A *'0 _6a6 #78 C8GD<>G :B >78 EC:F8;DC8 EC8G8A>8; @A #?=<8 6 C8?<@O8; B:C "<?GG 6 QB:C @<<DG>C?>@:AR ?C8 G7:MA @A #?=<8 1I *@AF8 @> M?G :A<J >78 98F7?A@G9 :B >78 EC:F8;DC8 >7?> M8 M?A>8; >: EC8G8A> @A #?=<8 6 M8 ;: A:> EC8G8A> ;8>?@<G B:C :>78C F<?GG8GI

! !

#?=<8 1I!#78 C8GD<>G :B >78 EC:F8;DC8 B:C >78 K?C@?=<8 @9E:C>?AF8 8K?<D?>@:A B:C "<?GG 6 @A ;?>?G8> ?0%++ %:I :B @>8C?>@:A -8<8>8; EC8;@F>:C )?A; &A;8L "' EC8;@F>@:A 8CC:C *>?A;?C; 8CC:C

6 'I3 54a2\ 5411a 54515

1 'I[ 54a6a 54165 5451i

2 'I2 54a65 Z[UZX! Z[ZU\!

i 'I1 54[\a 541i[ 545i[

3 'I6 54[32 541\\ 5452f

\ 'Ia 54[2f @ABCD 5456i

f !"# 54fii 54131 54561

[ !$# _{543\[ 54233 54525}

a !%#

*:DCF8^ :MA C8GD<>GI

V8 F?A 8?G@<J G88 >7?> >78 =8G> 9:;8< Q>78 :A8 M@>7 >78 9@A@9D9 EC8;@F>@:A 8CC:C _ @A =:<;B?F8R @G A:> >78 9:;8< =D@<> :A >78 F:9E<8>8 G8> :B EC8;@F>:CG =D> >78 :A84 M78C8 K?C@?=<8G^ 'I34 'I[ ?A; 'I2 M8C8 ;8<8>8; Q>78G8 @AED>G ?C8 @CC8<8K?A> B:C >78 "<?GG 6 =:DA;?CJRI !G EC:E:G8; =J j?G>@8 ./ %01 Q1556R M8 F7::G8 >78 9:;8< M@>7 >78 B8M8G> @AED> K?C@?=<8G M@>7 >78 EC8;@F>@:A 8CC:C A:> NC8?>8C >7?A >78 9@A@9D9 EC8;@F>@:A 8CC:C Q54153R @AFC8?G8; =J @>G G>?A;?C; 8CC:C Q5451[RI &A >78 N@K8A 8L?9E<84 >7@G ?<<:M8; >: 8L>8A; >78 G8> :B C8;DA;?A> EC8;@F>:CG >: k'I34 'I[4 'I24 'I14 'I64 'IalI )8?;@AN >78 <@G> :B ;8<8>8; EC8;@F>:CG Q>78 G8F:A; F:<D9A :B #?=<8 1R @A C8K8CG8 M8 :=>?@A >78 C?AH@AN :B @AED> K?C@?=<8G QBC:9 >78 9:G> >: >78 <8?G> @9E:C>?A>RI #7DG K?C@?=<8 'Ii @G >78 :A8 M@>7 >78 <?CN8G> ;@GFC@9@A?>@K8 E:M8C B:C >78 EC:=<89 :B ;@G>@AND@G7@AN :=h8F>G :B "<?GG 6 BC:9 ?AJ :>78C :=G8CK?>@:AGI

#78 C?AH@ANG :B EC8;@F>:CG B:C 8K8CJ F<?GG @A ;?>?G8> ]<?GG ?C8 EC8G8A>8; @A #?=<8 2I

0@F7?Y #COZG@:H

6a1

#?=<8 2I!)?AH@ANG :B EC8;@F>:CG B:C 8K8CJ @A;@K@;D?< F<?GG @A ;?>?G8> ]<?GG :=>?@A8; ?G >78 C8GD<> :B >78 EC:E:G8; EC:F8;DC8 @AK:<K@AN =?FHM?C; 8<@9@A?>@:A ?A; )?A; @A;8L

S:G@>@:A @A C?AH@AN "<?GG 6 `D@<;@AN M@A;:MG B<:?> EC:F8GG8; "<?GG 1 `D@<;@AN M@A;:MG A:A B<:?> EC:F8GG8; "<?GG 2 K87@F<8 M@A;:MG B<:?> EC:F8GG8; "<?GG i F:A>?@A8CG "<?GG 3 >?=<8M?C8 "<?GG \ 78?;<?9EG 6 /:W! /:W! /:\! /:]! /:^! /:^! 1 /:_! /:V! 'If /:\! /:_! 'I3 2 /:]! /:D! 'I\ /:_! /:]! 'If

i 'Ia /:^! 'I3 /:X! /:V! 'Ii

3 'I6 'Ia 'Ii 'Ii /:\! 'Ia

\ 'I1 'I3 'I[ 'I2 /:X! 'I\

f 'I2 'If 'I2 'I[ 'I1 'I2

[ 'I[ 'I1 'I1 'I1 'Ii 'I1

a 'I3 'I\ 'I6 'I6 'I6 'I6

*:DCF8^ :MA C8GD<>GI

#78G8 C?AH@ANG ?C8 K8CJ 8?GJ B:C @A>8CEC8>?>@:AI /:C 8L?9E<8 M8 G88 >7?> "<?GG 2 _ K87@F<8 M@A;:MG _ @G K8CJ M8<< G8E?C?=<8 DG@AN :A<J :A8 EC8;@F>:C 'Ia QM8@N7> E8CF8A>?N8 :B >78 @C:A :L@;8RI /:C G8E?C?>@AN "<?GG i :=h8F>G @> @G 8A:DN7 >: DG8 EC8;@F>:CG^ 'I\4 'Ia4 'If ?A; 'I3I V8 F?A ?<G: F:AF<D;8 >7?> M@>7 :A<J :A8 8LF8E>@:A4 EC8;@F>:C 'I6 _ C8BC?F>@K8 @A;8L _ @G @;8A>@B@8; ?G ? C8;DA;?A> K?C@?=<8I &> @G K8CJ 8?GJ >: :=>?@A >78 EC:B@<8 ;8GFC@E>@:A :B 8K8CJ F<?GG BC:9 #?=<8 2I

! !

/:!,(+,132%(+!

V8 EC:E:G8; ?A @A>D@>@K8 EC:F8;DC8 B:C 8K?<D?>@AN >78 @9E:C>?AF8 :B K?C@?=<8G B:C 8K8CJ @A;@K@;D?< F<?GG @A *'0G 9:;8<GI #78 EC:F8;DC8 @G ? G@9E<8 9:;@B@F?>@:A :B >78 C8FDCG@K8 =?FHM?C; 8<@9@A?>@:A >8F7A@PD8I &AG>8?; :B DG@AN >78 9@A@9D9 "'_EC8;@F>@:A 8CC:C ?G >78 FC@>8C@:A B:C ;8<8>@AN @AED> K?C@?=<8G M78A FC8?>@AN >78 C?AH@AN M8 DG8 >78 9?L@9D9 F<?GG@B@F?>@:A ?NC8898A> Q)?A; @A;8LR 98?GDC@AN >78 ;@BB8C8AF8G @A >78 EC8;@F>@:A =8>M88A >78 9:;8< =D@<> M@>7 >78 M7:<8 G8> :B K?C@?=<8G ?A; >78 C8;DF8; G8> :B EC8;@F>:CGI #7@G 9:;@B@F?>@:A @G hDG>@B@8; =J >78 :=G8CK?>@:A >7?> ;8<8>@AN >78 C8;DA;?A> K?C@?=<8 ;:8G A:> F7?AN8 >78 C8GD<>G :B F<?GG@B@F?>@:A G@NA@B@F?A><JI #78 ?;K?A>?N8 :B DG@AN >78 )?A; @A;8L @AG>8?; :B >78 "'_F<?GG@B@F?>@:A 8CC:C @G >78 C8;DF>@:A :B F:9ED>?>@:A?< F:G>G :B >78 ?<N:C@>79I #78 ?<N:C@>79 @G A:> :E>@9?< G@AF8 @> DG8G >78 NC88;J G8?CF7@AN >8F7A@PD8I &B >78 AD9=8C :B :=G8CK?>@:AG @G >:: <?CN8 >: E8CB:C9 >78 EC:F8;DC8 8BB8F>@K8<J @> @G GDNN8G>8; >: F?<< @> :A >78 C?A;:9 GD=G8> :C :A >78 GD=G8> F:AG@G>@AN :B ?<< GDEE:C> K8F>:CG @;8A>@B@8; =J >78 9:;8< DG8; ?G >78 E?>>8CAI

#78 &9E:C>?AF8 :B SC8;@F>:C '?C@?=<8G B:C &A;@K@;D?< "<?GG8G @A *'0 _6a2 0:C8:K8C4 >78 C?AH@AN C8GD<>@AN BC:9 >78 EC:F8;DC8 @G K8CJ 8?GJ B:C @A>8CEC8>?>@:AI V8 :=>?@A >78 EC:B@<8 ;8GFC@E>@:A :B 8K8CJ F<?GG! ?A; @> N@K8G ?;;@>@:A?< @9E:C>?A> @AB:C9?>@:A ?=:D> >78 ?A?<JO8; E78A:98A:AI #78 8L?9E<8 :A >78 =8AF79?CH C8?<_M:C<; ;?>? G8> ;89:AG>C?>8G >78 DG8BD<A8GG :B >78 EC8G8A>8; EC:F8;DC8I ! ! )$-$)$+,$2! !=8 *I Q1553R4 >7::,(/ E.#/,( !%#$"9.+ 6,( F%//.(9 ;0%++"6"#%/",9 GH5=%9#.+ "9 F%//.(9 I.#,J9"/",9K4 *EC@AN8CI

]DJ:A &I4 ]DAA *I4 %@HC?K8G7 0I4 .?;87 +I QC8;IR Q155\R4 L.%/7(. MN/(%#/",9A L,795%/",9+ %95 H::0"#%/",9+I *EC@AN8CI

j?G>@8 #I4 #@=G7@C?A@ )I4 /C@8;9?A mI Q1556R4 '$. M0.8.9/+ ,6 >/%/"+/"#%0 O.%(9"9J4 *EC@AN8C '8C<?N4 %InI

)?H:>:9?9:AhJ !I Q1552R4 '?C@?=<8 *8<8F>@:A $G@AN *'0_=?G8; "C@>8C@?4 dP,7(9%0 ,6 !%#$"9. O.%(9"9J I.+.%(#$e4 24 EI 623f_62f5I

*F7b<H:EB `I4 *9:<? !I Q1551R4 O.%(9"9J Q"/$ R.(9.0+1 >7::,(/ E.#/,( !%#$"9.+A I.J70%(")%/",9A S:/"8")%/",9A %95 T.3,95A 0&# SC8GG4 "?9=C@;N8I'

'?EA@H 'I Q6aa[R4 >/%/"+/"#%0 O.%(9"9J '$.,(34 m:7A V@<8J o *:AG4 %InI

V8G>:A mI4 0DH78Ch88 *I4 "7?E8<<8 ,I4 S:A>@< 0I4 S@?NN@: #I4 '?EA@H 'I Q1556R4 /8?>DC8 G8<8F>@:A B:C *'0G4 dH5=%9#.+ "9 2.7(%0 U96,(8%/",9 F(,#.++"9J >3+/.8+e4 624 0&# SC8GG4 EI \\[_\[6I

!"#$%& '()*+",-

!

B'`aB!G&%$++a,#!(0b*c+%*bd,a,#!+*!;2G"*`"!'(2G,G$Ce1+a,#! ;1*2!B!&$"(.G%$!B$;"()eB!+(c+a,#!

V 98>:;O@8 M8H>:CpM A:qAJF7 Q*'0R BDAHFh? ;JGHCJ9@ADhrF? MJOA?FO?A? h8G> E:ECO8O >C?AGB:C9?FhZ ;?AJF7 M ECO8G>CO8s : OA?FOA@8 M@ZHGOJ9 MJ9@?CO84 N;O@8 E:GODHDh8 G@Z :E>J9?<A8h 7@E8CEY?GOFOJOAJ C:O;O@8<?hrF8h H<?GJ E?C?9@I %? GHD>8H >8h >C?AGB:C9?Fh@ ;O@?Y?A@8 98>:;J *'0 ECOJE:9@A? ;O@?Y?A@8 tFO?CA8h GHCOJAH@e4 F: :OA?FO?4 @u =?C;O: >CD;A: @A>8CEC8>:M?v MJA@H@ >?H :>COJ9?A8h H<?GJB@H?Fh@I S: O=D;:M?A@D 9:;8<D FOZG>: M?uAJ9 EC:=<8989 h8G> OA?<8O@8A@8 G>:G:MA8N: :E@GD H<?G :C?O C:OE:OA?A@84 H>pC8 O9@8AA8 :=h?qA@?hrF8 9@?YJ A?hM@ZHGOJ MEYJM A? HGO>?Y> E:GOFO8Np<AJF7 H<?G QO@;8A>JB@H:M?A@8 O9@8AAJF7 F7?C?H>8CJG>JFOAJF7RI

]YpMAJ9 F8<89 ECO8EC:M?;O:A8h ?A?<@OJ h8G> ECO8;G>?M@8A@8 EC:F8;DCJ MJH:COJG>DhrF8h >8F7A@H@ ECp=H:M?A@?4 G8<8HFhZ :C?O 9@?CZ ON:;A:qF@ H<?GJB@H?Fh@4 ;: :F8AJ MEYJMD E:GOFO8Np<AJF7 O9@8AAJF7 ;@?NA:G>JFOAJF7 A? HGO>?Y> H?u;8h O H<?GI