NIPS+読み会・関西 #7 発表資料

Sanity Checks for Saliency Maps
NIPS 2018(spotlight)
+
A Theoretical Explanation for
Perplexing Behaviors of
Backpropagation-based Visualizations
ICML 2018
+
#

#
=
P =
• A C
• (
•
6 A 2 6 N
5 (3)H S
2018/11/11 NIPS+読み会関西 #7 1

zyN f s t
B G + CE A B 1 D 2
• p k ( S ik ro
• DECD uc e p TPVP
• ( )
• ng x
• Local Explanation Methods for Deep Neural Networks Lack Sensitivity to
Parameter Values (ICLR2018 - Workshop) h ver.
) CE G A - DA B G CB CE EDA B I CE C
DECD G CB 8 A L G CB +10
• DECD CBI2 GM A B 1 D l p
• +22
• CBI2 G +22 CCA B
• A B 1 D c eadb v
2018/11/11 NIPS+読み会関西 #7 2

Sanity Checks for
Saliency Maps
+
Moritz Hardt
UC Berkeley
Google Brain
Julius Adebayo, Justin Gilmer,
Michael Muelly, Ian Goodfellow,
Been Kim
Google Brain
#

UcRB
LP da MP
!" # = %# + ', % =
)!"
)#
- =
N S % =
)!"
)#
G e e G D
e *+
,-.
= ReLU *+
,
e 3+
,
= *+
,
> 0 6 3+
,-.
3+
,
= 3+
,-.
> 0 6 3+
,-.
+ 3+
,
= *+
,
> 0 6 3+
,-.
> 0 6 3+
,-.
2018/11/11 NIPS+読み会関西 #7 4
[Simonyan et al., 2013]
# % =
)!"
)#[Simonyan et al., 2013]
[Zeiler & Fergus, 2014]
[Springenberg et al., 2014]

B
• !
• !
2018/11/11 NIPS+読み会関西 #7 5

e r h
(
( h !" # =
%&'
%(
# + *
#+ = 0 #+ G -+ vyi n I
( (
R Is u g tm
S p a udGo
(
) (
2018/11/11 NIPS+読み会関西 #7 6
b (0= )
[Shrikumar et al., 2017]
[Sundararajan et al., 2017]
[Smilkov et al., 2017]
[Smilkov et al., 2017]

( ) )
N
C A M
2018/11/11 NIPS+読み会関西 #7 7
N
[Zhou et al., 2016]

b n a
)
)
• c U
• =4 )A 0== pG
U M d )0 p R U P
p C k o
) (1 -2 Bev i
= N )
2018/11/11 NIPS+読み会関西 #7 8
g
lu rU LR
[Selvaraju et al, 2016]

jrG
t S da g
c O jr H m
t Rnyo O y O PX
( ) i Pl RIR ( vx L M
Rv 2 i R P h
s
e fg u
C 2 (
2
2018/11/11 NIPS+読み会関西 #7 9
s

el n
k hk L n G Rr
G aI G Rr
a C aI
0 10 ( 207 0 I ) g el
aI Iz R i
t
n o I aI R
2018/11/11 NIPS+読み会関西 #7 10
[Zhang et al., 2017]

36 90 2
36 1 9
2018/11/11 NIPS+読み会関西 #7 11

M CG GI B
• - A CG
• GI A A P
2018/11/11 NIPS+読み会関西 #7 12

b M G I
• A - CP M G
• - BP
• A d i
• A A
A e b
2018/11/11 NIPS+読み会関西 #7 13
n
a
n
a
n
a

&
2 (
2018/11/11 NIPS+読み会関西 #7 14
[Sundararajan&Taly, 2018]
2 (
80%
0( )
MNIST
( 0 )
( )
8
! Rand. Vec ) 02

G 0 G A .
• 0 N
•
2018/11/11 NIPS+読み会関西 #7 15

•
•
2018/11/11 NIPS+読み会関西 #7 16

• G
• B ( ) (
2018/11/11 NIPS+読み会関西 #7 17

, ( )
2018/11/11 NIPS+読み会関西 #7 18
GG
• G
•
•
• I
G

NIM MA n
eg MA
i
! " = $"
GradientsCSmooth Grad d
34567 " =
8($")
8"
= $ = 3;4
0 - . -. 4 d
3<= " = " − ?" @
A
B 8! ?" + D " − ?"
8"
ED = " − ?"
$
2
. . e A d
-. d
NG A SA -. 4C A a
2018/11/11 NIPS+読み会関西 #7 19

(
! " = $
%&'
(
$
)&'
(
ReLU . ∗ " %)
0
0"%)
! " = $
1&2'
'
$
3&2'
'
ReLU′ . ∗ " %51,)53_ .13 = $
1&2'
'
$
3&2'
'
8%51,)53.13
3×3 "%)
;
;<=>
)
1
2018/11/11 NIPS+読み会関西 #7 20
.
?
?
3
3
1 if . ∗ " %) > 0

2018/11/11 NIPS+読み会関西 #7 21

+ -7 7- -
7 -
- - - -
-7 A-
N EB
Yang Zhang
Department of Computer
Science,
Rice University, Houston, USA
Weili Nie
Department of Electrical
and Computer
Engineering, Rice
University, Houston, USA
Ankit B. Patel
Department of Neuroscience, Baylor College of Medicine,
Houston, USA
Department of Electrical and Computer Engineering, Rice
University, Houston, USA
I

2018/11/11 NIPS+読み会関西 #7 23

cD
- 6B ygm
- 1 G P l
Go
G SV U
G e
- 1 G S L
G I
G S t
yg e L
2018/11/11 NIPS+読み会関西 #7 24
Saliency
Deconv
GBP
a
i
S
482 560
RGB v LV n L B
RGBP R yg

B
• !
• !
2018/11/11 NIPS+読み会関西 #7 25

!",$
%
& ≜ ( )$
%
&
!*,$
%
& ≜ ( +$
%
&
,$
%
=
!",$
%
+$
%
!*,$
%
+$
%
!",$
%
!*,$
%
+$
%
,$
%
= ℎ +$
%
/0 )$
%
/)$
%
2018/11/11 NIPS+読み会関西 #7 26
for Saliency Map
for DeconvNet
for GBP
ReLU
) F
, +

d
k
!" # = %
&'(
)
%
*'(
+
,-./,"1 2 & 34 *
, 5 6 0, 89
3 3 k i
N .
:" # =
1
<"
%
*'(
+
=*
3
%
&'(
)
ℎ ,-./," ?2 &,*
?2 &,* = @
2 &
2 & A 2 & 34 *
2018/11/11 NIPS+読み会関西 #7 27
ReLU
ReLU
ReLU
CNN
#
B-dim
# = 1
,
2 &
5
G-filter
M-output
1
4
C
CNN
for DeconvNet
for Saliency Maps and GBP
4 *
= _`#

P
! B G "
#$
%&'
( ≅ (
#$ ( =
1
,-$
.
/01
2
3/
4 1
!
.
501
6
ℎ 89:;,$ => 5,/
≅
1
,-$
.
/01
2
3/
4
? ℎ 89:;,$ => 5,/
≅
1
,-$
.
/01
2
3/
4
? ℎ 89:;,$ ? => 5,/
2018/11/11 NIPS+読み会関西 #7 28
1/N
i.i.d
ReLU( )
-->
=> 5,/ = > 5 @ > 5 4A /
A / = 3B(
( )
(

c N
2018/11/11 NIPS+読み会関西 #7 29
BD l
MGP ! "e S & B l
#$
%&'
( , #$
*+,-./
( ≅ 1 0, 3
a
#$ ( =
1
67$
8
9:;
<
=9
> 1
!
8
?:;
@
ℎ BCDE,$ FG ?,9
≅
1
67$
8
9:;
<
=9
>
H ℎ BCDE,$ FG ?,9
≅
1
67$
8
9:;
<
=9
>
H ℎ BCDE,$ H FG ?,9
Saliency Map
ReLU( )
--> 0
FG ?,9 = G ? I G ? >J 9
--> 0
DeconvNet
( i)

a
!" # = %
&'(
)
%
*'(
+
,-./,"1 2 3 & 45 *
g
6" # =
1
8"
%
*'(
+
9*
4
%
&'(
)
ℎ 1; <&* ,-./," =3 &,*
6" # ≅
1
8"
%
*'(
+
9*
4
%
&'(
)
ℎ ,-./," =3 &,* ? 3 & 45 *
i Re
2018/11/11 NIPS+読み会関西 #7 30
Max pooling
PM
L
PM3 & 4
5 *
> 0
≅ ReLU
=3 &,* = B
3 &
3 & ? 3 & 45 *
for DeconvNet
for Saliency Maps and GBP
U
= P

C ( N
(!
"# $ = Γ#
' (
) Γ '*+ ( ⋯ ) Γ + ($
-
./ = ) Γ / (. /*+ , . 1 = $
2# $ =
1
4#
5
67+
8
96
(
5
:7+
;
ℎ =>?@A,#
+
BC :,6
=>D,#
/
=
E F. /G+
E. /
D ℎ
E F. /GH
E. /G+
⋯ ℎ
E F. '*+
E. '*H
ℎ Γ#
'
F. / = I Γ / . /*+
2018/11/11 NIPS+読み会関西 #7 31
orD
) )
( )
( )

e P
C )) N !"#,%
&
C
( N
2018/11/11 NIPS+読み会関西 #7 32
( )
Appendix D
D 3 G B Deep

1 1
1
1
1
C
1 N1
2018/11/11 NIPS+読み会関西 #7 34
1
1 1 C
ReLU C
GBP Edge
[Yosinski et al., 2014; Zeiler & Fergus, 2014]

/ P
( V ) c
e B D
) c
! "#$
%&'
!(
≅ *+,-. (
1 V f
/0 ( =
1
30
! "# %&'
!(
ℎ 567,0
%&'
) P
/0 ( =
1
30
9
$:'
;
! "#$
%&'
!(
7 ℎ 56$,0
%&'
≅
'
<=
*+,-. ( 7 ℎ 56$,0
%&'
2018/11/11 NIPS+読み会関西 #7 35
V
CNN^nc
…
…
…
*+,-. (
fc1 fc1
fc1c G 1 B
C
fc1

CNN ( DeconvNet)GBP
-. / ≅
1
2.
34567 / 8 ℎ :;<,.
>?@
•
•
2. = ℎ :;<,.
>?@
)(
2018/11/11 NIPS+読み会関西 #7 36
CNN

MV6 GC --
6 -- . /
P I L
30 1-1
2018/11/11 NIPS+読み会関西 #7 37
CNN
GBP
GBP N

) P
3C
3 ( NG
B
2018/11/11 NIPS+読み会関西 #7 38
MLP
CNN

3 D & 11
11 - C +
2018/11/11 NIPS+読み会関西 #7 39
6G

162
6 - 162
2018/11/11 NIPS+読み会関西 #7 40

6 1 - 6
2018/11/11 NIPS+読み会関西 #7 41

P B 1 V
2018/11/11 NIPS+読み会関西 #7 42
1 1
1 1
- 6
G

l t
• eGMN v b d
• ( c a G n =N G x d
• 2 ( 2 G x d
• G ANB SP .
• D .
• yor ) D c a G n 2
• c a nGi 2
2018/11/11 NIPS+読み会関西 #7 43

NIPS+読み会・関西 #7 発表資料

Recommended

Recommended

More Related Content

Similar to NIPS+読み会・関西 #7 発表資料

Similar to NIPS+読み会・関西 #7 発表資料 (20)

Recently uploaded

Recently uploaded (20)

NIPS+読み会・関西 #7 発表資料