Paper Review: An exact mapping between the Variational Renormalization Group and Deep Learning

An exact mapping between the Variational
Renormalization Group and Deep Learning
Kai-Wen Zhao, kv
Physics, National Taiwan University
kelispinor@gmail.com
December 1, 2016
Kai-Wen Zhao, kv (NTU-PHYS) Review December 1, 2016 1 / 18

Outline
Overview
Renormalization Group
Physical world with various length scales
Symmetry and Scale Invariance
Restricted Boltzman Machine
Generative, Energy-based Model, Unsupervised Learning Algorithm
Richard Feynman: What I Cannot Create, I Do Not Understand.
Mapping
Unsupervised Deep Learning Implements the Kadanoﬀ Real Space
Variational Renormalization Group
HRG
λ [{hj }] = HRBM
λ [{hj }]

Overview of Variational RG
Statistical Physics
An ensemble of N spins {vi }, take value ±1, i is position index in some
lattice. Boltzman distribution and partition function
P({vi }) =
e−H({vi })
Z
, where Z = Trvi e−H({vi })
=
v1,v2,...=±1
e−H({vi })
Typically, Hamiltonian depends on a set of couplings {Ks}
H[{vi }] = −
i
Ki vi −
ij
Kij vi vj −
ijk
Kijkvi vj vk + ...
Free energy of spin system
F = − log Z = − log(Trvi e−H({vi })
)

Overview of Variational Renormalization Group
Idea behind RG: To ﬁnde a new coarsed-grained description of spin
system, where one has integrated out short distance ﬂuctuations.
N Physical spins: {vi }, couplings {K}
M Coarse-grained spins: {hj }, couplings { ˜K}, where M < N
Renormalization transformation is often represented as a mapping
{K} → { ˜K}
Coarse-grained Hamiltonian
HRG
[{hj }] = −
i
˜Ki hi −
ij
˜Kij hi hj −
ijk
˜Kijkhi hj hk + ...
Now, we do not distinguish vi and {vi } if no ambiguity

Variational RG scheme (Kadanoﬀ)
Coarse graining procedure: Tλ(vi , hj ) couples auxiliary spins hj to physical
spins vi
Naturally, we marginalize over the physical spins
exp (−HRG
λ (hj )) = Trvi exp (Tλ(vi , hj ) − H(vi ))
The free energy of coarse grained system
Fh
λ = −log(Trhj
e−HRG
λ (hj )
)
Choose parameters λ to ensure long-distrance observables are invariant.
Minimize free energy diﬀerence
∆F = Fh
λ − Fv

RBMs and Deep Neural Networks
Binary data probability distribution P(vi ). Energy function
E(vi , hj ) =
ij
wij vi hj +
i
ci vi +
j
bj hj
where we denote parameters λ = {w, b, c}. Joint probability
pλ(vi , hj ) =
e−E(vi ,hj )
Z

RBMs and Deep Neural Networks
Variational distribution of visible variables
pλ(vi ) =
hj
p(vi , hj ) = Trhj
pλ(vi , hj ) :=
e−HRBM
λ (vi )
Z
pλ(hj ) =
vi
p(vi , hj ) = Trvi pλ(vi , hj ) :=
e−HRBM
λ (hj )
Z
Kullback-Leibler divergence
DKL(P(vi )||pλ(vi )) =
vi
P(vi ) log
P(vi )
pλ(vi )

Exact Mapping VRG to DL
Mapping Variational RG to RBM
In RG scheme, the couplings between visible and hidden spins are encodes
by the operators T. Analogous role, in RBM, is played by joint energy
function.
T(vi , hj ) = −E(vi , hj ) + H(vi )
To derive equivalent statement from coarse-grained Hamiltonian
e−HRG
λ (hj )
Z
=
Trvi eTλ(vi ,hj )−H(vi )
Z
= Trvi
e−E(vi ,hj )
Z
= pλ(hj )
=
e−HRBM
λ (hj )
Z
Subsituting the right-hand side yields
HRG
λ [{hj }] = HRBM
λ [{hj }] (1)

Exact Mapping VRG to DL
Mapping Variational RG to RBM
The operator Tλ can be viewed as a variational approximation for
conditional probability
eT(vi ,hj )
= e−E(vi ,hj )+H(vi )
=
pλ(vi , hj )
pλ(vi )
eH(vi )−HRBM
λ (vi )
= pλ(hj |vi )eH(vi )−HRBM
λ (vi )

Examples
Examples: 2D Ising Model
Two dimensional nearest neighbor Ising model with ferromagnetic coupling
H({vi }) = −J
<ij>
vi vj
Phase transition occurs when J/(kBT) = 0.4352.
Experiment Setup
20,000 samples, 40x40 periodic lattice
RBM’s architecture 1600-400-100-25

Examples
Figure: Top layer

Examples
Figure: Middle layer

Examples

Conclusion
Conclusion and Discussion
One-to-one mapping between RBM-based DNN and variational RG
Suggest learning implements RG-like scheme to extract important
features from data

Relate to us
Relate to us: Auto-Encoder and Convolutional AE
z is the codes extracted by machine
φ : X → Z ψ : Z → X
arg min ||X − (ψ ◦ φ)X||2
Figure: Scheme of Auto-Encoder

Relate to us
Relate to us: Auto-Encoder and Convolutional AE

Relate to us
Thanks

Paper Review: An exact mapping between the Variational Renormalization Group and Deep Learning

More Related Content

What's hot

Viewers also liked

Similar to Paper Review: An exact mapping between the Variational Renormalization Group and Deep Learning

More from Kai-Wen Zhao

Recently uploaded

Paper Review: An exact mapping between the Variational Renormalization Group and Deep Learning