SlideShare a Scribd company logo
Quantum Annealing for Dirichlet Process Mixture
Models with Applications to Network Clustering

Issei Sato, Shu Tanaka, Kenichi Kurihara,
Seiji Miyashita, and Hiroshi Nakagawa
Neurocomputing 121, 523 (2013)
Main Results
Diff. of log-likelihood

Better

We considered the efficiency of quantum annealing method for
Dirichlet process mixture models. In this study, Monte Carlo
simulation was performed.
21300

Wikivote

21200
21100
21000

2.5

3

3.5

4

4.5

5

0

- We constructed a method to apply quantum annealing to network
clustering.
- Quantum annealing succeeded to obtain a better solution than
conventional methods.
- The number of classes can be changed.
(cf. K. Kurihara et al. and I. Sato et al., UAI2009)
K. Kurihara et al., I. Sato et al., Proceedings of UAI2009.
Background
Optimization problem
To find the state (best solution) where the real-valued cost
function is minimized.
If the size of problem is small, we can easily obtain the best solution
by brute-force calculation.
However...
if the size of problem is large, we cannot obtain the best solution by
brute-force calculation in practice.

We should develop methods to obtain the best solution (at least,
better solution) efficiently.
Background
Cost function of most optimization problems can be represented by
Hamiltonian of classical discrete spin systems.
We can use the knowledge of statistical physics.
To find the state where the
cost function is minimized.

To find the ground state of
the Hamiltonian.

Simulated annealing (SA)
By decreasing the temperature (thermal fluctuation) gradually,
the ground state of the Hamiltonian is obtained.
S. Kirkpatrick, C. D. Gelatte, and M. P. Vecchi, Science, 220, 671 (1983).

SA can be adopted to both stochastic methods such as Monte Carlo
method and deterministic method.
Background
Quantum annealing (QA)
By decreasing the quantum fluctuation gradually, the ground
state of the Hamiltonian is obtained.
T. Kadowaki and H. Nishimori, Phys. Rev. E, 58, 5355 (1998).
E. Farhi, J. Goldstone, S. Gutmann, J. Lapan, A. Lundgren, and D. Preda, Science, 292, 472 (2001).
G. E. Santoro, R. Martonak, E. Tosatti, and R. Car, Science, 295, 2427 (2002).
Review articles
G. E. Santoro and E. Tosatti, J. Phys. A: Math. Gen., 39, R393 (2006).
A. Das and B. K. Chakrabarti, Rev. Mod. Phys., 80, 1061 (2008).
S. Tanaka and R. Tamura, Kinki University Series on Quantum Computing Series "Lectures on Quantum
Computing, Thermodynamics and Statistical Physics" (2012).

QA is better than SA?
What is CRP?
Chinese Restaurant Process (CRP)
Table (data class)
Restaurant (entire set)

1

1

2

3

2

4

5

3

Customer (data point)
Chinese Restaurant Process (CRP) assigns a probability for the
seating arrangement of the customers.
Chinese Restaurant Process (CRP)
Seating arrangement of the customers: Z =
customer i sits at the k-th table: zi = k

N
{zi }i=1

N: the number of customers

When customer i enters a restaurant with K occupied tables at
which other customers are already seated, customer i sits at a table
with the following probability:
(k-th occupied table)

+N 1

p(zi |Zzi ; )

Nk
+N 1

(new unoccupied table)

Nk: the number of customers sitting at the k-th table
: hyper parameter of the CRP
The log-likelihood of Z is given by p(Z) =

K(Z)

K(Z)
N
=1 (N

+ )

(Nk
k=1

1)!
What is QACRP?
Quantum annealing for CRP (QACRP)
QACRP uses multiple restaurants (m restaurants).
customer i sits at the k-th table in the j-th restaurant: zj,i = k
Seating arrangement of the customers in the j-th restaurant: Zj = {zj,i }
In the j-th restaurant, when customer i enters a restaurant with K
occupied tables at which other customers are already seated,
customer i sits at a table with the following probability:
Nj,k
+N 1

/m

(k-th occupied table)

m

pQA (zj,i | {Zd }d=1  {zj,i } ; , )

e

(cj,k (i)+c+ (i))f ( , )
j,k

/m
+N 1

: inverse temperature (thermal fluctuation)
: quantum fluctuation

(new unoccupied table)
Quantum annealing for CRP (QACRP)
/m

Nj,k
+N 1

e

(cj,k (i)+c+ (i))f ( , )
j,k

(k-th occupied table)

m

pQA (zj,i | {Zd }d=1  {zj,i } ; , )

/m

(new unoccupied table)

+N 1

c± (i) : the number of customers who sit at the k-th table in the j-th
j,k
restaurant and share tables with customer i in the (j ± 1)-th

restaurant.

j-1-th CRP
1

1

2

j+1-th CRP

j-th CRP
3

2

4

5

3

1

1

4

3

2

5

3

2

1

3

4

1

2

5

2

The above fact will be proven in the following.

3
Quantum annealing for CRP (QACRP)
Bit matrix representation for CRP
A bit matrix B : adjacency matrix of customers

1
1
2
3

1

2

4

3

5

4
5

B

Seating conditions ˜

2

3

4

5

1
1
0
1
0

1
1
0
1
0

0
0
1
0
1

1
1
0
1
0

0
0
1
0
1

=

N
i=1

N
n=1

˜i,n

Bi,n = Bn,i
Bi,i = 1 (i = 1, 2, · · · , N )

i, , Bi /|Bi | · B /|B | = 1 or 0

Sitting arrangement
can be represented by
the Ising model with
constraints.
Quantum annealing for CRP (QACRP)
Bit matrix representation for CRP
1
1

2

4

3

2

2

1
2 1 1 0 1 0
0
customers who share a
1
0 table with customer 2.

1

4

3

3
4
5

5

1
1
1 1 0 1 0
0
1
0

0
0 1 1 0 1
1
0
1

0
0 1 0 0 0
0
0
0

a set of the states that customer 2 can take
under the seating conditions.

3

4

5

1
1
0
1
0

1
1
0
1
0

0
0
1
0
1

1
1
0
1
0

0
0
1
0
1

1

1

5

2

2

3

4

5

1

0 1 0

0
1
0

1 0 1
0 1 0
1 0 1

2
3
4
5
Quantum annealing for CRP (QACRP)
Density matrix representation for “classical” CRP
Hc = diag[E(
E(

( )

)=

p( ) =

(1)

), E(

ln p(

( )

(2)

)

+
T

e

), · · · E(
( )

T e Hc

=:

T

)

)]

˜

( )

Hc

(2

N2

˜

e Hc
Zc

Sitting arrangement can be represented by the
Ising model with constraints.
Quantum annealing for CRP (QACRP)
Formulation for quantum CRP
H = Hc + Hq

Hc : classical CRP

Hq : quantum fluctuation

T

pQA ( ; , ) =

Classical CRP
p(˜i | ˜i ) =

p(zi |Zzi ; )

e

(Hc +Hq )

Te

T
˜i

e

(Hc +Hq )

Hc

T e Hc
Nk
+N 1

(k-th occupied table)

+N 1

(new unoccupied table)
Quantum annealing for CRP (QACRP)
Formulation for quantum CRP
H = Hc + Hq

Hc : classical CRP

Hq : quantum fluctuation

T

pQA ( ; , ) =

e

(Hc +Hq )

Te

Quantum CRP

(Hc +Hq )

T

pQA (˜i | ˜i ; , ) =

˜i

e

(Hc +Hq )

Te

(Hc +Hq )

Transverse field as a quantum fluctuation
N

Hq =

N
x
i,n ,

i=1 n=1

E=

1
0

0
1

,

x

=

0 1
1 0
Quantum annealing for CRP (QACRP)
Approximation inference for QACRP
T

pQA ( ; , ) =

e

(Hc +Hq )

Te

=

(Hc +Hq )

pQA
j (j

ST (

,

2)

2, · · ·

m

pQA

ST ( 1 ,

2, · · ·

,

m;

, )=

N
j+1 )

e

,

E(

j=1

f ( , ) = 2 ln coth
s( j ,

By the Suzuki-Trotter decomposition,
pQA can be approximately expressed
by the classical CRP.
m;

, )+O
ef ( , )s(
Z( , )

j )/m

m
N

(˜j,i,n , ˜j+1,i,n )

=
i=1 n=1

2N

Z( , ) = sinh

m

e

E( )
m

2

m
j , j+1 )
Experiments
Network model & dataset
Citeseer
citation network dataset for 2110
papers.
527

I. Sato et al. / Neurocomputing 121 (2013) 523–531

. (a) Social network (assortive network), (b) election network (disassortative network) and (c) citation network (mixture of assortative

ning CRPs in which sj ðj ¼ 1; …; mÞ
ment of the j-th CRP and represents
~
espond Bj;i;n ¼ 1 to s j;i;n ¼ ð1; 0Þ⊤ and
means that we can represent Bj as
the following121 (2013) 523–531
eurocomputing theorem:
(10) is approximated by the Suzuki–

!

β2
…; sm ; β; ΓÞ þ O
;
m

1
e−β=mEðsj Þ ef ðβ;ΓÞsðsj ;sjþ1 Þ ;
¼ 1 Zðβ; ΓÞ

ð15Þ

m

∏

ð16Þ

Netscience
coauthorship network of
regarded as a similarity function between the j-th and (j+1)-th bit
matrices. If they are the same matrices, then sðs ; s Þ ¼ N . In
scientists working on a network
Eq. (2), log p ðs Þ corresponds to log e
=Z and the regularizer
term f Á Rðs ; …; s Þ is log ∏
e
¼ f ðβ;
sðs ; s Þ.
thatΓÞ∑ inference for scientists.
has 1589
Note that we aim at deriving the approximation
SA

1

−β=mEðsj Þ

j

m

m
f ðβ;ΓÞsðsj ;sjþ1 Þ
j¼1

527

j

2

jþ1

m
j¼1

j

jþ1

pQA ðs i jss i ; β; ΓÞ in Eq. (13). Using Theorem 3.1, we can derive
~
~
Eq. (4) as the approximation inference. The details of the derivation are provided in Appendix B.

Wikivote
a bipertite network constructed
4. Experiments
using QA to a DPM
We evaluated QA in a real application. We applied administrator elections.
model for clustering vertices in a network where a seating
7115 Wikipedia users.
arrangement of the CRP indicates a network partition.

ples of network structures. (a) Social network (assortive network), (b) election network (disassortative network) and (c) citation network (mixture of assortative
Experiments
Annealing schedule
m : Trotter number, the number of replicas; m = 16

We tested several schedules of inverse temperature.
ln(1 + t)
0 t
0t
0

=

0

= 0.2m, 0.4m, 0.6m

t : t-th iteration.

= 0.4m t is a better schedule in SA (MAP estimation).
T
= 0
m
t

is a schedule of quantum fluctuation.
T : Total number of iterations
Diff. of log-likelihood

Better

Results
21300

Wikivote

21200
21100
21000

2.5

3

3.5

4

4.5

0

Lmax : the maximum log-likelihood of the beam search
Beam
Lmax : the maximum log-likelihood of 16 CRPs in SA
16SAs

5
Diff. of log-likelihood

Results
Citeseer

1600

1400

1200

Diff. of log-likelihood

1.5

2.5

3

Netscience
We consider multiple running CRPs in which sj ðj ¼ 1; …; mÞ
indicates the seating arrangement of the j-th CRP and represents
~
the j-th bit matrix Bj . We correspond Bj;i;n ¼ 1 to s j;i;n ¼ ð1; 0Þ⊤ and
⊤
Bj;i;n ¼ 0 to s j;i;n ¼ ð0; 1Þ , which means that we can represent Bj as
~
sj by using Eq. (5). We derive the following theorem:

600
500

1

Theorem 3.1. Sato ðs;al. ΓÞ in Eq. (10) is approximated by the Suzuki–
I. pQA et β; / Neurocomputing 121 (2013) 523–531
Trotter expansion as2.5
follows: 3
1.5
2
0
pQA ðs; β; ΓÞ ¼

21300

1 ⊤ −βðHc þHq Þ
s e
s
Z

Wikivote

¼ ∑ pQA−ST ðs; s2 ; …; sm ; β; ΓÞ þ O
sj ðj≥2Þ

21200

2

!

β
;
m

pQA−ST ðs1 ; s2 ; …; sm ; β; ΓÞ

4. Experiments

ð16Þ

We evaluated QA in a real application. We applied QA to a DP
model for clustering vertices in a network where a seati
arrangement of the CRP indicates a network partition.

2.5

1
e−β=mEðsj Þ ef ðβ;ΓÞsðsj ;sjþ1 Þ ;
Zðβ; ΓÞ
j¼1
m

¼ ∏

regarded as a similarity function between the j-th and (j+1)-th
matrices. If they are the same matrices, then sðsj ; sjþ1 Þ ¼ N 2 .
Eq. (2), log pSA ðsj Þ corresponds to log e−β=mEðsj Þ =Z and the regulari
term f Á Rðs1 ; …; sm Þ is log ∏m 1 ef ðβ;ΓÞsðsj ;sjþ1 Þ ¼ f ðβ; ΓÞ∑m 1 sðsj ; sjþ
j¼
j¼
Note that we aim at deriving the approximation inference
pQA ðs i jss i ; β; ΓÞ in Eq. (13). Using Theorem 3.1, we can der
~
~
527
Eq. (4) as the approximation inference. The details of the deriv
tion are provided in Appendix B.

ð15Þ

where we rewrite s as s1 , and

21100
21000

I. Sato et al. / Neurocomputing 121 (2013) 523–531

3.5

Fig. 5. Examples of network structures. (a) Social network (assortive network), (b) election network (disassortative network) and (c) citation network (mixture of assorta
and disassortative network).
0

700

400

Diff. of log-likelihood

2

Better solution
can be obtained
by QA.



β
Γ ;
ð17Þ
f ðβ; ΓÞ ¼ 2 Fig. 5. Examples of network structures. (a) Social network (assortive network), (b) election network (disassortative network) and (c) citation netwo
log coth
m
4.1. Network model
and disassortative network).

3

3.5

4

N

4.5

5

N

~
~
sðsj ; sjþ1 Þ ¼ 0∑ ∑ δðs j;i;n ; s jþ1;i;n Þ;

ð18Þ

We used the Newman model [17] for network modeling in t
Diff. of log-likelihood

Results
Citeseer

1600

SA(T=30,m=1)
13 sec.

calc. time

QA(T=30,m=16)
15 sec.

1400

16 SAs
1200

1600 SAs

beam search

QA(m=16)

35

30

57

37

# classes

1.5

2

2.5

3

3.5

Diff. of log-likelihood

0

700

SA(T=30,m=1)
calc. time

600

25 sec.

16 SAs

500
400

QA(T=30,m=16)

22 sec.

Netscience

1600 SAs

beam search

QA(m=16)

22

65

61

26

# classes
1

1.5

2

2.5

3

Diff. of log-likelihood

0

21300

SA(T=30,m=1)
calc. time

21200

79 sec.

16 SAs

21100
21000

QA(T=30,m=16)

76 sec.

Wikivote

# classes
2.5

3

3.5

4
0

4.5

5

1600 SAs

beam search

QA(m=16)

8

8

27

8
Main Results
Diff. of log-likelihood

Better

We considered the efficiency of quantum annealing method for
Dirichlet process mixture models. In this study, Monte Carlo
simulation was performed.
21300

Wikivote

21200
21100
21000

2.5

3

3.5

4

4.5

5

0

- We constructed a method to apply quantum annealing to network
clustering.
- Quantum annealing succeeded to obtain a better solution than
conventional methods.
- The number of classes can be changed.
(cf. K. Kurihara et al. and I. Sato et al., UAI2009)
K. Kurihara et al., I. Sato et al., Proceedings of UAI2009.
Thank you !

Issei Sato, Shu Tanaka, Kenichi Kurihara,
Seiji Miyashita, and Hiroshi Nakagawa
Neurocomputing 121, 523 (2013)

More Related Content

What's hot

Spectral properties of the Goldstino in supersymmetric Bose-Fermi mixtures
Spectral properties of the Goldstino in supersymmetric Bose-Fermi mixturesSpectral properties of the Goldstino in supersymmetric Bose-Fermi mixtures
Spectral properties of the Goldstino in supersymmetric Bose-Fermi mixtures
Daisuke Satow
 
Complex Dynamics and Statistics in Hamiltonian 1-D Lattices - Tassos Bountis
Complex Dynamics and Statistics  in Hamiltonian 1-D Lattices - Tassos Bountis Complex Dynamics and Statistics  in Hamiltonian 1-D Lattices - Tassos Bountis
Complex Dynamics and Statistics in Hamiltonian 1-D Lattices - Tassos Bountis
Lake Como School of Advanced Studies
 
NITheP UKZN Seminar: Prof. Alexander Gorokhov (Samara State University, Russi...
NITheP UKZN Seminar: Prof. Alexander Gorokhov (Samara State University, Russi...NITheP UKZN Seminar: Prof. Alexander Gorokhov (Samara State University, Russi...
NITheP UKZN Seminar: Prof. Alexander Gorokhov (Samara State University, Russi...
Rene Kotze
 
Quantum chaos of generic systems - Marko Robnik
Quantum chaos of generic systems - Marko RobnikQuantum chaos of generic systems - Marko Robnik
Quantum chaos of generic systems - Marko Robnik
Lake Como School of Advanced Studies
 
Quantum chaos in clean many-body systems - Tomaž Prosen
Quantum chaos in clean many-body systems - Tomaž ProsenQuantum chaos in clean many-body systems - Tomaž Prosen
Quantum chaos in clean many-body systems - Tomaž Prosen
Lake Como School of Advanced Studies
 
Neutral Electronic Excitations: a Many-body approach to the optical absorptio...
Neutral Electronic Excitations: a Many-body approach to the optical absorptio...Neutral Electronic Excitations: a Many-body approach to the optical absorptio...
Neutral Electronic Excitations: a Many-body approach to the optical absorptio...
Claudio Attaccalite
 
Introduction to Quantum Monte Carlo
Introduction to Quantum Monte CarloIntroduction to Quantum Monte Carlo
Introduction to Quantum Monte Carlo
Claudio Attaccalite
 
SV-InclusionSOcouplinginNaCs
SV-InclusionSOcouplinginNaCsSV-InclusionSOcouplinginNaCs
SV-InclusionSOcouplinginNaCs
Stephane Valladier
 
Dr. Arpan Bhattacharyya (Indian Institute Of Science, Bangalore)
Dr. Arpan Bhattacharyya (Indian Institute Of Science, Bangalore)Dr. Arpan Bhattacharyya (Indian Institute Of Science, Bangalore)
Dr. Arpan Bhattacharyya (Indian Institute Of Science, Bangalore)
Rene Kotze
 
Dynamic stiffness and eigenvalues of nonlocal nano beams
Dynamic stiffness and eigenvalues of nonlocal nano beamsDynamic stiffness and eigenvalues of nonlocal nano beams
Dynamic stiffness and eigenvalues of nonlocal nano beams
University of Glasgow
 
Wits Node Seminar: Dr Sunandan Gangopadhyay (NITheP Stellenbosch) TITLE: Path...
Wits Node Seminar: Dr Sunandan Gangopadhyay (NITheP Stellenbosch) TITLE: Path...Wits Node Seminar: Dr Sunandan Gangopadhyay (NITheP Stellenbosch) TITLE: Path...
Wits Node Seminar: Dr Sunandan Gangopadhyay (NITheP Stellenbosch) TITLE: Path...
Rene Kotze
 
Prof. Vishnu Jejjala (Witwatersrand) TITLE: "The Geometry of Generations"
Prof. Vishnu Jejjala (Witwatersrand) TITLE: "The Geometry of Generations"Prof. Vishnu Jejjala (Witwatersrand) TITLE: "The Geometry of Generations"
Prof. Vishnu Jejjala (Witwatersrand) TITLE: "The Geometry of Generations"
Rene Kotze
 
Stochastic Gravity in Conformally-flat Spacetimes
Stochastic Gravity in Conformally-flat SpacetimesStochastic Gravity in Conformally-flat Spacetimes
Stochastic Gravity in Conformally-flat Spacetimes
Rene Kotze
 
A02402001011
A02402001011A02402001011
A02402001011
inventionjournals
 
Bethe salpeter equation
Bethe salpeter equationBethe salpeter equation
Bethe salpeter equation
Claudio Attaccalite
 
BSE and TDDFT at work
BSE and TDDFT at workBSE and TDDFT at work
BSE and TDDFT at work
Claudio Attaccalite
 
Complexity of exact solutions of many body systems: nonequilibrium steady sta...
Complexity of exact solutions of many body systems: nonequilibrium steady sta...Complexity of exact solutions of many body systems: nonequilibrium steady sta...
Complexity of exact solutions of many body systems: nonequilibrium steady sta...
Lake Como School of Advanced Studies
 
Chebyshev Polynomial Based Numerical Inverse Laplace Transform Solutions of L...
Chebyshev Polynomial Based Numerical Inverse Laplace Transform Solutions of L...Chebyshev Polynomial Based Numerical Inverse Laplace Transform Solutions of L...
Chebyshev Polynomial Based Numerical Inverse Laplace Transform Solutions of L...
arj_online
 
Linear response theory
Linear response theoryLinear response theory
Linear response theory
Claudio Attaccalite
 
TwoLevelMedium
TwoLevelMediumTwoLevelMedium
TwoLevelMedium
John Paul
 

What's hot (20)

Spectral properties of the Goldstino in supersymmetric Bose-Fermi mixtures
Spectral properties of the Goldstino in supersymmetric Bose-Fermi mixturesSpectral properties of the Goldstino in supersymmetric Bose-Fermi mixtures
Spectral properties of the Goldstino in supersymmetric Bose-Fermi mixtures
 
Complex Dynamics and Statistics in Hamiltonian 1-D Lattices - Tassos Bountis
Complex Dynamics and Statistics  in Hamiltonian 1-D Lattices - Tassos Bountis Complex Dynamics and Statistics  in Hamiltonian 1-D Lattices - Tassos Bountis
Complex Dynamics and Statistics in Hamiltonian 1-D Lattices - Tassos Bountis
 
NITheP UKZN Seminar: Prof. Alexander Gorokhov (Samara State University, Russi...
NITheP UKZN Seminar: Prof. Alexander Gorokhov (Samara State University, Russi...NITheP UKZN Seminar: Prof. Alexander Gorokhov (Samara State University, Russi...
NITheP UKZN Seminar: Prof. Alexander Gorokhov (Samara State University, Russi...
 
Quantum chaos of generic systems - Marko Robnik
Quantum chaos of generic systems - Marko RobnikQuantum chaos of generic systems - Marko Robnik
Quantum chaos of generic systems - Marko Robnik
 
Quantum chaos in clean many-body systems - Tomaž Prosen
Quantum chaos in clean many-body systems - Tomaž ProsenQuantum chaos in clean many-body systems - Tomaž Prosen
Quantum chaos in clean many-body systems - Tomaž Prosen
 
Neutral Electronic Excitations: a Many-body approach to the optical absorptio...
Neutral Electronic Excitations: a Many-body approach to the optical absorptio...Neutral Electronic Excitations: a Many-body approach to the optical absorptio...
Neutral Electronic Excitations: a Many-body approach to the optical absorptio...
 
Introduction to Quantum Monte Carlo
Introduction to Quantum Monte CarloIntroduction to Quantum Monte Carlo
Introduction to Quantum Monte Carlo
 
SV-InclusionSOcouplinginNaCs
SV-InclusionSOcouplinginNaCsSV-InclusionSOcouplinginNaCs
SV-InclusionSOcouplinginNaCs
 
Dr. Arpan Bhattacharyya (Indian Institute Of Science, Bangalore)
Dr. Arpan Bhattacharyya (Indian Institute Of Science, Bangalore)Dr. Arpan Bhattacharyya (Indian Institute Of Science, Bangalore)
Dr. Arpan Bhattacharyya (Indian Institute Of Science, Bangalore)
 
Dynamic stiffness and eigenvalues of nonlocal nano beams
Dynamic stiffness and eigenvalues of nonlocal nano beamsDynamic stiffness and eigenvalues of nonlocal nano beams
Dynamic stiffness and eigenvalues of nonlocal nano beams
 
Wits Node Seminar: Dr Sunandan Gangopadhyay (NITheP Stellenbosch) TITLE: Path...
Wits Node Seminar: Dr Sunandan Gangopadhyay (NITheP Stellenbosch) TITLE: Path...Wits Node Seminar: Dr Sunandan Gangopadhyay (NITheP Stellenbosch) TITLE: Path...
Wits Node Seminar: Dr Sunandan Gangopadhyay (NITheP Stellenbosch) TITLE: Path...
 
Prof. Vishnu Jejjala (Witwatersrand) TITLE: "The Geometry of Generations"
Prof. Vishnu Jejjala (Witwatersrand) TITLE: "The Geometry of Generations"Prof. Vishnu Jejjala (Witwatersrand) TITLE: "The Geometry of Generations"
Prof. Vishnu Jejjala (Witwatersrand) TITLE: "The Geometry of Generations"
 
Stochastic Gravity in Conformally-flat Spacetimes
Stochastic Gravity in Conformally-flat SpacetimesStochastic Gravity in Conformally-flat Spacetimes
Stochastic Gravity in Conformally-flat Spacetimes
 
A02402001011
A02402001011A02402001011
A02402001011
 
Bethe salpeter equation
Bethe salpeter equationBethe salpeter equation
Bethe salpeter equation
 
BSE and TDDFT at work
BSE and TDDFT at workBSE and TDDFT at work
BSE and TDDFT at work
 
Complexity of exact solutions of many body systems: nonequilibrium steady sta...
Complexity of exact solutions of many body systems: nonequilibrium steady sta...Complexity of exact solutions of many body systems: nonequilibrium steady sta...
Complexity of exact solutions of many body systems: nonequilibrium steady sta...
 
Chebyshev Polynomial Based Numerical Inverse Laplace Transform Solutions of L...
Chebyshev Polynomial Based Numerical Inverse Laplace Transform Solutions of L...Chebyshev Polynomial Based Numerical Inverse Laplace Transform Solutions of L...
Chebyshev Polynomial Based Numerical Inverse Laplace Transform Solutions of L...
 
Linear response theory
Linear response theoryLinear response theory
Linear response theory
 
TwoLevelMedium
TwoLevelMediumTwoLevelMedium
TwoLevelMedium
 

Similar to Quantum Annealing for Dirichlet Process Mixture Models with Applications to Network Clustering

Metodo Monte Carlo -Wang Landau
Metodo Monte Carlo -Wang LandauMetodo Monte Carlo -Wang Landau
Metodo Monte Carlo -Wang Landau
angely alcendra
 
C024015024
C024015024C024015024
C024015024
inventionjournals
 
Estimating structured vector autoregressive models
Estimating structured vector autoregressive modelsEstimating structured vector autoregressive models
Estimating structured vector autoregressive models
Akira Tanimoto
 
A New Enhanced Method of Non Parametric power spectrum Estimation.
A New Enhanced Method of Non Parametric power spectrum Estimation.A New Enhanced Method of Non Parametric power spectrum Estimation.
A New Enhanced Method of Non Parametric power spectrum Estimation.
CSCJournals
 
On observer design methods for a
On observer design methods for aOn observer design methods for a
On observer design methods for a
csandit
 
A05920109
A05920109A05920109
A05920109
IOSR-JEN
 
Efficient Simulations for Contamination of Groundwater Aquifers under Uncerta...
Efficient Simulations for Contamination of Groundwater Aquifers under Uncerta...Efficient Simulations for Contamination of Groundwater Aquifers under Uncerta...
Efficient Simulations for Contamination of Groundwater Aquifers under Uncerta...
Alexander Litvinenko
 
Conference ppt
Conference pptConference ppt
Conference ppt
Zeeshan Khalid
 
Finite frequency H∞ control for wind turbine systems in T-S form
Finite frequency H∞ control for wind turbine systems in T-S formFinite frequency H∞ control for wind turbine systems in T-S form
Finite frequency H∞ control for wind turbine systems in T-S form
International Journal of Power Electronics and Drive Systems
 
Response Surface in Tensor Train format for Uncertainty Quantification
Response Surface in Tensor Train format for Uncertainty QuantificationResponse Surface in Tensor Train format for Uncertainty Quantification
Response Surface in Tensor Train format for Uncertainty Quantification
Alexander Litvinenko
 
Stability of Iteration for Some General Operators in b-Metric
Stability of Iteration for Some General Operators in b-MetricStability of Iteration for Some General Operators in b-Metric
Stability of Iteration for Some General Operators in b-Metric
Komal Goyal
 
A common random fixed point theorem for rational inequality in hilbert space
A common random fixed point theorem for rational inequality in hilbert spaceA common random fixed point theorem for rational inequality in hilbert space
A common random fixed point theorem for rational inequality in hilbert space
Alexander Decker
 
Existence of positive solutions for fractional q-difference equations involvi...
Existence of positive solutions for fractional q-difference equations involvi...Existence of positive solutions for fractional q-difference equations involvi...
Existence of positive solutions for fractional q-difference equations involvi...
IJRTEMJOURNAL
 
17 16512 32451-1-sm (edit ari)
17 16512 32451-1-sm (edit ari)17 16512 32451-1-sm (edit ari)
17 16512 32451-1-sm (edit ari)
IAESIJEECS
 
17 16512 32451-1-sm (edit ari)
17 16512 32451-1-sm (edit ari)17 16512 32451-1-sm (edit ari)
17 16512 32451-1-sm (edit ari)
IAESIJEECS
 
Computing the masses of hyperons and charmed baryons from Lattice QCD
Computing the masses of hyperons and charmed baryons from Lattice QCDComputing the masses of hyperons and charmed baryons from Lattice QCD
Computing the masses of hyperons and charmed baryons from Lattice QCD
Christos Kallidonis
 
On a Deterministic Property of the Category of k-almost Primes: A Determinist...
On a Deterministic Property of the Category of k-almost Primes: A Determinist...On a Deterministic Property of the Category of k-almost Primes: A Determinist...
On a Deterministic Property of the Category of k-almost Primes: A Determinist...
Ramin (A.) Zahedi
 
Adaptive Restore algorithm & importance Monte Carlo
Adaptive Restore algorithm & importance Monte CarloAdaptive Restore algorithm & importance Monte Carlo
Adaptive Restore algorithm & importance Monte Carlo
Christian Robert
 
A kernel-free particle method: Smile Problem Resolved
A kernel-free particle method: Smile Problem ResolvedA kernel-free particle method: Smile Problem Resolved
A kernel-free particle method: Smile Problem Resolved
Kaiju Capital Management
 
Radiation effects on heat and mass transfer of a mhd
Radiation effects on heat and mass transfer of a mhdRadiation effects on heat and mass transfer of a mhd
Radiation effects on heat and mass transfer of a mhd
eSAT Publishing House
 

Similar to Quantum Annealing for Dirichlet Process Mixture Models with Applications to Network Clustering (20)

Metodo Monte Carlo -Wang Landau
Metodo Monte Carlo -Wang LandauMetodo Monte Carlo -Wang Landau
Metodo Monte Carlo -Wang Landau
 
C024015024
C024015024C024015024
C024015024
 
Estimating structured vector autoregressive models
Estimating structured vector autoregressive modelsEstimating structured vector autoregressive models
Estimating structured vector autoregressive models
 
A New Enhanced Method of Non Parametric power spectrum Estimation.
A New Enhanced Method of Non Parametric power spectrum Estimation.A New Enhanced Method of Non Parametric power spectrum Estimation.
A New Enhanced Method of Non Parametric power spectrum Estimation.
 
On observer design methods for a
On observer design methods for aOn observer design methods for a
On observer design methods for a
 
A05920109
A05920109A05920109
A05920109
 
Efficient Simulations for Contamination of Groundwater Aquifers under Uncerta...
Efficient Simulations for Contamination of Groundwater Aquifers under Uncerta...Efficient Simulations for Contamination of Groundwater Aquifers under Uncerta...
Efficient Simulations for Contamination of Groundwater Aquifers under Uncerta...
 
Conference ppt
Conference pptConference ppt
Conference ppt
 
Finite frequency H∞ control for wind turbine systems in T-S form
Finite frequency H∞ control for wind turbine systems in T-S formFinite frequency H∞ control for wind turbine systems in T-S form
Finite frequency H∞ control for wind turbine systems in T-S form
 
Response Surface in Tensor Train format for Uncertainty Quantification
Response Surface in Tensor Train format for Uncertainty QuantificationResponse Surface in Tensor Train format for Uncertainty Quantification
Response Surface in Tensor Train format for Uncertainty Quantification
 
Stability of Iteration for Some General Operators in b-Metric
Stability of Iteration for Some General Operators in b-MetricStability of Iteration for Some General Operators in b-Metric
Stability of Iteration for Some General Operators in b-Metric
 
A common random fixed point theorem for rational inequality in hilbert space
A common random fixed point theorem for rational inequality in hilbert spaceA common random fixed point theorem for rational inequality in hilbert space
A common random fixed point theorem for rational inequality in hilbert space
 
Existence of positive solutions for fractional q-difference equations involvi...
Existence of positive solutions for fractional q-difference equations involvi...Existence of positive solutions for fractional q-difference equations involvi...
Existence of positive solutions for fractional q-difference equations involvi...
 
17 16512 32451-1-sm (edit ari)
17 16512 32451-1-sm (edit ari)17 16512 32451-1-sm (edit ari)
17 16512 32451-1-sm (edit ari)
 
17 16512 32451-1-sm (edit ari)
17 16512 32451-1-sm (edit ari)17 16512 32451-1-sm (edit ari)
17 16512 32451-1-sm (edit ari)
 
Computing the masses of hyperons and charmed baryons from Lattice QCD
Computing the masses of hyperons and charmed baryons from Lattice QCDComputing the masses of hyperons and charmed baryons from Lattice QCD
Computing the masses of hyperons and charmed baryons from Lattice QCD
 
On a Deterministic Property of the Category of k-almost Primes: A Determinist...
On a Deterministic Property of the Category of k-almost Primes: A Determinist...On a Deterministic Property of the Category of k-almost Primes: A Determinist...
On a Deterministic Property of the Category of k-almost Primes: A Determinist...
 
Adaptive Restore algorithm & importance Monte Carlo
Adaptive Restore algorithm & importance Monte CarloAdaptive Restore algorithm & importance Monte Carlo
Adaptive Restore algorithm & importance Monte Carlo
 
A kernel-free particle method: Smile Problem Resolved
A kernel-free particle method: Smile Problem ResolvedA kernel-free particle method: Smile Problem Resolved
A kernel-free particle method: Smile Problem Resolved
 
Radiation effects on heat and mass transfer of a mhd
Radiation effects on heat and mass transfer of a mhdRadiation effects on heat and mass transfer of a mhd
Radiation effects on heat and mass transfer of a mhd
 

More from Shu Tanaka

量子アニーリングの研究開発最前線
量子アニーリングの研究開発最前線量子アニーリングの研究開発最前線
量子アニーリングの研究開発最前線
Shu Tanaka
 
量子アニーリングのこれまでとこれから -- ハード・ソフト・アプリ三方向からの協調的展開 --
量子アニーリングのこれまでとこれから -- ハード・ソフト・アプリ三方向からの協調的展開 --量子アニーリングのこれまでとこれから -- ハード・ソフト・アプリ三方向からの協調的展開 --
量子アニーリングのこれまでとこれから -- ハード・ソフト・アプリ三方向からの協調的展開 --
Shu Tanaka
 
次世代量子情報技術 量子アニーリングが拓く新時代 -- 情報処理と物理学のハーモニー --
次世代量子情報技術 量子アニーリングが拓く新時代 -- 情報処理と物理学のハーモニー --次世代量子情報技術 量子アニーリングが拓く新時代 -- 情報処理と物理学のハーモニー --
次世代量子情報技術 量子アニーリングが拓く新時代 -- 情報処理と物理学のハーモニー --
Shu Tanaka
 
量子アニーリングを用いたクラスタ分析 (QIT32)
量子アニーリングを用いたクラスタ分析 (QIT32)量子アニーリングを用いたクラスタ分析 (QIT32)
量子アニーリングを用いたクラスタ分析 (QIT32)
Shu Tanaka
 
2次元可解量子系のエンタングルメント特性
2次元可解量子系のエンタングルメント特性2次元可解量子系のエンタングルメント特性
2次元可解量子系のエンタングルメント特性
Shu Tanaka
 
量子アニーリングを用いたクラスタ分析
量子アニーリングを用いたクラスタ分析量子アニーリングを用いたクラスタ分析
量子アニーリングを用いたクラスタ分析
Shu Tanaka
 

More from Shu Tanaka (6)

量子アニーリングの研究開発最前線
量子アニーリングの研究開発最前線量子アニーリングの研究開発最前線
量子アニーリングの研究開発最前線
 
量子アニーリングのこれまでとこれから -- ハード・ソフト・アプリ三方向からの協調的展開 --
量子アニーリングのこれまでとこれから -- ハード・ソフト・アプリ三方向からの協調的展開 --量子アニーリングのこれまでとこれから -- ハード・ソフト・アプリ三方向からの協調的展開 --
量子アニーリングのこれまでとこれから -- ハード・ソフト・アプリ三方向からの協調的展開 --
 
次世代量子情報技術 量子アニーリングが拓く新時代 -- 情報処理と物理学のハーモニー --
次世代量子情報技術 量子アニーリングが拓く新時代 -- 情報処理と物理学のハーモニー --次世代量子情報技術 量子アニーリングが拓く新時代 -- 情報処理と物理学のハーモニー --
次世代量子情報技術 量子アニーリングが拓く新時代 -- 情報処理と物理学のハーモニー --
 
量子アニーリングを用いたクラスタ分析 (QIT32)
量子アニーリングを用いたクラスタ分析 (QIT32)量子アニーリングを用いたクラスタ分析 (QIT32)
量子アニーリングを用いたクラスタ分析 (QIT32)
 
2次元可解量子系のエンタングルメント特性
2次元可解量子系のエンタングルメント特性2次元可解量子系のエンタングルメント特性
2次元可解量子系のエンタングルメント特性
 
量子アニーリングを用いたクラスタ分析
量子アニーリングを用いたクラスタ分析量子アニーリングを用いたクラスタ分析
量子アニーリングを用いたクラスタ分析
 

Recently uploaded

Taking AI to the Next Level in Manufacturing.pdf
Taking AI to the Next Level in Manufacturing.pdfTaking AI to the Next Level in Manufacturing.pdf
Taking AI to the Next Level in Manufacturing.pdf
ssuserfac0301
 
5th LF Energy Power Grid Model Meet-up Slides
5th LF Energy Power Grid Model Meet-up Slides5th LF Energy Power Grid Model Meet-up Slides
5th LF Energy Power Grid Model Meet-up Slides
DanBrown980551
 
Main news related to the CCS TSI 2023 (2023/1695)
Main news related to the CCS TSI 2023 (2023/1695)Main news related to the CCS TSI 2023 (2023/1695)
Main news related to the CCS TSI 2023 (2023/1695)
Jakub Marek
 
Y-Combinator seed pitch deck template PP
Y-Combinator seed pitch deck template PPY-Combinator seed pitch deck template PP
Y-Combinator seed pitch deck template PP
c5vrf27qcz
 
HCL Notes and Domino License Cost Reduction in the World of DLAU
HCL Notes and Domino License Cost Reduction in the World of DLAUHCL Notes and Domino License Cost Reduction in the World of DLAU
HCL Notes and Domino License Cost Reduction in the World of DLAU
panagenda
 
The Microsoft 365 Migration Tutorial For Beginner.pptx
The Microsoft 365 Migration Tutorial For Beginner.pptxThe Microsoft 365 Migration Tutorial For Beginner.pptx
The Microsoft 365 Migration Tutorial For Beginner.pptx
operationspcvita
 
Digital Banking in the Cloud: How Citizens Bank Unlocked Their Mainframe
Digital Banking in the Cloud: How Citizens Bank Unlocked Their MainframeDigital Banking in the Cloud: How Citizens Bank Unlocked Their Mainframe
Digital Banking in the Cloud: How Citizens Bank Unlocked Their Mainframe
Precisely
 
[OReilly Superstream] Occupy the Space: A grassroots guide to engineering (an...
[OReilly Superstream] Occupy the Space: A grassroots guide to engineering (an...[OReilly Superstream] Occupy the Space: A grassroots guide to engineering (an...
[OReilly Superstream] Occupy the Space: A grassroots guide to engineering (an...
Jason Yip
 
Programming Foundation Models with DSPy - Meetup Slides
Programming Foundation Models with DSPy - Meetup SlidesProgramming Foundation Models with DSPy - Meetup Slides
Programming Foundation Models with DSPy - Meetup Slides
Zilliz
 
Choosing The Best AWS Service For Your Website + API.pptx
Choosing The Best AWS Service For Your Website + API.pptxChoosing The Best AWS Service For Your Website + API.pptx
Choosing The Best AWS Service For Your Website + API.pptx
Brandon Minnick, MBA
 
Columbus Data & Analytics Wednesdays - June 2024
Columbus Data & Analytics Wednesdays - June 2024Columbus Data & Analytics Wednesdays - June 2024
Columbus Data & Analytics Wednesdays - June 2024
Jason Packer
 
Leveraging the Graph for Clinical Trials and Standards
Leveraging the Graph for Clinical Trials and StandardsLeveraging the Graph for Clinical Trials and Standards
Leveraging the Graph for Clinical Trials and Standards
Neo4j
 
Skybuffer SAM4U tool for SAP license adoption
Skybuffer SAM4U tool for SAP license adoptionSkybuffer SAM4U tool for SAP license adoption
Skybuffer SAM4U tool for SAP license adoption
Tatiana Kojar
 
Dandelion Hashtable: beyond billion requests per second on a commodity server
Dandelion Hashtable: beyond billion requests per second on a commodity serverDandelion Hashtable: beyond billion requests per second on a commodity server
Dandelion Hashtable: beyond billion requests per second on a commodity server
Antonios Katsarakis
 
June Patch Tuesday
June Patch TuesdayJune Patch Tuesday
June Patch Tuesday
Ivanti
 
9 CEO's who hit $100m ARR Share Their Top Growth Tactics Nathan Latka, Founde...
9 CEO's who hit $100m ARR Share Their Top Growth Tactics Nathan Latka, Founde...9 CEO's who hit $100m ARR Share Their Top Growth Tactics Nathan Latka, Founde...
9 CEO's who hit $100m ARR Share Their Top Growth Tactics Nathan Latka, Founde...
saastr
 
zkStudyClub - LatticeFold: A Lattice-based Folding Scheme and its Application...
zkStudyClub - LatticeFold: A Lattice-based Folding Scheme and its Application...zkStudyClub - LatticeFold: A Lattice-based Folding Scheme and its Application...
zkStudyClub - LatticeFold: A Lattice-based Folding Scheme and its Application...
Alex Pruden
 
GraphRAG for Life Science to increase LLM accuracy
GraphRAG for Life Science to increase LLM accuracyGraphRAG for Life Science to increase LLM accuracy
GraphRAG for Life Science to increase LLM accuracy
Tomaz Bratanic
 
Freshworks Rethinks NoSQL for Rapid Scaling & Cost-Efficiency
Freshworks Rethinks NoSQL for Rapid Scaling & Cost-EfficiencyFreshworks Rethinks NoSQL for Rapid Scaling & Cost-Efficiency
Freshworks Rethinks NoSQL for Rapid Scaling & Cost-Efficiency
ScyllaDB
 
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdfHow to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
Chart Kalyan
 

Recently uploaded (20)

Taking AI to the Next Level in Manufacturing.pdf
Taking AI to the Next Level in Manufacturing.pdfTaking AI to the Next Level in Manufacturing.pdf
Taking AI to the Next Level in Manufacturing.pdf
 
5th LF Energy Power Grid Model Meet-up Slides
5th LF Energy Power Grid Model Meet-up Slides5th LF Energy Power Grid Model Meet-up Slides
5th LF Energy Power Grid Model Meet-up Slides
 
Main news related to the CCS TSI 2023 (2023/1695)
Main news related to the CCS TSI 2023 (2023/1695)Main news related to the CCS TSI 2023 (2023/1695)
Main news related to the CCS TSI 2023 (2023/1695)
 
Y-Combinator seed pitch deck template PP
Y-Combinator seed pitch deck template PPY-Combinator seed pitch deck template PP
Y-Combinator seed pitch deck template PP
 
HCL Notes and Domino License Cost Reduction in the World of DLAU
HCL Notes and Domino License Cost Reduction in the World of DLAUHCL Notes and Domino License Cost Reduction in the World of DLAU
HCL Notes and Domino License Cost Reduction in the World of DLAU
 
The Microsoft 365 Migration Tutorial For Beginner.pptx
The Microsoft 365 Migration Tutorial For Beginner.pptxThe Microsoft 365 Migration Tutorial For Beginner.pptx
The Microsoft 365 Migration Tutorial For Beginner.pptx
 
Digital Banking in the Cloud: How Citizens Bank Unlocked Their Mainframe
Digital Banking in the Cloud: How Citizens Bank Unlocked Their MainframeDigital Banking in the Cloud: How Citizens Bank Unlocked Their Mainframe
Digital Banking in the Cloud: How Citizens Bank Unlocked Their Mainframe
 
[OReilly Superstream] Occupy the Space: A grassroots guide to engineering (an...
[OReilly Superstream] Occupy the Space: A grassroots guide to engineering (an...[OReilly Superstream] Occupy the Space: A grassroots guide to engineering (an...
[OReilly Superstream] Occupy the Space: A grassroots guide to engineering (an...
 
Programming Foundation Models with DSPy - Meetup Slides
Programming Foundation Models with DSPy - Meetup SlidesProgramming Foundation Models with DSPy - Meetup Slides
Programming Foundation Models with DSPy - Meetup Slides
 
Choosing The Best AWS Service For Your Website + API.pptx
Choosing The Best AWS Service For Your Website + API.pptxChoosing The Best AWS Service For Your Website + API.pptx
Choosing The Best AWS Service For Your Website + API.pptx
 
Columbus Data & Analytics Wednesdays - June 2024
Columbus Data & Analytics Wednesdays - June 2024Columbus Data & Analytics Wednesdays - June 2024
Columbus Data & Analytics Wednesdays - June 2024
 
Leveraging the Graph for Clinical Trials and Standards
Leveraging the Graph for Clinical Trials and StandardsLeveraging the Graph for Clinical Trials and Standards
Leveraging the Graph for Clinical Trials and Standards
 
Skybuffer SAM4U tool for SAP license adoption
Skybuffer SAM4U tool for SAP license adoptionSkybuffer SAM4U tool for SAP license adoption
Skybuffer SAM4U tool for SAP license adoption
 
Dandelion Hashtable: beyond billion requests per second on a commodity server
Dandelion Hashtable: beyond billion requests per second on a commodity serverDandelion Hashtable: beyond billion requests per second on a commodity server
Dandelion Hashtable: beyond billion requests per second on a commodity server
 
June Patch Tuesday
June Patch TuesdayJune Patch Tuesday
June Patch Tuesday
 
9 CEO's who hit $100m ARR Share Their Top Growth Tactics Nathan Latka, Founde...
9 CEO's who hit $100m ARR Share Their Top Growth Tactics Nathan Latka, Founde...9 CEO's who hit $100m ARR Share Their Top Growth Tactics Nathan Latka, Founde...
9 CEO's who hit $100m ARR Share Their Top Growth Tactics Nathan Latka, Founde...
 
zkStudyClub - LatticeFold: A Lattice-based Folding Scheme and its Application...
zkStudyClub - LatticeFold: A Lattice-based Folding Scheme and its Application...zkStudyClub - LatticeFold: A Lattice-based Folding Scheme and its Application...
zkStudyClub - LatticeFold: A Lattice-based Folding Scheme and its Application...
 
GraphRAG for Life Science to increase LLM accuracy
GraphRAG for Life Science to increase LLM accuracyGraphRAG for Life Science to increase LLM accuracy
GraphRAG for Life Science to increase LLM accuracy
 
Freshworks Rethinks NoSQL for Rapid Scaling & Cost-Efficiency
Freshworks Rethinks NoSQL for Rapid Scaling & Cost-EfficiencyFreshworks Rethinks NoSQL for Rapid Scaling & Cost-Efficiency
Freshworks Rethinks NoSQL for Rapid Scaling & Cost-Efficiency
 
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdfHow to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
 

Quantum Annealing for Dirichlet Process Mixture Models with Applications to Network Clustering

  • 1. Quantum Annealing for Dirichlet Process Mixture Models with Applications to Network Clustering Issei Sato, Shu Tanaka, Kenichi Kurihara, Seiji Miyashita, and Hiroshi Nakagawa Neurocomputing 121, 523 (2013)
  • 2. Main Results Diff. of log-likelihood Better We considered the efficiency of quantum annealing method for Dirichlet process mixture models. In this study, Monte Carlo simulation was performed. 21300 Wikivote 21200 21100 21000 2.5 3 3.5 4 4.5 5 0 - We constructed a method to apply quantum annealing to network clustering. - Quantum annealing succeeded to obtain a better solution than conventional methods. - The number of classes can be changed. (cf. K. Kurihara et al. and I. Sato et al., UAI2009) K. Kurihara et al., I. Sato et al., Proceedings of UAI2009.
  • 3. Background Optimization problem To find the state (best solution) where the real-valued cost function is minimized. If the size of problem is small, we can easily obtain the best solution by brute-force calculation. However... if the size of problem is large, we cannot obtain the best solution by brute-force calculation in practice. We should develop methods to obtain the best solution (at least, better solution) efficiently.
  • 4. Background Cost function of most optimization problems can be represented by Hamiltonian of classical discrete spin systems. We can use the knowledge of statistical physics. To find the state where the cost function is minimized. To find the ground state of the Hamiltonian. Simulated annealing (SA) By decreasing the temperature (thermal fluctuation) gradually, the ground state of the Hamiltonian is obtained. S. Kirkpatrick, C. D. Gelatte, and M. P. Vecchi, Science, 220, 671 (1983). SA can be adopted to both stochastic methods such as Monte Carlo method and deterministic method.
  • 5. Background Quantum annealing (QA) By decreasing the quantum fluctuation gradually, the ground state of the Hamiltonian is obtained. T. Kadowaki and H. Nishimori, Phys. Rev. E, 58, 5355 (1998). E. Farhi, J. Goldstone, S. Gutmann, J. Lapan, A. Lundgren, and D. Preda, Science, 292, 472 (2001). G. E. Santoro, R. Martonak, E. Tosatti, and R. Car, Science, 295, 2427 (2002). Review articles G. E. Santoro and E. Tosatti, J. Phys. A: Math. Gen., 39, R393 (2006). A. Das and B. K. Chakrabarti, Rev. Mod. Phys., 80, 1061 (2008). S. Tanaka and R. Tamura, Kinki University Series on Quantum Computing Series "Lectures on Quantum Computing, Thermodynamics and Statistical Physics" (2012). QA is better than SA?
  • 7. Chinese Restaurant Process (CRP) Table (data class) Restaurant (entire set) 1 1 2 3 2 4 5 3 Customer (data point) Chinese Restaurant Process (CRP) assigns a probability for the seating arrangement of the customers.
  • 8. Chinese Restaurant Process (CRP) Seating arrangement of the customers: Z = customer i sits at the k-th table: zi = k N {zi }i=1 N: the number of customers When customer i enters a restaurant with K occupied tables at which other customers are already seated, customer i sits at a table with the following probability: (k-th occupied table) +N 1 p(zi |Zzi ; ) Nk +N 1 (new unoccupied table) Nk: the number of customers sitting at the k-th table : hyper parameter of the CRP The log-likelihood of Z is given by p(Z) = K(Z) K(Z) N =1 (N + ) (Nk k=1 1)!
  • 10. Quantum annealing for CRP (QACRP) QACRP uses multiple restaurants (m restaurants). customer i sits at the k-th table in the j-th restaurant: zj,i = k Seating arrangement of the customers in the j-th restaurant: Zj = {zj,i } In the j-th restaurant, when customer i enters a restaurant with K occupied tables at which other customers are already seated, customer i sits at a table with the following probability: Nj,k +N 1 /m (k-th occupied table) m pQA (zj,i | {Zd }d=1 {zj,i } ; , ) e (cj,k (i)+c+ (i))f ( , ) j,k /m +N 1 : inverse temperature (thermal fluctuation) : quantum fluctuation (new unoccupied table)
  • 11. Quantum annealing for CRP (QACRP) /m Nj,k +N 1 e (cj,k (i)+c+ (i))f ( , ) j,k (k-th occupied table) m pQA (zj,i | {Zd }d=1 {zj,i } ; , ) /m (new unoccupied table) +N 1 c± (i) : the number of customers who sit at the k-th table in the j-th j,k restaurant and share tables with customer i in the (j ± 1)-th restaurant. j-1-th CRP 1 1 2 j+1-th CRP j-th CRP 3 2 4 5 3 1 1 4 3 2 5 3 2 1 3 4 1 2 5 2 The above fact will be proven in the following. 3
  • 12. Quantum annealing for CRP (QACRP) Bit matrix representation for CRP A bit matrix B : adjacency matrix of customers 1 1 2 3 1 2 4 3 5 4 5 B Seating conditions ˜ 2 3 4 5 1 1 0 1 0 1 1 0 1 0 0 0 1 0 1 1 1 0 1 0 0 0 1 0 1 = N i=1 N n=1 ˜i,n Bi,n = Bn,i Bi,i = 1 (i = 1, 2, · · · , N ) i, , Bi /|Bi | · B /|B | = 1 or 0 Sitting arrangement can be represented by the Ising model with constraints.
  • 13. Quantum annealing for CRP (QACRP) Bit matrix representation for CRP 1 1 2 4 3 2 2 1 2 1 1 0 1 0 0 customers who share a 1 0 table with customer 2. 1 4 3 3 4 5 5 1 1 1 1 0 1 0 0 1 0 0 0 1 1 0 1 1 0 1 0 0 1 0 0 0 0 0 0 a set of the states that customer 2 can take under the seating conditions. 3 4 5 1 1 0 1 0 1 1 0 1 0 0 0 1 0 1 1 1 0 1 0 0 0 1 0 1 1 1 5 2 2 3 4 5 1 0 1 0 0 1 0 1 0 1 0 1 0 1 0 1 2 3 4 5
  • 14. Quantum annealing for CRP (QACRP) Density matrix representation for “classical” CRP Hc = diag[E( E( ( ) )= p( ) = (1) ), E( ln p( ( ) (2) ) + T e ), · · · E( ( ) T e Hc =: T ) )] ˜ ( ) Hc (2 N2 ˜ e Hc Zc Sitting arrangement can be represented by the Ising model with constraints.
  • 15. Quantum annealing for CRP (QACRP) Formulation for quantum CRP H = Hc + Hq Hc : classical CRP Hq : quantum fluctuation T pQA ( ; , ) = Classical CRP p(˜i | ˜i ) = p(zi |Zzi ; ) e (Hc +Hq ) Te T ˜i e (Hc +Hq ) Hc T e Hc Nk +N 1 (k-th occupied table) +N 1 (new unoccupied table)
  • 16. Quantum annealing for CRP (QACRP) Formulation for quantum CRP H = Hc + Hq Hc : classical CRP Hq : quantum fluctuation T pQA ( ; , ) = e (Hc +Hq ) Te Quantum CRP (Hc +Hq ) T pQA (˜i | ˜i ; , ) = ˜i e (Hc +Hq ) Te (Hc +Hq ) Transverse field as a quantum fluctuation N Hq = N x i,n , i=1 n=1 E= 1 0 0 1 , x = 0 1 1 0
  • 17. Quantum annealing for CRP (QACRP) Approximation inference for QACRP T pQA ( ; , ) = e (Hc +Hq ) Te = (Hc +Hq ) pQA j (j ST ( , 2) 2, · · · m pQA ST ( 1 , 2, · · · , m; , )= N j+1 ) e , E( j=1 f ( , ) = 2 ln coth s( j , By the Suzuki-Trotter decomposition, pQA can be approximately expressed by the classical CRP. m; , )+O ef ( , )s( Z( , ) j )/m m N (˜j,i,n , ˜j+1,i,n ) = i=1 n=1 2N Z( , ) = sinh m e E( ) m 2 m j , j+1 )
  • 18. Experiments Network model & dataset Citeseer citation network dataset for 2110 papers. 527 I. Sato et al. / Neurocomputing 121 (2013) 523–531 . (a) Social network (assortive network), (b) election network (disassortative network) and (c) citation network (mixture of assortative ning CRPs in which sj ðj ¼ 1; …; mÞ ment of the j-th CRP and represents ~ espond Bj;i;n ¼ 1 to s j;i;n ¼ ð1; 0Þ⊤ and means that we can represent Bj as the following121 (2013) 523–531 eurocomputing theorem: (10) is approximated by the Suzuki– ! β2 …; sm ; β; ΓÞ þ O ; m 1 e−β=mEðsj Þ ef ðβ;ΓÞsðsj ;sjþ1 Þ ; ¼ 1 Zðβ; ΓÞ ð15Þ m ∏ ð16Þ Netscience coauthorship network of regarded as a similarity function between the j-th and (j+1)-th bit matrices. If they are the same matrices, then sðs ; s Þ ¼ N . In scientists working on a network Eq. (2), log p ðs Þ corresponds to log e =Z and the regularizer term f Á Rðs ; …; s Þ is log ∏ e ¼ f ðβ; sðs ; s Þ. thatΓÞ∑ inference for scientists. has 1589 Note that we aim at deriving the approximation SA 1 −β=mEðsj Þ j m m f ðβ;ΓÞsðsj ;sjþ1 Þ j¼1 527 j 2 jþ1 m j¼1 j jþ1 pQA ðs i jss i ; β; ΓÞ in Eq. (13). Using Theorem 3.1, we can derive ~ ~ Eq. (4) as the approximation inference. The details of the derivation are provided in Appendix B. Wikivote a bipertite network constructed 4. Experiments using QA to a DPM We evaluated QA in a real application. We applied administrator elections. model for clustering vertices in a network where a seating 7115 Wikipedia users. arrangement of the CRP indicates a network partition. ples of network structures. (a) Social network (assortive network), (b) election network (disassortative network) and (c) citation network (mixture of assortative
  • 19. Experiments Annealing schedule m : Trotter number, the number of replicas; m = 16 We tested several schedules of inverse temperature. ln(1 + t) 0 t 0t 0 = 0 = 0.2m, 0.4m, 0.6m t : t-th iteration. = 0.4m t is a better schedule in SA (MAP estimation). T = 0 m t is a schedule of quantum fluctuation. T : Total number of iterations
  • 20. Diff. of log-likelihood Better Results 21300 Wikivote 21200 21100 21000 2.5 3 3.5 4 4.5 0 Lmax : the maximum log-likelihood of the beam search Beam Lmax : the maximum log-likelihood of 16 CRPs in SA 16SAs 5
  • 21. Diff. of log-likelihood Results Citeseer 1600 1400 1200 Diff. of log-likelihood 1.5 2.5 3 Netscience We consider multiple running CRPs in which sj ðj ¼ 1; …; mÞ indicates the seating arrangement of the j-th CRP and represents ~ the j-th bit matrix Bj . We correspond Bj;i;n ¼ 1 to s j;i;n ¼ ð1; 0Þ⊤ and ⊤ Bj;i;n ¼ 0 to s j;i;n ¼ ð0; 1Þ , which means that we can represent Bj as ~ sj by using Eq. (5). We derive the following theorem: 600 500 1 Theorem 3.1. Sato ðs;al. ΓÞ in Eq. (10) is approximated by the Suzuki– I. pQA et β; / Neurocomputing 121 (2013) 523–531 Trotter expansion as2.5 follows: 3 1.5 2 0 pQA ðs; β; ΓÞ ¼ 21300 1 ⊤ −βðHc þHq Þ s e s Z Wikivote ¼ ∑ pQA−ST ðs; s2 ; …; sm ; β; ΓÞ þ O sj ðj≥2Þ 21200 2 ! β ; m pQA−ST ðs1 ; s2 ; …; sm ; β; ΓÞ 4. Experiments ð16Þ We evaluated QA in a real application. We applied QA to a DP model for clustering vertices in a network where a seati arrangement of the CRP indicates a network partition. 2.5 1 e−β=mEðsj Þ ef ðβ;ΓÞsðsj ;sjþ1 Þ ; Zðβ; ΓÞ j¼1 m ¼ ∏ regarded as a similarity function between the j-th and (j+1)-th matrices. If they are the same matrices, then sðsj ; sjþ1 Þ ¼ N 2 . Eq. (2), log pSA ðsj Þ corresponds to log e−β=mEðsj Þ =Z and the regulari term f Á Rðs1 ; …; sm Þ is log ∏m 1 ef ðβ;ΓÞsðsj ;sjþ1 Þ ¼ f ðβ; ΓÞ∑m 1 sðsj ; sjþ j¼ j¼ Note that we aim at deriving the approximation inference pQA ðs i jss i ; β; ΓÞ in Eq. (13). Using Theorem 3.1, we can der ~ ~ 527 Eq. (4) as the approximation inference. The details of the deriv tion are provided in Appendix B. ð15Þ where we rewrite s as s1 , and 21100 21000 I. Sato et al. / Neurocomputing 121 (2013) 523–531 3.5 Fig. 5. Examples of network structures. (a) Social network (assortive network), (b) election network (disassortative network) and (c) citation network (mixture of assorta and disassortative network). 0 700 400 Diff. of log-likelihood 2 Better solution can be obtained by QA. β Γ ; ð17Þ f ðβ; ΓÞ ¼ 2 Fig. 5. Examples of network structures. (a) Social network (assortive network), (b) election network (disassortative network) and (c) citation netwo log coth m 4.1. Network model and disassortative network). 3 3.5 4 N 4.5 5 N ~ ~ sðsj ; sjþ1 Þ ¼ 0∑ ∑ δðs j;i;n ; s jþ1;i;n Þ; ð18Þ We used the Newman model [17] for network modeling in t
  • 22. Diff. of log-likelihood Results Citeseer 1600 SA(T=30,m=1) 13 sec. calc. time QA(T=30,m=16) 15 sec. 1400 16 SAs 1200 1600 SAs beam search QA(m=16) 35 30 57 37 # classes 1.5 2 2.5 3 3.5 Diff. of log-likelihood 0 700 SA(T=30,m=1) calc. time 600 25 sec. 16 SAs 500 400 QA(T=30,m=16) 22 sec. Netscience 1600 SAs beam search QA(m=16) 22 65 61 26 # classes 1 1.5 2 2.5 3 Diff. of log-likelihood 0 21300 SA(T=30,m=1) calc. time 21200 79 sec. 16 SAs 21100 21000 QA(T=30,m=16) 76 sec. Wikivote # classes 2.5 3 3.5 4 0 4.5 5 1600 SAs beam search QA(m=16) 8 8 27 8
  • 23. Main Results Diff. of log-likelihood Better We considered the efficiency of quantum annealing method for Dirichlet process mixture models. In this study, Monte Carlo simulation was performed. 21300 Wikivote 21200 21100 21000 2.5 3 3.5 4 4.5 5 0 - We constructed a method to apply quantum annealing to network clustering. - Quantum annealing succeeded to obtain a better solution than conventional methods. - The number of classes can be changed. (cf. K. Kurihara et al. and I. Sato et al., UAI2009) K. Kurihara et al., I. Sato et al., Proceedings of UAI2009.
  • 24. Thank you ! Issei Sato, Shu Tanaka, Kenichi Kurihara, Seiji Miyashita, and Hiroshi Nakagawa Neurocomputing 121, 523 (2013)