SlideShare a Scribd company logo
1 of 38
Download to read offline
-           -




MATSUURA Satoshi
matsuura@is.naist.jp




         1
2
3
20%   35%       85%




            4
P (C|D)

D
    C       P


        5
P (C|D)




      6
7
P (D|C)P (C)
P (C|D) =
              P (D)



          8
9
P (CD)

D
    C


        10
P (CD) = P (C|D)P (D)
           = P (D|C)P (C)

•   D                 C        x   D
            P (C|D)                    P (D)

•       C             D        x       C
            P (D|C)                    P (C)

                          11
P (D|C)P (C)
P (C|D) =
              P (D)



          12
P (D|C)P (C)
P (C|D) =
              P (D)


P (D)
        P (C|D)



                  13
P (D|C)P (C)
P (C|D) =
              P (D)


 P (C)       C
    C                    /



            14
P (D|C)P (C)
   P (C|D) =
                 P (D)


    P (D|C)       C
              D

P (D|C) =

                  15
16
D


P (D|C)


          17
bag of words



    18
ick
                 -k 0




                        FIFA
      hat
           relew nder-2
         f ye lo u c
     Con fed er        ar d    tric
                                   k
      goal       at i on s
           ke hooligan
       off    ep er
                      nte ring
             s i d ce
                  e goal




19
P (D|C) =

            P (W1|C)P (W2|C) · · · P (Wn|C)


       P (Wi|C) =             Wi




             D            W




                     20
21
P (D|C)P (C)
        P (C|D) =
                      P (D)
    P (D|C)  P (W1 |C)P (W2 |C) · · · P (Wn |C)
                              P (Wi|C) =       Wi




•
    ★                           (          )
    ★

                         22
Wa
    Wb
    Wc
    Wx
    Wy




         Wa Wy                Wx
                                    Wc
          Wb Wb               Wa             W     W
W                                                W W   W W
                                             W
          bag of words        bag of words




                         23
bag of words




               24
25
Wa Wz
 Wy Wb
 bag of words




26
Wa Wz            Wa
         Wy Wb           Wb
         bag of words    Wc
                         Wx
                         Wy



                  4
P (Cs )P (D|Cs )  P (Wa |Cs )P (Wb |Cs )P (Wy |Cs )P (Wz |Cs )
                  7
                  4 1 2 1 0
                 = × × × × )                Wz
                  7 4 4 4 4
                 =0




                              27
28
29
Wnew
P (Wnew |C)



P (Wnew |C) =
                ×
                                popfile




                    Wi
  P (Wi|C) =

                           Wi    α
           →
                                 α×


                α



                           30
popfile




         31
Wa Wz                  Wa
                Wy Wb                 Wb
                bag of words          Wc
                                      Wx
                                      Wy




                                                               4
                                            P (Cs )P (D|Cs )  P (Wa |Cs )P (Wb |Cs )P (Wy |Cs )P (Wz |Cs )
                                                               7
                                                               4 1 2 1              1
                                                             = × × × ×                  )
                                                               7 4 4 4 10 × 7
                                                                 1
                                                             =
                                                               3920



                                                               3
                                            P (Cp )P (D|Cp )  P (Wa |Cp )P (Wb |Cp )P (Wy |Cp )P (Wz |Cp )
                                                               7
                                                               3 1        1          1          1
                                                             = × ×            ×          ×         )
                                                               7 3 10 × 7 10 × 7 10 × 7
                                                                  1
P (Cs )P (D|Cs )  P (Cp )P (D|Cp )                          =
                                                               2401000


                                           32
33
34
35
36
DEMO




 37
•                               (          )

    •     Web+DB vol.56 p.134-142,                  , May. 2010.

•   4.2

    •                                          , p.101-117,         , Aug, 2010.

•                                                          (                       )

    •     http://gihyo.jp/dev/serial/01/machine-learning/0003
•

    •     http://d.hatena.ne.jp/kogecoo/20091103/1257281433
•                                               (               )

    •     http://homepage3.nifty.com/DO/ensyu3_class2.pdf

                                                         38

More Related Content

What's hot

What's hot (20)

Clustering in Hilbert simplex geometry
Clustering in Hilbert simplex geometryClustering in Hilbert simplex geometry
Clustering in Hilbert simplex geometry
 
1 ESO - Unit 04 - Exercises 1.4.2. - Adding and Subtracting Integers
1 ESO - Unit 04 - Exercises 1.4.2. - Adding and Subtracting Integers1 ESO - Unit 04 - Exercises 1.4.2. - Adding and Subtracting Integers
1 ESO - Unit 04 - Exercises 1.4.2. - Adding and Subtracting Integers
 
Bregman Voronoi Diagrams (SODA 2007)
Bregman Voronoi Diagrams (SODA 2007)  Bregman Voronoi Diagrams (SODA 2007)
Bregman Voronoi Diagrams (SODA 2007)
 
Graph Edit Distance: Basics & Trends
Graph Edit Distance: Basics & TrendsGraph Edit Distance: Basics & Trends
Graph Edit Distance: Basics & Trends
 
Computational Information Geometry: A quick review (ICMS)
Computational Information Geometry: A quick review (ICMS)Computational Information Geometry: A quick review (ICMS)
Computational Information Geometry: A quick review (ICMS)
 
Distributed Support Vector Machines
Distributed Support Vector MachinesDistributed Support Vector Machines
Distributed Support Vector Machines
 
Hat04 0205
Hat04 0205Hat04 0205
Hat04 0205
 
445 colouring0
445 colouring0445 colouring0
445 colouring0
 
1 ESO - Unit 04 - Exercises 1.4.3. - Integer Multiplication and Division.
1  ESO - Unit 04 - Exercises 1.4.3. - Integer Multiplication and Division.1  ESO - Unit 04 - Exercises 1.4.3. - Integer Multiplication and Division.
1 ESO - Unit 04 - Exercises 1.4.3. - Integer Multiplication and Division.
 
Clustering in Hilbert geometry for machine learning
Clustering in Hilbert geometry for machine learningClustering in Hilbert geometry for machine learning
Clustering in Hilbert geometry for machine learning
 
Nodal Domain Theorem for the p-Laplacian on Graphs and the Related Multiway C...
Nodal Domain Theorem for the p-Laplacian on Graphs and the Related Multiway C...Nodal Domain Theorem for the p-Laplacian on Graphs and the Related Multiway C...
Nodal Domain Theorem for the p-Laplacian on Graphs and the Related Multiway C...
 
Graph kernels
Graph kernelsGraph kernels
Graph kernels
 
Slides: The dual Voronoi diagrams with respect to representational Bregman di...
Slides: The dual Voronoi diagrams with respect to representational Bregman di...Slides: The dual Voronoi diagrams with respect to representational Bregman di...
Slides: The dual Voronoi diagrams with respect to representational Bregman di...
 
The Digital Image Processing Q@A
The Digital Image Processing Q@AThe Digital Image Processing Q@A
The Digital Image Processing Q@A
 
Divergence center-based clustering and their applications
Divergence center-based clustering and their applicationsDivergence center-based clustering and their applications
Divergence center-based clustering and their applications
 
Slides: Total Jensen divergences: Definition, Properties and k-Means++ Cluste...
Slides: Total Jensen divergences: Definition, Properties and k-Means++ Cluste...Slides: Total Jensen divergences: Definition, Properties and k-Means++ Cluste...
Slides: Total Jensen divergences: Definition, Properties and k-Means++ Cluste...
 
Small updates of matrix functions used for network centrality
Small updates of matrix functions used for network centralitySmall updates of matrix functions used for network centrality
Small updates of matrix functions used for network centrality
 
Optimal L-shaped matrix reordering, aka graph's core-periphery
Optimal L-shaped matrix reordering, aka graph's core-peripheryOptimal L-shaped matrix reordering, aka graph's core-periphery
Optimal L-shaped matrix reordering, aka graph's core-periphery
 
Divergence clustering
Divergence clusteringDivergence clustering
Divergence clustering
 
Complexity Classes and the Graph Isomorphism Problem
Complexity Classes and the Graph Isomorphism ProblemComplexity Classes and the Graph Isomorphism Problem
Complexity Classes and the Graph Isomorphism Problem
 

Similar to 分類器 (ナイーブベイズ)

Triangle counting handout
Triangle counting handoutTriangle counting handout
Triangle counting handout
csedays
 
Link-based document classification using Bayesian Networks
Link-based document classification using Bayesian NetworksLink-based document classification using Bayesian Networks
Link-based document classification using Bayesian Networks
Alfonso E. Romero
 
Teknik Menjawab Kertas 1 Matematik Tambahan
Teknik Menjawab Kertas 1 Matematik TambahanTeknik Menjawab Kertas 1 Matematik Tambahan
Teknik Menjawab Kertas 1 Matematik Tambahan
Zefry Hanif
 

Similar to 分類器 (ナイーブベイズ) (20)

0209 ch 2 day 9
0209 ch 2 day 90209 ch 2 day 9
0209 ch 2 day 9
 
Ml4nlp04 1
Ml4nlp04 1Ml4nlp04 1
Ml4nlp04 1
 
Triangle counting handout
Triangle counting handoutTriangle counting handout
Triangle counting handout
 
Cpt 2009 qa
Cpt 2009 qaCpt 2009 qa
Cpt 2009 qa
 
Naive Bayesian Text Classifier Event Models
Naive Bayesian Text Classifier Event ModelsNaive Bayesian Text Classifier Event Models
Naive Bayesian Text Classifier Event Models
 
Query Suggestion @ tokyotextmining#2
Query Suggestion @ tokyotextmining#2Query Suggestion @ tokyotextmining#2
Query Suggestion @ tokyotextmining#2
 
Link-based document classification using Bayesian Networks
Link-based document classification using Bayesian NetworksLink-based document classification using Bayesian Networks
Link-based document classification using Bayesian Networks
 
Modeling Transformations
Modeling TransformationsModeling Transformations
Modeling Transformations
 
Comparing estimation algorithms for block clustering models
Comparing estimation algorithms for block clustering modelsComparing estimation algorithms for block clustering models
Comparing estimation algorithms for block clustering models
 
近似ベイズ計算によるベイズ推定
近似ベイズ計算によるベイズ推定近似ベイズ計算によるベイズ推定
近似ベイズ計算によるベイズ推定
 
Triggering patterns of topology changes in dynamic attributed graphs
Triggering patterns of topology changes in dynamic attributed graphsTriggering patterns of topology changes in dynamic attributed graphs
Triggering patterns of topology changes in dynamic attributed graphs
 
NTHU AI Reading Group: Improved Training of Wasserstein GANs
NTHU AI Reading Group: Improved Training of Wasserstein GANsNTHU AI Reading Group: Improved Training of Wasserstein GANs
NTHU AI Reading Group: Improved Training of Wasserstein GANs
 
Model Selection with Piecewise Regular Gauges
Model Selection with Piecewise Regular GaugesModel Selection with Piecewise Regular Gauges
Model Selection with Piecewise Regular Gauges
 
Testing for mixtures at BNP 13
Testing for mixtures at BNP 13Testing for mixtures at BNP 13
Testing for mixtures at BNP 13
 
Integral
IntegralIntegral
Integral
 
Probabilistic Retrieval
Probabilistic RetrievalProbabilistic Retrieval
Probabilistic Retrieval
 
確率伝播その2
確率伝播その2確率伝播その2
確率伝播その2
 
0208 ch 2 day 8
0208 ch 2 day 80208 ch 2 day 8
0208 ch 2 day 8
 
Low Complexity Regularization of Inverse Problems
Low Complexity Regularization of Inverse ProblemsLow Complexity Regularization of Inverse Problems
Low Complexity Regularization of Inverse Problems
 
Teknik Menjawab Kertas 1 Matematik Tambahan
Teknik Menjawab Kertas 1 Matematik TambahanTeknik Menjawab Kertas 1 Matematik Tambahan
Teknik Menjawab Kertas 1 Matematik Tambahan
 

Recently uploaded

Architecting Cloud Native Applications
Architecting Cloud Native ApplicationsArchitecting Cloud Native Applications
Architecting Cloud Native Applications
WSO2
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
panagenda
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Safe Software
 

Recently uploaded (20)

Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodPolkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
 
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWEREMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
 
Navi Mumbai Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Navi Mumbai Call Girls 🥰 8617370543 Service Offer VIP Hot ModelNavi Mumbai Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Navi Mumbai Call Girls 🥰 8617370543 Service Offer VIP Hot Model
 
AWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of Terraform
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
 
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingRepurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
 
AXA XL - Insurer Innovation Award Americas 2024
AXA XL - Insurer Innovation Award Americas 2024AXA XL - Insurer Innovation Award Americas 2024
AXA XL - Insurer Innovation Award Americas 2024
 
Architecting Cloud Native Applications
Architecting Cloud Native ApplicationsArchitecting Cloud Native Applications
Architecting Cloud Native Applications
 
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
 
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
 
Apidays Singapore 2024 - Modernizing Securities Finance by Madhu Subbu
Apidays Singapore 2024 - Modernizing Securities Finance by Madhu SubbuApidays Singapore 2024 - Modernizing Securities Finance by Madhu Subbu
Apidays Singapore 2024 - Modernizing Securities Finance by Madhu Subbu
 
Artificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyArtificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : Uncertainty
 
A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?
 
FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
 
A Beginners Guide to Building a RAG App Using Open Source Milvus
A Beginners Guide to Building a RAG App Using Open Source MilvusA Beginners Guide to Building a RAG App Using Open Source Milvus
A Beginners Guide to Building a RAG App Using Open Source Milvus
 
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
Manulife - Insurer Transformation Award 2024
Manulife - Insurer Transformation Award 2024Manulife - Insurer Transformation Award 2024
Manulife - Insurer Transformation Award 2024
 
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
 

分類器 (ナイーブベイズ)

  • 1. - - MATSUURA Satoshi matsuura@is.naist.jp 1
  • 2. 2
  • 3. 3
  • 4. 20% 35% 85% 4
  • 5. P (C|D) D C P 5
  • 7. 7
  • 8. P (D|C)P (C) P (C|D) = P (D) 8
  • 9. 9
  • 10. P (CD) D C 10
  • 11. P (CD) = P (C|D)P (D) = P (D|C)P (C) • D C x D P (C|D) P (D) • C D x C P (D|C) P (C) 11
  • 12. P (D|C)P (C) P (C|D) = P (D) 12
  • 13. P (D|C)P (C) P (C|D) = P (D) P (D) P (C|D) 13
  • 14. P (D|C)P (C) P (C|D) = P (D) P (C) C C / 14
  • 15. P (D|C)P (C) P (C|D) = P (D) P (D|C) C D P (D|C) = 15
  • 16. 16
  • 17. D P (D|C) 17
  • 19. ick -k 0 FIFA hat relew nder-2 f ye lo u c Con fed er ar d tric k goal at i on s ke hooligan off ep er nte ring s i d ce e goal 19
  • 20. P (D|C) = P (W1|C)P (W2|C) · · · P (Wn|C) P (Wi|C) = Wi D W 20
  • 21. 21
  • 22. P (D|C)P (C) P (C|D) = P (D) P (D|C) P (W1 |C)P (W2 |C) · · · P (Wn |C) P (Wi|C) = Wi • ★ ( ) ★ 22
  • 23. Wa Wb Wc Wx Wy Wa Wy Wx Wc Wb Wb Wa W W W W W W W W bag of words bag of words 23
  • 25. 25
  • 26. Wa Wz Wy Wb bag of words 26
  • 27. Wa Wz Wa Wy Wb Wb bag of words Wc Wx Wy 4 P (Cs )P (D|Cs ) P (Wa |Cs )P (Wb |Cs )P (Wy |Cs )P (Wz |Cs ) 7 4 1 2 1 0 = × × × × ) Wz 7 4 4 4 4 =0 27
  • 28. 28
  • 29. 29
  • 30. Wnew P (Wnew |C) P (Wnew |C) = × popfile Wi P (Wi|C) = Wi α → α× α 30
  • 31. popfile 31
  • 32. Wa Wz Wa Wy Wb Wb bag of words Wc Wx Wy 4 P (Cs )P (D|Cs ) P (Wa |Cs )P (Wb |Cs )P (Wy |Cs )P (Wz |Cs ) 7 4 1 2 1 1 = × × × × ) 7 4 4 4 10 × 7 1 = 3920 3 P (Cp )P (D|Cp ) P (Wa |Cp )P (Wb |Cp )P (Wy |Cp )P (Wz |Cp ) 7 3 1 1 1 1 = × × × × ) 7 3 10 × 7 10 × 7 10 × 7 1 P (Cs )P (D|Cs ) P (Cp )P (D|Cp ) = 2401000 32
  • 33. 33
  • 34. 34
  • 35. 35
  • 36. 36
  • 38. ( ) • Web+DB vol.56 p.134-142, , May. 2010. • 4.2 • , p.101-117, , Aug, 2010. • ( ) • http://gihyo.jp/dev/serial/01/machine-learning/0003 • • http://d.hatena.ne.jp/kogecoo/20091103/1257281433 • ( ) • http://homepage3.nifty.com/DO/ensyu3_class2.pdf 38

Editor's Notes

  1. \n
  2. \n
  3. \n
  4. \n
  5. \n
  6. \n
  7. \n
  8. \n
  9. \n
  10. \n
  11. \n
  12. \n
  13. \n
  14. \n
  15. \n
  16. \n
  17. \n
  18. \n
  19. \n
  20. \n
  21. \n
  22. \n
  23. \n
  24. \n
  25. \n
  26. \n
  27. \n
  28. \n
  29. \n
  30. \n
  31. \n
  32. \n
  33. \n
  34. \n
  35. \n
  36. \n
  37. \n
  38. \n