Submit Search
Upload
Common Probability Distibution
•
Download as PPTX, PDF
•
0 likes
•
364 views
Lukas Tencer
Follow
Presentation for reading session of Computer Vision: Models, Learning, and Inference
Read less
Read more
Technology
Report
Share
Report
Share
1 of 22
Download now
Recommended
03 cv mil_probability_distributions
03 cv mil_probability_distributions
zukun
Introduction to Probability
Introduction to Probability
Lukas Tencer
12 cv mil_models_for_grids
12 cv mil_models_for_grids
zukun
02 cv mil_intro_to_probability
02 cv mil_intro_to_probability
zukun
05 cv mil_normal_distribution
05 cv mil_normal_distribution
zukun
07 cv mil_modeling_complex_densities
07 cv mil_modeling_complex_densities
zukun
Lesson 25: Evaluating Definite Integrals (handout)
Lesson 25: Evaluating Definite Integrals (handout)
Matthew Leingang
Probability concept and Probability distribution
Probability concept and Probability distribution
Southern Range, Berhampur, Odisha
Recommended
03 cv mil_probability_distributions
03 cv mil_probability_distributions
zukun
Introduction to Probability
Introduction to Probability
Lukas Tencer
12 cv mil_models_for_grids
12 cv mil_models_for_grids
zukun
02 cv mil_intro_to_probability
02 cv mil_intro_to_probability
zukun
05 cv mil_normal_distribution
05 cv mil_normal_distribution
zukun
07 cv mil_modeling_complex_densities
07 cv mil_modeling_complex_densities
zukun
Lesson 25: Evaluating Definite Integrals (handout)
Lesson 25: Evaluating Definite Integrals (handout)
Matthew Leingang
Probability concept and Probability distribution
Probability concept and Probability distribution
Southern Range, Berhampur, Odisha
10 cv mil_graphical_models
10 cv mil_graphical_models
zukun
04 cv mil_fitting_probability_models
04 cv mil_fitting_probability_models
zukun
15 cv mil_models_for_transformations
15 cv mil_models_for_transformations
zukun
09 cv mil_classification
09 cv mil_classification
zukun
13 cv mil_preprocessing
13 cv mil_preprocessing
zukun
17 cv mil_models_for_shape
17 cv mil_models_for_shape
zukun
11 cv mil_models_for_chains_and_trees
11 cv mil_models_for_chains_and_trees
zukun
16 cv mil_multiple_cameras
16 cv mil_multiple_cameras
zukun
08 cv mil_regression
08 cv mil_regression
zukun
06 cv mil_learning_and_inference
06 cv mil_learning_and_inference
zukun
20 cv mil_models_for_words
20 cv mil_models_for_words
zukun
18 cv mil_style_and_identity
18 cv mil_style_and_identity
zukun
14 cv mil_the_pinhole_camera
14 cv mil_the_pinhole_camera
zukun
Semi-Supervised Learning
Semi-Supervised Learning
Lukas Tencer
ICRA: Intelligent Platform for Collaboration and Interaction
ICRA: Intelligent Platform for Collaboration and Interaction
Lukas Tencer
Large Scale Online Learning of Image Similarity Through Ranking
Large Scale Online Learning of Image Similarity Through Ranking
Lukas Tencer
Slovakia Presentation at Day of Cultures
Slovakia Presentation at Day of Cultures
Lukas Tencer
Web-based framework for online sketch-based image retrieval
Web-based framework for online sketch-based image retrieval
Lukas Tencer
Supervised Learning of Semantic Classes for Image Annotation and Retrieval
Supervised Learning of Semantic Classes for Image Annotation and Retrieval
Lukas Tencer
Personal Career,Education and skills presentation, 2011
Personal Career,Education and skills presentation, 2011
Lukas Tencer
Introduction to Computer Graphics, lesson 1
Introduction to Computer Graphics, lesson 1
Lukas Tencer
Computer graphics on web and in mobile devices
Computer graphics on web and in mobile devices
Lukas Tencer
More Related Content
Similar to Common Probability Distibution
10 cv mil_graphical_models
10 cv mil_graphical_models
zukun
04 cv mil_fitting_probability_models
04 cv mil_fitting_probability_models
zukun
15 cv mil_models_for_transformations
15 cv mil_models_for_transformations
zukun
09 cv mil_classification
09 cv mil_classification
zukun
13 cv mil_preprocessing
13 cv mil_preprocessing
zukun
17 cv mil_models_for_shape
17 cv mil_models_for_shape
zukun
11 cv mil_models_for_chains_and_trees
11 cv mil_models_for_chains_and_trees
zukun
16 cv mil_multiple_cameras
16 cv mil_multiple_cameras
zukun
08 cv mil_regression
08 cv mil_regression
zukun
06 cv mil_learning_and_inference
06 cv mil_learning_and_inference
zukun
20 cv mil_models_for_words
20 cv mil_models_for_words
zukun
18 cv mil_style_and_identity
18 cv mil_style_and_identity
zukun
14 cv mil_the_pinhole_camera
14 cv mil_the_pinhole_camera
zukun
Similar to Common Probability Distibution
(13)
10 cv mil_graphical_models
10 cv mil_graphical_models
04 cv mil_fitting_probability_models
04 cv mil_fitting_probability_models
15 cv mil_models_for_transformations
15 cv mil_models_for_transformations
09 cv mil_classification
09 cv mil_classification
13 cv mil_preprocessing
13 cv mil_preprocessing
17 cv mil_models_for_shape
17 cv mil_models_for_shape
11 cv mil_models_for_chains_and_trees
11 cv mil_models_for_chains_and_trees
16 cv mil_multiple_cameras
16 cv mil_multiple_cameras
08 cv mil_regression
08 cv mil_regression
06 cv mil_learning_and_inference
06 cv mil_learning_and_inference
20 cv mil_models_for_words
20 cv mil_models_for_words
18 cv mil_style_and_identity
18 cv mil_style_and_identity
14 cv mil_the_pinhole_camera
14 cv mil_the_pinhole_camera
More from Lukas Tencer
Semi-Supervised Learning
Semi-Supervised Learning
Lukas Tencer
ICRA: Intelligent Platform for Collaboration and Interaction
ICRA: Intelligent Platform for Collaboration and Interaction
Lukas Tencer
Large Scale Online Learning of Image Similarity Through Ranking
Large Scale Online Learning of Image Similarity Through Ranking
Lukas Tencer
Slovakia Presentation at Day of Cultures
Slovakia Presentation at Day of Cultures
Lukas Tencer
Web-based framework for online sketch-based image retrieval
Web-based framework for online sketch-based image retrieval
Lukas Tencer
Supervised Learning of Semantic Classes for Image Annotation and Retrieval
Supervised Learning of Semantic Classes for Image Annotation and Retrieval
Lukas Tencer
Personal Career,Education and skills presentation, 2011
Personal Career,Education and skills presentation, 2011
Lukas Tencer
Introduction to Computer Graphics, lesson 1
Introduction to Computer Graphics, lesson 1
Lukas Tencer
Computer graphics on web and in mobile devices
Computer graphics on web and in mobile devices
Lukas Tencer
Telnet and SSH
Telnet and SSH
Lukas Tencer
Tracking of objects with known color signature - ELITECH 20
Tracking of objects with known color signature - ELITECH 20
Lukas Tencer
More from Lukas Tencer
(11)
Semi-Supervised Learning
Semi-Supervised Learning
ICRA: Intelligent Platform for Collaboration and Interaction
ICRA: Intelligent Platform for Collaboration and Interaction
Large Scale Online Learning of Image Similarity Through Ranking
Large Scale Online Learning of Image Similarity Through Ranking
Slovakia Presentation at Day of Cultures
Slovakia Presentation at Day of Cultures
Web-based framework for online sketch-based image retrieval
Web-based framework for online sketch-based image retrieval
Supervised Learning of Semantic Classes for Image Annotation and Retrieval
Supervised Learning of Semantic Classes for Image Annotation and Retrieval
Personal Career,Education and skills presentation, 2011
Personal Career,Education and skills presentation, 2011
Introduction to Computer Graphics, lesson 1
Introduction to Computer Graphics, lesson 1
Computer graphics on web and in mobile devices
Computer graphics on web and in mobile devices
Telnet and SSH
Telnet and SSH
Tracking of objects with known color signature - ELITECH 20
Tracking of objects with known color signature - ELITECH 20
Recently uploaded
Unblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen Frames
Sinan KOZAK
Key Features Of Token Development (1).pptx
Key Features Of Token Development (1).pptx
LBM Solutions
Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?
Mattias Andersson
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
2toLead Limited
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
Fwdays
Pigging Solutions in Pet Food Manufacturing
Pigging Solutions in Pet Food Manufacturing
Pigging Solutions
AI as an Interface for Commercial Buildings
AI as an Interface for Commercial Buildings
Memoori
E-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptx
E-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptx
null - The Open Security Community
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Patryk Bandurski
Build your next Gen AI Breakthrough - April 2024
Build your next Gen AI Breakthrough - April 2024
Neo4j
Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Alan Dix
My INSURER PTE LTD - Insurtech Innovation Award 2024
My INSURER PTE LTD - Insurtech Innovation Award 2024
The Digital Insurer
SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024
Scott Keck-Warren
APIForce Zurich 5 April Automation LPDG
APIForce Zurich 5 April Automation LPDG
MarianaLemus7
My Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 Presentation
Ridwan Fadjar
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
carlostorres15106
Making_way_through_DLL_hollowing_inspite_of_CFG_by_Debjeet Banerjee.pptx
Making_way_through_DLL_hollowing_inspite_of_CFG_by_Debjeet Banerjee.pptx
null - The Open Security Community
Pigging Solutions Piggable Sweeping Elbows
Pigging Solutions Piggable Sweeping Elbows
Pigging Solutions
The transition to renewables in India.pdf
The transition to renewables in India.pdf
Competition Advisory Services (India) LLP
Scanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL Certs
Rizwan Syed
Recently uploaded
(20)
Unblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen Frames
Key Features Of Token Development (1).pptx
Key Features Of Token Development (1).pptx
Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
Pigging Solutions in Pet Food Manufacturing
Pigging Solutions in Pet Food Manufacturing
AI as an Interface for Commercial Buildings
AI as an Interface for Commercial Buildings
E-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptx
E-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptx
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Build your next Gen AI Breakthrough - April 2024
Build your next Gen AI Breakthrough - April 2024
Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...
My INSURER PTE LTD - Insurtech Innovation Award 2024
My INSURER PTE LTD - Insurtech Innovation Award 2024
SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024
APIForce Zurich 5 April Automation LPDG
APIForce Zurich 5 April Automation LPDG
My Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 Presentation
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Making_way_through_DLL_hollowing_inspite_of_CFG_by_Debjeet Banerjee.pptx
Making_way_through_DLL_hollowing_inspite_of_CFG_by_Debjeet Banerjee.pptx
Pigging Solutions Piggable Sweeping Elbows
Pigging Solutions Piggable Sweeping Elbows
The transition to renewables in India.pdf
The transition to renewables in India.pdf
Scanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL Certs
Common Probability Distibution
1.
CHAPTER 3: COMMON PROBABILITY DISTRIBUTIONS COMPUTER
VISION: MODELS, LEARNING AND INFERENCE Lukas Tencer
2.
2
Computer vision: models, learning and inference. ©2011 Simon J.D. Prince
3.
Why model these
complicated quantities? 3 Because we need probability distributions over model parameters as well as over data and world state. Hence, some of the distributions describe the parameters of the others: Computer vision: models, learning and inference. ©2011 Simon J.D. Prince
4.
Why model these
complicated quantities? 4 Because we need probability distributions over model parameters as well as over data and world state. Hence, some of the distributions describe the parameters of the others: Example: Parameters modelled by: Models variance Models mean Computer vision: models, learning and inference. ©2011 Simon J.D. Prince
5.
Bernoulli Distribution 5
or For short we write: Bernoulli distribution describes situation where only two possible outcomes y=0/y=1 or failure/success Takes a single parameter Computer vision: models, learning and inference. ©2011 Simon J.D. Prince
6.
Beta Distribution 6
Defined over data (i.e. parameter of Bernoulli) • Two parameters both > 0 For short we write: • Mean depends on relative values E[ ] = . • Concentration depends on magnitude Computer vision: models, learning and inference. ©2011 Simon J.D. Prince
7.
Categorical Distribution 7
or can think of data as vector with all elements zero except kth e.g. e4 = [0,0,0,1,0] For short we write: Categorical distribution describes situation where K possible outcomes y=1… y=k. Takes K parameters where Computer vision: models, learning and inference. ©2011 Simon J.D. Prince
8.
Dirichlet Distribution 8 Defined over
K values where Or for short: Has k parameters k>0 Computer vision: models, learning and inference. ©2011 Simon J.D. Prince
9.
Univariate Normal Distribution 9
For short we write: Univariate normal distribution describes single continuous variable. Takes 2 parameters and Computer vision: models, learning2and inference. ©2011 >0Simon J.D. Prince
10.
Normal Inverse Gamma 10
Distribution Defined on 2 variables and 2>0 or for short Four parameters and Computer vision: models, learning and inference. ©2011 Simon J.D. Prince
11.
Multivariate Normal Distribution 11
For short we write: Multivariate normal distribution describes multiple continuous variables. Takes 2 parameters • a vector containing mean position, • a symmetric “positive definite” covariance matrix Positive definite: is positive for any real Computer vision: models, learning and inference. ©2011 Simon J.D. Prince
12.
Types of covariance 12
Covariance matrix has three forms, termed spherical, diagonal and full Computer vision: models, learning and inference. ©2011 Simon J.D. Prince
13.
Normal Inverse Wishart 13
Defined on two variables: a mean vector and a symmetric positive definite matrix, . or for short: Has four parameters • a positive scalar, • a positive definite matrix • a positive scalar, • a vector Computer vision: models, learning and inference. ©2011 Simon J.D. Prince
14.
Samples from
Normal Inverse 14 Wishart (dispersion) (ave. Covar) (disper of means) (ave. of means) Computer vision: models, learning and inference. ©2011 Simon J.D. Prince
15.
Conjugate Distributions 15
The pairs of distributions discussed have a special relationship: they are conjugate distributions Beta is conjugate to Bernouilli Dirichlet is conjugate to categorical Normal inverse gamma is conjugate to univariate normal Normal inverse Wishart is conjugate to multivariate normal Computer vision: models, learning and inference. ©2011 Simon J.D. Prince
16.
Conjugate Distributions 16
When we take product of distribution and it’s conjugate, the result has the same form as the conjugate. For example, consider the case where then a constant A new Beta distribution Computer vision: models, learning and inference. ©2011 Simon J.D. Prince
17.
Example proof 17
When we take product of distribution and it’s conjugate, the result has the same form as the conjugate. Computer vision: models, learning and inference. ©2011 Simon J.D. 17 Prince
18.
Bayes’ Rule Terminology 18
Likelihood – propensity Prior – what we know for observing a certain about y before seeing value of x given a certain x value of y Posterior – what we Evidence – a constant to know about y after ensure that the left hand seeing x side is a valid distribution Computer vision: models, learning and inference. ©2011 Simon J.D. Prince
19.
Importance of the
Conjugate 19 Relation 1 1. Choose prior Learning parameters: that is conjugate to likelihood 2. Implies that posterior 3. Posterior must be a distribution must have same form as which implies that evidence must conjugate prior equal constant from conjugate distribution relation Computer vision: models, learning and inference. ©2011 Simon J.D. Prince
20.
Importance of the
Conjugate 20 Relation 2 Marginalizing over parameters 2. Integral becomes easy --the product 1. Chosen so becomes a constant times a distribution conjugate to othe term Integral of constant times probability distribution = constant times integral of probability distribution = constant vision: models, learning and inference. Computer x 1 = constant ©2011 Simon J.D. Prince
21.
Conclusions 21
• Presented four distributions which model useful quantities • Presented four other distributions which model the parameters of the first four • They are paired in a special way – the second set is conjugate to the other • In the following material we’ll see that this relationship is verymodels, learning and inference. ©2011 Computer vision: useful Simon J.D. Prince
22.
22
Thank You for you attention Based on: Computer vision: models, learning and inference. ©2011 Simon J.D. Prince http://www.computervisionmodels.com/
Download now