SlideShare a Scribd company logo
Bayesian for us
Masahiro Ryo
masahiroryo@gmail.com
Matthias Rillig Lab.
Freie Universität Berlin
Berlin-Brandenburg Institute of
Advanced Biodiversity Research
2016.07.27
1. Bayes' theorem
2. What is same?
3. What is “practically” different?
4. p-value and our intuition
5. Assumptions
6. By the way…
7. prior distribution
8. Summary
2
Outline
Practical part
Technical part
3
1. Bayes' theorem
P(A|B) =
P(B|A) P(A)
P(B)
P(A): the probability of observing event A
P(A|B): a conditional probability, the probability of
observing event A given that B is true
4
1. Bayes' theorem
P(A|B) =
P(B|A) P(A)
P(B)
P(A): the probability of observing event A
P(A|B): a conditional probability, the probability of
observing event A given that B is true
5
2. What is same?
1. To assume a hypothesis
• M under the treatment is larger
than M under control (comparison)
• Y is increased by increasing X
(correlation)
2. To collect samples
3. To test the hypothesis
population
samples
Statistical test
6
3. What is “practically” different? - test
Frequentists Bayesians
“if p < 0.05 or not” “how probable”
1. Set a null hypothesis H0
2. Estimate probability of type I
error (p-value)
3. Evaluate how rarely H0 occurs
4. Reject H0 and support H1
1. Set a hypothesis H1
2. Evaluate how possibly H1 occurs
Bayesian is more direct
and intuitive
to test a hypothesis
e.g., my hypothesis was supported
with 80% probability.
7
3. What is “practically” different?
Frequentists Bayesians
“how probable”“if p < 0.05 or not”
y = β0 + β1 x
Parameter β1
Probability
0.89
H0: β1 = 0 is rejected
H1: β1 ≠ 0 is supported
(and β1= 0.89)
The parameter β1 is rarely <0,
so H1 is greatly supported.
Most probably β1=0.89 and
can span between 0.28 and 1.52
with 95% probability.
8
4. p-value and our intuition
Importantly, p-value does not indicate
how reliable your hypothesis is
but how safely reject the corresponding null hypothesis.
This does not fit our intuition.
In most cases, we want to know
“how reliable my hypothesis is?”
Frequentists
9
5. Assumptions
Bayesians
population
Your
samples
Assuming repetitive sampling from
the population to find the single
true value for a parameter
governing the population
population
Your
samples
Assuming the probability
distribution of a parameter value,
and its reliability is increased by
increasing the sample size.
0.3
1.3
β=0.8
β
What you estimated
from your samples
Frequentists
10
5. Assumptions
Bayesians
95% Confidence interval (CI)
assumes that if you conduct same
sampling design 20 times and
estimate a 95%CI for each,
only once a 95%CI would not cross
the true value β.
β
95% Credible interval (CI) assumes
that the parameter β governing the
population would be within the
range of the 95% CI with 95%
probability.
β
0.3 1.3
Any value you estimated from your
samples can be the parameter
(does not matter if it is true or not)
11
5. Assumptions
Using same data,
fitting a same probability distribution,
estimating the parameters based on likelihood….
Then, while the concepts are different,
do we eventually get identical results
from frequentism and Bayesianism?
12
5. Assumptions
Answer:
Yes, if we consider only in our scientific field,
they are “most likely“ same.
Recommendation:
If your interest is the effect size, use Bayesian
If it is to support hypothesis, use Frequentist
13
6. By the way…
The answer becomes NO
when “prior distribution“ is explicitly assumed
P(β|D) =
P(D|β) P(β)
P(D)
Likelihood
posterior
distribution
fixed value
(practically neglectable)
prior distribution
14
6. By the way…
Note that this is much less important for us...
P(β|D) ∝ P(D|β) P(β)
posterior
distribution
prior distributionLikelihood
15
What I have explained was the following case:
P(β|D) ∝ P(D|β) P(β)
posterior
distribution
prior distributionLikelihood
β
0.3 1.3
This was the outcome
(estimated parameter value & range)
β
0.3 1.3
This was estimated
β
−∞ +∞
This was like nothing
6. By the way…
16
7. prior distribution
P(β|D) ∝ P(D|β) P(β)
prior distribution
β
−∞ +∞
What‘s this?
17
7. prior distribution
Prior distribution
• This is the other key point of Bayesian statistics
• But interestingly we don‘t care this aspect for our analysis (and if
you google Bayesian, most articles explain this firstly: Suck!)
• We can include a subjective assumption of the probability
distribution of parameters (i.e., prior distribution) before analysis
(but don‘t have to and indeed we don‘t)
18
7. prior distribution
An example
• Question: to quantify mean and variability of our height
— Probability districution of height: Gaussian
— Shall we assume the parameters beforehand? μ= XX? ±σ=XX?
This is called “prior distribution“
μ
170 180
175
±σ
3 8
5
— We measure individuals and calculate the likelihoods
— Multiply the posterior distribution by the likelihoods
to obtain the posterior distribution
19
7. prior distribution
An example
• In case of average μ
P(β|D) ∝ P(D|β) P(β)
μ
170 180
175
prior dist.
(your assumption)
μ
160 178
171
Likelihood
(measurement)
Posterior dist.
(output: updated
distribution after
measurement)
μ
174
166 179
20
7. prior distribution
170 180
175
P(β|D) ∝ P(D|β) P(β)
160 178
171174
166 179
In our study
μ
160 178
171
μ
171
160 178
β
−∞ +∞
To avoid subjectivity
21
8. Summary
Recommendation:
If your interest is the effect size, use Bayesian
If it is to support hypothesis, use Frequentist
β
0.3 1.3
Any value you estimated from your
samples can be the parameter,
following a probability distribution
P(β|D) ∝ P(D|β) P(β)
Prior information can be important in other field
but this is not important for us: so, let‘s ignore.

More Related Content

What's hot

How to read a receiver operating characteritic (ROC) curve
How to read a receiver operating characteritic (ROC) curveHow to read a receiver operating characteritic (ROC) curve
How to read a receiver operating characteritic (ROC) curve
Samir Haffar
 
5.7 poisson regression in the analysis of cohort data
5.7 poisson regression in the analysis of  cohort data5.7 poisson regression in the analysis of  cohort data
5.7 poisson regression in the analysis of cohort data
A M
 
Multinomial logisticregression basicrelationships
Multinomial logisticregression basicrelationshipsMultinomial logisticregression basicrelationships
Multinomial logisticregression basicrelationships
Anirudha si
 
Introduction to statistical modeling in R
Introduction to statistical modeling in RIntroduction to statistical modeling in R
Introduction to statistical modeling in R
richardchandler
 
Logistic regression
Logistic regressionLogistic regression
Logistic regression
DrZahid Khan
 
Probability distribution
Probability distributionProbability distribution
Probability distribution
Punit Raut
 
Bayes rule (Bayes Law)
Bayes rule (Bayes Law)Bayes rule (Bayes Law)
Bayes rule (Bayes Law)
Tish997
 
The standard normal curve & its application in biomedical sciences
The standard normal curve & its application in biomedical sciencesThe standard normal curve & its application in biomedical sciences
The standard normal curve & its application in biomedical sciences
Abhi Manu
 
Visual Explanation of Ridge Regression and LASSO
Visual Explanation of Ridge Regression and LASSOVisual Explanation of Ridge Regression and LASSO
Visual Explanation of Ridge Regression and LASSO
Kazuki Yoshida
 
Bayesian Structural Equations Modeling (SEM)
Bayesian Structural Equations Modeling (SEM)Bayesian Structural Equations Modeling (SEM)
Bayesian Structural Equations Modeling (SEM)
Hamy Temkit
 
Poisson regression models for count data
Poisson regression models for count dataPoisson regression models for count data
Poisson regression models for count data
University of Southampton
 
Multiple comparison problem
Multiple comparison problemMultiple comparison problem
Multiple comparison problem
Jiri Haviger
 
2.03 bayesian estimation
2.03 bayesian estimation2.03 bayesian estimation
2.03 bayesian estimation
Andres Mendez-Vazquez
 
Bayesian inference
Bayesian inferenceBayesian inference
Bayesian inference
CharthaGaglani
 
Standard deviation and standard error
Standard deviation and standard errorStandard deviation and standard error
Standard deviation and standard error
Shahla Yasmin
 
Logistic regression
Logistic regressionLogistic regression
Logistic regression
Khaled Abd Elaziz
 
The Method Of Maximum Likelihood
The Method Of Maximum LikelihoodThe Method Of Maximum Likelihood
The Method Of Maximum Likelihood
Max Chipulu
 
Biostatistics
BiostatisticsBiostatistics
Introduction to Maximum Likelihood Estimator
Introduction to Maximum Likelihood EstimatorIntroduction to Maximum Likelihood Estimator
Introduction to Maximum Likelihood Estimator
Amir Al-Ansary
 
Bayesian statistics
Bayesian statisticsBayesian statistics
Bayesian statistics
Sagar Kamble
 

What's hot (20)

How to read a receiver operating characteritic (ROC) curve
How to read a receiver operating characteritic (ROC) curveHow to read a receiver operating characteritic (ROC) curve
How to read a receiver operating characteritic (ROC) curve
 
5.7 poisson regression in the analysis of cohort data
5.7 poisson regression in the analysis of  cohort data5.7 poisson regression in the analysis of  cohort data
5.7 poisson regression in the analysis of cohort data
 
Multinomial logisticregression basicrelationships
Multinomial logisticregression basicrelationshipsMultinomial logisticregression basicrelationships
Multinomial logisticregression basicrelationships
 
Introduction to statistical modeling in R
Introduction to statistical modeling in RIntroduction to statistical modeling in R
Introduction to statistical modeling in R
 
Logistic regression
Logistic regressionLogistic regression
Logistic regression
 
Probability distribution
Probability distributionProbability distribution
Probability distribution
 
Bayes rule (Bayes Law)
Bayes rule (Bayes Law)Bayes rule (Bayes Law)
Bayes rule (Bayes Law)
 
The standard normal curve & its application in biomedical sciences
The standard normal curve & its application in biomedical sciencesThe standard normal curve & its application in biomedical sciences
The standard normal curve & its application in biomedical sciences
 
Visual Explanation of Ridge Regression and LASSO
Visual Explanation of Ridge Regression and LASSOVisual Explanation of Ridge Regression and LASSO
Visual Explanation of Ridge Regression and LASSO
 
Bayesian Structural Equations Modeling (SEM)
Bayesian Structural Equations Modeling (SEM)Bayesian Structural Equations Modeling (SEM)
Bayesian Structural Equations Modeling (SEM)
 
Poisson regression models for count data
Poisson regression models for count dataPoisson regression models for count data
Poisson regression models for count data
 
Multiple comparison problem
Multiple comparison problemMultiple comparison problem
Multiple comparison problem
 
2.03 bayesian estimation
2.03 bayesian estimation2.03 bayesian estimation
2.03 bayesian estimation
 
Bayesian inference
Bayesian inferenceBayesian inference
Bayesian inference
 
Standard deviation and standard error
Standard deviation and standard errorStandard deviation and standard error
Standard deviation and standard error
 
Logistic regression
Logistic regressionLogistic regression
Logistic regression
 
The Method Of Maximum Likelihood
The Method Of Maximum LikelihoodThe Method Of Maximum Likelihood
The Method Of Maximum Likelihood
 
Biostatistics
BiostatisticsBiostatistics
Biostatistics
 
Introduction to Maximum Likelihood Estimator
Introduction to Maximum Likelihood EstimatorIntroduction to Maximum Likelihood Estimator
Introduction to Maximum Likelihood Estimator
 
Bayesian statistics
Bayesian statisticsBayesian statistics
Bayesian statistics
 

Similar to Bayesian statistics for biologists and ecologists

Bayesian Statistics.pdf
Bayesian Statistics.pdfBayesian Statistics.pdf
Bayesian Statistics.pdf
MuhammadAnas742878
 
The replication crisis: are P-values the problem and are Bayes factors the so...
The replication crisis: are P-values the problem and are Bayes factors the so...The replication crisis: are P-values the problem and are Bayes factors the so...
The replication crisis: are P-values the problem and are Bayes factors the so...
jemille6
 
The replication crisis: are P-values the problem and are Bayes factors the so...
The replication crisis: are P-values the problem and are Bayes factors the so...The replication crisis: are P-values the problem and are Bayes factors the so...
The replication crisis: are P-values the problem and are Bayes factors the so...
StephenSenn2
 
Introduction to Bayesian Statistics.ppt
Introduction to Bayesian Statistics.pptIntroduction to Bayesian Statistics.ppt
Introduction to Bayesian Statistics.ppt
Long Dang
 
bayesjaw.ppt
bayesjaw.pptbayesjaw.ppt
unit 3 -ML.pptx
unit 3 -ML.pptxunit 3 -ML.pptx
unit 3 -ML.pptx
Chitrachitrap
 
What should we expect from reproducibiliry
What should we expect from reproducibiliryWhat should we expect from reproducibiliry
What should we expect from reproducibiliry
Stephen Senn
 
Uncertainty
UncertaintyUncertainty
Uncertainty
Digvijay Singh
 
Naive Bayes.pptx
Naive Bayes.pptxNaive Bayes.pptx
Naive Bayes.pptx
Uttara University
 
Bayes' theorem
Bayes' theoremBayes' theorem
Bayes' theorem
Dr. C.V. Suresh Babu
 
Replication Crises and the Statistics Wars: Hidden Controversies
Replication Crises and the Statistics Wars: Hidden ControversiesReplication Crises and the Statistics Wars: Hidden Controversies
Replication Crises and the Statistics Wars: Hidden Controversies
jemille6
 
Probability and basic statistics with R
Probability and basic statistics with RProbability and basic statistics with R
Probability and basic statistics with R
Alberto Labarga
 
Warmup_New.pdf
Warmup_New.pdfWarmup_New.pdf
Warmup_New.pdf
HongAnhNguyn285885
 
Statistical Inference as Severe Testing: Beyond Performance and Probabilism
Statistical Inference as Severe Testing: Beyond Performance and ProbabilismStatistical Inference as Severe Testing: Beyond Performance and Probabilism
Statistical Inference as Severe Testing: Beyond Performance and Probabilism
jemille6
 
4-ML-UNIT-IV-Bayesian Learning.pptx
4-ML-UNIT-IV-Bayesian Learning.pptx4-ML-UNIT-IV-Bayesian Learning.pptx
4-ML-UNIT-IV-Bayesian Learning.pptx
Saitama84
 
Review Z Test Ci 1
Review Z Test Ci 1Review Z Test Ci 1
Review Z Test Ci 1
shoffma5
 
D. G. Mayo Columbia slides for Workshop on Probability &Learning
D. G. Mayo Columbia slides for Workshop on Probability &LearningD. G. Mayo Columbia slides for Workshop on Probability &Learning
D. G. Mayo Columbia slides for Workshop on Probability &Learning
jemille6
 
Linear Regression
Linear RegressionLinear Regression
Linear Regression
mailund
 
Senn repligate
Senn repligateSenn repligate
Senn repligate
jemille6
 
Meeting #1 Slides Phil 6334/Econ 6614 SP2019
Meeting #1 Slides Phil 6334/Econ 6614 SP2019Meeting #1 Slides Phil 6334/Econ 6614 SP2019
Meeting #1 Slides Phil 6334/Econ 6614 SP2019
jemille6
 

Similar to Bayesian statistics for biologists and ecologists (20)

Bayesian Statistics.pdf
Bayesian Statistics.pdfBayesian Statistics.pdf
Bayesian Statistics.pdf
 
The replication crisis: are P-values the problem and are Bayes factors the so...
The replication crisis: are P-values the problem and are Bayes factors the so...The replication crisis: are P-values the problem and are Bayes factors the so...
The replication crisis: are P-values the problem and are Bayes factors the so...
 
The replication crisis: are P-values the problem and are Bayes factors the so...
The replication crisis: are P-values the problem and are Bayes factors the so...The replication crisis: are P-values the problem and are Bayes factors the so...
The replication crisis: are P-values the problem and are Bayes factors the so...
 
Introduction to Bayesian Statistics.ppt
Introduction to Bayesian Statistics.pptIntroduction to Bayesian Statistics.ppt
Introduction to Bayesian Statistics.ppt
 
bayesjaw.ppt
bayesjaw.pptbayesjaw.ppt
bayesjaw.ppt
 
unit 3 -ML.pptx
unit 3 -ML.pptxunit 3 -ML.pptx
unit 3 -ML.pptx
 
What should we expect from reproducibiliry
What should we expect from reproducibiliryWhat should we expect from reproducibiliry
What should we expect from reproducibiliry
 
Uncertainty
UncertaintyUncertainty
Uncertainty
 
Naive Bayes.pptx
Naive Bayes.pptxNaive Bayes.pptx
Naive Bayes.pptx
 
Bayes' theorem
Bayes' theoremBayes' theorem
Bayes' theorem
 
Replication Crises and the Statistics Wars: Hidden Controversies
Replication Crises and the Statistics Wars: Hidden ControversiesReplication Crises and the Statistics Wars: Hidden Controversies
Replication Crises and the Statistics Wars: Hidden Controversies
 
Probability and basic statistics with R
Probability and basic statistics with RProbability and basic statistics with R
Probability and basic statistics with R
 
Warmup_New.pdf
Warmup_New.pdfWarmup_New.pdf
Warmup_New.pdf
 
Statistical Inference as Severe Testing: Beyond Performance and Probabilism
Statistical Inference as Severe Testing: Beyond Performance and ProbabilismStatistical Inference as Severe Testing: Beyond Performance and Probabilism
Statistical Inference as Severe Testing: Beyond Performance and Probabilism
 
4-ML-UNIT-IV-Bayesian Learning.pptx
4-ML-UNIT-IV-Bayesian Learning.pptx4-ML-UNIT-IV-Bayesian Learning.pptx
4-ML-UNIT-IV-Bayesian Learning.pptx
 
Review Z Test Ci 1
Review Z Test Ci 1Review Z Test Ci 1
Review Z Test Ci 1
 
D. G. Mayo Columbia slides for Workshop on Probability &Learning
D. G. Mayo Columbia slides for Workshop on Probability &LearningD. G. Mayo Columbia slides for Workshop on Probability &Learning
D. G. Mayo Columbia slides for Workshop on Probability &Learning
 
Linear Regression
Linear RegressionLinear Regression
Linear Regression
 
Senn repligate
Senn repligateSenn repligate
Senn repligate
 
Meeting #1 Slides Phil 6334/Econ 6614 SP2019
Meeting #1 Slides Phil 6334/Econ 6614 SP2019Meeting #1 Slides Phil 6334/Econ 6614 SP2019
Meeting #1 Slides Phil 6334/Econ 6614 SP2019
 

Recently uploaded

Describing and Interpreting an Immersive Learning Case with the Immersion Cub...
Describing and Interpreting an Immersive Learning Case with the Immersion Cub...Describing and Interpreting an Immersive Learning Case with the Immersion Cub...
Describing and Interpreting an Immersive Learning Case with the Immersion Cub...
Leonel Morgado
 
Basics of crystallography, crystal systems, classes and different forms
Basics of crystallography, crystal systems, classes and different formsBasics of crystallography, crystal systems, classes and different forms
Basics of crystallography, crystal systems, classes and different forms
MaheshaNanjegowda
 
aziz sancar nobel prize winner: from mardin to nobel
aziz sancar nobel prize winner: from mardin to nobelaziz sancar nobel prize winner: from mardin to nobel
aziz sancar nobel prize winner: from mardin to nobel
İsa Badur
 
ESR spectroscopy in liquid food and beverages.pptx
ESR spectroscopy in liquid food and beverages.pptxESR spectroscopy in liquid food and beverages.pptx
ESR spectroscopy in liquid food and beverages.pptx
PRIYANKA PATEL
 
Applied Science: Thermodynamics, Laws & Methodology.pdf
Applied Science: Thermodynamics, Laws & Methodology.pdfApplied Science: Thermodynamics, Laws & Methodology.pdf
Applied Science: Thermodynamics, Laws & Methodology.pdf
University of Hertfordshire
 
Phenomics assisted breeding in crop improvement
Phenomics assisted breeding in crop improvementPhenomics assisted breeding in crop improvement
Phenomics assisted breeding in crop improvement
IshaGoswami9
 
20240520 Planning a Circuit Simulator in JavaScript.pptx
20240520 Planning a Circuit Simulator in JavaScript.pptx20240520 Planning a Circuit Simulator in JavaScript.pptx
20240520 Planning a Circuit Simulator in JavaScript.pptx
Sharon Liu
 
Equivariant neural networks and representation theory
Equivariant neural networks and representation theoryEquivariant neural networks and representation theory
Equivariant neural networks and representation theory
Daniel Tubbenhauer
 
原版制作(carleton毕业证书)卡尔顿大学毕业证硕士文凭原版一模一样
原版制作(carleton毕业证书)卡尔顿大学毕业证硕士文凭原版一模一样原版制作(carleton毕业证书)卡尔顿大学毕业证硕士文凭原版一模一样
原版制作(carleton毕业证书)卡尔顿大学毕业证硕士文凭原版一模一样
yqqaatn0
 
Eukaryotic Transcription Presentation.pptx
Eukaryotic Transcription Presentation.pptxEukaryotic Transcription Presentation.pptx
Eukaryotic Transcription Presentation.pptx
RitabrataSarkar3
 
The binding of cosmological structures by massless topological defects
The binding of cosmological structures by massless topological defectsThe binding of cosmological structures by massless topological defects
The binding of cosmological structures by massless topological defects
Sérgio Sacani
 
Unlocking the mysteries of reproduction: Exploring fecundity and gonadosomati...
Unlocking the mysteries of reproduction: Exploring fecundity and gonadosomati...Unlocking the mysteries of reproduction: Exploring fecundity and gonadosomati...
Unlocking the mysteries of reproduction: Exploring fecundity and gonadosomati...
AbdullaAlAsif1
 
Sharlene Leurig - Enabling Onsite Water Use with Net Zero Water
Sharlene Leurig - Enabling Onsite Water Use with Net Zero WaterSharlene Leurig - Enabling Onsite Water Use with Net Zero Water
Sharlene Leurig - Enabling Onsite Water Use with Net Zero Water
Texas Alliance of Groundwater Districts
 
在线办理(salfor毕业证书)索尔福德大学毕业证毕业完成信一模一样
在线办理(salfor毕业证书)索尔福德大学毕业证毕业完成信一模一样在线办理(salfor毕业证书)索尔福德大学毕业证毕业完成信一模一样
在线办理(salfor毕业证书)索尔福德大学毕业证毕业完成信一模一样
vluwdy49
 
molar-distalization in orthodontics-seminar.pptx
molar-distalization in orthodontics-seminar.pptxmolar-distalization in orthodontics-seminar.pptx
molar-distalization in orthodontics-seminar.pptx
Anagha Prasad
 
Bob Reedy - Nitrate in Texas Groundwater.pdf
Bob Reedy - Nitrate in Texas Groundwater.pdfBob Reedy - Nitrate in Texas Groundwater.pdf
Bob Reedy - Nitrate in Texas Groundwater.pdf
Texas Alliance of Groundwater Districts
 
8.Isolation of pure cultures and preservation of cultures.pdf
8.Isolation of pure cultures and preservation of cultures.pdf8.Isolation of pure cultures and preservation of cultures.pdf
8.Isolation of pure cultures and preservation of cultures.pdf
by6843629
 
The debris of the ‘last major merger’ is dynamically young
The debris of the ‘last major merger’ is dynamically youngThe debris of the ‘last major merger’ is dynamically young
The debris of the ‘last major merger’ is dynamically young
Sérgio Sacani
 
Thornton ESPP slides UK WW Network 4_6_24.pdf
Thornton ESPP slides UK WW Network 4_6_24.pdfThornton ESPP slides UK WW Network 4_6_24.pdf
Thornton ESPP slides UK WW Network 4_6_24.pdf
European Sustainable Phosphorus Platform
 
Micronuclei test.M.sc.zoology.fisheries.
Micronuclei test.M.sc.zoology.fisheries.Micronuclei test.M.sc.zoology.fisheries.
Micronuclei test.M.sc.zoology.fisheries.
Aditi Bajpai
 

Recently uploaded (20)

Describing and Interpreting an Immersive Learning Case with the Immersion Cub...
Describing and Interpreting an Immersive Learning Case with the Immersion Cub...Describing and Interpreting an Immersive Learning Case with the Immersion Cub...
Describing and Interpreting an Immersive Learning Case with the Immersion Cub...
 
Basics of crystallography, crystal systems, classes and different forms
Basics of crystallography, crystal systems, classes and different formsBasics of crystallography, crystal systems, classes and different forms
Basics of crystallography, crystal systems, classes and different forms
 
aziz sancar nobel prize winner: from mardin to nobel
aziz sancar nobel prize winner: from mardin to nobelaziz sancar nobel prize winner: from mardin to nobel
aziz sancar nobel prize winner: from mardin to nobel
 
ESR spectroscopy in liquid food and beverages.pptx
ESR spectroscopy in liquid food and beverages.pptxESR spectroscopy in liquid food and beverages.pptx
ESR spectroscopy in liquid food and beverages.pptx
 
Applied Science: Thermodynamics, Laws & Methodology.pdf
Applied Science: Thermodynamics, Laws & Methodology.pdfApplied Science: Thermodynamics, Laws & Methodology.pdf
Applied Science: Thermodynamics, Laws & Methodology.pdf
 
Phenomics assisted breeding in crop improvement
Phenomics assisted breeding in crop improvementPhenomics assisted breeding in crop improvement
Phenomics assisted breeding in crop improvement
 
20240520 Planning a Circuit Simulator in JavaScript.pptx
20240520 Planning a Circuit Simulator in JavaScript.pptx20240520 Planning a Circuit Simulator in JavaScript.pptx
20240520 Planning a Circuit Simulator in JavaScript.pptx
 
Equivariant neural networks and representation theory
Equivariant neural networks and representation theoryEquivariant neural networks and representation theory
Equivariant neural networks and representation theory
 
原版制作(carleton毕业证书)卡尔顿大学毕业证硕士文凭原版一模一样
原版制作(carleton毕业证书)卡尔顿大学毕业证硕士文凭原版一模一样原版制作(carleton毕业证书)卡尔顿大学毕业证硕士文凭原版一模一样
原版制作(carleton毕业证书)卡尔顿大学毕业证硕士文凭原版一模一样
 
Eukaryotic Transcription Presentation.pptx
Eukaryotic Transcription Presentation.pptxEukaryotic Transcription Presentation.pptx
Eukaryotic Transcription Presentation.pptx
 
The binding of cosmological structures by massless topological defects
The binding of cosmological structures by massless topological defectsThe binding of cosmological structures by massless topological defects
The binding of cosmological structures by massless topological defects
 
Unlocking the mysteries of reproduction: Exploring fecundity and gonadosomati...
Unlocking the mysteries of reproduction: Exploring fecundity and gonadosomati...Unlocking the mysteries of reproduction: Exploring fecundity and gonadosomati...
Unlocking the mysteries of reproduction: Exploring fecundity and gonadosomati...
 
Sharlene Leurig - Enabling Onsite Water Use with Net Zero Water
Sharlene Leurig - Enabling Onsite Water Use with Net Zero WaterSharlene Leurig - Enabling Onsite Water Use with Net Zero Water
Sharlene Leurig - Enabling Onsite Water Use with Net Zero Water
 
在线办理(salfor毕业证书)索尔福德大学毕业证毕业完成信一模一样
在线办理(salfor毕业证书)索尔福德大学毕业证毕业完成信一模一样在线办理(salfor毕业证书)索尔福德大学毕业证毕业完成信一模一样
在线办理(salfor毕业证书)索尔福德大学毕业证毕业完成信一模一样
 
molar-distalization in orthodontics-seminar.pptx
molar-distalization in orthodontics-seminar.pptxmolar-distalization in orthodontics-seminar.pptx
molar-distalization in orthodontics-seminar.pptx
 
Bob Reedy - Nitrate in Texas Groundwater.pdf
Bob Reedy - Nitrate in Texas Groundwater.pdfBob Reedy - Nitrate in Texas Groundwater.pdf
Bob Reedy - Nitrate in Texas Groundwater.pdf
 
8.Isolation of pure cultures and preservation of cultures.pdf
8.Isolation of pure cultures and preservation of cultures.pdf8.Isolation of pure cultures and preservation of cultures.pdf
8.Isolation of pure cultures and preservation of cultures.pdf
 
The debris of the ‘last major merger’ is dynamically young
The debris of the ‘last major merger’ is dynamically youngThe debris of the ‘last major merger’ is dynamically young
The debris of the ‘last major merger’ is dynamically young
 
Thornton ESPP slides UK WW Network 4_6_24.pdf
Thornton ESPP slides UK WW Network 4_6_24.pdfThornton ESPP slides UK WW Network 4_6_24.pdf
Thornton ESPP slides UK WW Network 4_6_24.pdf
 
Micronuclei test.M.sc.zoology.fisheries.
Micronuclei test.M.sc.zoology.fisheries.Micronuclei test.M.sc.zoology.fisheries.
Micronuclei test.M.sc.zoology.fisheries.
 

Bayesian statistics for biologists and ecologists

  • 1. Bayesian for us Masahiro Ryo masahiroryo@gmail.com Matthias Rillig Lab. Freie Universität Berlin Berlin-Brandenburg Institute of Advanced Biodiversity Research 2016.07.27
  • 2. 1. Bayes' theorem 2. What is same? 3. What is “practically” different? 4. p-value and our intuition 5. Assumptions 6. By the way… 7. prior distribution 8. Summary 2 Outline Practical part Technical part
  • 3. 3 1. Bayes' theorem P(A|B) = P(B|A) P(A) P(B) P(A): the probability of observing event A P(A|B): a conditional probability, the probability of observing event A given that B is true
  • 4. 4 1. Bayes' theorem P(A|B) = P(B|A) P(A) P(B) P(A): the probability of observing event A P(A|B): a conditional probability, the probability of observing event A given that B is true
  • 5. 5 2. What is same? 1. To assume a hypothesis • M under the treatment is larger than M under control (comparison) • Y is increased by increasing X (correlation) 2. To collect samples 3. To test the hypothesis population samples Statistical test
  • 6. 6 3. What is “practically” different? - test Frequentists Bayesians “if p < 0.05 or not” “how probable” 1. Set a null hypothesis H0 2. Estimate probability of type I error (p-value) 3. Evaluate how rarely H0 occurs 4. Reject H0 and support H1 1. Set a hypothesis H1 2. Evaluate how possibly H1 occurs Bayesian is more direct and intuitive to test a hypothesis e.g., my hypothesis was supported with 80% probability.
  • 7. 7 3. What is “practically” different? Frequentists Bayesians “how probable”“if p < 0.05 or not” y = β0 + β1 x Parameter β1 Probability 0.89 H0: β1 = 0 is rejected H1: β1 ≠ 0 is supported (and β1= 0.89) The parameter β1 is rarely <0, so H1 is greatly supported. Most probably β1=0.89 and can span between 0.28 and 1.52 with 95% probability.
  • 8. 8 4. p-value and our intuition Importantly, p-value does not indicate how reliable your hypothesis is but how safely reject the corresponding null hypothesis. This does not fit our intuition. In most cases, we want to know “how reliable my hypothesis is?”
  • 9. Frequentists 9 5. Assumptions Bayesians population Your samples Assuming repetitive sampling from the population to find the single true value for a parameter governing the population population Your samples Assuming the probability distribution of a parameter value, and its reliability is increased by increasing the sample size.
  • 10. 0.3 1.3 β=0.8 β What you estimated from your samples Frequentists 10 5. Assumptions Bayesians 95% Confidence interval (CI) assumes that if you conduct same sampling design 20 times and estimate a 95%CI for each, only once a 95%CI would not cross the true value β. β 95% Credible interval (CI) assumes that the parameter β governing the population would be within the range of the 95% CI with 95% probability. β 0.3 1.3 Any value you estimated from your samples can be the parameter (does not matter if it is true or not)
  • 11. 11 5. Assumptions Using same data, fitting a same probability distribution, estimating the parameters based on likelihood…. Then, while the concepts are different, do we eventually get identical results from frequentism and Bayesianism?
  • 12. 12 5. Assumptions Answer: Yes, if we consider only in our scientific field, they are “most likely“ same. Recommendation: If your interest is the effect size, use Bayesian If it is to support hypothesis, use Frequentist
  • 13. 13 6. By the way… The answer becomes NO when “prior distribution“ is explicitly assumed P(β|D) = P(D|β) P(β) P(D) Likelihood posterior distribution fixed value (practically neglectable) prior distribution
  • 14. 14 6. By the way… Note that this is much less important for us... P(β|D) ∝ P(D|β) P(β) posterior distribution prior distributionLikelihood
  • 15. 15 What I have explained was the following case: P(β|D) ∝ P(D|β) P(β) posterior distribution prior distributionLikelihood β 0.3 1.3 This was the outcome (estimated parameter value & range) β 0.3 1.3 This was estimated β −∞ +∞ This was like nothing 6. By the way…
  • 16. 16 7. prior distribution P(β|D) ∝ P(D|β) P(β) prior distribution β −∞ +∞ What‘s this?
  • 17. 17 7. prior distribution Prior distribution • This is the other key point of Bayesian statistics • But interestingly we don‘t care this aspect for our analysis (and if you google Bayesian, most articles explain this firstly: Suck!) • We can include a subjective assumption of the probability distribution of parameters (i.e., prior distribution) before analysis (but don‘t have to and indeed we don‘t)
  • 18. 18 7. prior distribution An example • Question: to quantify mean and variability of our height — Probability districution of height: Gaussian — Shall we assume the parameters beforehand? μ= XX? ±σ=XX? This is called “prior distribution“ μ 170 180 175 ±σ 3 8 5 — We measure individuals and calculate the likelihoods — Multiply the posterior distribution by the likelihoods to obtain the posterior distribution
  • 19. 19 7. prior distribution An example • In case of average μ P(β|D) ∝ P(D|β) P(β) μ 170 180 175 prior dist. (your assumption) μ 160 178 171 Likelihood (measurement) Posterior dist. (output: updated distribution after measurement) μ 174 166 179
  • 20. 20 7. prior distribution 170 180 175 P(β|D) ∝ P(D|β) P(β) 160 178 171174 166 179 In our study μ 160 178 171 μ 171 160 178 β −∞ +∞ To avoid subjectivity
  • 21. 21 8. Summary Recommendation: If your interest is the effect size, use Bayesian If it is to support hypothesis, use Frequentist β 0.3 1.3 Any value you estimated from your samples can be the parameter, following a probability distribution P(β|D) ∝ P(D|β) P(β) Prior information can be important in other field but this is not important for us: so, let‘s ignore.