This document provides an introduction to Bayesian methods for theory, computation, inference and prediction. It discusses key concepts in Bayesian statistics including the likelihood principle, the likelihood function, Bayes' theorem, and using Markov chain Monte Carlo methods like the Metropolis-Hastings algorithm to perform posterior integration when closed-form solutions are not possible. Examples are provided on using Bayesian regression to model the relationship between salmon body length and egg mass while incorporating prior information. The summary concludes that the Bayesian approach provides a coherent way to quantify uncertainty and make predictions accounting for both aleatory and epistemic sources of variation.
This talk on Bayesian statistics is tailored especially for biologists and ecologists. The main points are to highlight what the particular benefit to use Bayesian is in comparison to frequentist statistics and to understand the essence for practical application for scientific purposes.
This talk on Bayesian statistics is tailored especially for biologists and ecologists. The main points are to highlight what the particular benefit to use Bayesian is in comparison to frequentist statistics and to understand the essence for practical application for scientific purposes.
Chapter 6 part2-Introduction to Inference-Tests of Significance, Stating Hyp...nszakir
Mathematics, Statistics, Introduction to Inference, Tests of Significance, The Reasoning of Tests of Significance, Stating Hypotheses, Test Statistics, P-values, Statistical Significance, Test for a Population Mean, Two-Sided Significance Tests and Confidence Intervals
What is bayesian statistics and how is it different?Wayne Lee
Gentle intro to Bayesian Statistics and how it's different from classical frequentist statistics. Assumes you have basic statistical knowledge.
Why "Am I pregnant?" is a question more suitable for Bayesian techniques and not actually suitable at all for Frequentist techniques!
Data Science - Part XII - Ridge Regression, LASSO, and Elastic NetsDerek Kane
This lecture provides an overview of some modern regression techniques including a discussion of the bias variance tradeoff for regression errors and the topic of shrinkage estimators. This leads into an overview of ridge regression, LASSO, and elastic nets. These topics will be discussed in detail and we will go through the calibration/diagnostics and then conclude with a practical example highlighting the techniques.
Uncertainty & Probability
Baye's rule
Choosing Hypotheses- Maximum a posteriori
Maximum Likelihood - Baye's concept learning
Maximum Likelihood of real valued function
Bayes optimal Classifier
Joint distributions
Naive Bayes Classifier
Chapter 6 part2-Introduction to Inference-Tests of Significance, Stating Hyp...nszakir
Mathematics, Statistics, Introduction to Inference, Tests of Significance, The Reasoning of Tests of Significance, Stating Hypotheses, Test Statistics, P-values, Statistical Significance, Test for a Population Mean, Two-Sided Significance Tests and Confidence Intervals
What is bayesian statistics and how is it different?Wayne Lee
Gentle intro to Bayesian Statistics and how it's different from classical frequentist statistics. Assumes you have basic statistical knowledge.
Why "Am I pregnant?" is a question more suitable for Bayesian techniques and not actually suitable at all for Frequentist techniques!
Data Science - Part XII - Ridge Regression, LASSO, and Elastic NetsDerek Kane
This lecture provides an overview of some modern regression techniques including a discussion of the bias variance tradeoff for regression errors and the topic of shrinkage estimators. This leads into an overview of ridge regression, LASSO, and elastic nets. These topics will be discussed in detail and we will go through the calibration/diagnostics and then conclude with a practical example highlighting the techniques.
Uncertainty & Probability
Baye's rule
Choosing Hypotheses- Maximum a posteriori
Maximum Likelihood - Baye's concept learning
Maximum Likelihood of real valued function
Bayes optimal Classifier
Joint distributions
Naive Bayes Classifier
Palestine last event orientationfvgnh .pptxRaedMohamed3
An EFL lesson about the current events in Palestine. It is intended to be for intermediate students who wish to increase their listening skills through a short lesson in power point.
Instructions for Submissions thorugh G- Classroom.pptxJheel Barad
This presentation provides a briefing on how to upload submissions and documents in Google Classroom. It was prepared as part of an orientation for new Sainik School in-service teacher trainees. As a training officer, my goal is to ensure that you are comfortable and proficient with this essential tool for managing assignments and fostering student engagement.
A Strategic Approach: GenAI in EducationPeter Windle
Artificial Intelligence (AI) technologies such as Generative AI, Image Generators and Large Language Models have had a dramatic impact on teaching, learning and assessment over the past 18 months. The most immediate threat AI posed was to Academic Integrity with Higher Education Institutes (HEIs) focusing their efforts on combating the use of GenAI in assessment. Guidelines were developed for staff and students, policies put in place too. Innovative educators have forged paths in the use of Generative AI for teaching, learning and assessments leading to pockets of transformation springing up across HEIs, often with little or no top-down guidance, support or direction.
This Gasta posits a strategic approach to integrating AI into HEIs to prepare staff, students and the curriculum for an evolving world and workplace. We will highlight the advantages of working with these technologies beyond the realm of teaching, learning and assessment by considering prompt engineering skills, industry impact, curriculum changes, and the need for staff upskilling. In contrast, not engaging strategically with Generative AI poses risks, including falling behind peers, missed opportunities and failing to ensure our graduates remain employable. The rapid evolution of AI technologies necessitates a proactive and strategic approach if we are to remain relevant.
The Roman Empire A Historical Colossus.pdfkaushalkr1407
The Roman Empire, a vast and enduring power, stands as one of history's most remarkable civilizations, leaving an indelible imprint on the world. It emerged from the Roman Republic, transitioning into an imperial powerhouse under the leadership of Augustus Caesar in 27 BCE. This transformation marked the beginning of an era defined by unprecedented territorial expansion, architectural marvels, and profound cultural influence.
The empire's roots lie in the city of Rome, founded, according to legend, by Romulus in 753 BCE. Over centuries, Rome evolved from a small settlement to a formidable republic, characterized by a complex political system with elected officials and checks on power. However, internal strife, class conflicts, and military ambitions paved the way for the end of the Republic. Julius Caesar’s dictatorship and subsequent assassination in 44 BCE created a power vacuum, leading to a civil war. Octavian, later Augustus, emerged victorious, heralding the Roman Empire’s birth.
Under Augustus, the empire experienced the Pax Romana, a 200-year period of relative peace and stability. Augustus reformed the military, established efficient administrative systems, and initiated grand construction projects. The empire's borders expanded, encompassing territories from Britain to Egypt and from Spain to the Euphrates. Roman legions, renowned for their discipline and engineering prowess, secured and maintained these vast territories, building roads, fortifications, and cities that facilitated control and integration.
The Roman Empire’s society was hierarchical, with a rigid class system. At the top were the patricians, wealthy elites who held significant political power. Below them were the plebeians, free citizens with limited political influence, and the vast numbers of slaves who formed the backbone of the economy. The family unit was central, governed by the paterfamilias, the male head who held absolute authority.
Culturally, the Romans were eclectic, absorbing and adapting elements from the civilizations they encountered, particularly the Greeks. Roman art, literature, and philosophy reflected this synthesis, creating a rich cultural tapestry. Latin, the Roman language, became the lingua franca of the Western world, influencing numerous modern languages.
Roman architecture and engineering achievements were monumental. They perfected the arch, vault, and dome, constructing enduring structures like the Colosseum, Pantheon, and aqueducts. These engineering marvels not only showcased Roman ingenuity but also served practical purposes, from public entertainment to water supply.
2024.06.01 Introducing a competency framework for languag learning materials ...Sandy Millin
http://sandymillin.wordpress.com/iateflwebinar2024
Published classroom materials form the basis of syllabuses, drive teacher professional development, and have a potentially huge influence on learners, teachers and education systems. All teachers also create their own materials, whether a few sentences on a blackboard, a highly-structured fully-realised online course, or anything in between. Despite this, the knowledge and skills needed to create effective language learning materials are rarely part of teacher training, and are mostly learnt by trial and error.
Knowledge and skills frameworks, generally called competency frameworks, for ELT teachers, trainers and managers have existed for a few years now. However, until I created one for my MA dissertation, there wasn’t one drawing together what we need to know and do to be able to effectively produce language learning materials.
This webinar will introduce you to my framework, highlighting the key competencies I identified from my research. It will also show how anybody involved in language teaching (any language, not just English!), teacher training, managing schools or developing language learning materials can benefit from using the framework.
Model Attribute Check Company Auto PropertyCeline George
In Odoo, the multi-company feature allows you to manage multiple companies within a single Odoo database instance. Each company can have its own configurations while still sharing common resources such as products, customers, and suppliers.
Acetabularia Information For Class 9 .docxvaibhavrinwa19
Acetabularia acetabulum is a single-celled green alga that in its vegetative state is morphologically differentiated into a basal rhizoid and an axially elongated stalk, which bears whorls of branching hairs. The single diploid nucleus resides in the rhizoid.
Honest Reviews of Tim Han LMA Course Program.pptxtimhan337
Personal development courses are widely available today, with each one promising life-changing outcomes. Tim Han’s Life Mastery Achievers (LMA) Course has drawn a lot of interest. In addition to offering my frank assessment of Success Insider’s LMA Course, this piece examines the course’s effects via a variety of Tim Han LMA course reviews and Success Insider comments.
5. The Likelihood Principle
● All information contained in data x, with
respect to inference about the value of θ, is
contained in the likelihood function:
L | x ∝ P X= x |
Corey Chivers, 2012
7. The Likelihood Function
L | x ∝ P X= x |
L | x =f | x
Where θ is(are) our parameter(s) of interest
ex:
Attack rate
Fitness
Mean body mass
Mortality
etc...
Corey Chivers, 2012
9. The Ecologist's Quarter
Lands tails (caribou up) 60% of the time
● 1) What is the probability that I will flip tails, given that
I am flipping an ecologist's quarter (p(tail=0.6))?
P x | =0.6
● 2) What is the likelihood that I am flipping an
ecologist's quarter, given the flip(s) that I have
observed?
L=0.6 | x
Corey Chivers, 2012
10. The Ecologist's Quarter
T H
L | x = ∏ ∏ 1−
t=1 h=1
L=0.6 | x=H T T H T
3 2
= ∏ 0.6 ∏ 0.4
t =1 h=1
= 0.03456
Corey Chivers, 2012
11. The Ecologist's Quarter
T H
L | x = ∏ ∏ 1−
t=1 h=1
L=0.6 | x=H T T H T
3 2 But what does this
= ∏ 0.6 ∏ 0.4 mean?
0.03456 ≠ P(θ|x) !!!!
t =1 h=1
= 0.03456
Corey Chivers, 2012
12. How do we ask Statistical Questions?
A Frequentist asks: What is the probability of
having observed data at least as extreme as my
data if the null hypothesis is true?
P(data | H0) ? ← note: P=1 does not mean P(H0)=1
A Bayesian asks: What is the probability of
hypotheses given that I have observed my data?
P(H | data) ? ← note: here H denotes the space of all
possible hypotheses
Corey Chivers, 2012
13. P(data | H0) P(H | data)
But we both want to make
inferences about our hypotheses,
not the data.
Corey Chivers, 2012
14. Bayes Theorem
● The posterior probability of θ, given
our observation (x) is proportional to the
likelihood times the prior probability of θ.
P x | P
P | x=
P x
Corey Chivers, 2012
16. The Ecologist's Quarter
T H
L | x = ∏ ∏ 1−
t=1 h=1
L=0.6 | x=H T T H T
3 2
= ∏ 0.6 ∏ 0.4
t =1 h=1
= 0.03456
Corey Chivers, 2012
17. Likelihood of data
given hypothesis
P( x | θ)
But we want to know
P(θ | x )
Corey Chivers, 2012
18. ● How can we make inferences about our
ecologist's quarter using Bayes?
P( x | θ) P(θ)
P(θ | x )=
P( x )
Corey Chivers, 2012
19. ● How can we make inferences about our
ecologist's quarter using Bayes?
Likelihood
P x | P
P | x=
P x
Corey Chivers, 2012
20. ● How can we make inferences about our
ecologist's quarter using Bayes?
Likelihood Prior
P( x | θ) P(θ)
P(θ | x )=
P( x )
Corey Chivers, 2012
21. ● How can we make inferences about our
ecologist's quarter using Bayes?
Likelihood Prior
P x | P
P | x=
Posterior
P x
Corey Chivers, 2012
22. ● How can we make inferences about our
ecologist's quarter using Bayes?
Likelihood Prior
P x | P
P | x=
Posterior
P x
P x =∫ P x | P d
Not always a closed form solution possible!!
Corey Chivers, 2012
23.
24. Randomization to Solve Difficult
Problems
`
Feynman, Ulam &
Von Neumann
∫ f d
Corey Chivers, 2012
25. Monte Carlo
Throw darts at random Feynman, Ulam &
Von Neumann
(0,1)
P(blue) = ?
P(blue) = 1/2
P(blue) ~ 7/15 ~ 1/2
(0.5,0) (1,0)
Corey Chivers, 2012
26. Your turn...
Let's use Monte Carlo to estimate π
- Generate random x and y values using the number sheet
- Plot those points on your graph
How many of the points fall
within the circle?
y=17
x=4
29. Posterior Integration via Markov
Chain Monte Carlo
A Markov Chain is a mathematical construct
where given the present, the past and the
future are independent.
“Where I decide to go next depends not
on where I have been, or where I may
go in the future – but only on where I
am right now.”
-Andrey Markov (maybe)
Corey Chivers, 2012
32. Metropolis-Hastings Algorithm
1. Pick a starting location at
The Markovian Explorer!
random.
2. Choose a new location in
your vicinity.
3. Go to the new location with
probability:
p=min 1, x proposal
x current
4. Otherwise stay where you
are.
5. Repeat.
Corey Chivers, 2012
34. ● We've solved our integration problem!
P x | P
P | x=
P x
P | x∝ P x | P
Corey Chivers, 2012
35. Ex: Bayesian Regression
● Regression coefficients are traditionally
estimated via maximum likelihood.
● To obtain full posterior distributions, we can
view the regression problem from a Bayesian
perspective.
Corey Chivers, 2012
37. Example: Salmon Regression
Model Priors
Y =a+ bX +ϵ a ~ Normal (0,100)
ϵ ~ Normal( 0, σ) b ~ Normal (0,100)
σ ~ gamma (1,1/ 100)
P( a , b , σ | X , Y )∝ P( X ,Y | a , b , σ)
P( a) P(b) P( σ)
Corey Chivers, 2012
38. Example: Salmon Regression
Likelihood of the data (x,y), given
the parameters (a,b,σ):
n
P( X ,Y | a , b , σ)= ∏ N ( y i ,μ=a+ b x i , sd=σ)
i=1
Corey Chivers, 2012
42. ##@ 2.5 @##
>## Print the Bayesian Credible Intervals
> BCI(mcmc_salmon)
0.025 0.975 post_mean
a -13.16485 14.84092 0.9762583
b 0.127730 0.455046 0.2911597
Sigma 1.736082 3.186122 2.3303188
Inference:
Does body length have
EM =ab BL an effect on egg mass?
Corey Chivers, 2012
43. The Prior revisited
● What if we do have prior information?
● You have done a literature search and find that a
previous study on the same salmon population
found a slope of 0.6mg/cm (SE=0.1), and an
intercept of -3.1mg (SE=1.2).
How does this prior information change your
analysis?
Corey Chivers, 2012
45. Example: Salmon Regression
Informative
Model Priors
EM =ab BL a ~ Normal (−3.1,1 .2)
~ Normal 0, b ~ Normal (0.6,0 .1)
~ gamma1,1 /100
Corey Chivers, 2012
46. If you can formulate the likelihood function, you
can estimate the posterior, and we have a
coherent way to incorporate prior information.
Most experiments do happen in a vacuum.
Corey Chivers, 2012
47. Making predictions using point estimates can
be a dangerous endeavor – using the posterior
(aka predictive) distribution allows us to take
full account of uncertainty.
How sure are we about our predictions?
Corey Chivers, 2012
49. ##@ 3.1 @##
● Suppose you have a 90cm long individual
salmon, what do you predict to be the egg
mass produced by this individual?
● What is the posterior probability that the egg
mass produced will be greater than 35mg?
Corey Chivers, 2012
53. Extensions:
● By quantifying our uncertainty through
integration of the posterior distribution, we can
make better informed decisions.
● Bayesian analysis provides the basis for
decision theory.
● Bayesian analysis allows us to construct
hierarchical models of arbitrary complexity.
Corey Chivers, 2012
54. Summary
● The output of a Bayesian analysis is not a single estimate of
θ, but rather the entire posterior distribution., which
represents our degree of belief about the value of θ.
● To get a posterior distribution, we need to specify our prior
belief about θ.
● Complex Bayesian models can be estimated using MCMC.
● The posterior can be used to make both inference about θ,
and quantitative predictions with proper accounting of
uncertainty.
Corey Chivers, 2012
55. Questions for Corey
● You can email me!
Corey.chivers@mail.mcgill.ca
● I blog about statistics:
bayesianbiologist.com
● I tweet about statistics:
@cjbayesian
56. Resources
● Bayesian Updating using Gibbs Sampling
http://www.mrc-bsu.cam.ac.uk/bugs/winbugs/
● Just Another Gibbs Sampler
http://www-ice.iarc.fr/~martyn/software/jags/
● Chi-squared example, done Bayesian:
http://madere.biol.mcgill.ca/cchivers/biol373/chi-
squared_done_bayesian.pdf
Corey Chivers, 2012