SlideShare a Scribd company logo
Probability
Questions
• what is a good general size for artifact
samples?
• what proportion of populations of interest
should we be attempting to sample?
• how do we evaluate the absence of an
artifact type in our collections?
“frequentist” approach
• probability should be assessed in purely
objective terms
• no room for subjectivity on the part of
individual researchers
• knowledge about probabilities comes from
the relative frequency of a large number of
trials
– this is a good model for coin tossing
– not so useful for archaeology, where many of
the events that interest us are unique…
Bayesian approach
• Bayes Theorem
– Thomas Bayes
– 18th century English clergyman

• concerned with integrating “prior knowledge” into
calculations of probability
• problematic for frequentists
– prior knowledge = bias, subjectivity…
basic concepts
• probability of event = p
0 <= p <= 1
0 = certain non-occurrence
1 = certain occurrence

• .5 = even odds
• .1 = 1 chance out of 10
basic concepts (cont.)
• if A and B are mutually exclusive events:
P(A or B) = P(A) + P(B)
ex., die roll: P(1 or 6) = 1/6 + 1/6 = .33

• possibility set:
sum of all possible outcomes
~A = anything other than A
P(A or ~A) = P(A) + P(~A) = 1
basic concepts (cont.)
• discrete vs. continuous probabilities
• discrete
– finite number of outcomes

• continuous
– outcomes vary along continuous scale
discrete probabilities
.5

p
.25

HH
0

HT

TT
continuous probabilities
0.22
.2

total area under curve = 1

p

but
the probability of any
single value = 0

.1

∴ interested in the
0
0.00
-5

5

probability assoc. w/
intervals
independent events
• one event has no influence on the outcome
of another event
• if events A & B are independent
then P(A&B) = P(A)*P(B)

• if P(A&B) = P(A)*P(B)
then events A & B are independent

• coin flipping
if P(H) = P(T) = .5 then
P(HTHTH) = P(HHHHH) =
.5*.5*.5*.5*.5 = .55 = .03
• if you are flipping a coin and it has already
come up heads 6 times in a row, what are
the odds of an 7th head?

.5
• note that P(10H) < > P(4H,6T)
– lots of ways to achieve the 2nd result (therefore
much more probable)
• mutually exclusive events are not
independent
• rather, the most dependent kinds of events
– if not heads, then tails
– joint probability of 2 mutually exclusive events
is 0
• P(A&B)=0
conditional probability
• concern the odds of one event occurring,
given that another event has occurred
• P(A|B)=Prob of A, given B
e.g.
• consider a temporally ambiguous, but
generally late, pottery type
• the probability that an actual example is
“late” increases if found with other types of
pottery that are unambiguously late…
• P = probability that the specimen is late:
isolated:

P(Ta) = .7

w/ late pottery (Tb):

P(Ta|Tb) = .9

w/ early pottery (Tc):

P(Ta|Tc) = .3
conditional probability (cont.)
• P(B|A) = P(A&B)/P(A)
• if A and B are independent, then
P(B|A) = P(A)*P(B)/P(A)
P(B|A) = P(B)
Bayes Theorem
P( B ) P( A | B )
P ( B | A) =
P( B ) P( A | B ) + P( ~ B ) P( A |~ B )

• can be derived from the basic equation for
conditional probabilities
application
• archaeological data about ceramic design
– bowls and jars, decorated and undecorated

• previous excavations show:
– 75% of assemblage are bowls, 25% jars
– of the bowls, about 50% are decorated
– of the jars, only about 20% are decorated

• we have a decorated sherd fragment, but it’s too
small to determine its form…
• what is the probability that it comes from a bowl?
dec.
undec.

bowl
??

50% of bowls
20% of jars
50% of bowls
80% of jars

75%
•
•
•
•
•
•
•
•

jar
P ( B | A) =

P( B ) P( A | B )
P( B ) P( A | B ) + P( ~ B ) P( A |~ B )

25%

can solve for P(B|A)
events:??
events: B = “bowlness”; A = “decoratedness”
P(B)=??; P(A|B)=??
P(B)=.75; P(A|B)=.50
P(~B)=.25; P(A|~B)=.20
P(B|A)=.75*.50 / ((.75*50)+(.25*.20))
P(B|A)=.88
Binomial theorem
• P(n,k,p)
– probability of k successes in n trials
where the probability of success on any one
trial is p
– “success” = some specific event or outcome
– k specified outcomes
– n trials
– p probability of the specified outcome in 1 trial
P ( n, k , p ) = C ( n, k ) p ( 1 − p )
k

n−k

where

n!
C ( n, k ) =
k!( n − k )!
n! = n*(n-1)*(n-2)…*1 (where n is an integer)
0!=1
binomial distribution
• binomial theorem describes a theoretical
distribution that can be plotted in two
different ways:
– probability density function (PDF)
– cumulative density function (CDF)
probability density function (PDF)
• summarizes how odds/probabilities are
distributed among the events that can arise
from a series of trials
ex: coin toss
• we toss a coin three times, defining the
outcome head as a “success”…
• what are the possible outcomes?
• how do we calculate their probabilities?
coin toss (cont.)
• how do we assign values to
P(n,k,p)?
•
•
•
•

3 trials; n = 3
even odds of success; p=.5
P(3,k,.5)
there are 4 possible values for ‘k’,
and we want to calculate P for
each of them

k
0

TTT

1

HTT (THT,TTH)

2

HHT (HTH, THH)

3

HHH

“probability of k successes in n trials
where the probability of success on any one trial is p”
(
P( 3,1,.5) = (
P( 3,0,.5) =

(

3!
0!( 3− 0 )!

3!
1!( 3−1)!

) p (1 − p )
k

).5 (1 − .5)
0

).5 (1 − .5)
1

n−k

3− 0

3−1

0.400
0.350
0.300
0.250
P(3,k,.5)

P ( n, k , p ) =

n!
k !( n − k )!

0.200
0.150
0.100
0.050
0.000
0

1

2
k

3
practical applications
• how do we interpret the absence of key
types in artifact samples??
• does sample size matter??
• does anything else matter??
example
1. we are interested in ceramic production in
southern Utah
2. we have surface collections from a
number of sites
 are any of them ceramic workshops??

3. evidence: ceramic “wasters”
 ethnoarchaeological data suggests that
wasters tend to make up about 5% of samples
at ceramic workshops
• one of our sites  15 sherds, none
identified as wasters…
• so, our evidence seems to suggest that this
site is not a workshop
• how strong is our conclusion??
• reverse the logic: assume that it is a ceramic
workshop
• new question:
– how likely is it to have missed collecting wasters in a
sample of 15 sherds from a real ceramic workshop??

• P(n,k,p)
[n trials, k successes, p prob. of success on 1 trial]

• P(15,0,.05)
[we may want to look at other values of k…]
P(15,k,.05)
0.46
0.37
0.13
0.03
0.00

0.50
0.40
P(15,k,.05)

k
0
1
2
3
4
…
15

0.30
0.20
0.10
0.00
0

5

10
k

0.00

15
• how large a sample do you need before you
can place some reasonable confidence in the
idea that no wasters = no workshop?
• how could we find out??
• we could plot P(n,0,.05) against different
values of n…
0.50

P(n,0,.05)

0.40
0.30
0.20
0.10
0.00
0

50

100

150

n

• 50 – less than 1 chance in 10 of collecting
no wasters…
• 100 – about 1 chance in 100…
What if wasters existed at a higher proportion than 5%??
0.50
0.45
p=.05

0.35
P(n,0,p)

0.40

p=.10

0.30
0.25
0.20
0.15
0.10
0.05
0.00
0

20

40

60

80
n

100

120

140

160
so, how big should samples be?
• depends on your research goals & interests
• need big samples to study rare items…
• “rules of thumb” are usually misguided (ex.
“200 pollen grains is a valid sample”)
• in general, sheer sample size is more
important that the actual proportion
• large samples that constitute a very small
proportion of a population may be highly
useful for inferential purposes
• the plots we have been using are probability
density functions (PDF)
• cumulative density functions (CDF) have a
special purpose
• example based on mortuary data…
Pre-Dynastic cemeteries in Upper Egypt
Site 1
•
•
•

800 graves
160 exhibit body position and grave goods that mark
members of a distinct ethnicity (group A)
relative frequency of 0.2

Site 2
•
•
•

badly damaged; only 50 graves excavated
6 exhibit “group A” characteristics
relative frequency of 0.12
• expressed as a proportion, Site 1 has around
twice as many burials of individuals from
“group A” as Site 2
• how seriously should we take this
observation as evidence about social
differences between underlying
populations?
• assume for the moment that there is no
difference between these societies—they
represent samples from the same underlying
population
• how likely would it be to collect our Site 2
sample from this underlying population?
• we could use data merged from both sites as
a basis for characterizing this population
• but since the sample from Site 1 is so large,
lets just use it …
• Site 1 suggests that about 20% of our
society belong to this distinct social class…
• if so, we might have expected that 10 of the
50 sites excavated from site 2 would belong
to this class
• but we found only 6…
• how likely is it that this difference (10 vs. 6)
could arise just from random chance??
• to answer this question, we have to be
interested in more than just the probability
associated with the single observed
outcome “6”
• we are also interested in the total
probability associated with outcomes that
are more extreme than “6”…
• imagine a simulation of the
discovery/excavation process of graves at
Site 2:
• repeated drawing of 50 balls from a jar:
– ca. 800 balls
– 80% black, 20% white

• on average, samples will contain 10 white
balls, but individual samples will vary
• by keeping score on how many times we
draw a sample that is as, or more divergent
(relative to the mean sample) than what we
observed in our real-world sample…
• this means we have to tally all samples that
produce 6, 5, 4…0, white balls…
• a tally of just those samples with 6 white
balls eliminates crucial evidence…
• we can use the binomial theorem instead of
the drawing experiment, but the same logic
applies
• a cumulative density function (CDF)
displays probabilities associated with a
range of outcomes (such as 6 to 0 graves
with evidence for elite status)
n
50
50
50
50
50
50
50

k
0
1
2
3
4
5
6

p
0.20
0.20
0.20
0.20
0.20
0.20
0.20

P(n,k,p)
0.000
0.000
0.001
0.004
0.013
0.030
0.055

cumP
0.000
0.000
0.001
0.006
0.018
0.048
0.103
1.00
0.90

cum P(50,k,.20)

0.80
0.70
0.60
0.50
0.40
0.30
0.20
0.10
0.00
0

10

20

k

30

40

50
• so, the odds are about 1 in 10 that the
differences we see could be attributed to
random effects—rather than social
differences
• you have to decide what this observation
really means, and other kinds of evidence
will probably play a role in your decision…

More Related Content

Similar to 4 probability

Probablity
ProbablityProbablity
PROBABILITY THEORIES.pptx
PROBABILITY THEORIES.pptxPROBABILITY THEORIES.pptx
PROBABILITY THEORIES.pptx
MarcJoshuaGorospe
 
Phylogenetics2
Phylogenetics2Phylogenetics2
Phylogenetics2
Sébastien De Landtsheer
 
probability
probabilityprobability
probability
Dr.Muhammad Omer
 
Stat.pptx
Stat.pptxStat.pptx
Stat.pptx
ValDarylAnhao2
 
Class 11 Basic Probability.pptx
Class 11 Basic Probability.pptxClass 11 Basic Probability.pptx
Class 11 Basic Probability.pptx
CallplanetsDeveloper
 
Probability Theory for Data Scientists
Probability Theory for Data ScientistsProbability Theory for Data Scientists
Probability Theory for Data Scientists
Ferdin Joe John Joseph PhD
 
probability
probabilityprobability
probability
Unsa Shakir
 
Statistical computing 1
Statistical computing 1Statistical computing 1
Statistical computing 1
Padma Metta
 
Basic statistics for algorithmic trading
Basic statistics for algorithmic tradingBasic statistics for algorithmic trading
Basic statistics for algorithmic trading
QuantInsti
 
Crisis of confidence, p-hacking and the future of psychology
Crisis of confidence, p-hacking and the future of psychologyCrisis of confidence, p-hacking and the future of psychology
Crisis of confidence, p-hacking and the future of psychology
Matti Heino
 
Simple probability
Simple probabilitySimple probability
Simple probability
06426345
 
Unit 1-probability
Unit 1-probabilityUnit 1-probability
Unit 1-probability
Rai University
 
powerpoints probability.pptx
powerpoints probability.pptxpowerpoints probability.pptx
powerpoints probability.pptx
carrie mixto
 
Lec13_Bayes.pptx
Lec13_Bayes.pptxLec13_Bayes.pptx
Lec13_Bayes.pptx
KhushiDuttVatsa
 
Chapter Five.ppthhjhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhh
Chapter Five.ppthhjhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhChapter Five.ppthhjhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhh
Chapter Five.ppthhjhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhh
beshahashenafe20
 

Similar to 4 probability (20)

4 probability (1)
4 probability (1)4 probability (1)
4 probability (1)
 
4 probability
4 probability4 probability
4 probability
 
4 probability
4 probability4 probability
4 probability
 
Probablity
ProbablityProbablity
Probablity
 
PROBABILITY THEORIES.pptx
PROBABILITY THEORIES.pptxPROBABILITY THEORIES.pptx
PROBABILITY THEORIES.pptx
 
Phylogenetics2
Phylogenetics2Phylogenetics2
Phylogenetics2
 
probability
probabilityprobability
probability
 
Stat.pptx
Stat.pptxStat.pptx
Stat.pptx
 
Class 11 Basic Probability.pptx
Class 11 Basic Probability.pptxClass 11 Basic Probability.pptx
Class 11 Basic Probability.pptx
 
Probability Theory for Data Scientists
Probability Theory for Data ScientistsProbability Theory for Data Scientists
Probability Theory for Data Scientists
 
probability
probabilityprobability
probability
 
Statistical computing 1
Statistical computing 1Statistical computing 1
Statistical computing 1
 
Basic statistics for algorithmic trading
Basic statistics for algorithmic tradingBasic statistics for algorithmic trading
Basic statistics for algorithmic trading
 
2주차
2주차2주차
2주차
 
Crisis of confidence, p-hacking and the future of psychology
Crisis of confidence, p-hacking and the future of psychologyCrisis of confidence, p-hacking and the future of psychology
Crisis of confidence, p-hacking and the future of psychology
 
Simple probability
Simple probabilitySimple probability
Simple probability
 
Unit 1-probability
Unit 1-probabilityUnit 1-probability
Unit 1-probability
 
powerpoints probability.pptx
powerpoints probability.pptxpowerpoints probability.pptx
powerpoints probability.pptx
 
Lec13_Bayes.pptx
Lec13_Bayes.pptxLec13_Bayes.pptx
Lec13_Bayes.pptx
 
Chapter Five.ppthhjhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhh
Chapter Five.ppthhjhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhChapter Five.ppthhjhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhh
Chapter Five.ppthhjhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhh
 

Recently uploaded

Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
UiPathCommunity
 
Elizabeth Buie - Older adults: Are we really designing for our future selves?
Elizabeth Buie - Older adults: Are we really designing for our future selves?Elizabeth Buie - Older adults: Are we really designing for our future selves?
Elizabeth Buie - Older adults: Are we really designing for our future selves?
Nexer Digital
 
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdfSmart TV Buyer Insights Survey 2024 by 91mobiles.pdf
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf
91mobiles
 
The Art of the Pitch: WordPress Relationships and Sales
The Art of the Pitch: WordPress Relationships and SalesThe Art of the Pitch: WordPress Relationships and Sales
The Art of the Pitch: WordPress Relationships and Sales
Laura Byrne
 
Accelerate your Kubernetes clusters with Varnish Caching
Accelerate your Kubernetes clusters with Varnish CachingAccelerate your Kubernetes clusters with Varnish Caching
Accelerate your Kubernetes clusters with Varnish Caching
Thijs Feryn
 
Leading Change strategies and insights for effective change management pdf 1.pdf
Leading Change strategies and insights for effective change management pdf 1.pdfLeading Change strategies and insights for effective change management pdf 1.pdf
Leading Change strategies and insights for effective change management pdf 1.pdf
OnBoard
 
UiPath Community Day Dubai: AI at Work..
UiPath Community Day Dubai: AI at Work..UiPath Community Day Dubai: AI at Work..
UiPath Community Day Dubai: AI at Work..
UiPathCommunity
 
Securing your Kubernetes cluster_ a step-by-step guide to success !
Securing your Kubernetes cluster_ a step-by-step guide to success !Securing your Kubernetes cluster_ a step-by-step guide to success !
Securing your Kubernetes cluster_ a step-by-step guide to success !
KatiaHIMEUR1
 
Removing Uninteresting Bytes in Software Fuzzing
Removing Uninteresting Bytes in Software FuzzingRemoving Uninteresting Bytes in Software Fuzzing
Removing Uninteresting Bytes in Software Fuzzing
Aftab Hussain
 
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdfFIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance
 
Secstrike : Reverse Engineering & Pwnable tools for CTF.pptx
Secstrike : Reverse Engineering & Pwnable tools for CTF.pptxSecstrike : Reverse Engineering & Pwnable tools for CTF.pptx
Secstrike : Reverse Engineering & Pwnable tools for CTF.pptx
nkrafacyberclub
 
Climate Impact of Software Testing at Nordic Testing Days
Climate Impact of Software Testing at Nordic Testing DaysClimate Impact of Software Testing at Nordic Testing Days
Climate Impact of Software Testing at Nordic Testing Days
Kari Kakkonen
 
PCI PIN Basics Webinar from the Controlcase Team
PCI PIN Basics Webinar from the Controlcase TeamPCI PIN Basics Webinar from the Controlcase Team
PCI PIN Basics Webinar from the Controlcase Team
ControlCase
 
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdfFIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
FIDO Alliance
 
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Albert Hoitingh
 
zkStudyClub - Reef: Fast Succinct Non-Interactive Zero-Knowledge Regex Proofs
zkStudyClub - Reef: Fast Succinct Non-Interactive Zero-Knowledge Regex ProofszkStudyClub - Reef: Fast Succinct Non-Interactive Zero-Knowledge Regex Proofs
zkStudyClub - Reef: Fast Succinct Non-Interactive Zero-Knowledge Regex Proofs
Alex Pruden
 
GraphRAG is All You need? LLM & Knowledge Graph
GraphRAG is All You need? LLM & Knowledge GraphGraphRAG is All You need? LLM & Knowledge Graph
GraphRAG is All You need? LLM & Knowledge Graph
Guy Korland
 
PHP Frameworks: I want to break free (IPC Berlin 2024)
PHP Frameworks: I want to break free (IPC Berlin 2024)PHP Frameworks: I want to break free (IPC Berlin 2024)
PHP Frameworks: I want to break free (IPC Berlin 2024)
Ralf Eggert
 
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
Sri Ambati
 
Assure Contact Center Experiences for Your Customers With ThousandEyes
Assure Contact Center Experiences for Your Customers With ThousandEyesAssure Contact Center Experiences for Your Customers With ThousandEyes
Assure Contact Center Experiences for Your Customers With ThousandEyes
ThousandEyes
 

Recently uploaded (20)

Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
 
Elizabeth Buie - Older adults: Are we really designing for our future selves?
Elizabeth Buie - Older adults: Are we really designing for our future selves?Elizabeth Buie - Older adults: Are we really designing for our future selves?
Elizabeth Buie - Older adults: Are we really designing for our future selves?
 
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdfSmart TV Buyer Insights Survey 2024 by 91mobiles.pdf
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf
 
The Art of the Pitch: WordPress Relationships and Sales
The Art of the Pitch: WordPress Relationships and SalesThe Art of the Pitch: WordPress Relationships and Sales
The Art of the Pitch: WordPress Relationships and Sales
 
Accelerate your Kubernetes clusters with Varnish Caching
Accelerate your Kubernetes clusters with Varnish CachingAccelerate your Kubernetes clusters with Varnish Caching
Accelerate your Kubernetes clusters with Varnish Caching
 
Leading Change strategies and insights for effective change management pdf 1.pdf
Leading Change strategies and insights for effective change management pdf 1.pdfLeading Change strategies and insights for effective change management pdf 1.pdf
Leading Change strategies and insights for effective change management pdf 1.pdf
 
UiPath Community Day Dubai: AI at Work..
UiPath Community Day Dubai: AI at Work..UiPath Community Day Dubai: AI at Work..
UiPath Community Day Dubai: AI at Work..
 
Securing your Kubernetes cluster_ a step-by-step guide to success !
Securing your Kubernetes cluster_ a step-by-step guide to success !Securing your Kubernetes cluster_ a step-by-step guide to success !
Securing your Kubernetes cluster_ a step-by-step guide to success !
 
Removing Uninteresting Bytes in Software Fuzzing
Removing Uninteresting Bytes in Software FuzzingRemoving Uninteresting Bytes in Software Fuzzing
Removing Uninteresting Bytes in Software Fuzzing
 
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdfFIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
 
Secstrike : Reverse Engineering & Pwnable tools for CTF.pptx
Secstrike : Reverse Engineering & Pwnable tools for CTF.pptxSecstrike : Reverse Engineering & Pwnable tools for CTF.pptx
Secstrike : Reverse Engineering & Pwnable tools for CTF.pptx
 
Climate Impact of Software Testing at Nordic Testing Days
Climate Impact of Software Testing at Nordic Testing DaysClimate Impact of Software Testing at Nordic Testing Days
Climate Impact of Software Testing at Nordic Testing Days
 
PCI PIN Basics Webinar from the Controlcase Team
PCI PIN Basics Webinar from the Controlcase TeamPCI PIN Basics Webinar from the Controlcase Team
PCI PIN Basics Webinar from the Controlcase Team
 
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdfFIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
 
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
 
zkStudyClub - Reef: Fast Succinct Non-Interactive Zero-Knowledge Regex Proofs
zkStudyClub - Reef: Fast Succinct Non-Interactive Zero-Knowledge Regex ProofszkStudyClub - Reef: Fast Succinct Non-Interactive Zero-Knowledge Regex Proofs
zkStudyClub - Reef: Fast Succinct Non-Interactive Zero-Knowledge Regex Proofs
 
GraphRAG is All You need? LLM & Knowledge Graph
GraphRAG is All You need? LLM & Knowledge GraphGraphRAG is All You need? LLM & Knowledge Graph
GraphRAG is All You need? LLM & Knowledge Graph
 
PHP Frameworks: I want to break free (IPC Berlin 2024)
PHP Frameworks: I want to break free (IPC Berlin 2024)PHP Frameworks: I want to break free (IPC Berlin 2024)
PHP Frameworks: I want to break free (IPC Berlin 2024)
 
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
 
Assure Contact Center Experiences for Your Customers With ThousandEyes
Assure Contact Center Experiences for Your Customers With ThousandEyesAssure Contact Center Experiences for Your Customers With ThousandEyes
Assure Contact Center Experiences for Your Customers With ThousandEyes
 

4 probability

  • 2. Questions • what is a good general size for artifact samples? • what proportion of populations of interest should we be attempting to sample? • how do we evaluate the absence of an artifact type in our collections?
  • 3. “frequentist” approach • probability should be assessed in purely objective terms • no room for subjectivity on the part of individual researchers • knowledge about probabilities comes from the relative frequency of a large number of trials – this is a good model for coin tossing – not so useful for archaeology, where many of the events that interest us are unique…
  • 4. Bayesian approach • Bayes Theorem – Thomas Bayes – 18th century English clergyman • concerned with integrating “prior knowledge” into calculations of probability • problematic for frequentists – prior knowledge = bias, subjectivity…
  • 5. basic concepts • probability of event = p 0 <= p <= 1 0 = certain non-occurrence 1 = certain occurrence • .5 = even odds • .1 = 1 chance out of 10
  • 6. basic concepts (cont.) • if A and B are mutually exclusive events: P(A or B) = P(A) + P(B) ex., die roll: P(1 or 6) = 1/6 + 1/6 = .33 • possibility set: sum of all possible outcomes ~A = anything other than A P(A or ~A) = P(A) + P(~A) = 1
  • 7. basic concepts (cont.) • discrete vs. continuous probabilities • discrete – finite number of outcomes • continuous – outcomes vary along continuous scale
  • 9. continuous probabilities 0.22 .2 total area under curve = 1 p but the probability of any single value = 0 .1 ∴ interested in the 0 0.00 -5 5 probability assoc. w/ intervals
  • 10. independent events • one event has no influence on the outcome of another event • if events A & B are independent then P(A&B) = P(A)*P(B) • if P(A&B) = P(A)*P(B) then events A & B are independent • coin flipping if P(H) = P(T) = .5 then P(HTHTH) = P(HHHHH) = .5*.5*.5*.5*.5 = .55 = .03
  • 11. • if you are flipping a coin and it has already come up heads 6 times in a row, what are the odds of an 7th head? .5 • note that P(10H) < > P(4H,6T) – lots of ways to achieve the 2nd result (therefore much more probable)
  • 12. • mutually exclusive events are not independent • rather, the most dependent kinds of events – if not heads, then tails – joint probability of 2 mutually exclusive events is 0 • P(A&B)=0
  • 13. conditional probability • concern the odds of one event occurring, given that another event has occurred • P(A|B)=Prob of A, given B
  • 14. e.g. • consider a temporally ambiguous, but generally late, pottery type • the probability that an actual example is “late” increases if found with other types of pottery that are unambiguously late… • P = probability that the specimen is late: isolated: P(Ta) = .7 w/ late pottery (Tb): P(Ta|Tb) = .9 w/ early pottery (Tc): P(Ta|Tc) = .3
  • 15. conditional probability (cont.) • P(B|A) = P(A&B)/P(A) • if A and B are independent, then P(B|A) = P(A)*P(B)/P(A) P(B|A) = P(B)
  • 16. Bayes Theorem P( B ) P( A | B ) P ( B | A) = P( B ) P( A | B ) + P( ~ B ) P( A |~ B ) • can be derived from the basic equation for conditional probabilities
  • 17. application • archaeological data about ceramic design – bowls and jars, decorated and undecorated • previous excavations show: – 75% of assemblage are bowls, 25% jars – of the bowls, about 50% are decorated – of the jars, only about 20% are decorated • we have a decorated sherd fragment, but it’s too small to determine its form… • what is the probability that it comes from a bowl?
  • 18. dec. undec. bowl ?? 50% of bowls 20% of jars 50% of bowls 80% of jars 75% • • • • • • • • jar P ( B | A) = P( B ) P( A | B ) P( B ) P( A | B ) + P( ~ B ) P( A |~ B ) 25% can solve for P(B|A) events:?? events: B = “bowlness”; A = “decoratedness” P(B)=??; P(A|B)=?? P(B)=.75; P(A|B)=.50 P(~B)=.25; P(A|~B)=.20 P(B|A)=.75*.50 / ((.75*50)+(.25*.20)) P(B|A)=.88
  • 19. Binomial theorem • P(n,k,p) – probability of k successes in n trials where the probability of success on any one trial is p – “success” = some specific event or outcome – k specified outcomes – n trials – p probability of the specified outcome in 1 trial
  • 20. P ( n, k , p ) = C ( n, k ) p ( 1 − p ) k n−k where n! C ( n, k ) = k!( n − k )! n! = n*(n-1)*(n-2)…*1 (where n is an integer) 0!=1
  • 21. binomial distribution • binomial theorem describes a theoretical distribution that can be plotted in two different ways: – probability density function (PDF) – cumulative density function (CDF)
  • 22. probability density function (PDF) • summarizes how odds/probabilities are distributed among the events that can arise from a series of trials
  • 23. ex: coin toss • we toss a coin three times, defining the outcome head as a “success”… • what are the possible outcomes? • how do we calculate their probabilities?
  • 24. coin toss (cont.) • how do we assign values to P(n,k,p)? • • • • 3 trials; n = 3 even odds of success; p=.5 P(3,k,.5) there are 4 possible values for ‘k’, and we want to calculate P for each of them k 0 TTT 1 HTT (THT,TTH) 2 HHT (HTH, THH) 3 HHH “probability of k successes in n trials where the probability of success on any one trial is p”
  • 25. ( P( 3,1,.5) = ( P( 3,0,.5) = ( 3! 0!( 3− 0 )! 3! 1!( 3−1)! ) p (1 − p ) k ).5 (1 − .5) 0 ).5 (1 − .5) 1 n−k 3− 0 3−1 0.400 0.350 0.300 0.250 P(3,k,.5) P ( n, k , p ) = n! k !( n − k )! 0.200 0.150 0.100 0.050 0.000 0 1 2 k 3
  • 26. practical applications • how do we interpret the absence of key types in artifact samples?? • does sample size matter?? • does anything else matter??
  • 27. example 1. we are interested in ceramic production in southern Utah 2. we have surface collections from a number of sites  are any of them ceramic workshops?? 3. evidence: ceramic “wasters”  ethnoarchaeological data suggests that wasters tend to make up about 5% of samples at ceramic workshops
  • 28. • one of our sites  15 sherds, none identified as wasters… • so, our evidence seems to suggest that this site is not a workshop • how strong is our conclusion??
  • 29. • reverse the logic: assume that it is a ceramic workshop • new question: – how likely is it to have missed collecting wasters in a sample of 15 sherds from a real ceramic workshop?? • P(n,k,p) [n trials, k successes, p prob. of success on 1 trial] • P(15,0,.05) [we may want to look at other values of k…]
  • 31. • how large a sample do you need before you can place some reasonable confidence in the idea that no wasters = no workshop? • how could we find out?? • we could plot P(n,0,.05) against different values of n…
  • 32. 0.50 P(n,0,.05) 0.40 0.30 0.20 0.10 0.00 0 50 100 150 n • 50 – less than 1 chance in 10 of collecting no wasters… • 100 – about 1 chance in 100…
  • 33. What if wasters existed at a higher proportion than 5%?? 0.50 0.45 p=.05 0.35 P(n,0,p) 0.40 p=.10 0.30 0.25 0.20 0.15 0.10 0.05 0.00 0 20 40 60 80 n 100 120 140 160
  • 34. so, how big should samples be? • depends on your research goals & interests • need big samples to study rare items… • “rules of thumb” are usually misguided (ex. “200 pollen grains is a valid sample”) • in general, sheer sample size is more important that the actual proportion • large samples that constitute a very small proportion of a population may be highly useful for inferential purposes
  • 35. • the plots we have been using are probability density functions (PDF) • cumulative density functions (CDF) have a special purpose • example based on mortuary data…
  • 36. Pre-Dynastic cemeteries in Upper Egypt Site 1 • • • 800 graves 160 exhibit body position and grave goods that mark members of a distinct ethnicity (group A) relative frequency of 0.2 Site 2 • • • badly damaged; only 50 graves excavated 6 exhibit “group A” characteristics relative frequency of 0.12
  • 37. • expressed as a proportion, Site 1 has around twice as many burials of individuals from “group A” as Site 2 • how seriously should we take this observation as evidence about social differences between underlying populations?
  • 38. • assume for the moment that there is no difference between these societies—they represent samples from the same underlying population • how likely would it be to collect our Site 2 sample from this underlying population? • we could use data merged from both sites as a basis for characterizing this population • but since the sample from Site 1 is so large, lets just use it …
  • 39. • Site 1 suggests that about 20% of our society belong to this distinct social class… • if so, we might have expected that 10 of the 50 sites excavated from site 2 would belong to this class • but we found only 6…
  • 40. • how likely is it that this difference (10 vs. 6) could arise just from random chance?? • to answer this question, we have to be interested in more than just the probability associated with the single observed outcome “6” • we are also interested in the total probability associated with outcomes that are more extreme than “6”…
  • 41. • imagine a simulation of the discovery/excavation process of graves at Site 2: • repeated drawing of 50 balls from a jar: – ca. 800 balls – 80% black, 20% white • on average, samples will contain 10 white balls, but individual samples will vary
  • 42. • by keeping score on how many times we draw a sample that is as, or more divergent (relative to the mean sample) than what we observed in our real-world sample… • this means we have to tally all samples that produce 6, 5, 4…0, white balls… • a tally of just those samples with 6 white balls eliminates crucial evidence…
  • 43. • we can use the binomial theorem instead of the drawing experiment, but the same logic applies • a cumulative density function (CDF) displays probabilities associated with a range of outcomes (such as 6 to 0 graves with evidence for elite status)
  • 46. • so, the odds are about 1 in 10 that the differences we see could be attributed to random effects—rather than social differences • you have to decide what this observation really means, and other kinds of evidence will probably play a role in your decision…