SlideShare a Scribd company logo
Theory of Decision Time Dynamics,
with Applications to Memory
Pachella’s Speed Accuracy
Tradeoff Figure
Key Issues
• If accuracy builds up continuously with time as Pachella
suggests, how do we ensure that the results we
observe in different conditions don’t reflect changes in
the speed-accuracy tradeoff?
• How can we use reaction times to make inferences in
the face of the problem of speed-accuracy tradeoff?
– Relying on high levels of accuracy is highly problematic –
we can’t tell if participants are operating at different points
on the SAT function in different conditions or not!
• In general, it appears that we need a theory of how
accuracy builds up over time, and we need tasks that
produce both reaction times and error rates to make
inferences.
A Starting Place: Noisy Evidence
Accumulation Theory
• Consider a stimulus perturbed by noise.
– Maybe a cloud of dots with mean position m = +2 or -2 pixel
from the center of a screen
– Imagine that the cloud is updated once every 20 msec, of 50
times a second, but each time its mean position shifts randomly
with a standard deviation s of 10 pixels.
• What is theoretically possible maximum value of d’ based
on just one update?
• Suppose we sample n updates and add up the samples.
• Expected value of the sum = m*n
• Expected value of the standard deviation of the sum = sn
• What then is the theoretically possible maximum value of
d’ after n updates?
Some facts and some questions
• With very difficult stimuli, accuracy
always levels off at long processing
times.
– Why?
• Participant stops integrating before
the end of trial?
• Trial-to-trial variability in direction of
drift?
– Noise is between as well as or in
addition to within trials
• Imperfect integration (leakage or
mutual inhibition, to be discussed
later).
• If the subject controls the integration
time, how does he decide when to
stop?
• What is the optimal policy for deciding
when to stop integrating evidence?
– Maximize earnings per unit time?
– Maximize earning per unit ‘effort’?
A simple optimal model for a
sequential random sampling process
• Imagine we have two ‘urns’
– One with 2/3 black, 1/3 white balls
– One with 1/3 black, 2/3 white balls
• Suppose we sample ‘with replacement’, one ball at a time
– What can we conclude after drawing one black ball? One white ball?
– Two black balls? Two white balls? One white and one black?
• Sequential Probability Ratio test.
• Difference as log of the probability ratio.
• Starting place, bounds; priors
• Optimality: Minimizes the # of samples needed on average to
achieve a given success rate.
• DDM is the continuous analog of this
Ratcliff’s Drift Diffusion Model Applied
to a Perceptual Discrimination Task
• There is a single noisy evidence
variable that adds up samples of noisy
evidence over time.
• There is both between trial and within
trial variability.
• Assumes participants stop integrating
when a bound condition is reached.
• Speed emphasis: bounds closer to
starting point
• Accuracy emphasis: bounds farther
from starting point
• Different difficulty levels lead to
different frequencies of errors and
correct responses and different
distributions of error and correct
responses
• Graph at right from Smith and Ratcliff
shows accuracy and distribution
information within the same Quantile
probability plot
Application of the DDM to Memory
Matching is a matter of degree
What are the factors influencing ‘relatedness’?
Some features of
the model
Ratcliff & Murdock
(1976)
Study-Test Paradigm
• Study 16 words,
test 16 ‘old’ and
16 ‘new’
• Responses on a
six-point scale
– ‘Accuracy and
latency are
recorded’
Fits and Parameter Values
RTs for Hits and Correct Rejections
Sternberg Paridigm
• Set sizes 3, 4, 5
• Two participants data
averaged
Error Latencies
• Predicted error
latencies too large
• Error latencies show
extreme dependency
on tails of the
relatedness distribution
Some Remaining Issues
• For Memory Search:
– Who is right, Ratcliff or Sternberg?
– Resonance, relatedness, u and v parameters
– John Anderson and the fan effect
• Relation to semantic network and ‘propositional’ models of
memory search
– Spreading activation vs. similarity-based models
– The fan effect
• What is the basis of differences in confidence in the DDM?
– Time to reach a bound
– Continuing integration after the bound is reached
– In models with separate accumulators for evidence for both
decisions, activation of the looser can be used
The Leaky Competing Accumulator
Model as an Alternative to the DDM
• Separate evidence variables for each
alternative
– Generalizes easily to n>2 alternatives
• Evidence variables subject to leakage
and mutual inhibition
• Both can limit accuracy
• LCA offers a different way to think
about what it means to ‘make a
decision’
• LCA has elements of discreteness and
continuity
• Continuity in decision states is one
possible basis of variations in
confidence
• Research is ongoing testing
differential predictions of these
models!

More Related Content

Similar to 205_April_22.pptx

Simulation Models as a Research Method.ppt
Simulation Models as a Research Method.pptSimulation Models as a Research Method.ppt
Simulation Models as a Research Method.ppt
QidiwQidiwQidiw
 
Validity and Reliability of Cranfield-like Evaluation in Information Retrieval
Validity and Reliability of Cranfield-like Evaluation in Information RetrievalValidity and Reliability of Cranfield-like Evaluation in Information Retrieval
Validity and Reliability of Cranfield-like Evaluation in Information Retrieval
Julián Urbano
 
Planning of experiment in industrial research
Planning of experiment in industrial researchPlanning of experiment in industrial research
Planning of experiment in industrial research
pbbharate
 

Similar to 205_April_22.pptx (20)

E3 chap-09
E3 chap-09E3 chap-09
E3 chap-09
 
L7 method validation and modeling
L7 method validation and modelingL7 method validation and modeling
L7 method validation and modeling
 
Bad metric, bad! - Joseph Ours
Bad metric, bad! - Joseph OursBad metric, bad! - Joseph Ours
Bad metric, bad! - Joseph Ours
 
Bad metric, bad!
Bad metric, bad!Bad metric, bad!
Bad metric, bad!
 
Simple math for anomaly detection toufic boubez - metafor software - monito...
Simple math for anomaly detection   toufic boubez - metafor software - monito...Simple math for anomaly detection   toufic boubez - metafor software - monito...
Simple math for anomaly detection toufic boubez - metafor software - monito...
 
Simulation Models as a Research Method.ppt
Simulation Models as a Research Method.pptSimulation Models as a Research Method.ppt
Simulation Models as a Research Method.ppt
 
[CVPR2022, LongVersion] Online Continual Learning on a Contaminated Data Stre...
[CVPR2022, LongVersion] Online Continual Learning on a Contaminated Data Stre...[CVPR2022, LongVersion] Online Continual Learning on a Contaminated Data Stre...
[CVPR2022, LongVersion] Online Continual Learning on a Contaminated Data Stre...
 
5954987.ppt
5954987.ppt5954987.ppt
5954987.ppt
 
Turning Information chaos into reliable data
Turning Information chaos into reliable dataTurning Information chaos into reliable data
Turning Information chaos into reliable data
 
I love the smell of data in the morning (getting started with data science) ...
I love the smell of data in the morning (getting started with data science)  ...I love the smell of data in the morning (getting started with data science)  ...
I love the smell of data in the morning (getting started with data science) ...
 
Five Things I Learned While Building Anomaly Detection Tools - Toufic Boubez ...
Five Things I Learned While Building Anomaly Detection Tools - Toufic Boubez ...Five Things I Learned While Building Anomaly Detection Tools - Toufic Boubez ...
Five Things I Learned While Building Anomaly Detection Tools - Toufic Boubez ...
 
Hyperparameter Tuning
Hyperparameter TuningHyperparameter Tuning
Hyperparameter Tuning
 
Validity and Reliability of Cranfield-like Evaluation in Information Retrieval
Validity and Reliability of Cranfield-like Evaluation in Information RetrievalValidity and Reliability of Cranfield-like Evaluation in Information Retrieval
Validity and Reliability of Cranfield-like Evaluation in Information Retrieval
 
Mini datathon
Mini datathonMini datathon
Mini datathon
 
Mixed Effects Models - Centering and Transformations
Mixed Effects Models - Centering and TransformationsMixed Effects Models - Centering and Transformations
Mixed Effects Models - Centering and Transformations
 
Evaluation techniques
Evaluation techniquesEvaluation techniques
Evaluation techniques
 
e3-chap-09.ppt
e3-chap-09.ppte3-chap-09.ppt
e3-chap-09.ppt
 
Planning of experiment in industrial research
Planning of experiment in industrial researchPlanning of experiment in industrial research
Planning of experiment in industrial research
 
Risk Management and Reliable Forecasting using Un-reliable Data (magennis) - ...
Risk Management and Reliable Forecasting using Un-reliable Data (magennis) - ...Risk Management and Reliable Forecasting using Un-reliable Data (magennis) - ...
Risk Management and Reliable Forecasting using Un-reliable Data (magennis) - ...
 
Diagnosis Support by Machine Learning Using Posturography Data
Diagnosis Support by Machine Learning Using Posturography DataDiagnosis Support by Machine Learning Using Posturography Data
Diagnosis Support by Machine Learning Using Posturography Data
 

Recently uploaded

Dr. Nazrul Islam, Northern University Bangladesh - CV (29.5.2024).pdf
Dr. Nazrul Islam, Northern University Bangladesh - CV (29.5.2024).pdfDr. Nazrul Islam, Northern University Bangladesh - CV (29.5.2024).pdf
Dr. Nazrul Islam, Northern University Bangladesh - CV (29.5.2024).pdf
Dr. Nazrul Islam
 
皇冠体育- 皇冠体育官方网站- CROWN SPORTS| 立即访问【ac123.net】
皇冠体育- 皇冠体育官方网站- CROWN SPORTS| 立即访问【ac123.net】皇冠体育- 皇冠体育官方网站- CROWN SPORTS| 立即访问【ac123.net】
皇冠体育- 皇冠体育官方网站- CROWN SPORTS| 立即访问【ac123.net】
larisashrestha558
 
Transferable Skills - Your Roadmap - Part 1 and 2 - Dirk Spencer Senior Recru...
Transferable Skills - Your Roadmap - Part 1 and 2 - Dirk Spencer Senior Recru...Transferable Skills - Your Roadmap - Part 1 and 2 - Dirk Spencer Senior Recru...
Transferable Skills - Your Roadmap - Part 1 and 2 - Dirk Spencer Senior Recru...
Dirk Spencer Corporate Recruiter LION
 

Recently uploaded (20)

129. Reviewer Certificate in BioNature [2024]
129. Reviewer Certificate in BioNature [2024]129. Reviewer Certificate in BioNature [2024]
129. Reviewer Certificate in BioNature [2024]
 
欧洲杯投注app-欧洲杯投注app推荐-欧洲杯投注app| 立即访问【ac123.net】
欧洲杯投注app-欧洲杯投注app推荐-欧洲杯投注app| 立即访问【ac123.net】欧洲杯投注app-欧洲杯投注app推荐-欧洲杯投注app| 立即访问【ac123.net】
欧洲杯投注app-欧洲杯投注app推荐-欧洲杯投注app| 立即访问【ac123.net】
 
132. Acta Scientific Pharmaceutical Sciences
132. Acta Scientific Pharmaceutical Sciences132. Acta Scientific Pharmaceutical Sciences
132. Acta Scientific Pharmaceutical Sciences
 
欧洲杯投注网站-欧洲杯投注网站推荐-欧洲杯投注网站| 立即访问【ac123.net】
欧洲杯投注网站-欧洲杯投注网站推荐-欧洲杯投注网站| 立即访问【ac123.net】欧洲杯投注网站-欧洲杯投注网站推荐-欧洲杯投注网站| 立即访问【ac123.net】
欧洲杯投注网站-欧洲杯投注网站推荐-欧洲杯投注网站| 立即访问【ac123.net】
 
D.El.Ed. College List -Session 2024-26.pdf
D.El.Ed. College List -Session 2024-26.pdfD.El.Ed. College List -Session 2024-26.pdf
D.El.Ed. College List -Session 2024-26.pdf
 
Dr. Nazrul Islam, Northern University Bangladesh - CV (29.5.2024).pdf
Dr. Nazrul Islam, Northern University Bangladesh - CV (29.5.2024).pdfDr. Nazrul Islam, Northern University Bangladesh - CV (29.5.2024).pdf
Dr. Nazrul Islam, Northern University Bangladesh - CV (29.5.2024).pdf
 
Widal Agglutination Test: A rapid serological diagnosis of typhoid fever
Widal Agglutination Test: A rapid serological diagnosis of typhoid feverWidal Agglutination Test: A rapid serological diagnosis of typhoid fever
Widal Agglutination Test: A rapid serological diagnosis of typhoid fever
 
135. Reviewer Certificate in Journal of Engineering
135. Reviewer Certificate in Journal of Engineering135. Reviewer Certificate in Journal of Engineering
135. Reviewer Certificate in Journal of Engineering
 
皇冠体育- 皇冠体育官方网站- CROWN SPORTS| 立即访问【ac123.net】
皇冠体育- 皇冠体育官方网站- CROWN SPORTS| 立即访问【ac123.net】皇冠体育- 皇冠体育官方网站- CROWN SPORTS| 立即访问【ac123.net】
皇冠体育- 皇冠体育官方网站- CROWN SPORTS| 立即访问【ac123.net】
 
0524.priorspeakingengagementslist-01.pdf
0524.priorspeakingengagementslist-01.pdf0524.priorspeakingengagementslist-01.pdf
0524.priorspeakingengagementslist-01.pdf
 
Heidi Livengood Resume Senior Technical Recruiter / HR Generalist
Heidi Livengood Resume Senior Technical Recruiter / HR GeneralistHeidi Livengood Resume Senior Technical Recruiter / HR Generalist
Heidi Livengood Resume Senior Technical Recruiter / HR Generalist
 
Day care leadership document it helps to a person who needs caring children
Day care leadership document it helps to a person who needs caring childrenDay care leadership document it helps to a person who needs caring children
Day care leadership document it helps to a person who needs caring children
 
0524.THOMASGIRARD_SINGLEPAGERESUME-01.pdf
0524.THOMASGIRARD_SINGLEPAGERESUME-01.pdf0524.THOMASGIRARD_SINGLEPAGERESUME-01.pdf
0524.THOMASGIRARD_SINGLEPAGERESUME-01.pdf
 
Transferable Skills - Your Roadmap - Part 1 and 2 - Dirk Spencer Senior Recru...
Transferable Skills - Your Roadmap - Part 1 and 2 - Dirk Spencer Senior Recru...Transferable Skills - Your Roadmap - Part 1 and 2 - Dirk Spencer Senior Recru...
Transferable Skills - Your Roadmap - Part 1 and 2 - Dirk Spencer Senior Recru...
 
太阳城娱乐-太阳城娱乐推荐-太阳城娱乐官方网站| 立即访问【ac123.net】
太阳城娱乐-太阳城娱乐推荐-太阳城娱乐官方网站| 立即访问【ac123.net】太阳城娱乐-太阳城娱乐推荐-太阳城娱乐官方网站| 立即访问【ac123.net】
太阳城娱乐-太阳城娱乐推荐-太阳城娱乐官方网站| 立即访问【ac123.net】
 
Operating system. short answes and Interview questions .pdf
Operating system. short answes and Interview questions .pdfOperating system. short answes and Interview questions .pdf
Operating system. short answes and Interview questions .pdf
 
DIGITAL MARKETING COURSE IN CHENNAI.pptx
DIGITAL MARKETING COURSE IN CHENNAI.pptxDIGITAL MARKETING COURSE IN CHENNAI.pptx
DIGITAL MARKETING COURSE IN CHENNAI.pptx
 
134. Reviewer Certificate in Computer Science
134. Reviewer Certificate in Computer Science134. Reviewer Certificate in Computer Science
134. Reviewer Certificate in Computer Science
 
欧洲杯买球平台-欧洲杯买球平台推荐-欧洲杯买球平台| 立即访问【ac123.net】
欧洲杯买球平台-欧洲杯买球平台推荐-欧洲杯买球平台| 立即访问【ac123.net】欧洲杯买球平台-欧洲杯买球平台推荐-欧洲杯买球平台| 立即访问【ac123.net】
欧洲杯买球平台-欧洲杯买球平台推荐-欧洲杯买球平台| 立即访问【ac123.net】
 
133. Reviewer Certificate in Advances in Research
133. Reviewer Certificate in Advances in Research133. Reviewer Certificate in Advances in Research
133. Reviewer Certificate in Advances in Research
 

205_April_22.pptx

  • 1. Theory of Decision Time Dynamics, with Applications to Memory
  • 3. Key Issues • If accuracy builds up continuously with time as Pachella suggests, how do we ensure that the results we observe in different conditions don’t reflect changes in the speed-accuracy tradeoff? • How can we use reaction times to make inferences in the face of the problem of speed-accuracy tradeoff? – Relying on high levels of accuracy is highly problematic – we can’t tell if participants are operating at different points on the SAT function in different conditions or not! • In general, it appears that we need a theory of how accuracy builds up over time, and we need tasks that produce both reaction times and error rates to make inferences.
  • 4. A Starting Place: Noisy Evidence Accumulation Theory • Consider a stimulus perturbed by noise. – Maybe a cloud of dots with mean position m = +2 or -2 pixel from the center of a screen – Imagine that the cloud is updated once every 20 msec, of 50 times a second, but each time its mean position shifts randomly with a standard deviation s of 10 pixels. • What is theoretically possible maximum value of d’ based on just one update? • Suppose we sample n updates and add up the samples. • Expected value of the sum = m*n • Expected value of the standard deviation of the sum = sn • What then is the theoretically possible maximum value of d’ after n updates?
  • 5. Some facts and some questions • With very difficult stimuli, accuracy always levels off at long processing times. – Why? • Participant stops integrating before the end of trial? • Trial-to-trial variability in direction of drift? – Noise is between as well as or in addition to within trials • Imperfect integration (leakage or mutual inhibition, to be discussed later). • If the subject controls the integration time, how does he decide when to stop? • What is the optimal policy for deciding when to stop integrating evidence? – Maximize earnings per unit time? – Maximize earning per unit ‘effort’?
  • 6. A simple optimal model for a sequential random sampling process • Imagine we have two ‘urns’ – One with 2/3 black, 1/3 white balls – One with 1/3 black, 2/3 white balls • Suppose we sample ‘with replacement’, one ball at a time – What can we conclude after drawing one black ball? One white ball? – Two black balls? Two white balls? One white and one black? • Sequential Probability Ratio test. • Difference as log of the probability ratio. • Starting place, bounds; priors • Optimality: Minimizes the # of samples needed on average to achieve a given success rate. • DDM is the continuous analog of this
  • 7. Ratcliff’s Drift Diffusion Model Applied to a Perceptual Discrimination Task • There is a single noisy evidence variable that adds up samples of noisy evidence over time. • There is both between trial and within trial variability. • Assumes participants stop integrating when a bound condition is reached. • Speed emphasis: bounds closer to starting point • Accuracy emphasis: bounds farther from starting point • Different difficulty levels lead to different frequencies of errors and correct responses and different distributions of error and correct responses • Graph at right from Smith and Ratcliff shows accuracy and distribution information within the same Quantile probability plot
  • 8. Application of the DDM to Memory
  • 9. Matching is a matter of degree What are the factors influencing ‘relatedness’?
  • 11.
  • 12. Ratcliff & Murdock (1976) Study-Test Paradigm • Study 16 words, test 16 ‘old’ and 16 ‘new’ • Responses on a six-point scale – ‘Accuracy and latency are recorded’
  • 14. RTs for Hits and Correct Rejections
  • 15. Sternberg Paridigm • Set sizes 3, 4, 5 • Two participants data averaged
  • 16. Error Latencies • Predicted error latencies too large • Error latencies show extreme dependency on tails of the relatedness distribution
  • 17. Some Remaining Issues • For Memory Search: – Who is right, Ratcliff or Sternberg? – Resonance, relatedness, u and v parameters – John Anderson and the fan effect • Relation to semantic network and ‘propositional’ models of memory search – Spreading activation vs. similarity-based models – The fan effect • What is the basis of differences in confidence in the DDM? – Time to reach a bound – Continuing integration after the bound is reached – In models with separate accumulators for evidence for both decisions, activation of the looser can be used
  • 18. The Leaky Competing Accumulator Model as an Alternative to the DDM • Separate evidence variables for each alternative – Generalizes easily to n>2 alternatives • Evidence variables subject to leakage and mutual inhibition • Both can limit accuracy • LCA offers a different way to think about what it means to ‘make a decision’ • LCA has elements of discreteness and continuity • Continuity in decision states is one possible basis of variations in confidence • Research is ongoing testing differential predictions of these models!