SlideShare a Scribd company logo
Defining statistical perceptions
with an empirical Bayes approach
Satohiro Tajima
Perception of image statistics is an empirical Bayes estimation.
Stimulus statistics?

Contrast

Smoothness

1

α

α=1.284
α=1.122

α=1.201
Stimulus statistics = cue for recognition

1

α

α=1.284
α=1.122

α=1.201
Stimulus statistics = cue for recognition
Texture

(Hansen & Hess, J. Vis., 2006)

Blur

(Liu et al., CVPR., 2008)

Scene category

(Torralba & Oliva, Network, 2003)
We can perceive statistics!
Idea

Image engineering “Image restoration”
Empirical Bayes

Vision science “Perception of stimulus statistics”
Problem in perceiving stimulus statistics

Statistics
(smoothness)

Stimulus
(image)

θ
Stochasticity

Neural
response

s

“Percepts”

r
Noise

^

^
s
Estimate

θ
Bayesian framework
Statistics Stimulus Response

θ

θ

s

s

Goal of:

r

Image
restoration

r

Visual
recognition
Bayesian framework
Statistics Stimulus Response
“hyperparameter”

θ

s

r
Bayes
Empirical Bayes

θ

s

r
Bayesian framework
Statistics Stimulus Response

θ

s

r

θ

s

r
Different goals of estimation
Image
restoration

Visual
recognition

Statistics

Stimulus
for

Stimulus

Statistics
for

… But both are mathematically equal manipulations.
Different criteria
Image
restoration

Visual
recognition

Mean square error
E [ s

ˆ
s

2

/N]

Variance of
estimate

Fisher information
E [-

ln P ( r | θ )]

ˆ ] -1
Var [

(Ideal observer)
Different criteria
Image
restoration

Visual
recognition

Mean square error
E [ s

ˆ
s

2

/N]
Signal detection
theory

Fisher information
E [-

ln P ( r | θ )]

(d ' )

(Ideal observer)

2
Application
Decoding retinal codes
Decoding retinal codes
θ

s

r

Statistics
Cortex

θ

Estimate (Percept)
Natural image statistics
• Smoothness
• Contrast

Statistics

θ

Cortex
Neural response model

Receptive field
Statistics

θ

Cortex
Estimation of stimulus

Receptive field

s

As

r

^

s

(Tajima, Inoue & Okada, J. Phys. Soc. Jpn., 2008)
Estimation of statistics

- ln P(r|θ)

Receptive field

(Tajima, Inoue & Okada, J. Phys. Soc. Jpn., 2008)
Optimal receptive field size?
Image restoration
Criteria:

Visual recognition

Mean square error

Fisher information
of smoothness

(Noise level)

Receptive field size

Receptive field size

(Natural image model: Power-law model)
Receptive field size

Optimal receptive field size?

(Natural image model: Power-law model)
Receptive field size

Optimal receptive field size?

Intensity-dependent RF changes:
Retina (Barlow et al., 1957)
V1 (Polat & Norcia, 1996)
MT (Hunter & Born, 2011)
Receptive field size

Optimal receptive field size?

Parasol

Bistratified
Midget

Retinal ganglion cells
Which cell type is the best?

Receptive field
Parasol
(Magno)

SIZE

Midget
(Parvo)

SHAPE

Bistratified
(Konio)

(Field et al., Nature, 2010)
Parasol (Magno)
Midget (Parvo)
Bistratified (Konio)

Fisher information

Which cell type is the best? - (prediction)

(Natural image model: Power-law model)
Parasol (Magno)
Midget (Parvo)
Bistratified (Konio)

Fisher information

Which cell type is the best? - (prediction)

(Natural image model: Power-law model)
Implementation of empirical Bayes?
Message

Image engineering “Image restoration”
Empirical Bayes!

Vision science “Perception of stimulus statistics”
Vision science  Image engineering

What criteria should we use?
Purpose:

•

Mean square error Restoration

•

Fisher information

Human recognition
Image engineering  Vision science

What is the function of statistics perception?
Rolls of statistics:

•

Compression

Cue for recognition

•

Denoising

Prior for stimulus estimation

•

Prediction

Hidden variables of system
Perception of image statistics is empirical Bayes estimation.
Satohiro Tajima.
Defining statistical perceptions with an empirical Bayesian approach.
Physical Review E, 87(4):042707, (2013).
https://sites.google.com/site/satohirotajima/

More Related Content

Similar to Defining statistical perceptions with an empirical Bayesian approach.

Fundamental Limits of Recovering Tree Sparse Vectors from Noisy Linear Measur...
Fundamental Limits of Recovering Tree Sparse Vectors from Noisy Linear Measur...Fundamental Limits of Recovering Tree Sparse Vectors from Noisy Linear Measur...
Fundamental Limits of Recovering Tree Sparse Vectors from Noisy Linear Measur...
sonix022
 
Vanni Vipp2010 presentation_bu
Vanni Vipp2010 presentation_buVanni Vipp2010 presentation_bu
Vanni Vipp2010 presentation_bu
hansvanni
 
Vanni Vipp2010 presentation_bu
Vanni Vipp2010 presentation_buVanni Vipp2010 presentation_bu
Vanni Vipp2010 presentation_bu
hansvanni
 
Vanni Vipp2010
Vanni Vipp2010Vanni Vipp2010
Vanni Vipp2010
hansvanni
 
Vanni Vipp2010 presentation_bu
Vanni Vipp2010 presentation_buVanni Vipp2010 presentation_bu
Vanni Vipp2010 presentation_bu
hansvanni
 
Vanni Vipp2010 presentation_bu
Vanni Vipp2010 presentation_buVanni Vipp2010 presentation_bu
Vanni Vipp2010 presentation_bu
hansvanni
 
Vanni Vipp2010 presentation_bu
Vanni Vipp2010 presentation_buVanni Vipp2010 presentation_bu
Vanni Vipp2010 presentation_bu
hansvanni
 
Visual cortex
Visual cortexVisual cortex
Visual cortex
hansvanni
 
Vanni Vipp2010
Vanni Vipp2010Vanni Vipp2010
Vanni Vipp2010
hansvanni
 
Vanni_presentation_VIPP2010
Vanni_presentation_VIPP2010Vanni_presentation_VIPP2010
Vanni_presentation_VIPP2010
hansvanni
 
Vanni Vipp2010 presentation_bu
Vanni Vipp2010 presentation_buVanni Vipp2010 presentation_bu
Vanni Vipp2010 presentation_bu
hansvanni
 
Spike sorting: What is it? Why do we need it? Where does it come from? How is...
Spike sorting: What is it? Why do we need it? Where does it come from? How is...Spike sorting: What is it? Why do we need it? Where does it come from? How is...
Spike sorting: What is it? Why do we need it? Where does it come from? How is...
NeuroMat
 
Olga Senyukova - Machine Learning Applications in Medicine
Olga Senyukova - Machine Learning Applications in MedicineOlga Senyukova - Machine Learning Applications in Medicine
Olga Senyukova - Machine Learning Applications in Medicine
Olsen222
 
An Application of Uncertainty Quantification to MPM
An Application of Uncertainty Quantification to MPMAn Application of Uncertainty Quantification to MPM
An Application of Uncertainty Quantification to MPM
wallstedt
 
Neural Power Amplifier
Neural Power AmplifierNeural Power Amplifier
Neural Power Amplifier
Andrew Doyle
 
Deep learning application to medical imaging: Perspectives as a physician
Deep learning application to medical imaging: Perspectives as a physicianDeep learning application to medical imaging: Perspectives as a physician
Deep learning application to medical imaging: Perspectives as a physician
Hongyoon Choi
 
Action Video Games and “Learning to Learn”
Action Video Games and “Learning to Learn”Action Video Games and “Learning to Learn”
Action Video Games and “Learning to Learn”
jamonjanight
 
BLPs
BLPsBLPs
BLPs
butest
 

Similar to Defining statistical perceptions with an empirical Bayesian approach. (18)

Fundamental Limits of Recovering Tree Sparse Vectors from Noisy Linear Measur...
Fundamental Limits of Recovering Tree Sparse Vectors from Noisy Linear Measur...Fundamental Limits of Recovering Tree Sparse Vectors from Noisy Linear Measur...
Fundamental Limits of Recovering Tree Sparse Vectors from Noisy Linear Measur...
 
Vanni Vipp2010 presentation_bu
Vanni Vipp2010 presentation_buVanni Vipp2010 presentation_bu
Vanni Vipp2010 presentation_bu
 
Vanni Vipp2010 presentation_bu
Vanni Vipp2010 presentation_buVanni Vipp2010 presentation_bu
Vanni Vipp2010 presentation_bu
 
Vanni Vipp2010
Vanni Vipp2010Vanni Vipp2010
Vanni Vipp2010
 
Vanni Vipp2010 presentation_bu
Vanni Vipp2010 presentation_buVanni Vipp2010 presentation_bu
Vanni Vipp2010 presentation_bu
 
Vanni Vipp2010 presentation_bu
Vanni Vipp2010 presentation_buVanni Vipp2010 presentation_bu
Vanni Vipp2010 presentation_bu
 
Vanni Vipp2010 presentation_bu
Vanni Vipp2010 presentation_buVanni Vipp2010 presentation_bu
Vanni Vipp2010 presentation_bu
 
Visual cortex
Visual cortexVisual cortex
Visual cortex
 
Vanni Vipp2010
Vanni Vipp2010Vanni Vipp2010
Vanni Vipp2010
 
Vanni_presentation_VIPP2010
Vanni_presentation_VIPP2010Vanni_presentation_VIPP2010
Vanni_presentation_VIPP2010
 
Vanni Vipp2010 presentation_bu
Vanni Vipp2010 presentation_buVanni Vipp2010 presentation_bu
Vanni Vipp2010 presentation_bu
 
Spike sorting: What is it? Why do we need it? Where does it come from? How is...
Spike sorting: What is it? Why do we need it? Where does it come from? How is...Spike sorting: What is it? Why do we need it? Where does it come from? How is...
Spike sorting: What is it? Why do we need it? Where does it come from? How is...
 
Olga Senyukova - Machine Learning Applications in Medicine
Olga Senyukova - Machine Learning Applications in MedicineOlga Senyukova - Machine Learning Applications in Medicine
Olga Senyukova - Machine Learning Applications in Medicine
 
An Application of Uncertainty Quantification to MPM
An Application of Uncertainty Quantification to MPMAn Application of Uncertainty Quantification to MPM
An Application of Uncertainty Quantification to MPM
 
Neural Power Amplifier
Neural Power AmplifierNeural Power Amplifier
Neural Power Amplifier
 
Deep learning application to medical imaging: Perspectives as a physician
Deep learning application to medical imaging: Perspectives as a physicianDeep learning application to medical imaging: Perspectives as a physician
Deep learning application to medical imaging: Perspectives as a physician
 
Action Video Games and “Learning to Learn”
Action Video Games and “Learning to Learn”Action Video Games and “Learning to Learn”
Action Video Games and “Learning to Learn”
 
BLPs
BLPsBLPs
BLPs
 

Recently uploaded

9 CEO's who hit $100m ARR Share Their Top Growth Tactics Nathan Latka, Founde...
9 CEO's who hit $100m ARR Share Their Top Growth Tactics Nathan Latka, Founde...9 CEO's who hit $100m ARR Share Their Top Growth Tactics Nathan Latka, Founde...
9 CEO's who hit $100m ARR Share Their Top Growth Tactics Nathan Latka, Founde...
saastr
 
HCL Notes and Domino License Cost Reduction in the World of DLAU
HCL Notes and Domino License Cost Reduction in the World of DLAUHCL Notes and Domino License Cost Reduction in the World of DLAU
HCL Notes and Domino License Cost Reduction in the World of DLAU
panagenda
 
"Frontline Battles with DDoS: Best practices and Lessons Learned", Igor Ivaniuk
"Frontline Battles with DDoS: Best practices and Lessons Learned",  Igor Ivaniuk"Frontline Battles with DDoS: Best practices and Lessons Learned",  Igor Ivaniuk
"Frontline Battles with DDoS: Best practices and Lessons Learned", Igor Ivaniuk
Fwdays
 
Crafting Excellence: A Comprehensive Guide to iOS Mobile App Development Serv...
Crafting Excellence: A Comprehensive Guide to iOS Mobile App Development Serv...Crafting Excellence: A Comprehensive Guide to iOS Mobile App Development Serv...
Crafting Excellence: A Comprehensive Guide to iOS Mobile App Development Serv...
Pitangent Analytics & Technology Solutions Pvt. Ltd
 
Mutation Testing for Task-Oriented Chatbots
Mutation Testing for Task-Oriented ChatbotsMutation Testing for Task-Oriented Chatbots
Mutation Testing for Task-Oriented Chatbots
Pablo Gómez Abajo
 
Connector Corner: Seamlessly power UiPath Apps, GenAI with prebuilt connectors
Connector Corner: Seamlessly power UiPath Apps, GenAI with prebuilt connectorsConnector Corner: Seamlessly power UiPath Apps, GenAI with prebuilt connectors
Connector Corner: Seamlessly power UiPath Apps, GenAI with prebuilt connectors
DianaGray10
 
Principle of conventional tomography-Bibash Shahi ppt..pptx
Principle of conventional tomography-Bibash Shahi ppt..pptxPrinciple of conventional tomography-Bibash Shahi ppt..pptx
Principle of conventional tomography-Bibash Shahi ppt..pptx
BibashShahi
 
Taking AI to the Next Level in Manufacturing.pdf
Taking AI to the Next Level in Manufacturing.pdfTaking AI to the Next Level in Manufacturing.pdf
Taking AI to the Next Level in Manufacturing.pdf
ssuserfac0301
 
GNSS spoofing via SDR (Criptored Talks 2024)
GNSS spoofing via SDR (Criptored Talks 2024)GNSS spoofing via SDR (Criptored Talks 2024)
GNSS spoofing via SDR (Criptored Talks 2024)
Javier Junquera
 
The Microsoft 365 Migration Tutorial For Beginner.pptx
The Microsoft 365 Migration Tutorial For Beginner.pptxThe Microsoft 365 Migration Tutorial For Beginner.pptx
The Microsoft 365 Migration Tutorial For Beginner.pptx
operationspcvita
 
Essentials of Automations: Exploring Attributes & Automation Parameters
Essentials of Automations: Exploring Attributes & Automation ParametersEssentials of Automations: Exploring Attributes & Automation Parameters
Essentials of Automations: Exploring Attributes & Automation Parameters
Safe Software
 
Northern Engraving | Nameplate Manufacturing Process - 2024
Northern Engraving | Nameplate Manufacturing Process - 2024Northern Engraving | Nameplate Manufacturing Process - 2024
Northern Engraving | Nameplate Manufacturing Process - 2024
Northern Engraving
 
Monitoring and Managing Anomaly Detection on OpenShift.pdf
Monitoring and Managing Anomaly Detection on OpenShift.pdfMonitoring and Managing Anomaly Detection on OpenShift.pdf
Monitoring and Managing Anomaly Detection on OpenShift.pdf
Tosin Akinosho
 
Astute Business Solutions | Oracle Cloud Partner |
Astute Business Solutions | Oracle Cloud Partner |Astute Business Solutions | Oracle Cloud Partner |
Astute Business Solutions | Oracle Cloud Partner |
AstuteBusiness
 
Generating privacy-protected synthetic data using Secludy and Milvus
Generating privacy-protected synthetic data using Secludy and MilvusGenerating privacy-protected synthetic data using Secludy and Milvus
Generating privacy-protected synthetic data using Secludy and Milvus
Zilliz
 
Dandelion Hashtable: beyond billion requests per second on a commodity server
Dandelion Hashtable: beyond billion requests per second on a commodity serverDandelion Hashtable: beyond billion requests per second on a commodity server
Dandelion Hashtable: beyond billion requests per second on a commodity server
Antonios Katsarakis
 
“Temporal Event Neural Networks: A More Efficient Alternative to the Transfor...
“Temporal Event Neural Networks: A More Efficient Alternative to the Transfor...“Temporal Event Neural Networks: A More Efficient Alternative to the Transfor...
“Temporal Event Neural Networks: A More Efficient Alternative to the Transfor...
Edge AI and Vision Alliance
 
June Patch Tuesday
June Patch TuesdayJune Patch Tuesday
June Patch Tuesday
Ivanti
 
Biomedical Knowledge Graphs for Data Scientists and Bioinformaticians
Biomedical Knowledge Graphs for Data Scientists and BioinformaticiansBiomedical Knowledge Graphs for Data Scientists and Bioinformaticians
Biomedical Knowledge Graphs for Data Scientists and Bioinformaticians
Neo4j
 
Introduction of Cybersecurity with OSS at Code Europe 2024
Introduction of Cybersecurity with OSS  at Code Europe 2024Introduction of Cybersecurity with OSS  at Code Europe 2024
Introduction of Cybersecurity with OSS at Code Europe 2024
Hiroshi SHIBATA
 

Recently uploaded (20)

9 CEO's who hit $100m ARR Share Their Top Growth Tactics Nathan Latka, Founde...
9 CEO's who hit $100m ARR Share Their Top Growth Tactics Nathan Latka, Founde...9 CEO's who hit $100m ARR Share Their Top Growth Tactics Nathan Latka, Founde...
9 CEO's who hit $100m ARR Share Their Top Growth Tactics Nathan Latka, Founde...
 
HCL Notes and Domino License Cost Reduction in the World of DLAU
HCL Notes and Domino License Cost Reduction in the World of DLAUHCL Notes and Domino License Cost Reduction in the World of DLAU
HCL Notes and Domino License Cost Reduction in the World of DLAU
 
"Frontline Battles with DDoS: Best practices and Lessons Learned", Igor Ivaniuk
"Frontline Battles with DDoS: Best practices and Lessons Learned",  Igor Ivaniuk"Frontline Battles with DDoS: Best practices and Lessons Learned",  Igor Ivaniuk
"Frontline Battles with DDoS: Best practices and Lessons Learned", Igor Ivaniuk
 
Crafting Excellence: A Comprehensive Guide to iOS Mobile App Development Serv...
Crafting Excellence: A Comprehensive Guide to iOS Mobile App Development Serv...Crafting Excellence: A Comprehensive Guide to iOS Mobile App Development Serv...
Crafting Excellence: A Comprehensive Guide to iOS Mobile App Development Serv...
 
Mutation Testing for Task-Oriented Chatbots
Mutation Testing for Task-Oriented ChatbotsMutation Testing for Task-Oriented Chatbots
Mutation Testing for Task-Oriented Chatbots
 
Connector Corner: Seamlessly power UiPath Apps, GenAI with prebuilt connectors
Connector Corner: Seamlessly power UiPath Apps, GenAI with prebuilt connectorsConnector Corner: Seamlessly power UiPath Apps, GenAI with prebuilt connectors
Connector Corner: Seamlessly power UiPath Apps, GenAI with prebuilt connectors
 
Principle of conventional tomography-Bibash Shahi ppt..pptx
Principle of conventional tomography-Bibash Shahi ppt..pptxPrinciple of conventional tomography-Bibash Shahi ppt..pptx
Principle of conventional tomography-Bibash Shahi ppt..pptx
 
Taking AI to the Next Level in Manufacturing.pdf
Taking AI to the Next Level in Manufacturing.pdfTaking AI to the Next Level in Manufacturing.pdf
Taking AI to the Next Level in Manufacturing.pdf
 
GNSS spoofing via SDR (Criptored Talks 2024)
GNSS spoofing via SDR (Criptored Talks 2024)GNSS spoofing via SDR (Criptored Talks 2024)
GNSS spoofing via SDR (Criptored Talks 2024)
 
The Microsoft 365 Migration Tutorial For Beginner.pptx
The Microsoft 365 Migration Tutorial For Beginner.pptxThe Microsoft 365 Migration Tutorial For Beginner.pptx
The Microsoft 365 Migration Tutorial For Beginner.pptx
 
Essentials of Automations: Exploring Attributes & Automation Parameters
Essentials of Automations: Exploring Attributes & Automation ParametersEssentials of Automations: Exploring Attributes & Automation Parameters
Essentials of Automations: Exploring Attributes & Automation Parameters
 
Northern Engraving | Nameplate Manufacturing Process - 2024
Northern Engraving | Nameplate Manufacturing Process - 2024Northern Engraving | Nameplate Manufacturing Process - 2024
Northern Engraving | Nameplate Manufacturing Process - 2024
 
Monitoring and Managing Anomaly Detection on OpenShift.pdf
Monitoring and Managing Anomaly Detection on OpenShift.pdfMonitoring and Managing Anomaly Detection on OpenShift.pdf
Monitoring and Managing Anomaly Detection on OpenShift.pdf
 
Astute Business Solutions | Oracle Cloud Partner |
Astute Business Solutions | Oracle Cloud Partner |Astute Business Solutions | Oracle Cloud Partner |
Astute Business Solutions | Oracle Cloud Partner |
 
Generating privacy-protected synthetic data using Secludy and Milvus
Generating privacy-protected synthetic data using Secludy and MilvusGenerating privacy-protected synthetic data using Secludy and Milvus
Generating privacy-protected synthetic data using Secludy and Milvus
 
Dandelion Hashtable: beyond billion requests per second on a commodity server
Dandelion Hashtable: beyond billion requests per second on a commodity serverDandelion Hashtable: beyond billion requests per second on a commodity server
Dandelion Hashtable: beyond billion requests per second on a commodity server
 
“Temporal Event Neural Networks: A More Efficient Alternative to the Transfor...
“Temporal Event Neural Networks: A More Efficient Alternative to the Transfor...“Temporal Event Neural Networks: A More Efficient Alternative to the Transfor...
“Temporal Event Neural Networks: A More Efficient Alternative to the Transfor...
 
June Patch Tuesday
June Patch TuesdayJune Patch Tuesday
June Patch Tuesday
 
Biomedical Knowledge Graphs for Data Scientists and Bioinformaticians
Biomedical Knowledge Graphs for Data Scientists and BioinformaticiansBiomedical Knowledge Graphs for Data Scientists and Bioinformaticians
Biomedical Knowledge Graphs for Data Scientists and Bioinformaticians
 
Introduction of Cybersecurity with OSS at Code Europe 2024
Introduction of Cybersecurity with OSS  at Code Europe 2024Introduction of Cybersecurity with OSS  at Code Europe 2024
Introduction of Cybersecurity with OSS at Code Europe 2024
 

Defining statistical perceptions with an empirical Bayesian approach.