SlideShare a Scribd company logo
1 of 60
Download to read offline
Color Perception at Low Signal
to Noise Levels
By:
Mehdi REZAGHOLIZADEH
MCGILL UNIVERSITY
DEPARTMENT OF ELECTRICAL AND COMPUTER ENGINEERING
Supervisor:
Prof. James J. CLARK
Brief Overview
DECEMBER 2014
Statement of Problems
• Developing a Fast and Accurate Color
Constancy Method
• Color Appearance Modeling at Low Light
Levels
• Image Sensor Modeling and Color
Measurement at Low Light Levels
2
Definition of Color Constancy
• Discounting the illuminant effect on the color
of objects
• Color constancy is a great feature of our
visual system
3Computational Color Constancy
Importance of Color Constancy
• Applications:
Object Recognition
Image Enhancement
Robot Vision
Object Tracking
Photography and Film
Industry
The last three cases are
real-time applications of color
constancy.
4Computational Color Constancy
Problem of Color Constancy
5Computational Color Constancy
Problem of Color Constancy
• Image Formation Model:
ܴ௜ = න ‫ܧ‬ ߣ ܵ ߣ, ‫ݔ‬ ߩ௜ ߣ 	݀ߣ
‫ܧ‬ ߣ : the illuminant spectrum
ܵ(ߣ, ‫:)ݔ‬ the surface spectral reflectance function
at location ‫.ݔ‬
ߩ௜(ߣ): the sensor spectral sensitivity
ܴ௜: the sensor response of ith channel
6Computational Color Constancy
Problem of Color Constancy
• The Transformation Imposed by a Change in Illumination:
ܴ௜ = න ‫ܧ‬ ߣ ܵ ߣ, ‫ݔ‬ ߩ௜ ߣ 	݀ߣ
Givens:
ߩ௜(ߣ): the sensor spectral sensitivity
ܴ௜: the sensor response of ith channel
Unknowns:
‫ܧ‬ ߣ : the illuminant spectrum
ܵ(ߣ, ‫:)ݔ‬ the surface spectral reflectance function at location ‫.ݔ‬
Spectral Color Constancy Approaches try to find the entire spectrum
of the illuminant and the surface spectral reflectance function.
It is an ill-posed problem.
7Computational Color Constancy
Methods of Color Constancy
Computational
Color Constancy
Spectral Methods
Non-spectral
Methods
Static Methods
Gamut-Based
Learning-Based
8Computational Color Constancy
Non-Spectral Methods:
• MAIN Objective of this problem is to obtain:
ܴ௜
ௌ
= න ܵ ߣ, ‫ݔ‬ ߩ௜ ߣ 	݀ߣ
It is equivalent to obtaining the sensor responses when
‫ܧ‬ ߣ = 1.
• Assuming that color of the illuminant can be estimated:
ܴ௜
ா
= න ‫ܧ‬ ߣ ߩ௜ ߣ 	݀ߣ
• The Transformation Imposed by an illuminant can be
obtained through an Over-simplification:
ܴ௜
ௌ
≅
ܴ௜
ܴ௜
ா =
‫׬‬ ‫ܧ‬ ߣ ܵ ߣ, ‫ݔ‬ ߩ௜ ߣ 	݀ߣ
‫׬‬ ‫ܧ‬ ߣ ߩ௜ ߣ 	݀ߣ
9Computational Color Constancy, March. 2014
Non-Spectral Methods:
Over-simplification leads to:
- Estimating the illuminant color
rather than
- Estimating the entire spectrum of the illuminant ‫)ߣ(ܧ‬
• Corrective Transformation:
ܴଵ
௦
ܴଶ
௦
ܴଷ
௦
=
1
ܴଵ
ா 0 0
0
1
ܴଶ
ா 0
0 0
1
ܴଶ
ா
ܴଵ
ܴଶ
ܴଷ
10Computational Color Constancy, March. 2014
Problem II:
Color Appearance Modeling at Low Light Levels
• Color Appearance Model (CAM):
• An ideal color appearance model:
The output resembles human perception in all
conditions including different light levels
• Lack of a good color appearance model
for low light conditions
Color Perception at Low Signal to Noise Levels 11
TransformTransform
Tristimulus
values (RGB)
Perceptual attributes of
color:
lightness, hue, chroma
Biophysical Background
• Our eye can work in three different modes:
1- Photopic condition (Luminance>5 cd/m2 )
2- Mesopic condition (0.005<Luminance<5 cd/m2 )
3- Scotopic condition (Luminance<0.005 cd/m2 )
• Photopic Condition: (High Light Levels)
Color Perception at Low Signal to Noise Levels 12
• Mesopic Condition: (Low Light Levels)• Scotopic Condition: (Very Low Light Levels)
Background and Preliminaries
• Existing Models for Mesopic & Scotopic Vision:
Modeling Blue Shift in Moonlit scenes [1]
– Addresses scotopic vision by adding some blue to the initial image
– The output of this algorithm does not look natural and realistic
Cao’s Model of Mesopic Vision [2]
– It is a two stage model based on the gain control and cone opponent
mechanisms
– Model is fitted to the psychophysical experiment data
iCAM06 Tone Compression Model for Mesopic Vision [3]
– iCAM06 includes rod responses in a linear fashion
Shin’s Color Appearance Model [4]
– Boynton two-stage model is fitted to the behavioral experiment data
13
[1] S. M. Khan and S. N. Pattanaik, “Modeling blue shift in moonlit scenes by rod cone interaction,” Journal of VISION, vol. 4, no. 8,
2004.
[2] D. Cao, J. Pokorny, V. C. Smith, and A. J. Zele, “Rod contributions to color perception: linear with rod contrast," Vision research, vol.
48, no. 26, pp. 2586-2592, 2008.
[3] J. Kuang, G. M. Johnson, and M. D. Fairchild, “iCAM06: a rened image appearance model for HDR image rendering," Journal of
Visual Communication and Image Representation, vol. 18, no. 5, pp. 406 -414, 2007.
[4] J. Shin, N. Matsuki, H. Yaguchi, and S. Shioiri, “A color appearance model applicable in mesopic vision," Optical review, vol. 11, no.
4, pp. 272-278, 2004.
Physics & Color Perception
Color Perception at Low Signal to Noise Levels 14
Problem
• Lack of a good color appearance model
(CAM) for the low light conditions
Physics
• The basic physical principles governing the
probabilistic nature of color perception at
low light levels
Analysis
• Photon Detection and Color Perception at
low light levels
Proposed Method:
Maximum Entropy Spectral Modeling Approach to the
Low Light Levels Color Appearance Modeling
• Under very low light conditions:
The photoreceptor responses more uncertain
• Hypothesis:
Color Perception at Low Signal to Noise Levels 15
Visual Processing Center reconstructs
a part of the information being lost in the
projection of light spectra into the space
of photoreceptor responses
Proposed Method:
Maximum Entropy Spectral Modeling Approach to the
Low Light Levels Color Appearance Modeling
• The spectral theory of color perception [Clark and Skaff,
2009]:
Provides a tool to address the issues of uncertain
measurements
Estimates the spectral power distributions corresponding
to these uncertain measurements.
Color Perception at Low Signal to Noise Levels 16
Proposed Method:
Maximum Entropy Spectral Modeling Approach to the
Low Light Levels Color Appearance Modeling
• Spectral Model of Mesopic Vision
Clark and Skaff proposed a spectral model for color perception
which is valid for photopic conditions
During the mesopic condition, both cones and rods contribute to the
vision
Given the measurement vector ‫,ݎ‬ we can model the rod intrusion
into the perception as follows:
‫ݎ‬௜ = ߚ ‫׬‬ ݂௜
௖
ߣ + ߦ‫ݓ‬௜݂௥ ߣ ‫݌‬ ߣ ݀ߣ + ߥ
	
ஃ
															݅ ∈ {‫,ܮ‬ ‫,ܯ‬ ܵ}
- ࢌࢉ(ࣅ) and ࢌ࢘(ࣅ): cone and rod spectral sensitivity functions respectively
- ࢖(ࣅ): normalized mesopic spectral power distribution
- ߚ: intensity factor
- ࣈ [0, 1]: a parameter which determines relative rod intrusion
- ܹ = [‫ݓ‬௅
‫ݓ‬ெ
‫ݓ‬ௌ]: a diagonal matrix specifies the relative contribution of rod response to each cone
channel.
- ߥ: additive noise
17Color Perception at Low Signal to Noise Levels
Proposed Method:
Maximum Entropy Spectral Modeling Approach to the
Low Light Levels Color Appearance Modeling
• Spectral Model of Mesopic Vision
Given the measurement vector ‫,ݎ‬ we can model the rod intrusion
into the perception as follows:
‫ݎ‬௜
= ߚ ‫׬‬ ݂௜
௖
ߣ + ߦ‫ݓ‬௜
݂௥ ߣ ‫݌‬ ߣ ݀ߣ + ߥ
	
ஃ
															݅ ∈ {‫,ܮ‬ ‫,ܯ‬ ܵ}
18
19
Proposed Method:
Maximum Entropy Spectral Modeling Approach to the
Low Light Levels Color Appearance Modeling
An exponential family is employed to estimate ‫݌‬ ߣ :
‫̂݌‬ ߣ = exp	(< ݂ ߣ , ߠ > −߰(ߠ))
݂ ߣ = ݂௖ ߣ + ߦܹ݂௥ ߣ
ߠ: parameter vector which should be estimated
߰(ߠ): normalizing function
Parameters can be estimated as follows:
ߠመ = min
ఏ
{ ߟො − ߟ ்
‫ߟ(	ܣ‬ො − ߟ)} − ߛ‫})ߠ(ܪ‬
ߟ = ‫ߚ/ݎ‬ normalized measurement
‫:)ߠ(ܪ‬ entropy function corresponding to ‫̂݌‬(ߣ)
A: positive definite matrix
ࢽ: regularization factor
• Spectral Model of Mesopic Vision
Color Perception at Low Signal to Noise Levels
Results:
• Simulation of Munsell patches
– surrounded by a white background
– viewed under different light levels from scotopic to
photopic.
Color Perception at Low Signal to Noise Levels 20
Image Sensor Modeling:
Color Measurement at Low Light Levels
By:
Mehdi REZAGHOLIZADEH
James J. CLARK
MCGILL UNIVERSITY
November 2014
22nd Color and Imaging Conference
The Presentation Outline:
Image Sensor Modeling: Color Measurement at Low Light Levels 22
Conclusion
Experiments and Results:
Preparation Caveats Analysis Experiment Scenarios
Solution: Image Sensor Modeling
Physical Background Noise Model Pixel Measurement Model
Introduction:
Motivation Statement of the Problem: Color Measurement at Low Light Levels
Introduction:
Motivation
Importance of Studying low light levels:
• Color Measurement at low light level
becomes more uncertain due to the
low signal to noise ratio
• Most of the theories, measures,
models and methods in color science
are developed for high intensities
• The quality of the human color vision
at low light levels is much better than
existing handy cameras
23Image Sensor Modeling: Color Measurement at Low Light Levels
Kirk, Adam G., and James F. O'Brien. "Perceptually based tone
mapping for low-light conditions." ACM Trans. Graph. 30.4 (2011): 42.
Introduction:
Statement of the Problem
24
Problem:
• What is the impact of noise at low light
levels on the color measurements of
imaging devices?
Image Sensor Modeling: Color Measurement at Low Light Levels
Applications of the Study:
Spectral Imaging
Image Processing
Low Light Photography
Characterizing the Noise of Image Sensors
Developing Denoising and Enhancement Algorithms
Photon Limited Imaging (biosensors, astronomy, etc)
25Image Sensor Modeling: Color Measurement at Low Light Levels
What Next…
26
Conclusion
Experiments and Results:
Preparation Caveats Analysis Experiment Scenarios
Solution: Image Sensor Modeling
Physical Background Noise Model Pixel Measurement Model
Introduction:
Motivation Statement of the Problem: Color Measurement at Low Light Levels
Image Sensor Modeling: Color Measurement at Low Light Levels
Physical Background
27
• Simulating the effect of Photon Noise (given the high
intensity description of the light):
• For each bin:
ܲ ݃(ߣ௜), ݊ ൌ
௚ ఒ೔
೙௘ష೒ ഊ೔
௡!
0
2
4
6
8
10
400
420
440
460
480
500
520
540
560
580
600
620
640
660
680
700
AveragePhotonCount:g(λ)
Wavelength (nm)
ᵟ
Image Sensor Modeling: Color Measurement at Low Light Levels
Physical Background
28
• A set of Poisson distributions (one for each bin)
characterizes the targeted light.
• To estimate the spectral radiance at a lower intensity:
• The estimated quantal spectral radiance:
‫ܮ‬෠ிே ߣ௜ =
‫ܩ‬෨ி(ߣ௜)
ߜ
0
10
g(λ)
Wavelength (nm)
Image Sensor Modeling: Color Measurement at Low Light Levels
‫ܨ‬ =
low	intensity
high	intensity	
Draw samples from
ࡼ࢕࢏࢙ ࡲ ൈ ࢍ ࣅ࢏ ૚
ࡺ ࡳ෩ࡲ ࣅ࢏ ~ࡼ࢕࢏࢙ሺࡲ ൈ ࢍሺࣅ࢏ሻሻ
Simulation:
How Does Spectral Power Distribution Change with Intensity?
• The estimated spectral power distribution at
different intensities.
‫ܨ‬ = 5 ൈ 10ିଵଶ
	ܹܽ‫ݐݐ‬
ߜ ൌ 5	݊݉
‫ݐ‬ ൌ 0.2	‫ܿ݁ݏ‬
Color Perception at Low Signal to Noise Levels 29
Simulation:
How Does Spectral Power Distribution Change with Intensity?
• The estimated spectral power distribution at
different intensities.
Color Perception at Low Signal to Noise Levels 30
‫ܨ‬ ൌ 5 ൈ 10ିଵଷ
	ܹܽ‫ݐݐ‬
ߜ ൌ 5	݊݉
‫ݐ‬ ൌ 0.2	‫ܿ݁ݏ‬
Simulation:
How Does Spectral Power Distribution Change with Intensity?
• The estimated spectral power distribution at
different intensities.
Color Perception at Low Signal to Noise Levels 31
‫ܨ‬ ൌ 5 ൈ 10ିଵସ
	ܹܽ‫ݐݐ‬
ߜ ൌ 5	݊݉
‫ݐ‬ ൌ 0.2	‫ܿ݁ݏ‬
Image Sensor Modeling
32
• Image sensor pipeline (for a single channel):
Noise
Model
Photon Shot
Noise
Dark Current
Noise
Read Noise
Quantization
Noise
Image Sensor Modeling: Color Measurement at Low Light Levels
Image Sensor Modeling
33
• Image sensor pipeline (for a single channel):
Noise
Model
Photon Shot
Noise
Dark Current
Noise
Read Noise
Quantization
Noise
Image Sensor Modeling: Color Measurement at Low Light Levels
Image Sensor Modeling
34
• Image sensor pipeline (for a single channel):
Noise
Model
Photon Shot
Noise
Dark Current
Noise
Read Noise
Quantization
Noise
Image Sensor Modeling: Color Measurement at Low Light Levels
Image Sensor Modeling
35
• Image sensor pipeline (for a single channel):
Noise
Model
Photon Shot
Noise
Dark Current
Noise
Read Noise
Quantization
Noise
Image Sensor Modeling: Color Measurement at Low Light Levels
Image Sensor Modeling
36
• Image sensor pipeline (for a single channel):
Noise
Model
Photon Shot
Noise
Dark Current
Noise
Read Noise
Quantization
Noise
Image Sensor Modeling: Color Measurement at Low Light Levels
Image Sensor Modeling:
Noise Model
37
• Variations in the number of emitted photons
• Can be modeled by a Poisson Distribution
Photon Shot Noise
• The current produced inside the image sensor
• ܰௗ௔௥௞
௞
(ߙ, ߚ)~ܲ‫(ݏ݅݋‬ ߪௗ௔௥௞
௞ ଶ
)
Dark Current
Noise
• The noise in the readout circuit
• ܰ௥௘௔ௗ~ܰ(0, ߪ௥௘௔ௗ)
Read Noise
• The error introduced in the quantization step
Quantization
Noise
Image Sensor Modeling: Color Measurement at Low Light Levels
Image Sensor Modeling:
Pixel Measurement Model
38
Output of the
Image Sensor
• ܸ௞
ߙ, ߚ ൌ ‫ܩ‬௏௘ష ൈ ݂௦௔௧ ܶ ൈ ‫׬‬ ‫ܮ‬෠ிே ߙ, ߚ, ߣ ܳ௘
௞
ߣ ݀ߣ ൅ ܶ ൈ ܰௗ௔௥௞
௞
ሺߙ, ߚሻ
Measured
Voltage
• ܸ෨௞
ߙ, ߚ ൌ ܸ௞
ߙ, ߚ ൅ ܰ௥௘௔ௗሺߙ, ߚሻ
Raw Output
Image
• ࡵ࢑
ࢻ, ࢼ ൌ ࡳ ൈ ࢂ෩࢑
ሺࢻ, ࢼሻ ࢔࢈
Image Sensor Modeling: Color Measurement at Low Light Levels
What Next…
39
Conclusion
Experiments and Results:
Preparation Caveats Analysis Experiment Scenarios
Solution: Image Sensor Modeling
Physical Background Noise Model Pixel Measurement Model
Introduction:
Motivation Statement of the Problem: Color Measurement at Low Light Levels
Image Sensor Modeling: Color Measurement at Low Light Levels
Experiments & Results:
Dataset and Preparation
Dataset: “A data set for Color Research”
By: Barnard et al.
Includes:
- The Sony DXC-930 sensor sensitivity curves
- The spectra and color measurements of 598 color samples
made by the Sony camera
40
[1] K. Barnard, L. Martin, B. Funt, and A. Coath, “A data set for color research,” Color Research & Application, vol. 27, no. 3, pp.
147-151, 2002.
Experiments & Results:
Dataset and Preparation
Preparation:
− 20 samples from the 598 color measurements are selected
for our experiments
− By scaling the initial spectra, the luminance values of color
samples are set to 100
41
− The luminance of each color
sample is modified by applying
the intensity factor, F.
Image Sensor Modeling: Color Measurement at Low Light Levels
Experiments & Results:
Caveats
42
• Temperature is assumed constant, hence the dark noise
parameters are fixed during the experiments.
• Noise model is additive
• The Sony DXC-930 camera is nearly linear for most of its
range, provided it is used with gamma disabled.
• Raw output images are considered for our analysis.
• The effects of reset noise, photodetector response
nonuniformity (PRNU), dark signal nonuniformity(DSNU) are
considered negligible.
Image Sensor Modeling: Color Measurement at Low Light Levels
Experiments & Results:
Analysis
43
Experiments:
Scenario I: Ideal Image Sensor
Scenario II: Effects of Dark Current
Scenario III: Real Image Sensor Model
Image Sensor Modeling: Color Measurement at Low Light Levels
Experiments & Results:
Scenario I: Ideal Image Sensor
44
Assumptions:
• Sensor is ideal (no internal noise in the model)
• Photon shot noise may corrupt the measurements
• log ‫ܨ‬ ∈ ሼ0, െ7, െ8, െ9, െ10, െ11, െ12, െ13, െ14ሽ
Image Sensor Modeling: Color Measurement at Low Light Levels
Experiments & Results:
Scenario I: Ideal Image Sensor
45Image Sensor Modeling: Color Measurement at Low Light Levels
Chromaticity of Measured Samples at
Different Light Levels
Magnified Result of the Data Point Indexed 3
at Different Intensity Factors
Experiments & Results:
Scenario II: Effects of Dark Current
46
Assumptions:
• Only photon shot noise and dark noise may corrupt
the measurements
• Only boundary color patches are used (index: 1-13)
• ‫ܨ‬ ∈ ሼ1, 0.5, 0.1, 0.05, 0.01, 0.005, 0.001ሽ
Image Sensor Modeling: Color Measurement at Low Light Levels
Experiments & Results:
Scenario II: Effects of Dark Current
47Image Sensor Modeling: Color Measurement at Low Light Levels
Chromaticity of Measured Samples at
Different Light Levels
Magnified Result of the Data Point Indexed 3
at Different Intensity Factors
Experiments & Results:
Scenario III: Real Image Sensor Model
48
Assumptions:
• A model of real image sensor is
considered
• ‫ܨ‬ ∈ ሼ1, 0.5, 0.1, 0.05, 0.01, 0.005, 0.001ሽ
Image Sensor Modeling: Color Measurement at Low Light Levels
Experiments & Results:
Scenario III: Real Image Sensor Model
49Image Sensor Modeling: Color Measurement at Low Light Levels
Chromaticity of Measured Samples at
Different Light Levels
Magnified Result of the Data Point Indexed 3
at Different Intensity Factors
Experiments & Results:
Comparing the Three Scenarios
50Image Sensor Modeling: Color Measurement at Low Light Levels
Scenario I Scenario II Scenario III
Experiments & Results:
Comparing the Three Scenarios
51Image Sensor Modeling: Color Measurement at Low Light Levels
Scenario I Scenario II Scenario III
What Next…
52
Conclusion
Experiments and Results:
Preparation Caveats Analysis Experiment Scenarios
Solution: Image Sensor Modeling
Physical Background Noise Model Pixel Measurement Model
Introduction:
Motivation Statement of the Problem: Color Measurement at Low Light Levels
Image Sensor Modeling: Color Measurement at Low Light Levels
Conclusion
53
− Photon noise
− read noise
− quantization error
The physical limitation
imposed by the photon noise
Dark current dominates the other sensor noise types
in the image sensor
Image Sensor Modeling: Color Measurement at Low Light Levels
Uncertain measurements distributed
around the noise free measurements
Dark
current
noise
dynamic
effects
on color
measur
ements
Shifting
chromaticities
towards the
camera black
point
1
2
3
4
Prevents stable measuring of color
(even for an ideal image sensor)
Image Sensor Modeling: Color Measurement at Low Light Levels 54
Thank You for Your Attention!
Questions…
Image Sensor Modeling
55
• Image sensor pipeline (for a single channel):
Noise
Model
Photon Shot
Noise
Dark Current
Noise
Read Noise
Quantization
Noise
Image Sensor Modeling: Color Measurement at Low Light Levels
Image Sensor Modeling:
Pixel Measurement Model
56
Output of the
Image Sensor
• ‫ܩ‬௏௘ష: conversion gain (volts/݁ି
)
• ݂௦௔௧: saturation function of the sensor
• ܳ௘
௞
ߣ : the quantum efficiency function of the sensor
• ‫ܮ‬෠ிே: the quantal radiance at the intensity factor F (photons/sec/݉ଶ
/sr/nm)
ܸ௞
ߙ, ߚ ൌ ‫ܩ‬௏௘ష ൈ ݂௦௔௧ ܶ ൈ න ‫ܮ‬෠ிே ߙ, ߚ, ߣ ܳ௘
௞
ߣ ݀ߣ ൅ ܶ ൈ ܰௗ௔௥௞
௞
ሺߙ, ߚሻ
Image Sensor Modeling: Color Measurement at Low Light Levels
Image Sensor Modeling:
Pixel Measurement Model
57
Output of the
Image Sensor
• ܸ௞ ߙ, ߚ ൌ
‫ܩ‬௏௘ష ൈ ݂௦௔௧ ܶ ൈ ‫׬‬ ‫ܮ‬෠ிே ߙ, ߚ, ߣ ܳ௘
௞ ߣ ݀ߣ ൅ ܶ ൈ ܰௗ௔௥௞
௞
ሺߙ, ߚሻ
Measured
Voltage
• ࢂ෩࢑
ࢻ, ࢼ ൌ ࢂ࢑
ࢻ, ࢼ ൅ ࡺ࢘ࢋࢇࢊሺࢻ, ࢼሻ
Image Sensor Modeling: Color Measurement at Low Light Levels
Experiments & Results:
Scenario I: Ideal Image Sensor
58Image Sensor Modeling: Color Measurement at Low Light Levels
Experiments & Results:
Scenario II: Effects of Dark Current
59Image Sensor Modeling: Color Measurement at Low Light Levels
Experiments & Results:
Scenario III: Real Image Sensor Model
60Image Sensor Modeling: Color Measurement at Low Light Levels

More Related Content

What's hot

The Impact of Color Space and Intensity Normalization to Face Detection Perfo...
The Impact of Color Space and Intensity Normalization to Face Detection Perfo...The Impact of Color Space and Intensity Normalization to Face Detection Perfo...
The Impact of Color Space and Intensity Normalization to Face Detection Perfo...TELKOMNIKA JOURNAL
 
Edge detection using evolutionary algorithms new
Edge detection using evolutionary algorithms newEdge detection using evolutionary algorithms new
Edge detection using evolutionary algorithms newPriyanka Sharma
 
APPEARANCE-BASED REPRESENTATION AND RENDERING OF CAST SHADOWS
APPEARANCE-BASED REPRESENTATION AND RENDERING OF CAST SHADOWSAPPEARANCE-BASED REPRESENTATION AND RENDERING OF CAST SHADOWS
APPEARANCE-BASED REPRESENTATION AND RENDERING OF CAST SHADOWSijcga
 
Advanced Hybrid Color Space Normalization for Human Face Extraction and Detec...
Advanced Hybrid Color Space Normalization for Human Face Extraction and Detec...Advanced Hybrid Color Space Normalization for Human Face Extraction and Detec...
Advanced Hybrid Color Space Normalization for Human Face Extraction and Detec...ijsrd.com
 
Single Image Super-Resolution Using Analytical Solution for L2-L2 Algorithm
Single Image Super-Resolution Using Analytical Solution for L2-L2 AlgorithmSingle Image Super-Resolution Using Analytical Solution for L2-L2 Algorithm
Single Image Super-Resolution Using Analytical Solution for L2-L2 Algorithmijtsrd
 
Exploring Methods to Improve Edge Detection with Canny Algorithm
Exploring Methods to Improve Edge Detection with Canny AlgorithmExploring Methods to Improve Edge Detection with Canny Algorithm
Exploring Methods to Improve Edge Detection with Canny AlgorithmPrasad Thakur
 
Image Segmentation from RGBD Images by 3D Point Cloud Attributes and High-Lev...
Image Segmentation from RGBD Images by 3D Point Cloud Attributes and High-Lev...Image Segmentation from RGBD Images by 3D Point Cloud Attributes and High-Lev...
Image Segmentation from RGBD Images by 3D Point Cloud Attributes and High-Lev...CSCJournals
 
Optic flow estimation with deep learning
Optic flow estimation with deep learningOptic flow estimation with deep learning
Optic flow estimation with deep learningYu Huang
 
Lighting and shading
Lighting and shadingLighting and shading
Lighting and shadingeshveeen
 
IMAGE SEGMENTATION TECHNIQUES
IMAGE SEGMENTATION TECHNIQUESIMAGE SEGMENTATION TECHNIQUES
IMAGE SEGMENTATION TECHNIQUESVicky Kumar
 
The effects of visual realism on search tasks in mixed reality simulations-IE...
The effects of visual realism on search tasks in mixed reality simulations-IE...The effects of visual realism on search tasks in mixed reality simulations-IE...
The effects of visual realism on search tasks in mixed reality simulations-IE...Yadhu Kiran
 
An Inclusive Analysis on Various Image Enhancement Techniques
An Inclusive Analysis on Various Image Enhancement TechniquesAn Inclusive Analysis on Various Image Enhancement Techniques
An Inclusive Analysis on Various Image Enhancement TechniquesIJMER
 
Performance Evaluation of Illumination Invariant Face Recognition Algorthims
Performance Evaluation of Illumination Invariant Face Recognition AlgorthimsPerformance Evaluation of Illumination Invariant Face Recognition Algorthims
Performance Evaluation of Illumination Invariant Face Recognition AlgorthimsIRJET Journal
 
Single Image Super Resolution using Interpolation and Discrete Wavelet Transform
Single Image Super Resolution using Interpolation and Discrete Wavelet TransformSingle Image Super Resolution using Interpolation and Discrete Wavelet Transform
Single Image Super Resolution using Interpolation and Discrete Wavelet Transformijtsrd
 
Quality assessment of stereoscopic 3 d image compression by binocular integra...
Quality assessment of stereoscopic 3 d image compression by binocular integra...Quality assessment of stereoscopic 3 d image compression by binocular integra...
Quality assessment of stereoscopic 3 d image compression by binocular integra...Shakas Technologies
 

What's hot (20)

Technical Portion of PhD Research
Technical Portion of PhD ResearchTechnical Portion of PhD Research
Technical Portion of PhD Research
 
An Improved Hybrid Model for Molecular Image Denoising
An Improved Hybrid Model for Molecular Image DenoisingAn Improved Hybrid Model for Molecular Image Denoising
An Improved Hybrid Model for Molecular Image Denoising
 
PPT s02-machine vision-s2
PPT s02-machine vision-s2PPT s02-machine vision-s2
PPT s02-machine vision-s2
 
Illumination Model
Illumination ModelIllumination Model
Illumination Model
 
The Impact of Color Space and Intensity Normalization to Face Detection Perfo...
The Impact of Color Space and Intensity Normalization to Face Detection Perfo...The Impact of Color Space and Intensity Normalization to Face Detection Perfo...
The Impact of Color Space and Intensity Normalization to Face Detection Perfo...
 
Edge detection using evolutionary algorithms new
Edge detection using evolutionary algorithms newEdge detection using evolutionary algorithms new
Edge detection using evolutionary algorithms new
 
APPEARANCE-BASED REPRESENTATION AND RENDERING OF CAST SHADOWS
APPEARANCE-BASED REPRESENTATION AND RENDERING OF CAST SHADOWSAPPEARANCE-BASED REPRESENTATION AND RENDERING OF CAST SHADOWS
APPEARANCE-BASED REPRESENTATION AND RENDERING OF CAST SHADOWS
 
Advanced Hybrid Color Space Normalization for Human Face Extraction and Detec...
Advanced Hybrid Color Space Normalization for Human Face Extraction and Detec...Advanced Hybrid Color Space Normalization for Human Face Extraction and Detec...
Advanced Hybrid Color Space Normalization for Human Face Extraction and Detec...
 
Single Image Super-Resolution Using Analytical Solution for L2-L2 Algorithm
Single Image Super-Resolution Using Analytical Solution for L2-L2 AlgorithmSingle Image Super-Resolution Using Analytical Solution for L2-L2 Algorithm
Single Image Super-Resolution Using Analytical Solution for L2-L2 Algorithm
 
GRPHICS06 - Shading
GRPHICS06 - ShadingGRPHICS06 - Shading
GRPHICS06 - Shading
 
Exploring Methods to Improve Edge Detection with Canny Algorithm
Exploring Methods to Improve Edge Detection with Canny AlgorithmExploring Methods to Improve Edge Detection with Canny Algorithm
Exploring Methods to Improve Edge Detection with Canny Algorithm
 
Image Segmentation from RGBD Images by 3D Point Cloud Attributes and High-Lev...
Image Segmentation from RGBD Images by 3D Point Cloud Attributes and High-Lev...Image Segmentation from RGBD Images by 3D Point Cloud Attributes and High-Lev...
Image Segmentation from RGBD Images by 3D Point Cloud Attributes and High-Lev...
 
Optic flow estimation with deep learning
Optic flow estimation with deep learningOptic flow estimation with deep learning
Optic flow estimation with deep learning
 
Lighting and shading
Lighting and shadingLighting and shading
Lighting and shading
 
IMAGE SEGMENTATION TECHNIQUES
IMAGE SEGMENTATION TECHNIQUESIMAGE SEGMENTATION TECHNIQUES
IMAGE SEGMENTATION TECHNIQUES
 
The effects of visual realism on search tasks in mixed reality simulations-IE...
The effects of visual realism on search tasks in mixed reality simulations-IE...The effects of visual realism on search tasks in mixed reality simulations-IE...
The effects of visual realism on search tasks in mixed reality simulations-IE...
 
An Inclusive Analysis on Various Image Enhancement Techniques
An Inclusive Analysis on Various Image Enhancement TechniquesAn Inclusive Analysis on Various Image Enhancement Techniques
An Inclusive Analysis on Various Image Enhancement Techniques
 
Performance Evaluation of Illumination Invariant Face Recognition Algorthims
Performance Evaluation of Illumination Invariant Face Recognition AlgorthimsPerformance Evaluation of Illumination Invariant Face Recognition Algorthims
Performance Evaluation of Illumination Invariant Face Recognition Algorthims
 
Single Image Super Resolution using Interpolation and Discrete Wavelet Transform
Single Image Super Resolution using Interpolation and Discrete Wavelet TransformSingle Image Super Resolution using Interpolation and Discrete Wavelet Transform
Single Image Super Resolution using Interpolation and Discrete Wavelet Transform
 
Quality assessment of stereoscopic 3 d image compression by binocular integra...
Quality assessment of stereoscopic 3 d image compression by binocular integra...Quality assessment of stereoscopic 3 d image compression by binocular integra...
Quality assessment of stereoscopic 3 d image compression by binocular integra...
 

Viewers also liked

Ali khalili: Towards an Open Linked Data-based Infrastructure for Studying Sc...
Ali khalili: Towards an Open Linked Data-based Infrastructure for Studying Sc...Ali khalili: Towards an Open Linked Data-based Infrastructure for Studying Sc...
Ali khalili: Towards an Open Linked Data-based Infrastructure for Studying Sc...knowdiff
 
Using color sensor for user interaction
Using color sensor for user interaction Using color sensor for user interaction
Using color sensor for user interaction Alex Tien
 
Detection and tracking of red color by using matlab
Detection and tracking of red color by using matlabDetection and tracking of red color by using matlab
Detection and tracking of red color by using matlabAbhiraj Bohra
 
Automatic sorting machine (cpu)
Automatic sorting machine (cpu)Automatic sorting machine (cpu)
Automatic sorting machine (cpu)vishnucool
 
Presentation Object Recognition And Tracking Project
Presentation Object Recognition And Tracking ProjectPresentation Object Recognition And Tracking Project
Presentation Object Recognition And Tracking ProjectPrathamesh Joshi
 
Automatic intelligent industrial object sorter with conveyor belt
Automatic intelligent industrial object sorter with conveyor beltAutomatic intelligent industrial object sorter with conveyor belt
Automatic intelligent industrial object sorter with conveyor beltindianspandana
 
RGB colour detection and tracking on MATLAB
RGB colour detection and tracking on MATLABRGB colour detection and tracking on MATLAB
RGB colour detection and tracking on MATLABNirma University
 
Intelligent conveyor belt system
Intelligent conveyor belt systemIntelligent conveyor belt system
Intelligent conveyor belt systemrumaisaam
 
UX, ethnography and possibilities: for Libraries, Museums and Archives
UX, ethnography and possibilities: for Libraries, Museums and ArchivesUX, ethnography and possibilities: for Libraries, Museums and Archives
UX, ethnography and possibilities: for Libraries, Museums and ArchivesNed Potter
 
Hype vs. Reality: The AI Explainer
Hype vs. Reality: The AI ExplainerHype vs. Reality: The AI Explainer
Hype vs. Reality: The AI ExplainerLuminary Labs
 

Viewers also liked (14)

Ali khalili: Towards an Open Linked Data-based Infrastructure for Studying Sc...
Ali khalili: Towards an Open Linked Data-based Infrastructure for Studying Sc...Ali khalili: Towards an Open Linked Data-based Infrastructure for Studying Sc...
Ali khalili: Towards an Open Linked Data-based Infrastructure for Studying Sc...
 
Using color sensor for user interaction
Using color sensor for user interaction Using color sensor for user interaction
Using color sensor for user interaction
 
Color sensor
Color sensorColor sensor
Color sensor
 
Colour sensor vivek
Colour sensor   vivekColour sensor   vivek
Colour sensor vivek
 
Color detection
Color detectionColor detection
Color detection
 
Detection and tracking of red color by using matlab
Detection and tracking of red color by using matlabDetection and tracking of red color by using matlab
Detection and tracking of red color by using matlab
 
Robotics-Colour sensor
Robotics-Colour sensorRobotics-Colour sensor
Robotics-Colour sensor
 
Automatic sorting machine (cpu)
Automatic sorting machine (cpu)Automatic sorting machine (cpu)
Automatic sorting machine (cpu)
 
Presentation Object Recognition And Tracking Project
Presentation Object Recognition And Tracking ProjectPresentation Object Recognition And Tracking Project
Presentation Object Recognition And Tracking Project
 
Automatic intelligent industrial object sorter with conveyor belt
Automatic intelligent industrial object sorter with conveyor beltAutomatic intelligent industrial object sorter with conveyor belt
Automatic intelligent industrial object sorter with conveyor belt
 
RGB colour detection and tracking on MATLAB
RGB colour detection and tracking on MATLABRGB colour detection and tracking on MATLAB
RGB colour detection and tracking on MATLAB
 
Intelligent conveyor belt system
Intelligent conveyor belt systemIntelligent conveyor belt system
Intelligent conveyor belt system
 
UX, ethnography and possibilities: for Libraries, Museums and Archives
UX, ethnography and possibilities: for Libraries, Museums and ArchivesUX, ethnography and possibilities: for Libraries, Museums and Archives
UX, ethnography and possibilities: for Libraries, Museums and Archives
 
Hype vs. Reality: The AI Explainer
Hype vs. Reality: The AI ExplainerHype vs. Reality: The AI Explainer
Hype vs. Reality: The AI Explainer
 

Similar to Mehdi Rezagholizadeh: Image Sensor Modeling: Color Measurement at Low Light Levels

DIGITAL IMAGE PROCESSING - Visual perception - DAY 2
DIGITAL IMAGE PROCESSING - Visual perception - DAY 2DIGITAL IMAGE PROCESSING - Visual perception - DAY 2
DIGITAL IMAGE PROCESSING - Visual perception - DAY 2vijayanand Kandaswamy
 
The Importance of Terminology and sRGB Uncertainty - Notes - 0.5
The Importance of Terminology and sRGB Uncertainty - Notes - 0.5The Importance of Terminology and sRGB Uncertainty - Notes - 0.5
The Importance of Terminology and sRGB Uncertainty - Notes - 0.5Thomas Mansencal
 
DIGITAL IMAGE PROCESSING - LECTURE NOTES
DIGITAL IMAGE PROCESSING - LECTURE NOTESDIGITAL IMAGE PROCESSING - LECTURE NOTES
DIGITAL IMAGE PROCESSING - LECTURE NOTESEzhilya venkat
 
MC0086 Internal Assignment (SMU)
MC0086 Internal Assignment (SMU)MC0086 Internal Assignment (SMU)
MC0086 Internal Assignment (SMU)Krishan Pareek
 
Color Image Processing
Color Image ProcessingColor Image Processing
Color Image Processingkiruthiammu
 
Colour Printing 7.0 Next Generation Multi-Channel Printing
Colour Printing 7.0 Next Generation Multi-Channel PrintingColour Printing 7.0 Next Generation Multi-Channel Printing
Colour Printing 7.0 Next Generation Multi-Channel PrintingLudovic Gustafsson Coppel
 
Digital Image Fundamentals
Digital Image FundamentalsDigital Image Fundamentals
Digital Image FundamentalsKalyan Acharjya
 
Introduction to Color Science for display engineer
Introduction to Color Science for display engineerIntroduction to Color Science for display engineer
Introduction to Color Science for display engineerBrian Kim, PhD
 
International Journal of Engineering Research and Development (IJERD)
International Journal of Engineering Research and Development (IJERD)International Journal of Engineering Research and Development (IJERD)
International Journal of Engineering Research and Development (IJERD)IJERD Editor
 
IEEE 2014 MATLAB IMAGE PROCESSING PROJECTS Multi illuminant estimation with c...
IEEE 2014 MATLAB IMAGE PROCESSING PROJECTS Multi illuminant estimation with c...IEEE 2014 MATLAB IMAGE PROCESSING PROJECTS Multi illuminant estimation with c...
IEEE 2014 MATLAB IMAGE PROCESSING PROJECTS Multi illuminant estimation with c...IEEEBEBTECHSTUDENTPROJECTS
 
A Novel and Robust Wavelet based Super Resolution Reconstruction of Low Resol...
A Novel and Robust Wavelet based Super Resolution Reconstruction of Low Resol...A Novel and Robust Wavelet based Super Resolution Reconstruction of Low Resol...
A Novel and Robust Wavelet based Super Resolution Reconstruction of Low Resol...CSCJournals
 
Paper on image processing
Paper on image processingPaper on image processing
Paper on image processingSaloni Bhatia
 

Similar to Mehdi Rezagholizadeh: Image Sensor Modeling: Color Measurement at Low Light Levels (20)

DIGITAL IMAGE PROCESSING - Visual perception - DAY 2
DIGITAL IMAGE PROCESSING - Visual perception - DAY 2DIGITAL IMAGE PROCESSING - Visual perception - DAY 2
DIGITAL IMAGE PROCESSING - Visual perception - DAY 2
 
The Importance of Terminology and sRGB Uncertainty - Notes - 0.5
The Importance of Terminology and sRGB Uncertainty - Notes - 0.5The Importance of Terminology and sRGB Uncertainty - Notes - 0.5
The Importance of Terminology and sRGB Uncertainty - Notes - 0.5
 
lecture_07.pptx
lecture_07.pptxlecture_07.pptx
lecture_07.pptx
 
I0351053058
I0351053058I0351053058
I0351053058
 
Image Filtering
Image FilteringImage Filtering
Image Filtering
 
Module 1.pptx
Module 1.pptxModule 1.pptx
Module 1.pptx
 
DIGITAL IMAGE PROCESSING - LECTURE NOTES
DIGITAL IMAGE PROCESSING - LECTURE NOTESDIGITAL IMAGE PROCESSING - LECTURE NOTES
DIGITAL IMAGE PROCESSING - LECTURE NOTES
 
Dip chapter 2
Dip chapter 2Dip chapter 2
Dip chapter 2
 
MC0086 Internal Assignment (SMU)
MC0086 Internal Assignment (SMU)MC0086 Internal Assignment (SMU)
MC0086 Internal Assignment (SMU)
 
Color Image Processing
Color Image ProcessingColor Image Processing
Color Image Processing
 
Colour Printing 7.0 Next Generation Multi-Channel Printing
Colour Printing 7.0 Next Generation Multi-Channel PrintingColour Printing 7.0 Next Generation Multi-Channel Printing
Colour Printing 7.0 Next Generation Multi-Channel Printing
 
[IJET-V1I6P10] Authors: Mr.B.V.Sathish Kumar, M.Tech Scholar G.Sumalatha
[IJET-V1I6P10] Authors: Mr.B.V.Sathish Kumar, M.Tech Scholar G.Sumalatha [IJET-V1I6P10] Authors: Mr.B.V.Sathish Kumar, M.Tech Scholar G.Sumalatha
[IJET-V1I6P10] Authors: Mr.B.V.Sathish Kumar, M.Tech Scholar G.Sumalatha
 
PPT s03-machine vision-s2
PPT s03-machine vision-s2PPT s03-machine vision-s2
PPT s03-machine vision-s2
 
Digital Image Fundamentals
Digital Image FundamentalsDigital Image Fundamentals
Digital Image Fundamentals
 
Introduction to Color Science for display engineer
Introduction to Color Science for display engineerIntroduction to Color Science for display engineer
Introduction to Color Science for display engineer
 
DIP-Questions.pdf
DIP-Questions.pdfDIP-Questions.pdf
DIP-Questions.pdf
 
International Journal of Engineering Research and Development (IJERD)
International Journal of Engineering Research and Development (IJERD)International Journal of Engineering Research and Development (IJERD)
International Journal of Engineering Research and Development (IJERD)
 
IEEE 2014 MATLAB IMAGE PROCESSING PROJECTS Multi illuminant estimation with c...
IEEE 2014 MATLAB IMAGE PROCESSING PROJECTS Multi illuminant estimation with c...IEEE 2014 MATLAB IMAGE PROCESSING PROJECTS Multi illuminant estimation with c...
IEEE 2014 MATLAB IMAGE PROCESSING PROJECTS Multi illuminant estimation with c...
 
A Novel and Robust Wavelet based Super Resolution Reconstruction of Low Resol...
A Novel and Robust Wavelet based Super Resolution Reconstruction of Low Resol...A Novel and Robust Wavelet based Super Resolution Reconstruction of Low Resol...
A Novel and Robust Wavelet based Super Resolution Reconstruction of Low Resol...
 
Paper on image processing
Paper on image processingPaper on image processing
Paper on image processing
 

More from knowdiff

Ut talk feb 2017
Ut talk   feb 2017Ut talk   feb 2017
Ut talk feb 2017knowdiff
 
Scheduling for cloud systems with multi level data locality
Scheduling for cloud systems with multi level data localityScheduling for cloud systems with multi level data locality
Scheduling for cloud systems with multi level data localityknowdiff
 
Amin Milani Fard: Directed Model Inference for Testing and Analysis of Web Ap...
Amin Milani Fard: Directed Model Inference for Testing and Analysis of Web Ap...Amin Milani Fard: Directed Model Inference for Testing and Analysis of Web Ap...
Amin Milani Fard: Directed Model Inference for Testing and Analysis of Web Ap...knowdiff
 
Knowledge based economy and power of crowd sourcing
Knowledge based economy and power of crowd sourcing Knowledge based economy and power of crowd sourcing
Knowledge based economy and power of crowd sourcing knowdiff
 
Amin tayyebi: Big Data and Land Use Change Science
Amin tayyebi: Big Data and Land Use Change ScienceAmin tayyebi: Big Data and Land Use Change Science
Amin tayyebi: Big Data and Land Use Change Scienceknowdiff
 
Sara Afshar: Scheduling and Resource Sharing in Multiprocessor Real-Time Systems
Sara Afshar: Scheduling and Resource Sharing in Multiprocessor Real-Time SystemsSara Afshar: Scheduling and Resource Sharing in Multiprocessor Real-Time Systems
Sara Afshar: Scheduling and Resource Sharing in Multiprocessor Real-Time Systemsknowdiff
 
Seyed Mehdi mohaghegh: Modelling material use within the low carbon energy pa...
Seyed Mehdi mohaghegh: Modelling material use within the low carbon energy pa...Seyed Mehdi mohaghegh: Modelling material use within the low carbon energy pa...
Seyed Mehdi mohaghegh: Modelling material use within the low carbon energy pa...knowdiff
 
Narjess Afzaly: Model Your Problem with Graphs and Generate your objects
Narjess Afzaly: Model Your Problem with Graphs and Generate your objectsNarjess Afzaly: Model Your Problem with Graphs and Generate your objects
Narjess Afzaly: Model Your Problem with Graphs and Generate your objectsknowdiff
 
Computational methods applications in air pollution modeling (Dr. Yadghar)
Computational methods applications in air pollution modeling (Dr. Yadghar)Computational methods applications in air pollution modeling (Dr. Yadghar)
Computational methods applications in air pollution modeling (Dr. Yadghar)knowdiff
 
Somaz Kolahi : Functional Dependencies: Redundancy Analysis and Correcting Vi...
Somaz Kolahi : Functional Dependencies: Redundancy Analysis and Correcting Vi...Somaz Kolahi : Functional Dependencies: Redundancy Analysis and Correcting Vi...
Somaz Kolahi : Functional Dependencies: Redundancy Analysis and Correcting Vi...knowdiff
 
Uncalibrated Image-Based Robotic Visual Servoing (knowdiff.net)
Uncalibrated Image-Based Robotic Visual Servoing (knowdiff.net)Uncalibrated Image-Based Robotic Visual Servoing (knowdiff.net)
Uncalibrated Image-Based Robotic Visual Servoing (knowdiff.net)knowdiff
 
Knowdiff visiting lecturer 140 (Azad Shademan): Uncalibrated Image-Based Robo...
Knowdiff visiting lecturer 140 (Azad Shademan): Uncalibrated Image-Based Robo...Knowdiff visiting lecturer 140 (Azad Shademan): Uncalibrated Image-Based Robo...
Knowdiff visiting lecturer 140 (Azad Shademan): Uncalibrated Image-Based Robo...knowdiff
 
Mehran Shaghaghi: Quantum Mechanics Dilemmas
Mehran Shaghaghi: Quantum Mechanics DilemmasMehran Shaghaghi: Quantum Mechanics Dilemmas
Mehran Shaghaghi: Quantum Mechanics Dilemmasknowdiff
 
Hossein Taghavi : Codes on Graphs
Hossein Taghavi : Codes on GraphsHossein Taghavi : Codes on Graphs
Hossein Taghavi : Codes on Graphsknowdiff
 
Dr. Amir Nejat
Dr. Amir NejatDr. Amir Nejat
Dr. Amir Nejatknowdiff
 

More from knowdiff (16)

Ut talk feb 2017
Ut talk   feb 2017Ut talk   feb 2017
Ut talk feb 2017
 
Scheduling for cloud systems with multi level data locality
Scheduling for cloud systems with multi level data localityScheduling for cloud systems with multi level data locality
Scheduling for cloud systems with multi level data locality
 
Amin Milani Fard: Directed Model Inference for Testing and Analysis of Web Ap...
Amin Milani Fard: Directed Model Inference for Testing and Analysis of Web Ap...Amin Milani Fard: Directed Model Inference for Testing and Analysis of Web Ap...
Amin Milani Fard: Directed Model Inference for Testing and Analysis of Web Ap...
 
Knowledge based economy and power of crowd sourcing
Knowledge based economy and power of crowd sourcing Knowledge based economy and power of crowd sourcing
Knowledge based economy and power of crowd sourcing
 
Amin tayyebi: Big Data and Land Use Change Science
Amin tayyebi: Big Data and Land Use Change ScienceAmin tayyebi: Big Data and Land Use Change Science
Amin tayyebi: Big Data and Land Use Change Science
 
Sara Afshar: Scheduling and Resource Sharing in Multiprocessor Real-Time Systems
Sara Afshar: Scheduling and Resource Sharing in Multiprocessor Real-Time SystemsSara Afshar: Scheduling and Resource Sharing in Multiprocessor Real-Time Systems
Sara Afshar: Scheduling and Resource Sharing in Multiprocessor Real-Time Systems
 
Seyed Mehdi mohaghegh: Modelling material use within the low carbon energy pa...
Seyed Mehdi mohaghegh: Modelling material use within the low carbon energy pa...Seyed Mehdi mohaghegh: Modelling material use within the low carbon energy pa...
Seyed Mehdi mohaghegh: Modelling material use within the low carbon energy pa...
 
Narjess Afzaly: Model Your Problem with Graphs and Generate your objects
Narjess Afzaly: Model Your Problem with Graphs and Generate your objectsNarjess Afzaly: Model Your Problem with Graphs and Generate your objects
Narjess Afzaly: Model Your Problem with Graphs and Generate your objects
 
Computational methods applications in air pollution modeling (Dr. Yadghar)
Computational methods applications in air pollution modeling (Dr. Yadghar)Computational methods applications in air pollution modeling (Dr. Yadghar)
Computational methods applications in air pollution modeling (Dr. Yadghar)
 
Somaz Kolahi : Functional Dependencies: Redundancy Analysis and Correcting Vi...
Somaz Kolahi : Functional Dependencies: Redundancy Analysis and Correcting Vi...Somaz Kolahi : Functional Dependencies: Redundancy Analysis and Correcting Vi...
Somaz Kolahi : Functional Dependencies: Redundancy Analysis and Correcting Vi...
 
Uncalibrated Image-Based Robotic Visual Servoing (knowdiff.net)
Uncalibrated Image-Based Robotic Visual Servoing (knowdiff.net)Uncalibrated Image-Based Robotic Visual Servoing (knowdiff.net)
Uncalibrated Image-Based Robotic Visual Servoing (knowdiff.net)
 
Knowdiff visiting lecturer 140 (Azad Shademan): Uncalibrated Image-Based Robo...
Knowdiff visiting lecturer 140 (Azad Shademan): Uncalibrated Image-Based Robo...Knowdiff visiting lecturer 140 (Azad Shademan): Uncalibrated Image-Based Robo...
Knowdiff visiting lecturer 140 (Azad Shademan): Uncalibrated Image-Based Robo...
 
Mehran Shaghaghi: Quantum Mechanics Dilemmas
Mehran Shaghaghi: Quantum Mechanics DilemmasMehran Shaghaghi: Quantum Mechanics Dilemmas
Mehran Shaghaghi: Quantum Mechanics Dilemmas
 
Hossein Taghavi : Codes on Graphs
Hossein Taghavi : Codes on GraphsHossein Taghavi : Codes on Graphs
Hossein Taghavi : Codes on Graphs
 
Dr. Amir Nejat
Dr. Amir NejatDr. Amir Nejat
Dr. Amir Nejat
 
Alborz
AlborzAlborz
Alborz
 

Recently uploaded

Introduction to Microprocesso programming and interfacing.pptx
Introduction to Microprocesso programming and interfacing.pptxIntroduction to Microprocesso programming and interfacing.pptx
Introduction to Microprocesso programming and interfacing.pptxvipinkmenon1
 
Sachpazis Costas: Geotechnical Engineering: A student's Perspective Introduction
Sachpazis Costas: Geotechnical Engineering: A student's Perspective IntroductionSachpazis Costas: Geotechnical Engineering: A student's Perspective Introduction
Sachpazis Costas: Geotechnical Engineering: A student's Perspective IntroductionDr.Costas Sachpazis
 
VIP Call Girls Service Hitech City Hyderabad Call +91-8250192130
VIP Call Girls Service Hitech City Hyderabad Call +91-8250192130VIP Call Girls Service Hitech City Hyderabad Call +91-8250192130
VIP Call Girls Service Hitech City Hyderabad Call +91-8250192130Suhani Kapoor
 
power system scada applications and uses
power system scada applications and usespower system scada applications and uses
power system scada applications and usesDevarapalliHaritha
 
VICTOR MAESTRE RAMIREZ - Planetary Defender on NASA's Double Asteroid Redirec...
VICTOR MAESTRE RAMIREZ - Planetary Defender on NASA's Double Asteroid Redirec...VICTOR MAESTRE RAMIREZ - Planetary Defender on NASA's Double Asteroid Redirec...
VICTOR MAESTRE RAMIREZ - Planetary Defender on NASA's Double Asteroid Redirec...VICTOR MAESTRE RAMIREZ
 
OSVC_Meta-Data based Simulation Automation to overcome Verification Challenge...
OSVC_Meta-Data based Simulation Automation to overcome Verification Challenge...OSVC_Meta-Data based Simulation Automation to overcome Verification Challenge...
OSVC_Meta-Data based Simulation Automation to overcome Verification Challenge...Soham Mondal
 
Gfe Mayur Vihar Call Girls Service WhatsApp -> 9999965857 Available 24x7 ^ De...
Gfe Mayur Vihar Call Girls Service WhatsApp -> 9999965857 Available 24x7 ^ De...Gfe Mayur Vihar Call Girls Service WhatsApp -> 9999965857 Available 24x7 ^ De...
Gfe Mayur Vihar Call Girls Service WhatsApp -> 9999965857 Available 24x7 ^ De...srsj9000
 
Call Girls Delhi {Jodhpur} 9711199012 high profile service
Call Girls Delhi {Jodhpur} 9711199012 high profile serviceCall Girls Delhi {Jodhpur} 9711199012 high profile service
Call Girls Delhi {Jodhpur} 9711199012 high profile servicerehmti665
 
Internship report on mechanical engineering
Internship report on mechanical engineeringInternship report on mechanical engineering
Internship report on mechanical engineeringmalavadedarshan25
 
Oxy acetylene welding presentation note.
Oxy acetylene welding presentation note.Oxy acetylene welding presentation note.
Oxy acetylene welding presentation note.eptoze12
 
Decoding Kotlin - Your guide to solving the mysterious in Kotlin.pptx
Decoding Kotlin - Your guide to solving the mysterious in Kotlin.pptxDecoding Kotlin - Your guide to solving the mysterious in Kotlin.pptx
Decoding Kotlin - Your guide to solving the mysterious in Kotlin.pptxJoão Esperancinha
 
(ANVI) Koregaon Park Call Girls Just Call 7001035870 [ Cash on Delivery ] Pun...
(ANVI) Koregaon Park Call Girls Just Call 7001035870 [ Cash on Delivery ] Pun...(ANVI) Koregaon Park Call Girls Just Call 7001035870 [ Cash on Delivery ] Pun...
(ANVI) Koregaon Park Call Girls Just Call 7001035870 [ Cash on Delivery ] Pun...ranjana rawat
 
microprocessor 8085 and its interfacing
microprocessor 8085  and its interfacingmicroprocessor 8085  and its interfacing
microprocessor 8085 and its interfacingjaychoudhary37
 
High Profile Call Girls Nagpur Meera Call 7001035870 Meet With Nagpur Escorts
High Profile Call Girls Nagpur Meera Call 7001035870 Meet With Nagpur EscortsHigh Profile Call Girls Nagpur Meera Call 7001035870 Meet With Nagpur Escorts
High Profile Call Girls Nagpur Meera Call 7001035870 Meet With Nagpur EscortsCall Girls in Nagpur High Profile
 
chaitra-1.pptx fake news detection using machine learning
chaitra-1.pptx  fake news detection using machine learningchaitra-1.pptx  fake news detection using machine learning
chaitra-1.pptx fake news detection using machine learningmisbanausheenparvam
 
Model Call Girl in Narela Delhi reach out to us at 🔝8264348440🔝
Model Call Girl in Narela Delhi reach out to us at 🔝8264348440🔝Model Call Girl in Narela Delhi reach out to us at 🔝8264348440🔝
Model Call Girl in Narela Delhi reach out to us at 🔝8264348440🔝soniya singh
 
GDSC ASEB Gen AI study jams presentation
GDSC ASEB Gen AI study jams presentationGDSC ASEB Gen AI study jams presentation
GDSC ASEB Gen AI study jams presentationGDSCAESB
 

Recently uploaded (20)

Introduction to Microprocesso programming and interfacing.pptx
Introduction to Microprocesso programming and interfacing.pptxIntroduction to Microprocesso programming and interfacing.pptx
Introduction to Microprocesso programming and interfacing.pptx
 
9953056974 Call Girls In South Ex, Escorts (Delhi) NCR.pdf
9953056974 Call Girls In South Ex, Escorts (Delhi) NCR.pdf9953056974 Call Girls In South Ex, Escorts (Delhi) NCR.pdf
9953056974 Call Girls In South Ex, Escorts (Delhi) NCR.pdf
 
Sachpazis Costas: Geotechnical Engineering: A student's Perspective Introduction
Sachpazis Costas: Geotechnical Engineering: A student's Perspective IntroductionSachpazis Costas: Geotechnical Engineering: A student's Perspective Introduction
Sachpazis Costas: Geotechnical Engineering: A student's Perspective Introduction
 
VIP Call Girls Service Hitech City Hyderabad Call +91-8250192130
VIP Call Girls Service Hitech City Hyderabad Call +91-8250192130VIP Call Girls Service Hitech City Hyderabad Call +91-8250192130
VIP Call Girls Service Hitech City Hyderabad Call +91-8250192130
 
power system scada applications and uses
power system scada applications and usespower system scada applications and uses
power system scada applications and uses
 
VICTOR MAESTRE RAMIREZ - Planetary Defender on NASA's Double Asteroid Redirec...
VICTOR MAESTRE RAMIREZ - Planetary Defender on NASA's Double Asteroid Redirec...VICTOR MAESTRE RAMIREZ - Planetary Defender on NASA's Double Asteroid Redirec...
VICTOR MAESTRE RAMIREZ - Planetary Defender on NASA's Double Asteroid Redirec...
 
OSVC_Meta-Data based Simulation Automation to overcome Verification Challenge...
OSVC_Meta-Data based Simulation Automation to overcome Verification Challenge...OSVC_Meta-Data based Simulation Automation to overcome Verification Challenge...
OSVC_Meta-Data based Simulation Automation to overcome Verification Challenge...
 
Gfe Mayur Vihar Call Girls Service WhatsApp -> 9999965857 Available 24x7 ^ De...
Gfe Mayur Vihar Call Girls Service WhatsApp -> 9999965857 Available 24x7 ^ De...Gfe Mayur Vihar Call Girls Service WhatsApp -> 9999965857 Available 24x7 ^ De...
Gfe Mayur Vihar Call Girls Service WhatsApp -> 9999965857 Available 24x7 ^ De...
 
Call Girls Delhi {Jodhpur} 9711199012 high profile service
Call Girls Delhi {Jodhpur} 9711199012 high profile serviceCall Girls Delhi {Jodhpur} 9711199012 high profile service
Call Girls Delhi {Jodhpur} 9711199012 high profile service
 
🔝9953056974🔝!!-YOUNG call girls in Rajendra Nagar Escort rvice Shot 2000 nigh...
🔝9953056974🔝!!-YOUNG call girls in Rajendra Nagar Escort rvice Shot 2000 nigh...🔝9953056974🔝!!-YOUNG call girls in Rajendra Nagar Escort rvice Shot 2000 nigh...
🔝9953056974🔝!!-YOUNG call girls in Rajendra Nagar Escort rvice Shot 2000 nigh...
 
Internship report on mechanical engineering
Internship report on mechanical engineeringInternship report on mechanical engineering
Internship report on mechanical engineering
 
Oxy acetylene welding presentation note.
Oxy acetylene welding presentation note.Oxy acetylene welding presentation note.
Oxy acetylene welding presentation note.
 
Decoding Kotlin - Your guide to solving the mysterious in Kotlin.pptx
Decoding Kotlin - Your guide to solving the mysterious in Kotlin.pptxDecoding Kotlin - Your guide to solving the mysterious in Kotlin.pptx
Decoding Kotlin - Your guide to solving the mysterious in Kotlin.pptx
 
(ANVI) Koregaon Park Call Girls Just Call 7001035870 [ Cash on Delivery ] Pun...
(ANVI) Koregaon Park Call Girls Just Call 7001035870 [ Cash on Delivery ] Pun...(ANVI) Koregaon Park Call Girls Just Call 7001035870 [ Cash on Delivery ] Pun...
(ANVI) Koregaon Park Call Girls Just Call 7001035870 [ Cash on Delivery ] Pun...
 
microprocessor 8085 and its interfacing
microprocessor 8085  and its interfacingmicroprocessor 8085  and its interfacing
microprocessor 8085 and its interfacing
 
High Profile Call Girls Nagpur Meera Call 7001035870 Meet With Nagpur Escorts
High Profile Call Girls Nagpur Meera Call 7001035870 Meet With Nagpur EscortsHigh Profile Call Girls Nagpur Meera Call 7001035870 Meet With Nagpur Escorts
High Profile Call Girls Nagpur Meera Call 7001035870 Meet With Nagpur Escorts
 
chaitra-1.pptx fake news detection using machine learning
chaitra-1.pptx  fake news detection using machine learningchaitra-1.pptx  fake news detection using machine learning
chaitra-1.pptx fake news detection using machine learning
 
young call girls in Rajiv Chowk🔝 9953056974 🔝 Delhi escort Service
young call girls in Rajiv Chowk🔝 9953056974 🔝 Delhi escort Serviceyoung call girls in Rajiv Chowk🔝 9953056974 🔝 Delhi escort Service
young call girls in Rajiv Chowk🔝 9953056974 🔝 Delhi escort Service
 
Model Call Girl in Narela Delhi reach out to us at 🔝8264348440🔝
Model Call Girl in Narela Delhi reach out to us at 🔝8264348440🔝Model Call Girl in Narela Delhi reach out to us at 🔝8264348440🔝
Model Call Girl in Narela Delhi reach out to us at 🔝8264348440🔝
 
GDSC ASEB Gen AI study jams presentation
GDSC ASEB Gen AI study jams presentationGDSC ASEB Gen AI study jams presentation
GDSC ASEB Gen AI study jams presentation
 

Mehdi Rezagholizadeh: Image Sensor Modeling: Color Measurement at Low Light Levels

  • 1. Color Perception at Low Signal to Noise Levels By: Mehdi REZAGHOLIZADEH MCGILL UNIVERSITY DEPARTMENT OF ELECTRICAL AND COMPUTER ENGINEERING Supervisor: Prof. James J. CLARK Brief Overview DECEMBER 2014
  • 2. Statement of Problems • Developing a Fast and Accurate Color Constancy Method • Color Appearance Modeling at Low Light Levels • Image Sensor Modeling and Color Measurement at Low Light Levels 2
  • 3. Definition of Color Constancy • Discounting the illuminant effect on the color of objects • Color constancy is a great feature of our visual system 3Computational Color Constancy
  • 4. Importance of Color Constancy • Applications: Object Recognition Image Enhancement Robot Vision Object Tracking Photography and Film Industry The last three cases are real-time applications of color constancy. 4Computational Color Constancy
  • 5. Problem of Color Constancy 5Computational Color Constancy
  • 6. Problem of Color Constancy • Image Formation Model: ܴ௜ = න ‫ܧ‬ ߣ ܵ ߣ, ‫ݔ‬ ߩ௜ ߣ ݀ߣ ‫ܧ‬ ߣ : the illuminant spectrum ܵ(ߣ, ‫:)ݔ‬ the surface spectral reflectance function at location ‫.ݔ‬ ߩ௜(ߣ): the sensor spectral sensitivity ܴ௜: the sensor response of ith channel 6Computational Color Constancy
  • 7. Problem of Color Constancy • The Transformation Imposed by a Change in Illumination: ܴ௜ = න ‫ܧ‬ ߣ ܵ ߣ, ‫ݔ‬ ߩ௜ ߣ ݀ߣ Givens: ߩ௜(ߣ): the sensor spectral sensitivity ܴ௜: the sensor response of ith channel Unknowns: ‫ܧ‬ ߣ : the illuminant spectrum ܵ(ߣ, ‫:)ݔ‬ the surface spectral reflectance function at location ‫.ݔ‬ Spectral Color Constancy Approaches try to find the entire spectrum of the illuminant and the surface spectral reflectance function. It is an ill-posed problem. 7Computational Color Constancy
  • 8. Methods of Color Constancy Computational Color Constancy Spectral Methods Non-spectral Methods Static Methods Gamut-Based Learning-Based 8Computational Color Constancy
  • 9. Non-Spectral Methods: • MAIN Objective of this problem is to obtain: ܴ௜ ௌ = න ܵ ߣ, ‫ݔ‬ ߩ௜ ߣ ݀ߣ It is equivalent to obtaining the sensor responses when ‫ܧ‬ ߣ = 1. • Assuming that color of the illuminant can be estimated: ܴ௜ ா = න ‫ܧ‬ ߣ ߩ௜ ߣ ݀ߣ • The Transformation Imposed by an illuminant can be obtained through an Over-simplification: ܴ௜ ௌ ≅ ܴ௜ ܴ௜ ா = ‫׬‬ ‫ܧ‬ ߣ ܵ ߣ, ‫ݔ‬ ߩ௜ ߣ ݀ߣ ‫׬‬ ‫ܧ‬ ߣ ߩ௜ ߣ ݀ߣ 9Computational Color Constancy, March. 2014
  • 10. Non-Spectral Methods: Over-simplification leads to: - Estimating the illuminant color rather than - Estimating the entire spectrum of the illuminant ‫)ߣ(ܧ‬ • Corrective Transformation: ܴଵ ௦ ܴଶ ௦ ܴଷ ௦ = 1 ܴଵ ா 0 0 0 1 ܴଶ ா 0 0 0 1 ܴଶ ா ܴଵ ܴଶ ܴଷ 10Computational Color Constancy, March. 2014
  • 11. Problem II: Color Appearance Modeling at Low Light Levels • Color Appearance Model (CAM): • An ideal color appearance model: The output resembles human perception in all conditions including different light levels • Lack of a good color appearance model for low light conditions Color Perception at Low Signal to Noise Levels 11 TransformTransform Tristimulus values (RGB) Perceptual attributes of color: lightness, hue, chroma
  • 12. Biophysical Background • Our eye can work in three different modes: 1- Photopic condition (Luminance>5 cd/m2 ) 2- Mesopic condition (0.005<Luminance<5 cd/m2 ) 3- Scotopic condition (Luminance<0.005 cd/m2 ) • Photopic Condition: (High Light Levels) Color Perception at Low Signal to Noise Levels 12 • Mesopic Condition: (Low Light Levels)• Scotopic Condition: (Very Low Light Levels)
  • 13. Background and Preliminaries • Existing Models for Mesopic & Scotopic Vision: Modeling Blue Shift in Moonlit scenes [1] – Addresses scotopic vision by adding some blue to the initial image – The output of this algorithm does not look natural and realistic Cao’s Model of Mesopic Vision [2] – It is a two stage model based on the gain control and cone opponent mechanisms – Model is fitted to the psychophysical experiment data iCAM06 Tone Compression Model for Mesopic Vision [3] – iCAM06 includes rod responses in a linear fashion Shin’s Color Appearance Model [4] – Boynton two-stage model is fitted to the behavioral experiment data 13 [1] S. M. Khan and S. N. Pattanaik, “Modeling blue shift in moonlit scenes by rod cone interaction,” Journal of VISION, vol. 4, no. 8, 2004. [2] D. Cao, J. Pokorny, V. C. Smith, and A. J. Zele, “Rod contributions to color perception: linear with rod contrast," Vision research, vol. 48, no. 26, pp. 2586-2592, 2008. [3] J. Kuang, G. M. Johnson, and M. D. Fairchild, “iCAM06: a rened image appearance model for HDR image rendering," Journal of Visual Communication and Image Representation, vol. 18, no. 5, pp. 406 -414, 2007. [4] J. Shin, N. Matsuki, H. Yaguchi, and S. Shioiri, “A color appearance model applicable in mesopic vision," Optical review, vol. 11, no. 4, pp. 272-278, 2004.
  • 14. Physics & Color Perception Color Perception at Low Signal to Noise Levels 14 Problem • Lack of a good color appearance model (CAM) for the low light conditions Physics • The basic physical principles governing the probabilistic nature of color perception at low light levels Analysis • Photon Detection and Color Perception at low light levels
  • 15. Proposed Method: Maximum Entropy Spectral Modeling Approach to the Low Light Levels Color Appearance Modeling • Under very low light conditions: The photoreceptor responses more uncertain • Hypothesis: Color Perception at Low Signal to Noise Levels 15 Visual Processing Center reconstructs a part of the information being lost in the projection of light spectra into the space of photoreceptor responses
  • 16. Proposed Method: Maximum Entropy Spectral Modeling Approach to the Low Light Levels Color Appearance Modeling • The spectral theory of color perception [Clark and Skaff, 2009]: Provides a tool to address the issues of uncertain measurements Estimates the spectral power distributions corresponding to these uncertain measurements. Color Perception at Low Signal to Noise Levels 16
  • 17. Proposed Method: Maximum Entropy Spectral Modeling Approach to the Low Light Levels Color Appearance Modeling • Spectral Model of Mesopic Vision Clark and Skaff proposed a spectral model for color perception which is valid for photopic conditions During the mesopic condition, both cones and rods contribute to the vision Given the measurement vector ‫,ݎ‬ we can model the rod intrusion into the perception as follows: ‫ݎ‬௜ = ߚ ‫׬‬ ݂௜ ௖ ߣ + ߦ‫ݓ‬௜݂௥ ߣ ‫݌‬ ߣ ݀ߣ + ߥ ஃ ݅ ∈ {‫,ܮ‬ ‫,ܯ‬ ܵ} - ࢌࢉ(ࣅ) and ࢌ࢘(ࣅ): cone and rod spectral sensitivity functions respectively - ࢖(ࣅ): normalized mesopic spectral power distribution - ߚ: intensity factor - ࣈ [0, 1]: a parameter which determines relative rod intrusion - ܹ = [‫ݓ‬௅ ‫ݓ‬ெ ‫ݓ‬ௌ]: a diagonal matrix specifies the relative contribution of rod response to each cone channel. - ߥ: additive noise 17Color Perception at Low Signal to Noise Levels
  • 18. Proposed Method: Maximum Entropy Spectral Modeling Approach to the Low Light Levels Color Appearance Modeling • Spectral Model of Mesopic Vision Given the measurement vector ‫,ݎ‬ we can model the rod intrusion into the perception as follows: ‫ݎ‬௜ = ߚ ‫׬‬ ݂௜ ௖ ߣ + ߦ‫ݓ‬௜ ݂௥ ߣ ‫݌‬ ߣ ݀ߣ + ߥ ஃ ݅ ∈ {‫,ܮ‬ ‫,ܯ‬ ܵ} 18
  • 19. 19 Proposed Method: Maximum Entropy Spectral Modeling Approach to the Low Light Levels Color Appearance Modeling An exponential family is employed to estimate ‫݌‬ ߣ : ‫̂݌‬ ߣ = exp (< ݂ ߣ , ߠ > −߰(ߠ)) ݂ ߣ = ݂௖ ߣ + ߦܹ݂௥ ߣ ߠ: parameter vector which should be estimated ߰(ߠ): normalizing function Parameters can be estimated as follows: ߠመ = min ఏ { ߟො − ߟ ் ‫ߟ( ܣ‬ො − ߟ)} − ߛ‫})ߠ(ܪ‬ ߟ = ‫ߚ/ݎ‬ normalized measurement ‫:)ߠ(ܪ‬ entropy function corresponding to ‫̂݌‬(ߣ) A: positive definite matrix ࢽ: regularization factor • Spectral Model of Mesopic Vision Color Perception at Low Signal to Noise Levels
  • 20. Results: • Simulation of Munsell patches – surrounded by a white background – viewed under different light levels from scotopic to photopic. Color Perception at Low Signal to Noise Levels 20
  • 21. Image Sensor Modeling: Color Measurement at Low Light Levels By: Mehdi REZAGHOLIZADEH James J. CLARK MCGILL UNIVERSITY November 2014 22nd Color and Imaging Conference
  • 22. The Presentation Outline: Image Sensor Modeling: Color Measurement at Low Light Levels 22 Conclusion Experiments and Results: Preparation Caveats Analysis Experiment Scenarios Solution: Image Sensor Modeling Physical Background Noise Model Pixel Measurement Model Introduction: Motivation Statement of the Problem: Color Measurement at Low Light Levels
  • 23. Introduction: Motivation Importance of Studying low light levels: • Color Measurement at low light level becomes more uncertain due to the low signal to noise ratio • Most of the theories, measures, models and methods in color science are developed for high intensities • The quality of the human color vision at low light levels is much better than existing handy cameras 23Image Sensor Modeling: Color Measurement at Low Light Levels Kirk, Adam G., and James F. O'Brien. "Perceptually based tone mapping for low-light conditions." ACM Trans. Graph. 30.4 (2011): 42.
  • 24. Introduction: Statement of the Problem 24 Problem: • What is the impact of noise at low light levels on the color measurements of imaging devices? Image Sensor Modeling: Color Measurement at Low Light Levels
  • 25. Applications of the Study: Spectral Imaging Image Processing Low Light Photography Characterizing the Noise of Image Sensors Developing Denoising and Enhancement Algorithms Photon Limited Imaging (biosensors, astronomy, etc) 25Image Sensor Modeling: Color Measurement at Low Light Levels
  • 26. What Next… 26 Conclusion Experiments and Results: Preparation Caveats Analysis Experiment Scenarios Solution: Image Sensor Modeling Physical Background Noise Model Pixel Measurement Model Introduction: Motivation Statement of the Problem: Color Measurement at Low Light Levels Image Sensor Modeling: Color Measurement at Low Light Levels
  • 27. Physical Background 27 • Simulating the effect of Photon Noise (given the high intensity description of the light): • For each bin: ܲ ݃(ߣ௜), ݊ ൌ ௚ ఒ೔ ೙௘ష೒ ഊ೔ ௡! 0 2 4 6 8 10 400 420 440 460 480 500 520 540 560 580 600 620 640 660 680 700 AveragePhotonCount:g(λ) Wavelength (nm) ᵟ Image Sensor Modeling: Color Measurement at Low Light Levels
  • 28. Physical Background 28 • A set of Poisson distributions (one for each bin) characterizes the targeted light. • To estimate the spectral radiance at a lower intensity: • The estimated quantal spectral radiance: ‫ܮ‬෠ிே ߣ௜ = ‫ܩ‬෨ி(ߣ௜) ߜ 0 10 g(λ) Wavelength (nm) Image Sensor Modeling: Color Measurement at Low Light Levels ‫ܨ‬ = low intensity high intensity Draw samples from ࡼ࢕࢏࢙ ࡲ ൈ ࢍ ࣅ࢏ ૚ ࡺ ࡳ෩ࡲ ࣅ࢏ ~ࡼ࢕࢏࢙ሺࡲ ൈ ࢍሺࣅ࢏ሻሻ
  • 29. Simulation: How Does Spectral Power Distribution Change with Intensity? • The estimated spectral power distribution at different intensities. ‫ܨ‬ = 5 ൈ 10ିଵଶ ܹܽ‫ݐݐ‬ ߜ ൌ 5 ݊݉ ‫ݐ‬ ൌ 0.2 ‫ܿ݁ݏ‬ Color Perception at Low Signal to Noise Levels 29
  • 30. Simulation: How Does Spectral Power Distribution Change with Intensity? • The estimated spectral power distribution at different intensities. Color Perception at Low Signal to Noise Levels 30 ‫ܨ‬ ൌ 5 ൈ 10ିଵଷ ܹܽ‫ݐݐ‬ ߜ ൌ 5 ݊݉ ‫ݐ‬ ൌ 0.2 ‫ܿ݁ݏ‬
  • 31. Simulation: How Does Spectral Power Distribution Change with Intensity? • The estimated spectral power distribution at different intensities. Color Perception at Low Signal to Noise Levels 31 ‫ܨ‬ ൌ 5 ൈ 10ିଵସ ܹܽ‫ݐݐ‬ ߜ ൌ 5 ݊݉ ‫ݐ‬ ൌ 0.2 ‫ܿ݁ݏ‬
  • 32. Image Sensor Modeling 32 • Image sensor pipeline (for a single channel): Noise Model Photon Shot Noise Dark Current Noise Read Noise Quantization Noise Image Sensor Modeling: Color Measurement at Low Light Levels
  • 33. Image Sensor Modeling 33 • Image sensor pipeline (for a single channel): Noise Model Photon Shot Noise Dark Current Noise Read Noise Quantization Noise Image Sensor Modeling: Color Measurement at Low Light Levels
  • 34. Image Sensor Modeling 34 • Image sensor pipeline (for a single channel): Noise Model Photon Shot Noise Dark Current Noise Read Noise Quantization Noise Image Sensor Modeling: Color Measurement at Low Light Levels
  • 35. Image Sensor Modeling 35 • Image sensor pipeline (for a single channel): Noise Model Photon Shot Noise Dark Current Noise Read Noise Quantization Noise Image Sensor Modeling: Color Measurement at Low Light Levels
  • 36. Image Sensor Modeling 36 • Image sensor pipeline (for a single channel): Noise Model Photon Shot Noise Dark Current Noise Read Noise Quantization Noise Image Sensor Modeling: Color Measurement at Low Light Levels
  • 37. Image Sensor Modeling: Noise Model 37 • Variations in the number of emitted photons • Can be modeled by a Poisson Distribution Photon Shot Noise • The current produced inside the image sensor • ܰௗ௔௥௞ ௞ (ߙ, ߚ)~ܲ‫(ݏ݅݋‬ ߪௗ௔௥௞ ௞ ଶ ) Dark Current Noise • The noise in the readout circuit • ܰ௥௘௔ௗ~ܰ(0, ߪ௥௘௔ௗ) Read Noise • The error introduced in the quantization step Quantization Noise Image Sensor Modeling: Color Measurement at Low Light Levels
  • 38. Image Sensor Modeling: Pixel Measurement Model 38 Output of the Image Sensor • ܸ௞ ߙ, ߚ ൌ ‫ܩ‬௏௘ష ൈ ݂௦௔௧ ܶ ൈ ‫׬‬ ‫ܮ‬෠ிே ߙ, ߚ, ߣ ܳ௘ ௞ ߣ ݀ߣ ൅ ܶ ൈ ܰௗ௔௥௞ ௞ ሺߙ, ߚሻ Measured Voltage • ܸ෨௞ ߙ, ߚ ൌ ܸ௞ ߙ, ߚ ൅ ܰ௥௘௔ௗሺߙ, ߚሻ Raw Output Image • ࡵ࢑ ࢻ, ࢼ ൌ ࡳ ൈ ࢂ෩࢑ ሺࢻ, ࢼሻ ࢔࢈ Image Sensor Modeling: Color Measurement at Low Light Levels
  • 39. What Next… 39 Conclusion Experiments and Results: Preparation Caveats Analysis Experiment Scenarios Solution: Image Sensor Modeling Physical Background Noise Model Pixel Measurement Model Introduction: Motivation Statement of the Problem: Color Measurement at Low Light Levels Image Sensor Modeling: Color Measurement at Low Light Levels
  • 40. Experiments & Results: Dataset and Preparation Dataset: “A data set for Color Research” By: Barnard et al. Includes: - The Sony DXC-930 sensor sensitivity curves - The spectra and color measurements of 598 color samples made by the Sony camera 40 [1] K. Barnard, L. Martin, B. Funt, and A. Coath, “A data set for color research,” Color Research & Application, vol. 27, no. 3, pp. 147-151, 2002.
  • 41. Experiments & Results: Dataset and Preparation Preparation: − 20 samples from the 598 color measurements are selected for our experiments − By scaling the initial spectra, the luminance values of color samples are set to 100 41 − The luminance of each color sample is modified by applying the intensity factor, F. Image Sensor Modeling: Color Measurement at Low Light Levels
  • 42. Experiments & Results: Caveats 42 • Temperature is assumed constant, hence the dark noise parameters are fixed during the experiments. • Noise model is additive • The Sony DXC-930 camera is nearly linear for most of its range, provided it is used with gamma disabled. • Raw output images are considered for our analysis. • The effects of reset noise, photodetector response nonuniformity (PRNU), dark signal nonuniformity(DSNU) are considered negligible. Image Sensor Modeling: Color Measurement at Low Light Levels
  • 43. Experiments & Results: Analysis 43 Experiments: Scenario I: Ideal Image Sensor Scenario II: Effects of Dark Current Scenario III: Real Image Sensor Model Image Sensor Modeling: Color Measurement at Low Light Levels
  • 44. Experiments & Results: Scenario I: Ideal Image Sensor 44 Assumptions: • Sensor is ideal (no internal noise in the model) • Photon shot noise may corrupt the measurements • log ‫ܨ‬ ∈ ሼ0, െ7, െ8, െ9, െ10, െ11, െ12, െ13, െ14ሽ Image Sensor Modeling: Color Measurement at Low Light Levels
  • 45. Experiments & Results: Scenario I: Ideal Image Sensor 45Image Sensor Modeling: Color Measurement at Low Light Levels Chromaticity of Measured Samples at Different Light Levels Magnified Result of the Data Point Indexed 3 at Different Intensity Factors
  • 46. Experiments & Results: Scenario II: Effects of Dark Current 46 Assumptions: • Only photon shot noise and dark noise may corrupt the measurements • Only boundary color patches are used (index: 1-13) • ‫ܨ‬ ∈ ሼ1, 0.5, 0.1, 0.05, 0.01, 0.005, 0.001ሽ Image Sensor Modeling: Color Measurement at Low Light Levels
  • 47. Experiments & Results: Scenario II: Effects of Dark Current 47Image Sensor Modeling: Color Measurement at Low Light Levels Chromaticity of Measured Samples at Different Light Levels Magnified Result of the Data Point Indexed 3 at Different Intensity Factors
  • 48. Experiments & Results: Scenario III: Real Image Sensor Model 48 Assumptions: • A model of real image sensor is considered • ‫ܨ‬ ∈ ሼ1, 0.5, 0.1, 0.05, 0.01, 0.005, 0.001ሽ Image Sensor Modeling: Color Measurement at Low Light Levels
  • 49. Experiments & Results: Scenario III: Real Image Sensor Model 49Image Sensor Modeling: Color Measurement at Low Light Levels Chromaticity of Measured Samples at Different Light Levels Magnified Result of the Data Point Indexed 3 at Different Intensity Factors
  • 50. Experiments & Results: Comparing the Three Scenarios 50Image Sensor Modeling: Color Measurement at Low Light Levels Scenario I Scenario II Scenario III
  • 51. Experiments & Results: Comparing the Three Scenarios 51Image Sensor Modeling: Color Measurement at Low Light Levels Scenario I Scenario II Scenario III
  • 52. What Next… 52 Conclusion Experiments and Results: Preparation Caveats Analysis Experiment Scenarios Solution: Image Sensor Modeling Physical Background Noise Model Pixel Measurement Model Introduction: Motivation Statement of the Problem: Color Measurement at Low Light Levels Image Sensor Modeling: Color Measurement at Low Light Levels
  • 53. Conclusion 53 − Photon noise − read noise − quantization error The physical limitation imposed by the photon noise Dark current dominates the other sensor noise types in the image sensor Image Sensor Modeling: Color Measurement at Low Light Levels Uncertain measurements distributed around the noise free measurements Dark current noise dynamic effects on color measur ements Shifting chromaticities towards the camera black point 1 2 3 4 Prevents stable measuring of color (even for an ideal image sensor)
  • 54. Image Sensor Modeling: Color Measurement at Low Light Levels 54 Thank You for Your Attention! Questions…
  • 55. Image Sensor Modeling 55 • Image sensor pipeline (for a single channel): Noise Model Photon Shot Noise Dark Current Noise Read Noise Quantization Noise Image Sensor Modeling: Color Measurement at Low Light Levels
  • 56. Image Sensor Modeling: Pixel Measurement Model 56 Output of the Image Sensor • ‫ܩ‬௏௘ష: conversion gain (volts/݁ି ) • ݂௦௔௧: saturation function of the sensor • ܳ௘ ௞ ߣ : the quantum efficiency function of the sensor • ‫ܮ‬෠ிே: the quantal radiance at the intensity factor F (photons/sec/݉ଶ /sr/nm) ܸ௞ ߙ, ߚ ൌ ‫ܩ‬௏௘ష ൈ ݂௦௔௧ ܶ ൈ න ‫ܮ‬෠ிே ߙ, ߚ, ߣ ܳ௘ ௞ ߣ ݀ߣ ൅ ܶ ൈ ܰௗ௔௥௞ ௞ ሺߙ, ߚሻ Image Sensor Modeling: Color Measurement at Low Light Levels
  • 57. Image Sensor Modeling: Pixel Measurement Model 57 Output of the Image Sensor • ܸ௞ ߙ, ߚ ൌ ‫ܩ‬௏௘ష ൈ ݂௦௔௧ ܶ ൈ ‫׬‬ ‫ܮ‬෠ிே ߙ, ߚ, ߣ ܳ௘ ௞ ߣ ݀ߣ ൅ ܶ ൈ ܰௗ௔௥௞ ௞ ሺߙ, ߚሻ Measured Voltage • ࢂ෩࢑ ࢻ, ࢼ ൌ ࢂ࢑ ࢻ, ࢼ ൅ ࡺ࢘ࢋࢇࢊሺࢻ, ࢼሻ Image Sensor Modeling: Color Measurement at Low Light Levels
  • 58. Experiments & Results: Scenario I: Ideal Image Sensor 58Image Sensor Modeling: Color Measurement at Low Light Levels
  • 59. Experiments & Results: Scenario II: Effects of Dark Current 59Image Sensor Modeling: Color Measurement at Low Light Levels
  • 60. Experiments & Results: Scenario III: Real Image Sensor Model 60Image Sensor Modeling: Color Measurement at Low Light Levels