SlideShare a Scribd company logo
Today: The Camera
Overview
• The pinhole projection model
• Qualitative properties
• Perspective projection matrix
• Cameras with lenses
• Depth of focus
• Field of view
• Lens aberrations
• Digital cameras
• Types of sensors
• Color
How do we see the world?
Let’s design a camera
• Idea 1: put a piece of film in front of an object
• Do we get a reasonable image?
object film
Slide by Steve Seitz
Pinhole camera
Add a barrier to block off most of the rays
• This reduces blurring
• The opening known as the aperture
object filmbarrier
Slide by Steve Seitz
Pinhole camera model
Pinhole model:
• Captures pencil of rays – all rays through a single point
• The point is called Center of Projection (focal point)
• The image is formed on the Image Plane
Slide by Steve Seitz
Point of observation
Figures © Stephen E. Palmer, 2002
Dimensionality Reduction Machine (3D to 2D)
3D world 2D image
What have we lost?
• Angles
• Distances (lengths)
Slide by A. Efros
Projection properties
• Many-to-one: any points along same ray map
to same point in image
• Points → points
• But projection of points on focal plane is undefined
• Lines → lines (collinearity is preserved)
• But line through focal point projects to a point
• Planes → planes (or half-planes)
• But plane through focal point projects to line
Projection properties
• Parallel lines converge at a vanishing point
• Each direction in space has its own vanishing point
• But parallels parallel to the image plane remain parallel
• All directions in the same plane have vanishing points on the
same line
How do we construct the vanishing point/line?
One-point perspective
Masaccio, Trinity, Santa
Maria Novella,
Florence, 1425-28
First consistent use of
perspective in
Western art?
Perspective distortion
• Problem for architectural photography:
converging verticals
Source: F. Durand
Perspective distortion
• Problem for architectural photography:
converging verticals
• Solution: view camera (lens shifted w.r.t. film)
Source: F. Durand
Tilting the camera
upwards results in
converging verticals
Keeping the camera level,
with an ordinary lens,
captures only the bottom
portion of the building
Shifting the lens
upwards results in a
picture of the entire
subject
http://en.wikipedia.org/wiki/Perspective_correction_lens
Perspective distortion
• Problem for architectural photography:
converging verticals
• Result:
Source: F. Durand
Perspective distortion
• However, converging verticals work quite well
for horror movies…
Perspective distortion
• What does a sphere project to?
Image source: F. Durand
Perspective distortion
• What does a sphere project to?
Perspective distortion
• The exterior columns appear bigger
• The distortion is not due to lens flaws
• Problem pointed out by Da Vinci
Slide by F. Durand
Perspective distortion: People
Modeling projection
The coordinate system
• We will use the pinhole model as an approximation
• Put the optical center (O) at the origin
• Put the image plane (Π’) in front of O
x
y
z
Source: J. Ponce, S. Seitz
x
y
z
Modeling projection
Projection equations
• Compute intersection with Π’ of ray from P = (x,y,z) to O
• Derived using similar triangles
)',','(),,( f
z
y
f
z
x
fzyx →
Source: J. Ponce, S. Seitz
• We get the projection by throwing out the last coordinate:
)','(),,(
z
y
f
z
x
fzyx →
Homogeneous coordinates
Is this a linear transformation?
Trick: add one more coordinate:
homogeneous image
coordinates
homogeneous scene
coordinates
Converting from homogeneous coordinates
• no—division by z is nonlinear
Slide by Steve Seitz
)','(),,(
z
y
f
z
x
fzyx →
divide by the third
coordinate
Perspective Projection Matrix
Projection is a matrix multiplication using homogeneous
coordinates:
⎥
⎥
⎥
⎦
⎤
⎢
⎢
⎢
⎣
⎡
=
⎥
⎥
⎥
⎥
⎦
⎤
⎢
⎢
⎢
⎢
⎣
⎡
⎥
⎥
⎥
⎦
⎤
⎢
⎢
⎢
⎣
⎡
'/
1
0'/100
0010
0001
fz
y
x
z
y
x
f
)','(
z
y
f
z
x
f⇒
divide by the third
coordinate
Perspective Projection Matrix
Projection is a matrix multiplication using homogeneous
coordinates:
⎥
⎥
⎥
⎦
⎤
⎢
⎢
⎢
⎣
⎡
=
⎥
⎥
⎥
⎥
⎦
⎤
⎢
⎢
⎢
⎢
⎣
⎡
⎥
⎥
⎥
⎦
⎤
⎢
⎢
⎢
⎣
⎡
'/
1
0'/100
0010
0001
fz
y
x
z
y
x
f
)','(
z
y
f
z
x
f⇒
In practice: lots of coordinate transformations…
World to
camera coord.
trans. matrix
(4x4)
Perspective
projection matrix
(3x4)
Camera to
pixel coord.
trans. matrix
(3x3)
=
2D
point
(3x1)
3D
point
(4x1)
Orthographic Projection
Special case of perspective projection
• Distance from center of projection to image plane is infinite
• Also called “parallel projection”
• What’s the projection matrix?
Image World
Slide by Steve Seitz
Building a real camera
Camera Obscura
• Basic principle known to
Mozi (470-390 BCE),
Aristotle (384-322 BCE)
• Drawing aid for artists:
described by Leonardo
da Vinci (1452-1519)
Gemma Frisius, 1558
Source: A. Efros
Abelardo Morell
Camera Obscura Image of Manhattan View
Looking South in Large Room, 1996
http://www.abelardomorell.net/camera_obscura1.html
From Grand Images Through a Tiny Opening, Photo
District News, February 2005
Home-made pinhole camera
http://www.debevec.org/Pinhole/
Why so
blurry?
Slide by A. Efros
Shrinking the aperture
Why not make the aperture as small as possible?
• Less light gets through
• Diffraction effects…
Slide by Steve Seitz
Shrinking the aperture
Adding a lens
A lens focuses light onto the film
• Rays passing through the center are not deviated
object filmlens
Slide by Steve Seitz
Adding a lens
A lens focuses light onto the film
• Rays passing through the center are not deviated
• All parallel rays converge to one point on a plane located at
the focal length f
object filmlens
Slide by Steve Seitz
focal point
f
Adding a lens
A lens focuses light onto the film
• There is a specific distance at which objects are “in focus”
– other points project to a “circle of confusion” in the image
object filmlens
“circle of
confusion”
Slide by Steve Seitz
Thin lens formula
f
DD’
Frédo Durand’s slide
Thin lens formula
f
DD’
Similar triangles everywhere!
Frédo Durand’s slide
Thin lens formula
f
DD’
Similar triangles everywhere!
y’
y
y’/y = D’/D
Frédo Durand’s slide
Thin lens formula
f
DD’
Similar triangles everywhere!
y’
y
y’/y = D’/D
y’/y = (D’-f)/D
Frédo Durand’s slide
Thin lens formula
f
DD’
1
D’ D
1 1
f
+ =
Any point satisfying the thin lens 
equation is in focus.
Frédo Durand’s slide
Depth of Field
http://www.cambridgeincolour.com/tutorials/depth-of-field.htm
Slide by A. Efros
How can we control the depth of field?
Changing the aperture size affects depth of field
• A smaller aperture increases the range in which the object is
approximately in focus
• But small aperture reduces amount of light – need to
increase exposure Slide by A. Efros
Varying the aperture
Large aperture = small DOF Small aperture = large DOF
Slide by A. Efros
Manipulating the plane of focus
In this image, the plane of focus is almost at a
right angle to the image plane
Source: F. Durand
Tilt-shift lenses
• Tilting the lens with respect to the image plane allows
to choose an arbitrary plane of focus
• Standard setup: plane of focus is parallel to image
plane and lens plane
image planelens planeplane of focus
shift
tilt
Tilt-shift lenses
• Tilting the lens with respect to the image plane allows
to choose an arbitrary plane of focus
• Scheimpflug principle: plane of focus
passes through the line of intersection
between the lens plane and the image plane
image planetilted
lens plane
plane of focus
shift
tilt
“Fake miniatures”
Olivo Barbieri: http://www.metropolismag.com/cda/story.php?artid=1760
Field of View (Zoom)
Slide by A. Efros
Field of View (Zoom)
Slide by A. Efros
f
Field of View
Smaller FOV = larger Focal Length Slide by A. Efros
f
FOV depends on focal length and size of the camera retina
Field of View / Focal Length
Large FOV, small f
Camera close to car
Small FOV, large f
Camera far from the car
Sources: A. Efros, F. Durand
Source: Hartley & Zisserman
Approximating an affine camera
Real lenses
Lens Flaws: Chromatic Aberration
Lens has different refractive indices for different
wavelengths: causes color fringing
Near Lens CenterNear Lens Center Near Lens Outer EdgeNear Lens Outer Edge
Lens flaws: Spherical aberration
Spherical lenses don’t focus light perfectly
Rays farther from the optical axis focus closer
Lens flaws: Vignetting
No distortion Pin cushion Barrel
Radial Distortion
• Caused by imperfect lenses
• Deviations are most noticeable for rays that pass through the edge of
the lens
Digital camera
A digital camera replaces film with a sensor array
• Each cell in the array is light-sensitive diode that converts photons to electrons
• Two common types
– Charge Coupled Device (CCD)
– Complementary metal oxide semiconductor (CMOS)
• http://electronics.howstuffworks.com/digital-camera.htm
Slide by Steve Seitz
CCD vs. CMOS
CCD: transports the charge across the chip and reads it at one corner of the array.
An analog-to-digital converter (ADC) then turns each pixel's value into a digital
value by measuring the amount of charge at each photosite and converting that
measurement to binary form
CMOS: uses several transistors at each pixel to amplify and move the charge using
more traditional wires. The CMOS signal is digital, so it needs no ADC.
http://www.dalsa.com/shared/content/pdfs/CCD_vs_CMOS_Litwiller_2005.pdf
http://electronics.howstuffworks.com/digital-camera.htm
Color sensing in camera: Color filter array
Source: Steve Seitz
Estimate missing
components from
neighboring values
(demosaicing)
Why more green?
Bayer grid
Human Luminance Sensitivity Function
Problem with demosaicing: color moire
Slide by F. Durand
The cause of color moire
detector
Fine black and white detail in image
misinterpreted as color information
Slide by F. Durand
Color sensing in camera: Prism
• Requires three chips and precise alignment
• More expensive
CCD(B)
CCD(G)
CCD(R)
Color sensing in camera: Foveon X3
Source: M. Pollefeys
http://en.wikipedia.org/wiki/Foveon_X3_sensorhttp://www.foveon.com/article.php?a=67
• CMOS sensor
• Takes advantage of the fact that red, blue and green
light penetrate silicon to different depths
better image quality
Issues with digital cameras
Noise
– low light is where you most notice noise
– light sensitivity (ISO) / noise tradeoff
– stuck pixels
Resolution: Are more megapixels better?
– requires higher quality lens
– noise issues
In-camera processing
– oversharpening can produce halos
RAW vs. compressed
– file size vs. quality tradeoff
Blooming
– charge overflowing into neighboring pixels
Color artifacts
– purple fringing from microlenses, artifacts from Bayer patterns
– white balance
More info online:
• http://electronics.howstuffworks.com/digital-camera.htm
• http://www.dpreview.com/
Slide by Steve Seitz
Historical context
• Pinhole model: Mozi (470-390 BCE),
Aristotle (384-322 BCE)
• Principles of optics (including lenses):
Alhacen (965-1039 CE)
• Camera obscura: Leonardo da Vinci
(1452-1519), Johann Zahn (1631-1707)
• First photo: Joseph Nicephore Niepce (1822)
• Daguerréotypes (1839)
• Photographic film (Eastman, 1889)
• Cinema (Lumière Brothers, 1895)
• Color Photography (Lumière Brothers, 1908)
• Television (Baird, Farnsworth, Zworykin, 1920s)
• First consumer camera with CCD:
Sony Mavica (1981)
• First fully digital camera: Kodak DCS100 (1990)
Niepce, “La Table Servie,” 1822
CCD chip
Alhacen’s notes
Next time
Light and color
Slide by Steve Seitz

More Related Content

What's hot

Lec09 hough
Lec09 houghLec09 hough
Lec09 hough
BaliThorat1
 
Lec07 corner blob
Lec07 corner blobLec07 corner blob
Lec07 corner blob
BaliThorat1
 
Lec08 fitting
Lec08 fittingLec08 fitting
Lec08 fitting
BaliThorat1
 
Lec12 epipolar
Lec12 epipolarLec12 epipolar
Lec12 epipolar
BaliThorat1
 
smallpt: Global Illumination in 99 lines of C++
smallpt:  Global Illumination in 99 lines of C++smallpt:  Global Illumination in 99 lines of C++
smallpt: Global Illumination in 99 lines of C++
鍾誠 陳鍾誠
 
Illumination Model
Illumination ModelIllumination Model
Illumination Model
aishwaryabharadwaj7
 
Lighting and shading
Lighting and shadingLighting and shading
Lighting and shadingeshveeen
 
Lighting and shading
Lighting and shadingLighting and shading
Lighting and shading
Sri Harsha Vemuri
 
2 basic imaging and radiometry
2 basic imaging and radiometry2 basic imaging and radiometry
2 basic imaging and radiometry
zjnsrbt
 
Graphics Lecture 7
Graphics Lecture 7Graphics Lecture 7
Graphics Lecture 7
Saiful Islam
 
GRPHICS06 - Shading
GRPHICS06 - ShadingGRPHICS06 - Shading
GRPHICS06 - Shading
Michael Heron
 
Phong Shading over any Polygonal Surface
Phong Shading over any Polygonal Surface Phong Shading over any Polygonal Surface
Phong Shading over any Polygonal Surface
Bhuvnesh Pratap
 
SIGGRAPH 2012 Computational Plenoptic Imaging Course - 4 Light Fields
SIGGRAPH 2012 Computational Plenoptic Imaging Course - 4 Light FieldsSIGGRAPH 2012 Computational Plenoptic Imaging Course - 4 Light Fields
SIGGRAPH 2012 Computational Plenoptic Imaging Course - 4 Light Fields
Gordon Wetzstein
 
Computer vision - photometric
Computer vision - photometricComputer vision - photometric
Computer vision - photometric
Wael Badawy
 
Ray Tracing
Ray TracingRay Tracing
Ray Tracing
Syed Zaid Irshad
 
Lenses in Optics
Lenses in OpticsLenses in Optics
Lenses in Optics
Cyrus Vincent Eludo
 
3.3 form 4 converging lens
3.3 form 4 converging lens3.3 form 4 converging lens
3.3 form 4 converging lens
chris lembalemba
 

What's hot (18)

Lec09 hough
Lec09 houghLec09 hough
Lec09 hough
 
Lec07 corner blob
Lec07 corner blobLec07 corner blob
Lec07 corner blob
 
Lec08 fitting
Lec08 fittingLec08 fitting
Lec08 fitting
 
Lec12 epipolar
Lec12 epipolarLec12 epipolar
Lec12 epipolar
 
smallpt: Global Illumination in 99 lines of C++
smallpt:  Global Illumination in 99 lines of C++smallpt:  Global Illumination in 99 lines of C++
smallpt: Global Illumination in 99 lines of C++
 
Illumination Model
Illumination ModelIllumination Model
Illumination Model
 
Lighting and shading
Lighting and shadingLighting and shading
Lighting and shading
 
Lighting and shading
Lighting and shadingLighting and shading
Lighting and shading
 
2 basic imaging and radiometry
2 basic imaging and radiometry2 basic imaging and radiometry
2 basic imaging and radiometry
 
Graphics Lecture 7
Graphics Lecture 7Graphics Lecture 7
Graphics Lecture 7
 
GRPHICS06 - Shading
GRPHICS06 - ShadingGRPHICS06 - Shading
GRPHICS06 - Shading
 
Phong Shading over any Polygonal Surface
Phong Shading over any Polygonal Surface Phong Shading over any Polygonal Surface
Phong Shading over any Polygonal Surface
 
SIGGRAPH 2012 Computational Plenoptic Imaging Course - 4 Light Fields
SIGGRAPH 2012 Computational Plenoptic Imaging Course - 4 Light FieldsSIGGRAPH 2012 Computational Plenoptic Imaging Course - 4 Light Fields
SIGGRAPH 2012 Computational Plenoptic Imaging Course - 4 Light Fields
 
Computer vision - photometric
Computer vision - photometricComputer vision - photometric
Computer vision - photometric
 
Ray Tracing
Ray TracingRay Tracing
Ray Tracing
 
Edges and lines
Edges and linesEdges and lines
Edges and lines
 
Lenses in Optics
Lenses in OpticsLenses in Optics
Lenses in Optics
 
3.3 form 4 converging lens
3.3 form 4 converging lens3.3 form 4 converging lens
3.3 form 4 converging lens
 

Similar to Lec02 camera

Computer Vision - cameras
Computer Vision - camerasComputer Vision - cameras
Computer Vision - cameras
Wael Badawy
 
Jamel gantt- Know More About Computer Graphics
Jamel gantt- Know More About Computer GraphicsJamel gantt- Know More About Computer Graphics
Jamel gantt- Know More About Computer Graphics
Jamel Gantt
 
Computer Vision Course includes deep learning
Computer Vision Course includes deep learningComputer Vision Course includes deep learning
Computer Vision Course includes deep learning
gigap29589
 
2018.02 intro to visual odometry
2018.02 intro to visual odometry2018.02 intro to visual odometry
2018.02 intro to visual odometry
BrianHoltPhD
 
Mirrors and Reflections
Mirrors and ReflectionsMirrors and Reflections
Mirrors and Reflections
Nicole Ynne Estabillo
 
2-Camera-Properties.pdf
2-Camera-Properties.pdf2-Camera-Properties.pdf
2-Camera-Properties.pdf
ssusera9462d1
 
Lenses
LensesLenses
Light field
Light field Light field
Light field
Ujjayanta Bhaumik
 
refraction of light at curved surfaces
refraction of light at curved surfacesrefraction of light at curved surfaces
refraction of light at curved surfaces
Krishna Gali
 
02 principle of photography and imaging
02 principle of photography and imaging02 principle of photography and imaging
02 principle of photography and imaging
Sarhat Adam
 
Ray Tracing
Ray TracingRay Tracing
Ray Tracing
Cyrus Vincent Eludo
 
october23.ppt
october23.pptoctober23.ppt
october23.ppt
CharlesMatu2
 
session3_Radiometry.pptx
session3_Radiometry.pptxsession3_Radiometry.pptx
session3_Radiometry.pptx
shaiksohail55
 
Physics 504 chapter 1 & 2 opticks
Physics 504 chapter 1 & 2  opticksPhysics 504 chapter 1 & 2  opticks
Physics 504 chapter 1 & 2 opticksNeil MacIntosh
 
Concave and convex
Concave and convexConcave and convex
Concave and convex
BonbonArboleda
 
Aberrations in optical aids
Aberrations in optical aids Aberrations in optical aids
Aberrations in optical aids
Mohammad Arman Bin Aziz
 
PPT s02-machine vision-s2
PPT s02-machine vision-s2PPT s02-machine vision-s2
PPT s02-machine vision-s2
Binus Online Learning
 
G10 Science Q2-Week 8- Properties of Mirror.ppt
G10 Science Q2-Week 8- Properties of Mirror.pptG10 Science Q2-Week 8- Properties of Mirror.ppt
G10 Science Q2-Week 8- Properties of Mirror.ppt
RegieBenigno
 
Cameras
CamerasCameras
Cameras
gayu r
 
Light full chaptet 10 cbse x
Light full chaptet 10 cbse x Light full chaptet 10 cbse x
Light full chaptet 10 cbse x
RAVNEET NAGI
 

Similar to Lec02 camera (20)

Computer Vision - cameras
Computer Vision - camerasComputer Vision - cameras
Computer Vision - cameras
 
Jamel gantt- Know More About Computer Graphics
Jamel gantt- Know More About Computer GraphicsJamel gantt- Know More About Computer Graphics
Jamel gantt- Know More About Computer Graphics
 
Computer Vision Course includes deep learning
Computer Vision Course includes deep learningComputer Vision Course includes deep learning
Computer Vision Course includes deep learning
 
2018.02 intro to visual odometry
2018.02 intro to visual odometry2018.02 intro to visual odometry
2018.02 intro to visual odometry
 
Mirrors and Reflections
Mirrors and ReflectionsMirrors and Reflections
Mirrors and Reflections
 
2-Camera-Properties.pdf
2-Camera-Properties.pdf2-Camera-Properties.pdf
2-Camera-Properties.pdf
 
Lenses
LensesLenses
Lenses
 
Light field
Light field Light field
Light field
 
refraction of light at curved surfaces
refraction of light at curved surfacesrefraction of light at curved surfaces
refraction of light at curved surfaces
 
02 principle of photography and imaging
02 principle of photography and imaging02 principle of photography and imaging
02 principle of photography and imaging
 
Ray Tracing
Ray TracingRay Tracing
Ray Tracing
 
october23.ppt
october23.pptoctober23.ppt
october23.ppt
 
session3_Radiometry.pptx
session3_Radiometry.pptxsession3_Radiometry.pptx
session3_Radiometry.pptx
 
Physics 504 chapter 1 & 2 opticks
Physics 504 chapter 1 & 2  opticksPhysics 504 chapter 1 & 2  opticks
Physics 504 chapter 1 & 2 opticks
 
Concave and convex
Concave and convexConcave and convex
Concave and convex
 
Aberrations in optical aids
Aberrations in optical aids Aberrations in optical aids
Aberrations in optical aids
 
PPT s02-machine vision-s2
PPT s02-machine vision-s2PPT s02-machine vision-s2
PPT s02-machine vision-s2
 
G10 Science Q2-Week 8- Properties of Mirror.ppt
G10 Science Q2-Week 8- Properties of Mirror.pptG10 Science Q2-Week 8- Properties of Mirror.ppt
G10 Science Q2-Week 8- Properties of Mirror.ppt
 
Cameras
CamerasCameras
Cameras
 
Light full chaptet 10 cbse x
Light full chaptet 10 cbse x Light full chaptet 10 cbse x
Light full chaptet 10 cbse x
 

More from BaliThorat1

Lec15 sfm
Lec15 sfmLec15 sfm
Lec15 sfm
BaliThorat1
 
8 operating system concept
8 operating system concept8 operating system concept
8 operating system concept
BaliThorat1
 
7 processor
7 processor7 processor
7 processor
BaliThorat1
 
6 input output devices
6 input output devices6 input output devices
6 input output devices
BaliThorat1
 
2 windows operating system
2 windows operating system2 windows operating system
2 windows operating system
BaliThorat1
 
5 computer memory
5 computer memory5 computer memory
5 computer memory
BaliThorat1
 
4 computer languages
4 computer languages4 computer languages
4 computer languages
BaliThorat1
 
1 fundamentals of computer
1 fundamentals of computer1 fundamentals of computer
1 fundamentals of computer
BaliThorat1
 
1 fundamentals of computer system
1 fundamentals of computer system1 fundamentals of computer system
1 fundamentals of computer system
BaliThorat1
 
Computer generation and classification
Computer generation and classificationComputer generation and classification
Computer generation and classification
BaliThorat1
 
Algorithm and flowchart
Algorithm and flowchartAlgorithm and flowchart
Algorithm and flowchart
BaliThorat1
 
6 cpu scheduling
6 cpu scheduling6 cpu scheduling
6 cpu scheduling
BaliThorat1
 
5 process synchronization
5 process synchronization5 process synchronization
5 process synchronization
BaliThorat1
 
4 threads
4 threads4 threads
4 threads
BaliThorat1
 
3 processes
3 processes3 processes
3 processes
BaliThorat1
 
2 os structure
2 os structure2 os structure
2 os structure
BaliThorat1
 
1 intro and overview
1 intro and overview1 intro and overview
1 intro and overview
BaliThorat1
 
Lec01 introduction
Lec01 introductionLec01 introduction
Lec01 introduction
BaliThorat1
 

More from BaliThorat1 (18)

Lec15 sfm
Lec15 sfmLec15 sfm
Lec15 sfm
 
8 operating system concept
8 operating system concept8 operating system concept
8 operating system concept
 
7 processor
7 processor7 processor
7 processor
 
6 input output devices
6 input output devices6 input output devices
6 input output devices
 
2 windows operating system
2 windows operating system2 windows operating system
2 windows operating system
 
5 computer memory
5 computer memory5 computer memory
5 computer memory
 
4 computer languages
4 computer languages4 computer languages
4 computer languages
 
1 fundamentals of computer
1 fundamentals of computer1 fundamentals of computer
1 fundamentals of computer
 
1 fundamentals of computer system
1 fundamentals of computer system1 fundamentals of computer system
1 fundamentals of computer system
 
Computer generation and classification
Computer generation and classificationComputer generation and classification
Computer generation and classification
 
Algorithm and flowchart
Algorithm and flowchartAlgorithm and flowchart
Algorithm and flowchart
 
6 cpu scheduling
6 cpu scheduling6 cpu scheduling
6 cpu scheduling
 
5 process synchronization
5 process synchronization5 process synchronization
5 process synchronization
 
4 threads
4 threads4 threads
4 threads
 
3 processes
3 processes3 processes
3 processes
 
2 os structure
2 os structure2 os structure
2 os structure
 
1 intro and overview
1 intro and overview1 intro and overview
1 intro and overview
 
Lec01 introduction
Lec01 introductionLec01 introduction
Lec01 introduction
 

Recently uploaded

PART A. Introduction to Costumer Service
PART A. Introduction to Costumer ServicePART A. Introduction to Costumer Service
PART A. Introduction to Costumer Service
PedroFerreira53928
 
Digital Tools and AI for Teaching Learning and Research
Digital Tools and AI for Teaching Learning and ResearchDigital Tools and AI for Teaching Learning and Research
Digital Tools and AI for Teaching Learning and Research
Vikramjit Singh
 
GIÁO ÁN DẠY THÊM (KẾ HOẠCH BÀI BUỔI 2) - TIẾNG ANH 8 GLOBAL SUCCESS (2 CỘT) N...
GIÁO ÁN DẠY THÊM (KẾ HOẠCH BÀI BUỔI 2) - TIẾNG ANH 8 GLOBAL SUCCESS (2 CỘT) N...GIÁO ÁN DẠY THÊM (KẾ HOẠCH BÀI BUỔI 2) - TIẾNG ANH 8 GLOBAL SUCCESS (2 CỘT) N...
GIÁO ÁN DẠY THÊM (KẾ HOẠCH BÀI BUỔI 2) - TIẾNG ANH 8 GLOBAL SUCCESS (2 CỘT) N...
Nguyen Thanh Tu Collection
 
Cambridge International AS A Level Biology Coursebook - EBook (MaryFosbery J...
Cambridge International AS  A Level Biology Coursebook - EBook (MaryFosbery J...Cambridge International AS  A Level Biology Coursebook - EBook (MaryFosbery J...
Cambridge International AS A Level Biology Coursebook - EBook (MaryFosbery J...
AzmatAli747758
 
TESDA TM1 REVIEWER FOR NATIONAL ASSESSMENT WRITTEN AND ORAL QUESTIONS WITH A...
TESDA TM1 REVIEWER  FOR NATIONAL ASSESSMENT WRITTEN AND ORAL QUESTIONS WITH A...TESDA TM1 REVIEWER  FOR NATIONAL ASSESSMENT WRITTEN AND ORAL QUESTIONS WITH A...
TESDA TM1 REVIEWER FOR NATIONAL ASSESSMENT WRITTEN AND ORAL QUESTIONS WITH A...
EugeneSaldivar
 
Mule 4.6 & Java 17 Upgrade | MuleSoft Mysore Meetup #46
Mule 4.6 & Java 17 Upgrade | MuleSoft Mysore Meetup #46Mule 4.6 & Java 17 Upgrade | MuleSoft Mysore Meetup #46
Mule 4.6 & Java 17 Upgrade | MuleSoft Mysore Meetup #46
MysoreMuleSoftMeetup
 
MARUTI SUZUKI- A Successful Joint Venture in India.pptx
MARUTI SUZUKI- A Successful Joint Venture in India.pptxMARUTI SUZUKI- A Successful Joint Venture in India.pptx
MARUTI SUZUKI- A Successful Joint Venture in India.pptx
bennyroshan06
 
How to Create Map Views in the Odoo 17 ERP
How to Create Map Views in the Odoo 17 ERPHow to Create Map Views in the Odoo 17 ERP
How to Create Map Views in the Odoo 17 ERP
Celine George
 
How to Split Bills in the Odoo 17 POS Module
How to Split Bills in the Odoo 17 POS ModuleHow to Split Bills in the Odoo 17 POS Module
How to Split Bills in the Odoo 17 POS Module
Celine George
 
Synthetic Fiber Construction in lab .pptx
Synthetic Fiber Construction in lab .pptxSynthetic Fiber Construction in lab .pptx
Synthetic Fiber Construction in lab .pptx
Pavel ( NSTU)
 
Model Attribute Check Company Auto Property
Model Attribute  Check Company Auto PropertyModel Attribute  Check Company Auto Property
Model Attribute Check Company Auto Property
Celine George
 
Fish and Chips - have they had their chips
Fish and Chips - have they had their chipsFish and Chips - have they had their chips
Fish and Chips - have they had their chips
GeoBlogs
 
1.4 modern child centered education - mahatma gandhi-2.pptx
1.4 modern child centered education - mahatma gandhi-2.pptx1.4 modern child centered education - mahatma gandhi-2.pptx
1.4 modern child centered education - mahatma gandhi-2.pptx
JosvitaDsouza2
 
Ethnobotany and Ethnopharmacology ......
Ethnobotany and Ethnopharmacology ......Ethnobotany and Ethnopharmacology ......
Ethnobotany and Ethnopharmacology ......
Ashokrao Mane college of Pharmacy Peth-Vadgaon
 
2024.06.01 Introducing a competency framework for languag learning materials ...
2024.06.01 Introducing a competency framework for languag learning materials ...2024.06.01 Introducing a competency framework for languag learning materials ...
2024.06.01 Introducing a competency framework for languag learning materials ...
Sandy Millin
 
Supporting (UKRI) OA monographs at Salford.pptx
Supporting (UKRI) OA monographs at Salford.pptxSupporting (UKRI) OA monographs at Salford.pptx
Supporting (UKRI) OA monographs at Salford.pptx
Jisc
 
Instructions for Submissions thorugh G- Classroom.pptx
Instructions for Submissions thorugh G- Classroom.pptxInstructions for Submissions thorugh G- Classroom.pptx
Instructions for Submissions thorugh G- Classroom.pptx
Jheel Barad
 
The Roman Empire A Historical Colossus.pdf
The Roman Empire A Historical Colossus.pdfThe Roman Empire A Historical Colossus.pdf
The Roman Empire A Historical Colossus.pdf
kaushalkr1407
 
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
siemaillard
 
Phrasal Verbs.XXXXXXXXXXXXXXXXXXXXXXXXXX
Phrasal Verbs.XXXXXXXXXXXXXXXXXXXXXXXXXXPhrasal Verbs.XXXXXXXXXXXXXXXXXXXXXXXXXX
Phrasal Verbs.XXXXXXXXXXXXXXXXXXXXXXXXXX
MIRIAMSALINAS13
 

Recently uploaded (20)

PART A. Introduction to Costumer Service
PART A. Introduction to Costumer ServicePART A. Introduction to Costumer Service
PART A. Introduction to Costumer Service
 
Digital Tools and AI for Teaching Learning and Research
Digital Tools and AI for Teaching Learning and ResearchDigital Tools and AI for Teaching Learning and Research
Digital Tools and AI for Teaching Learning and Research
 
GIÁO ÁN DẠY THÊM (KẾ HOẠCH BÀI BUỔI 2) - TIẾNG ANH 8 GLOBAL SUCCESS (2 CỘT) N...
GIÁO ÁN DẠY THÊM (KẾ HOẠCH BÀI BUỔI 2) - TIẾNG ANH 8 GLOBAL SUCCESS (2 CỘT) N...GIÁO ÁN DẠY THÊM (KẾ HOẠCH BÀI BUỔI 2) - TIẾNG ANH 8 GLOBAL SUCCESS (2 CỘT) N...
GIÁO ÁN DẠY THÊM (KẾ HOẠCH BÀI BUỔI 2) - TIẾNG ANH 8 GLOBAL SUCCESS (2 CỘT) N...
 
Cambridge International AS A Level Biology Coursebook - EBook (MaryFosbery J...
Cambridge International AS  A Level Biology Coursebook - EBook (MaryFosbery J...Cambridge International AS  A Level Biology Coursebook - EBook (MaryFosbery J...
Cambridge International AS A Level Biology Coursebook - EBook (MaryFosbery J...
 
TESDA TM1 REVIEWER FOR NATIONAL ASSESSMENT WRITTEN AND ORAL QUESTIONS WITH A...
TESDA TM1 REVIEWER  FOR NATIONAL ASSESSMENT WRITTEN AND ORAL QUESTIONS WITH A...TESDA TM1 REVIEWER  FOR NATIONAL ASSESSMENT WRITTEN AND ORAL QUESTIONS WITH A...
TESDA TM1 REVIEWER FOR NATIONAL ASSESSMENT WRITTEN AND ORAL QUESTIONS WITH A...
 
Mule 4.6 & Java 17 Upgrade | MuleSoft Mysore Meetup #46
Mule 4.6 & Java 17 Upgrade | MuleSoft Mysore Meetup #46Mule 4.6 & Java 17 Upgrade | MuleSoft Mysore Meetup #46
Mule 4.6 & Java 17 Upgrade | MuleSoft Mysore Meetup #46
 
MARUTI SUZUKI- A Successful Joint Venture in India.pptx
MARUTI SUZUKI- A Successful Joint Venture in India.pptxMARUTI SUZUKI- A Successful Joint Venture in India.pptx
MARUTI SUZUKI- A Successful Joint Venture in India.pptx
 
How to Create Map Views in the Odoo 17 ERP
How to Create Map Views in the Odoo 17 ERPHow to Create Map Views in the Odoo 17 ERP
How to Create Map Views in the Odoo 17 ERP
 
How to Split Bills in the Odoo 17 POS Module
How to Split Bills in the Odoo 17 POS ModuleHow to Split Bills in the Odoo 17 POS Module
How to Split Bills in the Odoo 17 POS Module
 
Synthetic Fiber Construction in lab .pptx
Synthetic Fiber Construction in lab .pptxSynthetic Fiber Construction in lab .pptx
Synthetic Fiber Construction in lab .pptx
 
Model Attribute Check Company Auto Property
Model Attribute  Check Company Auto PropertyModel Attribute  Check Company Auto Property
Model Attribute Check Company Auto Property
 
Fish and Chips - have they had their chips
Fish and Chips - have they had their chipsFish and Chips - have they had their chips
Fish and Chips - have they had their chips
 
1.4 modern child centered education - mahatma gandhi-2.pptx
1.4 modern child centered education - mahatma gandhi-2.pptx1.4 modern child centered education - mahatma gandhi-2.pptx
1.4 modern child centered education - mahatma gandhi-2.pptx
 
Ethnobotany and Ethnopharmacology ......
Ethnobotany and Ethnopharmacology ......Ethnobotany and Ethnopharmacology ......
Ethnobotany and Ethnopharmacology ......
 
2024.06.01 Introducing a competency framework for languag learning materials ...
2024.06.01 Introducing a competency framework for languag learning materials ...2024.06.01 Introducing a competency framework for languag learning materials ...
2024.06.01 Introducing a competency framework for languag learning materials ...
 
Supporting (UKRI) OA monographs at Salford.pptx
Supporting (UKRI) OA monographs at Salford.pptxSupporting (UKRI) OA monographs at Salford.pptx
Supporting (UKRI) OA monographs at Salford.pptx
 
Instructions for Submissions thorugh G- Classroom.pptx
Instructions for Submissions thorugh G- Classroom.pptxInstructions for Submissions thorugh G- Classroom.pptx
Instructions for Submissions thorugh G- Classroom.pptx
 
The Roman Empire A Historical Colossus.pdf
The Roman Empire A Historical Colossus.pdfThe Roman Empire A Historical Colossus.pdf
The Roman Empire A Historical Colossus.pdf
 
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
 
Phrasal Verbs.XXXXXXXXXXXXXXXXXXXXXXXXXX
Phrasal Verbs.XXXXXXXXXXXXXXXXXXXXXXXXXXPhrasal Verbs.XXXXXXXXXXXXXXXXXXXXXXXXXX
Phrasal Verbs.XXXXXXXXXXXXXXXXXXXXXXXXXX
 

Lec02 camera

  • 2. Overview • The pinhole projection model • Qualitative properties • Perspective projection matrix • Cameras with lenses • Depth of focus • Field of view • Lens aberrations • Digital cameras • Types of sensors • Color
  • 3. How do we see the world? Let’s design a camera • Idea 1: put a piece of film in front of an object • Do we get a reasonable image? object film Slide by Steve Seitz
  • 4. Pinhole camera Add a barrier to block off most of the rays • This reduces blurring • The opening known as the aperture object filmbarrier Slide by Steve Seitz
  • 5. Pinhole camera model Pinhole model: • Captures pencil of rays – all rays through a single point • The point is called Center of Projection (focal point) • The image is formed on the Image Plane Slide by Steve Seitz
  • 6. Point of observation Figures © Stephen E. Palmer, 2002 Dimensionality Reduction Machine (3D to 2D) 3D world 2D image What have we lost? • Angles • Distances (lengths) Slide by A. Efros
  • 7. Projection properties • Many-to-one: any points along same ray map to same point in image • Points → points • But projection of points on focal plane is undefined • Lines → lines (collinearity is preserved) • But line through focal point projects to a point • Planes → planes (or half-planes) • But plane through focal point projects to line
  • 8. Projection properties • Parallel lines converge at a vanishing point • Each direction in space has its own vanishing point • But parallels parallel to the image plane remain parallel • All directions in the same plane have vanishing points on the same line How do we construct the vanishing point/line?
  • 9. One-point perspective Masaccio, Trinity, Santa Maria Novella, Florence, 1425-28 First consistent use of perspective in Western art?
  • 10. Perspective distortion • Problem for architectural photography: converging verticals Source: F. Durand
  • 11. Perspective distortion • Problem for architectural photography: converging verticals • Solution: view camera (lens shifted w.r.t. film) Source: F. Durand Tilting the camera upwards results in converging verticals Keeping the camera level, with an ordinary lens, captures only the bottom portion of the building Shifting the lens upwards results in a picture of the entire subject http://en.wikipedia.org/wiki/Perspective_correction_lens
  • 12. Perspective distortion • Problem for architectural photography: converging verticals • Result: Source: F. Durand
  • 13. Perspective distortion • However, converging verticals work quite well for horror movies…
  • 14. Perspective distortion • What does a sphere project to? Image source: F. Durand
  • 15. Perspective distortion • What does a sphere project to?
  • 16. Perspective distortion • The exterior columns appear bigger • The distortion is not due to lens flaws • Problem pointed out by Da Vinci Slide by F. Durand
  • 18. Modeling projection The coordinate system • We will use the pinhole model as an approximation • Put the optical center (O) at the origin • Put the image plane (Π’) in front of O x y z Source: J. Ponce, S. Seitz
  • 19. x y z Modeling projection Projection equations • Compute intersection with Π’ of ray from P = (x,y,z) to O • Derived using similar triangles )',','(),,( f z y f z x fzyx → Source: J. Ponce, S. Seitz • We get the projection by throwing out the last coordinate: )','(),,( z y f z x fzyx →
  • 20. Homogeneous coordinates Is this a linear transformation? Trick: add one more coordinate: homogeneous image coordinates homogeneous scene coordinates Converting from homogeneous coordinates • no—division by z is nonlinear Slide by Steve Seitz )','(),,( z y f z x fzyx →
  • 21. divide by the third coordinate Perspective Projection Matrix Projection is a matrix multiplication using homogeneous coordinates: ⎥ ⎥ ⎥ ⎦ ⎤ ⎢ ⎢ ⎢ ⎣ ⎡ = ⎥ ⎥ ⎥ ⎥ ⎦ ⎤ ⎢ ⎢ ⎢ ⎢ ⎣ ⎡ ⎥ ⎥ ⎥ ⎦ ⎤ ⎢ ⎢ ⎢ ⎣ ⎡ '/ 1 0'/100 0010 0001 fz y x z y x f )','( z y f z x f⇒
  • 22. divide by the third coordinate Perspective Projection Matrix Projection is a matrix multiplication using homogeneous coordinates: ⎥ ⎥ ⎥ ⎦ ⎤ ⎢ ⎢ ⎢ ⎣ ⎡ = ⎥ ⎥ ⎥ ⎥ ⎦ ⎤ ⎢ ⎢ ⎢ ⎢ ⎣ ⎡ ⎥ ⎥ ⎥ ⎦ ⎤ ⎢ ⎢ ⎢ ⎣ ⎡ '/ 1 0'/100 0010 0001 fz y x z y x f )','( z y f z x f⇒ In practice: lots of coordinate transformations… World to camera coord. trans. matrix (4x4) Perspective projection matrix (3x4) Camera to pixel coord. trans. matrix (3x3) = 2D point (3x1) 3D point (4x1)
  • 23. Orthographic Projection Special case of perspective projection • Distance from center of projection to image plane is infinite • Also called “parallel projection” • What’s the projection matrix? Image World Slide by Steve Seitz
  • 24. Building a real camera
  • 25. Camera Obscura • Basic principle known to Mozi (470-390 BCE), Aristotle (384-322 BCE) • Drawing aid for artists: described by Leonardo da Vinci (1452-1519) Gemma Frisius, 1558 Source: A. Efros
  • 26. Abelardo Morell Camera Obscura Image of Manhattan View Looking South in Large Room, 1996 http://www.abelardomorell.net/camera_obscura1.html From Grand Images Through a Tiny Opening, Photo District News, February 2005
  • 28. Shrinking the aperture Why not make the aperture as small as possible? • Less light gets through • Diffraction effects… Slide by Steve Seitz
  • 30. Adding a lens A lens focuses light onto the film • Rays passing through the center are not deviated object filmlens Slide by Steve Seitz
  • 31. Adding a lens A lens focuses light onto the film • Rays passing through the center are not deviated • All parallel rays converge to one point on a plane located at the focal length f object filmlens Slide by Steve Seitz focal point f
  • 32. Adding a lens A lens focuses light onto the film • There is a specific distance at which objects are “in focus” – other points project to a “circle of confusion” in the image object filmlens “circle of confusion” Slide by Steve Seitz
  • 34. Thin lens formula f DD’ Similar triangles everywhere! Frédo Durand’s slide
  • 35. Thin lens formula f DD’ Similar triangles everywhere! y’ y y’/y = D’/D Frédo Durand’s slide
  • 36. Thin lens formula f DD’ Similar triangles everywhere! y’ y y’/y = D’/D y’/y = (D’-f)/D Frédo Durand’s slide
  • 37. Thin lens formula f DD’ 1 D’ D 1 1 f + = Any point satisfying the thin lens  equation is in focus. Frédo Durand’s slide
  • 39. How can we control the depth of field? Changing the aperture size affects depth of field • A smaller aperture increases the range in which the object is approximately in focus • But small aperture reduces amount of light – need to increase exposure Slide by A. Efros
  • 40. Varying the aperture Large aperture = small DOF Small aperture = large DOF Slide by A. Efros
  • 41. Manipulating the plane of focus In this image, the plane of focus is almost at a right angle to the image plane Source: F. Durand
  • 42. Tilt-shift lenses • Tilting the lens with respect to the image plane allows to choose an arbitrary plane of focus • Standard setup: plane of focus is parallel to image plane and lens plane image planelens planeplane of focus shift tilt
  • 43. Tilt-shift lenses • Tilting the lens with respect to the image plane allows to choose an arbitrary plane of focus • Scheimpflug principle: plane of focus passes through the line of intersection between the lens plane and the image plane image planetilted lens plane plane of focus shift tilt
  • 44. “Fake miniatures” Olivo Barbieri: http://www.metropolismag.com/cda/story.php?artid=1760
  • 45. Field of View (Zoom) Slide by A. Efros
  • 46. Field of View (Zoom) Slide by A. Efros
  • 47. f Field of View Smaller FOV = larger Focal Length Slide by A. Efros f FOV depends on focal length and size of the camera retina
  • 48. Field of View / Focal Length Large FOV, small f Camera close to car Small FOV, large f Camera far from the car Sources: A. Efros, F. Durand
  • 49. Source: Hartley & Zisserman Approximating an affine camera
  • 51. Lens Flaws: Chromatic Aberration Lens has different refractive indices for different wavelengths: causes color fringing Near Lens CenterNear Lens Center Near Lens Outer EdgeNear Lens Outer Edge
  • 52. Lens flaws: Spherical aberration Spherical lenses don’t focus light perfectly Rays farther from the optical axis focus closer
  • 54. No distortion Pin cushion Barrel Radial Distortion • Caused by imperfect lenses • Deviations are most noticeable for rays that pass through the edge of the lens
  • 55. Digital camera A digital camera replaces film with a sensor array • Each cell in the array is light-sensitive diode that converts photons to electrons • Two common types – Charge Coupled Device (CCD) – Complementary metal oxide semiconductor (CMOS) • http://electronics.howstuffworks.com/digital-camera.htm Slide by Steve Seitz
  • 56. CCD vs. CMOS CCD: transports the charge across the chip and reads it at one corner of the array. An analog-to-digital converter (ADC) then turns each pixel's value into a digital value by measuring the amount of charge at each photosite and converting that measurement to binary form CMOS: uses several transistors at each pixel to amplify and move the charge using more traditional wires. The CMOS signal is digital, so it needs no ADC. http://www.dalsa.com/shared/content/pdfs/CCD_vs_CMOS_Litwiller_2005.pdf http://electronics.howstuffworks.com/digital-camera.htm
  • 57. Color sensing in camera: Color filter array Source: Steve Seitz Estimate missing components from neighboring values (demosaicing) Why more green? Bayer grid Human Luminance Sensitivity Function
  • 58. Problem with demosaicing: color moire Slide by F. Durand
  • 59. The cause of color moire detector Fine black and white detail in image misinterpreted as color information Slide by F. Durand
  • 60. Color sensing in camera: Prism • Requires three chips and precise alignment • More expensive CCD(B) CCD(G) CCD(R)
  • 61. Color sensing in camera: Foveon X3 Source: M. Pollefeys http://en.wikipedia.org/wiki/Foveon_X3_sensorhttp://www.foveon.com/article.php?a=67 • CMOS sensor • Takes advantage of the fact that red, blue and green light penetrate silicon to different depths better image quality
  • 62. Issues with digital cameras Noise – low light is where you most notice noise – light sensitivity (ISO) / noise tradeoff – stuck pixels Resolution: Are more megapixels better? – requires higher quality lens – noise issues In-camera processing – oversharpening can produce halos RAW vs. compressed – file size vs. quality tradeoff Blooming – charge overflowing into neighboring pixels Color artifacts – purple fringing from microlenses, artifacts from Bayer patterns – white balance More info online: • http://electronics.howstuffworks.com/digital-camera.htm • http://www.dpreview.com/ Slide by Steve Seitz
  • 63. Historical context • Pinhole model: Mozi (470-390 BCE), Aristotle (384-322 BCE) • Principles of optics (including lenses): Alhacen (965-1039 CE) • Camera obscura: Leonardo da Vinci (1452-1519), Johann Zahn (1631-1707) • First photo: Joseph Nicephore Niepce (1822) • Daguerréotypes (1839) • Photographic film (Eastman, 1889) • Cinema (Lumière Brothers, 1895) • Color Photography (Lumière Brothers, 1908) • Television (Baird, Farnsworth, Zworykin, 1920s) • First consumer camera with CCD: Sony Mavica (1981) • First fully digital camera: Kodak DCS100 (1990) Niepce, “La Table Servie,” 1822 CCD chip Alhacen’s notes
  • 64. Next time Light and color Slide by Steve Seitz