SlideShare a Scribd company logo
1 of 1
Download to read offline
Structured Light Systems are often used in computer
vision to form accurate 3D models. These systems
include at least one or more camera, projector pairs.
Before these systems can be effectively implemented,
the projector and camera must first be calibrated.
Camera calibration has already been extensively studied,
while projector calibration is less established. An
effective structured light system calibration technique
called Huang’s method calibrates the projector in the
same way as a camera, thus simplifying the process.
Using Huang’s methods as a basis, we designed a quick,
accurate calibration technique that works with our
hardware and can eventually be implemented into a multi
camera, projector structured light system.
This work was supported by LentinkLab with
thanks to a generous grant from the Summer
Undergraduate Research Institute in the
Stanford University Department of Mechanical
Engineering.
[1] Bouguet 2013, “Camera Calibration Toolbox for
Matlab”,
[Online]: www.vision.caltech.edu/bouguetj/calib_doc/
[2] Falcao,	
  Gabriel,	
  Natalie	
  Hurtos,	
  and	
  Joan	
  Massich.	
  "Plane-­‐
based	
   Calibra<on	
   of	
   a	
   Projector-­‐camera	
   System."	
   VIBOT	
  
Master	
  (2008):	
  1-­‐12.	
  2008.	
  Web.	
  24	
  Aug.	
  2016.	
  
Unique Challenges
•  Matlab code must be adapted for a specific
calibration system.
•  Calibration technique must be easily integrated
into a multi-projector, camera system.
•  New hardware must work together effectively.
Multi-camera, projector system
Alter calibration rig and Matlab code to allow for the
simultaneous calibration of four camera, projector
pairs.
Structured Light System Calibration
Nathan Petrie, Marc Deetjen, David Lentink
Lentink Lab, Department of Mechanical Engineering, Stanford University
2. Image Capturing
The	
  projector	
  projects	
  a	
  checkerboard	
  
image	
   onto	
   the	
   checkerboard.	
   The	
  
high-­‐speed	
   camera	
   captures	
   mul<ple	
  
images	
  of	
  the	
  checkerboard	
  in	
  different	
  
orienta<ons	
  while	
  the	
  projector	
  is	
  both	
  
on	
  and	
  off.	
  
3. Matlab Corner Clicking
Images are loaded into Matlab
where corners are extracted
( t h r o u g h c l i c k i n g ) . 2 D - 3 D
correspondences are created using
the images. Extrinsic and intrinsic
parameters of both the projector
and camera are then estimated.
Step	
  1:	
  Calibrate	
  Camera	
  
(Find	
  Camera	
  Matrix	
  KC)	
  
	
  
	
  
	
  
	
  
	
  
	
  
	
  
	
  
	
  
Projector	
  On	
   Projector	
  Off	
  
Camera Number: 1, Image Number: 1
Bouguet 2000
Step	
  3:	
  Calibrate	
  
Projector	
  (Find	
  Kp)	
  
Step	
  2:	
  Find	
  the	
  3D	
  
Coordinates	
  of	
  the	
  
projected	
  pa[ern	
  
	
  
The	
   structured	
   Light	
   system	
   is	
   used	
   to	
   create	
   a	
   3D	
  
reconstruc<on	
   of	
   the	
   surface	
   of	
   a	
   bird.	
   The	
   system	
  
must	
  first	
  be	
  calibrated.	
  The	
  calibra<on	
  method	
  must	
  
be	
  adapted	
  to	
  fit	
  the	
  experiment	
  specifica<ons.	
  
Goal: Find the Intrinsic and Extrinsic Parameters of the Projector and Camera
1. Set-up
Projector and camera are directed
towards a checkerboard. The
projector will project a pattern onto
the checkerboard while the high-
speed camera captures images of
the checkerboard.
High	
  Speed	
  
Camera	
  
Projector	
  
Step	
  4:	
  Compute	
  
Rota<on	
  and	
  
Transla<on	
  (R,T)	
  
	
  
	
  
	
  
	
  
	
  
	
  
	
  
	
  
	
  
	
  

More Related Content

Similar to ME_Poster

Novel-design-Panoramic-camera-by dr MONIKA
Novel-design-Panoramic-camera-by dr MONIKANovel-design-Panoramic-camera-by dr MONIKA
Novel-design-Panoramic-camera-by dr MONIKA
Devarshi Bajpai
 
Synthesizing pseudo 2.5 d content from monocular videos for mixed reality
Synthesizing pseudo 2.5 d content from monocular videos for mixed realitySynthesizing pseudo 2.5 d content from monocular videos for mixed reality
Synthesizing pseudo 2.5 d content from monocular videos for mixed reality
NAVER Engineering
 
Intelligent two axis dual-ccd image-servo shooting platform design
Intelligent two axis dual-ccd image-servo shooting platform designIntelligent two axis dual-ccd image-servo shooting platform design
Intelligent two axis dual-ccd image-servo shooting platform design
eSAT Publishing House
 
Intelligent two axis dual-ccd image-servo shooting platform design
Intelligent two axis dual-ccd image-servo shooting platform designIntelligent two axis dual-ccd image-servo shooting platform design
Intelligent two axis dual-ccd image-servo shooting platform design
eSAT Publishing House
 

Similar to ME_Poster (20)

Real Time Object Dectection using machine learning
Real Time Object Dectection using machine learningReal Time Object Dectection using machine learning
Real Time Object Dectection using machine learning
 
slide-171212080528.pptx
slide-171212080528.pptxslide-171212080528.pptx
slide-171212080528.pptx
 
Novel-design-Panoramic-camera-by dr MONIKA
Novel-design-Panoramic-camera-by dr MONIKANovel-design-Panoramic-camera-by dr MONIKA
Novel-design-Panoramic-camera-by dr MONIKA
 
Luigy Bertaglia Bortolo - Poster Final
Luigy Bertaglia Bortolo - Poster FinalLuigy Bertaglia Bortolo - Poster Final
Luigy Bertaglia Bortolo - Poster Final
 
Tracking Chessboard Corners Using Projective Transformation for Augmented Rea...
Tracking Chessboard Corners Using Projective Transformation for Augmented Rea...Tracking Chessboard Corners Using Projective Transformation for Augmented Rea...
Tracking Chessboard Corners Using Projective Transformation for Augmented Rea...
 
AUTO LANDING PROCESS FOR AUTONOMOUS FLYING ROBOT BY USING IMAGE PROCESSING BA...
AUTO LANDING PROCESS FOR AUTONOMOUS FLYING ROBOT BY USING IMAGE PROCESSING BA...AUTO LANDING PROCESS FOR AUTONOMOUS FLYING ROBOT BY USING IMAGE PROCESSING BA...
AUTO LANDING PROCESS FOR AUTONOMOUS FLYING ROBOT BY USING IMAGE PROCESSING BA...
 
Synthesizing pseudo 2.5 d content from monocular videos for mixed reality
Synthesizing pseudo 2.5 d content from monocular videos for mixed realitySynthesizing pseudo 2.5 d content from monocular videos for mixed reality
Synthesizing pseudo 2.5 d content from monocular videos for mixed reality
 
IRJET-Cleaner Drone
IRJET-Cleaner DroneIRJET-Cleaner Drone
IRJET-Cleaner Drone
 
Improving image resolution through the cra algorithm involved recycling proce...
Improving image resolution through the cra algorithm involved recycling proce...Improving image resolution through the cra algorithm involved recycling proce...
Improving image resolution through the cra algorithm involved recycling proce...
 
IMPROVING IMAGE RESOLUTION THROUGH THE CRA ALGORITHM INVOLVED RECYCLING PROCE...
IMPROVING IMAGE RESOLUTION THROUGH THE CRA ALGORITHM INVOLVED RECYCLING PROCE...IMPROVING IMAGE RESOLUTION THROUGH THE CRA ALGORITHM INVOLVED RECYCLING PROCE...
IMPROVING IMAGE RESOLUTION THROUGH THE CRA ALGORITHM INVOLVED RECYCLING PROCE...
 
Intelligent two axis dual-ccd image-servo shooting platform design
Intelligent two axis dual-ccd image-servo shooting platform designIntelligent two axis dual-ccd image-servo shooting platform design
Intelligent two axis dual-ccd image-servo shooting platform design
 
Intelligent two axis dual-ccd image-servo shooting platform design
Intelligent two axis dual-ccd image-servo shooting platform designIntelligent two axis dual-ccd image-servo shooting platform design
Intelligent two axis dual-ccd image-servo shooting platform design
 
I0333043049
I0333043049I0333043049
I0333043049
 
ei2106-submit-opt-415
ei2106-submit-opt-415ei2106-submit-opt-415
ei2106-submit-opt-415
 
Robot Machine Vision
Robot Machine VisionRobot Machine Vision
Robot Machine Vision
 
Ay33292297
Ay33292297Ay33292297
Ay33292297
 
Ay33292297
Ay33292297Ay33292297
Ay33292297
 
Review on an object following wireless robot
Review on an object following wireless robotReview on an object following wireless robot
Review on an object following wireless robot
 
Camera Analytics System (Based on IEEE topic Camera Selection for adaptive hu...
Camera Analytics System (Based on IEEE topic Camera Selection for adaptive hu...Camera Analytics System (Based on IEEE topic Camera Selection for adaptive hu...
Camera Analytics System (Based on IEEE topic Camera Selection for adaptive hu...
 
poster
posterposter
poster
 

ME_Poster

  • 1. Structured Light Systems are often used in computer vision to form accurate 3D models. These systems include at least one or more camera, projector pairs. Before these systems can be effectively implemented, the projector and camera must first be calibrated. Camera calibration has already been extensively studied, while projector calibration is less established. An effective structured light system calibration technique called Huang’s method calibrates the projector in the same way as a camera, thus simplifying the process. Using Huang’s methods as a basis, we designed a quick, accurate calibration technique that works with our hardware and can eventually be implemented into a multi camera, projector structured light system. This work was supported by LentinkLab with thanks to a generous grant from the Summer Undergraduate Research Institute in the Stanford University Department of Mechanical Engineering. [1] Bouguet 2013, “Camera Calibration Toolbox for Matlab”, [Online]: www.vision.caltech.edu/bouguetj/calib_doc/ [2] Falcao,  Gabriel,  Natalie  Hurtos,  and  Joan  Massich.  "Plane-­‐ based   Calibra<on   of   a   Projector-­‐camera   System."   VIBOT   Master  (2008):  1-­‐12.  2008.  Web.  24  Aug.  2016.   Unique Challenges •  Matlab code must be adapted for a specific calibration system. •  Calibration technique must be easily integrated into a multi-projector, camera system. •  New hardware must work together effectively. Multi-camera, projector system Alter calibration rig and Matlab code to allow for the simultaneous calibration of four camera, projector pairs. Structured Light System Calibration Nathan Petrie, Marc Deetjen, David Lentink Lentink Lab, Department of Mechanical Engineering, Stanford University 2. Image Capturing The  projector  projects  a  checkerboard   image   onto   the   checkerboard.   The   high-­‐speed   camera   captures   mul<ple   images  of  the  checkerboard  in  different   orienta<ons  while  the  projector  is  both   on  and  off.   3. Matlab Corner Clicking Images are loaded into Matlab where corners are extracted ( t h r o u g h c l i c k i n g ) . 2 D - 3 D correspondences are created using the images. Extrinsic and intrinsic parameters of both the projector and camera are then estimated. Step  1:  Calibrate  Camera   (Find  Camera  Matrix  KC)                     Projector  On   Projector  Off   Camera Number: 1, Image Number: 1 Bouguet 2000 Step  3:  Calibrate   Projector  (Find  Kp)   Step  2:  Find  the  3D   Coordinates  of  the   projected  pa[ern     The   structured   Light   system   is   used   to   create   a   3D   reconstruc<on   of   the   surface   of   a   bird.   The   system   must  first  be  calibrated.  The  calibra<on  method  must   be  adapted  to  fit  the  experiment  specifica<ons.   Goal: Find the Intrinsic and Extrinsic Parameters of the Projector and Camera 1. Set-up Projector and camera are directed towards a checkerboard. The projector will project a pattern onto the checkerboard while the high- speed camera captures images of the checkerboard. High  Speed   Camera   Projector   Step  4:  Compute   Rota<on  and   Transla<on  (R,T)