SlideShare a Scribd company logo
1 of 22
Studio 7: Surface Data Capture
Presented by
Rashid Javed (704076)
Supervisor:
Prof. Dr. Ing. Eberhard Gülch
AGENDA:
1) Introduction
2) Workflow
3) Data and Software Used
4) Methodology
5) Experiment Results
6) Conclusion
Introduction
In the development of digital photogrammetric system, automatic image
matching process play an important role.
 The automatic image matching is used in finding the conjugate points of an
aerial photograph stereo pair automatically.
The first solution of problems to Image matching was given by Hobrough in late
1950.
Main task is to Develop a procedure for automatic point transfer of regular
raster points in an epipolar image pair
Introduction
Epipolar Images:
Epipolar images are stereo pairs in which the left and right images are oriented in
such a way that ground feature points have the same y-coordinates on both
images.
Introduction
Conjugate Points:
• Common points in the overlap areas of the stereo pair images.
• Also called Tie Points
• The search for correspondence points can be done in 2-D e.g. in a
rectangle oriented along an approximate epipolar line.
Introduction
Relationship Between Matching Methods and Matching Entities
Introduction
Area Based Matching
• Oldest and simplest matching technique
• Is performed on the basis of grey values
• Compare the grey level of small sub image with its counterpart in the
other image
• Template and Search Window
Introduction
Correlation
• Technique used for finding the conjugate points
• Measure the similarity of template and search window computing the
correlation factor
Parallax
• Apparent change in the position of object
• Related to the elevation of the terrain
Applications:
 Image registration, DEM generation, displacement measurements, Target
measurements, Surveillance, Treaty verification
AGENDA:
Introduction
Objectives:
• To develop a procedure of automatic point transfer to determine the
conjugate points in an epipolar image pair
• To compare the intensity or gray values of a template
• To asses the quality of the match through using correlation coefficient.
• Develop a parallax field of M*N matrix
AGENDA:
Workflow
Select odd size template
in the source image
Matching window in the destination
image with conjugate entities
Computation of co-rrelation
coefficients for different threshold
Repeat above steps for new template location until
all positions to be matched are visited
Analyse for
consistency
AGENDA:
Workflow
Location of Template:
• Not to locate in the occluded areas, area with low contrast or repetitive
pattern.
Size of Template
• Increase in size will increase the uniqueness of grey value but also increase
distortion.
• Decrease in the size will amount to less distortion but the uniqueness of
the grey values will be decreased.
Location and size of search window
• Location is important (Epipolar Line)
• size should be large enough to include farthest moving template and small
enough to limit the computational cost of matching
Workflow
Acceptance Criteria
•Three threshold values are used
Quality Control
•Accuracy and reliability of conjugate Points.
AGENDA:
Workflow
Correlation Coefficient
Workflow
Calculation of Parallax
• P = Xleft – Xright
• Where,
• Xleft = position of certain object in left image
• Xright = position of same object in right image
Data and Software Used
Images:
• Two epipolar images
• MATLAB
Image Left Image Right
Methodology:
Develop algorithm in the MATLAB
Take the input of starting point in left image, template size as well as window
size in the right image.
Select the threshold values for correlation coefficient calculation.
Threshold 1 = 0 ≤ r ≤ 0.5, low correlation
Threshold 2 = 0.5 ≤ r ≤ 0.75, medium correlation
Threshold 3 = 0.75 ≤ r ≤ 1, high correlation
Calculate and locate the correlated points in right image as well as the grid in
left image.
Calculate the parallax value
Experiment Results:
Destination Image showing
correlating points of different
threshold values with template size
7 x 7.
Source Image with the Grid
Experiment Results:
Destination Image showing
correlating points of different
threshold values with template size
of 21 x 21.
Source Image with the Grid
Experiment Results:
Less match points in Shadow and Homogeneous areas,
because of constant grey values
Shadow
Areas
Homogeneous
Areas
Conclusion:
Area based matching depends upon the quality of image as well as the template
size
In case of homogenous areas, occluded areas as well as shadow areas, points
are not well located.
With small template size, grey value uniqueness is decreased as well as the
comuptation time is increased.
With large template size, grey value uniquness is increased but so is the
geometric distortion.
Computation of parallax value gives terrain height but we were unable to
generate the surface.
Reference:
Schenk, T. (1999). Digital Photogrammetry. Volume I. United States Of America:
Terra Science.
Hannah, M. J., 1974. "Computer Matching of Areas in Stereo Images," Ph.D.
Thesis, Stanford University, Computer Science Department Report STAN-CS-74-
438, July, 1974.
Dr. Marsha Jo Hannah ,“Digital Stereo Image Matching Techniques”
http://www.e-perimetron.org/Vol_4_3/Balletti_Guerra.pdf
Misganu Debella-Gilo,Andreas Kääb “Sub-pixel precision image matching for
measuring surface displacements on mass movements using normalized cross-
correlation“
Misganu Debella-Gilo,Andreas Kääb “LOCALLY ADAPTIVE TEMPLATE SIZES FOR
MATCHING REPEAT IMAGES OF MASS MOVEMENTS “
Thank you for your
Attention

More Related Content

What's hot

IEEE 2014 MATLAB IMAGE PROCESSING PROJECTS Tension in active shapes
IEEE 2014 MATLAB IMAGE PROCESSING PROJECTS Tension in active shapesIEEE 2014 MATLAB IMAGE PROCESSING PROJECTS Tension in active shapes
IEEE 2014 MATLAB IMAGE PROCESSING PROJECTS Tension in active shapesIEEEBEBTECHSTUDENTPROJECTS
 
Iterative Closest Point Algorithm - analysis and implementation
Iterative Closest Point Algorithm - analysis and implementationIterative Closest Point Algorithm - analysis and implementation
Iterative Closest Point Algorithm - analysis and implementationPankaj Gautam
 
Creating watershed using SRTM DEM
Creating watershed using SRTM DEMCreating watershed using SRTM DEM
Creating watershed using SRTM DEMbajajngadat
 
Combining Two Datasets into a Single Map Animation
Combining Two Datasets into a Single Map AnimationCombining Two Datasets into a Single Map Animation
Combining Two Datasets into a Single Map AnimationCLEEN_Ltd
 
SIFT vs other Feature Descriptor
SIFT vs other Feature DescriptorSIFT vs other Feature Descriptor
SIFT vs other Feature DescriptorNisar Ahmed Rana
 
Mesh colorization presentation
Mesh colorization presentationMesh colorization presentation
Mesh colorization presentationChung-Yuan Lee
 
Feature Matching using SIFT algorithm
Feature Matching using SIFT algorithmFeature Matching using SIFT algorithm
Feature Matching using SIFT algorithmSajid Pareeth
 
Scale Invariant Feature Transform
Scale Invariant Feature TransformScale Invariant Feature Transform
Scale Invariant Feature Transformkislayabhi
 
Remote Sensing: Overlay Analysis
Remote Sensing: Overlay AnalysisRemote Sensing: Overlay Analysis
Remote Sensing: Overlay AnalysisKamlesh Kumar
 
Geographical information system unit 6
Geographical information  system unit 6Geographical information  system unit 6
Geographical information system unit 6WE-IT TUTORIALS
 
2018 icml part 2 segwangkim
2018 icml part 2 segwangkim2018 icml part 2 segwangkim
2018 icml part 2 segwangkimsegwangkim
 
Knowing when to look
Knowing when to lookKnowing when to look
Knowing when to lookJaeHo Jang
 
Fast Computational Four-Neighborhood Search Algorithm For Block matching Moti...
Fast Computational Four-Neighborhood Search Algorithm For Block matching Moti...Fast Computational Four-Neighborhood Search Algorithm For Block matching Moti...
Fast Computational Four-Neighborhood Search Algorithm For Block matching Moti...IJERA Editor
 
A Fast Content-Based Image Retrieval Method Using Deep Visual Features
A Fast Content-Based Image Retrieval Method Using Deep Visual FeaturesA Fast Content-Based Image Retrieval Method Using Deep Visual Features
A Fast Content-Based Image Retrieval Method Using Deep Visual FeaturesHiroki Tanioka
 

What's hot (20)

Visual Search
Visual SearchVisual Search
Visual Search
 
poster
posterposter
poster
 
IEEE 2014 MATLAB IMAGE PROCESSING PROJECTS Tension in active shapes
IEEE 2014 MATLAB IMAGE PROCESSING PROJECTS Tension in active shapesIEEE 2014 MATLAB IMAGE PROCESSING PROJECTS Tension in active shapes
IEEE 2014 MATLAB IMAGE PROCESSING PROJECTS Tension in active shapes
 
Iterative Closest Point Algorithm - analysis and implementation
Iterative Closest Point Algorithm - analysis and implementationIterative Closest Point Algorithm - analysis and implementation
Iterative Closest Point Algorithm - analysis and implementation
 
3D Analyst Lab 1
3D Analyst Lab 13D Analyst Lab 1
3D Analyst Lab 1
 
Creating watershed using SRTM DEM
Creating watershed using SRTM DEMCreating watershed using SRTM DEM
Creating watershed using SRTM DEM
 
Combining Two Datasets into a Single Map Animation
Combining Two Datasets into a Single Map AnimationCombining Two Datasets into a Single Map Animation
Combining Two Datasets into a Single Map Animation
 
SIFT vs other Feature Descriptor
SIFT vs other Feature DescriptorSIFT vs other Feature Descriptor
SIFT vs other Feature Descriptor
 
Mesh colorization presentation
Mesh colorization presentationMesh colorization presentation
Mesh colorization presentation
 
Feature Matching using SIFT algorithm
Feature Matching using SIFT algorithmFeature Matching using SIFT algorithm
Feature Matching using SIFT algorithm
 
Scale Invariant Feature Transform
Scale Invariant Feature TransformScale Invariant Feature Transform
Scale Invariant Feature Transform
 
Remote Sensing: Overlay Analysis
Remote Sensing: Overlay AnalysisRemote Sensing: Overlay Analysis
Remote Sensing: Overlay Analysis
 
Geographical information system unit 6
Geographical information  system unit 6Geographical information  system unit 6
Geographical information system unit 6
 
2018 icml part 2 segwangkim
2018 icml part 2 segwangkim2018 icml part 2 segwangkim
2018 icml part 2 segwangkim
 
Object Tracking
Object TrackingObject Tracking
Object Tracking
 
Poster
PosterPoster
Poster
 
Project 2
Project 2Project 2
Project 2
 
Knowing when to look
Knowing when to lookKnowing when to look
Knowing when to look
 
Fast Computational Four-Neighborhood Search Algorithm For Block matching Moti...
Fast Computational Four-Neighborhood Search Algorithm For Block matching Moti...Fast Computational Four-Neighborhood Search Algorithm For Block matching Moti...
Fast Computational Four-Neighborhood Search Algorithm For Block matching Moti...
 
A Fast Content-Based Image Retrieval Method Using Deep Visual Features
A Fast Content-Based Image Retrieval Method Using Deep Visual FeaturesA Fast Content-Based Image Retrieval Method Using Deep Visual Features
A Fast Content-Based Image Retrieval Method Using Deep Visual Features
 

Similar to Surface Data Capture Image Matching

Based on correlation coefficient in image matching
Based on correlation coefficient in image matchingBased on correlation coefficient in image matching
Based on correlation coefficient in image matchingIJRES Journal
 
Object Elimination and Reconstruction Using an Effective Inpainting Method
Object Elimination and Reconstruction Using an Effective Inpainting MethodObject Elimination and Reconstruction Using an Effective Inpainting Method
Object Elimination and Reconstruction Using an Effective Inpainting MethodIOSR Journals
 
Image Inpainting Using Cloning Algorithms
Image Inpainting Using Cloning AlgorithmsImage Inpainting Using Cloning Algorithms
Image Inpainting Using Cloning AlgorithmsCSCJournals
 
Implementation of High Dimension Colour Transform in Domain of Image Processing
Implementation of High Dimension Colour Transform in Domain of Image ProcessingImplementation of High Dimension Colour Transform in Domain of Image Processing
Implementation of High Dimension Colour Transform in Domain of Image ProcessingIRJET Journal
 
A PROJECT REPORT ON REMOVAL OF UNNECESSARY OBJECTS FROM PHOTOS USING MASKING
A PROJECT REPORT ON REMOVAL OF UNNECESSARY OBJECTS FROM PHOTOS USING MASKINGA PROJECT REPORT ON REMOVAL OF UNNECESSARY OBJECTS FROM PHOTOS USING MASKING
A PROJECT REPORT ON REMOVAL OF UNNECESSARY OBJECTS FROM PHOTOS USING MASKINGIRJET Journal
 
IRJET-A Review on Implementation of High Dimension Colour Transform in Domain...
IRJET-A Review on Implementation of High Dimension Colour Transform in Domain...IRJET-A Review on Implementation of High Dimension Colour Transform in Domain...
IRJET-A Review on Implementation of High Dimension Colour Transform in Domain...IRJET Journal
 
Disparity Estimation Using A Color Segmentation V3
Disparity Estimation Using A Color Segmentation V3Disparity Estimation Using A Color Segmentation V3
Disparity Estimation Using A Color Segmentation V3thomaswangxin
 
3D Reconstruction from Multiple uncalibrated 2D Images of an Object
3D Reconstruction from Multiple uncalibrated 2D Images of an Object3D Reconstruction from Multiple uncalibrated 2D Images of an Object
3D Reconstruction from Multiple uncalibrated 2D Images of an ObjectAnkur Tyagi
 
Digital Composition of Mosaics using Edge Priority Tile Assignment
Digital Composition of Mosaics using Edge Priority Tile AssignmentDigital Composition of Mosaics using Edge Priority Tile Assignment
Digital Composition of Mosaics using Edge Priority Tile AssignmentBill Kromydas
 
Developing 3D Viewing Model from 2D Stereo Pair with its Occlusion Ratio
Developing 3D Viewing Model from 2D Stereo Pair with its Occlusion RatioDeveloping 3D Viewing Model from 2D Stereo Pair with its Occlusion Ratio
Developing 3D Viewing Model from 2D Stereo Pair with its Occlusion RatioCSCJournals
 
06 image features
06 image features06 image features
06 image featuresankit_ppt
 
AE 497 Spring 2015 Final Report
AE 497 Spring 2015 Final ReportAE 497 Spring 2015 Final Report
AE 497 Spring 2015 Final ReportCatherine McCarthy
 
One dimensional vector based pattern
One dimensional vector based patternOne dimensional vector based pattern
One dimensional vector based patternijcsit
 
Asilomar09 compressive superres
Asilomar09 compressive superresAsilomar09 compressive superres
Asilomar09 compressive superresHoàng Sơn
 
Locally_adaptive.ppt
Locally_adaptive.pptLocally_adaptive.ppt
Locally_adaptive.pptgrssieee
 
Template Matching - Pattern Recognition
Template Matching - Pattern RecognitionTemplate Matching - Pattern Recognition
Template Matching - Pattern RecognitionMustafa Salam
 
202224010101 RAHMAN SHIDDIQUR - Image Stitching.pptx
202224010101 RAHMAN SHIDDIQUR - Image Stitching.pptx202224010101 RAHMAN SHIDDIQUR - Image Stitching.pptx
202224010101 RAHMAN SHIDDIQUR - Image Stitching.pptxKazmirFahrier
 
Basic image matching techniques, epipolar geometry and normalized image
Basic image matching techniques, epipolar geometry and normalized imageBasic image matching techniques, epipolar geometry and normalized image
Basic image matching techniques, epipolar geometry and normalized imageNational Cheng Kung University
 

Similar to Surface Data Capture Image Matching (20)

Based on correlation coefficient in image matching
Based on correlation coefficient in image matchingBased on correlation coefficient in image matching
Based on correlation coefficient in image matching
 
Object Elimination and Reconstruction Using an Effective Inpainting Method
Object Elimination and Reconstruction Using an Effective Inpainting MethodObject Elimination and Reconstruction Using an Effective Inpainting Method
Object Elimination and Reconstruction Using an Effective Inpainting Method
 
Image Inpainting Using Cloning Algorithms
Image Inpainting Using Cloning AlgorithmsImage Inpainting Using Cloning Algorithms
Image Inpainting Using Cloning Algorithms
 
Implementation of High Dimension Colour Transform in Domain of Image Processing
Implementation of High Dimension Colour Transform in Domain of Image ProcessingImplementation of High Dimension Colour Transform in Domain of Image Processing
Implementation of High Dimension Colour Transform in Domain of Image Processing
 
A PROJECT REPORT ON REMOVAL OF UNNECESSARY OBJECTS FROM PHOTOS USING MASKING
A PROJECT REPORT ON REMOVAL OF UNNECESSARY OBJECTS FROM PHOTOS USING MASKINGA PROJECT REPORT ON REMOVAL OF UNNECESSARY OBJECTS FROM PHOTOS USING MASKING
A PROJECT REPORT ON REMOVAL OF UNNECESSARY OBJECTS FROM PHOTOS USING MASKING
 
IRJET-A Review on Implementation of High Dimension Colour Transform in Domain...
IRJET-A Review on Implementation of High Dimension Colour Transform in Domain...IRJET-A Review on Implementation of High Dimension Colour Transform in Domain...
IRJET-A Review on Implementation of High Dimension Colour Transform in Domain...
 
Template Matching
Template MatchingTemplate Matching
Template Matching
 
conferense
conferense conferense
conferense
 
Disparity Estimation Using A Color Segmentation V3
Disparity Estimation Using A Color Segmentation V3Disparity Estimation Using A Color Segmentation V3
Disparity Estimation Using A Color Segmentation V3
 
3D Reconstruction from Multiple uncalibrated 2D Images of an Object
3D Reconstruction from Multiple uncalibrated 2D Images of an Object3D Reconstruction from Multiple uncalibrated 2D Images of an Object
3D Reconstruction from Multiple uncalibrated 2D Images of an Object
 
Digital Composition of Mosaics using Edge Priority Tile Assignment
Digital Composition of Mosaics using Edge Priority Tile AssignmentDigital Composition of Mosaics using Edge Priority Tile Assignment
Digital Composition of Mosaics using Edge Priority Tile Assignment
 
Developing 3D Viewing Model from 2D Stereo Pair with its Occlusion Ratio
Developing 3D Viewing Model from 2D Stereo Pair with its Occlusion RatioDeveloping 3D Viewing Model from 2D Stereo Pair with its Occlusion Ratio
Developing 3D Viewing Model from 2D Stereo Pair with its Occlusion Ratio
 
06 image features
06 image features06 image features
06 image features
 
AE 497 Spring 2015 Final Report
AE 497 Spring 2015 Final ReportAE 497 Spring 2015 Final Report
AE 497 Spring 2015 Final Report
 
One dimensional vector based pattern
One dimensional vector based patternOne dimensional vector based pattern
One dimensional vector based pattern
 
Asilomar09 compressive superres
Asilomar09 compressive superresAsilomar09 compressive superres
Asilomar09 compressive superres
 
Locally_adaptive.ppt
Locally_adaptive.pptLocally_adaptive.ppt
Locally_adaptive.ppt
 
Template Matching - Pattern Recognition
Template Matching - Pattern RecognitionTemplate Matching - Pattern Recognition
Template Matching - Pattern Recognition
 
202224010101 RAHMAN SHIDDIQUR - Image Stitching.pptx
202224010101 RAHMAN SHIDDIQUR - Image Stitching.pptx202224010101 RAHMAN SHIDDIQUR - Image Stitching.pptx
202224010101 RAHMAN SHIDDIQUR - Image Stitching.pptx
 
Basic image matching techniques, epipolar geometry and normalized image
Basic image matching techniques, epipolar geometry and normalized imageBasic image matching techniques, epipolar geometry and normalized image
Basic image matching techniques, epipolar geometry and normalized image
 

Surface Data Capture Image Matching

  • 1. Studio 7: Surface Data Capture Presented by Rashid Javed (704076) Supervisor: Prof. Dr. Ing. Eberhard Gülch
  • 2. AGENDA: 1) Introduction 2) Workflow 3) Data and Software Used 4) Methodology 5) Experiment Results 6) Conclusion
  • 3. Introduction In the development of digital photogrammetric system, automatic image matching process play an important role.  The automatic image matching is used in finding the conjugate points of an aerial photograph stereo pair automatically. The first solution of problems to Image matching was given by Hobrough in late 1950. Main task is to Develop a procedure for automatic point transfer of regular raster points in an epipolar image pair
  • 4. Introduction Epipolar Images: Epipolar images are stereo pairs in which the left and right images are oriented in such a way that ground feature points have the same y-coordinates on both images.
  • 5. Introduction Conjugate Points: • Common points in the overlap areas of the stereo pair images. • Also called Tie Points • The search for correspondence points can be done in 2-D e.g. in a rectangle oriented along an approximate epipolar line.
  • 6. Introduction Relationship Between Matching Methods and Matching Entities
  • 7. Introduction Area Based Matching • Oldest and simplest matching technique • Is performed on the basis of grey values • Compare the grey level of small sub image with its counterpart in the other image • Template and Search Window
  • 8. Introduction Correlation • Technique used for finding the conjugate points • Measure the similarity of template and search window computing the correlation factor Parallax • Apparent change in the position of object • Related to the elevation of the terrain Applications:  Image registration, DEM generation, displacement measurements, Target measurements, Surveillance, Treaty verification
  • 9. AGENDA: Introduction Objectives: • To develop a procedure of automatic point transfer to determine the conjugate points in an epipolar image pair • To compare the intensity or gray values of a template • To asses the quality of the match through using correlation coefficient. • Develop a parallax field of M*N matrix
  • 10. AGENDA: Workflow Select odd size template in the source image Matching window in the destination image with conjugate entities Computation of co-rrelation coefficients for different threshold Repeat above steps for new template location until all positions to be matched are visited Analyse for consistency
  • 11. AGENDA: Workflow Location of Template: • Not to locate in the occluded areas, area with low contrast or repetitive pattern. Size of Template • Increase in size will increase the uniqueness of grey value but also increase distortion. • Decrease in the size will amount to less distortion but the uniqueness of the grey values will be decreased. Location and size of search window • Location is important (Epipolar Line) • size should be large enough to include farthest moving template and small enough to limit the computational cost of matching
  • 12. Workflow Acceptance Criteria •Three threshold values are used Quality Control •Accuracy and reliability of conjugate Points.
  • 14. Workflow Calculation of Parallax • P = Xleft – Xright • Where, • Xleft = position of certain object in left image • Xright = position of same object in right image
  • 15. Data and Software Used Images: • Two epipolar images • MATLAB Image Left Image Right
  • 16. Methodology: Develop algorithm in the MATLAB Take the input of starting point in left image, template size as well as window size in the right image. Select the threshold values for correlation coefficient calculation. Threshold 1 = 0 ≤ r ≤ 0.5, low correlation Threshold 2 = 0.5 ≤ r ≤ 0.75, medium correlation Threshold 3 = 0.75 ≤ r ≤ 1, high correlation Calculate and locate the correlated points in right image as well as the grid in left image. Calculate the parallax value
  • 17. Experiment Results: Destination Image showing correlating points of different threshold values with template size 7 x 7. Source Image with the Grid
  • 18. Experiment Results: Destination Image showing correlating points of different threshold values with template size of 21 x 21. Source Image with the Grid
  • 19. Experiment Results: Less match points in Shadow and Homogeneous areas, because of constant grey values Shadow Areas Homogeneous Areas
  • 20. Conclusion: Area based matching depends upon the quality of image as well as the template size In case of homogenous areas, occluded areas as well as shadow areas, points are not well located. With small template size, grey value uniqueness is decreased as well as the comuptation time is increased. With large template size, grey value uniquness is increased but so is the geometric distortion. Computation of parallax value gives terrain height but we were unable to generate the surface.
  • 21. Reference: Schenk, T. (1999). Digital Photogrammetry. Volume I. United States Of America: Terra Science. Hannah, M. J., 1974. "Computer Matching of Areas in Stereo Images," Ph.D. Thesis, Stanford University, Computer Science Department Report STAN-CS-74- 438, July, 1974. Dr. Marsha Jo Hannah ,“Digital Stereo Image Matching Techniques” http://www.e-perimetron.org/Vol_4_3/Balletti_Guerra.pdf Misganu Debella-Gilo,Andreas Kääb “Sub-pixel precision image matching for measuring surface displacements on mass movements using normalized cross- correlation“ Misganu Debella-Gilo,Andreas Kääb “LOCALLY ADAPTIVE TEMPLATE SIZES FOR MATCHING REPEAT IMAGES OF MASS MOVEMENTS “
  • 22. Thank you for your Attention