SlideShare a Scribd company logo
1 of 11
Download to read offline
Appendix
The appendix shows a set of figures which illustrate some of the methods I have developed.
Simultaneous registration of multiple 3-D images without known
corresponding points
50
100
150
200
250
300
−50
0
50
100
150
200
250
300
50
100
150
X1
Y1
Z1
50
100
150
200
250
300
−50
0
50
100
150
200
250
300
80
100
120
140
160
X1
Y1
Z1
Figure 1: Registration of multiple profile maps using the proposed iterative parametric
point algorithm. Left: Initial registration. Right: Refined registration.
Self-calibration of a light striping system by matching multiple
3-D images
Figure 2: Four synthetic data sets before and after calibration of the light striping system
by the proposed method based on matching the surfaces. When there are errors in the
calibration, the surfaces acquired from different viewpoints do not fit to each other, but
when the calibration is corrected, they do fit.
1
Statistical analysis of two registration and modeling strategies
Figure 3: Precision of the modeled profile maps in a simultaneous registration strategy
with the model computed afterwards, as given by the statistical analysis performed. The
color ranges from blue through green and yellow to red as the precision decreases from
high to low. The statistical analysis takes into account all the error sources including
measurement, calibration, registration, and modeling uncertainties.
2
Detection of distortions in digital elevation models of glacial areas
after aligning the models accurately
x / m
y/10
6
m
28000 29500 31000 32500 34000 35500 37000 38500
5.192
5.1905
5.189
5.1875
5.186
5.1845
5.183
5.1815
−4
−3
−2
−1
0
1
2
3
4
m
hollow in IKONOS DEM
hollow in IKONOS DEM
edge in aerial photography DEM
aerial photography DEM distorted
Figure 4: Distortions detected in the aerial photography DEM and Ikonos DEM of Hin-
tereisferner glacier. The color shows the difference in elevation between the DEMs. The
detection of distortions is based on analyzing difference images between three or more
DEMs produced from data acquired on the same day.
Visualization of airborne laser scanner data on a terrestrial
panoramic image of a glacial area
Figure 5: Triangulated laser scanner data projected onto one of the terrestrial panoramic
images after registering the laser scanner data with a terrestrial photography DEM.
3
Derivation of estimates for the accuracy of change in elevation
and volume of a glacier
x / m
y/106
m
632000 633000 634000 635000 636000 637000 638000
5.191
5.19
5.189
5.188
5.187
5.186
−8
−6
−4
−2
0
2
4
6
8
m
ice−free area for precision estimation
ice−free area for precision estimation
Hintereisferner study area for change detection
0 100 200 300 400 500 600 700 800
−3
−2.5
−2
−1.5
−1
−0.5
0
0.5
1
1.5
2
x 10
7
time in days
changeinvolume/m3
Figure 6: Top: Changes in elevation at least occurred in Hintereisferner between August
19, 2002, and August 12, 2003, according to the error bounds derived, and differences
in elevation between the DEMs in ice-free test areas for precision estimation. Bottom:
Changes in volume (circles and solid line) with error bounds (dashed lines) in Hintereis-
ferner during a period of two years as estimated by the proposed method from a sequence
of ten laser scanner DEMs.
4
Correspondence matching between trunks estimated from a pair
of terrestrial images and from airborne laser scanner data
50 100 150 200
50
100
150
200
Figure 7: Left: Trunks extracted from the terrestrial image are shown as red lines and
trunks extracted from the laser scanner data and projected onto the image as green lines.
Right: The positions of the corresponding trunks found by the proposed method and the
viewing areas of the cameras visualized on a digital surface model of 0.5m × 0.5m ground
resolution.
3-D reconstruction from a stereo image sequence
Figure 8: Left: One image of the left camera. Right: Surface model of the trunk re-
constructed by the proposed method from a stereo image sequence captured onboard a
harvester approaching the tree.
5
3-D deformation estimation from a single image or multiple im-
ages with weak imaging geometry
−10
−5
0
5
10
−10
−5
0
5
10
−2
−1.5
−1
−0.5
0
0.5
1
X / mY / m
Z/m
−5
0
5
−5
0
5
−1.5
−1
−0.5
0
0.5
X / mY / m
Z/m
Figure 9: True deformed surface in blue and the estimated deformed surface in red, when
the imaging geometry is weak. The traditional method gives mainly noise (left figure)
while the proposed method estimates the deformation accurately (right figure).
6
Detection of cameras the orientations of which have changed
when the object deforms at the same time
Figure 10: A plate monitored with four cameras. Upper left: A discrepancy measure
exceeds an adaptive threshold for image 2, which shows that the orientation of camera
2 has changed. Upper right: In red, the surface after deformation and correction of the
exterior orientation of camera 2 using the proposed method based on a shape function;
In dark blue, the deformed surface reconstructed using the traditional method; In cyan,
the surface before deformation given by iWitness software.
7
Tracking of facial deformations in multi-image sequences with
elimination of rigid motion of the head
Frame 35 Frame 50 Frame 70
Figure 11: Top: Tracked image points in one camera of a multi-image sequence. Bottom:
Large changes in the image coordinates without (left image) and with (right image) elim-
ination of the effect of rigid motion. The facial deformation around the mouth is correctly
pointed out in the right image.
8
Estimation of lower bounds for deviations of as-built structures
from an as-designed Building Information Model given a single
spherical panoramic image of the scene
Figure 12: From top to bottom: edge curves extracted from the spherical panoramic image
and initial orientation of the image with respect to a BIM; refined orientation; BIM model
adjusted to fit with the edge features of the image; adjusted BIM in 3-D space with color
illustrating differences against the as-designed BIM.
9
Shape function-based 3-D deformation estimation with moving
cameras attached to the deforming body
Figure 13: Deformation estimation of the frame of a crane by the proposed method, when
the cameras need to be attached to the self deforming body, the structure sways during
loading, and the imaging geometry is not optimal due to physical limitations.
10
Dense image matching and 3-D reconstruction from a pair of
scanning electron microscope images of a single atmospheric dust
particle
Figure 14: Top: SEM image of an aggregate particle. Bottom: Dense TIN model of over
million points reconstructed by the proposed method from a pair of SEM images.
11

More Related Content

What's hot

FinalProjectSurveyingfinal
FinalProjectSurveyingfinalFinalProjectSurveyingfinal
FinalProjectSurveyingfinalkai yu chen
 
Surveying ii module iii class 3
Surveying ii module iii class 3Surveying ii module iii class 3
Surveying ii module iii class 3SHAMJITH KM
 
Elements of Analytical Photogrammetry
Elements of Analytical PhotogrammetryElements of Analytical Photogrammetry
Elements of Analytical PhotogrammetryNadia Aziz
 
Photogrammetry - areaotriangulation
Photogrammetry - areaotriangulationPhotogrammetry - areaotriangulation
Photogrammetry - areaotriangulationjayan_sri
 
Acad civil3 d_points_manual
Acad civil3 d_points_manualAcad civil3 d_points_manual
Acad civil3 d_points_manualMiodrag Hrenek
 
Lecture 4 image measumrents & refinement
Lecture 4  image measumrents & refinementLecture 4  image measumrents & refinement
Lecture 4 image measumrents & refinementSarhat Adam
 
SURVEYING - Photogrammetry (CE 115) Lec2 By Afia Narzis Spring 2016
SURVEYING - Photogrammetry (CE 115) Lec2 By Afia Narzis Spring 2016SURVEYING - Photogrammetry (CE 115) Lec2 By Afia Narzis Spring 2016
SURVEYING - Photogrammetry (CE 115) Lec2 By Afia Narzis Spring 2016PIYAL Bhuiyan
 
Arc Geographic Information System (GIS) Digital Elevation Models (DEM).
Arc Geographic Information System (GIS) Digital Elevation Models (DEM).Arc Geographic Information System (GIS) Digital Elevation Models (DEM).
Arc Geographic Information System (GIS) Digital Elevation Models (DEM).Uday Kumar Shil
 
Principle of photogrammetry
Principle of photogrammetryPrinciple of photogrammetry
Principle of photogrammetrySumant Diwakar
 
BASIC CONCEPTS OF PHOTOGRAMMETRY
BASIC CONCEPTS OF PHOTOGRAMMETRYBASIC CONCEPTS OF PHOTOGRAMMETRY
BASIC CONCEPTS OF PHOTOGRAMMETRYNamitha M R
 
Digital terrain representations(last)
Digital terrain representations(last)Digital terrain representations(last)
Digital terrain representations(last)Muhammad1212
 

What's hot (20)

Collinearity Equations
Collinearity EquationsCollinearity Equations
Collinearity Equations
 
Photogrammetry chandu
Photogrammetry chanduPhotogrammetry chandu
Photogrammetry chandu
 
Photogrammetry chandu
Photogrammetry chanduPhotogrammetry chandu
Photogrammetry chandu
 
Digital terrain model
Digital terrain modelDigital terrain model
Digital terrain model
 
Photogrammetry
PhotogrammetryPhotogrammetry
Photogrammetry
 
FinalProjectSurveyingfinal
FinalProjectSurveyingfinalFinalProjectSurveyingfinal
FinalProjectSurveyingfinal
 
Surveying ii module iii class 3
Surveying ii module iii class 3Surveying ii module iii class 3
Surveying ii module iii class 3
 
Elements of Analytical Photogrammetry
Elements of Analytical PhotogrammetryElements of Analytical Photogrammetry
Elements of Analytical Photogrammetry
 
Photogrammetry - areaotriangulation
Photogrammetry - areaotriangulationPhotogrammetry - areaotriangulation
Photogrammetry - areaotriangulation
 
Acad civil3 d_points_manual
Acad civil3 d_points_manualAcad civil3 d_points_manual
Acad civil3 d_points_manual
 
3D Road Profiling Using Stereography Paper80963
3D Road Profiling Using Stereography Paper809633D Road Profiling Using Stereography Paper80963
3D Road Profiling Using Stereography Paper80963
 
Photogrammetry1
Photogrammetry1Photogrammetry1
Photogrammetry1
 
region Basd in ML
region Basd in MLregion Basd in ML
region Basd in ML
 
Lecture 4 image measumrents & refinement
Lecture 4  image measumrents & refinementLecture 4  image measumrents & refinement
Lecture 4 image measumrents & refinement
 
SURVEYING - Photogrammetry (CE 115) Lec2 By Afia Narzis Spring 2016
SURVEYING - Photogrammetry (CE 115) Lec2 By Afia Narzis Spring 2016SURVEYING - Photogrammetry (CE 115) Lec2 By Afia Narzis Spring 2016
SURVEYING - Photogrammetry (CE 115) Lec2 By Afia Narzis Spring 2016
 
Arc Geographic Information System (GIS) Digital Elevation Models (DEM).
Arc Geographic Information System (GIS) Digital Elevation Models (DEM).Arc Geographic Information System (GIS) Digital Elevation Models (DEM).
Arc Geographic Information System (GIS) Digital Elevation Models (DEM).
 
Principle of photogrammetry
Principle of photogrammetryPrinciple of photogrammetry
Principle of photogrammetry
 
BASIC CONCEPTS OF PHOTOGRAMMETRY
BASIC CONCEPTS OF PHOTOGRAMMETRYBASIC CONCEPTS OF PHOTOGRAMMETRY
BASIC CONCEPTS OF PHOTOGRAMMETRY
 
C012271015
C012271015C012271015
C012271015
 
Digital terrain representations(last)
Digital terrain representations(last)Digital terrain representations(last)
Digital terrain representations(last)
 

Similar to appendix

Enhanced Algorithm for Obstacle Detection and Avoidance Using a Hybrid of Pla...
Enhanced Algorithm for Obstacle Detection and Avoidance Using a Hybrid of Pla...Enhanced Algorithm for Obstacle Detection and Avoidance Using a Hybrid of Pla...
Enhanced Algorithm for Obstacle Detection and Avoidance Using a Hybrid of Pla...IOSR Journals
 
IGASS_Hu6.ppt
IGASS_Hu6.pptIGASS_Hu6.ppt
IGASS_Hu6.pptgrssieee
 
Using Generic Image Processing Operations to Detect a Calibration Grid
Using Generic Image Processing Operations to Detect a Calibration GridUsing Generic Image Processing Operations to Detect a Calibration Grid
Using Generic Image Processing Operations to Detect a Calibration GridJan Wedekind
 
Scanning 3 d full human bodies using kinects
Scanning 3 d full human bodies using kinectsScanning 3 d full human bodies using kinects
Scanning 3 d full human bodies using kinectsFensa Saj
 
3-d interpretation from single 2-d image for autonomous driving
3-d interpretation from single 2-d image for autonomous driving3-d interpretation from single 2-d image for autonomous driving
3-d interpretation from single 2-d image for autonomous drivingYu Huang
 
BC Conference Poster
BC Conference PosterBC Conference Poster
BC Conference PosterAndrew Moss
 
[論文紹介] DPSNet: End-to-end Deep Plane Sweep Stereo
[論文紹介] DPSNet: End-to-end Deep Plane Sweep Stereo[論文紹介] DPSNet: End-to-end Deep Plane Sweep Stereo
[論文紹介] DPSNet: End-to-end Deep Plane Sweep StereoSeiya Ito
 
Vision based non-invasive tool for facial swelling assessment
Vision based non-invasive tool for facial swelling assessment Vision based non-invasive tool for facial swelling assessment
Vision based non-invasive tool for facial swelling assessment University of Moratuwa
 
Research Paper v2.0
Research Paper v2.0Research Paper v2.0
Research Paper v2.0Kapil Tiwari
 
Distance Estimation to Image Objects Using Adapted Scale
Distance Estimation to Image Objects Using Adapted ScaleDistance Estimation to Image Objects Using Adapted Scale
Distance Estimation to Image Objects Using Adapted Scaletheijes
 
Distance Estimation to Image Objects Using Adapted Scale
Distance Estimation to Image Objects Using Adapted ScaleDistance Estimation to Image Objects Using Adapted Scale
Distance Estimation to Image Objects Using Adapted Scaletheijes
 
Digital image processing
Digital image processingDigital image processing
Digital image processingChetan Hulsure
 
Estimation of Terrain Gradient Conditions & Obstacle Detection Using a Monocu...
Estimation of Terrain Gradient Conditions & Obstacle Detection Using a Monocu...Estimation of Terrain Gradient Conditions & Obstacle Detection Using a Monocu...
Estimation of Terrain Gradient Conditions & Obstacle Detection Using a Monocu...Connor Goddard
 
Pix4D quality report for July 21 2017 RGB of terraref.org sorghum at Maricopa...
Pix4D quality report for July 21 2017 RGB of terraref.org sorghum at Maricopa...Pix4D quality report for July 21 2017 RGB of terraref.org sorghum at Maricopa...
Pix4D quality report for July 21 2017 RGB of terraref.org sorghum at Maricopa...Rick Ward
 

Similar to appendix (20)

Enhanced Algorithm for Obstacle Detection and Avoidance Using a Hybrid of Pla...
Enhanced Algorithm for Obstacle Detection and Avoidance Using a Hybrid of Pla...Enhanced Algorithm for Obstacle Detection and Avoidance Using a Hybrid of Pla...
Enhanced Algorithm for Obstacle Detection and Avoidance Using a Hybrid of Pla...
 
IGASS_Hu6.ppt
IGASS_Hu6.pptIGASS_Hu6.ppt
IGASS_Hu6.ppt
 
Using Generic Image Processing Operations to Detect a Calibration Grid
Using Generic Image Processing Operations to Detect a Calibration GridUsing Generic Image Processing Operations to Detect a Calibration Grid
Using Generic Image Processing Operations to Detect a Calibration Grid
 
NRpgray
NRpgrayNRpgray
NRpgray
 
Scanning 3 d full human bodies using kinects
Scanning 3 d full human bodies using kinectsScanning 3 d full human bodies using kinects
Scanning 3 d full human bodies using kinects
 
3-d interpretation from single 2-d image for autonomous driving
3-d interpretation from single 2-d image for autonomous driving3-d interpretation from single 2-d image for autonomous driving
3-d interpretation from single 2-d image for autonomous driving
 
Sensory Substitution
Sensory SubstitutionSensory Substitution
Sensory Substitution
 
BC Conference Poster
BC Conference PosterBC Conference Poster
BC Conference Poster
 
06466595
0646659506466595
06466595
 
[論文紹介] DPSNet: End-to-end Deep Plane Sweep Stereo
[論文紹介] DPSNet: End-to-end Deep Plane Sweep Stereo[論文紹介] DPSNet: End-to-end Deep Plane Sweep Stereo
[論文紹介] DPSNet: End-to-end Deep Plane Sweep Stereo
 
Vision based non-invasive tool for facial swelling assessment
Vision based non-invasive tool for facial swelling assessment Vision based non-invasive tool for facial swelling assessment
Vision based non-invasive tool for facial swelling assessment
 
Research Paper v2.0
Research Paper v2.0Research Paper v2.0
Research Paper v2.0
 
Distance Estimation to Image Objects Using Adapted Scale
Distance Estimation to Image Objects Using Adapted ScaleDistance Estimation to Image Objects Using Adapted Scale
Distance Estimation to Image Objects Using Adapted Scale
 
Distance Estimation to Image Objects Using Adapted Scale
Distance Estimation to Image Objects Using Adapted ScaleDistance Estimation to Image Objects Using Adapted Scale
Distance Estimation to Image Objects Using Adapted Scale
 
Digital image processing
Digital image processingDigital image processing
Digital image processing
 
Estimation of Terrain Gradient Conditions & Obstacle Detection Using a Monocu...
Estimation of Terrain Gradient Conditions & Obstacle Detection Using a Monocu...Estimation of Terrain Gradient Conditions & Obstacle Detection Using a Monocu...
Estimation of Terrain Gradient Conditions & Obstacle Detection Using a Monocu...
 
posterfinal
posterfinalposterfinal
posterfinal
 
Aberration_Errors
Aberration_ErrorsAberration_Errors
Aberration_Errors
 
Pix4D quality report for July 21 2017 RGB of terraref.org sorghum at Maricopa...
Pix4D quality report for July 21 2017 RGB of terraref.org sorghum at Maricopa...Pix4D quality report for July 21 2017 RGB of terraref.org sorghum at Maricopa...
Pix4D quality report for July 21 2017 RGB of terraref.org sorghum at Maricopa...
 
Lane Detection
Lane DetectionLane Detection
Lane Detection
 

appendix

  • 1. Appendix The appendix shows a set of figures which illustrate some of the methods I have developed. Simultaneous registration of multiple 3-D images without known corresponding points 50 100 150 200 250 300 −50 0 50 100 150 200 250 300 50 100 150 X1 Y1 Z1 50 100 150 200 250 300 −50 0 50 100 150 200 250 300 80 100 120 140 160 X1 Y1 Z1 Figure 1: Registration of multiple profile maps using the proposed iterative parametric point algorithm. Left: Initial registration. Right: Refined registration. Self-calibration of a light striping system by matching multiple 3-D images Figure 2: Four synthetic data sets before and after calibration of the light striping system by the proposed method based on matching the surfaces. When there are errors in the calibration, the surfaces acquired from different viewpoints do not fit to each other, but when the calibration is corrected, they do fit. 1
  • 2. Statistical analysis of two registration and modeling strategies Figure 3: Precision of the modeled profile maps in a simultaneous registration strategy with the model computed afterwards, as given by the statistical analysis performed. The color ranges from blue through green and yellow to red as the precision decreases from high to low. The statistical analysis takes into account all the error sources including measurement, calibration, registration, and modeling uncertainties. 2
  • 3. Detection of distortions in digital elevation models of glacial areas after aligning the models accurately x / m y/10 6 m 28000 29500 31000 32500 34000 35500 37000 38500 5.192 5.1905 5.189 5.1875 5.186 5.1845 5.183 5.1815 −4 −3 −2 −1 0 1 2 3 4 m hollow in IKONOS DEM hollow in IKONOS DEM edge in aerial photography DEM aerial photography DEM distorted Figure 4: Distortions detected in the aerial photography DEM and Ikonos DEM of Hin- tereisferner glacier. The color shows the difference in elevation between the DEMs. The detection of distortions is based on analyzing difference images between three or more DEMs produced from data acquired on the same day. Visualization of airborne laser scanner data on a terrestrial panoramic image of a glacial area Figure 5: Triangulated laser scanner data projected onto one of the terrestrial panoramic images after registering the laser scanner data with a terrestrial photography DEM. 3
  • 4. Derivation of estimates for the accuracy of change in elevation and volume of a glacier x / m y/106 m 632000 633000 634000 635000 636000 637000 638000 5.191 5.19 5.189 5.188 5.187 5.186 −8 −6 −4 −2 0 2 4 6 8 m ice−free area for precision estimation ice−free area for precision estimation Hintereisferner study area for change detection 0 100 200 300 400 500 600 700 800 −3 −2.5 −2 −1.5 −1 −0.5 0 0.5 1 1.5 2 x 10 7 time in days changeinvolume/m3 Figure 6: Top: Changes in elevation at least occurred in Hintereisferner between August 19, 2002, and August 12, 2003, according to the error bounds derived, and differences in elevation between the DEMs in ice-free test areas for precision estimation. Bottom: Changes in volume (circles and solid line) with error bounds (dashed lines) in Hintereis- ferner during a period of two years as estimated by the proposed method from a sequence of ten laser scanner DEMs. 4
  • 5. Correspondence matching between trunks estimated from a pair of terrestrial images and from airborne laser scanner data 50 100 150 200 50 100 150 200 Figure 7: Left: Trunks extracted from the terrestrial image are shown as red lines and trunks extracted from the laser scanner data and projected onto the image as green lines. Right: The positions of the corresponding trunks found by the proposed method and the viewing areas of the cameras visualized on a digital surface model of 0.5m × 0.5m ground resolution. 3-D reconstruction from a stereo image sequence Figure 8: Left: One image of the left camera. Right: Surface model of the trunk re- constructed by the proposed method from a stereo image sequence captured onboard a harvester approaching the tree. 5
  • 6. 3-D deformation estimation from a single image or multiple im- ages with weak imaging geometry −10 −5 0 5 10 −10 −5 0 5 10 −2 −1.5 −1 −0.5 0 0.5 1 X / mY / m Z/m −5 0 5 −5 0 5 −1.5 −1 −0.5 0 0.5 X / mY / m Z/m Figure 9: True deformed surface in blue and the estimated deformed surface in red, when the imaging geometry is weak. The traditional method gives mainly noise (left figure) while the proposed method estimates the deformation accurately (right figure). 6
  • 7. Detection of cameras the orientations of which have changed when the object deforms at the same time Figure 10: A plate monitored with four cameras. Upper left: A discrepancy measure exceeds an adaptive threshold for image 2, which shows that the orientation of camera 2 has changed. Upper right: In red, the surface after deformation and correction of the exterior orientation of camera 2 using the proposed method based on a shape function; In dark blue, the deformed surface reconstructed using the traditional method; In cyan, the surface before deformation given by iWitness software. 7
  • 8. Tracking of facial deformations in multi-image sequences with elimination of rigid motion of the head Frame 35 Frame 50 Frame 70 Figure 11: Top: Tracked image points in one camera of a multi-image sequence. Bottom: Large changes in the image coordinates without (left image) and with (right image) elim- ination of the effect of rigid motion. The facial deformation around the mouth is correctly pointed out in the right image. 8
  • 9. Estimation of lower bounds for deviations of as-built structures from an as-designed Building Information Model given a single spherical panoramic image of the scene Figure 12: From top to bottom: edge curves extracted from the spherical panoramic image and initial orientation of the image with respect to a BIM; refined orientation; BIM model adjusted to fit with the edge features of the image; adjusted BIM in 3-D space with color illustrating differences against the as-designed BIM. 9
  • 10. Shape function-based 3-D deformation estimation with moving cameras attached to the deforming body Figure 13: Deformation estimation of the frame of a crane by the proposed method, when the cameras need to be attached to the self deforming body, the structure sways during loading, and the imaging geometry is not optimal due to physical limitations. 10
  • 11. Dense image matching and 3-D reconstruction from a pair of scanning electron microscope images of a single atmospheric dust particle Figure 14: Top: SEM image of an aggregate particle. Bottom: Dense TIN model of over million points reconstructed by the proposed method from a pair of SEM images. 11