2008 brokerage 03 scalable 3 d models [compatibility mode]

594 views

Published on

0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
594
On SlideShare
0
From Embeds
0
Number of Embeds
4
Actions
Shares
0
Downloads
4
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

2008 brokerage 03 scalable 3 d models [compatibility mode]

  1. 1. Scaleable 3D models Luc Van Gool
  2. 2. Large-scale 3D modeling Clear trend towards ever more massive 3D models, and dynamic capture (4D) SecondLife, Google Earth, games like the Runaway, 3D navigation systems, Digital 3D Cartography (AGIV), digitalisation of museum content (EDL), … Developers of acquisition, editing, transmission, rendering, and presentation technologies are struggling to match Problem is huge, as massive, high-quality modelling also requires bridging the infamous semantic gap
  3. 3. Large-scale 3D modeling ACQUISITION
  4. 4. 3D acquisition taxonomy 3D acquisition methods passive active uni-directional multi-directional uni-directional multi-directional Shape-from Stereo LIDAR Line scanning - texture Structured light - contour Str. from motion - silhouettes Photom. stereo - defocus - shading
  5. 5. 3D acquisition taxonomy 3D acquisition methods passive active uni-directional multi-directional uni-directional multi-directional Shape-from Stereo LIDAR Line scanning - texture Structured light - contour Str. from motion - silhouettes Photom. stereo - defocus - shading
  6. 6. Underlying principles Structure from motion TRIANGULATION Structured light LIDAR TIME-OF-FLIGHT
  7. 7. Stereo The underlying principle is “triangulation” :
  8. 8. Active triangulation Triangulation 3D measurements Camera Projector 8
  9. 9. Active triangulation Camera image
  10. 10. Active triangulation Need for registration... Has to be automatic for large-scale work
  11. 11. Time-of-flight Cyrax Distance = C x T ÷2
  12. 12. Time-of-flight Cyrax Laser sweeps over surface No correspondences needed
  13. 13. Large-scale 3D capture Speed becomes essential … fast calculations (e.g. helped by GPU) … but also easy setup and data capture Increasingly systems that are based on comsumer HW … and intelligent modeling tools … and automatic data capture
  14. 14. 3D acquisition / structure-from-motion Tracking Dense 3D and depth surface Calibration estimation modeling Points and cameras Depth map 3D models
  15. 15. 3D acquisition / structure-from-motion Shape from Video (KUL)
  16. 16. 3D acquisition / structure-from-motion Shape from Stills (KUL)
  17. 17. ARC – Free 3D webservice ARC Automatic Reconstruction Conduit non-commercial use is free www.arc3d.be
  18. 18. Automatic photo mining (kooaba) 18
  19. 19. Use in movies / e.g. King Arthur (2003) Dublin: The Hollywood Valley (Eyetronics) 19
  20. 20. Use in movies / e.g. King Arthur (2003) Area B 20
  21. 21. Use in movies / e.g. King Arthur (2003) Combined areas 21
  22. 22. Use in movies / e.g. King Arthur (2003)
  23. 23. Use in movies / e.g. King Arthur (2003)
  24. 24. 3D acquisition / structured light One-shot ShapeCam
  25. 25. 3D acquisition / structured light Jackie Chan Latest RushHour Movie (Eyetronics)
  26. 26. 3D acquisition / structured light MLB 1200 players for gaming (Eyetronics)
  27. 27. 3D acquisition / structured light MLB 1200 players for gaming (Eyetronics)
  28. 28. 3D acquisition / structured light MLB 1200 players for gaming (Eyetronics)
  29. 29. 4D acquisition / structured light 3D snapshots in fast succession (KUL)
  30. 30. 4D acquisition / structured light (KUL & ETH Zurich) 30
  31. 31. 4D acquisition / structured light Real-time 3D extraction, incl. texture (KUL & ETH Zurich)
  32. 32. 3D acquisition / structured light
  33. 33. LIDAR Chevron hydrocarbon plant
  34. 34. LIDAR Cyrax / Leica
  35. 35. LIDAR
  36. 36. Large-scale 3D modeling EDITING / REPRESENTATION
  37. 37. LIDAR (Cyrax / Leica)
  38. 38. LIDAR
  39. 39. 39
  40. 40. LIDAR 400’x500’ area 10 vessels; 5 pumps 6,000 objects 81 scans from 30 tripod locations Cyrax field time = 50 hrs
  41. 41. Measuring for cartographic surveying Large-scale 3D measurements Efficiency of the interface !
  42. 42. Procedural modeling Modeling using rules from a style-specific shape grammar (ETH Zurich & Procedural)
  43. 43. Large-scale 3D modeling STREAMING / RENDERING
  44. 44. QoS • Bandwith of channel and type of platform! • Local, over network, wireless, ...? • PC cluster, PC, PDA, mobile phone, ...? • Level-of-Detail mechanisms • Compact representations • Exploit differential sensitivity HVS • 3D meshes or... point splashing, IBR, ...?
  45. 45. A4MC3 WIFI connected community with PDAs (EDM, IMEC, VUB)
  46. 46. MobiComp (Un. Kent & Bologna )
  47. 47. MeshGrid A scalable coding scheme for 3D models that: • enables progressive transmission • offers quality, resolution scalability and region-of-interest coding • guarantees a minimum distortion at any bit-rate • provides resilience against transmission errors
  48. 48. MeshGrid A MeshGrid model consists of a connectivity-wireframe (CW) and a reference-grid (RG) that acts as the reference-system (RS) of the model.
  49. 49. MeshGrid G2 G2 V V G1 G1 Vertex offset is a relative value: Update vertex position when uuuu r G1V grid is deformed or animated: offset = uuuuu , with offset ∈ [0,1) r uuuu uuuuu r r G1G2 G1V = G1G2 offset
  50. 50. MeshGrid Scalability, Regions Of Interest Coding Volumetric Morphing Volumetric Animation (a) (b) (c)
  51. 51. Image-based Rendering (KUL) (Un. Bonn) (EDM) 51
  52. 52. Large-scale 3D modeling PRESENTATION
  53. 53. Blue-C project Shuttered Walls & Synchronized Cameras walls opaque – walls transparent – no acquisition, projection acquisition, no projection (ETH Zurich)
  54. 54. Blue-C project
  55. 55. CyberWalk project
  56. 56. Towards holistic vision – 3D & recognition 56

×