Representation

10,377 views

Published on

Section 2 of the BYO3D SIGGRAPH 2010 Course

Published in: Self Improvement
  • Be the first to comment

  • Be the first to like this

Representation

  1. 1. Course Outline<br /><ul><li>Introduction: History and Physiology
  2. 2. Representation and Display
  3. 3. Glasses-bound Stereoscopic Displays
  4. 4. Unencumbered Automultiscopic Displays
  5. 5. Source Material: Rendering and Capture
  6. 6. Emerging Technology
  7. 7. Conclusion and Q & A</li></li></ul><li>Taxonomy of 3D Displays:<br />Glasses-bound vs. Unencumbered Designs<br />Immersive<br />Parallax Barriers<br />Multi-planar<br />Static<br />Head-mounted<br />(blocks direct-viewing of real world)<br />(uniform array of 1D slits or 2D pinhole arrays)<br />(time-sequential projection onto swept surfaces)<br />(holographic films) <br />(eyepiece-objective and microdisplay)<br />See-through<br />Integral Imaging<br />Transparent Substrates<br />Dynamic<br />Glasses-bound<br />Stereoscopic<br />(superimposes synthetic images onto real world)<br />(lenticular sheets or fly’s eye lenslet arrays)<br />(intersecting laser beams, fog layers, etc.)<br />(holovideo)<br />Spatially-multiplexed (field-concurrent)<br />Multiplexed <br />(color filters, polarizers, autostereograms, etc.)<br />(stereo pair with same display surface)<br />Temporally-multiplexed (field-sequential)<br />(LCD shutter glasses)<br />Parallax-based<br />(2D display with light-directing elements)<br />Unencumbered<br />Automultiscopic<br />Volumetric<br />(directly illuminate points within a volume)<br />Holographic<br />(reconstructs wavefront using 2D element)<br />Taxonomy adapted from Hong Hua<br />
  8. 8. Taxonomy of 3D Displays:<br />Immersive Head-mounted Displays (HMDs)<br />Immersive<br />(blocks direct-viewing of real world)<br />Multiplexed <br />(stereo pair with same display surface)<br />Head-mounted<br />(eyepiece-objective and microdisplay)<br />Glasses-bound<br />Stereoscopic<br />
  9. 9. Taxonomy of 3D Displays:<br />See-throughHead-mounted Displays (HMDs)<br />Immersive<br />(blocks direct-viewing of real world)<br />See-through<br />(superimposes synthetic images onto real world)<br />Multiplexed <br />(stereo pair with same display surface)<br />Head-mounted<br />(eyepiece-objective and microdisplay)<br />Glasses-bound<br />Stereoscopic<br />
  10. 10. Taxonomy of 3D Displays:<br />Spatial Multiplexing (e.g., Anaglyphs)<br />Immersive<br />(blocks direct-viewing of real world)<br />See-through<br />(superimposes synthetic images onto real world)<br />Spatially-multiplexed (field-concurrent)<br />Multiplexed <br />(color filters, polarizers, etc.)<br />(stereo pair with same display surface)<br />Head-mounted<br />(eyepiece-objective and microdisplay)<br />Glasses-bound<br />Stereoscopic<br />
  11. 11. Taxonomy of 3D Displays:<br />Temporal Multiplexing (e.g., Shutter Glasses)<br />Immersive<br />(blocks direct-viewing of real world)<br />See-through<br />(superimposes synthetic images onto real world)<br />Spatially-multiplexed (field-concurrent)<br />Multiplexed <br />(color filters, polarizers, autostereograms, etc.)<br />(stereo pair with same display surface)<br />Temporally-multiplexed (field-sequential)<br />(LCD shutter glasses)<br />Head-mounted<br />(eyepiece-objective and microdisplay)<br />Glasses-bound<br />Stereoscopic<br />
  12. 12. Taxonomy of 3D Displays:<br />Parallax Barriers<br />NewSight MV-42AD3 42''<br />(1920x1080, 1x8 views)<br />Parallax Barriers<br />Parallax-based<br />(uniform array of 1D slits or 2D pinhole arrays)<br />(2D display with light-directing elements)<br />Volumetric<br />Unencumbered<br />Automultiscopic<br />(directly illuminate points within a volume)<br />Holographic<br />(reconstructs wavefront using 2D element)<br />
  13. 13. Taxonomy of 3D Displays:<br />Integral Imaging<br />Alioscopy 3DHD 42''<br />(1920x1200, 1x8 views)<br />Parallax Barriers<br />Parallax-based<br />(uniform array of 1D slits or 2D pinhole arrays)<br />(2D display with light-directing elements)<br />Integral Imaging<br />(lenticular sheets or fly’s eye lenslet arrays)<br />Volumetric<br />Unencumbered<br />Automultiscopic<br />(directly illuminate points within a volume)<br />Holographic<br />(reconstructs wavefront using 2D element)<br />
  14. 14. Taxonomy of 3D Displays:<br />Multi-planar Volumetric Displays<br />Parallax Barriers<br />Parallax-based<br />(uniform array of 1D slits or 2D pinhole arrays)<br />(2D display with light-directing elements)<br />Integral Imaging<br />(lenticular sheets or fly’s eye lenslet arrays)<br />Multi-planar<br />Volumetric<br />(time-sequential projection onto swept surfaces)<br />Unencumbered<br />Automultiscopic<br />(directly illuminate points within a volume)<br />Holographic<br />(reconstructs wavefront using 2D element)<br />
  15. 15. Taxonomy of 3D Displays:<br />Transparent-substrate Volumetric Displays<br />Parallax Barriers<br />Parallax-based<br />(uniform array of 1D slits or 2D pinhole arrays)<br />(2D display with light-directing elements)<br />Integral Imaging<br />(lenticular sheets or fly’s eye lenslet arrays)<br />Multi-planar<br />Volumetric<br />(time-sequential projection onto swept surfaces)<br />Unencumbered<br />Automultiscopic<br />(directly illuminate points within a volume)<br />Transparent Substrates<br />(intersecting laser beams, fog layers, etc.)<br />Holographic<br />(reconstructs wavefront using 2D element)<br />
  16. 16. Taxonomy of 3D Displays:<br />Static Holograms<br />Static<br />(holographic films) <br />capture<br />reconstruction<br />Parallax Barriers<br />Parallax-based<br />(uniform array of 1D slits or 2D pinhole arrays)<br />(2D display with light-directing elements)<br />Integral Imaging<br />(lenticular sheets or fly’s eye lenslet arrays)<br />Multi-planar<br />Volumetric<br />(time-sequential projection onto swept surfaces)<br />Unencumbered<br />Automultiscopic<br />(directly illuminate points within a volume)<br />Transparent Substrates<br />(intersecting laser beams, fog layers, etc.)<br />Holographic<br />(reconstructs wavefront using 2D element)<br />
  17. 17. Taxonomy of 3D Displays:<br />Dynamic Holograms (Holovideo)<br />Static<br />(holographic films) <br />Tay et al. <br />[Nature, 2008]<br />MIT Media Lab Spatial Imaging Group<br />[Holovideo, 1989 – present]<br />Parallax Barriers<br />Parallax-based<br />(uniform array of 1D slits or 2D pinhole arrays)<br />(2D display with light-directing elements)<br />Integral Imaging<br />(lenticular sheets or fly’s eye lenslet arrays)<br />Multi-planar<br />Volumetric<br />(time-sequential projection onto swept surfaces)<br />Unencumbered<br />Automultiscopic<br />(directly illuminate points within a volume)<br />Transparent Substrates<br />(intersecting laser beams, fog layers, etc.)<br />Holographic<br />(reconstructs wavefront using 2D element)<br />Dynamic<br />(holovideo)<br />
  18. 18. Introduction to Light Fields<br />(s,t)<br />v<br />t<br />(u,v)<br />u<br />s<br />Representing Light Transport <br /><ul><li> Assume geometrical (ray) optics approximation
  19. 19. Parameterize radiance of 3D rays using a 4D light field L(u,v,s,t)</li></ul>Marc Levoy and Pat Hanrahan. Light Field Rendering. 1996.<br />Steven Gortler et al. The Lumigraph. 1996.<br />
  20. 20. Introduction to Light Fields<br />u<br />s<br />s<br />q<br />Two Plane Parameterization<br />Position-Angle Parameterization<br />Light Fields [Levoy and Hanrahan1996, Gortler et al.1996]<br /><ul><li>Radiance along any direction at every point in 3D space
  21. 21. Light fields are 4D (e.g., two plane vs. position-angle parameterization)</li></li></ul><li>Representing 3D Displays with Light Fields<br />(u,s) or (u,a)<br />(u,v,s,t) or (u,v,a,b)<br />v<br />a<br />u<br />s<br />u<br />LCD<br />Light Fields [Levoy and Hanrahan1996, Gortler et al.1996]<br /><ul><li>Radiance along any direction at every point in 3D space
  22. 22. For a planar 3D display, the emitted light field is a 4D function
  23. 23. Parameterizedusing absolute or relative two plane parameterization</li></li></ul><li>Representing Multiple Views with Light Fields<br />viewer moves right<br />
  24. 24. Representing Multiple Views with Light Fields<br />
  25. 25. Representing Multiple Views with Light Fields<br />viewer moves right<br />v<br />v<br />v<br />v<br />v<br />v<br />v<br />v<br />v<br />b<br />u<br />u<br />u<br />u<br />u<br />u<br />u<br />u<br />u<br />a<br />viewer moves up<br />
  26. 26. Example: Parallax Barriers<br />(u,s)<br />s<br />parallax barrier<br />u<br />LCD<br />Light Fields [Levoy and Hanrahan1996, Gortler et al.1996]<br /><ul><li>Radiance along any direction at every point in 3D space
  27. 27. For a planar 3D display, the emitted light field is a 4D function
  28. 28. Parameterized using absolute or relative two plane parameterization
  29. 29. Represents multiple views projected by parallax barrier displays</li></li></ul><li>Example: Volumetric Displays<br />(u,s)<br />s<br />u<br />Light Fields [Levoy and Hanrahan1996, Gortler et al.1996]<br /><ul><li>Radiance along any direction at every point in 3D space
  30. 30. For a general planar 3D display, the emitted light field is a 4D function
  31. 31. Light field is parameterized using intersection with two planes
  32. 32. Represents multiple views projected by volumetric displays</li></li></ul><li>Course Outline<br /><ul><li>Introduction: History and Physiology
  33. 33. Representation and Display
  34. 34. Glasses-bound Stereoscopic Displays
  35. 35. Unencumbered Automultiscopic Displays
  36. 36. Source Material: Rendering and Capture
  37. 37. Emerging Technology
  38. 38. Conclusion and Q & A</li>

×