What's my geometry?


Published on

A very high level (no code) look at the benefits of considering real world geometry when rendering AR, including a grossly simplified walk through of how to determine real world geometry using stereographic imaging based on single (mobile) camera frame sampling.

Published in: Technology
1 Like
  • Be the first to comment

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide

  • What's my geometry?

    1. 1. What’s my geometry? Putting more reality into your AR. James Bryan Graves Mobile Applications Developer at Sogeo Company jamesbryangraves@gmail.com Twitter: @jbryangraves
    2. 2. Today • Most AR relies on existing data to be present (or queried for) at the scene. • Most common, in the mobile space anyway, is geographic data including latitude, longitude, heading and altitude. • Input: GPS and accelerometer sensors. • Output: some rendering over a camera view
    3. 3. Output: OpenGL ES Model of geographic data
    4. 4. Enable AR geometry interaction with picking • Picking is the translation of screen coordinates into 3D world space points.
    5. 5. What’s wrong with this picture? • Although this is a completely valid use case: “Walk toward this spot.” • It’s misleading in other use cases. The spot is not on my window sill!
    6. 6. Tomorrow • Marker/Pattern based recognition • Has been in R&D, but Apple is now officially allowing access to raw camera pixels with iPhone OS4, just like Android had all along. • Markers provide projection and geometry data • Software still requires existing data to be present at the location. Specifically knowledge about markers.
    7. 7. So. . .what about the data after tomorrow? • Realtime analysis of the geometry of the real world for more realistic augmentations.
    8. 8. this becomes this
    9. 9. How?
    10. 10. Clouds of the mushroom kingdom (2.5D) NES SNES move at the same rate as move slower than the the foreground foreground, on their own layer
    11. 11. What’s have to do with AR? • The cloud layer suggests a projection matrix in Mario’s reality.
    12. 12. Stereographic Images • It’s why you have 2 eyes • Using 2 camera to produce 3D images is technology that has been around since the 1800’s • Hollywood is now capitalizing on it
    13. 13. But mobile phones only have one camera. . .
    14. 14. So sample. . . Keyframe 1 Keyframe 2
    15. 15. Already with 2 images, 6 points and 2 planes we have some reasonable geometry with which to construct a projection matrix.
    16. 16. Why is this cool? • No need to rely on markers for 3D model placement • Users can pick objects in reality just like they can pick AR objects • Geometry adds additional contextual information for data queries.
    17. 17. Thanks! James Bryan Graves Mobile Applications Developer at Sogeo Company jamesbryangraves@gmail.com Twitter: @jbryangraves