All rights reserved to Intel RealSense Game Studios / Perceptual Computing / 2015
Intel RealSense Scene Perception demo
“Mommy, can I play in the
kitchen pleeeeaaase?”
All rights reserved to Intel RealSense Game Studios / Perceptual Computing / 2015
3-toys-in-1
All rights reserved to Intel RealSense Game Studios / Perceptual Computing / 2015
Real time mesh
reconstruction
All rights reserved to Intel RealSense Game Studios / Perceptual Computing / 2015
Real time mesh
reconstruction
All rights reserved to Intel RealSense Game Studios / Perceptual Computing / 2015
Real time mesh
reconstruction
All rights reserved to Intel RealSense Game Studios / Perceptual Computing / 2015
Real time mesh
reconstruction
All rights reserved to Intel RealSense Game Studios / Perceptual Computing / 2015
Real time mesh
reconstruction
All rights reserved to Intel RealSense Game Studios / Perceptual Computing / 2015
Real time scanning
and tracking
All rights reserved to Intel RealSense Game Studios / Perceptual Computing / 2015
Real time scanning
and tracking
All rights reserved to Intel RealSense Game Studios / Perceptual Computing / 2015
Real time scanning
and tracking
All rights reserved to Intel RealSense Game Studios / Perceptual Computing / 2015
Interaction with
reconstructed mesh
All rights reserved to Intel RealSense Game Studios / Perceptual Computing / 2015
Occlusion of virtual
by real elements
All rights reserved to Intel RealSense Game Studios / Perceptual Computing / 2015
Occlusion of virtual
by real elements
All rights reserved to Intel RealSense Game Studios / Perceptual Computing / 2015
Fun to play
All rights reserved to Intel RealSense Game Studios / Perceptual Computing / 2015
Fun to play
All rights reserved to Intel RealSense Game Studios / Perceptual Computing / 2015
Fun to play
All rights reserved to Intel RealSense Game Studios / Perceptual Computing / 2015
Fun to play
All rights reserved to Intel RealSense Game Studios / Perceptual Computing / 2015 18
Eli Elhadad, General Manager
Amir Rosenberger, Developer
Yinon Oshrat, Developer
Omer Goshen, Developer
Hagit Schechter, Developer
Yaron Yanai, Creative Manager
Shachar Oz, UX & Game Design
Bar Shulman, 3D Artist
Edna Nuama, 3D Artist
Intel RealSense Game Studio, Jerusalem Israel
All rights reserved to Intel RealSense Game Studios / Perceptual Computing / 2015
Software.intel.com/RealSense
All rights reserved to Intel RealSense Game Studios / Perceptual Computing / 2015

ToyZ: Augmented Reality Open World Game

  • 1.
    All rights reservedto Intel RealSense Game Studios / Perceptual Computing / 2015 Intel RealSense Scene Perception demo “Mommy, can I play in the kitchen pleeeeaaase?”
  • 2.
    All rights reservedto Intel RealSense Game Studios / Perceptual Computing / 2015 3-toys-in-1
  • 3.
    All rights reservedto Intel RealSense Game Studios / Perceptual Computing / 2015 Real time mesh reconstruction
  • 4.
    All rights reservedto Intel RealSense Game Studios / Perceptual Computing / 2015 Real time mesh reconstruction
  • 5.
    All rights reservedto Intel RealSense Game Studios / Perceptual Computing / 2015 Real time mesh reconstruction
  • 6.
    All rights reservedto Intel RealSense Game Studios / Perceptual Computing / 2015 Real time mesh reconstruction
  • 7.
    All rights reservedto Intel RealSense Game Studios / Perceptual Computing / 2015 Real time mesh reconstruction
  • 8.
    All rights reservedto Intel RealSense Game Studios / Perceptual Computing / 2015 Real time scanning and tracking
  • 9.
    All rights reservedto Intel RealSense Game Studios / Perceptual Computing / 2015 Real time scanning and tracking
  • 10.
    All rights reservedto Intel RealSense Game Studios / Perceptual Computing / 2015 Real time scanning and tracking
  • 11.
    All rights reservedto Intel RealSense Game Studios / Perceptual Computing / 2015 Interaction with reconstructed mesh
  • 12.
    All rights reservedto Intel RealSense Game Studios / Perceptual Computing / 2015 Occlusion of virtual by real elements
  • 13.
    All rights reservedto Intel RealSense Game Studios / Perceptual Computing / 2015 Occlusion of virtual by real elements
  • 14.
    All rights reservedto Intel RealSense Game Studios / Perceptual Computing / 2015 Fun to play
  • 15.
    All rights reservedto Intel RealSense Game Studios / Perceptual Computing / 2015 Fun to play
  • 16.
    All rights reservedto Intel RealSense Game Studios / Perceptual Computing / 2015 Fun to play
  • 17.
    All rights reservedto Intel RealSense Game Studios / Perceptual Computing / 2015 Fun to play
  • 18.
    All rights reservedto Intel RealSense Game Studios / Perceptual Computing / 2015 18 Eli Elhadad, General Manager Amir Rosenberger, Developer Yinon Oshrat, Developer Omer Goshen, Developer Hagit Schechter, Developer Yaron Yanai, Creative Manager Shachar Oz, UX & Game Design Bar Shulman, 3D Artist Edna Nuama, 3D Artist Intel RealSense Game Studio, Jerusalem Israel
  • 19.
    All rights reservedto Intel RealSense Game Studios / Perceptual Computing / 2015 Software.intel.com/RealSense
  • 20.
    All rights reservedto Intel RealSense Game Studios / Perceptual Computing / 2015

Editor's Notes

  • #2 Hi all Very happy to finally be here. Took me a few years to fly all this way, but I’m thrilled to be able to give back to the community that I was growing with in the past decade in the AR field.
  • #3  So, my name is Oz. I work for intel as a game designer and senior experience developer. Our game studio is responsible to create game demos that uses radical technologies, such as: gesture recognition, face expression, speech recognition, object recognition and room mapping. Toyz was born with the idea that we wanted the young player to continue to imagine the game, while we only assist and enhance that imagination. We wanted them to be moving freely in space. We knew that it has to be an open world environment. We tried to think about what could we do that would be better than just playing with one of their toys? So we thought- why don’t we give the player 3 toys in one app? Each toy with its uniqueness: robot shoots goo, plane flies from one place to another. We also added optional timed missions, in case the player wishes to engage a few seconds of a challenge.
  • #4 But I came here to show you the technology itself and not the game idea, haven’t i? As you can see, the robot feels the edges of the table it walks on. This is enabled due to our ability to create a 3D mesh from the environment we play at. We are turning the real environment into a virtual one, in real time and in less than a few seconds.
  • #5 Let see what the sensor sees
  • #6 It takes an environment, scans it, and turns it into this green virtual mesh, that the virtual elements can relate to.
  • #8 This technology allows us to scan any surface, any environment, any object. It has some limitations at the moment, but we are already working to improve them, and hopefully by the time it gets to the market, it will be significantly better.
  • #9 The environment is being continuously tracked and scanned in real time. If you go back to places you visited, it will already know that place. The tech constantly tries to improve the mesh it created. It fills holes and gaps when it understands they don’t exist.
  • #10 Heres an example: Take a look at the coins scattered around.
  • #11 Even though we came back with the robot to the same area, the coins remained in the exact same position.
  • #12 We are also able to interact with the real environment, because it is actually a virtual one. This allows us to have goo splashes stick on the exact surface of the cup.
  • #13 And we can easily face one of the most wanted features in the world of AR: virtual object can now hide behind real object (be occluded by it). This is given “for free”. Just because we have created a 3D environment.
  • #14 You can play in your sink, walk under bridges, hide behind staff
  • #15 We created missions that are fun to play, like blowing up zombies
  • #17 Passing through hoops
  • #18 Intel is no longer the best hardware company. We are now giving a battle for innovative solutions as well.
  • #19 These are the people who stand with me today on this stage, who tool part in the development of this game. We are a team of 9: artists and developers
  • #20 You are very welcome to check out the real sense software available out there
  • #21 And you are also welcome to visit our booth and play this game for yourself