AR Glasses with Gaze-locked projection
•
1 like•152 views
Highly Efficient Immersive AR Glasses with Gaze-locked Exit Pupil Steering high level architecture and technology explanation given by Boris Greenberg at SPIE 2021
More Related Content
What's hot
What's hot (20)
Similar to AR Glasses with Gaze-locked projection
Similar to AR Glasses with Gaze-locked projection (20)
Recently uploaded
Recently uploaded (20)
AR Glasses with Gaze-locked projection
- 1. 1 Highly Efficient Immersive AR Glasses Using Gaze-locked Exit Pupil Steering By Boris Greenberg
- 2. 2 the AR experience Immersive Practical we all know this
- 3. 3 AR everywhere there are dozens of gen II devices including Magic Leap, Hololens II and others. they show massive advancements but still lacking:
- 4. 4 today many of these are believed to be MUTUALLY EXCLUSIVE
- 5. 5 system approach • forget everything about common AR architecture • to overcome these challenges, EyeWay has taken a completely different approach: • there are no screens • follow the physiology of the eye • track eye behavior
- 6. 6 Classical vs. EyeWay architecture Moving small exit pupil Projection follows the eye- movement directing emitted light into the pupil EyeWay approach Fixed large exit pupil Excess light always flooding the Eye regardless of pupil position Classical approach
- 7. 7 • Eye-tracking Accurate, high-speed eye-tracking using IR lasers that directs the projection according to the users’ gaze • Exit pupil shifter A dynamic system that can move the exit pupil or the optical system to maintain collinearity with the visual axis and overlap with the eye pupil • Direct retinal projection Low-power lasers project a single pixel at a time directly onto the users' retina without the use of screens or other intermediary images, at any level of brightness and contrast. An image is projected at the eye’s natural resolution only where it is needed at the center of the field of view - foveation EyeWay combined approach Exit pupil shifter
- 9. 9 Eyetracking EyeWay's system utilizes infrared light scattered from the retina (which back illuminates the pupil), and the reflection from the cornea. This method allows EyeWay to track gaze direction by following the optical axis of the eye.
- 10. 10 Eyeway Projects an image DIRECTLY on the retina and MOVES IT according to the eye’s movements Tapping into the Human-Vision
- 11. 11 Fovea the eye
- 12. 12 Foveation The EyeWay system takes advantage of the eye's natural peripheral and foveal vision and addresses these areas separately. When projected into the fovea at 1 pixel per arcmin (or 60 pixels/degree), the eye will perceive a pixel-less, "natural resolution" image. Using this method of projecting 2 SVGA images per eye, the EyeWay system achieves the equivalence of 5K projectors per eye and is thus 40 times more efficient.
- 13. 13 13
- 14. 14 Projection system Artist rendition 14 • The system move exit pupil in 4 degrees of freedom • Result: Small exit pupil constantly moved to follow an eye Patents: “Eye Projection System” - US10042161 “Image Projection System” - US10623707
- 15. 15 General system schematic 15 Sharing same optical path When MEMS move to correct the tracking: it also moves the projected image accordingly! Patents: “Image Projection System” - WO2018220608A1 “MEMS based light deflecting device and method” - WO2020212984
- 16. 16 EyeWay Best –of-class AR Natural eye resolution
- 17. 17 Vari-Focal EyeWay Best –of-class AR Virtual Content and User Focus ALWAYS MATCH Virtual Content and User Focus DONT MATCH
- 18. 18 Working in bright light EyeWay Best –of-class AR
- 19. 19 Technology summary • Image is super-bright indoors and even outdoors • Ultra-wide perceived FOV • The virtual objects’-focus matches real objects in the room • Pixelization-free image that matches the eye resolution • ‘Hard-AR’ - non-ghost-like virtual images • Power Efficiency – one-pixel-at-a-time
- 20. 20 2014 2020 12 - 24 Months Project Product Core Direct Retinal Projection Eye Tracking Hard AR Work Outside Eye Resolution Color Gamut On Axis Laser Based Ultra Fast First Moving Eye Box AR First adjustable Graphical Pipeline First Dynamic FOV First Fully- Immersive AR First Gaze Based Projection Pixel Flow Innovation Matrix First Gaze Based Vergence Accommodation Now
- 21. 21 2021 Combined system Lots of perception finetuning work to be done…