Paul Debevec Slides: LightFields VR+AI Frontiers Workshop SIGGRAPH Asia 17 Nov 2019

1. Welcome to Light Fields
SIGGRAPH SAsia 2019 Workshop on
Frontiers in VR and AI
11/18/2019
Paul Debevec / Google AR/VR /
www.debevec.org 1
Welcome to Light FieldsWelcome to Light Fields
debevec@gmail.com www.debevec.org 17 Nov 2019debevec@gmail.com www.debevec.org 17 Nov 2019
Paul Debevec, Google AR/VRPaul Debevec, Google AR/VR
Lenovo Mirage Solo
with Daydream
6 Degrees-of-
Freedom (6DOF)
Tracking
Oculus Quest

2. Welcome to Light Fields
SIGGRAPH SAsia 2019 Workshop on
Frontiers in VR and AI
11/18/2019
Paul Debevec / Google AR/VR /
www.debevec.org 2
Yi Halo (2017)Yi Halo (2017)GoPro Odyssey (2015)GoPro Odyssey (2015)
18 x 7 fisheye cylindrical/spherical camera array
(>1Gpixel/frame at 4K each camera)
light field video playback with
panoramic stereo and full parallax
(from Stanford SCIEN Workshop on Light Field Imaging, 2/12/2015)

3. Welcome to Light Fields
SIGGRAPH SAsia 2019 Workshop on
Frontiers in VR and AI
11/18/2019
Paul Debevec / Google AR/VR /
www.debevec.org 3
Welcome to Light Fields – Overbeck et al. SIGGRAPH 2018Welcome to Light Fields – Overbeck et al. SIGGRAPH 2018
JUMP Odyssey 360 Stereo
Camera
Jump: Virtual Reality Video
Anderson et al, SIGGRAPH
Asia 2016

4. Welcome to Light Fields
SIGGRAPH SAsia 2019 Workshop on
Frontiers in VR and AI
11/18/2019
Paul Debevec / Google AR/VR /
www.debevec.org 4
SIGGRAPH 2018
Portable + Easy to Set Up
Fits in single protected case
Assembles in 10 minutes (video @30x speed)

5. Welcome to Light Fields
SIGGRAPH SAsia 2019 Workshop on
Frontiers in VR and AI
11/18/2019
Paul Debevec / Google AR/VR /
www.debevec.org 5
SIGGRAPH Asia 2018
SIGGRAPH 2018
Calibration
Generates a position
and orientation, and
lens information for
each image in the
capture.

6. Welcome to Light Fields
SIGGRAPH SAsia 2019 Workshop on
Frontiers in VR and AI
11/18/2019
Paul Debevec / Google AR/VR /
www.debevec.org 6
SIGGRAPH 2018
SIGGRAPH 2018

7. Welcome to Light Fields
SIGGRAPH SAsia 2019 Workshop on
Frontiers in VR and AI
11/18/2019
Paul Debevec / Google AR/VR /
www.debevec.org 7
SIGGRAPH 2018

8. Welcome to Light Fields
SIGGRAPH SAsia 2019 Workshop on
Frontiers in VR and AI
11/18/2019
Paul Debevec / Google AR/VR /
www.debevec.org 8
SIGGRAPH 2018

9. Welcome to Light Fields
SIGGRAPH SAsia 2019 Workshop on
Frontiers in VR and AI
11/18/2019
Paul Debevec / Google AR/VR /
www.debevec.org 9
SIGGRAPH Asia 2018
SIGGRAPH Asia 2018

10. Welcome to Light Fields
SIGGRAPH SAsia 2019 Workshop on
Frontiers in VR and AI
11/18/2019
Paul Debevec / Google AR/VR /
www.debevec.org 10
Welcome to Light Fields on SteamVR (VIVE, Rift, Windows MxR)
VR@50 Light Fields SIGGRAPH 2018VR@50 Light Fields SIGGRAPH 2018

11. Welcome to Light Fields
SIGGRAPH SAsia 2019 Workshop on
Frontiers in VR and AI
11/18/2019
Paul Debevec / Google AR/VR /
www.debevec.org 11
GoPro “Iliad” Rig

12. Welcome to Light Fields
SIGGRAPH SAsia 2019 Workshop on
Frontiers in VR and AI
11/18/2019
Paul Debevec / Google AR/VR /
www.debevec.org 12

13. Welcome to Light Fields
SIGGRAPH SAsia 2019 Workshop on
Frontiers in VR and AI
11/18/2019
Paul Debevec / Google AR/VR /
www.debevec.org 13
SIGGRAPH 2018
SIGGRAPH 2018

14. Welcome to Light Fields
SIGGRAPH SAsia 2019 Workshop on
Frontiers in VR and AI
11/18/2019
Paul Debevec / Google AR/VR /
www.debevec.org 14
SIGGRAPH 2018
Google Artist in Residence / Alexa MeadeGoogle Artist in Residence / Alexa Meade

15. Welcome to Light Fields
SIGGRAPH SAsia 2019 Workshop on
Frontiers in VR and AI
11/18/2019
Paul Debevec / Google AR/VR /
www.debevec.org 15

16. Welcome to Light Fields
SIGGRAPH SAsia 2019 Workshop on
Frontiers in VR and AI
11/18/2019
Paul Debevec / Google AR/VR /
www.debevec.org 16
Broxton et al. “A Low Cost Multi-Camera Array for Panoramic Light Field Video
Capture”. SIGGRAPH Asia 2019 Posters
Broxton et al. “A Low Cost Multi-Camera Array for Panoramic Light Field Video
Capture”. SIGGRAPH Asia 2019 Posters

17. Welcome to Light Fields
SIGGRAPH SAsia 2019 Workshop on
Frontiers in VR and AI
11/18/2019
Paul Debevec / Google AR/VR /
www.debevec.org 17

18. Welcome to Light Fields
SIGGRAPH SAsia 2019 Workshop on
Frontiers in VR and AI
11/18/2019
Paul Debevec / Google AR/VR /
www.debevec.org 18

19. Welcome to Light Fields
SIGGRAPH SAsia 2019 Workshop on
Frontiers in VR and AI
11/18/2019
Paul Debevec / Google AR/VR /
www.debevec.org 19
Guo et al. The Reliightables. SIGGRAPH Asia 2019Guo et al. The Reliightables. SIGGRAPH Asia 2019
 Collaborators: Ryan Overbeck, Daniel Erickson, Dan Evangelakos, Greg Downing, John
Flynn, Graham Fyffe, Michael Broxton, Alex Ma, Matthew DuVall, Jason Dourgarian, Jay
Busch, Kaiwen Guo, Peter Lincoln, Philip Davidson, Jay Busch, Xueming Yu, Matt
Whalen, Geoff Harvey, Sergio Orts-Escolano, Rohit Pandey, Jason Dourgarian, Danhang
Tang, Anastasia Tkach, Adarsh Kowdle, Emily Cooper, Mingsong Dou, Sean Fanello,
Graham Fyffe, Christoph Rhemann, Jonathan Taylor, Shahram Izadi
 Thanks: Clay Bavor, Shahram Izadi, Steve Seitz, Peter Denny, Kathryn Knox, Andy
Maltz, Joe DiGennarro
 Research Sponsors: Google, US Army RDECOM, USC Office of the Provost
 Special Thanks: Joaquim Jorge, Mashhuda Glencross
 Collaborators: Ryan Overbeck, Daniel Erickson, Dan Evangelakos, Greg Downing, John
Flynn, Graham Fyffe, Michael Broxton, Alex Ma, Matthew DuVall, Jason Dourgarian, Jay
Busch, Kaiwen Guo, Peter Lincoln, Philip Davidson, Jay Busch, Xueming Yu, Matt
Whalen, Geoff Harvey, Sergio Orts-Escolano, Rohit Pandey, Jason Dourgarian, Danhang
Tang, Anastasia Tkach, Adarsh Kowdle, Emily Cooper, Mingsong Dou, Sean Fanello,
Graham Fyffe, Christoph Rhemann, Jonathan Taylor, Shahram Izadi
 Thanks: Clay Bavor, Shahram Izadi, Steve Seitz, Peter Denny, Kathryn Knox, Andy
Maltz, Joe DiGennarro
 Research Sponsors: Google, US Army RDECOM, USC Office of the Provost
 Special Thanks: Joaquim Jorge, Mashhuda Glencross
vr.google.com www.debevec.org paul@debevec.org
Thank You!Thank You!