AI ACCELERATES XR
Co-Founder & CEO
TERRY PROTO
www.linkedin.com/in/terryproto
Virtual Reality Marketing
© Vizualus. All Rights Reserved.
3
WhatisAI?
Artificial intelligence is a machine’s ability to perform the cognitive functions we usually associate
with human minds. Various kinds of AI - focused on solving a specific problem:
- Machine Learning - AI based on algorithms that are trained on data
- Generative AI - AI model that generates content in response to a prompt (ChatGPT or DALL-E)
- Artificial General Intelligence (AGI) - is still hypothetical and in the future
XR is the umbrella term that covers all the various forms of computer-altered reality:
Augmented Reality, Virtual Reality and Mixed Reality
Meanwhile, the Metaverse is the next generation of the internet - and a 5 trillion dollar opportunity
WhatisXR?
© Vizualus. All Rights Reserved.
5
RecentTechAdvancesarenotCompeting
Recent advancements in tech such as AI & XR have become disruptors in their domains
The media often pits these technologies against each other
But the reality is different - they are converging and mutually augmenting each other
The plane has not "killed" the car - they're complementary
HypeCycles&Sensationalism
The media is in pursuit of attention grabbing headlines
Journalists sometimes lack a deep understanding of these technologies and their applications
Avi Bar-Zeev has tracked the hype cycles of theses technologies in excellent AWE talk this year
© Vizualus. All Rights Reserved.
7
LearningfromthePast
Let's have a look back at the early 2000's
Online video, social media & mobile devices all became popular then
At the time it was believed those technologies would compete
Instead when combined, they gave birth to new applications like Youtube, Instagram or TikTok
© Vizualus. All Rights Reserved.
8
Convergence&Augmentation
Similar dynamics are at play in the convergence of XR & AI
Rather than competing, these technologies are amplifying and enhancing each other's capabilities
Example: Maya AI tools launched @Siggraph 2023 (textures, materials & HDR images)
KeyUseCasesofAIvsXR
AI Content Creation
3D Spatial Capture
& Computer Vision
Virtual Production
AI-Powered
Digital Humans
Real-time translation
& communication
© Vizualus. All Rights Reserved.
10
AIContentCreation-Today'sGenerativeAI
Generative AI Interfaces based on GPT (Generative Pre-Trained Transformer) algorithms
Those models use massive datasets and scrape the internet for data
Can be used for search, text, images, audio, video, conversation..
Examples: ChatGPT, DALL-E, Midjourney, Synthesia, HawkEye
© Vizualus. All Rights Reserved.
11
AIContentCreation-Tomorrow:Full3DWorlds
AI generated images and videos are possible today
But AI generated 3D worlds still remains in the near future
A lof of investments are made in that directions - see example Blockade Labs
3D worlds are extremely resource intensive to build - potentially unlocks massive efficiency gains
© Vizualus. All Rights Reserved.
12
3DSpatialCapture&ComputerVision
NeRFs or Neural Radiance Fields uses computer vision from a regular camera…
…to translate it in volumetric 3D renders that can be viewed in a 3D space or object
AI takes the information and fills the blanks to create a believable version of that space
In simple terms, it's now possible to wave you phone and get a 3D volumetric capture
© Vizualus. All Rights Reserved.
13
VirtualProduction
AI can streamline and enhance the virtual production process by automating tasks like:
scene generation, object placement, and lighting adjustments
AI-driven algorithms can analyze scripts and generate realistic virtual environments
All of it reducing the time and effort required for pre-production
© Vizualus. All Rights Reserved.
14
AI-PoweredDigitalHumans
Digital Humans are realistic characters created by tools like MetaHuman (Unreal) or Ziva (Unity)
Conversational AI like ChatGPT can enhance the behavior of those characters VR environments
These digital humans can enable more immersive social interactions and training simulations
© Vizualus. All Rights Reserved.
Real-TimeTranslation&Communication
AI can facilitate real-time translation of spoken language in immersive environments
Enabling seamless communication between users who speak different languages
This can be particularly useful for collaborative activities and social interactions
Examples: Google, Meta Labs
© Vizualus. All Rights Reserved.
16
AntlerGenerativeAILandscape
Antler has created the Gen-AI report
The first comprehensive Generative AI market map available to everyone
Can be viewed at https://www.antler.co/blog/generative-ai
© Vizualus. All Rights Reserved.
Conclusion-AnExponentialFuture
XR and AI re not competitors but rather collaborators pushing the boundaries of what is possible
Just as the car and the plane coexist, these technologies complement and augment each other
As Ori Inbar aptly stated at AWE 2023, "AI accelerates XR"
Co-Founder & CEO
TERRY PROTO
www.linkedin.com/in/terryproto
Virtual Reality Marketing
QA

Terry Proto - AI Accelerates XR.pdf

  • 1.
  • 2.
    Co-Founder & CEO TERRYPROTO www.linkedin.com/in/terryproto Virtual Reality Marketing
  • 3.
    © Vizualus. AllRights Reserved. 3 WhatisAI? Artificial intelligence is a machine’s ability to perform the cognitive functions we usually associate with human minds. Various kinds of AI - focused on solving a specific problem: - Machine Learning - AI based on algorithms that are trained on data - Generative AI - AI model that generates content in response to a prompt (ChatGPT or DALL-E) - Artificial General Intelligence (AGI) - is still hypothetical and in the future
  • 4.
    XR is theumbrella term that covers all the various forms of computer-altered reality: Augmented Reality, Virtual Reality and Mixed Reality Meanwhile, the Metaverse is the next generation of the internet - and a 5 trillion dollar opportunity WhatisXR?
  • 5.
    © Vizualus. AllRights Reserved. 5 RecentTechAdvancesarenotCompeting Recent advancements in tech such as AI & XR have become disruptors in their domains The media often pits these technologies against each other But the reality is different - they are converging and mutually augmenting each other The plane has not "killed" the car - they're complementary
  • 6.
    HypeCycles&Sensationalism The media isin pursuit of attention grabbing headlines Journalists sometimes lack a deep understanding of these technologies and their applications Avi Bar-Zeev has tracked the hype cycles of theses technologies in excellent AWE talk this year
  • 7.
    © Vizualus. AllRights Reserved. 7 LearningfromthePast Let's have a look back at the early 2000's Online video, social media & mobile devices all became popular then At the time it was believed those technologies would compete Instead when combined, they gave birth to new applications like Youtube, Instagram or TikTok
  • 8.
    © Vizualus. AllRights Reserved. 8 Convergence&Augmentation Similar dynamics are at play in the convergence of XR & AI Rather than competing, these technologies are amplifying and enhancing each other's capabilities Example: Maya AI tools launched @Siggraph 2023 (textures, materials & HDR images)
  • 9.
    KeyUseCasesofAIvsXR AI Content Creation 3DSpatial Capture & Computer Vision Virtual Production AI-Powered Digital Humans Real-time translation & communication
  • 10.
    © Vizualus. AllRights Reserved. 10 AIContentCreation-Today'sGenerativeAI Generative AI Interfaces based on GPT (Generative Pre-Trained Transformer) algorithms Those models use massive datasets and scrape the internet for data Can be used for search, text, images, audio, video, conversation.. Examples: ChatGPT, DALL-E, Midjourney, Synthesia, HawkEye
  • 11.
    © Vizualus. AllRights Reserved. 11 AIContentCreation-Tomorrow:Full3DWorlds AI generated images and videos are possible today But AI generated 3D worlds still remains in the near future A lof of investments are made in that directions - see example Blockade Labs 3D worlds are extremely resource intensive to build - potentially unlocks massive efficiency gains
  • 12.
    © Vizualus. AllRights Reserved. 12 3DSpatialCapture&ComputerVision NeRFs or Neural Radiance Fields uses computer vision from a regular camera… …to translate it in volumetric 3D renders that can be viewed in a 3D space or object AI takes the information and fills the blanks to create a believable version of that space In simple terms, it's now possible to wave you phone and get a 3D volumetric capture
  • 13.
    © Vizualus. AllRights Reserved. 13 VirtualProduction AI can streamline and enhance the virtual production process by automating tasks like: scene generation, object placement, and lighting adjustments AI-driven algorithms can analyze scripts and generate realistic virtual environments All of it reducing the time and effort required for pre-production
  • 14.
    © Vizualus. AllRights Reserved. 14 AI-PoweredDigitalHumans Digital Humans are realistic characters created by tools like MetaHuman (Unreal) or Ziva (Unity) Conversational AI like ChatGPT can enhance the behavior of those characters VR environments These digital humans can enable more immersive social interactions and training simulations
  • 15.
    © Vizualus. AllRights Reserved. Real-TimeTranslation&Communication AI can facilitate real-time translation of spoken language in immersive environments Enabling seamless communication between users who speak different languages This can be particularly useful for collaborative activities and social interactions Examples: Google, Meta Labs
  • 16.
    © Vizualus. AllRights Reserved. 16 AntlerGenerativeAILandscape Antler has created the Gen-AI report The first comprehensive Generative AI market map available to everyone Can be viewed at https://www.antler.co/blog/generative-ai
  • 17.
    © Vizualus. AllRights Reserved. Conclusion-AnExponentialFuture XR and AI re not competitors but rather collaborators pushing the boundaries of what is possible Just as the car and the plane coexist, these technologies complement and augment each other As Ori Inbar aptly stated at AWE 2023, "AI accelerates XR"
  • 18.
    Co-Founder & CEO TERRYPROTO www.linkedin.com/in/terryproto Virtual Reality Marketing
  • 19.