Philipp Nagele (Wikitude): Context Is for Kings: Putting Context in the Hands...AugmentedWorldExpo
A talk from the Develop Track at AWE USA 2018 - the World's #1 XR Conference & Expo in Santa Clara, California May 30- June 1, 2018.
Philipp Nagele (Wikitude): Context Is for Kings: Putting Context in the Hands of AR Developers
In this session, Philipp Nagele will explore why AR centers all around context and why contextual understanding is fundamental to any AR experience. He will show how Wikitude is trying to solve this problem for AR developers and provide technical details about the new release of the Wikitude SDK.
http://AugmentedWorldExpo.com
Philipp Nagele (Wikitude): Context Is for Kings: Putting Context in the Hands...AugmentedWorldExpo
A talk from the Develop Track at AWE USA 2018 - the World's #1 XR Conference & Expo in Santa Clara, California May 30- June 1, 2018.
Philipp Nagele (Wikitude): Context Is for Kings: Putting Context in the Hands of AR Developers
In this session, Philipp Nagele will explore why AR centers all around context and why contextual understanding is fundamental to any AR experience. He will show how Wikitude is trying to solve this problem for AR developers and provide technical details about the new release of the Wikitude SDK.
http://AugmentedWorldExpo.com
Building the Matrix: Your First VR App (SVCC 2016)Liv Erickson
The slides from my talk, Building The Matrix: Your First VR App at Silicon Valley Code Camp, Oct. 2016. Development, design, and sample projects for virtual reality applications.
Patrick O'Shaughnessey, Founder of Patched Reality Inc, gives an overview of AR SDK tutorial options, and tutorials using 4 of the most widely used SDK's in Unity 3D.
Codemotion Roma 2018 - Alessandro Pozone, Matteo Valoriani
If you think there's been a lot of talk about Augmented Reality and Virtual Reality this year, 2018 is going to blow you away. ARkit, ARCore, HoloLens, Magic Leap, Oculus and many others are working to transform our Reality with new products and services. Apple, Microsoft, Intel, Google and Facebook are approaching AR/VR from different perspectives and technologies: in this session we will try to understand how these different technologies can work together and create a shared multi device experience.
Immerge yourself in a new Reality - Alessandro Pozone - Codemotion Rome 2018Codemotion
If you think there's been a lot of talk about Augmented Reality and Virtual Reality this year, 2018 is going to blow you away. ARkit, ARCore, HoloLens, Magic Leap, Oculus and many others are working to transform our Reality with new products and services. Apple, Microsoft, Intel, Google and Facebook are approaching AR/VR from different perspectives and technologies: in this session we will try to understand how these different technologies can work together and create a shared multi device experience.
Unity XR platform has a new architecture – Unite Copenhagen 2019Unity Technologies
Unity developed a new architecture that improves the support for existing and future augmented reality (AR) and virtual reality (VR) platforms. Learn about the technology under the hood, the consequent benefits, and improvements to the platform, and how it impacts your workflows in creating AR/VR experiences.
Speakers: Mike Durand, Matt Fuad - Unity
Watch the session on Youtube: https://youtu.be/Stqk1GxlSK0
Augmented reality is a technology of blending the live view of the real world with the computer generated virtual worlds (digital graphics and sound). Today we can see that Augmented Reality is used in advertising, gaming, entertainment, robotics, military training, engineering, designing and in many other industries.
How ABB shapes the future of industry with Microsoft HoloLens and Unity - Uni...Unity Technologies
It's high time for augmented reality to be brought to a wider audience. In ABB, we know that it is not just a gimmick any more. However, with every innovative technology comes new challenges. In these slides, we show how to overcome them and deliver valuable products with Hololens and Unity.
Speakers:
Maciej Włodarczyk - ABB
Rafał Kielar - ABB
Watch the session on YouTube: https://youtu.be/QFsj8Pi_3Ho
PTC and Unity Announce Strategic Collaboration to Accelerate Augmented Realit...PTC
Vuforia AR Platform to be Integrated with Unity
LOS ANGELES. and NEEDHAM, Mass. – November 1, 2016 –– PTC (NASDAQ: PTC) and Unity Technologies today announced a collaboration to simplify augmented reality (AR) development. PTC and Unity will work together to integrate the Vuforia® AR platform with Unity in order to deliver a seamless development experience to Unity’s global ecosystem.
PTC Announces a Major New Release to Vuforia Augmented Reality PlatformPTC
Vuforia 7 Introduces Ground Plane Detection, Next-Generation Object Recognition
and Support for Apple’s ARKit and Google’s ARCore
NEEDHAM, Mass. – October 2, 2017 –– PTC (NASDAQ: PTC) today announced the upcoming release of the newest version of its award-winning Vuforia® platform for AR development, Vuforia 7. Vuforia 7 will introduce major advancements in the ability to attach digital content to more types of objects and environments, and a new capability for delivering enhanced AR experiences on a wide range of handheld devices.
Using synthetic data for computer vision model trainingUnity Technologies
During this webinar Unity’s computer vision team provides an overview of computer vision, walks through current real-world data workflows, and explains why companies are moving toward synthetically generated data as an alternate data source for model training.
Watch the webinar: https://resources.unity.com/ai-ml/cv-webinar-dec-2021
More Related Content
Similar to Augmenting reality: Bring digital objects into the real world
Building the Matrix: Your First VR App (SVCC 2016)Liv Erickson
The slides from my talk, Building The Matrix: Your First VR App at Silicon Valley Code Camp, Oct. 2016. Development, design, and sample projects for virtual reality applications.
Patrick O'Shaughnessey, Founder of Patched Reality Inc, gives an overview of AR SDK tutorial options, and tutorials using 4 of the most widely used SDK's in Unity 3D.
Codemotion Roma 2018 - Alessandro Pozone, Matteo Valoriani
If you think there's been a lot of talk about Augmented Reality and Virtual Reality this year, 2018 is going to blow you away. ARkit, ARCore, HoloLens, Magic Leap, Oculus and many others are working to transform our Reality with new products and services. Apple, Microsoft, Intel, Google and Facebook are approaching AR/VR from different perspectives and technologies: in this session we will try to understand how these different technologies can work together and create a shared multi device experience.
Immerge yourself in a new Reality - Alessandro Pozone - Codemotion Rome 2018Codemotion
If you think there's been a lot of talk about Augmented Reality and Virtual Reality this year, 2018 is going to blow you away. ARkit, ARCore, HoloLens, Magic Leap, Oculus and many others are working to transform our Reality with new products and services. Apple, Microsoft, Intel, Google and Facebook are approaching AR/VR from different perspectives and technologies: in this session we will try to understand how these different technologies can work together and create a shared multi device experience.
Unity XR platform has a new architecture – Unite Copenhagen 2019Unity Technologies
Unity developed a new architecture that improves the support for existing and future augmented reality (AR) and virtual reality (VR) platforms. Learn about the technology under the hood, the consequent benefits, and improvements to the platform, and how it impacts your workflows in creating AR/VR experiences.
Speakers: Mike Durand, Matt Fuad - Unity
Watch the session on Youtube: https://youtu.be/Stqk1GxlSK0
Augmented reality is a technology of blending the live view of the real world with the computer generated virtual worlds (digital graphics and sound). Today we can see that Augmented Reality is used in advertising, gaming, entertainment, robotics, military training, engineering, designing and in many other industries.
How ABB shapes the future of industry with Microsoft HoloLens and Unity - Uni...Unity Technologies
It's high time for augmented reality to be brought to a wider audience. In ABB, we know that it is not just a gimmick any more. However, with every innovative technology comes new challenges. In these slides, we show how to overcome them and deliver valuable products with Hololens and Unity.
Speakers:
Maciej Włodarczyk - ABB
Rafał Kielar - ABB
Watch the session on YouTube: https://youtu.be/QFsj8Pi_3Ho
PTC and Unity Announce Strategic Collaboration to Accelerate Augmented Realit...PTC
Vuforia AR Platform to be Integrated with Unity
LOS ANGELES. and NEEDHAM, Mass. – November 1, 2016 –– PTC (NASDAQ: PTC) and Unity Technologies today announced a collaboration to simplify augmented reality (AR) development. PTC and Unity will work together to integrate the Vuforia® AR platform with Unity in order to deliver a seamless development experience to Unity’s global ecosystem.
PTC Announces a Major New Release to Vuforia Augmented Reality PlatformPTC
Vuforia 7 Introduces Ground Plane Detection, Next-Generation Object Recognition
and Support for Apple’s ARKit and Google’s ARCore
NEEDHAM, Mass. – October 2, 2017 –– PTC (NASDAQ: PTC) today announced the upcoming release of the newest version of its award-winning Vuforia® platform for AR development, Vuforia 7. Vuforia 7 will introduce major advancements in the ability to attach digital content to more types of objects and environments, and a new capability for delivering enhanced AR experiences on a wide range of handheld devices.
Using synthetic data for computer vision model trainingUnity Technologies
During this webinar Unity’s computer vision team provides an overview of computer vision, walks through current real-world data workflows, and explains why companies are moving toward synthetically generated data as an alternate data source for model training.
Watch the webinar: https://resources.unity.com/ai-ml/cv-webinar-dec-2021
The Tipping Point: How Virtual Experiences Are Transforming Global IndustriesUnity Technologies
When it comes to emerging technology, Forrester found that “94% of those who have implemented real-time 3D are expanding their investment.”
Wonder why? Learn more in this webinar featuring guest speaker Paul Miller, a principal analyst at Forrester. He covers the key findings of a commissioned study conducted by Forrester Consulting on behalf of Unity, published in March 2020.
Learn more: https://on.unity.com/2Yz49kg
Watch the webinar: https://on.unity.com/3aYGlsF
Take a peek at the slide from the second installment of our 2020 roadmap: Live Games.
Watch the presentation on YouTube: https://www.youtube.com/watch?v=w6sn8bJiZ2g
Got questions about the roadmap? Check out the Q&A over on the Unity forum: https://on.unity.com/2wV3SwD
Take a peek at the slide from the first installment of our 2020 roadmap: Core Engine & Creator Tools.
Watch the presentation (hosted by Will Goldstone, Product Manager) on YouTube: https://www.youtube.com/watch?v=dDjsS4NPqFU
Got questions about the roadmap? Check out the Q&A over on the Unity forum: https://on.unity.com/CreateRoadmapQA
Autodesk and Unity announced a collaboration last year to streamline workflows and enable seamless development across the AEC design, build and operate lifecycles. This fall, Unity Reflect launches, giving designers, architects, and engineers the ability to seamlessly federate their Revit models for real-time 3D.
Andrew Sullivan - Digital Delivery Manager, SHoP Architects will provide an overview of how they are using the product to enable real-time decision making, reduce the time between revisions and meetings, and ultimately improve design review and construction planning processes.
Recording available here: https://youtu.be/qe0yxHA0fHI
How Daimler uses mobile mixed realities for training and sales - Unite Copenh...Unity Technologies
Daimler Protics implemented mixed and augmented reality on mobile devices and used the Microsoft HoloLens for automotive production, training, and marketing. Discover the challenges Daimler Protics faced and the Unity solutions that eased the mixed reality implementation.
Speakers:
Daniel Keßelheim - Daimler Protics
Sebastian Rigling - Daimler Protics
Session available here: https://youtu.be/fTc1c8iTGqU
How Volvo embraced real-time 3D and shook up the auto industry- Unite Copenha...Unity Technologies
Hear from Volvo's lead Unity developer, Timmy Ghiurau, about how he broke new ground by bringing technology forged in gaming into one of the leading brands in the automotive industry. Timmy will share how he used his gaming background to inspire people across his large organization to adopt Unity and embrace real-time 3D as a way of working.
Timmy Ghiurau - Volvo
Session available here: https://youtu.be/CD4Go3Uv5Uc
QA your code: The new Unity Test Framework – Unite Copenhagen 2019Unity Technologies
Are you involved in testing or QA on projects in Unity? In these slides, you'll get an overview of the state of Unity for all things testing-related, and have the opportunity to share your stories of success, failure, pain, and glory. Learn from your fellow developers and give feedback on how Unity could help you hold your projects to a higher standard of quality. You will also get an introduction to the newest features in the Test Framework.
Speakers:
Christian Warnecke - Unity
Richard Fine - Unity
Watch the session on YouTube: https://youtu.be/wTiF2D0_vKA
Engineering.com webinar: Real-time 3D and digital twins: The power of a virtu...Unity Technologies
From buildings and infrastructure to industrial machinery and factories, digital twins are becoming integral across the industrial sector. In this webinar, first shown on Engineering.com, leaders from Unity and Unit040, provider of digital twin platform Prespective, share how digital twins add value at all stages of the project and product lifecycle, from the early stages of design to predictive maintenance using IoT data.
Watch the webinar here: create.unity3d.com/real-time-3d-and-digital-twins
Supplying scalable VR training applications with Innoactive - Unite Copenhage...Unity Technologies
Major automotive brands like Volkswagen are leveraging the power of virtual reality to create immersive training programs that can be delivered across multiple global locations at the same time. Learn how to scale the production and distribution of real-time VR training in enterprise.
Speakers:
Thomas Wimmer - Innoactive
Andreea Raducan - Innoactive
Watch the session on YouTube: https://youtu.be/5DNFUTfyOEc
XR and real-time 3D in automotive digital marketing strategies | Visionaries ...Unity Technologies
Augmented reality (AR), virtual reality (VR), and mixed reality (MR) – collectively known as XR – are making inroads in the automotive industry. Join this session led by Visionaries 777, which works with major auto brands like INFINITI, to learn about the range of immersive experiences you can build with Unity to create a better customer experience that results in more engagement and sales.
Speakers:
David Castañeda - Visionaries 777
Frantz Lasorne - Visionaries 777
Session available here: https://youtu.be/WJpeWHGXyms
Real-time CG animation in Unity: unpacking the Sherman project - Unite Copenh...Unity Technologies
Get a complete walkthrough of the end-to-end animation workflow of the Sherman project. Learn how to use Unity for creating CG animation and take a deep dive into the real-time fur system in Unity.
Speaker:
Mike Wuetherick - Unity
Watch the session on YouTube: https://youtu.be/fFfWxErJMkY
Creating next-gen VR and MR experiences using Varjo VR-1 and XR-1 - Unite Cop...Unity Technologies
The developers of Varjo VR-1 learned a lot about human eye resolution and the demands it puts on virtual reality (VR) content. In these slides, you'll explore what next-generation VR can mean for your VR experiences. Learn about what matters the most when it comes to visual quality, the possible caveats, and the role performance requirements play in this equation.
Speaker:
Mikko Strandborg - Varjo
What's ahead for film and animation with Unity 2020 - Unite Copenhagen 2019Unity Technologies
Unity is enabling film and animation studios to revolutionize their pipelines with features developed specifically to empower storytellers who are creating linear and interactive content. Learn more about features such as Python, Shotgun, the Arbitrary Output Variables (AOV) used in Recorder for export, Alembic, and Universal Scene Description (USD).
Speaker:
Mathieu Muller - Unity
Watch the session on YouTube: https://youtu.be/wrc3R-BoDGs
How to Improve Visual Rendering Quality in VR - Unite Copenhagen 2019Unity Technologies
VR allows for an entirely new level of immersion, leading to more thrilling and engaging content to be delivered and is growing rapidly. Despite this, VR, especially on mobile, currently contains a number of limitations, which can make it an unrealistic, unconvincing and, sometimes, an uncomfortable experience. Virtual reality (VR) is a new way to deliver thrilling and engaging content and allows for a deep level of immersion. Despite this, VR, especially on mobile, currently has several limitations, which can make it an unrealistic, unconvincing and, sometimes, an uncomfortable experience. To achieve the true potential of VR, these limitations must be either solved or mitigated. Ways of mitigating these limitations include optimal alpha compositing approaches, texture filtering techniques and bump mapping methods for use with VR content. In these slides, technology company Arm will outline how to improve the rendering quality of your VR content, describing the most common pitfalls and bad practices, before providing clear examples and mitigation solutions of how to best overcome them.
Speaker:
Ryan O'Shea - ARM
Digital twins: the power of a virtual visual copy - Unite Copenhagen 2019Unity Technologies
From buildings and infrastructure to industrial machinery and factories, digital twins are becoming integral revisualization tools across the industrial sector. Learn how Unit040, a company specializing in visualization and simulation, creates digital twins that combine real-time 3D technology with BIM, CAD and CAE systems to add value at all stages of the building and product lifecycle, from the early design phase to predictive maintenance using Internet of Things (IoT) data.
Speakers:
Pieter Weterings - Unit040
Guido van Gageldonk - Unit040
Watch the session on YouTube: https://youtu.be/j4i14p89h_s
Virtual or real? AR Foundation best practices from Krikey - Unite Copenhagen ...Unity Technologies
The AR Foundation toolkit has been critical for Krikey to build compelling AR games that function cross-platform, at scale. Krikey, an AR mobile gaming application, used dynamic ground plane detection and camera translation to enable users to play 3D games that interact with the real world. These slides cover some of the best practices Krikey developed while using AR Foundation.
Speakers:
Ketaki Shriram - Krikey
Jhanvi Shriram - Krikey
Watch the session on YouTube: https://youtu.be/5MKRuJEA1hI
Visualizing the engineering project lifecycle - Unite CopenhagenUnity Technologies
From design to operations, visualization is a powerful tool to drive informed decision-making on major projects. Point clouds, virtual reality and mobile apps are combining to enable better outcomes throughout the engineering industry. Join this session led by Aurecon to learn how Unity can empower engineers to increase efficiency and realize value through every stage of the project lifecycle.
Speaker: Michael Gardiner - Aurecon
Session available here: https://youtu.be/dixtTbGcCFg
Unity is embracing the concept of an "engineering engine" and building tools and workflows to help the AEC industry. Aurecon Group has been using Unity in engineering for 3 years now and has developed a philosophy around visualization in engineering. In this video, you'll see some of the firm's work and hear about things that work well and some things that don't work so well for lessons about engineering in real-time.
Speaker: Murray Walker – Aurecon
Session available here: https://youtu.be/GJ4e-NUZCoo
UiPath Test Automation using UiPath Test Suite series, part 4DianaGray10
Welcome to UiPath Test Automation using UiPath Test Suite series part 4. In this session, we will cover Test Manager overview along with SAP heatmap.
The UiPath Test Manager overview with SAP heatmap webinar offers a concise yet comprehensive exploration of the role of a Test Manager within SAP environments, coupled with the utilization of heatmaps for effective testing strategies.
Participants will gain insights into the responsibilities, challenges, and best practices associated with test management in SAP projects. Additionally, the webinar delves into the significance of heatmaps as a visual aid for identifying testing priorities, areas of risk, and resource allocation within SAP landscapes. Through this session, attendees can expect to enhance their understanding of test management principles while learning practical approaches to optimize testing processes in SAP environments using heatmap visualization techniques
What will you get from this session?
1. Insights into SAP testing best practices
2. Heatmap utilization for testing
3. Optimization of testing processes
4. Demo
Topics covered:
Execution from the test manager
Orchestrator execution result
Defect reporting
SAP heatmap example with demo
Speaker:
Deepak Rai, Automation Practice Lead, Boundaryless Group and UiPath MVP
Connector Corner: Automate dynamic content and events by pushing a buttonDianaGray10
Here is something new! In our next Connector Corner webinar, we will demonstrate how you can use a single workflow to:
Create a campaign using Mailchimp with merge tags/fields
Send an interactive Slack channel message (using buttons)
Have the message received by managers and peers along with a test email for review
But there’s more:
In a second workflow supporting the same use case, you’ll see:
Your campaign sent to target colleagues for approval
If the “Approve” button is clicked, a Jira/Zendesk ticket is created for the marketing design team
But—if the “Reject” button is pushed, colleagues will be alerted via Slack message
Join us to learn more about this new, human-in-the-loop capability, brought to you by Integration Service connectors.
And...
Speakers:
Akshay Agnihotri, Product Manager
Charlie Greenberg, Host
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...Jeffrey Haguewood
Sidekick Solutions uses Bonterra Impact Management (fka Social Solutions Apricot) and automation solutions to integrate data for business workflows.
We believe integration and automation are essential to user experience and the promise of efficient work through technology. Automation is the critical ingredient to realizing that full vision. We develop integration products and services for Bonterra Case Management software to support the deployment of automations for a variety of use cases.
This video focuses on the notifications, alerts, and approval requests using Slack for Bonterra Impact Management. The solutions covered in this webinar can also be deployed for Microsoft Teams.
Interested in deploying notification automations for Bonterra Impact Management? Contact us at sales@sidekicksolutionsllc.com to discuss next steps.
Accelerate your Kubernetes clusters with Varnish CachingThijs Feryn
A presentation about the usage and availability of Varnish on Kubernetes. This talk explores the capabilities of Varnish caching and shows how to use the Varnish Helm chart to deploy it to Kubernetes.
This presentation was delivered at K8SUG Singapore. See https://feryn.eu/presentations/accelerate-your-kubernetes-clusters-with-varnish-caching-k8sug-singapore-28-2024 for more details.
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...UiPathCommunity
💥 Speed, accuracy, and scaling – discover the superpowers of GenAI in action with UiPath Document Understanding and Communications Mining™:
See how to accelerate model training and optimize model performance with active learning
Learn about the latest enhancements to out-of-the-box document processing – with little to no training required
Get an exclusive demo of the new family of UiPath LLMs – GenAI models specialized for processing different types of documents and messages
This is a hands-on session specifically designed for automation developers and AI enthusiasts seeking to enhance their knowledge in leveraging the latest intelligent document processing capabilities offered by UiPath.
Speakers:
👨🏫 Andras Palfi, Senior Product Manager, UiPath
👩🏫 Lenka Dulovicova, Product Program Manager, UiPath
State of ICS and IoT Cyber Threat Landscape Report 2024 previewPrayukth K V
The IoT and OT threat landscape report has been prepared by the Threat Research Team at Sectrio using data from Sectrio, cyber threat intelligence farming facilities spread across over 85 cities around the world. In addition, Sectrio also runs AI-based advanced threat and payload engagement facilities that serve as sinks to attract and engage sophisticated threat actors, and newer malware including new variants and latent threats that are at an earlier stage of development.
The latest edition of the OT/ICS and IoT security Threat Landscape Report 2024 also covers:
State of global ICS asset and network exposure
Sectoral targets and attacks as well as the cost of ransom
Global APT activity, AI usage, actor and tactic profiles, and implications
Rise in volumes of AI-powered cyberattacks
Major cyber events in 2024
Malware and malicious payload trends
Cyberattack types and targets
Vulnerability exploit attempts on CVEs
Attacks on counties – USA
Expansion of bot farms – how, where, and why
In-depth analysis of the cyber threat landscape across North America, South America, Europe, APAC, and the Middle East
Why are attacks on smart factories rising?
Cyber risk predictions
Axis of attacks – Europe
Systemic attacks in the Middle East
Download the full report from here:
https://sectrio.com/resources/ot-threat-landscape-reports/sectrio-releases-ot-ics-and-iot-security-threat-landscape-report-2024/
Key Trends Shaping the Future of Infrastructure.pdfCheryl Hung
Keynote at DIGIT West Expo, Glasgow on 29 May 2024.
Cheryl Hung, ochery.com
Sr Director, Infrastructure Ecosystem, Arm.
The key trends across hardware, cloud and open-source; exploring how these areas are likely to mature and develop over the short and long-term, and then considering how organisations can position themselves to adapt and thrive.
Neuro-symbolic is not enough, we need neuro-*semantic*Frank van Harmelen
Neuro-symbolic (NeSy) AI is on the rise. However, simply machine learning on just any symbolic structure is not sufficient to really harvest the gains of NeSy. These will only be gained when the symbolic structures have an actual semantics. I give an operational definition of semantics as “predictable inference”.
All of this illustrated with link prediction over knowledge graphs, but the argument is general.
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
Augmenting reality: Bring digital objects into the real world
1. Augmenting reality: Bring digital
objects into the real world
The webinar will begin shortly
The webinar will begin at 8 am PT | 11 am ET | 4 pm BST
2. 2 0 2 2
C R E A T O R S E R I E S
Augmenting reality: Bring digital
objects into the real world
3. Vanesa Mendez
Creator Advocate
Meet your hosts
3
Road to the Metaverse
Ben Radcliffe
Senior Technical Specialist
@lightandalchemy
Jerome Maurey-Delaunay
Senior Technical Specialist
@jeromemaurey
Drew Domokos
Creator & Developer Advocate
4. 4
Road to the Metaverse -> Welcome to the metaverse: Your journey starts here
Agenda
Survey available here!
→ Introduction (5 minutes)
→ Augmenting Reality: Bring digital objects into the real world
(45 minutes)
‒ What is AR?
‒ AR platforms overview
‒ Getting started with AR Foundations in Unity!
→ Q&A + Wrap-up (10 minutes)
→ Overtime! (30 minutes)
‒ MRTK
‒ The Future of AR
10. What is XR?
Road to the Metaverse
What is XR? It's shorthand for a related set of new
technologies that are changing the way we interact with
the world and with each other: Virtual Reality, Augmented
Reality, and Mixed Reality.
● VR - Virtual Reality
● MR - Mixed Reality
● AR - Augmented Reality
● XR - Umbrella term for all the above
Unity Learn Intro to XR
10
12. What is XR? -> Demo 12
Let’s jump in!
What is AR?
13. PTC
Vuforia
Vuforia Demo 13
Download the SDK via the Asset Store
● Log in and select Add to my Assets Here
● Open a project in Unity
○ Navigate to Window -> Package Manager and select
Packages: My Assets
○ Select Vuforia Engine and Download, then Import
○ Now you can find Vuforia Engine AR into your
Packages
● Add ARCamera Gameobject from the Vuforia Engine menu
○ Select the ARCamera and click Open Vuforia
Configuration
○ Select Add License and add Get Basic ( You will have
to register), copy and paste the license key into App
License Key on the Inspector.
Getting Started with Vuforia
14. PTC
Vuforia
Set up a basic AR Scene - Image Target
● GameObject → Vuforia Engine -> Image Target
○ Select Image Target and choose Type : Database on the
Inspector and click Import
○ Download Robot Kyle from the Unity Asset Store here and
Import
○ Add your asset as a Child of the Image Tracker and Scale it
○ Select Image Target → Advanced → Device Tracker
Settings -> PlayMode -> Playmode Type → Webcam
○ Print or Download to a mobile device the Image Tracker
○ Focus your webcam into the Image Tracker and press Play
Features Overview
Vuforia Demo 14
15. PTC
Vuforia
Other Examples
● Complex Image Targets
● Virtual Buttons
● Model Targets
● And more…
Core Samples
Vuforia VFX Library
Vuforia Demo 15
18. What is XR? -> Hardware Platforms
a technology that superimposes a computer-generated
image on a user's view of the real world, thus providing a
composite view.
Handheld AR offers the most mainstream AR solutions
today on social media. People may not even realize that
the AR filters they use on Instagram are augmented reality
experiences.
● Google Android - AR Core
● Apple IOS - ARKit
Unity for AR
18
Augmented Reality - Handheld
19. What is XR? -> Hardware Platforms
Augmented Reality - Head-mounted
Augmented Reality HMDs also known as Optical
head-mounted displays or OHMDs. The displays of these
devices are transparent. They allow users to see through
them while projecting images and information in front of
the users' eyes.
● Microsoft Hololens
● Magic Leap
● Nreal
● Lenovo A3
Intro to Unity for Hololens
Intro Unity for Magic Leap
19
20. AR Fundamental Concepts
What is XR? -> Hardware Platforms 20
Light Estimation
Environmental Understanding
Motion Tracking
22. PTC
Vuforia
Getting started with XR in Unity → Toolkits
Vuforia Engine Package
SDK for mobile devices that enables the
creation of AR applications. Available on the
Unity Asset Store here
Vuforia Features:
● Image Tracking
● Model Tracking
● Area Tracking
● Ground Plane Detection
Resources
● Project Set Up
● Docs
22
23. Niantic Lightship ARDK
Create persistent and realistic experiences. ARDK’s
meshing feature translates the colors produced by
the user’s camera, runs them through a neural
network, and builds a mesh of tessellated triangles
that create a machine-readable representation of the
physical world.
website | video
Getting started with XR in Unity → Toolkits 23
24. Niantic Lightship ARDK
What is XR? -> Hardware Platforms
Lightship Augmented Reality Developer Kit (ARDK) is the first
product of the Niantic Lightship Platform. It is a cross-platform
development kit that brings world understanding technology—
depth, meshing, semantics—together with Lightship VPS and
multiplayer services for more realistic and diverse AR experiences
fused with the real world.
● Depth : Generate 3D depth information from a user’s
surroundings in real time, using just the device’s camera.
● Semantic Segmentation : Easily and automatically classify
objects, such as “ground” or “sky”, from the user’s camera
data.
● Meshing : Build a 3D mesh representation of objects in the
world, based on camera images.
● GameBoard : Enable smart object placement, procedural
gameplay, and character navigation.
● Shared AR : Users can use your app to locate and orient
themselves in the same AR space, and then use that shared
space to collaborate in virtual activities.
● Lightship VPS : Use Lightship VPS to create immersive
experiences in which your users interact with persistent,
shareable AR content at real-world locations. With Lightship
VPS you can place virtual objects that persist in the
real-world and can be found and shared by others.
24
25. Microsoft
Mixed Reality Toolkit
Getting started with XR in Unity → Toolkits
Microsoft MRTK3 is distributed as a set of
packages that are imported into Unity using
the Mixed Reality Feature Tool for Unity and
the Unity Package Manager (UPM).
Microsoft MRTK3 leverages the Unity XR
Subsystem Management infrastructure for
writing extensible modules that can help
provide cross-platform support for features
like speech and hand tracking.
Docs
Initial Setup for MRTK3
MRTK3 packages
Subsystems
MRTK2 to MRTK3 concept migration guide
25
26. Microsoft MRTK
What is XR? -> Hardware Platforms
Lightship Augmented Reality Developer Kit (ARDK) is the first
product of the Niantic Lightship Platform. It is a cross-platform
development kit that brings world understanding technology—
depth, meshing, semantics—together with Lightship VPS and
multiplayer services for more realistic and diverse AR experiences
fused with the real world.
● Input System
● Hand Tracking
● Eye Tracking
● UI Controls
● Solvers
● Spatial Awareness
● Speech & Dictation
26
27. Unity
AR Foundation
Getting started with XR in Unity → Toolkits
AR Foundation allows you to work with augmented reality
platforms in a multi-platform way within Unity.
This package presents an interface for Unity developers
to use, but doesn't implement any AR features itself. To
use AR Foundation on a target device, you also need
separate packages for the target platforms officially
supported by Unity:
ARCore XR Plug-in on Android
ARKit XR Plug-in on iOS
OpenXR Plug-in on HoloLens
Docs
27
28. AR Foundation Samples
What is XR? -> Demo 28
Download sample project via the github
● Get Project Here
● Clone or download this repository to a workspace on your drive
○ Click the ⤓ Code button on this page to get the URL to clone
with Git or click Download ZIP to get a copy of this repository
that you can extract
● Open a project in Unity
○ Download, install, and run Unity Hub
○ In the Installs tab, select Locate or Add to find or install Unity
2019.4 LTS or later
○ In the Projects tab, click Add
○ Browse to the VR folder within your downloaded copy of this
repository and click Select Folder
○ Click the project which should now be added to the list to
open the project
● To run the AR Foundation sample on a headset, go to File > Build
Settings and build the app. 1
Samples (v4.2)
Samples (v5)
Building for iOS
Building for Android
29. Getting started with XR in Unity → Demo 29
Let’s jump in!
AR Foundations Demo
Project Assets:
https://bit.ly/R2MV_XpressoAR_assets
31. Unity AR project template
What is XR? -> Hardware Platforms
Unity’s AR project template provides a starting point for
augmented reality development in Unity. The template
pre-installs the right packages needed for AR
development, and the Scene hierarchy is pre-configured
for AR.
Unity directly supports the following AR platforms:
● ARCore
● ARKit
● HoloLens
● Magic Leap
Documentation
31
32. AR Foundation Packages
What is XR? -> Hardware Platforms
Create rich, deeply engaging augmented reality
experiences with Unity’s AR Feature Set. The AR Feature
Set provides a starting point for augmented reality
development, spanning from head-mounted displays to
mobile.
● AR Foundation
● ARKit XR Plugin
● ARCore XR Plugin
● XR Plugin Management
32
33. AR Sample Scene
What is XR? -> Hardware Platforms
The template contains a Scene named SampleScene. This
scene contains sample materials and models. It
additionally contains all the tutorials, and a script that
allows you to spawn anchors through input.
You can use this Scene as a reference, or you can remove
the example Assets from it and use it as a starting point
for your own Project.
● AR Session
● AR Session Origin
Documentation
33
34. PlaceOnPlanes script
What is XR? -> Hardware Platforms
Listens for touch events and performs an AR raycast from
the screen touch point. AR raycasts will only hit detected
trackables like feature points and planes.
PlaceOnPlanes.cs
AR Foundation Samples
34
using System.Collections.Generic;
using UnityEngine;
using UnityEngine.XR.ARFoundation;
using UnityEngine.XR.ARSubsystems;
namespace UnityEngine.XR.ARFoundation.Samples
{
/// <summary>
/// Listens for touch events and performs an AR raycast from the screen touch point.
/// AR raycasts will only hit detected trackables like feature points and planes.
///
/// If a raycast hits a trackable, the <see cref="placedPrefab"/> is instantiated
/// and moved to the hit position.
/// </summary>
[RequireComponent(typeof(ARRaycastManager))]
public class PlaceOnPlane : MonoBehaviour
{
[SerializeField]
[Tooltip("Instantiates this prefab on a plane at the touch location.")]
GameObject m_PlacedPrefab;
/// <summary>
/// The prefab to instantiate on touch.
/// </summary>
public GameObject placedPrefab
{
get { return m_PlacedPrefab; }
set { m_PlacedPrefab = value; }
}
/// <summary>
/// The object instantiated as a result of a successful raycast intersection with a plane.
/// </summary>
public GameObject spawnedObject { get; private set; }
void Awake()
{
m_RaycastManager = GetComponent<ARRaycastManager>();
}
bool TryGetTouchPosition(out Vector2 touchPosition)
{
if (Input.touchCount > 0)
{
touchPosition = Input.GetTouch(0).position;
return true;
}
touchPosition = default;
return false;
}
void Update()
{
if (!TryGetTouchPosition(out Vector2 touchPosition))
return;
if (m_RaycastManager.Raycast(touchPosition, s_Hits, TrackableType.PlaneWithinPolygon))
{
// Raycast hits are sorted by distance, so the first one
// will be the closest hit.
var hitPose = s_Hits[0].pose;
if (spawnedObject == null)
{
spawnedObject = Instantiate(m_PlacedPrefab, hitPose.position, hitPose.rotation);
}
else
{
spawnedObject.transform.position = hitPose.position;
}
}
}
static List<ARRaycastHit> s_Hits = new List<ARRaycastHit>();
ARRaycastManager m_RaycastManager;
}
}
35. Build Settings
What is XR? -> Hardware Platforms
Unity can build your application for different platforms and
with different settings. This documentation describes how
to define the scenes, target platform, and settings for
your build.
● Android
● iOS
Build Settings Documentation
35
36. XR Plug-in Management
What is XR? -> Hardware Platforms
Support for XR hardware is delivered via plug-ins. Plug-ins
allow you to develop for a universal XR platform so you
don’t need to modify your project for different XR
headsets. Supporting new XR hardware is as easy as
adding the Plug-in Providers in Project Settings.
Currently, XR plug-ins are available for Oculus, Windows
Mixed Reality, and Magic Leap headsets. Also included is
the MockHMD plug-in, which allows for XR development
without a device. It’s possible to install multiple XR
plug-ins to support multiple headsets. In this scenario, the
application will look for the headset supported by the first
listed loader (covered later in this tutorial). If the headset
is not available, the application will search for the next in
the list, continuing through all listed loaders in order.
● ARCore
● ARKit
● Oculus
● OpenXR
● WindowMixedReality
36
37. Setting Up the Development
Environment for AR Applications
What is XR? -> Hardware Platforms
There are a few tools we must set up before developing
Unity applications for either iOS or Android devices. If
developing for iOS, this involves setting up Xcode (Apple’s
integrated development environment (IDE)) on your
development machine. Xcode is required to deploy our
Unity builds onto our iOS devices.
Unity Learn Tutorial
37
38. Universal Render Pipeline
What is XR? -> Hardware Platforms
AR Foundation supports the Universal Render Pipeline
(URP) versions 7.0.0 or later.
Note: Projects made using URP are not compatible with
the High Definition Render Pipeline or the built-in Unity
rendering pipeline. Before you start development, you
must decide which render pipeline to use in your Project.
Configuring AR Camera Background
38
39. Overtime → Preview 39
Hololens Demo!
Wind Turbine Simulation
-> Porting to Hololens
-> Adding speech using Microsoft Azure!
-> Creating a custom Visual Scripting node
40.
41. April
May
June
July
August
September
October
November
December
January
February
March
41
Road to the Metaverse
Welcome to the Metaverse!
Bring your digital and physical assets into Unity
Add interactivity to your immersive experience
How to bring your real-time 3D digital twin data into Unity
Let’s get real: An introduction to AR, VR, MR, XR and more
Augmenting reality (AR): Bring digital objects into the real world
Build immersive worlds in virtual reality (VR)
Improve learning retention with immersive training experiences
Build a Microsoft HoloLens experience for training in AR
Integrate cloud-based IoT data into your XR experience
Masterclass: Build a collaborative multi user experience
Build geolocated and social experiences in AR
Workshops
https://create.unity.com/road-to-metaverse
42. 42
Road to the Metaverse
Prototyping and world building.
Intro to Visual Scripting
Animation
Intro to Universal Render Pipeline
Intro to High Definition Render Pipeline
Shader Graph
VFX Graph
Post Processing
UI Building
Intro to VR
Intro to AR
Intro to Spatial Audio
Learn Live
https://learn.unity.com/project/road-to-the-metaverse-live
March
April
May
June
July
August
September
October
November
December
January
February
43. Road to the Metaverse 43
Executive series
https://create.unity.com/road-to-metaverse#executive
44. Road to the Metaverse 44
The Metaverse
Minute
https://blog.unity.com/topic/metaverse-minute
45. Road to the Metaverse 45
Road to the Metaverse:
Forums!
https://forum.unity.com/forums/road-to-the-metaverse.798/
46. Social
-> Please use #R2MV
46
Road to the Metaverse
Ben Radcliffe
@lightandalchemy
Jerome Maurey-Delaunay
@jeromemaurey
52. Mixed Reality Feature Tool
A purpose-designed user interface and expert tools to:
● Author complex, data-oriented apps
visually
● Test experiences without leaving the
Unity Editor
● Deliver apps with runtime logic that
adapt responsively to the real world
and work across platforms
52
Use Mixed Reality Feature Tool to discover,
update, and add Mixed Reality feature
packages into Unity projects.
You can search packages by name or
category, see their dependencies, and even
view proposed changes to your projects
manifest file before importing.
Download the latest version from the
Microsoft Download Center.
Overtime -> MRTK Demo
54. Project Setup
What is XR? -> Hardware Platforms
Build settings
● UWP
● ARM 64-bit
● Use Visual Studio 2019
○ Install build tools v142
● Build and run via Device Portal
Project settings
● Make sure to check the required capabilities under
Player -> Publish Settings
● Use .NET Framework for the latest features
● Make sure to install the Mixed Reality OpenXR
Plugin!
54
55. 55
Overtime -> MRTK Demo
Holographic Remoting
55
Stream holographic content to your HoloLens in real time, quickly test
and debug your app, without building and deploying a full project.
1. Download the Holographic Remoting app from the Windows Store
on your Hololens
2. Enable Holograhic Remoting for Play Mode in Project Setting → XR
Plug-in Management -> OpenXR
3. Click the ⚙icon to reveal the settings
There are two options for connecting:
● Wifi for wireless freedom
● USB for speed and stability
🚨 When connected via a USB cable, make sure to disable Wifi on the
HoloLens.
Docs
57. Vertical turbine concept by Rifky Zaidani.
Created in Solidworks, imported with
Pixyz Plugin.
GrabCAD
Vertical Turbine with Solar Panels
A Microsoft Garage project provides the
ability to visualize a 3D map within
Unity-based projects.
Github
Maps SDK
Overtime -> MRTK Demo 57
Resources used
Import and learn about Azure Speech
Services to enhance your learning
experience.
Tutorial
Azure Cognitive Services