Philipp Nagele (Wikitude): Going Beyond ARKit and ARCore

•Download as PPTX, PDF•

0 likes•301 views

A talk from the Developer Track at AWE Europe 2017 - the largest conference for AR+VR in Munich, Germany October 19-20, 2017 Philipp Nagele (Wikitude): Going Beyond ARKit and ARCore There’s more to AR than world tracking. ARCore and ARKit put augmented reality in the spotlight and it’s now clear why tech giants are heavily betting on this technology. But what’s beyond the demos #madewithARKit all over social media? In this session Wikitude CTO, Philipp Nagele will talk about what ARKit and ARCore are made of and take them beyond the hype by demonstrating how to build a variety of AR experiences.

Technology

What matters for AR experiences?
Augmented RealityMobileDesktop

What matters for AR experiences?
Desktop Mobile Augmented Reality
Information
Density
Context
Relevance
+
=

10Source: © Business Insider Will Wei - http://www.businessinsider.com/new-snapchat-selfie-filters-2015-9

13
“There’s no point building an AR
App unless it interacts with the
physical world in some way.”
Matt Miesnieks

Components of an AR/VR/MR
system
14
Sensing Computing
VisualizeProject
Hardware Software

On the way to the Perfect Illusion
15
Sensing Computing Visualize Project
Mono Cameras
Stereo Cameras
HDR Cameras
Depth Cameras
Radar Sensors
Lidar Sensors
Location based Tracking
Marker Based Tracking
Monocular Vision SLAM
Sensor Fusion SLAM/VIO
Advanced Dense SLAM
Global SLAM
“AR Cloud”
Lag-free rendering (60fps+)
High-quality 3D models
Artificial motion blur
Apply atmospheric effects
Adaptive light rendering
Physics engine
Recognizing
pre-defined images
objects
Plane detection
Understanding
arbitrary shapes
Segmentation of
objects
Recognizing
pre-defined shapes
Semantical scene
Full mesh of
surrounding
Understanding of
material
Smartphone Displays
HMD
Untethered full FoV
Smart Lenses
Brain-Bridge
Smart Glasses
Spatially-coded Sound
Tactile Feedback

16
What is beyond ARKit/ARCore?
Many more possibilities to build
upon context of the user for AR/MR
experience.

Different Devices, OS and form-
factors
17

21
What is beyond ARKit/ARCore?
Share and collaborate on AR and
MR experiences
• Cross-Platform
• Cross-Tracker
• Cross-Devices

philipp.nagele@wikitude.com
Philipp Nagele, CTO
Thank you!
22

Similar to Philipp Nagele (Wikitude): Going Beyond ARKit and ARCore

Aurea Vision & Aurea Consulting: technology proposal

Anna Doroshenko

A talk from the Develop Track at AWE USA 2018 - the World's #1 XR Conference & Expo in Santa Clara, California May 30- June 1, 2018. Mitchell Reifel (pmdtechnologies ag): pmd Time-of-Flight – the Swiss Army Knife of 3D depth sensing pmd's Time-of-Flight technology is integrated into two AR-smartphones on the market! pmd ToF is in 4 AR headsets! This talk will show what pmd has achieved, what they can do with our 3D ToF technology and why depth sensing is one secret sauce for AR, VR and MR. http://AugmentedWorldExpo.com

Mitchell Reifel (pmdtechnologies ag): pmd Time-of-Flight – the Swiss Army Kni...

AugmentedWorldExpo

It's high time for augmented reality to be brought to a wider audience. In ABB, we know that it is not just a gimmick any more. However, with every innovative technology comes new challenges. In these slides, we show how to overcome them and deliver valuable products with Hololens and Unity. Speakers: Maciej Włodarczyk - ABB Rafał Kielar - ABB Watch the session on YouTube: https://youtu.be/QFsj8Pi_3Ho

How ABB shapes the future of industry with Microsoft HoloLens and Unity - Uni...

Unity Technologies

How 5G Will Unleash AI

Abaram Network Solutions

When it comes to managing infrastructure and physical assets, Augmented Reality is a game-changer. Using the Augmented Reality of today’s tablets and phones, you can save time and provide new value-added services. We will show how organizations with outdoor assets can leverage existing data to manage their infrastructure: making common tasks simpler, faster, and cheaper. The possibilities for experiencing data in a new way for city workers, surveyors, utility companies, and construction workers are endless. Dmitri, our Technical Specialist, will share some of what is possible by taking you into the field where you will visualize this through a live outdoor demo. He will showcase how the day in the life of anyone working on outdoor infrastructure can be made easier with FME and Augmented Reality. Let us show you how we can help you work smarter, be more productive, all while having fun experiencing your data.

Exploring Outdoor Infrastructure with AR

Safe Software

Virtual Reality: A Step into Land of Imagination

Siddharth Mishra

Augmented Reality

Kaviyaraj R

Nadi System Corp - q4 2020

Curt Riley

A talk from the Enterprise Track at AWE USA 2019 - the World's #1 XR Conference & Expo in Santa Clara, California May 29-31, 2019. Chloe Doyeon Kim (MAXST): The Current and Future State of MAXST Platform MAXST, a persistent challenger, is proudly specialized in Augmented Reality working with prominent Korean enterprises, such as Hyundai, Samsung Display, Samsung Electronics, and KT. MAXST’s cloud-based AR platform pursues innovation in terms of AR development tools, AR production costs, and profitability. We also believe Visual SLAM is critical basis for Future AR. We will reveal our stories and insight to the immersive world of today and tomorrow. https://awexr.com

Chloe Doyeon Kim (MAXST): The Current and Future State of MAXST Platform

AugmentedWorldExpo

Jochen Deldaele - House of digital

Digitopia

Ayonix gen en_v1.4

Dr. Sadi Vural

For the full video of this presentation, please visit: http://www.embedded-vision.com/platinum-members/qualcomm/embedded-vision-training/videos/pages/may-2016-embedded-vision-summit-talluri For more information about embedded vision, please visit: http://www.embedded-vision.com Raj Talluri, Senior Vice President of Product Management at Qualcomm Technologies, presents the "Is Vision the New Wireless?" tutorial at the May 2016 Embedded Vision Summit. Over the past 20 years, digital wireless communications has become an essential technology for many industries, and a primary driver for the electronics industry. Today, computer vision is showing signs of following a similar trajectory. Once used only in low-volume applications such as manufacturing inspection, vision is now becoming an essential technology for a wide range of mass-market devices, from cars to drones to mobile phones. In this presentation, Talluri examines the motivations for incorporating vision into diverse products, presents case studies that illuminate the current state of vision technology in high-volume products, and explores critical challenges to ubiquitous deployment of visual intelligence.

"Is Vision the New Wireless?," a Presentation from Qualcomm

Edge AI and Vision Alliance

VRCAI 2011 Billinghurst Keynote

Mark Billinghurst

MEMS Laser Scanning, the platform for next generation of 3D Depth Sensors

Jari Honkanen

Augmented reality

kaviyaraj

Pantheon pro GmbH AR Solutions

Helen Reunova

ABTO Software computer vision 2016

ABTO Software

At Unite Copenhagen, this session looked at what's involved in merging real-time 3D and PLM in manufacturing. Within the manufacturing industry, and especially in the automotive segment, product lifecycle management (PLM) is a critical foundation for customer workflows. Real-time 3D needs to use PLM systems as a source of geometry and metadata. In this session, you'll hear from an expert from Atos, a leader in digital transformation, how PLM and real-time 3D are coming together to enable powerful and efficient new workflows. Speakers: Winfried Schwan- Atos & Laurent Milon- PiXYZ Software Watch the session on YouTube: https://youtu.be/Nny2GYGE0oo

Merging real-time 3D and PLM in manufacturing - Unite Copenhagen 2019

Unity Technologies

ProboTEK - Gray Mantis (Security Drone System)

PROBOTEK

Direct Dimensions SME 3D Imaging 2009 Conference Keynote Presentation V2c Re...

Direct Dimensions, Inc.

Similar to Philipp Nagele (Wikitude): Going Beyond ARKit and ARCore (20)

Aurea Vision & Aurea Consulting: technology proposal

Mitchell Reifel (pmdtechnologies ag): pmd Time-of-Flight – the Swiss Army Kni...

How ABB shapes the future of industry with Microsoft HoloLens and Unity - Uni...

How 5G Will Unleash AI

Exploring Outdoor Infrastructure with AR

Virtual Reality: A Step into Land of Imagination

Augmented Reality

Nadi System Corp - q4 2020

Chloe Doyeon Kim (MAXST): The Current and Future State of MAXST Platform

Jochen Deldaele - House of digital

Ayonix gen en_v1.4

"Is Vision the New Wireless?," a Presentation from Qualcomm

VRCAI 2011 Billinghurst Keynote

MEMS Laser Scanning, the platform for next generation of 3D Depth Sensors

Augmented reality

Pantheon pro GmbH AR Solutions

ABTO Software computer vision 2016

Merging real-time 3D and PLM in manufacturing - Unite Copenhagen 2019

ProboTEK - Gray Mantis (Security Drone System)

Direct Dimensions SME 3D Imaging 2009 Conference Keynote Presentation V2c Re...

More from AugmentedWorldExpo

A talk from the Training & Education Track at AWE USA 2019 - the World's #1 XR Conference & Expo in Santa Clara, California May 29-31, 2019. Bill Meyer (Virtual Science Center): Turning Kids on to STEM by Letting Them Discover How VR and AR Tricks Our Brain How exactly does Virtual and Augmented Reality game human perception so things we know aren’t there seem to exist? Can simple and robust public learning experiences empower and delight people of all ages to experiment and discover the answers for themselves? The answer is yes. This talk will present examples and discuss how UX best practices can be applied to create effective inquiry-based learning experiences that unpack seemingly complex modern technologies. Through iterative design coupled with repeated visitor testing, we deconstructed the surprising perceptual science and technology behind VR and AR into 16 cool hands-on experiences that spark “aha” moments and minimize the need for wordy explanations. We keep concepts intuitive, playful, and fun to understand. Our traveling exhibition goal is to show visitors they're smarter than they suspect, inspire students to aim for STEM careers, and help teachers lead deeper NGSS and Common Core dives both in and out of the classroom. This 45 second video shows an example exhibit and part of our visitor testing process: https://youtu.be/Sgh0Sys57lY Without needing to learn the terms, visitors discover the secrets of how things like Motion Parallax, Stereo Vision, 3D Audio Spatialization, Outside-In, and Inside-Out Tracking work in concert to make virtual, augmented and mixed reality experiences possible. https://awexr.com

Bill Meyer (Virtual Science Center): Turning Kids on to STEM by Letting Them ...

AugmentedWorldExpo

A talk from the Gaming & Entertainment Track at AWE USA 2019 - the World's #1 XR Conference & Expo in Santa Clara, California May 29-31, 2019. Nick Klingensmith (Microsoft): Increasing Immersion with the MR Lighting Tools To-date, most 3D graphics have been rendered on opaque displays. Now, not only are we putting holograms into the real world, but we're also doing it on additive displays! How do we render holograms that look good in this environment, and how do we make them look like they belong? The Mixed Reality Lighting Tools are a collection of easy Unity based solutions, from replicating your environment's lighting, to casting believable additive shadows. Come find out how easy it is to make your Mixed Reality application more immersive! https://awexr.com

Nick Klingensmith (Microsoft): Increasing Immersion with the MR Lighting Tools

AugmentedWorldExpo

A talk from the Creator Track at AWE USA 2019 - the World's #1 XR Conference & Expo in Santa Clara, California May 29-31, 2019. Rokid: Design a seamless solution for AR glasses Qi Xiong | Rokid Paris Fan | Rokid Nan Wang | Rokid Gonglue Jiang | Rokid In this talk, we will discuss how Rokid creates a seamless AR experience from two aspects: ergonomic design(hardware) and systematic UI/UX design(software). The presentation will also share the insights of the entire product development cycle of Rokid Glass: from crafting product appearance with strict constraints, deploying user interfaces on a new and unique AR device, to the case studies and progressive design of real implementations. The talk offers a glimpse of the future AR design methodology by demonstrating the superpower enabled by design thinking. Rokid Glass is an AI-enabled, all-in-one AR glasses already in mass production, with seamless user experience which widely adopted by the industry. https://awexr.com

Rokid: Design a seamless solution for AR glasses

AugmentedWorldExpo

A talk from the Marking & Sales Track at AWE USA 2019 - the World's #1 XR Conference & Expo in Santa Clara, California May 29-31, 2019. Tom De Vos | Fat Boy Dalia Lasaite | CGTrader Augmented Reality is having a profound impact on the way people shop online. By enabling consumers to interact with and try products before purchasing as they would in a brick and mortar store, Augmented Reality has been proven to increase sales conversions, reduce product returns and extend online engagement. This presentation will examine the latest technologies, trends and strategies for deploying AR for e-Commerce. https://awexr.com

How AR is Transforming the Online Retail Experience

AugmentedWorldExpo

A talk from the Start-up Pitch Track at AWE USA 2019 - the World's #1 XR Conference & Expo in Santa Clara, California May 29-31, 2019. Owning Augmented Space Neil Mandt | The Layer Group Brian Wassom | Warner Norcross + Judd LLP "How can I own the AR 'air rights' around my physical property?" This may be the most commonly asked legal question around AR content. It is gaining new momentum and importance today, as location-based AR finally turns a profit, and as the quest for the Open AR Cloud takes shape. Finding the answers requires crossing the boundaries of multiple legal disciplines and practical concerns, and will not always be easy. This session will equip you to understand the legal risks and give you strategies to protect the integrity of both physical space and digital expression. https://awexr.com

AWE USA 2019: Owning Augmented Space

AugmentedWorldExpo

A talk from the XR Enablement Track at AWE USA 2019 - the World's #1 XR Conference & Expo in Santa Clara, California May 29-31, 2019. Victor Sun (Shadow Creator): How to turn Mixed Reality “headset” into “glasses”? Microsoft has released HoloLens 2 on MWC. I think it is the benchmark for mixed reality devices, but it only reaches the pass mark. In order to be used by ordinary consumers, headsets must be turned into glasses to eliminate their fears of tech equipment. https://awexr.com

Victor Sun (Shadow Creator): How to turn Mixed Reality “headset” into “glasses”?

AugmentedWorldExpo

Chris Pickett (DigiLens): XR is Hard: Here’s Why

AugmentedWorldExpo

A talk from the XR Enablement Track at AWE USA 2019 - the World's #1 XR Conference & Expo in Santa Clara, California May 29-31, 2019. Antti Sunnari (Dispelix Ltd): Full-color, single-waveguide near-eye displays for AR glasses and MR headsets For years, many have tried to develop a see-through, near-eye display technology that combines beautiful design, excellent image quality and scalable mass production with high yields. At Dispelix, we’ve figured it out. Dispelix is helping product companies to create beautiful AR glasses based on single-waveguide full-color displays with superior image quality and mass manufacturability. https://awexr.com

Antti Sunnari (Dispelix Ltd): Full-color, single-waveguide near-eye displays ...

AugmentedWorldExpo

A talk from the XR Enablement Track at AWE USA 2019 - the World's #1 XR Conference & Expo in Santa Clara, California May 29-31, 2019. Jian Liang (HiScene): AR for Industry in China: From Concepts to Real Applications AI/AR industry has attracted attention never seen before of academia and industry, into which numerous talents and resources have been invested. However, academic achievements are not equal to products, which need to be adjusted and optimized in technology, engineering, product, etc. according to specific application scenarios. This talk will share with you some difficulties, misconceptions and experience in commercializing AR based on HiScene’s practice. https://awexr.com

Jian Liang (HiScene): AR for Industry in China: From Concepts to Real Applica...

AugmentedWorldExpo

A talk from the Gaming & Entertainment Track at AWE USA 2019 - the World's #1 XR Conference & Expo in Santa Clara, California May 29-31, 2019. Augmented reality meets Television -Ellen DeGeneres' Game of Games AR App Daniel Leary | The Ellen DeGeneres Show Alexa Hook | The Ellen DeGeneres Show Paul Hake | HitPoint Inc. Ellen DeGeneres, America's most loved comedian and popular TV host, entered the augmented reality era with the "Game of Games" show. Over 900,000 app users get to tune in and play along with Ellen with AR by unlocking prizes that jump from the TV screen into viewers' phones. The app has hit 741,614 AR gift box markers scanned from NBC broadcasts of Game of Games, during the weekly Play Along Live game. At AWE, HitPoint Studios gives an insight into the creative and technical process of building the "Game of Games" Game app and how to connect traditional TV shows with AR technology. https://awexr.com

Augmented reality meets Television -Ellen DeGeneres' Game of Games AR App

AugmentedWorldExpo

Jennifer Cook (Dreamscape Immersive): Dreamscape Immersive Presentation

AugmentedWorldExpo

A talk from the Enterprise Track at AWE USA 2019 - the World's #1 XR Conference & Expo in Santa Clara, California May 29-31, 2019. 2 Partners sharing 1 vision for smart operators Mark Fleischer | AMA XPERTEYE INC. Peter Verstraeten | Proceedix The partnership between XpertEye and Proceedix offers a best-in-class solution to empower smart operators and technicians. The combination leverages both mobile technology and smart glasses for remote assistance and instruction and inspection execution. https://awexr.com

AWE USA 2019: 2 Partners sharing 1 vision for smart operators

AugmentedWorldExpo

Phil LaFond (Bosch Automotive Service Solutions Inc.): Bosch Technical Traini...

AugmentedWorldExpo

A talk from the Main Stage at AWE USA 2019 - the World's #1 XR Conference & Expo in Santa Clara, California May 29-31, 2019. Scott Montgomerie (Scope AR): AR’s Influence on the Workforce of Tomorrow: Job Eliminator or Creator? As the speed of technology continues to accelerate automation in the manufacturing world, the inevitable question of whether or not the “human touch” will become obsolete is top of mind for workers. The fear that robots and smart technologies will take everyone's jobs is prevalent, but not necessarily true. AR has the power to be a job creator, not a job eliminator. Its ability to make anyone an instant expert can in fact increase job security by quickly helping workers become more proficient in tasks. Learn about real-world use cases where AR is making people better, and safer, at their jobs, and explore why enterprises who create a workplace that’s augmented, not automated, will be the leaders of tomorrow. https://awexr.com

Scott Montgomerie (Scope AR): AR’s Influence on the Workforce of Tomorrow: Jo...

AugmentedWorldExpo

A talk from the Main Stage at AWE USA 2019 - the World's #1 XR Conference & Expo in Santa Clara, California May 29-31, 2019. Hugo Swart (Qualcomm, Inc.): How 5G, Distributed Processing and Technology Advancements are Accelerating the Timeline to a Ubiquitous XR World XR has the potential to become one of the world’s most disruptive computing platforms in the coming decade. Over the past year, we’ve seen significant strides in technology and with the introduction of new XR form factors such as standalone, tethered viewers and dual-mode HMDs – there has been an acceleration of XR opportunities, use cases and adoption. In this keynote presentation, Hugo Swart, Head of XR at Qualcomm Technologies, Inc. will speak to cutting-edge technological developments and how Qualcomm has met previous challenges, with a forward outlook on how strong ecosystem collaboration, the proliferation of 5G and AI will fast-track the industry timeline to an XR ubiquitous world. https://awexr.com

Hugo Swart (Qualcomm, Inc.): How 5G, Distributed Processing and Technology Ad...

AugmentedWorldExpo

A talk from the Creator Track at AWE USA 2019 - the World's #1 XR Conference & Expo in Santa Clara, California May 29-31, 2019. Valentin Heun (PTC): One Reality - A 3rd generation AR User Interface Many of our technological innovations seem to expand the computational abilities without the human in the loop. Augmented Reality is one of the view technologies that promises technological advances that enable us humans a better connection with the ubiquitous technology around us. We are not there yet to make use of such a user interface. We currently have individual islands of interactivity via AR. This conference may have many spatial demos as well, however, a single ubiquitous layer that penetrates all screens, surfaces, machines, and environments are not available. This is what the PTC Reality Lab researches. The core of this research is the ability to use AR in a scalable distributed platform to bridge among technological domains to allow the weaving of multiple technologies into one user experience. The resulting user experience is called One Reality. The goal for One Reality is to provide one seamless, ubiquitous flow of user experience for all technologies that touch the user’s decision making. This talk will iterate on the different stages of Augmented Reality User Interfaces and identifies One Reality as the 3rd stage in the evolution of AR user interfaces. This visionary talk aims to inspire the audience to think beyond the known applications for Augmented Reality. https://awexr.com

Valentin Heun (PTC): One Reality - A 3rd generation AR User Interface

AugmentedWorldExpo

A talk from the Training & Education Track at AWE USA 2019 - the World's #1 XR Conference & Expo in Santa Clara, California May 29-31, 2019. Anton Ebert (Siemens Healthcare): Challenges and approaches on integrating a cutting edge technology in modern healthcare businesses This session will provide insights and a basis for further discussions on how technologies like Augmented and Virtual Reality are being tested and explored in the healthcare sector. https://awexr.com

Anton Ebert (Siemens Healthcare): Challenges and approaches on integrating a ...

AugmentedWorldExpo

A talk from the Humanities Track at AWE USA 2019 - the World's #1 XR Conference & Expo in Santa Clara, California May 29-31, 2019. Sarah Hill (Healium by StoryUP Studios): Healing Stories Powered by Biometrics Users aren't just watching your content, they're feeling it with their wearables. Brain patterns and heart rate are XR storytelling's new inputs. Peek inside the world's first VR & AR content channel powered by a brain-computer interface and heart rate to learn about a new study on XR's therapeutic impact on anxiety. https://awexr.com

Sarah Hill (Healium by StoryUP Studios): Healing Stories Powered by Biometrics

AugmentedWorldExpo

A talk from the Humanities Track at AWE USA 2019 - the World's #1 XR Conference & Expo in Santa Clara, California May 29-31, 2019. Iva Leon (ARVR Women and Allies): Building community with social VR Social VR platforms like Facebook Spaces can help community builders and purpose-driven organizations innovate the way they engage their members and bring people together. Find out how ARVR Women uses social VR to elevate the visibility of their members and add value to the group. https://awexr.com

Iva Leon (ARVR Women and Allies): Building community with social VR

AugmentedWorldExpo

A talk from the Gaming & Entertainment Track at AWE USA 2019 - the World's #1 XR Conference & Expo in Santa Clara, California May 29-31, 2019. Rosario B. Casas ( www.vramericas.com): If data will be all over the space, who will take care of protecting it Conversation about the challenges that the industry has in terms of data analytics (standards, cybersecurity, data management protocols, etc) knowing that content, interactions and transactions will be creating data outside of "computers", but everywhere. https://awexr.com

Rosario B. Casas ( www.vramericas.com): If data will be all over the space, w...

AugmentedWorldExpo

More from AugmentedWorldExpo (20)