State of Mobile Augmented Reality (ARKit, ARcore, WebAR) given at Mobile Week 2022 Conference by Suyash Joshi

1. ARKit, ARCore, WebAR
Mobile Week Conference - 2022
// State of Mobile AR
@suyashcjoshi
Suyash Joshi -
(Creative Technologist & Evangelist)

2. State of Mobile AR - 2022

3. State of Mobile AR - 2022

4. State of Mobile AR - 2022

5. @suyashcjoshi
<AR 101>
Key Concepts that are relevant when
building mobile AR Applications on any
platform

6. // Mobile AR Development Process
// Research
IS AR the best
Solution ? Is it
Accessible ? How
to handle On-
boarding/Discovery
?
// Prototype
Quick Prototype
using RealityKit,
Adobe Aero etc
// Code + Design
Implement
Ask for help
Share knowledge
// Test & Monitor
Test, Deploy and
Monitor usage &
success

7. @suyashcjoshi
// Light Estimation for realistic AR UX

8. @suyashcjoshi
// Shared AR Experience

9. @suyashcjoshi
// Shared AR Experience (Niantic LightShip SDK)

10. @suyashcjoshi
// AR Instant App or Quick Look Experience

11. @suyashcjoshi
// ARCore Setup

12. @suyashcjoshi
// Android - ARCore Setup

13. // GPS + IMU + Visual Odometry for accuracy

14. // Room scale persistent AR Objects

15. @suyashcjoshi
<Demo & Code
Walkthrough>

16. Starting AR Session
- Motion Tracking
- Plane Detection
- Light Estimation
Requesting sensors, services
- Depth Estimation
- Object Placement
- Hit Testing
Closing Resources
// Understand AR Application Lifecycle

17. @suyashcjoshi
// ARCore - Setup (Gradle & Manifest File)
dependencies {
…
implementation
'com.google.ar:core:1.32.0'
}
<uses-permission android:name="android.permission.CAMERA" />
<!-- Limits app visibility in the Google Play Store to ARCore supported devices
(https://developers.google.com/ar/devices). -->
<uses-feature android:name="android.hardware.camera.ar" />
<application …>
…
<!-- "AR Required" app, requires "Google Play Services for AR" (ARCore)
to be installed, as the app does not include any non-AR features. -->
<meta-data android:name="com.google.ar.core" android:value="required" />
</application>

18. @suyashcjoshi
// ARCore - Create Session
public void createSession() {
// Create a new ARCore session.
session = new Session(this);
// Create a session config.
Config config = new Config(session);
// Do feature-specific operations here, such as enabling depth or turning on
// support for Augmented Faces.
// Configure the session.
session.configure(config);
}

19. @suyashcjoshi
<Conclusion>

20. Huge Potential
Market
/01
Over 1.2 Billion
Android devices and
select iOS devices
Good Platform Support
/02
SDK’s for Unity,
Unreal, Android (C,
Java, Kotlin), iOS
Lacks Tooling
/03
No Library or
Framework for easily
creating and
rendering 3D Content
Poor Documentation
/04
Few tutorials, sample
applications that are
current
// Android ARCore
@suyashcjoshi

21. @suyashcjoshi
// Comparison (3D Rendering)
// Web XR (AR) // ARCore (Android) // ARKit (iOS)
WebXR W3C Spec
SceneForm (not
maintained)
RealityKit,
RealityComposer,
Reality Converter
three.ar.js, AR.js,
mindAR, ReactAR
OpenFrameworks
SceneKit
8th Wall (proprietary) Filament SpriteKit
WebGL OpenGL ES, Vulkan Metal

22. // Thank you!!
● Rendering Framework for iOS
● Room Capture API
● Awesome ARKit Apps + Code
// iOS
// Android
● Google Filament with ARCore (Kotlin)
● ArCore Experiments
// Web
● Mind AR
Contact Me
● Twitter: @suyashcjoshi
● suyash@suyashjoshi.com