ARKit 2 introduces enhancements such as saving and loading maps, improved world tracking, realistic environment texturing, advanced image tracking capabilities, and object detection for 3D objects. Key features include a mutable list of named anchors for world mapping, tracking of multiple images, and face tracking enhancements like gaze and tongue support. The document summarizes the major updates and functionalities presented at WWDC 2018.

1. What’s new in ARKit 2
Victor S. Melo
WWDC 18

2. ARKit Recap

3. Topics
• Saving and loading maps
• Environment Texturing
• Image Tracking
• Real object Detection
• Face Tracking Enhancements

4. Saving and loading maps

6. ARWorldMap
• Mapping of physical 3D space
• Mutable list of named anchors
• Raw feature points and extent
• Serialization

7. Acquiring Good World Maps
• Important for relocalization
• Multiple points of view
• Static, well-textured
environment
• Dense feature points on the
map

8. World Mapping Status

9. World Mapping Status

10. Using WorldMappingStatus

11. Multi-User Experiences

13. World Tracking Enhancements
• Saving and loading maps
• Faster initialization and plane detection
• Robust tracking and plane detection
• More accurate extent and boundary
• Continuous autofocus
• New 4:3 video formats

14. Saving and loading maps
DEMO

15. Environment Texturing

16. Realistic Rendering
• Position and orientation
• Scale
• Lighting
• Shadow
• Reflection of textures

17. Environment Texturing
• Gathers scene texture
• Cube map representation
• Used as reflection probe
• Reflective objects

18. Environment Texturing

19. Environment Texturing

20. Environment Texturing

21. Environment Texturing
DEMO

22. Image Tracking

23. Image Tracking
• Images don’t need to be static
• Position and orientation for every frame
• Track multiple images simultaneously
• ARImageTrackingConfiguration

24. Image Tracking

25. Using good Images

26. Image Tracking
DEMO

27. Object Detection

28. Object Detection
• Detection of a known static 3D
object
• Objects need to be scanned
first
• Well-textured, rigid, non-
reflective
• Position and orientation
• Integrated into world tracking

29. Object Detection

30. ARObjectAnchor

31. Object Scanning
• Accumulated scene information
• Transform, extent, center
• Supported by Xcode asset catalog
• ARObjectScanningConfiguration
• Sample code available: scanning and
detecting 3D objects

32. Object Detection
DEMO

33. Face Tracking Enhancements

34. Gaze Tracking

35. Tongue Support

36. Tongue Support
“You could use it as a form of
input to your app”

37. Face Tracking
DEMO

38. ARKit 2 - Summary
• Saving and loading maps
• World tracking enhancements
• Environment texturing
• Image tracking
• Object detection
• Gaze and tongue

39. Building Blocks of ARKit

40. https://medium.com/@mohams3ios01/an-introduction-to-arkit-2-image-tracking-730fdff4e3fa
https://developer.apple.com/videos/play/wwdc2018/602/
https://github.com/vctrsmelo/WhatsNewInARKit2
References

41. Thank you!
fb.com/vctrsmelo
www.linkedin.com/in/vsmelo
www.victormelo.com.br