At FITC 2018 in Amsterdam I did a talk about AR. Augmented reality is now achieving mainstream adoption and will soon be the largest immersive technology platform in the world. As the technology takes off, more developers are leveraging AR to change the way users interact with their mobile devices and the world around them. From conquering plane detection to integrating geo-fencing, in this talk I share some of our key learnings from experimenting in the medium and launching our first AR app to the App Store.

1. THE HONEST TRUTH ABOUT
OWEN VAN DIJK - FIRSTBORN
#FITCAMSTERDAM
AR
@ohwhenwww.firstborn.com

2. @ohwhenwww.firstborn.com
WHO?

3. @ohwhenwww.firstborn.com

4. @ohwhenwww.firstborn.com

5. @ohwhenwww.firstborn.com

6. @ohwhenwww.firstborn.com

7. THIS TALK
1. AR Landscape
@ohwhenwww.firstborn.com

8. @ohwhenwww.firstborn.com
THIS TALK
1. AR Landscape
2. Lessons Learned

9. @ohwhenwww.firstborn.com
THIS TALK
1. AR Landscape
2. Lessons Learned
3. AR Meets ML

10. @ohwhenwww.firstborn.com
HYPE OR REALITY

11. @ohwhenwww.firstborn.com
Apple’s Tim Cook Says Augmented Reality
will “Change Everything”
Magic Leap kicked off 2018’s race for an
Augmented Reality Future
The race for AR glasses starts now

12. @ohwhenwww.firstborn.com
3D streaming is coming to your smart TV
Panasonic sells world’s first 3D TV system
This High-Def 3D TV that doesn’t
require glasses blew my mind… But
its origin is a mystery

13. @ohwhenwww.firstborn.com
Shambling corpse of 3D TV finally
falls down dead

14. @ohwhenwww.firstborn.com
AR SPECTRUM

15. AR SPECTRUM
@ohwhenwww.firstborn.com
Hardware

16. @ohwhenwww.firstborn.com
Hardware
AR SPECTRUM

17. @ohwhenwww.firstborn.com
Hardware
AR SPECTRUM

18. Hardware
@ohwhenwww.firstborn.com
Software
AR SPECTRUM

19. @ohwhenwww.firstborn.com

20. Hardware
@ohwhenwww.firstborn.com
Software
AR SPECTRUM

21. @ohwhenwww.firstborn.com
PLATFORM:
APPLE VS. GOOGLE

22. PLATFORM: APPLE VS. GOOGLE
@ohwhenwww.firstborn.com

23. @ohwhenwww.firstborn.com
PLATFORM: APPLE VS. GOOGLE

24. @ohwhenwww.firstborn.com
PLATFORM: APPLE VS. GOOGLE

25. @ohwhenwww.firstborn.com
ENGINES:
UNITY VS. UNREAL

26. @ohwhenwww.firstborn.com
ENGINES: UNITY VS. UNREAL

27. @ohwhenwww.firstborn.com
ENGINES: UNITY VS. UNREAL

28. @ohwhenwww.firstborn.com
MOBILE
AR
EXAMPLES

29. @ohwhenwww.firstborn.com
BUT HOW DOES IT
WORK?

30. @ohwhenwww.firstborn.com

31. @ohwhenwww.firstborn.com
CASE STUDY 1:
GRUESOME GOTHAM

32. @ohwhenwww.firstborn.com

39. @ohwhenwww.firstborn.com
Core Team
1. Producer
2. Visual Designer
3. Two 3D Artists
4. Mobile Developer

40. @ohwhenwww.firstborn.com
Full Team
1. Producer
2. Visual Designer
3. Two 3D Artists
4. Mobile Developer
5. Creative Director
6. Creative Team (design & copy)
7. Business Director
8. PR & Communications

41. @ohwhenwww.firstborn.com
USING AR AS A
NAVIGATION DEVICE

42. https://github.com/ProjectDent/ARKit-CoreLocation

44. @ohwhenwww.firstborn.com
3D WORKFLOW

45. 3D WORKFLOW
1. 3D artists model, texture and light assets in Maya
@ohwhenwww.firstborn.com

47. 3D WORKFLOW
1. 3D artists model, texture and light assets in Maya
2. Textures are pre-baked with lighting and shaders
@ohwhenwww.firstborn.com

48. PRE-LIGHTING

49. POST-LIGHTING

50. 3D WORKFLOW
1. 3D artists model, texture and light assets in Maya
2. Textures are pre-baked with lighting and shaders
3. Scenes are exported as Collada files
@ohwhenwww.firstborn.com

51. 3D WORKFLOW
1. 3D artists model, texture and light assets in Maya
2. Textures are pre-baked with lighting and shaders
3. Scenes are exported as Collada files
4. Collada files are imported and launched programmatically
@ohwhenwww.firstborn.com

53. @ohwhenwww.firstborn.com
PERFORMANCE &
POLYCOUNT

54. PERFORMANCE & POLYCOUNT
1. Optimizations
@ohwhenwww.firstborn.com

55. @ohwhenwww.firstborn.com
PERFORMANCE & POLYCOUNT
1. Optimizations
2. Target polygon budget

56. @ohwhenwww.firstborn.com
PERFORMANCE & POLYCOUNT
1. Optimizations
2. Target polygon budget
3. Test Devices

57. @ohwhenwww.firstborn.com
SHADER
LIMITATIONS

58. SHADER LIMITATIONS
1. Created primarily through code
@ohwhenwww.firstborn.com

59. @ohwhenwww.firstborn.com
SHADER LIMITATIONS
1. Created primarily through code
2. Not exchangeable

60. @ohwhenwww.firstborn.com
SHADER LIMITATIONS
1. Created primarily through code
2. Not exchangeable
3. Little documentation

61. @ohwhenwww.firstborn.com
DETECTING FLOOR
& PLACE OBJECTS

62. @ohwhenwww.firstborn.com

63. @ohwhenwww.firstborn.com
TRACKING CODE

64. @ohwhenwww.firstborn.com
TRACKING CODE

65. @ohwhenwww.firstborn.com
TRACKING FAILS
1. Poor lighting

66. @ohwhenwww.firstborn.com
TRACKING FAILS
1. Poor lighting
2. Lack of texture

67. BAD GOOD

68. @ohwhenwww.firstborn.com
TRACKING FAILS
1. Poor lighting
2. Lack of texture
3. Fast movements

69. @ohwhenwww.firstborn.com
GETTING THE
RIGHT SCALE

71. @ohwhenwww.firstborn.com
CASE STUDY 2:
Gatore AR

72. @ohwhenwww.firstborn.com

76. @ohwhenwww.firstborn.com
WHAT WE DID DIFFERENTLY
1. Using a game engine (Unity) instead of SceneKit

77. @ohwhenwww.firstborn.com
WHAT WE DID DIFFERENTLY
1. Using a game engine (Unity) instead of SceneKit
2. Adding a calibration step

78. @ohwhenwww.firstborn.com

79. @ohwhenwww.firstborn.com

80. @ohwhenwww.firstborn.com
INTEGRATING UNITY
WITH UIKIT
https://github.com/jiulongw/swift-unity

81. @ohwhenwww.firstborn.com
TRACKING WITH
VUFORIA

82. @ohwhenwww.firstborn.com

83. @ohwhenwww.firstborn.com
BETTER VISUAL
QUALITY

84. @ohwhenwww.firstborn.com

85. @ohwhenwww.firstborn.com
MACHINE LEARNING
& AR

86. https://twitter.com/braddwyer/status/910030265006923776

87. https://twitter.com/AndrewProjDent/status/958759429473734657

88. @ohwhenwww.firstborn.com
RECAP
1. Don’t believe the hype

89. @ohwhenwww.firstborn.com
RECAP
1. Don’t believe the hype
2. Come up with a compelling concept

90. @ohwhenwww.firstborn.com
RECAP
1. Don’t believe the hype
2. Come up with a compelling concept
3. Team is everything

91. @ohwhenwww.firstborn.com
RECAP
1. Don’t believe the hype
2. Come up with a compelling concept
3. Team is everything
4. Think about the user experience

92. @ohwhenwww.firstborn.com
RECAP
1. Don’t believe the hype
2. Come up with a compelling concept
3. Team is everything
4. Think about the user experience
5. Pick the right tools

93. Owen van Dijk
Twitter @ohwhen
Web owenvandijk.co
@ohwhenwww.firstborn.com
THANKS