Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

ARKit in Practice

199 views

Published on

Beyond the shiny effect of ARKit and ARCore, this presentation is about when ARKit/ARCore have the most impact, AR design patterns to solve the new challenges of implementing and designing with ARKit/ARCore.

‪https://www.youtube.com/watch?v=g8hD_J_70Hc‬

Published in: Design

ARKit in Practice

  1. 1. ARKit in Practice Luis Abreu, Sr. UX Designer, ribot.co.uk twitter.com/lmjabreu
  2. 2. ARCoreARKit
  3. 3. Agenda • How is Mobile AR different • A technical overview • Thinking about AR • AR in Practice
  4. 4. Agenda • How is Mobile AR different • A technical overview • Thinking about AR • AR in Practice
  5. 5. Scale.
  6. 6. Top AR/VR Solutions ARKit ARCore PSVR Vive Platform iPhone 6S>, iPad Pro/2017 Pixel 1/2, S8 PS4 PC/Mac Replaces Visual/Audio Visual/Audio Visual/Audio Visual/Audio Field of View Screen Screen/Full Full Full Session Time Short Short Short-Long Short-Long Tracking Internal Internal External Internal Interaction Touch/Motion/Face Touch/Motion/Face Move/Traditional Controller Vive Controller User Base 400M 23M 0.9M 0.5M Other • Plane Detection • Light Estimation* • Vision API • CoreML** • TrueDepth*** • Offline NLP • Plane Detection • Light Estimation • Visual Core**** … … Entry Cost £450 £600 £600 £1500 * Directional lighting on iPhone X TrueDepth Camera ** Faster with dedicated hardware on A11 *** Only on iPhone X **** Only on Pixel 2
  7. 7. Top AR/VR Solutions ARKit ARCore PSVR Vive Platform iPhone 6S>, iPad Pro/2017 Pixel 1/2, S8 PS4 PC/Mac Replaces Visual/Audio Visual/Audio Visual/Audio Visual/Audio Field of View Screen Screen/Full Full Full Session Time Short Short Short-Long Short-Long Tracking Internal Internal External Internal Interaction Touch/Motion/Face Touch/Motion/Face Move/Traditional Controller Vive Controller User Base 400M 23M 0.9M 0.5M Other • Plane Detection • Light Estimation* • Vision API • CoreML** • TrueDepth*** • Offline NLP • Plane Detection • Light Estimation • Visual Core**** … … Entry Cost £450 £600 £600 £1500 * Directional lighting on iPhone X TrueDepth Camera ** Faster with dedicated hardware on A11 *** Only on iPhone X **** Only on Pixel 2
  8. 8. 400M ARKit iOS Devices iPhone 6S, iPhone 7, iPhone 8, iPhone X, iPad Pro, iPad 2017 source: http://fortune.com/2017/03/06/apple-iphone-use-worldwide/
  9. 9. 23M ARCore Android Devices Pixel 1, Pixel 2, Samsung S8 source: BGR, ARS Technica
  10. 10. Agenda • How is Mobile AR different • A technical overview • Thinking about AR • AR in Practice
  11. 11. ARKit • Inside-out world tracking • Plane detection • Light estimation • Rendering
  12. 12. ARKit • Inside-out world tracking • Plane detection • Light estimation • Rendering
  13. 13. +y -y -z +z +x -x Camera
  14. 14. Metric Scale
  15. 15. ARKit • Inside-out world tracking • Plane detection • Light estimation • Rendering
  16. 16. ARKit • Inside-out world tracking • Plane detection • Light estimation • Rendering
  17. 17. ARKit • Inside-out world tracking • Plane detection • Light estimation • Rendering
  18. 18. SceneKit SpriteKit Metal
  19. 19. Reuse 3D Models and Code Just plug the camera into ARKit’s positioning data
  20. 20. developer.apple.com/videos/wwdc2017
  21. 21. Agenda • How is Mobile AR different • A technical overview • Thinking about AR • AR in Practice
  22. 22. AR on its own is worthless
  23. 23. 🐟
  24. 24. Intent
  25. 25. Find opportunities
  26. 26. Find problems that need solving
  27. 27. Design solutions
  28. 28. BJ Fogg’s Behavior Model X = T × (M + A)
  29. 29. X = T × (M + A)X = T × (M + A)
  30. 30. X = T × (M + A)X = T × (M + A)
  31. 31. X = T × (M + A)X = T × (M + A)
  32. 32. Motivation X = T × (M + A)X = T × (M + A) Avoiding pain or seeking pleasure in the short/long-term, physical and psychological (e.g. social) e.g. I’m feeling a bit sleepy, ugh 😴
  33. 33. Ability X = T × (M + A)X = T × (M + A) Being able to adopt a solution, involves time, money, physical and mental effort, social deviance e.g. I could go to Coffee@33 but Small Batch is across the road and I’ve got a meeting in 10min so… guess what I’m gonna do 🙈
  34. 34. Trigger X = T × (M + A) Triggers compensate for lack of Motivation or Ability. X = T × (M + A) e.g. show how much money I’m loosing (Motivation) and how little time I need to fix it (Ability).
  35. 35. BJ Fogg’s Behavior Model X = T × (M + A)
  36. 36. Estimote
  37. 37. Be your worst competitor
  38. 38. How could this fail?
  39. 39. The problem is real,but do people use my product?
  40. 40. Is my product used for what I think it is?
  41. 41. Do I really know my customers?
  42. 42. MeasureKit
  43. 43. Do I know my competitors?
  44. 44. MeasureKit App Store
  45. 45. MeasureKit Measure Tape
  46. 46. Winner Measure Tape
  47. 47. AR removes Physical and Time constraints
  48. 48. Opportunities Education Healthcare Media Authoring Architecture Art Construction Air & Space Travel Gaming Assisted Living Retail Real Estate Logistics Utilities
  49. 49. No need to buy,wait,try,return #retailproblems
  50. 50. Instant “vision”
  51. 51. TrueDepth
  52. 52. AR removes Physical and Time constraints
  53. 53. AR…adds Physical and Time constraints?
  54. 54. In psychology,the scarcity heuristic is a mental shortcut that places a value on an item based on how easily it might be lost,especially to competitors. Scarcity Heuristic, Wikipedia
  55. 55. AR on its own is worthless
  56. 56. Stop.
  57. 57. Create with Intent
  58. 58. Agenda • How is Mobile AR different • A technical overview • Thinking about AR • AR in Practice
  59. 59. Feature or Focus?
  60. 60. Warby Parker Feature
  61. 61. Amazon Feature
  62. 62. MeasureKit Focus
  63. 63. Challenges of AR
  64. 64. Challenges of AR • Onboarding • Immersion • Interaction • Error Handling • …
  65. 65. Onboarding Awareness and usage of AR
  66. 66. AR Badge Icon-Only
  67. 67. Onboarding Language Do Don't Unable to find a surface. Try moving to the side or repositioning your phone. Unable to find a plane. Adjust tracking. Tap a location to place the [name of object to be placed]. Tap a plane to anchor an object. Try turning on more lights and moving around. Insufficient features. Try moving your phone slower. Excessive motion detected.
  68. 68. Immersion How do you make the experience convincing?
  69. 69. Interaction Adding and Manipulating Objects, Controlling Characters
  70. 70. More than Gestures
  71. 71. Error Handling Get me out of here!
  72. 72. Helpful Error Messages Problem Possible suggestion Insufficient features detected Try turning on more lights and moving around. Excessive motion detected Try moving your phone slower. Surface detection takes too long Try moving around, turning on more lights, and making sure your phone is pointed at a sufficiently textured surface.
  73. 73. Thank you.
  74. 74. Your advice is welcome Tell me how I could make this presentation more useful to you twitter.com/lmjabreu Luis Abreu, Sr. UX Designer, ribot.co.uk

×