The slide for my presentation given in a mobile developer conference about the Siri Shortcuts API

1. Siri, I have a special upgrade
parts for you
MobileConf 2018
Pitiphong Phongpattranont - Mobile Developer at Omise

2. Prelude

3. Since the beginning of iPhone,
every 4 versions, iOS and iOS
SDK will have a new feature/
API which changes the way we
use iPhone forever

4. Multitasking in iOS 4

5. Extensions in iOS 8

6. iOS 12?

7. Custom Intents & Siri Shortcuts
integration

8. With Shortcuts, any app can
exposed quick action to Siri

9. This may be the beginning of a
new era of computer
interactions

10. Let's debunk some myths first

11. Apple is bad at AI because of
their privacy policy

12. – Craig Federighi, Senior Vice President, Software Engineering at Apple
“There's this idea that, well, if you don't have the data, how would
you ever learn? Well, turns out, if you want to get pictures of
mountains, you don't need to get it out of people's personal photo
libraries”

13. Google is good at AI because
they have a lot of users' data

14. – John Giannandrea, Chief of Machine Learning and AI Strategy at Apple
“Well you don’t need quite as much data as you think you do and in
fact there are lots and lots of large data sets which are open.”

15. – John Giannandrea, AI chief at Google
“Well you don’t need quite as much data as you think you do and in
fact there are lots and lots of large data sets which are open.”

16. Apple is late at AI

17. Apple has been working and
using Machine Learning (AI) in
lots of their products

18. What is Siri?

19. At the beginning, It was an
app/service as a voice
assistant

20. And then, Apple acquired it
and integrated it into iOS

21. Siri was the voice assistant

22. Siri has been improved and
upgraded into a Virtual
Assistant

23. Not just being a Voice
Assistant anymore

24. Nowadays Siri does not only
talk to you but also knows a lot
of you

25. Context

26. Information

27. Many things about you

28. So Siri can helps you in many
ways

29. Does a lot of suggestions in
many aspects

30. Now, let's talk about the
upgrading parts

31. Siri Shortcuts

32. “With Shortcuts, any app can
exposed quick action to Siri”

33. Siri can learn about user and
suggests some actions
throughout the iOS

34. In the form of
Siri Shortcuts

35. In order to have a better Siri,
Siri need to know more

36. You need to give Siri
information

37. The better and more
informations you gave to Siri,
the better it get

38. What Makes a Great Shortcut?
• Accelerate the user to perform a key function of your app
• Be of persistent interest to the user
• Be executable at any time

39. Working on Siri Shortcuts

40. Define Shortcut

41. Donate ShortcutDefine Shortcut

42. Donate ShortcutDefine Shortcut Handle Shortcut

43. Define and Donate?

44. There are 2 ways

45. NSUserActivity

46. let userActivity = NSUserActivity(activityType:
"com.myapp.name.my-activity-type")
userActivity.isEligibleForSearch = true
userActivity.isEligibleForPrediction = true
userActivity.title = "Activity"
userActivity.userInfo = ["key": "value"]
userActivity.suggestedInvocationPhrase = "Let's do it"

47. let userActivity = NSUserActivity(activityType:
"com.myapp.name.my-activity-type")
userActivity.isEligibleForSearch = true
userActivity.isEligibleForPrediction = true
userActivity.title = "Activity"
userActivity.userInfo = ["key": "value"]
userActivity.suggestedInvocationPhrase = "Let's do it"

48. let userActivity = NSUserActivity(activityType:
"com.myapp.name.my-activity-type")
userActivity.isEligibleForSearch = true
userActivity.isEligibleForPrediction = true
userActivity.title = "Activity"
userActivity.userInfo = ["key": "value"]
userActivity.suggestedInvocationPhrase = "Let's do it"

49. Intents

50. You can now define your own
custom Intent 🎉 🎉 🎉

52. Generated Code
public class OrderSoupIntent: INIntent {
public var items: [INObject]?
public var deliveryLocation: CLPlacemark?
}
public protocol OrderSoupIntentHandling: NSObjectProtocol
{
public func handle(intent: OrderSoupIntent, completion:
@escaping (OrderSoupIntentResponse) -> Void)
optional func confirm(intent: OrderSoupIntent,
completion:
@escaping (OrderSoupIntentResponse) -> Void)
}

53. Donation
// Donate your shortcut
let intent = OrderSoupIntent()
intent.items = order.items.map({
INObject(identifier: $0.id.uuidString,
display: $0.menuItem.displayName)
})
intent.deliveryLocation = order.destinationLocation
let interaction = INInteraction(intent: intent, response: nil)
interaction.donate { error in
// Handle error
}

54. Handle
// Handle your shortcut
func application(_ application: UIApplication,
continue userActivity: NSUserActivity,
restorationHandler: @escaping ([Any]?) -> Void)
-> Bool {
if userActivity.activityType == "OrderSoupIntent",
let intent = userActivity.interaction?.intent as?
OrderSoupIntent {
// Show ordering UI, pre-populated with the fields
from the intent
}
}

56. Handle
// Handle your shortcut
class IntentHandler: INExtension, OrderSoupIntentHandling {
func confirm(intent: OrderSoupIntent, completion:
(OrderSoupIntentResponse) -> Void) {
completion(OrderSoupIntentResponse(code: .ready,
userActivity: nil))
}
func handle(intent: OrderSoupIntent, completion: (
OrderSoupIntentResponse) -> Void) {
// Order the soup
completion(OrderSoupIntentResponse(code: .success,
userActivity: nil))
}
}

57. Choosing an Adoption Strategy
Use NSUserActivity if your shortcut:
• Opens something in your app
• Represents showing items that you index in Spotlight or offer for Handoff

58. Choosing an Adoption Strategy
For the best experience, adopt Intents. Intents-based shortcuts can:
• Run inline, without launching your app
• Include custom voice response or a custom UI
• Include granular predictions

59. Limitation

60. Intents cannot accept or pass
any parameters/data at the
moment

61. But we hope that it would be
able to do that in the future

62. For more information, please
visit https://
developer.apple.com/

63. Why do we need to support
this in our apps?

64. In my opinion, the integration
of apps and running OS will be
more and more integrated

65. It has been started for several
years already

66. And it’s still in progress

67. And it will continue for a long
time in the future

68. This means that just having a
mobile app without the OS
integration will not be enough
anymore

69. Except you are a huge gigantic
service which everyone uses
(I’m looking at you, Facebook)

70. I think and hope that it would
become one of the
requirements in the future

71. Even it’s not a requirement at
the moment but it will give a lot
of value to your app

72. Especially this Siri Shortcuts

73. Does it worth the effort?

74. YES!!!

75. Siri Shortcuts is designed for
every from beginner to power
users

83. So let’s upgrade Siri with your
app

84. And users will love your apps

86. Q&A

87. Thank you