Downloaded 16 times
![Alexa Authorization
@IBAction func tapLoginButton(_ sender: Any) {
let SCOPE_DATA = "{alexa:all: {
productID:プロダクトID,
productInstanceAttributes: {
{deviceSerialNumber:デバイスシリアル番号}
}
}
AIMobileLib.authorizeUser(forScopes: ["alexa:all"],
delegate: self,
options: [kAIOptionScopeData:SCOPE_DATA])
}
開発者ポータル](https://image.slidesharecdn.com/developers-170701024155/75/Developers-io-2017-iPhone-Alexa-Lex-Polly-46-2048.jpg)
Uploaded byShinichi Hirauchi
Developers.io 2017 iPhoneによるAlexa/Lex/Pollyを利用した 音声対応クライアントの作成方法
1. The document discusses methods for creating voice-enabled clients using Alexa, Lex, and Polly services on iPhone. 2. It begins with introductions and an agenda, then covers the basics of each service including architectures, endpoints, interfaces, registration, and authorization processes. 3. The document also provides examples of implementing voice clients using the AWS mobile SDK for iOS for Lex, and discusses using session attributes with Lex.
Developers.io 2017 iPhoneによるAlexa/Lex/Pollyを利用した 音声対応クライアントの作成方法
- 1.
- 2.
- 3. アジェンダ 1. Overview 2. Alexa 3.Lex 4. Polly 5. Summary
- 4. アジェンダ 1. Overview 2. Alexa 3.Lex 4. Polly 5. Summary
- 5.
- 6.
- 7.
- 8.
- 9.
- 10.
- 11.
- 12.
- 13. Alexa Alexa VoiceService https://developer.amazon.com/public/solutions/alexa/alexa-voice-service/content/avs-api-overview
- 14. Alexa Alexa VoiceService http://dev.classmethod.jp/smartphone/alexa-client-friendly-voice-assistant/
- 15.
- 16. Alexa Endpoints/Protocol Region Supported Countries URL North AmericaUS https://avs-alexa-na.amazon.com Europe UK, Germany https://avs-alexa-eu.amazon.com
- 17.
- 18.
- 19.
- 20.
- 21.
- 22.
- 23. Alexa Interface Interface Ddescription SpeechSynthesizerAlexaのスピーチインターフェース SpeechRecognizer AVSのコアインターフェース 各ユーザ発話は、認識イベントを利⽤する Speaker ミュートやミュート解除を含む、デバイスやアプリケーションの⾳量コントロールの ためのインターフェイス Settings ロケールなど、製品のAlexa設定を管理するためのインタフェース PlaybackController ボタンアフォーダンスを介して再⽣キューをナビゲートするためのインターフェイス AudioPlayer オーディオ再⽣を管理および制御するためのインターフェイス Alerts タイマーとアラームの設定、停⽌、および削除のためのインターフェース System Alexaにクライアント情報を提供するためのインタフェース
- 24. Alexa Interface SpeechRecognizer Interface Event/Directive Recognize Eventユーザ⾳声の送信 StopCapture Directive 録⾳停⽌指⽰ ExpectSpeech Directive 録⾳開始指⽰（会話継続） ExpectSpeechTimedOut Event タイムアウト
- 25. Alexa Interface SpeechSynthesizer Interface Event/Directive Speak DirectiveAlexaの送話 SpeechStarted Event 再⽣開始 SpeechFinished Event 再⽣終了
- 26.
- 27. Alexa Interface Event CodeDirective 1 録⾳開始 2 録⾳終了 3 SpeechRecognizer.Recognize + 録⾳⾳声 200 SpeechSynthesizer.Speak + Alexa⾳声 4 SpeechSynthesizer.SpeechStarted 204 会話が継続する場合 SpeechRecognizer.ExpectSpeech 会話が継続しない場合 DIRECTIVEなし 5 再⽣開始 6 再⽣終了 7 SpeechSynthesizer.SpeechFinished 204 SpeechRecognizer.ExpectSpeechが返っている場合は、１に戻る
- 28.
- 29.
- 30.
- 31.
- 32.
- 33.
- 34.
- 35.
- 36.
- 37.
- 38.
- 39.
- 40.
- 41.
- 42.
- 43.
- 44.
- 45. Alexa Authorization class AppDelegate: UIResponder, UIApplicationDelegate{ func application(_ application: UIApplication, open url: URL, sourceApplication: String?, annotation: Any) -> Bool { return AIMobileLib.handleOpen(url, sourceApplication: sourceApplication) }
- 46. Alexa Authorization @IBAction functapLoginButton(_ sender: Any) { let SCOPE_DATA = "{alexa:all: { productID:プロダクトID, productInstanceAttributes: { {deviceSerialNumber:デバイスシリアル番号} } } AIMobileLib.authorizeUser(forScopes: ["alexa:all"], delegate: self, options: [kAIOptionScopeData:SCOPE_DATA]) } 開発者ポータル
- 47.
- 48.
- 49.
- 50.
- 51.
- 52.
- 53.
- 54.
- 55.
- 56. Lex Endpoints/API Service RegionURL Model building service US East (N.Virginia) https://models.lex.us-east-1.amazonaws.com Runtime service US East (N.Virginia) https://runtime.lex.us-east-1.amazonaws.com
- 57.
- 58.
- 59. Lex Endpoints/API PostContent Sends user input (text or speech) to Amazon Lex PostTextSends user input (text-only) to Amazon Lex POST /bot/botName/alias/botAlias/user/userId/content HTTP/1.1 x-amz-lex-session-attributes: sessionAttributes Content-Type: contentType Accept: accept inputStream POST /bot/botName/alias/botAlias/user/userId/text HTTP/1.1 Content-type: application/json { "inputText": "string", "sessionAttributes": { "string" : "string" } }
- 60.
- 61. Lex AWS mobileSDK for iOS
- 62. Lex AWS mobileSDK for iOS http://dev.classmethod.jp/smartphone/amazon-lex-ios-sdk/ 1. pod install 2. マイク利⽤許可（info.plist） 3. CognitoによるIdentity発⾏とLexの初期化 4. AWSLexVoiceBottn
- 63. Lex AWS mobileSDK for iOS source 'https://github.com/CocoaPods/Specs.git’ target 'BotSampleApp' do platform :ios, '9.0’ use_frameworks! pod 'AWSLex’ pod 'AWSCognito’ end
- 64. Lex AWS mobileSDK for iOS <key>NSMicrophoneUsageDescription</key> <string>For interaction with Amazon Lex</string>
- 65. Lex AWS mobileSDK for iOS let poolId = "us-east-1:xxxxxxxx-xxxx-xxxx-xxxx-xxxxxxxx" let credentialsProvider = AWSCognitoCredentialsProvider(regionType:.USEast1,identityPoolId:poolId) let configuration = AWSServiceConfiguration(region:.USEast1, credentialsProvider:credentialsProvider) AWSServiceManager.default().defaultServiceConfiguration = configuration let BotName = “LexSample" let BotAlias = “$LATEST" let chatConfig = AWSLexInteractionKitConfig.defaultInteractionKitConfig(withBotName: BotName, botAlias: BotAlias) AWSLexInteractionKit.register(with: configuration!, interactionKitConfiguration: chatConfig, forKey: "AWSLexVoiceButton") AWSLexInteractionKit.register(with: configuration!, interactionKitConfiguration: chatConfig, forKey: "chatConfig") cognito Lex
- 66. Lex AWS mobileSDK for iOS
- 67. Lex AWS mobileSDK for iOS http://dev.classmethod.jp/smartphone/amazon-lex-ios-sdk/
- 68. Lex AWS mobileSDK for iOS
- 69. Lex AWS mobileSDK for iOS
- 70. Lex AWS mobileSDK for iOS etc.
- 71. Lex AWS mobileSDK for iOS • AWSLexInteractionDelegate • AWSLexAudioPlayerDelegate • AWSLexMicrophoneDelegate
- 72. Lex AWS mobileSDK for iOS Fullfillment switchMode InteractionDelegate
- 73. Lex AWS mobileSDK for iOS started finished AudioPlayerDelegate
- 74. Lex AWS mobileSDK for iOS start end SoundLevelChaned MicrophoneDelegate
- 75.
- 76.
- 77.
- 78.
- 79.
- 80.
- 81.
- 82. Lex SessionAttribute { "currentIntent": { "name": "intent-name", "slots": {"slot-name": "value",}, "confirmationStatus": "None, Confirmed,or Denied (intent confirmation, if configured)", }, "bot": { "name": "bot-name", "alias": "bot-alias", "version": "bot-version" }, "userId": "User ID specified in the POST request to Amazon Lex.", "inputTranscript": "Text used to process the request", "invocationSource": "FulfillmentCodeHook or DialogCodeHook", "outputDialogMode": "Text or Voice, based on ContentType request header in runtime API request", "sessionAttributes": { "key1": "value1", "key2": "value2" } } Lambda Input sessionAttribute http://docs.aws.amazon.com/ja_jp/lex/latest/dg/lambda-input-response-format.html
- 83.
- 84.
- 85.
- 86.
- 87.
- 88.
- 89.
- 90.
- 91. Polly AWS mobileSMD source 'https://github.com/CocoaPods/Specs.git’ target 'BotSampleApp' do platform :ios, '9.0’ use_frameworks! pod 'AWSPolly’ pod 'AWSCognito’ end
- 92. Polly AWS mobileSMD let input = AWSPollySynthesizeSpeechURLBuilderRequest() input.text = textView.text input.outputFormat = AWSPollyOutputFormat.mp3 input.voiceId = AWSPollyVoiceId.joanna let builder = AWSPollySynthesizeSpeechURLBuilder.default().getPreSignedURL(input) builder.continueOnSuccessWith { (awsTask: AWSTask<NSURL>) -> Any? in let url = awsTask.result! self.audioPlayer.replaceCurrentItem(with: AVPlayerItem(url: url as URL)) self.audioPlayer.play() return nil } http://dev.classmethod.jp/smartphone/amazon-polly-sdk/ AWSPollySynthesizeSpeechURLBuilderRequest テキスト 声の種類 AVFoundation.AudioPlayer
- 93.
- 94.
- 95.
- 96. Polly AWS mobileSMD ⾔語24 声の種類
- 97.
- 98.
- 99.
- 100.