Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

コンピューターと対話する - Conversation as a platform -

333 views

Published on

人口知能やIoT、ロボットなど、時間、場所、言語の壁を越えられるコンピューターシステムをどうやって開発することが出来るのか、マイクロソフトの最新技術を紹介しながらご説明します。

Published in: Technology
  • Be the first to comment

コンピューターと対話する - Conversation as a platform -

  1. 1. #azurejp https://www.facebook.com/dahatake/ https://twitter.com/dahatake/ https://github.com/dahatake/ https://daiyuhatakeyama.wordpress.com/
  2. 2. mid-80s PC mid-90s Web mid-00s スマート フォン mid-10s メッセージング
  3. 3. James Whittaker Fri 2/23/2013 4:35 PM Jennifer Whittaker OF Monsters And Men Coming! Hey Dad, One of my favorite bands, Of Monsters And Men, is coming to the Paramount Theater in May. OMG!!! I WANT to seem them and would LOVE to see them with my concert buddy!     Father and daughter night out (your treat…lucky!) Let me know…, NOW!!!!!!!! ;) TTYL, Jen Action Broker
  4. 4. James Whittaker Fri 2/23/2013 4:35 PM Jennifer Whittaker OF Monsters And Men Coming! Hey Dad, One of my favorite bands, Of Monsters And Men, is coming to the Paramount Theater in May. OMG!!! I WANT to seem them and would LOVE to see them with my concert buddy!     Father and daughter night out (your treat…lucky!) Let me know…, NOW!!!!!!!! ;) TTYL, Jen Message
  5. 5. James Whittaker Fri 2/23/2013 4:35 PM Jennifer Whittaker OF Monsters And Men Coming! Hey Dad, One of my favorite bands, Of Monsters And Men, is coming to the Paramount Theater in May. OMG!!! I WANT to seem them and would LOVE to see them with my concert buddy!     Father and daughter night out (your treat…lucky!) Let me know…, NOW!!!!!!!! ;) TTYL, Jen Message Band Overview Buy Music Top Videos Similar Artists biography After winning the nationwide 2010 battle-of- the-bands competition Musiktilraunir in their native Iceland, six-piece chamber pop group Of Monsters and Men were hailed as "the new Arcade Fire" in Rolling Stone magazine. A bidding war ensued, and the group signed with Universal Music Group. In the beginning of 2012, a four-song EP titled Into the Woods was issued as a preview to their full-length debut, My Head Is an Animal, which was released in the States that spring.
  6. 6. James Whittaker Fri 2/23/2013 4:35 PM Jennifer Whittaker OF Monsters And Men Coming! Hey Dad, One of my favorite bands, Of Monsters And Men, is coming to the Paramount Theater in May. OMG!!! I WANT to seem them and would LOVE to see them with my concert buddy!     Father and daughter night out (your treat…lucky!) Let me know…, NOW!!!!!!!! ;) TTYL, Jen Message Overview Buy Tickets Seating Chart Maps & Directions Nearby Seattle, WA 901 Pine Street 98101 An iconic venue in the heart of Seattle, the Paramount Theater presents the best in Broadway shows and live entertainment. Originally opened in 1928 the theater has been restored and maintained as one of Seattle's premier entertainment venues.
  7. 7. James Whittaker Fri 2/23/2013 4:35 PM Jennifer Whittaker OF Monsters And Men Coming! Hey Dad, One of my favorite bands, Of Monsters And Men, is coming to the Paramount Theater in May. OMG!!! I WANT to seem them and would LOVE to see them with my concert buddy!     Father and daughter night out (your treat…lucky!) Let me know…, NOW!!!!!!!! ;) TTYL, Jen Message Overview Buy Tickets Seating Chart Maps & Directions Nearby Sunday, April 2nd Nick Cave Sunday, April 10th Jillian Michaels Wednesday, April 13th Chris Tucker April 16th – April 23rd Black Watch May 1st – May 5th Black Watch Friday, May 11th Russell Peters Tuesday, May 14th Of Monster And Men
  8. 8. コミュニケーションを解析し、 そのコンテキストを類推する。= Know すぐに次の行動に移る事ができる。 = Do
  9. 9. 『夏休みの 予定を 立てませんか? 』
  10. 10. Flight Continued
  11. 11. 5
  12. 12. ワークフローの中心たる コンテキストがCanvasになる。 次のステップに適切な サービスを探し、 = Know 呼び出す = Do
  13. 13. こんにちは。○○株式会社の□□と申します。 本日△△さんと11:00からお約束しておりま す。 Intent: MTG Entities CompanyName:○○株式会社 VisitorName: □□ RequesterName: △△ MeetingDateTime: Today, 11:00 □□様、お待ちしておりました。 ××番の会議室までお越しください。
  14. 14. Pepper × Azure デバイス エコシステム Power BI を始めとした データ活用エコシステム Device Controller Device Router Application Router 32 インスタンス までスケール可能 Microsoft Azure 繰り返し学習 Power BI Service Cloud AI の利用
  15. 15. EmotionalProductivity 明日の天気は 晴れです。 どこか 出かける予定でもある の? 明日晴れるかなぁ?
  16. 16. 対人間
  17. 17. 旅行 Bot Conversational Agent 宿泊予約 飛行機 の予約 ご挨拶 (Hello!) 会員確認Dialogs/Tasks Parameters (なし) チェックイン 日 チェックアウ ト日 人数 (部屋の種類) 概算見積もり 出発場所 ….. 到着場所 認証 特別オファー
  18. 18. 認証 検索 購入
  19. 19. 認証 検索 購入 いらっしゃい ませ、 畠山さん はい、こちら に。 承りました。 ご利用ありが とうございま
  20. 20. Bot Framework Cortana Your personal assistant Cognitive Services
  21. 21. ダイアログ形式の コミュニケーションを実 装 (C#, Node.js) BOT アプリをメッセージ ングサービスに接続 Bing, Cortana などから利 用できるディレクトリに 登録
  22. 22. http://aka.ms/bf-bc-vstemplate https://aka.ms/bf-bc-emulator https://github.com/Microsoft/botbuilder https://docs.botframework.com/en-us/node/builder/overview/
  23. 23. # データのセット BotData userData = await activity.GetStateClient().BotState.GetUserDataAsync(activity.ChannelId, activity.From.Id); userData.SetProperty<int>("AuthProcess", 0); # セットしたデータの取得 BotData userData = await stateClient.BotState.GetUserDataAsync(activity.ChannelId, activity.From.Id);
  24. 24. 旅行 Bot Conversational Agent 宿泊予約 飛行機 の予約 ご挨拶 (Hello!) 会員確認Dialogs/Tasks Parameters (なし) チェックイン 日 チェックアウ ト日 人数 (部屋の種類) 概算見積もり 出発場所 ….. 到着場所 認証 特別オファー
  25. 25. 画像/ビデオの 読解/顔識別/ 感情判別/OCR 話者識別 音声⇔テキスト 文章解析 文意文脈理解 Web/学術情報 ビックデータ解 析 Bing による検 索
  26. 26. アプリを登録
  27. 27. Intent と Entity を登録 登録した Intent と Entity への対応付けを学習
  28. 28. [LuisModel("78685ddf-f144-4a10-9840-xxxxxxxxxxxx", "0fc3f088e3ab402f822fxxxxxxxxxxxx")] [Serializable] class HelpDeskOrderDialog : LuisDialog<HelpDeskOrder> { [LuisIntent("")] public async Task None(IDialogContext context, LuisResult result) { await context.PostAsync("I'm sorry, I didn't understand you."); context.Wait(MessageReceived); } [LuisIntent("InstallSoftware")] public async Task ProcessInsallSoftware(IDialogContext context, LuisResult result) { string software = result.Entities[0].Entity; await context.PostAsync($"So, you want to install {software}. I will put your request into the system. "); context.Wait(MessageReceived); } …
  29. 29. Microsoft Bot Framework Knowledge Base Azure Search Logic Apps
  30. 30. Azure Search Document DB Azure Media Services Microsoft Cognitive Service Azure Machine Learning Microsoft Bot Framework
  31. 31. 作業不要 自動設定 http://aka.ms/LUISBot
  32. 32. こんにちは。○○株式会社の□□と申します。 本日△△さんと11:00からお約束しておりま す。 Intent: MTG Entities CompanyName:○○株式会社 VisitorName: □□ RequesterName: △△ MeetingDateTime: Today, 11:00 □□様、お待ちしておりました。 ××番の会議室までお越しください。
  33. 33. AI の民主化
  34. 34. ImageNet 最大規模のイメージデータセット – 120万の学習用イメージ、10のテスト用イメージ – 1000 クラス http://image-net.org 28.2 25.8 16.4 11.7 7.3 6.7 5.1 3.5 2010 2011 Utronto 2012 NYU 2013 Oxford 2014 GoogleNet 2014 Human Microsoft 2015
  35. 35. 表現手段
  36. 36. 画像/ビデオの 読解/顔識別/ 感情判別/OCR 話者識別 音声⇔テキスト 文章解析 文意文脈理解 Web/学術情報 ビックデータ解 析 Bing による検 索
  37. 37. 表現手段
  38. 38. Class Outlook Temp. Windy Play Sunny Low Yes No Play Sunny High Yes No Play Sunny High No Play Overcast Low Yes Play Overcast High No Play Overcast Low No No Play Rainy Low Yes Play Rainy Low No ? Sunny Low No label (y) play / no play features outlook, temp, windy values (x) [Sunny, Low, Yes]
  39. 39. Class Outlook Temp. Windy Play Sunny Low Yes No Play Sunny High Yes No Play Sunny High No Play Overcast Low Yes Play Overcast High No Play Overcast Low No No Play Rainy Low Yes Play Rainy Low No ? Sunny Low No
  40. 40. というアルゴリズムを選択した 場合 どの Feature が 何の Value だった ら妥当なのかを 作ってくれる! 複数の Model を 作ってくれる! (個数の指定が可 能)
  41. 41. Input data Data Transformation Train Model Algorithm Split Data Score Model Evaluate Model
  42. 42. #azurejp
  43. 43. © 2016 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION. © 2014 Microsoft Corporation. All rights reserved. Microsoft, Windows and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.
  44. 44. #azurejp

×