Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

AWS 機器學習 I ─ 人工智慧 AI

493 views

Published on

講師: Yian Han, Senior Business Development Manager, AWS
AWS offers a family of intelligent services that provide cloud-native machine learning and deep learning technologies to address your different use cases and needs. For developers looking to add managed AI services to their applications, AWS brings natural language understanding (NLU) and text-to-speech (TTS) with Amazon Polly, visual search and image recognition with Amazon Rekognition, and developer-focused machine learning with Amazon Machine Learning. In this talk you will learn about these services and see demos of their capabilities

  • Be the first to comment

AWS 機器學習 I ─ 人工智慧 AI

  1. 1. AWS 機器學習 I ─ 人工智慧 AI Name: Yi-an Han Department: Senior Business Development Manager Company: Amazon Web Services
  2. 2. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. What to Expect from the Session Why AI? Amazon AI Service Introduction • Amazon Polly • Amazon Lex • Amazon Rekognition
  3. 3. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. AWS offers a range of tools to make AI/ML more accessible PollyLex Rekognition Deep Learning FrameworksMachine Learning PlatformsAmazon AI/ML Services Usability/simplicity: leverages AWS AI/ML expertise Greater control: customer-specific models These solutions are underpinned by proven, scalable AWS products and services AWS Greengrass AWS IoT AWS Lambda Amazon EC2 (P2 and G2 GPUs) Amazon S3 Amazon DynamoDB Amazon Redshift Amazon EC2 (CPUs) Amazon EC2 (ENA) Amazon ML Spark & EMR Kinesis Batch ECS MXNet, TensorFlow, Theano, Caffe, Torch
  4. 4. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. A Flywheel For Data Machine Learning Deep Learning AI More Users Better Products More Data Better Analytics Object Storage Databases Data warehouse Streaming analytics BI Hadoop Spark/Presto Elasticsearch Click stream User activity Generated content Purchases Clicks Likes Sensor data
  5. 5. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Machine Learning & Artificial Intelligence Big Data More Users Better Products More Data Better Analytics A Flywheel For Data
  6. 6. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Polly
  7. 7. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Converts text to life-like speech 47 voices 24 languages Low latency, real time Fully managed Polly: Life-like Speech Service Voice Quality & Pronunciation 1. Automatic, Accurate Text Processing 2. Intelligible and Easy to Understand 3. Add Semantic Meaning to Text 4. Customized Pronunciation Articles and Blogs Training Material Chatbots (Lex) Public Announcements
  8. 8. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. こんにちは, 私は韓さんです je t'aime plus que tout au monde Muchas gracias! Chao.
  9. 9. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Today in Las Vegas, NV it's 54°F
  10. 10. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. "We live for the music", live from the Madison Square Garden
  11. 11. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. St. Mary's Church is at 226 St. Mary's St.
  12. 12. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. SSML Support
  13. 13. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. <speak> My name is Kuklinski. It is spelled <prosody rate='x-slow'> <say-as interpret-as="characters">Kuklinski</say-as> </prosody> </speak> Improving Text to Speech with SSML Speech Synthesis Markup Language • W3C recommendation, an XML-based markup language for speech synthesis applications My name is Kuklinski. It is spelled Kuklinski.
  14. 14. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Richard’s number is 2025551212
  15. 15. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Custom Pronunciation with Lexicons Enables developers to customize the pronunciation of words or phrases Welcome to W3C community. <lexeme> <grapheme>W3C</grapheme> <alias>World Wide Web Consortium</alias> </lexeme>
  16. 16. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Jesus Manuel Corona is a professional footballer
  17. 17. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Polly: Whisper Voice and Speech Marks Whisper SSML effect: <amazon:effect name="whispered"> Synchronize speech with visual content for more lifelike speech behavior from characters, avatars, and text • Request an additional stream of TTS metadata containing sentence word timings • Use the metadata stream alongside the synthesized speech audio stream to sync audio and visual
  18. 18. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Still lost in the forest, Marry started to whisper: "Don't make any noise, they will find us"
  19. 19. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Duolingo voices its language learning service Using Polly Duolingo is a free language learning service where users help translate the web and rate translations. With Amazon Polly our users benefit from the most lifelike Text-to-Speech voices available on the market. Severin Hacker CTO, Duolingo ” “ • Spoken language crucial for language learning • Accurate pronunciation matters • Faster iteration thanks to TTS • As good as natural human speech
  20. 20. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Polly (Salli) Duolingo Old voice Winner! ”The new voice is a huge improvement ! I really like it, the old one was terrible at times.”
  21. 21. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Lex
  22. 22. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. 1st Gen: Machine-oriented interactions 2nd Gen: Control-oriented & translated 3rd Gen: Intent-oriented The Advent Of Conversational Interactions
  23. 23. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. When would you like to fly? Next Sunday Departure: 6/11/2017 Amazon Lex: Conversational Chatbots Heathrow, please Destination: LHR I’d like to book a flight to London Sure! Do you want to fly to Heathrow or Gatwick?
  24. 24. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
  25. 25. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Voice & Text “Chatbots” Powers Alexa Voice interactions on mobile, web & devices Text interaction with Slack & Messenger Enterprise Connectors (with more coming) Salesforce Microsoft Dynamics Marketo Zendesk Quickbooks Hubspot Lex: Build Natural, Conversational Interactions In Voice & Text Improving human interactions… • Contact, service, and support center interfaces (text + voice) • Employee productivity and collaboration (minutes into seconds)
  26. 26. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Origin Destination Departure Date Flight Booking “Book a flight to London” Automatic Speech Recognition Natural Language Understanding Book Flight London Utterances Flight booking London Heathrow Intent / Slot model London Heathrow
  27. 27. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Origin Destination Departure Date Flight Booking “Book a flight to London” Automatic Speech Recognition Natural Language Understanding Book Flight London Utterances Flight booking London Heathrow Intent / Slot model London Heathrow LocationLocation Seattle
  28. 28. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Origin Destination Departure Date Flight Booking “Book a flight to London” Automatic Speech Recognition Natural Language Understanding Book Flight London Utterances Flight booking London Heathrow Intent / Slot model London Heathrow LocationLocation Seattle Prompt “When would you like to fly?” “When would you like to fly?” Polly
  29. 29. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Origin Destination Departure Date Flight Booking London Heathrow Seattle Prompt “When would you like to fly?” “When would you like to fly?” Polly “Next Friday”
  30. 30. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Origin Destination Departure Date Flight Booking “Next Friday” Automatic Speech Recognition Next Friday Utterances Natural Language Understanding Flight booking 02 / 24 / 2017 Intent / Slot model London Heathrow Seattle 02/24/2017
  31. 31. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Origin Destination Departure Date Flight Booking “Next Friday” Automatic Speech Recognition Next Friday Utterances Natural Language Understanding Flight booking 02 / 24 / 2017 Intent / Slot model London Heathrow Seattle 02/24/2017 Confirmation “Your flight is booked for next Friday” “Your flight is booked for next Friday” Polly
  32. 32. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Origin Destination Departure Date Flight Booking “Next Friday” Automatic Speech Recognition Next Friday Utterances Natural Language Understanding Flight booking 02 / 24 / 2017 Intent / Slot model London Heathrow Seattle 02/24/2017 Hotel Booking
  33. 33. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Fulfillment AWS Lambda Integration Return to Client User input parsed to derive intents and slot values Output returned to client for further processing Intents and slots passed to AWS Lambda function for business logic implementation
  34. 34. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Lex Components End to End Speech to Intent ASR+NLU integrated into one API Dialog Management Native support & maintains context Text to Speech Amazon Polly integrated into API Business Logic Native integration with AWS Lambda Deployment One click deployment Security Encrypted data in transit & at rest Scale Completely managed service Analytics Monitor and improve
  35. 35. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Lex Console: Designed for Builders
  36. 36. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Save, Build, Test, and Publish Save Build Preserve the current state on the server Create versions you can test Publish Create a version of your bot with an alias for your clients Test Test your bot in a chat window on the console
  37. 37. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Versioning and Alias Support AliasVersioning v1 v2 v3 latest • Supported for Intents, Slots and Bots • Enables multi-developer environment • Rollback to previous versions v1 Dev v2 Stage v3 Prod • Deploy different aliases to different platforms • Run different stacks for dev, stage and prod environments • Target different user groups with different aliases
  38. 38. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Lex: Use Cases Informational Bots Manage everyday consumer requests Application Bots Build powerful interfaces to mobile applications • News updates • Weather information • FAQs …. • Book tickets • Order food • Manage bank accounts …. Enterprise Productivity Bots Streamline enterprise work activities • Check sales numbers • Marketing performance • Inventory status …. Internet of Things (IoT) Bots Enable conversational interfaces for device interactions • Wearables • Appliances • Auto ….
  39. 39. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Use Case: Employee Assistance File time off Sure. Starting what date July 1st How many days do you plan to take off? Book a conference room Sure. What time? Tomorrow Noon I found a room on the 2nd floor. Should I book it? Reduce employee time and effort in everyday tasks
  40. 40. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Employee Assistance: Design Welcome Intent Conf Room IntentTime off Intent Expense Report Intent :Record time off I will be out July 1st – July 10th Add PTO in July …… Utterances Start Date: AMAZON.DATE End Date: AMAZON.DATE …… Slots File time off Book a conference room Can you find a room for 10 Need a conf room for my meeting Utterances Conf Room: ConfRoomList Time: AMAZON.DATE Duration: AMAZON.NUMBER Slots Book a conference room Create expense report
  41. 41. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Conversation context Slot Values Intents Prompts Confirmations Session Attributes Slot Value Slot Value Conversation Yes/No Session Attributes Intent Prompt Lex maintains context by storing data throughout the conversation Confirm
  42. 42. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Dynamic conversation flow Conversation Session Attributes Second Intent Switch Intents First Intent Session Attributes Conversation Chain Intents Dine In Dine In or Take out? Anything else today? Book a Car Take out
  43. 43. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Chatbot Step-by-Step Webinar Amazon Lex 提供與 Slack、Twilio、Marketo、Salesforce、Quickbooks、Microsoft Dynamics、Zendesk 和 Hubspot 的整合。 除此之外,您還可以透過組合 Lex API 和 AWS API Gateway 將 Amazon Lex 與任何 其他應用程式進行集成,毫不費力的將您的聊天機器人擴展到幾乎任何用例。 Link: https://aws.amazon.com/tw/events/webinars/confirmation/ Amazon LexLambda Function Amazon API Gateway End User Twilio Programmable SMS
  44. 44. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Rekognition
  45. 45. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Rekognition: Object & Scene Detection
  46. 46. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Demo
  47. 47. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Age Range 38-59 Beard: False 84.3% Emotion: Happy 86.5% Eyeglasses: False 99.6% Eyes Open: True 99.9% Gender: Male 99.9% Mouth Open: False 86.2% Mustache: False 98.4% Smile: True 95.9% Sunglasses: False 99.8% Bounding Box Height: 0.36716.. Left: 0.40222.. Top: 0.23582.. Width: 0.27222.. Landmarks EyeLeft EyeRight Nose MouthLeft MouthRight LeftPupil RightPupil LeftEyeBrowLeft LeftEyeBrowRight LeftEyeBrowUp : Quality Brightness 52.5% Sharpness 99.9%
  48. 48. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Rekognition: Facial Search Facial comparison Face Search Visual Similarity Search (compare two faces) (compare many faces) (find similar faces)
  49. 49. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Face Comparison
  50. 50. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Facial Search Identify people in images by finding the closest match for an input face image against a collection of stored face vectors • Add friend tagging to social and messaging apps • Assist public safety officers find missing persons • Identify employees as they access sensitive locations • Identify celebrities in historical media archives
  51. 51. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Image Moderation Hierarchical taxonomy Confidence score "ModerationLabels": [ { "Confidence": 82.7555923461914, "Name": "Suggestive", "ParentName": "" }, { "Confidence": 82.7555923461914, "Name": "Female Swimwear or Underwear", "ParentName": "Suggestive" }, { "Confidence": 50.11056137084961, "Name": "Nudity and Sexuality", "ParentName": ""
  52. 52. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Travel and Hospitality Anticipatory guest experiences for hotels using Amazon Rekognition for facial recognition and sentiment capture Kaliber is using Amazon Rekognition to help front desk agents enhance relationships with guests: • Recognize guests early for instant and personalized service • Receive rich, contextualized guest information in real time • Track guest sentiment throughout their stay • Drive an 80% increase in guest satisfaction scores
  53. 53. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
  54. 54. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Media Case Study Identify who is on camera at what time for each of 8 networks so that recorded video streams can be indexed and searched Video frame-sampling facial recognition solution using Amazon Rekognition: • Indexed 97,000 people into a face collection in 1 day • Sample frames every 6 secs and test for image variance • Upload images to S3 and call Rekognition to find best facial match • Store time stamp and faceID metadata
  55. 55. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Rekognition Customers Media and Entertainment Public Safety Law Enforcement Digital Asset Management Influencer Marketing Digital Advertising Education Consumer Storage
  56. 56. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
  57. 57. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
  58. 58. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon AI Intelligent Services Powered By Deep Learning https://aws.amazon.com/blogs/ai/ https://aws.amazon.com/amazon-ai/ Using Amazon Polly to Provide Real-Time Home Monitoring Alerts: https://aws.amazon.com/blogs/ai/using-amazon-polly-to-provide-real-time-home-monitoring-alerts/ Build a Voice Kit with Amazon Lex and a Raspberry Pi: https://aws.amazon.com/blogs/ai/build-a- voice-kit-with-amazon-lex-and-a-raspberry-pi/ Create a Question and Answer Bot with Amazon Lex and Amazon Alexa: https://aws.amazon.com/blogs/ai/creating-a-question-and-answer-bot-with-amazon-lex-and-amazon-alexa/ Build Your Own Face Recognition Service Using Amazon Rekognition: https://aws.amazon.com/blogs/ai/build-your-own-face-recognition-service-using-amazon-rekognition/
  59. 59. Thank you! Yi-an Han yianhan@amazon.com

×