Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Introduction to AWS ML Application Services - BDA202 - Anaheim AWS Summit

313 views

Published on

Amazon brings computer vision, natural language processing, speech recognition, text-to-speech, and machine translation within the reach of every developer. API-driven application services enable developers to easily plug in pre-built AI functionality into their applications and automate manual workflows. Join us to learn more about new language capabilities and text-in-image extraction. We also share how others are building the next generation of intelligent apps that can see, hear, speak, understand, and interact with the world around us.

  • Be the first to comment

  • Be the first to like this

Introduction to AWS ML Application Services - BDA202 - Anaheim AWS Summit

  1. 1. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. David Pearson Business Development, ML Application Services BDA202 Introduction to AWS ML Application Services
  2. 2. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Machine Learning at Amazon: A long heritage Voice-driven interactions Fulfillment automation & inventory management Personalized recommendations Drones Inventing entirely new customer experiences
  3. 3. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. ML @ AWS OUR MISSION Put machine learning in the hands of every developer and data scientist
  4. 4. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. The AWS Machine Learning Stack FRAMEWORKS KERAS EC2 GPUs P3 Machine Learning AMIs INFRASTRUCTURE & EC2 CPUs EDGEIOT C5
  5. 5. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. The AWS Machine Learning Stack PLATFORMS Amazon SageMaker Amazon Mechanical Turk AWS DeepLens FRAMEWORKS KERAS EC2 GPUs P3 Machine Learning AMIs INFRASTRUCTURE & EC2 CPUs EDGEIOT C5
  6. 6. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. The AWS Machine Learning Stack FRAMEWORKS KERAS EC2 GPUs P3 Machine Learning AMIs INFRASTRUCTURE & EC2 CPUs EDGEIOT C5 PLATFORMS Amazon SageMaker Amazon Mechanical Turk AWS DeepLens APPLICATION SERVICES A M A Z O N R E K O G N I T I O N A M A Z O N R E K O G N I T I O N V I D E O A M A Z O N P O L L Y A M A Z O N T R A N S C R I B E A M A Z O N T R A N S L A T E A M A Z O N C O M P R E H E N D A M A Z O N L E X
  7. 7. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. AWS DeepLens architecture Video out Data out I N F E R E N C E D E P L O Y P R O J E C T S Manage device Security Console Project Management AWS Cloud Intel: Model Optimizer cIDNN and Driver
  8. 8. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Fast ML Build machine learning-based applications and features in less than a day
  9. 9. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Building blocks of fast ML APPLICATION SERVICES A M A Z O N R E K O G N I T I O N A M A Z O N R E K O G N I T I O N V I D E O A M A Z O N P O L L Y A M A Z O N T R A N S C R I B E A M A Z O N T R A N S L A T E A M A Z O N C O M P R E H E N D A M A Z O N L E X
  10. 10. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Deep learning-based image and video analysis service Extract metadata from rich media Used by customers in multiple industries: o Media & entertainment, security & safety, travel & hospitality o Digital advertising & marketing, social media, online dating o Education, automotive, financial services, facilities mgt ++ Fast ML: Build applications that see Amazon Rekognition APPLICATION SERVICES A M A Z O N R E K O G N I T I O N A M A Z O N R E K O G N I T I O N V I D E O A M A Z O N P O L L Y A M A Z O N T R A N S C R I B E A M A Z O N T R A N S L A T E A M A Z O N C O M P R E H E N D A M A Z O N L E X
  11. 11. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Rekognition Image Unsafe image detection Text in imageCelebrity recognition Facial analysis Face matchObject detection
  12. 12. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Rekognition Video Facial analysis Live stream face matchObject & activity detection Unsafe image detectionCelebrity recognition Motion path detection
  13. 13. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Celebrity guests at the Royal Wedding • “Who’s Who Live” function • Celebrity guests identified in live stream • On-screen captions of attendee names on arrival
  14. 14. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
  15. 15. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Rekognition and sports media tagging • Player recognition • Motion path tracking • Objects, activities, and event detection
  16. 16. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. • Turn text into lifelike speech • 53 voices, 26 languages, 16 AWS regions • Lip-syncing & text highlighting • Fine-grained voice control • Custom vocabularies • Education, publishing, IoT, telephony, gaming ++ Fast ML: Build applications that speak Amazon Polly APPLICATION SERVICES A M A Z O N R E K O G N I T I O N A M A Z O N R E K O G N I T I O N V I D E O A M A Z O N P O L L Y A M A Z O N T R A N S C R I B E A M A Z O N T R A N S L A T E A M A Z O N C O M P R E H E N D A M A Z O N L E X
  17. 17. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Polly – use cases Voiced notifications Special needs AI assistant AI radio announcer Video creation Navigation Podcasting Amazon Polly
  18. 18. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Read me the news A massive 8.2 magnitude earthquake struck in the middle of the Pacific Ocean, roughly 200 miles off Fiji and almost the same distance from Tonga, according to the preliminary report from the US Geological Survey. The earthquake struck just after midday Sunday and was almost 560 kilometers deep, the USGS said. The Pacific Tsunami Warning Center said based on the data available, a destructive Pacific-wide tsunami was not expected, and there was no threat to Hawaii. There were no immediate reports of damage or injuries.
  19. 19. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Multilingual personalized greetings <speak><prosody rate="fast"> Thank you for calling the Island Air rebooking hotline. नम्स्कार्। Island Air में आप का ्वागत है। मैं अदितत, आप कक ककस प्रकार सहाय्ता कर सकती हूँ? </prosody></speak> user_loc=india; user_lang=hindi user_loc=us; user_lang=english
  20. 20. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. • Automated speech recognition service • Support for both regular and telephony audio • Time stamps, confidence scores, and punctuation • Support for English and Spanish, and more to come! • Multiple speaker detection and custom vocabulary • Media, contact centers, security & safety, education ++ Fast ML: Build applications that listen APPLICATION SERVICES A M A Z O N R E K O G N I T I O N A M A Z O N R E K O G N I T I O N V I D E O A M A Z O N P O L L Y A M A Z O N T R A N S C R I B E A M A Z O N T R A N S L A T E A M A Z O N C O M P R E H E N D A M A Z O N L E X Amazon Transcribe
  21. 21. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. AMAZON TRANSCRIBE JSON INPUT VIDEO / AUDIO CONTENT OUTPUT METADATA • START / END TIME • SPOKEN TEXT • CONFIDENCE • PUNCTUATION • SPEAKER ID • CHANNEL ID
  22. 22. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. AMAZON TRANSCRIBE A man down and unwilling to play on without a first five coach hansen brings in lima. Sapporo wanna to fill the void left by baron, leaving dag spot on the wing empty. I just had to do my job. I just had to direct the traffic, get us in the right part of field, and our team will do the rest.
  23. 23. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. AMAZON TRANSCRIBE five-eighth Hansen Lima-Sopoaga Barrett Dagg AllOrNothing.txt Custom vocabulary A man down and unwilling to play on without a first five- eighth coach Hansen brings in Lima-Sopoaga to fill the void left by Barrett, leaving Dagg spot on the wing empty. I just had to do my job. I just had to direct the traffic, get us in the right part of field, and our team will do the rest.
  24. 24. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. • Neural machine translation – fast, affordable, & accurate • 12 languages supported, with more to come • Real-time translation with language detection (via Amazon Comprehend) • Messaging & communications, education, website and content publishing, public safety & security ++ Fast ML: Build multilingual applications Amazon Translate APPLICATION SERVICES A M A Z O N R E K O G N I T I O N A M A Z O N R E K O G N I T I O N V I D E O A M A Z O N P O L L Y A M A Z O N T R A N S C R I B E A M A Z O N T R A N S L A T E A M A Z O N C O M P R E H E N D A M A Z O N L E X
  25. 25. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Translate – supported languages Japanese Traditional Chinese Italian Russian Turkish Czech Arabic Simplified Chinese French German Spanish Portuguese Danish Dutch Finnish Hebrew Polish Swedish
  26. 26. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Use for high-volume and time-sensitive information Share of worldwide digital content Machine translation • User-authored content • Text analytics • Real-time communication • Content discovery Post-edited machine translation • Legal documents • Healthcare documents • Advertising materials
  27. 27. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Real-time translation in chat Amazon Translate
  28. 28. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. • Natural language processing (NLP) service that finds insights and relationships in text • Detect sentiment & language, model documents by topic • Identify entities, key phrases, and syntax • Financial services, healthcare, insurance, government, document classification & search, customer analytics ++ Fast ML: Build applications that understand text APPLICATION SERVICES A M A Z O N R E K O G N I T I O N A M A Z O N R E K O G N I T I O N V I D E O A M A Z O N P O L L Y A M A Z O N T R A N S C R I B E A M A Z O N T R A N S L A T E A M A Z O N C O M P R E H E N D A M A Z O N L E X Amazon Comprehend
  29. 29. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon.com, Inc. is located in Seattle, WA and was founded July 5th, 1994 by Jeff Bezos. Our customers love buying everything from books to blenders at great prices Named entities - Amazon.com: Organization - Seattle, WA: Location - July 5th,1994: Date - Jeff Bezos: Person Key phrases - Our customers - books - blenders - great prices Sentiment Positive Language English Amazon Comprehend – extract insights from text
  30. 30. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Comprehend – Syntax API Our customers love buying everything from books to blenders at great prices Token (word) Part of speech customers Noun love Verb books Noun great Adjective prices Noun
  31. 31. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Supported parts of speech NUM – Numeral O – Other PART – Particle PRON – Pronoun PROPN – Proper noun PUNCT – Punctuation SCONJ – Subordinating conjunction SYM – Symbol VERB – Verb ADJ – Adjective ADP – Ad position ADV – Adverb AUX – Auxiliary CCONJ – Coordinating conjunction DET – Determiner INTJ – Interjection NOUN – Noun
  32. 32. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Popular text analytics use cases Content Personalization: Understand related documents based on entities, phrases, or even topic similarities for trends analysis, to drive content personalization and recommendations Semantic Search: Index entities for boosting and ranking search results Intelligent Data Warehouse: Query unstructured data in relational databases and data lakes and insert the enriched output into a data warehouse Social Analytics: Ingest, process, and analyze trends from entities and sentiment from social media posts across Twitter and Facebook
  33. 33. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. • Create conversational interfaces using voice and text • Embedded ASR and NLU, and works with Alexa • Integrated with messaging applications and call centers • Real-time sentiment detection (via Amazon Comprehend) • Contact centers, enterprise assistants, education, gaming ++ Fast ML: Build applications that communicate Amazon Lex APPLICATION SERVICES A M A Z O N R E K O G N I T I O N A M A Z O N R E K O G N I T I O N V I D E O A M A Z O N P O L L Y A M A Z O N T R A N S C R I B E A M A Z O N T R A N S L A T E A M A Z O N C O M P R E H E N D A M A Z O N L E X
  34. 34. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Lex Scale Business Logic SecurityAnalytics Text to Speech Speech to Intent End to End Native support & maintains context One-click deployment Completely managed service Native integration with AWS Lambda Encrypted data in transit & at rest Monitor and improve Amazon Polly integrated into API ASR + NLU integrated into one API Dialog Management Deployment
  35. 35. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Lex Social Intelligence Personality Modality Dynamic Conversation • Built-in error handling allows you to manage unexpected scenarios • Intent chaining can build a conversation flow based on user input • Rich formatting capabilities can provide more engaging experiences • Create conversation combining speech and text in the same session • Select from multiple prompts to give your bot a personality • Choose from a range of Amazon Polly voices to suit your audience • Use AWS Lambda to personalize the conversation based on each user’s social profile • Context is maintained allowing you to build intelligent conversations
  36. 36. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Lex – use cases Informational Bots Chatbots for everyday consumer requests Application Bots Build powerful interfaces to mobile applications • News updates • Weather information • Game scores …. • Book tickets • Order food • Manage bank accounts …. Enterprise Productivity Bots Streamline enterprise work activities and improve efficiencies • Check sales numbers • Marketing performance • Inventory status …. Internet of Things (IoT) Bots Enable conversational interfaces for device interactions • Wearables • Appliances • Auto …. Contact Center Bots Chatbots for customer service IVR • Account inquiries • Bill payment • Service update ….
  37. 37. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Patrick Tedjamulia, Co-founder & CEO Ben Cobb, Co-founder & CTO Using AI to Gather Customer Insights
  38. 38. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. VideoPeel automates the collection of video testimonials to drive business results and better understand your customer.
  39. 39. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. VideoPeel edits each video for use in websites, emails, Facebook & Instagram ads, Amazon, Indiegogo, SEO, etc.
  40. 40. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. VideoPeel’s key challenge was to process and analyze thousands of videos to provide clients with actionable insights on who to target and what to message in their campaigns.
  41. 41. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. VideoPeel AI and Machine Learning technologies integrate with Amazon Transcribe, Amazon Comprehend, & Amazon Rekognition to quickly transcribe each video and audio to create rich profiles we can cluster to generate dynamic consumer personas and insights.
  42. 42. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
  43. 43. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. VideoPeel architecture ‒ integration with Amazon Transcribe, Amazon Comprehend, and Amazon Rekognition
  44. 44. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Getting Started Tools to help you build fast ML applications and features in minutes
  45. 45. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Multi-language product analytics Twitter Stream API Amazon S3 Amazon Athena Amazon Kinesis Amazon Translate AWS Lambda Amazon Comprehend Amazon Transcribe Amazon S3 Product Reviews
  46. 46. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Text analytics workloads Amazon Kinesis Amazon ES Amazon Redshift Amazon EMR • Semantic • Rich filtering • Grouping, trends • Joining, correlating • Clustering • Graph, search • Near real-time • Alerts Amazon S3 Social media, support Amazon Aurora Articles, documents
  47. 47. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Searchable media metadata index aws.amazon.com/answers/media-entertainment/media-analysis-solution Downloadable media analysis solution Tagged videos accessible in less than 30 mins
  48. 48. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Supported media use cases Media Asset Management System (Web App) (Media Content Store) • NEWS SEARCH & DISCOVERY • CELEBRITY RECOGNITION • CONTEXT AD INSERTION • COMPLIANCE MARKING • SPORTS ACTIVITIES & EVENTS • CLOSED CAPTIONING METADATA DAM / MAM extensible
  49. 49. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Machine Learning Blog aws.amazon.com/blogs/ machine-learning Contributions from AWS experts, customers, & partners • Code samples • Specific use cases • Architecture diagrams • Real-world deployments
  50. 50. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. AWS Answers aws.amazon.com/answers Includes: Serverless Bot Framework for multi-language chatbots Media Analysis Solution for media metadata indexing
  51. 51. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Submit session feedback 1. Tap the Schedule icon. 2. Select the session you attended. 3. Tap Session Evaluation to submit your feedback.
  52. 52. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. ml.aws

×