Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Serverless Text Analytics with Amazon Comprehend

44 views

Published on

Amazon Comprehend is a natural language processing (NLP) service that uses machine learning to find insights and relationships in text.

This deck provides how to build your own text analytics using Amazon Comprehend and integration with other AWS services. On top of that, this deck also provides an introduction to Amazon Lex.

Published in: Technology
  • Be the first to comment

  • Be the first to like this

Serverless Text Analytics with Amazon Comprehend

  1. 1. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Donnie Prakoso, MSc AWS Technology Evangelist, ASEAN Text Analytics Workload with Amazon Comprehend AWS User Group Meetup @donnieprakoso
  2. 2. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Hello, World. Donnie Prakoso, MSc AWS Technology Evangelist, ASEAN @donnieprakoso donnieprakoso • Speak in Go and Python • Machine Learning and Serverless • I AWS User Groups
  3. 3. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved. Let’s Discuss Something • Why do we need text analytics? • What are the examples of the use cases? • How Amazon Comprehend can help you? • Demo + API and architecture diagram example https://bit.ly/aws-donnie-serverless-text-analytics
  4. 4. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Why do we need text analytics?
  5. 5. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Enabling The Possibility for These Use Cases • News Media • Brand trends, correlating events • Customer engagement • Call center, issue triage, social media analytics • Records and research • Actionable document-centric processes, understand patterns
  6. 6. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. AWS Machine Learning Services
  7. 7. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. FRAMEWORKS AND INTERFACES AI for data scientists KERAS Frameworks Interfaces APPLICATION SERVICES AI for everyone P O L L Y R E K O G N I T I O N C O M P R E H E N DL E X R E K O G N I T I O N V I D E O T R A N S C R I B E T R A N S L A T E PLATFORM SERVICES AI for engineers AMAZON SAGEMAKER
  8. 8. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. G e t S t a r t e d w i t h A W S M L A p p l i c a t i o n S e r v i c e s POLLY REKOGNITION COMPREHENDLEX REKOGNITION VIDEO TRANSCRIBE TRANSLATE
  9. 9. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Sentiment Entities Languages Key phrases Topic modeling POWERED BY DEEP LEARNING Amazon Comprehend Discover insights and relationships in text
  10. 10. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Entities Key Phrases Language Sentiment Amazon Comprehend Amazon Comprehend Discover insights and relationships in text
  11. 11. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. A m a z o n . c o m , I n c . i s l o c a t e d i n S e a t t l e , W A a n d w a s f o u n d e d J u l y 5 t h , 1 9 9 4 b y J e f f B e z o s . O u r c u s t o m e r s l o v e b u y i n g e v e r y t h i n g f r o m b o o k s t o b l e n d e r s a t g r e a t p r i c e s N a m e d E n t i t i e s • A m a z o n . c o m : O r g a n i z a t i o n • S e a t t l e , W A : L o c a t i o n • J u l y 5 t h , 1 9 9 4 : D a t e • J e f f B e z o s : P e r s o n K e y p h r a s e s • O u r c u s t o m e r s • b o o k s • b l e n d e r s • g r e a t p r i c e s S e n t i m e n t • P o s i t i v e L a n g u a g e • E n g l i s h Text Analysis
  12. 12. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Synchronous • DetectDominantLanguage and BatchDetectDominantLanguage – to detect the dominant language in a document. We can detect up to 100 languages. • DetectEntities and Batch DetectEntities – to detect the entities, such as persons or places, in the document. • DetectKeyPhrases and Batch DetectKeyPhrases – to detect key noun phrases that are most indicative of the content. • DetectSentiment and Batch DetectSentiment – to detect the emotional sentiment, positive, negative, mixed, or neutral, of a document. API Summary - Synchronous
  13. 13. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Demo Twitter Sentiment Analysis w/ Amazon Comprehend
  14. 14. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Twitter Search API Analyze social media postings and comments AWS Lambda Amazon S3 AWS IoT Amazon DynamoDB
  15. 15. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Twitter Stream API Organize and classify customer feedback and look for common patterns. Visualize results in Amazon QuickSight Amazon Kinesis Amazon Athena Amazon S3 AWS Lambda
  16. 16. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Comprehend Customer Feedback Analytics
  17. 17. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Comprehend STORM WORLD SERIES STOCK MARKET WASHINGTON LIBRARY OF NEWS ARTICLES Amazon Comprehend Topic Modelling
  18. 18. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Topic Modeling Document Topic Proportion Doc.txt 0 .89 Doc.txt 1 .67 Doc.txt 2 .91 Topic Term Weight 0 Washington .89 1 Silicon Valley .67 2 Roasting .91 Keywords Topic Groups Document Relationship to Topics
  19. 19. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Asynchronous • StartTopicDetection – to start a topic modeling job • ListTopicDetection – to list all your submitted jobs • DescribeTopicDetection –to get progress status and information about each submitted job API Summary - Asynchronous
  20. 20. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Demo Classifying Customer Feedback
  21. 21. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Comprehend + AWS = Scale Text Analytics Amazon Kinesis Amazon EMR Amazon Redshift Amazon EMR • Semantic • Rich Filtering • Grouping, Trends • Joining, Correlating • Clustering • Graph, Search • Near real-time • Alerts Amazon S3 Articles, Documents Social Media, Support Amazon Aurora
  22. 22. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Comprehend Knowledge Management and Discovery
  23. 23. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Ideas Are Welcome Content Personalization: Customers are using Comprehend NLP output to understand related documents based on entities, phrases or even topic similarities for trends analysis, to drive content personalization and recommendations Semantic Search: Customers using Amazon Comprehend to index entities for boosting and ranking search results. Intelligent data warehouse: Customers are using Amazon Comprehend to query unstructured data in relational databases, processing data within the data lake (S3) and then inserting it back into the data warehouse Social Analytics: Customers are using Amazon Comprehend to ingest, process and analyze trends from entities and sentiment from social media posts across Twitter and Facebook. Information management: Customers are using Amazon Comprehend for indexing and finding related content for enterprise information management and various internal business processes including compliance and IT.
  24. 24. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Lex Scale Business Logic SecurityAnalytics Text to Speech Speech to Intent End to End Native support & maintains context One-click deployment Completely managed service Native integration with AWS Lambda Encrypted data in transit & at rest Monitor and improve Amazon Polly integrated into API ASR + NLU integrated into one API Dialog Management Deployment
  25. 25. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Lex Informational Bots Chatbots for everyday consumer requests Application Bots Build powerful interfaces to mobile applications News updates Weather information Game scores …. Book tickets Order food Manage bank accounts …. Enterprise Productivity Bots Streamline enterprise work activities and improve efficiencies Check sales numbers Marketing performance Inventory status …. Internet of Things (IoT) Bots Enable conversational interfaces for device interactions Wearables Appliances Auto …. Contact Center Bots Chatbots for customer service IVR Account inquiries Bill payment Service update …. Use cases
  26. 26. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Intents A particular goal that the user wants to achieve Utterances Spoken or typed phrases that invoke your intent Slots Data the user must provide to fulfill the intent Prompts Questions that ask the user to input data Fulfillment The business logic required to fulfill the user’s intent BookHotel
  27. 27. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Lex Customers
  28. 28. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Build On! Donnie Prakoso @donnieprakoso

×