Realizing the value of social media analytics can bolster your business goals. This type of analysis has grown in recent years due to the large amount of available information and the speed at which it can be collected and analyzed. In this workshop, we build a serverless data processing and machine learning (ML) pipeline that provides a multi-lingual social media dashboard of tweets within Amazon QuickSight. We leverage API-driven ML services, AWS Glue, Amazon Athena and Amazon QuickSight. These building blocks are put together with very little code by leveraging serverless offerings within AWS.

1. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Social Media Analytics with
Amazon QuickSight
Anupam Mishra
Principal Solutions Architect
AWS Startups
A N T 3 7 0
Neal Cauley
Sr. Business Development Manager
Amazon QuickSight

2. Why are we here today?

3. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Agenda
• Problem description
• Big data analytics for social media
• Lab: Hands-on setup for data consumption and
processing
• Amazon QuickSight usage and design patterns
• Lab: Hands-on data exploration and analysis

4. How can we act on data quickly?

5. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Data warehouse versus data lake
Data warehouse Data lake
Data Relational Relational & non-relational
Schema Schema-on-write Schema-on-read
Data quality Highly curated data Both curated & non-curated data
Analytics Mostly batch reporting Machine learning, data discovery
Price/performance
Fast results using higher cost
storage
Query results getting faster using
low-cost storage

6. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Central storage
Secure, cost-effective
storage in Amazon S3
Amazon S3
Access & user interface
Give your users easy & secure access
API Gateway IAM Amazon Cognito
Protect & secure
Use entitlements to ensure data is secure and users identities are verified
AWS STS CloudWatch CloudTrail AWS KMS
Athena Amazon
QuickSight
Amazon
EMR
Amazon
Redshift
Processing & analytics
Use predictive and prescriptive
analytics to gain better understanding
Kinesis Data
Firehose
AWS
Direct Connect
Snowball AWS DMS
Data ingestion
Get your data into Amazon S3
quickly and securely
Catalog & search
Capture, access, and search metadata
DynamoDB Amazon ESAWS Glue Macie

7. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Social media dashboard
Kinesis Data
Firehose
S3
Bucket
Amazon
Athena
Machine
Learning
Amazon QuickSight

8. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Twitter
Machine
translation
NLP
Data lake
Amazon
QuickSight
AWS Lambda
Amazon
Athena
Architecture

9. Where can we use these learnings?

10. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

11. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

12. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

13. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

14. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Business intelligence & machine learning
Data movement
AWS DMS | Snowball | Snowmobile | Kinesis Data Firehose | Kinesis Data Streams
Data lake
Relational databases Non-relational databases Analytics
AWS
database and
analytics stack
One of the broadest and
deepest portfolios
purpose-built for builders
Aurora
Amazon RDS
DynamoDB
(Key value/Document)
ElastiCache
(Redis, Memcached)
DW | Big data processing | Ad hoc
Amazon
Redshift
Amazon
EMR
Athena
Real-time
Kinesis
Data
Analytics
Amazon ES
AWS Glue
(ETL & Data Catalog)
Macie
(Data Protection)
S3/Amazon
Glacier
(Storage)
Machine learningAmazon QuickSight

15. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon QuickSight overview
Scalable
Amazon QuickSight automatically scales with your
usage and activity, with no need for additional
infrastructure. From 10 users to 10,000 Amazon
QuickSight seamlessly grows with you
Serverless and fully
managed
Amazon QuickSight is a fully managed cloud
application, meaning there's no up-front cost,
software to deploy, capacity planning, maintenance,
upgrades, or migrations
Fully integrated
Amazon QuickSight is deeply integrated with your
data sources and other AWS services like Amazon
Redshift, Amazon S3, Amazon Athena, Amazon
Aurora, Amazon Relational Database Service (Amazon
RDS), AWS Identity and Access Management (IAM),
AWS CloudTrail, Amazon Cloud Directory, and more –
providing you with everything you need for an end-
to-end cloud BI solution
Pay for what you use
Pay monthly or annually. Now with Pay-per-Session
pricing, data consumers only pay when they access
their reports and dashboards with no up-front costs!

16. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
One product for all of your users
Amazon QuickSight covers all of your users, from casual data
consumers, to dashboard creators, to power users and analysts
that need self-serve analytics
Explore
Give power users and analysts the freedom
to do their own self-serve data discovery
and analysis on governed data you control
Create
Create and publish rich, interactive
dashboards to all of your users
Consume
With the new Reader Role, you can provide
everyone in your organization with secure,
easy access to interactive dashboards and
reports, on any device

17. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Enterprise edition
Create and publish interactive dashboards Secure access to dashboards anytime, anywhere
$24/user/month, paying month to month *session = 30 minutes from login
$18per user/month
billed annually
$0.30per session*
up to a
max of $5per user/month
ReadersAuthors
For deploying insights at scale, across your organization.

18. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
SPICE
Amazon QuickSight is powered by SPICE, a superfast calculation
engine that delivers performance and scale, regardless of how many
users are active
SPICEYour data source

19. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. *Projected number of launches to year-end 2017
AWS Directory Service
Microsoft AD
Custom date format Dashboard Save As Aggregate calculations Readers Groups
Private VPC
25 GB SPICE
tables
Spark and Presto connector Scheduled refresh Just-in-time provisioning Ohio region
Search Totals Excel custom range
75+
new features released since
launch
Federated SSO
Athena connector Export to CSV S3 Analytics
Week aggregation Aurora PostgreSQL Calculations in SPICE
Cross-account
S3 access
Aggregate filters Sydney region
Row level security Hourly refresh
10K filter values Tokyo region
Amazon Redshift
Spectrum support
KPI chart
Spark connector
AWS Directory
Service
AD Connector
Tabular reports Singapore region
URL actions
Combo charts
Audit logging
with CloudTrail
Geospatial maps Count distinct Parameters Relative date filters Filter groups
Other buckets Snowflake Connector SaaS connectors Teradata Connector HIPAA PCI compliance

20. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Twitter dashboard

21. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Use case types and scenarios
• Self-service analytics for everyone
• Allow users to create customize existing reports and dashboards as well as create
purpose-made reports from scratch
• Reporting at scale
• Replace email reports, spreadsheets, dashboards with a unified reporting platform
•Sharing data with third parties
• Embedded dashboards with personalized cuts of data for partner- and customer-
facing reporting

22. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Example use cases we will cover
• Traditional data warehouse and BI
• Serverless big data / data lake
• Operational analytics
• AWS IoT Analytics
• Streaming data (social media)
• Embedded analytics

23. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

24. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
What is a data lake?
Architectural pattern enabling
• Ubiquitous storage at any scale
• Consolidated data processing
• Collaborate and analyze data in
different ways leading to better,
faster decision making

25. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS serverless data lake & analytics overview
• AWD Glue – Serverless ETL and Data Catalog
• Amazon Athena – Serverless SQL query
engine
• Amazon QuickSight – Serverless business
intelligence/visualization platform

26. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Serverless data lake & analytics with AWS
On-premises data
Web app data
Amazon RDS
Other databases
Streaming data
Your data

27. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Serverless data lake & analytics with AWS
On premises data
Web app data
Amazon RDS
Other databases
Streaming data
Your data

28. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

29. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Processing CloudTrail log files
Lambda to
consolidate
logs
AWS Glue to
convert to
Parquet
Athena & Amazon
QuickSight to
query and visualize

30. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Keep track of your account with AWS
CloudTrail for governance, compliance,
and auditing purposes
Answer questions such as
• How many / which users have seen this Amazon
QuickSight dashboard?
• What does my load-balancer traffic look like?
• Who has accessed data in my encrypted S3 bucket?
• When was my peak API activity?
Auditing & monitoring
using Amazon QuickSight

31. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

32. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS IoT Analytics

33. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS IoT Analytics

34. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS IoT Analytics

35. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

36. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Streaming data – Social media
• Capture Tweets in
real time
• Machine
translation
• Sentiment analysis
• Durably save
results
• As-needed
exploration

37. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Twitter dashboard

38. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

39. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Embedded dashboards – What’s the value
• Supercharge your applications with embedded dashboards
• Zero infrastructure to manage
• Fast development time, reduce time to market
• Best-in-class features constantly being added

40. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Embedded dashboards – How it works
• Create a unified user experience by embedding Amazon
QuickSight dashboards into custom applications and portals
• Fully interactive filtering and drill down
• Customize data displayed using row-level security
• Seamless authentication using Federated Single Sign-On
• Scalable pricing with session-based Reader pricing

41. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Sample embedded dashboards

42. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
iFrame Embedding

43. Thank you!
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Anupam Mishra
Principal Solutions Architect
AWS Startups
Neal Cauley
Sr. Business Development Manager
Amazon QuickSight

44. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.