You have billions of events in your fact table, all of it waiting to be visualized. Enter Tableau… but wait: how can you ensure scalability and speed with your data in Amazon S3, Spark, Amazon Redshift, or Presto? In this talk, you’ll hear how Albert Wong and Srikanth Devidi at Netflix use Tableau on top of their big data stack. Albert and Srikanth also show how you can get the most out of a massive dataset using Tableau, and help guide you through the problems you may encounter along the way. Session sponsored by Tableau. AWS Competency Partner

1. Tableau: Rules of Engagement
in the Cloud
Albert Wong - Enterprise Reporting Platform
Srikanth Devidi - Data Engineering & Analytics
Re:invent - December 1, 2016

2. Metrics
Re:Invent - Tableau Rules of Engagement in the Cloud - December 1, 2016
86 million members
125 hours/day
190 countries

3. Netflix Culture
Re:Invent - Tableau Rules of Engagement in the Cloud - December 1, 2016
● Freedom and responsibility
● Loosely coupled, highly aligned
● Context over control
Google Search: Netflix Culture Deck

4. Re:Invent - Tableau Rules of Engagement in the Cloud - December 1, 2016

5. Data Platform
Re:Invent - Tableau Rules of Engagement in the Cloud - December 1, 2016
events data
operations data
data processors
fast storage data viz
data
exploration
data services
kragle
metacat
portal
Amazon S3
Amazon Redshift

6. Single Data Warehouse
Re:Invent - Tableau Rules of Engagement in the Cloud - December 1, 2016
Amazon S3

7. Accessing Data Warehouse
Re:Invent - Tableau Rules of Engagement in the Cloud - December 1, 2016

8. Specialized Data Storage
Re:Invent - Tableau Rules of Engagement in the Cloud - December 1, 2016
Amazon Redshift

9. Tableau Development
Re:Invent - Tableau Rules of Engagement in the Cloud - December 1, 2016

10. Re:Invent - Tableau Rules of Engagement in the Cloud - December 1, 2016
REST API

11. Connecting to Data
Re:Invent - Tableau Rules of Engagement in the Cloud - December 1, 2016
Amazon Redshift

12. Addressing Big Data Issues
Re:Invent - Tableau Rules of Engagement in the Cloud - December 1, 2016
Amazon Redshift
Tableau data extract
Netflix + Tableau API

13. Summary
Re:Invent - Tableau Rules of Engagement in the Cloud - December 1, 2016
● Culture
● Cloud
● Scalability
● Development

14. Analytics
(How we use Tableau to run our business)
Re:Invent - Tableau Rules of Engagement in the Cloud - December 1, 2016

15. Re:Invent - Tableau Rules of Engagement in the Cloud - December 1, 2016
Data Engineering & Analytics
Metrics
Data Engineering
Visualization
f(x) = (a*b)/n

16. Re:Invent - Tableau Rules of Engagement in the Cloud - December 1, 2016
Audience

17. Re:Invent - Tableau Rules of Engagement in the Cloud - December 1, 2016
Read Process Store Sync Visualize
Architecture
Amazon S3 Amazon RedshiftAmazon S3

18. Data Products
Re:Invent - Tableau Rules of Engagement in the Cloud - December 1, 2016

19. Example: Exploratory dashboards
Re:Invent - Tableau Rules of Engagement in the Cloud - December 1, 2016

20. Re:Invent - Tableau Rules of Engagement in the Cloud - December 1, 2016
Example: Personalization

21. Iterative development
Storytelling
Tableau Desktop
Built-in chart types
Connectors
Tableau Server
Deployment
Version control
Re:Invent - Tableau Rules of Engagement in the Cloud - December 1, 2016
Tableau for Dashboards

22. Packaged Data Sources
(for power users)
Re:Invent - Tableau Rules of Engagement in the Cloud - December 1, 2016

23. Re:Invent - Tableau Rules of Engagement in the Cloud - December 1, 2016
Tableau Data Source
Tableau
Server
Tableau
ExtractRaw Data
Additional
Metadata
+

24. Re:Invent - Tableau Rules of Engagement in the Cloud - December 1, 2016
Tableau Data Source

25. Re:Invent - Tableau Rules of Engagement in the Cloud - December 1, 2016
Reusable
Data governance
Tested up to 100M records
Very wide
Varying cardinality
~90 GB uncompressed
~6 GB compressed
Why Tableau Data Source?
Hell’s Kitchen Stats

26. Re:Invent - Tableau Rules of Engagement in the Cloud - December 1, 2016
Tableau JS API
Tableau React

27. Re:Invent - Tableau Rules of Engagement in the Cloud - December 1, 2016
XML Hacking

28. Rule #1
Re:Invent - Tableau Rules of Engagement in the Cloud - December 1, 2016
Are you still watching?
Continue watching
Back

29. For iterative development, use:
• Smaller, local extracts
• Database views
#1
Re:Invent - Tableau Rules of Engagement in the Cloud - December 1, 2016

30. For dashboard performance, stick with extracts.
#2
Re:Invent - Tableau Rules of Engagement in the Cloud - December 1, 2016

31. Slow queries? Check system background jobs.
#3
Re:Invent - Tableau Rules of Engagement in the Cloud - December 1, 2016

32. For live connections, check:
• concurrency limits
• .tdc and query fusion
#4
Re:Invent - Tableau Rules of Engagement in the Cloud - December 1, 2016

33. Test with the user in mind.
#5
Re:Invent - Tableau Rules of Engagement in the Cloud - December 1, 2016

34. See you at the Netflix
booth!
@albertcwong
@srikanthdevidi
@netflixdata