Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
The Real-Time CDO and the Cloud-Forward Path to Predictive Analytics
1. Nikita Shamgunov, CTO and Co-founder of MemSQL
Gartner Data and Analytics Summit, March 2017
The Real-Time Chief Data Officer and the
Cloud-Forward Path to Predictive Analytics
2. Today’s Talk
The Real-Time Chief Data Officer
Introduction to MemSQL
Customer Use Cases
Demonstration: Historical, Real-Time, Predictive Analytics
Path to the Cloud
3. Real-time Chief Data Officer Objectives
▪ 360 view of the Business
• No silos
▪ Real-time access to ALL data
• Current and historical in one system
▪ Flexible and Strategic Deployment Model
• Built for the Cloud: Public, Private, As-A-Service
▪ Modern Data Architecture
• Scalable, Elastic
6. Real-Time Scalable Multi-Cloud
• Fast Ingest, Low Latency
Queries, High Concurrency
• Operational and Ad-Hoc
Analytics
• Powerful applications
• Petabyte scale
• Elastic
• Commodity hardware
• Low TCO
• Cloud Managed Service
• On-premises
• Multi-cloud deployments
• Enterprise-grade Security
A Modern Data Warehouse for the Enterprise Frontlines
7. Real-Time Data
Messaging and
Transforms
Historical Data
Bare Metal, Virtual Machines, Containers On-Premises, Cloud, As a Service
Business
Intelligence
Dashboards
Real-Time
Application
AnalyticsReal-Time Data
Warehouse
Live Data
Memory Optimized
Tables
Historical Data
Disk Optimized
Tables
Streaming Ingest
Real-Time
Data Pipelines
8. MemSQL Confidential8
Product or Services Scores
for Operational Data
Warehouse
Critical Capabilities for Data
Warehouse and Data
Management Solutions for
Analytics
Gartner, July 2016
14. ▪ Every piece of technology is scalable
▪ Analyzing data from hundreds of thousands of
machines
▪ Delivering immense value in real-time
• Real-time code deployment
• Detecting anomalies
• A/B testing results
▪ Fundamentally making the business faster by providing
data at your fingertips
An Insider’s View at Facebook
17. Real-time analytics transformed profitability analysis of customer logistics
from weekly to daily, and reduced latency from days to minutes
+
17
18. 18
BUSINESS BENEFITS
▪ New increased profitability customer logistics analysis from weekly to daily
▪ Reduce Latency from days to minutes
TECHNICAL BENEFITS
▪ Reduced 22 hour ETL to minutes
▪ Increased query response time by 80x
20. Reducing delay in “freshness of data” from two hours to 10 minutes
+
21. BUSINESS BENEFITS
▪ Reach over 1.5 billion users across 100s of thousands of mobile apps
▪ Real-time optimization of advertising campaigns with improved post-install
engagements
▪ Net new personalized campaign performance reports for greater visibility
TECHNICAL BENEFITS
▪ 10x faster data refresh, from hours to minutes
▪ Ad-hoc queries on raw log-level data in seconds
▪ Real-time deduplication
▪ 1 TB/day ingest
22. THE MANAGE REAL-TIME ARCHITECTURE
22
REAL-TIME
ANALYTICSReal-Time
inputs
http://www.enterprisetech.com/2016/12/09/managing-30b-bid-requests/
26. SECURE DATA LAKE ARCHITECTURE
26 http://itblog.emc.com/2016/05/03/simplifying-lives-emc-myservice360/
27. 27
The global leader in Content Delivery Network services, has deployed MemSQL
to enhance billing speed and efficiency for thousands of customers around the world
+
28. 28
BUSINESS BENEFITS
▪ Analyze Historical Against Live Data
▪ 30% Increased Forecast Accuracy
▪ Tighter Financial Reporting to Street
TECHNICAL BENEFITS
▪ Analyze Millions of rows / second
▪ Massive Concurrency
▪ 8 Million UPSERTS per second
▪ Process 1PB Data Per Day
29. THE AKAMAI REAL-TIME ARCHITECTURE
29
REAL-TIME
ANALYTICSCustomer
traffic
statistics
33. Demo Details
1.Showcase fast queries on historical data with Tableau
1.Incorporate real-time data with MemSQL Pipelines
and exactly-once ingest from Kafka
1.Add predictive analytics with Sentiment Analysis
Historical Data
CREATE
PIPELINE
Real-Time
Data
Sentiment
Analysis
36. Gartner Hybrid DBMS Cloud Scenarios
36
Dev Test
Disaster
recovery
Architecture Spanning Use Case Specific Multicloud
Prod
Source: Gartner (April 2016)
37. A Comprehensive Hybrid Cloud Approach
▪On-Premises deployments
•Any hardware, NUMA optimizations, vectorized processing
•Any Linux, VMs, Containers
•Robust security including Role-based Access Control (RBAC)
•Perfect for retiring legacy appliances
▪Any Cloud
•Any cloud service IaaS
•Simple `replicate database`
•Also available as a MemSQL Managed Service
38. Strategic Approach to Global Analytics
▪ Develop a center of excellence for real-time
infrastructure
• Include both real-time AND historical data
▪ Identify complements and replacements for traditional
technologies
• Data warehouse appliances, rigid systems
▪ Choose a straightforward path
• Faster historical insights, real-time data, predictive analytics