SlideShare a Scribd company logo
1 of 41
Nikita Shamgunov, CTO and Co-founder of MemSQL
Gartner Data and Analytics Summit, March 2017
The Real-Time Chief Data Officer and the
Cloud-Forward Path to Predictive Analytics
Today’s Talk
The Real-Time Chief Data Officer
Introduction to MemSQL
Customer Use Cases
Demonstration: Historical, Real-Time, Predictive Analytics
Path to the Cloud
Real-time Chief Data Officer Objectives
▪ 360 view of the Business
• No silos
▪ Real-time access to ALL data
• Current and historical in one system
▪ Flexible and Strategic Deployment Model
• Built for the Cloud: Public, Private, As-A-Service
▪ Modern Data Architecture
• Scalable, Elastic
Introduction to MemSQL
The Real-Time Data Warehouse
For the front lines of your business
Real-Time Scalable Multi-Cloud
• Fast Ingest, Low Latency
Queries, High Concurrency
• Operational and Ad-Hoc
Analytics
• Powerful applications
• Petabyte scale
• Elastic
• Commodity hardware
• Low TCO
• Cloud Managed Service
• On-premises
• Multi-cloud deployments
• Enterprise-grade Security
A Modern Data Warehouse for the Enterprise Frontlines
Real-Time Data
Messaging and
Transforms
Historical Data
Bare Metal, Virtual Machines, Containers On-Premises, Cloud, As a Service
Business
Intelligence
Dashboards
Real-Time
Application
AnalyticsReal-Time Data
Warehouse
Live Data
Memory Optimized
Tables
Historical Data
Disk Optimized
Tables
Streaming Ingest
Real-Time
Data Pipelines
MemSQL Confidential8
Product or Services Scores
for Operational Data
Warehouse
Critical Capabilities for Data
Warehouse and Data
Management Solutions for
Analytics
Gartner, July 2016
How Did We Get Here
Trying to build
scale-out for
a traditional
product
Scale-out
▪ Every piece of technology is scalable
▪ Analyzing data from hundreds of thousands of
machines
▪ Delivering immense value in real-time
• Real-time code deployment
• Detecting anomalies
• A/B testing results
▪ Fundamentally making the business faster by providing
data at your fingertips
An Insider’s View at Facebook
Imagine scaling a
database on industry
standard hardware.
Need 2x the
performance?
Add 2x the nodes.
Customer Use Cases
Real-time analytics transformed profitability analysis of customer logistics
from weekly to daily, and reduced latency from days to minutes
+
17
18
BUSINESS BENEFITS
▪ New increased profitability customer logistics analysis from weekly to daily
▪ Reduce Latency from days to minutes
TECHNICAL BENEFITS
▪ Reduced 22 hour ETL to minutes
▪ Increased query response time by 80x
THE KELLOGG’S REAL-TIME ARCHITECTURE
19
22 hours to minutes
80x faster
Reducing delay in “freshness of data” from two hours to 10 minutes
+
BUSINESS BENEFITS
▪ Reach over 1.5 billion users across 100s of thousands of mobile apps
▪ Real-time optimization of advertising campaigns with improved post-install
engagements
▪ Net new personalized campaign performance reports for greater visibility
TECHNICAL BENEFITS
▪ 10x faster data refresh, from hours to minutes
▪ Ad-hoc queries on raw log-level data in seconds
▪ Real-time deduplication
▪ 1 TB/day ingest
THE MANAGE REAL-TIME ARCHITECTURE
22
REAL-TIME
ANALYTICSReal-Time
inputs
http://www.enterprisetech.com/2016/12/09/managing-30b-bid-requests/
DellEMC Adopts MemSQL for Customer Acquisition
Lifecycle Management
+
24
BUSINESS BENEFITS
• Deliver real-time customer updates to DellEMC Sales Department
• Scale customer analytics to increase sales productivity
• Execute joins across multiple distributed data set
• Drive real-time personalization for operational efficiency
TECHNICAL BENEFITS
• Data loading
• Concurrency
• Sub-second response
• Distributed joins
Tables: Customer, Inventory and Contracts
DELLEMC REAL-TIME ARCHITECTURE
REAL-TIME
ANALYTICS
SECURE DATA LAKE ARCHITECTURE
26 http://itblog.emc.com/2016/05/03/simplifying-lives-emc-myservice360/
27
The global leader in Content Delivery Network services, has deployed MemSQL
to enhance billing speed and efficiency for thousands of customers around the world
+
28
BUSINESS BENEFITS
▪ Analyze Historical Against Live Data
▪ 30% Increased Forecast Accuracy
▪ Tighter Financial Reporting to Street
TECHNICAL BENEFITS
▪ Analyze Millions of rows / second
▪ Massive Concurrency
▪ 8 Million UPSERTS per second
▪ Process 1PB Data Per Day
THE AKAMAI REAL-TIME ARCHITECTURE
29
REAL-TIME
ANALYTICSCustomer
traffic
statistics
Demonstration
The Path to Real-Time Analytics
Real-Time Data Predictive AnalyticsHistorical Data
MemSQL Springs and Golf Resorts
Demo Details
1.Showcase fast queries on historical data with Tableau
1.Incorporate real-time data with MemSQL Pipelines
and exactly-once ingest from Kafka
1.Add predictive analytics with Sentiment Analysis
Historical Data
CREATE
PIPELINE
Real-Time
Data
Sentiment
Analysis
CDO Strategies
for Hybrid Cloud
Gartner Hybrid DBMS Cloud Scenarios
36
Dev Test
Disaster
recovery
Architecture Spanning Use Case Specific Multicloud
Prod
Source: Gartner (April 2016)
A Comprehensive Hybrid Cloud Approach
▪On-Premises deployments
•Any hardware, NUMA optimizations, vectorized processing
•Any Linux, VMs, Containers
•Robust security including Role-based Access Control (RBAC)
•Perfect for retiring legacy appliances
▪Any Cloud
•Any cloud service IaaS
•Simple `replicate database`
•Also available as a MemSQL Managed Service
Strategic Approach to Global Analytics
▪ Develop a center of excellence for real-time
infrastructure
• Include both real-time AND historical data
▪ Identify complements and replacements for traditional
technologies
• Data warehouse appliances, rigid systems
▪ Choose a straightforward path
• Faster historical insights, real-time data, predictive analytics
Please visit at the MemSQL booth
Q&A
www.memsql.com
Thank You

More Related Content

What's hot

What's hot (20)

The Fast Path to Building Operational Applications with Spark
The Fast Path to Building Operational Applications with SparkThe Fast Path to Building Operational Applications with Spark
The Fast Path to Building Operational Applications with Spark
 
Enabling Real-Time Analytics for IoT
Enabling Real-Time Analytics for IoTEnabling Real-Time Analytics for IoT
Enabling Real-Time Analytics for IoT
 
Building the Ideal Stack for Machine Learning
Building the Ideal Stack for Machine LearningBuilding the Ideal Stack for Machine Learning
Building the Ideal Stack for Machine Learning
 
In-Memory Computing Webcast. Market Predictions 2017
In-Memory Computing Webcast. Market Predictions 2017In-Memory Computing Webcast. Market Predictions 2017
In-Memory Computing Webcast. Market Predictions 2017
 
Tapjoy: Building a Real-Time Data Science Service for Mobile Advertising
Tapjoy: Building a Real-Time Data Science Service for Mobile AdvertisingTapjoy: Building a Real-Time Data Science Service for Mobile Advertising
Tapjoy: Building a Real-Time Data Science Service for Mobile Advertising
 
Real-Time Analytics with Spark and MemSQL
Real-Time Analytics with Spark and MemSQLReal-Time Analytics with Spark and MemSQL
Real-Time Analytics with Spark and MemSQL
 
Getting It Right Exactly Once: Principles for Streaming Architectures
Getting It Right Exactly Once: Principles for Streaming ArchitecturesGetting It Right Exactly Once: Principles for Streaming Architectures
Getting It Right Exactly Once: Principles for Streaming Architectures
 
Driving the On-Demand Economy with Spark and Predictive Analytics
Driving the On-Demand Economy with Spark and Predictive AnalyticsDriving the On-Demand Economy with Spark and Predictive Analytics
Driving the On-Demand Economy with Spark and Predictive Analytics
 
Real-Time Geospatial Intelligence at Scale
Real-Time Geospatial Intelligence at Scale Real-Time Geospatial Intelligence at Scale
Real-Time Geospatial Intelligence at Scale
 
Real-Time Analytics with Confluent and MemSQL
Real-Time Analytics with Confluent and MemSQLReal-Time Analytics with Confluent and MemSQL
Real-Time Analytics with Confluent and MemSQL
 
Winning the On-Demand Economy with Spark and Predictive Analytics
Winning the On-Demand Economy with Spark and Predictive AnalyticsWinning the On-Demand Economy with Spark and Predictive Analytics
Winning the On-Demand Economy with Spark and Predictive Analytics
 
Zero Downtime App Deployment using Hadoop
Zero Downtime App Deployment using HadoopZero Downtime App Deployment using Hadoop
Zero Downtime App Deployment using Hadoop
 
Real-Time, Geospatial, Maps by Neil Dahlke
Real-Time, Geospatial, Maps by Neil DahlkeReal-Time, Geospatial, Maps by Neil Dahlke
Real-Time, Geospatial, Maps by Neil Dahlke
 
See who is using MemSQL
See who is using MemSQLSee who is using MemSQL
See who is using MemSQL
 
Scaling Production Machine Learning Pipelines with Databricks
Scaling Production Machine Learning Pipelines with DatabricksScaling Production Machine Learning Pipelines with Databricks
Scaling Production Machine Learning Pipelines with Databricks
 
Operationalizing Machine Learning at Scale at Starbucks
Operationalizing Machine Learning at Scale at StarbucksOperationalizing Machine Learning at Scale at Starbucks
Operationalizing Machine Learning at Scale at Starbucks
 
Webinar: BI in the Sky - The New Rules of Cloud Analytics
Webinar: BI in the Sky - The New Rules of Cloud AnalyticsWebinar: BI in the Sky - The New Rules of Cloud Analytics
Webinar: BI in the Sky - The New Rules of Cloud Analytics
 
Internet of Things and Multi-model Data Infrastructure
Internet of Things and Multi-model Data InfrastructureInternet of Things and Multi-model Data Infrastructure
Internet of Things and Multi-model Data Infrastructure
 
O'Reilly Media Webcast: Building Real-Time Data Pipelines
O'Reilly Media Webcast: Building Real-Time Data PipelinesO'Reilly Media Webcast: Building Real-Time Data Pipelines
O'Reilly Media Webcast: Building Real-Time Data Pipelines
 
Building the Foundation for a Latency-Free Life
Building the Foundation for a Latency-Free LifeBuilding the Foundation for a Latency-Free Life
Building the Foundation for a Latency-Free Life
 

Viewers also liked

Viewers also liked (11)

Real-Time Supply Chain Analytics with Machine Learning, Kafka, and Spark
Real-Time Supply Chain Analytics with Machine Learning, Kafka, and SparkReal-Time Supply Chain Analytics with Machine Learning, Kafka, and Spark
Real-Time Supply Chain Analytics with Machine Learning, Kafka, and Spark
 
INTRODUCING: CREATE PIPELINE
INTRODUCING: CREATE PIPELINEINTRODUCING: CREATE PIPELINE
INTRODUCING: CREATE PIPELINE
 
Journey to the Real-Time Analytics in Extreme Growth
Journey to the Real-Time Analytics in Extreme GrowthJourney to the Real-Time Analytics in Extreme Growth
Journey to the Real-Time Analytics in Extreme Growth
 
IoT Connected Brewery
IoT Connected BreweryIoT Connected Brewery
IoT Connected Brewery
 
Building Real-Time Data Pipelines with Kafka, Spark, and MemSQL
Building Real-Time Data Pipelines with Kafka, Spark, and MemSQLBuilding Real-Time Data Pipelines with Kafka, Spark, and MemSQL
Building Real-Time Data Pipelines with Kafka, Spark, and MemSQL
 
Predictive Analytics using R
Predictive Analytics using RPredictive Analytics using R
Predictive Analytics using R
 
Introduction To Predictive Analytics Part I
Introduction To Predictive Analytics   Part IIntroduction To Predictive Analytics   Part I
Introduction To Predictive Analytics Part I
 
How to Succeed at Jobs That Don't Exist Yet
How to Succeed at Jobs That Don't Exist YetHow to Succeed at Jobs That Don't Exist Yet
How to Succeed at Jobs That Don't Exist Yet
 
Modern Data Architectures for Business Insights at Scale
Modern Data Architectures for Business Insights at ScaleModern Data Architectures for Business Insights at Scale
Modern Data Architectures for Business Insights at Scale
 
DI&A Slides: Descriptive, Prescriptive, and Predictive Analytics
DI&A Slides: Descriptive, Prescriptive, and Predictive AnalyticsDI&A Slides: Descriptive, Prescriptive, and Predictive Analytics
DI&A Slides: Descriptive, Prescriptive, and Predictive Analytics
 
PowerStream: Propelling Energy Innovation with Predictive Analytics
PowerStream: Propelling Energy Innovation with Predictive Analytics PowerStream: Propelling Energy Innovation with Predictive Analytics
PowerStream: Propelling Energy Innovation with Predictive Analytics
 

Similar to The Real-Time CDO and the Cloud-Forward Path to Predictive Analytics

Accelerating a Path to Digital With a Cloud Data Strategy
Accelerating a Path to Digital With a Cloud Data StrategyAccelerating a Path to Digital With a Cloud Data Strategy
Accelerating a Path to Digital With a Cloud Data Strategy
MongoDB
 
Key Data Management Requirements for the IoT
Key Data Management Requirements for the IoTKey Data Management Requirements for the IoT
Key Data Management Requirements for the IoT
MongoDB
 
Driving Business Transformation with Real-Time Analytics Using Apache Kafka a...
Driving Business Transformation with Real-Time Analytics Using Apache Kafka a...Driving Business Transformation with Real-Time Analytics Using Apache Kafka a...
Driving Business Transformation with Real-Time Analytics Using Apache Kafka a...
confluent
 

Similar to The Real-Time CDO and the Cloud-Forward Path to Predictive Analytics (20)

Digital Business Transformation in the Streaming Era
Digital Business Transformation in the Streaming EraDigital Business Transformation in the Streaming Era
Digital Business Transformation in the Streaming Era
 
Solving Performance Problems on Hadoop
Solving Performance Problems on HadoopSolving Performance Problems on Hadoop
Solving Performance Problems on Hadoop
 
Webinar: SQL for Machine Data?
Webinar: SQL for Machine Data?Webinar: SQL for Machine Data?
Webinar: SQL for Machine Data?
 
Yellowbrick MicroStrategy webcast
Yellowbrick MicroStrategy webcastYellowbrick MicroStrategy webcast
Yellowbrick MicroStrategy webcast
 
Introducing Amazon Kinesis: Real-time Processing of Streaming Big Data (BDT10...
Introducing Amazon Kinesis: Real-time Processing of Streaming Big Data (BDT10...Introducing Amazon Kinesis: Real-time Processing of Streaming Big Data (BDT10...
Introducing Amazon Kinesis: Real-time Processing of Streaming Big Data (BDT10...
 
"An introduction to Kx Technology - a Big Data solution", Kyra Coyne, Data Sc...
"An introduction to Kx Technology - a Big Data solution", Kyra Coyne, Data Sc..."An introduction to Kx Technology - a Big Data solution", Kyra Coyne, Data Sc...
"An introduction to Kx Technology - a Big Data solution", Kyra Coyne, Data Sc...
 
"An introduction to Kx Technology - a Big Data solution", Kyra Coyne, Data Sc...
"An introduction to Kx Technology - a Big Data solution", Kyra Coyne, Data Sc..."An introduction to Kx Technology - a Big Data solution", Kyra Coyne, Data Sc...
"An introduction to Kx Technology - a Big Data solution", Kyra Coyne, Data Sc...
 
Modern Data Architectures for Business Outcomes
Modern Data Architectures for Business OutcomesModern Data Architectures for Business Outcomes
Modern Data Architectures for Business Outcomes
 
Supercharging Smart Meter BIG DATA Analytics with Microsoft Azure Cloud- SRP ...
Supercharging Smart Meter BIG DATA Analytics with Microsoft Azure Cloud- SRP ...Supercharging Smart Meter BIG DATA Analytics with Microsoft Azure Cloud- SRP ...
Supercharging Smart Meter BIG DATA Analytics with Microsoft Azure Cloud- SRP ...
 
Set Your Data In Motion - CTO Roundtable
Set Your Data In Motion - CTO RoundtableSet Your Data In Motion - CTO Roundtable
Set Your Data In Motion - CTO Roundtable
 
Event Streaming CTO Roundtable for Cloud-native Kafka Architectures
Event Streaming CTO Roundtable for Cloud-native Kafka ArchitecturesEvent Streaming CTO Roundtable for Cloud-native Kafka Architectures
Event Streaming CTO Roundtable for Cloud-native Kafka Architectures
 
Webinar: Faster Big Data Analytics with MongoDB
Webinar: Faster Big Data Analytics with MongoDBWebinar: Faster Big Data Analytics with MongoDB
Webinar: Faster Big Data Analytics with MongoDB
 
Data & Analytics Forum: Moving Telcos to Real Time
Data & Analytics Forum: Moving Telcos to Real TimeData & Analytics Forum: Moving Telcos to Real Time
Data & Analytics Forum: Moving Telcos to Real Time
 
Accelerating a Path to Digital With a Cloud Data Strategy
Accelerating a Path to Digital With a Cloud Data StrategyAccelerating a Path to Digital With a Cloud Data Strategy
Accelerating a Path to Digital With a Cloud Data Strategy
 
Five ways database modernization simplifies your data life
Five ways database modernization simplifies your data lifeFive ways database modernization simplifies your data life
Five ways database modernization simplifies your data life
 
Key Data Management Requirements for the IoT
Key Data Management Requirements for the IoTKey Data Management Requirements for the IoT
Key Data Management Requirements for the IoT
 
Driving Business Transformation with Real-Time Analytics Using Apache Kafka a...
Driving Business Transformation with Real-Time Analytics Using Apache Kafka a...Driving Business Transformation with Real-Time Analytics Using Apache Kafka a...
Driving Business Transformation with Real-Time Analytics Using Apache Kafka a...
 
LeanIX & LoQutus: Next generation Enterprise Architecture Management
LeanIX & LoQutus: Next generation Enterprise Architecture ManagementLeanIX & LoQutus: Next generation Enterprise Architecture Management
LeanIX & LoQutus: Next generation Enterprise Architecture Management
 
MongoDB World 2019: re:Innovate from Siloed to Deep Insights on Your Data
MongoDB World 2019: re:Innovate from Siloed to Deep Insights on Your DataMongoDB World 2019: re:Innovate from Siloed to Deep Insights on Your Data
MongoDB World 2019: re:Innovate from Siloed to Deep Insights on Your Data
 
Assessing New Databases– Translytical Use Cases
Assessing New Databases– Translytical Use CasesAssessing New Databases– Translytical Use Cases
Assessing New Databases– Translytical Use Cases
 

More from SingleStore

More from SingleStore (20)

How Kafka and Modern Databases Benefit Apps and Analytics
How Kafka and Modern Databases Benefit Apps and AnalyticsHow Kafka and Modern Databases Benefit Apps and Analytics
How Kafka and Modern Databases Benefit Apps and Analytics
 
Architecting Data in the AWS Ecosystem
Architecting Data in the AWS EcosystemArchitecting Data in the AWS Ecosystem
Architecting Data in the AWS Ecosystem
 
Converging Database Transactions and Analytics
Converging Database Transactions and Analytics Converging Database Transactions and Analytics
Converging Database Transactions and Analytics
 
Building a Machine Learning Recommendation Engine in SQL
Building a Machine Learning Recommendation Engine in SQLBuilding a Machine Learning Recommendation Engine in SQL
Building a Machine Learning Recommendation Engine in SQL
 
MemSQL 201: Advanced Tips and Tricks Webcast
MemSQL 201: Advanced Tips and Tricks WebcastMemSQL 201: Advanced Tips and Tricks Webcast
MemSQL 201: Advanced Tips and Tricks Webcast
 
Introduction to MemSQL
Introduction to MemSQLIntroduction to MemSQL
Introduction to MemSQL
 
An Engineering Approach to Database Evaluations
An Engineering Approach to Database EvaluationsAn Engineering Approach to Database Evaluations
An Engineering Approach to Database Evaluations
 
Building a Fault Tolerant Distributed Architecture
Building a Fault Tolerant Distributed ArchitectureBuilding a Fault Tolerant Distributed Architecture
Building a Fault Tolerant Distributed Architecture
 
Stream Processing with Pipelines and Stored Procedures
Stream Processing with Pipelines  and Stored ProceduresStream Processing with Pipelines  and Stored Procedures
Stream Processing with Pipelines and Stored Procedures
 
Curriculum Associates Strata NYC 2017
Curriculum Associates Strata NYC 2017Curriculum Associates Strata NYC 2017
Curriculum Associates Strata NYC 2017
 
Image Recognition on Streaming Data
Image Recognition  on Streaming DataImage Recognition  on Streaming Data
Image Recognition on Streaming Data
 
Spark Summit Dublin 2017 - MemSQL - Real-Time Image Recognition
Spark Summit Dublin 2017 - MemSQL - Real-Time Image RecognitionSpark Summit Dublin 2017 - MemSQL - Real-Time Image Recognition
Spark Summit Dublin 2017 - MemSQL - Real-Time Image Recognition
 
The State of the Data Warehouse in 2017 and Beyond
The State of the Data Warehouse in 2017 and BeyondThe State of the Data Warehouse in 2017 and Beyond
The State of the Data Warehouse in 2017 and Beyond
 
How Database Convergence Impacts the Coming Decades of Data Management
How Database Convergence Impacts the Coming Decades of Data ManagementHow Database Convergence Impacts the Coming Decades of Data Management
How Database Convergence Impacts the Coming Decades of Data Management
 
Teaching Databases to Learn in the World of AI
Teaching Databases to Learn in the World of AITeaching Databases to Learn in the World of AI
Teaching Databases to Learn in the World of AI
 
Gartner Catalyst 2017: The Data Warehouse Blueprint for ML, AI, and Hybrid Cloud
Gartner Catalyst 2017: The Data Warehouse Blueprint for ML, AI, and Hybrid CloudGartner Catalyst 2017: The Data Warehouse Blueprint for ML, AI, and Hybrid Cloud
Gartner Catalyst 2017: The Data Warehouse Blueprint for ML, AI, and Hybrid Cloud
 
Gartner Catalyst 2017: Image Recognition on Streaming Data
Gartner Catalyst 2017: Image Recognition on Streaming DataGartner Catalyst 2017: Image Recognition on Streaming Data
Gartner Catalyst 2017: Image Recognition on Streaming Data
 
Spark Summit West 2017: Real-Time Image Recognition with MemSQL and Spark
Spark Summit West 2017: Real-Time Image Recognition with MemSQL and SparkSpark Summit West 2017: Real-Time Image Recognition with MemSQL and Spark
Spark Summit West 2017: Real-Time Image Recognition with MemSQL and Spark
 
Real-Time Analytics at Uber Scale
Real-Time Analytics at Uber ScaleReal-Time Analytics at Uber Scale
Real-Time Analytics at Uber Scale
 
Machines and the Magic of Fast Learning - Strata Keynote
Machines and the Magic of Fast Learning - Strata KeynoteMachines and the Magic of Fast Learning - Strata Keynote
Machines and the Magic of Fast Learning - Strata Keynote
 

Recently uploaded

+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
?#DUbAI#??##{{(☎️+971_581248768%)**%*]'#abortion pills for sale in dubai@
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Safe Software
 

Recently uploaded (20)

Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt Robison
 
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
 
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodPolkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century education
 
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
 
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
 
Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)
 
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
 
Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
Top 10 Most Downloaded Games on Play Store in 2024
Top 10 Most Downloaded Games on Play Store in 2024Top 10 Most Downloaded Games on Play Store in 2024
Top 10 Most Downloaded Games on Play Store in 2024
 
HTML Injection Attacks: Impact and Mitigation Strategies
HTML Injection Attacks: Impact and Mitigation StrategiesHTML Injection Attacks: Impact and Mitigation Strategies
HTML Injection Attacks: Impact and Mitigation Strategies
 
AWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of Terraform
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 

The Real-Time CDO and the Cloud-Forward Path to Predictive Analytics

  • 1. Nikita Shamgunov, CTO and Co-founder of MemSQL Gartner Data and Analytics Summit, March 2017 The Real-Time Chief Data Officer and the Cloud-Forward Path to Predictive Analytics
  • 2. Today’s Talk The Real-Time Chief Data Officer Introduction to MemSQL Customer Use Cases Demonstration: Historical, Real-Time, Predictive Analytics Path to the Cloud
  • 3. Real-time Chief Data Officer Objectives ▪ 360 view of the Business • No silos ▪ Real-time access to ALL data • Current and historical in one system ▪ Flexible and Strategic Deployment Model • Built for the Cloud: Public, Private, As-A-Service ▪ Modern Data Architecture • Scalable, Elastic
  • 5. The Real-Time Data Warehouse For the front lines of your business
  • 6. Real-Time Scalable Multi-Cloud • Fast Ingest, Low Latency Queries, High Concurrency • Operational and Ad-Hoc Analytics • Powerful applications • Petabyte scale • Elastic • Commodity hardware • Low TCO • Cloud Managed Service • On-premises • Multi-cloud deployments • Enterprise-grade Security A Modern Data Warehouse for the Enterprise Frontlines
  • 7. Real-Time Data Messaging and Transforms Historical Data Bare Metal, Virtual Machines, Containers On-Premises, Cloud, As a Service Business Intelligence Dashboards Real-Time Application AnalyticsReal-Time Data Warehouse Live Data Memory Optimized Tables Historical Data Disk Optimized Tables Streaming Ingest Real-Time Data Pipelines
  • 8. MemSQL Confidential8 Product or Services Scores for Operational Data Warehouse Critical Capabilities for Data Warehouse and Data Management Solutions for Analytics Gartner, July 2016
  • 9. How Did We Get Here
  • 10.
  • 11. Trying to build scale-out for a traditional product
  • 12.
  • 14. ▪ Every piece of technology is scalable ▪ Analyzing data from hundreds of thousands of machines ▪ Delivering immense value in real-time • Real-time code deployment • Detecting anomalies • A/B testing results ▪ Fundamentally making the business faster by providing data at your fingertips An Insider’s View at Facebook
  • 15. Imagine scaling a database on industry standard hardware. Need 2x the performance? Add 2x the nodes.
  • 17. Real-time analytics transformed profitability analysis of customer logistics from weekly to daily, and reduced latency from days to minutes + 17
  • 18. 18 BUSINESS BENEFITS ▪ New increased profitability customer logistics analysis from weekly to daily ▪ Reduce Latency from days to minutes TECHNICAL BENEFITS ▪ Reduced 22 hour ETL to minutes ▪ Increased query response time by 80x
  • 19. THE KELLOGG’S REAL-TIME ARCHITECTURE 19 22 hours to minutes 80x faster
  • 20. Reducing delay in “freshness of data” from two hours to 10 minutes +
  • 21. BUSINESS BENEFITS ▪ Reach over 1.5 billion users across 100s of thousands of mobile apps ▪ Real-time optimization of advertising campaigns with improved post-install engagements ▪ Net new personalized campaign performance reports for greater visibility TECHNICAL BENEFITS ▪ 10x faster data refresh, from hours to minutes ▪ Ad-hoc queries on raw log-level data in seconds ▪ Real-time deduplication ▪ 1 TB/day ingest
  • 22. THE MANAGE REAL-TIME ARCHITECTURE 22 REAL-TIME ANALYTICSReal-Time inputs http://www.enterprisetech.com/2016/12/09/managing-30b-bid-requests/
  • 23. DellEMC Adopts MemSQL for Customer Acquisition Lifecycle Management +
  • 24. 24 BUSINESS BENEFITS • Deliver real-time customer updates to DellEMC Sales Department • Scale customer analytics to increase sales productivity • Execute joins across multiple distributed data set • Drive real-time personalization for operational efficiency TECHNICAL BENEFITS • Data loading • Concurrency • Sub-second response • Distributed joins Tables: Customer, Inventory and Contracts
  • 26. SECURE DATA LAKE ARCHITECTURE 26 http://itblog.emc.com/2016/05/03/simplifying-lives-emc-myservice360/
  • 27. 27 The global leader in Content Delivery Network services, has deployed MemSQL to enhance billing speed and efficiency for thousands of customers around the world +
  • 28. 28 BUSINESS BENEFITS ▪ Analyze Historical Against Live Data ▪ 30% Increased Forecast Accuracy ▪ Tighter Financial Reporting to Street TECHNICAL BENEFITS ▪ Analyze Millions of rows / second ▪ Massive Concurrency ▪ 8 Million UPSERTS per second ▪ Process 1PB Data Per Day
  • 29. THE AKAMAI REAL-TIME ARCHITECTURE 29 REAL-TIME ANALYTICSCustomer traffic statistics
  • 31. The Path to Real-Time Analytics Real-Time Data Predictive AnalyticsHistorical Data
  • 32. MemSQL Springs and Golf Resorts
  • 33. Demo Details 1.Showcase fast queries on historical data with Tableau 1.Incorporate real-time data with MemSQL Pipelines and exactly-once ingest from Kafka 1.Add predictive analytics with Sentiment Analysis Historical Data CREATE PIPELINE Real-Time Data Sentiment Analysis
  • 34.
  • 36. Gartner Hybrid DBMS Cloud Scenarios 36 Dev Test Disaster recovery Architecture Spanning Use Case Specific Multicloud Prod Source: Gartner (April 2016)
  • 37. A Comprehensive Hybrid Cloud Approach ▪On-Premises deployments •Any hardware, NUMA optimizations, vectorized processing •Any Linux, VMs, Containers •Robust security including Role-based Access Control (RBAC) •Perfect for retiring legacy appliances ▪Any Cloud •Any cloud service IaaS •Simple `replicate database` •Also available as a MemSQL Managed Service
  • 38. Strategic Approach to Global Analytics ▪ Develop a center of excellence for real-time infrastructure • Include both real-time AND historical data ▪ Identify complements and replacements for traditional technologies • Data warehouse appliances, rigid systems ▪ Choose a straightforward path • Faster historical insights, real-time data, predictive analytics
  • 39. Please visit at the MemSQL booth
  • 40. Q&A