SlideShare a Scribd company logo
1 of 67
Download to read offline
1© 2015 Delphix. All Rights Reserved. Private & Confidential.
Thought Leadership Series -
It’s all about data!
Agenda
 Introductions
 Pure Storage - Stu
 Delphix - Kyle
 Cloudera - Stephen
 Wrap and Q & A session - Devin
© 2016 PURE STORAGE, INC.
INTRODUCING PURE STORAGE
ITS ALL ABOUT DATA
Double Developer Productivity with Virtual Data
Kyle Hailey, Technical Evangelist at Delphix
kyle@delphix.com
The Phoenix Project
What is the
constraint
in Application
Development?
Flow of Features
6
1
Development
Environments
2
QA & Testing Environments
Product
Management
Features
2 2
Code Architecture
3Code Speed
4
5
Data
Development Pipeline for QA
Build Deploy
Environment
Database
8
PROD
DEV Test UAT
DBA
Sys Admin
Storage
Admin
Legacy Data Movement: Slow & expensive
?
Slow environment builds: delays
Data Management not Agile
9
• 20% SDLC time lost waiting for data
• 60% dev/QA time consumed by data tasks
Conclusion:
Data management does not scale to Agile
- Infosys
Data is the Constraint
• Data Constraint
• Solution
• Use Cases
In this presentation :
Development UATQA
99% of blocks are identical
Solution
Development QA UAT
Thin Clone
One time backup of source database
Production
3 TB
1 TB
Install Delphix on Intel hardware
• .
• .
• .
• .
• .
• Data
• .
• Binaries
• Application Stacks
• EBS
• SAP
• Flat files
Allocate Any Storage to Delphix
Any Storage
PROD
3 TB
1 TB
One time backup of source database
Data is
compressed
typically 1/3 size
18
PROD DEV DEV Test Test UAT
Data as a Service : fast, elastic, secure
Self Service
1. Development
2. Security
3. Cloud Migration
Use Cases
Development: Virtual Data
Development
Problem Not Enough Resources: shared bottleneck
Frustration Waiting
Solution Virtual Data: Parallelize
gif by Steve Karam
Problem Not enough resources: limited environments
Solution Virtual data: increase the limit
2. Bad data leads to bugs: subsets
26
Problem subsets lead to bugs: Production Wall
Solution Virtual Data: Full size
Developer Asks for DB Get Access
Manager approves
DBA Request
system
Setup DB
System Admin Request
storage
Setup
machine
Storage Admin Allocate
storage (take
snapshot)
Problem Slow environment builds: delays
Solution Virtual Data: Self Service
Problem Bad data leads to bugs: late stage bugs
Dev QA UAT Production
#
bugs
Found
Solution Virtual data : find bugs fast
Dev QA UAT Production
Dev Testing UAT Production
0
10
20
30
40
50
60
70
1 2 3 4 5 6 7
Cost
To
Correct
Software
Engineering
Economics
– Barry Boehm (1981)
New York City based global bank
32
RefreshTest Refresh
Test
Refresh
Test
Virtual Data : Fast Refresh
0 2 4 6 8 10 12 14 16 18 20 22 24
Hours
Virtual Data
Physical Data
1. Development & QA
2. Security
3. Cloud Migration
Use Cases
Production Dev, QA, UAT Reporting Backup
Security problem
Production Dev, QA, UAT Reporting Sandbox
Security management improvement
Delphix Virtual Data Masking
• Automates discovery
• Suggests algorithms
• Mask once clone many
Mask Data
6 hours Clone 18 Hours
Clone
15 min
Mask Data
Mask
4 hours
Mask
Data
Production
Dev, QA, UAT Reporting Sandbox
Security Solution
1. Development & QA
2. Security
3. Cloud Migration
Use Cases
Cloud Optimizations
40
ON PREMISE / PRIVATE
CLOUD
Replication
Encrypted
Compressed
Masked
Migration to Cloud with Delphix
41
Three Clones
=
Moving 1/3 of Source Size
Cloud Optimizations
42
ON PREMISE / PRIVATE
CLOUD
$$$
1. Development & QA
– Dev throughput increase by 2x
2. Secure
– Mask once, clone many
3. Cloud Enablement
– Compressed, encrypted replication
– active/active replication
Summary
• Projects “12 months to 6 months.”
– New York Life
• Insurance product “about 50 days ... to about 23 days”
– Presbyterian Health
• “Can't imagine working without it”
– State of California
Virtual Data Quotes
» DBA dropped video titles table
» 24M users could not stream videos
» Recover takes at least one day
Automatic Recovery from Data Loss
Restored exact data in
15 MINUTES
Avoided delay of
1-2 DAYS
NEAR ZERO
Revenue loss
or reduced customer experience
Over $10M Saved, 2x Faster Releases
8+ Petabytes
In Storage Saved
6,000+ Apps, DBs
Virtualized for Self-Service
In my 4 years as CIO here at
Molina, the best ROI of any
technology investment that
I’ve made has been with
Delphix.
—Rick Hopfer
Molina CIO
CIO 100 Award Winner
with Delphix Implementation
• Regional expansion, Affordable Care Act, HIPAA
50% Reduction
In Application Release
Schedules
» ERP Migration from HP to HCL/Cognizant
» Refresh/Upgrade software and hardware
» Planned 7 day outage
Migration Risk Reduction
Almost ZERO
Downtime during migration
Accelerated project timeline by
30%
80%
Reduction in data migrated
Problem:
Rapid global expansion
Each region sub ledger must be reconciled in GL
Hard to root cause, reconcile sub ledger collisions
Solution:
» Finance now has 15 independent, trial-close tracks
» Preserve end-of-quarter data for SOX audits
» Data reset, refresh in 10 minutes vs. weeks
» Data errors reduced from ~20 per month to 0
21 to 2 Day Financial Close
Problem:
Mobile devices drive 50% traffic, revenues
Monthly releases were too slow
Solution:
» 30 day  daily releases (drives $400M sales)
» Delphix secures, automates data delivery
» Massive parallelization: from 5 to 120+ virtual DB copies
30 day releases down to daily
• Compliance risk for Sarbanes-Oxley
• Complex application, data migration
• Environment, data delivery times
• Costs for maintaining legacy environment
EBS upgrade and compliance
2x Faster Migration
reduce project risks
Fast Audit Compliance
Live Archive for full EBS R11
environment
Insert picture
© 2015 Delphix. All Rights Reserved. Private & Confidential. P50.
“Delphix saved my bacon” – Bryan Wise, IT Director
• Resources for only 2 app programs per year
Development productivity
50% Lower
Mitigated data loss compliance
risk
5x Development output
.
94% consolidation of Storage
.
Insert picture
© 2015 Delphix. All Rights Reserved. Private & Confidential. P51.
“Delphix saved my bacon” – Bryan Wise, IT Director
WALMART
» Rapid development to compete with Amazon
» 25 databases e-commerce application
» Refresh takes 10 DBAs 6 weeks
Rapid Application Updates
Moving to
100 copies
of PROD in dev/test
98% Reduction
In workdays required to refresh
15 TB DB
& 20+ others DBs
Provisioned in sync
Thank you!
• Kyle Hailey - Technical Evangelist (Oracle Ace Director, Oaktable)
– Kyle@delphix.com
– kylehailey.com
– slideshare.net/khailey
– @virtdata
67© Cloudera, Inc. All rights reserved.
Why is Big Data Important?
Stephen Fitzsimmons
Account Executive ANZ Government
68© Cloudera, Inc. All rights reserved.
Agenda
• What is the Big Data Mission?
• The role of Hadoop and an Enterprise Data Hub
• Big Data at work
69© Cloudera, Inc. All rights reserved.
Agenda
• What is the Big Data mission
• The role of Hadoop and an Enterprise Data Hub
• Big Data at work
70© Cloudera, Inc. All rights reserved.
The Mission:
Big Data helps organizations
get value from all their data
71© Cloudera, Inc. All rights reserved.
Agenda
• What is the Big Data Mission
• The role of Hadoop and an Enterprise Data Hub
• Big Data at work
72© Cloudera, Inc. All rights reserved.
Cloudera Enterprise
Making Hadoop Fast, Easy, and Secure
A new kind of data
platform:
• One place for unlimited data
• Unified, multi-framework data
access
Cloudera makes it:
• Fast for business
• Easy to manage
• Secure without compromise
STORE
INTEGRATE
OPERATIONS
Cloudera Manager
Cloudera Director
DATA
MANAGEMENT
Cloudera Navigator
Encrypt and KeyTrustee
Optimizer
STRUCTURED
Sqoop
UNSTRUCTURED
Kafka, Flume
PROCESS, ANALYZE, SERVE
UNIFIED SERVICES
RESOURCE MANAGEMENT
YARN
SECURITY
Sentry, RecordService
FILESYSTEM
HDFS
RELATIONAL
Kudu
NoSQL
HBase
STORE
INTEGRATE
BATCH
Spark, Hive, Pig
MapReduce
STREA
M
Spark
SQL
Impala
SEARCH
Solr
SDK
Kite
73© Cloudera, Inc. All rights reserved.
Our approach
Cloudera Enterprise
Enterprise Data Hub
Security and Administration
Unlimited Storage
Process Discover Model Serve
Manager
Navigator
Director
CDH
Cloudera Services
Cluster Certification
Cloudera Training
Cloudera Partners
Security Integration
Production Readiness
Ingest ETL Pilot
Descriptive Analytics Pilot
Center of Excellence
Hadoop or Manager
Admin
Building Big Data Apps
Spark, HBase,
Search or MR Developer
Hadoop Essentials
Data Analyst Training
Intro to Data Science
74© Cloudera, Inc. All rights reserved.
Agenda
• What is the Big Data Mission
• The role of Hadoop and an Enterprise Data Hub
• Big Data at work
75© Cloudera, Inc. All rights reserved.
Big Data across industries
Public Sector & Government
The intelligence community securely manages, audits, & analyzes massive video data sets to fight terrorism
Retail & E-Commerce
Take a 360o view of online behaviors to customize interactions, including real-time recommendations
Financial Services & Banking
Ingest, transform, secure, and scrutinize data from multiple silos to detect/prevent fraud and mitigate risk
Healthcare & Biotech
Index and cross-query patient and pharma data in real time and manage next-gen sequencing workflows
Media & Entertainment
Scale user data capture to optimize marketing, reporting, and content positioning at manageable cost
76© Cloudera, Inc. All rights reserved.
77© Cloudera, Inc. All rights reserved.
A large government
revenue service brings
customer convenience
with pre-populated tax
returns
78© Cloudera, Inc. All rights reserved.
Customer Spotlight: Govt Revenue Service
£506B annual collection
data is spread across 12
data warehouses
• Unacceptably slow data
access and analysis
Cloudera EDH
• 960TB structured &
unstructured data
• Thousands of users now
access the cluster, including
50,000 with Impala
View the complete
taxpayer journey
• How long did it take us
to respond to that
letter?
• Creates ability to pre-
populate tax returns
Challenge Solution Benefit
Pre-populating tax returns for taxpayer
convenience.
79© Cloudera, Inc. All rights reserved.
Questions?
stephen.fitzsimmons@cloudera.co
m
e-IT exec lunch - "It's all about data" - 25 May '16

More Related Content

What's hot

Oracle: Building Cloud Native Applications
Oracle: Building Cloud Native ApplicationsOracle: Building Cloud Native Applications
Oracle: Building Cloud Native ApplicationsKelly Goetsch
 
Light Speed with Test Data Management
Light Speed with Test Data ManagementLight Speed with Test Data Management
Light Speed with Test Data ManagementKellyn Pot'Vin-Gorman
 
Hadoop in 2015: Keys to Achieving Operational Excellence for the Real-Time En...
Hadoop in 2015: Keys to Achieving Operational Excellence for the Real-Time En...Hadoop in 2015: Keys to Achieving Operational Excellence for the Real-Time En...
Hadoop in 2015: Keys to Achieving Operational Excellence for the Real-Time En...MapR Technologies
 
InterVision-Overview.January-2016
InterVision-Overview.January-2016InterVision-Overview.January-2016
InterVision-Overview.January-2016Arthur Sobczyk
 
9 Hyperion Performance Myths and How to Debunk Them
9 Hyperion Performance Myths and How to Debunk Them9 Hyperion Performance Myths and How to Debunk Them
9 Hyperion Performance Myths and How to Debunk ThemDatavail
 
Kythera BioPharma Commercial Infrastructure 2015 05 28 final
Kythera BioPharma Commercial Infrastructure 2015 05 28 finalKythera BioPharma Commercial Infrastructure 2015 05 28 final
Kythera BioPharma Commercial Infrastructure 2015 05 28 finalMichael W. Hughes
 
Journey to the Cloud: What I Wish I Knew Before I Started
Journey to the Cloud: What I Wish I Knew Before I Started Journey to the Cloud: What I Wish I Knew Before I Started
Journey to the Cloud: What I Wish I Knew Before I Started Datavail
 
Hms crash planitsummit2016
Hms crash planitsummit2016Hms crash planitsummit2016
Hms crash planitsummit2016kevin_donovan
 
Hp discover 2012 managing the virtualization explosion
Hp discover 2012   managing the virtualization explosionHp discover 2012   managing the virtualization explosion
Hp discover 2012 managing the virtualization explosionStefan Bergstein
 
Focus on business, not backups
Focus on business, not backupsFocus on business, not backups
Focus on business, not backupsDell World
 
Redis rise of Dataops
Redis rise of DataopsRedis rise of Dataops
Redis rise of Dataopslandoop
 
Using Big Data to Transform Your Customer’s Experience - Part 1

Using Big Data to Transform Your Customer’s Experience - Part 1
Using Big Data to Transform Your Customer’s Experience - Part 1

Using Big Data to Transform Your Customer’s Experience - Part 1
Cloudera, Inc.
 
Webinar: Become PSD2 ready with DataStax
Webinar: Become PSD2 ready with DataStaxWebinar: Become PSD2 ready with DataStax
Webinar: Become PSD2 ready with DataStaxDataStax
 
5 Best Practices for Monitoring Hive and MapReduce Application Performance
5 Best Practices for Monitoring Hive and MapReduce Application Performance5 Best Practices for Monitoring Hive and MapReduce Application Performance
5 Best Practices for Monitoring Hive and MapReduce Application PerformanceDriven Inc.
 
Prescriptive Cloud Services for the Future Ready Enterprise
Prescriptive Cloud Services for the Future Ready EnterprisePrescriptive Cloud Services for the Future Ready Enterprise
Prescriptive Cloud Services for the Future Ready EnterpriseDell World
 
Pivotal HAWQ and Hortonworks Data Platform: Modern Data Architecture for IT T...
Pivotal HAWQ and Hortonworks Data Platform: Modern Data Architecture for IT T...Pivotal HAWQ and Hortonworks Data Platform: Modern Data Architecture for IT T...
Pivotal HAWQ and Hortonworks Data Platform: Modern Data Architecture for IT T...VMware Tanzu
 
Beyond Monitoring | Leveraging Unified IT Performance Management for Patient ...
Beyond Monitoring | Leveraging Unified IT Performance Management for Patient ...Beyond Monitoring | Leveraging Unified IT Performance Management for Patient ...
Beyond Monitoring | Leveraging Unified IT Performance Management for Patient ...eG Innovations
 
Journey to the Cloud: What I Wish I Knew Before I Started
 Journey to the Cloud: What I Wish I Knew Before I Started Journey to the Cloud: What I Wish I Knew Before I Started
Journey to the Cloud: What I Wish I Knew Before I StartedDatavail
 
Next Generation Datacenter Oracle - Alan Hartwell
Next Generation Datacenter Oracle - Alan HartwellNext Generation Datacenter Oracle - Alan Hartwell
Next Generation Datacenter Oracle - Alan HartwellHPDutchWorld
 

What's hot (20)

Oracle: Building Cloud Native Applications
Oracle: Building Cloud Native ApplicationsOracle: Building Cloud Native Applications
Oracle: Building Cloud Native Applications
 
DevOps for the DBA- Jax Style!
DevOps for the DBA-  Jax Style!DevOps for the DBA-  Jax Style!
DevOps for the DBA- Jax Style!
 
Light Speed with Test Data Management
Light Speed with Test Data ManagementLight Speed with Test Data Management
Light Speed with Test Data Management
 
Hadoop in 2015: Keys to Achieving Operational Excellence for the Real-Time En...
Hadoop in 2015: Keys to Achieving Operational Excellence for the Real-Time En...Hadoop in 2015: Keys to Achieving Operational Excellence for the Real-Time En...
Hadoop in 2015: Keys to Achieving Operational Excellence for the Real-Time En...
 
InterVision-Overview.January-2016
InterVision-Overview.January-2016InterVision-Overview.January-2016
InterVision-Overview.January-2016
 
9 Hyperion Performance Myths and How to Debunk Them
9 Hyperion Performance Myths and How to Debunk Them9 Hyperion Performance Myths and How to Debunk Them
9 Hyperion Performance Myths and How to Debunk Them
 
Kythera BioPharma Commercial Infrastructure 2015 05 28 final
Kythera BioPharma Commercial Infrastructure 2015 05 28 finalKythera BioPharma Commercial Infrastructure 2015 05 28 final
Kythera BioPharma Commercial Infrastructure 2015 05 28 final
 
Journey to the Cloud: What I Wish I Knew Before I Started
Journey to the Cloud: What I Wish I Knew Before I Started Journey to the Cloud: What I Wish I Knew Before I Started
Journey to the Cloud: What I Wish I Knew Before I Started
 
Hms crash planitsummit2016
Hms crash planitsummit2016Hms crash planitsummit2016
Hms crash planitsummit2016
 
Hp discover 2012 managing the virtualization explosion
Hp discover 2012   managing the virtualization explosionHp discover 2012   managing the virtualization explosion
Hp discover 2012 managing the virtualization explosion
 
Focus on business, not backups
Focus on business, not backupsFocus on business, not backups
Focus on business, not backups
 
Redis rise of Dataops
Redis rise of DataopsRedis rise of Dataops
Redis rise of Dataops
 
Using Big Data to Transform Your Customer’s Experience - Part 1

Using Big Data to Transform Your Customer’s Experience - Part 1
Using Big Data to Transform Your Customer’s Experience - Part 1

Using Big Data to Transform Your Customer’s Experience - Part 1

 
Webinar: Become PSD2 ready with DataStax
Webinar: Become PSD2 ready with DataStaxWebinar: Become PSD2 ready with DataStax
Webinar: Become PSD2 ready with DataStax
 
5 Best Practices for Monitoring Hive and MapReduce Application Performance
5 Best Practices for Monitoring Hive and MapReduce Application Performance5 Best Practices for Monitoring Hive and MapReduce Application Performance
5 Best Practices for Monitoring Hive and MapReduce Application Performance
 
Prescriptive Cloud Services for the Future Ready Enterprise
Prescriptive Cloud Services for the Future Ready EnterprisePrescriptive Cloud Services for the Future Ready Enterprise
Prescriptive Cloud Services for the Future Ready Enterprise
 
Pivotal HAWQ and Hortonworks Data Platform: Modern Data Architecture for IT T...
Pivotal HAWQ and Hortonworks Data Platform: Modern Data Architecture for IT T...Pivotal HAWQ and Hortonworks Data Platform: Modern Data Architecture for IT T...
Pivotal HAWQ and Hortonworks Data Platform: Modern Data Architecture for IT T...
 
Beyond Monitoring | Leveraging Unified IT Performance Management for Patient ...
Beyond Monitoring | Leveraging Unified IT Performance Management for Patient ...Beyond Monitoring | Leveraging Unified IT Performance Management for Patient ...
Beyond Monitoring | Leveraging Unified IT Performance Management for Patient ...
 
Journey to the Cloud: What I Wish I Knew Before I Started
 Journey to the Cloud: What I Wish I Knew Before I Started Journey to the Cloud: What I Wish I Knew Before I Started
Journey to the Cloud: What I Wish I Knew Before I Started
 
Next Generation Datacenter Oracle - Alan Hartwell
Next Generation Datacenter Oracle - Alan HartwellNext Generation Datacenter Oracle - Alan Hartwell
Next Generation Datacenter Oracle - Alan Hartwell
 

Similar to e-IT exec lunch - "It's all about data" - 25 May '16

Virtual Data : Eliminating the data constraint in Application Development
Virtual Data :  Eliminating the data constraint in Application DevelopmentVirtual Data :  Eliminating the data constraint in Application Development
Virtual Data : Eliminating the data constraint in Application DevelopmentKyle Hailey
 
Delphix and Pure Storage partner
Delphix and Pure Storage partnerDelphix and Pure Storage partner
Delphix and Pure Storage partnerKyle Hailey
 
451 Research: Data Is the Key to Friction in DevOps
451 Research: Data Is the Key to Friction in DevOps451 Research: Data Is the Key to Friction in DevOps
451 Research: Data Is the Key to Friction in DevOpsDelphix
 
Accelerate Develoment with VIrtual Data
Accelerate Develoment with VIrtual DataAccelerate Develoment with VIrtual Data
Accelerate Develoment with VIrtual DataKyle Hailey
 
Databases: The Neglected Technology in DevOps
Databases: The Neglected Technology in DevOpsDatabases: The Neglected Technology in DevOps
Databases: The Neglected Technology in DevOpsDevOps.com
 
Gab Genai Cloudera - Going Beyond Traditional Analytic
Gab Genai Cloudera - Going Beyond Traditional Analytic Gab Genai Cloudera - Going Beyond Traditional Analytic
Gab Genai Cloudera - Going Beyond Traditional Analytic IntelAPAC
 
There are 250 Database products, are you running the right one?
There are 250 Database products, are you running the right one?There are 250 Database products, are you running the right one?
There are 250 Database products, are you running the right one?Aerospike, Inc.
 
Turning Petabytes of Data into Profit with Hadoop for the World’s Biggest Ret...
Turning Petabytes of Data into Profit with Hadoop for the World’s Biggest Ret...Turning Petabytes of Data into Profit with Hadoop for the World’s Biggest Ret...
Turning Petabytes of Data into Profit with Hadoop for the World’s Biggest Ret...Cloudera, Inc.
 
Data Vault 2.0 DeMystified with Dan Linstedt and WhereScape
Data Vault 2.0 DeMystified with Dan Linstedt and WhereScapeData Vault 2.0 DeMystified with Dan Linstedt and WhereScape
Data Vault 2.0 DeMystified with Dan Linstedt and WhereScapeWhereScape
 
Data Vault 2.0 Demystified: East Coast Tour
Data Vault 2.0 Demystified: East Coast TourData Vault 2.0 Demystified: East Coast Tour
Data Vault 2.0 Demystified: East Coast TourWhereScape
 
Building Confidence in Big Data - IBM Smarter Business 2013
Building Confidence in Big Data - IBM Smarter Business 2013 Building Confidence in Big Data - IBM Smarter Business 2013
Building Confidence in Big Data - IBM Smarter Business 2013 IBM Sverige
 
Agile application delivery trio webinar
Agile application delivery trio webinarAgile application delivery trio webinar
Agile application delivery trio webinarSkytap Cloud
 
Houd controle over uw data
Houd controle over uw dataHoud controle over uw data
Houd controle over uw dataICT-Partners
 
C-BAG Big Data Meetup Chennai Oct.29-2014 Hortonworks and Concurrent on Casca...
C-BAG Big Data Meetup Chennai Oct.29-2014 Hortonworks and Concurrent on Casca...C-BAG Big Data Meetup Chennai Oct.29-2014 Hortonworks and Concurrent on Casca...
C-BAG Big Data Meetup Chennai Oct.29-2014 Hortonworks and Concurrent on Casca...Hortonworks
 
2022 Trends in Enterprise Analytics
2022 Trends in Enterprise Analytics2022 Trends in Enterprise Analytics
2022 Trends in Enterprise AnalyticsDATAVERSITY
 
Building a Modern Analytic Database with Cloudera 5.8
Building a Modern Analytic Database with Cloudera 5.8Building a Modern Analytic Database with Cloudera 5.8
Building a Modern Analytic Database with Cloudera 5.8Cloudera, Inc.
 
Data Architecture Best Practices for Advanced Analytics
Data Architecture Best Practices for Advanced AnalyticsData Architecture Best Practices for Advanced Analytics
Data Architecture Best Practices for Advanced AnalyticsDATAVERSITY
 
Increase your ROI with Hadoop in Six Months - Presented by Dell, Cloudera and...
Increase your ROI with Hadoop in Six Months - Presented by Dell, Cloudera and...Increase your ROI with Hadoop in Six Months - Presented by Dell, Cloudera and...
Increase your ROI with Hadoop in Six Months - Presented by Dell, Cloudera and...Cloudera, Inc.
 
OCSL - VMware, vSphere Webinar May 2013
OCSL - VMware, vSphere Webinar May 2013OCSL - VMware, vSphere Webinar May 2013
OCSL - VMware, vSphere Webinar May 2013OCSL
 

Similar to e-IT exec lunch - "It's all about data" - 25 May '16 (20)

Virtual Data : Eliminating the data constraint in Application Development
Virtual Data :  Eliminating the data constraint in Application DevelopmentVirtual Data :  Eliminating the data constraint in Application Development
Virtual Data : Eliminating the data constraint in Application Development
 
Delphix and Pure Storage partner
Delphix and Pure Storage partnerDelphix and Pure Storage partner
Delphix and Pure Storage partner
 
451 Research: Data Is the Key to Friction in DevOps
451 Research: Data Is the Key to Friction in DevOps451 Research: Data Is the Key to Friction in DevOps
451 Research: Data Is the Key to Friction in DevOps
 
Accelerate Develoment with VIrtual Data
Accelerate Develoment with VIrtual DataAccelerate Develoment with VIrtual Data
Accelerate Develoment with VIrtual Data
 
Databases: The Neglected Technology in DevOps
Databases: The Neglected Technology in DevOpsDatabases: The Neglected Technology in DevOps
Databases: The Neglected Technology in DevOps
 
Gab Genai Cloudera - Going Beyond Traditional Analytic
Gab Genai Cloudera - Going Beyond Traditional Analytic Gab Genai Cloudera - Going Beyond Traditional Analytic
Gab Genai Cloudera - Going Beyond Traditional Analytic
 
There are 250 Database products, are you running the right one?
There are 250 Database products, are you running the right one?There are 250 Database products, are you running the right one?
There are 250 Database products, are you running the right one?
 
Turning Petabytes of Data into Profit with Hadoop for the World’s Biggest Ret...
Turning Petabytes of Data into Profit with Hadoop for the World’s Biggest Ret...Turning Petabytes of Data into Profit with Hadoop for the World’s Biggest Ret...
Turning Petabytes of Data into Profit with Hadoop for the World’s Biggest Ret...
 
Data Vault 2.0 DeMystified with Dan Linstedt and WhereScape
Data Vault 2.0 DeMystified with Dan Linstedt and WhereScapeData Vault 2.0 DeMystified with Dan Linstedt and WhereScape
Data Vault 2.0 DeMystified with Dan Linstedt and WhereScape
 
Data Vault 2.0 Demystified: East Coast Tour
Data Vault 2.0 Demystified: East Coast TourData Vault 2.0 Demystified: East Coast Tour
Data Vault 2.0 Demystified: East Coast Tour
 
Building Confidence in Big Data - IBM Smarter Business 2013
Building Confidence in Big Data - IBM Smarter Business 2013 Building Confidence in Big Data - IBM Smarter Business 2013
Building Confidence in Big Data - IBM Smarter Business 2013
 
Agile application delivery trio webinar
Agile application delivery trio webinarAgile application delivery trio webinar
Agile application delivery trio webinar
 
Big Data: Myths and Realities
Big Data: Myths and RealitiesBig Data: Myths and Realities
Big Data: Myths and Realities
 
Houd controle over uw data
Houd controle over uw dataHoud controle over uw data
Houd controle over uw data
 
C-BAG Big Data Meetup Chennai Oct.29-2014 Hortonworks and Concurrent on Casca...
C-BAG Big Data Meetup Chennai Oct.29-2014 Hortonworks and Concurrent on Casca...C-BAG Big Data Meetup Chennai Oct.29-2014 Hortonworks and Concurrent on Casca...
C-BAG Big Data Meetup Chennai Oct.29-2014 Hortonworks and Concurrent on Casca...
 
2022 Trends in Enterprise Analytics
2022 Trends in Enterprise Analytics2022 Trends in Enterprise Analytics
2022 Trends in Enterprise Analytics
 
Building a Modern Analytic Database with Cloudera 5.8
Building a Modern Analytic Database with Cloudera 5.8Building a Modern Analytic Database with Cloudera 5.8
Building a Modern Analytic Database with Cloudera 5.8
 
Data Architecture Best Practices for Advanced Analytics
Data Architecture Best Practices for Advanced AnalyticsData Architecture Best Practices for Advanced Analytics
Data Architecture Best Practices for Advanced Analytics
 
Increase your ROI with Hadoop in Six Months - Presented by Dell, Cloudera and...
Increase your ROI with Hadoop in Six Months - Presented by Dell, Cloudera and...Increase your ROI with Hadoop in Six Months - Presented by Dell, Cloudera and...
Increase your ROI with Hadoop in Six Months - Presented by Dell, Cloudera and...
 
OCSL - VMware, vSphere Webinar May 2013
OCSL - VMware, vSphere Webinar May 2013OCSL - VMware, vSphere Webinar May 2013
OCSL - VMware, vSphere Webinar May 2013
 

Recently uploaded

VIP Call Girls Service Miyapur Hyderabad Call +91-8250192130
VIP Call Girls Service Miyapur Hyderabad Call +91-8250192130VIP Call Girls Service Miyapur Hyderabad Call +91-8250192130
VIP Call Girls Service Miyapur Hyderabad Call +91-8250192130Suhani Kapoor
 
BigBuy dropshipping via API with DroFx.pptx
BigBuy dropshipping via API with DroFx.pptxBigBuy dropshipping via API with DroFx.pptx
BigBuy dropshipping via API with DroFx.pptxolyaivanovalion
 
Industrialised data - the key to AI success.pdf
Industrialised data - the key to AI success.pdfIndustrialised data - the key to AI success.pdf
Industrialised data - the key to AI success.pdfLars Albertsson
 
04242024_CCC TUG_Joins and Relationships
04242024_CCC TUG_Joins and Relationships04242024_CCC TUG_Joins and Relationships
04242024_CCC TUG_Joins and Relationshipsccctableauusergroup
 
꧁❤ Greater Noida Call Girls Delhi ❤꧂ 9711199171 ☎️ Hard And Sexy Vip Call
꧁❤ Greater Noida Call Girls Delhi ❤꧂ 9711199171 ☎️ Hard And Sexy Vip Call꧁❤ Greater Noida Call Girls Delhi ❤꧂ 9711199171 ☎️ Hard And Sexy Vip Call
꧁❤ Greater Noida Call Girls Delhi ❤꧂ 9711199171 ☎️ Hard And Sexy Vip Callshivangimorya083
 
Market Analysis in the 5 Largest Economic Countries in Southeast Asia.pdf
Market Analysis in the 5 Largest Economic Countries in Southeast Asia.pdfMarket Analysis in the 5 Largest Economic Countries in Southeast Asia.pdf
Market Analysis in the 5 Largest Economic Countries in Southeast Asia.pdfRachmat Ramadhan H
 
Low Rate Call Girls Bhilai Anika 8250192130 Independent Escort Service Bhilai
Low Rate Call Girls Bhilai Anika 8250192130 Independent Escort Service BhilaiLow Rate Call Girls Bhilai Anika 8250192130 Independent Escort Service Bhilai
Low Rate Call Girls Bhilai Anika 8250192130 Independent Escort Service BhilaiSuhani Kapoor
 
Unveiling Insights: The Role of a Data Analyst
Unveiling Insights: The Role of a Data AnalystUnveiling Insights: The Role of a Data Analyst
Unveiling Insights: The Role of a Data AnalystSamantha Rae Coolbeth
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...apidays
 
Data-Analysis for Chicago Crime Data 2023
Data-Analysis for Chicago Crime Data  2023Data-Analysis for Chicago Crime Data  2023
Data-Analysis for Chicago Crime Data 2023ymrp368
 
BPAC WITH UFSBI GENERAL PRESENTATION 18_05_2017-1.pptx
BPAC WITH UFSBI GENERAL PRESENTATION 18_05_2017-1.pptxBPAC WITH UFSBI GENERAL PRESENTATION 18_05_2017-1.pptx
BPAC WITH UFSBI GENERAL PRESENTATION 18_05_2017-1.pptxMohammedJunaid861692
 
Generative AI on Enterprise Cloud with NiFi and Milvus
Generative AI on Enterprise Cloud with NiFi and MilvusGenerative AI on Enterprise Cloud with NiFi and Milvus
Generative AI on Enterprise Cloud with NiFi and MilvusTimothy Spann
 
Al Barsha Escorts $#$ O565212860 $#$ Escort Service In Al Barsha
Al Barsha Escorts $#$ O565212860 $#$ Escort Service In Al BarshaAl Barsha Escorts $#$ O565212860 $#$ Escort Service In Al Barsha
Al Barsha Escorts $#$ O565212860 $#$ Escort Service In Al BarshaAroojKhan71
 
Brighton SEO | April 2024 | Data Storytelling
Brighton SEO | April 2024 | Data StorytellingBrighton SEO | April 2024 | Data Storytelling
Brighton SEO | April 2024 | Data StorytellingNeil Barnes
 
(PARI) Call Girls Wanowrie ( 7001035870 ) HI-Fi Pune Escorts Service
(PARI) Call Girls Wanowrie ( 7001035870 ) HI-Fi Pune Escorts Service(PARI) Call Girls Wanowrie ( 7001035870 ) HI-Fi Pune Escorts Service
(PARI) Call Girls Wanowrie ( 7001035870 ) HI-Fi Pune Escorts Serviceranjana rawat
 
代办国外大学文凭《原版美国UCLA文凭证书》加州大学洛杉矶分校毕业证制作成绩单修改
代办国外大学文凭《原版美国UCLA文凭证书》加州大学洛杉矶分校毕业证制作成绩单修改代办国外大学文凭《原版美国UCLA文凭证书》加州大学洛杉矶分校毕业证制作成绩单修改
代办国外大学文凭《原版美国UCLA文凭证书》加州大学洛杉矶分校毕业证制作成绩单修改atducpo
 
BabyOno dropshipping via API with DroFx.pptx
BabyOno dropshipping via API with DroFx.pptxBabyOno dropshipping via API with DroFx.pptx
BabyOno dropshipping via API with DroFx.pptxolyaivanovalion
 
B2 Creative Industry Response Evaluation.docx
B2 Creative Industry Response Evaluation.docxB2 Creative Industry Response Evaluation.docx
B2 Creative Industry Response Evaluation.docxStephen266013
 
Mature dropshipping via API with DroFx.pptx
Mature dropshipping via API with DroFx.pptxMature dropshipping via API with DroFx.pptx
Mature dropshipping via API with DroFx.pptxolyaivanovalion
 

Recently uploaded (20)

VIP Call Girls Service Miyapur Hyderabad Call +91-8250192130
VIP Call Girls Service Miyapur Hyderabad Call +91-8250192130VIP Call Girls Service Miyapur Hyderabad Call +91-8250192130
VIP Call Girls Service Miyapur Hyderabad Call +91-8250192130
 
BigBuy dropshipping via API with DroFx.pptx
BigBuy dropshipping via API with DroFx.pptxBigBuy dropshipping via API with DroFx.pptx
BigBuy dropshipping via API with DroFx.pptx
 
Industrialised data - the key to AI success.pdf
Industrialised data - the key to AI success.pdfIndustrialised data - the key to AI success.pdf
Industrialised data - the key to AI success.pdf
 
04242024_CCC TUG_Joins and Relationships
04242024_CCC TUG_Joins and Relationships04242024_CCC TUG_Joins and Relationships
04242024_CCC TUG_Joins and Relationships
 
꧁❤ Greater Noida Call Girls Delhi ❤꧂ 9711199171 ☎️ Hard And Sexy Vip Call
꧁❤ Greater Noida Call Girls Delhi ❤꧂ 9711199171 ☎️ Hard And Sexy Vip Call꧁❤ Greater Noida Call Girls Delhi ❤꧂ 9711199171 ☎️ Hard And Sexy Vip Call
꧁❤ Greater Noida Call Girls Delhi ❤꧂ 9711199171 ☎️ Hard And Sexy Vip Call
 
Market Analysis in the 5 Largest Economic Countries in Southeast Asia.pdf
Market Analysis in the 5 Largest Economic Countries in Southeast Asia.pdfMarket Analysis in the 5 Largest Economic Countries in Southeast Asia.pdf
Market Analysis in the 5 Largest Economic Countries in Southeast Asia.pdf
 
Low Rate Call Girls Bhilai Anika 8250192130 Independent Escort Service Bhilai
Low Rate Call Girls Bhilai Anika 8250192130 Independent Escort Service BhilaiLow Rate Call Girls Bhilai Anika 8250192130 Independent Escort Service Bhilai
Low Rate Call Girls Bhilai Anika 8250192130 Independent Escort Service Bhilai
 
Unveiling Insights: The Role of a Data Analyst
Unveiling Insights: The Role of a Data AnalystUnveiling Insights: The Role of a Data Analyst
Unveiling Insights: The Role of a Data Analyst
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
 
Data-Analysis for Chicago Crime Data 2023
Data-Analysis for Chicago Crime Data  2023Data-Analysis for Chicago Crime Data  2023
Data-Analysis for Chicago Crime Data 2023
 
BPAC WITH UFSBI GENERAL PRESENTATION 18_05_2017-1.pptx
BPAC WITH UFSBI GENERAL PRESENTATION 18_05_2017-1.pptxBPAC WITH UFSBI GENERAL PRESENTATION 18_05_2017-1.pptx
BPAC WITH UFSBI GENERAL PRESENTATION 18_05_2017-1.pptx
 
VIP Call Girls Service Charbagh { Lucknow Call Girls Service 9548273370 } Boo...
VIP Call Girls Service Charbagh { Lucknow Call Girls Service 9548273370 } Boo...VIP Call Girls Service Charbagh { Lucknow Call Girls Service 9548273370 } Boo...
VIP Call Girls Service Charbagh { Lucknow Call Girls Service 9548273370 } Boo...
 
Generative AI on Enterprise Cloud with NiFi and Milvus
Generative AI on Enterprise Cloud with NiFi and MilvusGenerative AI on Enterprise Cloud with NiFi and Milvus
Generative AI on Enterprise Cloud with NiFi and Milvus
 
Al Barsha Escorts $#$ O565212860 $#$ Escort Service In Al Barsha
Al Barsha Escorts $#$ O565212860 $#$ Escort Service In Al BarshaAl Barsha Escorts $#$ O565212860 $#$ Escort Service In Al Barsha
Al Barsha Escorts $#$ O565212860 $#$ Escort Service In Al Barsha
 
Brighton SEO | April 2024 | Data Storytelling
Brighton SEO | April 2024 | Data StorytellingBrighton SEO | April 2024 | Data Storytelling
Brighton SEO | April 2024 | Data Storytelling
 
(PARI) Call Girls Wanowrie ( 7001035870 ) HI-Fi Pune Escorts Service
(PARI) Call Girls Wanowrie ( 7001035870 ) HI-Fi Pune Escorts Service(PARI) Call Girls Wanowrie ( 7001035870 ) HI-Fi Pune Escorts Service
(PARI) Call Girls Wanowrie ( 7001035870 ) HI-Fi Pune Escorts Service
 
代办国外大学文凭《原版美国UCLA文凭证书》加州大学洛杉矶分校毕业证制作成绩单修改
代办国外大学文凭《原版美国UCLA文凭证书》加州大学洛杉矶分校毕业证制作成绩单修改代办国外大学文凭《原版美国UCLA文凭证书》加州大学洛杉矶分校毕业证制作成绩单修改
代办国外大学文凭《原版美国UCLA文凭证书》加州大学洛杉矶分校毕业证制作成绩单修改
 
BabyOno dropshipping via API with DroFx.pptx
BabyOno dropshipping via API with DroFx.pptxBabyOno dropshipping via API with DroFx.pptx
BabyOno dropshipping via API with DroFx.pptx
 
B2 Creative Industry Response Evaluation.docx
B2 Creative Industry Response Evaluation.docxB2 Creative Industry Response Evaluation.docx
B2 Creative Industry Response Evaluation.docx
 
Mature dropshipping via API with DroFx.pptx
Mature dropshipping via API with DroFx.pptxMature dropshipping via API with DroFx.pptx
Mature dropshipping via API with DroFx.pptx
 

e-IT exec lunch - "It's all about data" - 25 May '16

  • 1. 1© 2015 Delphix. All Rights Reserved. Private & Confidential. Thought Leadership Series - It’s all about data!
  • 2. Agenda  Introductions  Pure Storage - Stu  Delphix - Kyle  Cloudera - Stephen  Wrap and Q & A session - Devin
  • 3. © 2016 PURE STORAGE, INC. INTRODUCING PURE STORAGE ITS ALL ABOUT DATA
  • 4. Double Developer Productivity with Virtual Data Kyle Hailey, Technical Evangelist at Delphix kyle@delphix.com
  • 5. The Phoenix Project What is the constraint in Application Development?
  • 6. Flow of Features 6 1 Development Environments 2 QA & Testing Environments Product Management Features 2 2 Code Architecture 3Code Speed 4 5 Data
  • 7. Development Pipeline for QA Build Deploy Environment Database
  • 8. 8 PROD DEV Test UAT DBA Sys Admin Storage Admin Legacy Data Movement: Slow & expensive ? Slow environment builds: delays
  • 9. Data Management not Agile 9 • 20% SDLC time lost waiting for data • 60% dev/QA time consumed by data tasks Conclusion: Data management does not scale to Agile - Infosys Data is the Constraint
  • 10. • Data Constraint • Solution • Use Cases In this presentation :
  • 11. Development UATQA 99% of blocks are identical
  • 14. One time backup of source database Production 3 TB 1 TB
  • 15. Install Delphix on Intel hardware • . • . • . • . • . • Data • . • Binaries • Application Stacks • EBS • SAP • Flat files
  • 16. Allocate Any Storage to Delphix Any Storage
  • 17. PROD 3 TB 1 TB One time backup of source database Data is compressed typically 1/3 size
  • 18. 18 PROD DEV DEV Test Test UAT Data as a Service : fast, elastic, secure Self Service
  • 19. 1. Development 2. Security 3. Cloud Migration Use Cases
  • 21. Problem Not Enough Resources: shared bottleneck Frustration Waiting
  • 22. Solution Virtual Data: Parallelize gif by Steve Karam
  • 23. Problem Not enough resources: limited environments
  • 24. Solution Virtual data: increase the limit
  • 25. 2. Bad data leads to bugs: subsets
  • 26. 26 Problem subsets lead to bugs: Production Wall
  • 28. Developer Asks for DB Get Access Manager approves DBA Request system Setup DB System Admin Request storage Setup machine Storage Admin Allocate storage (take snapshot) Problem Slow environment builds: delays
  • 29. Solution Virtual Data: Self Service
  • 30. Problem Bad data leads to bugs: late stage bugs Dev QA UAT Production # bugs Found
  • 31. Solution Virtual data : find bugs fast Dev QA UAT Production Dev Testing UAT Production 0 10 20 30 40 50 60 70 1 2 3 4 5 6 7 Cost To Correct Software Engineering Economics – Barry Boehm (1981)
  • 32. New York City based global bank 32
  • 33. RefreshTest Refresh Test Refresh Test Virtual Data : Fast Refresh 0 2 4 6 8 10 12 14 16 18 20 22 24 Hours Virtual Data Physical Data
  • 34. 1. Development & QA 2. Security 3. Cloud Migration Use Cases
  • 35. Production Dev, QA, UAT Reporting Backup Security problem
  • 36. Production Dev, QA, UAT Reporting Sandbox Security management improvement
  • 37. Delphix Virtual Data Masking • Automates discovery • Suggests algorithms • Mask once clone many Mask Data 6 hours Clone 18 Hours Clone 15 min Mask Data Mask 4 hours Mask Data
  • 38. Production Dev, QA, UAT Reporting Sandbox Security Solution
  • 39. 1. Development & QA 2. Security 3. Cloud Migration Use Cases
  • 40. Cloud Optimizations 40 ON PREMISE / PRIVATE CLOUD Replication Encrypted Compressed Masked
  • 41. Migration to Cloud with Delphix 41 Three Clones = Moving 1/3 of Source Size
  • 42. Cloud Optimizations 42 ON PREMISE / PRIVATE CLOUD $$$
  • 43. 1. Development & QA – Dev throughput increase by 2x 2. Secure – Mask once, clone many 3. Cloud Enablement – Compressed, encrypted replication – active/active replication Summary
  • 44. • Projects “12 months to 6 months.” – New York Life • Insurance product “about 50 days ... to about 23 days” – Presbyterian Health • “Can't imagine working without it” – State of California Virtual Data Quotes
  • 45. » DBA dropped video titles table » 24M users could not stream videos » Recover takes at least one day Automatic Recovery from Data Loss Restored exact data in 15 MINUTES Avoided delay of 1-2 DAYS NEAR ZERO Revenue loss or reduced customer experience
  • 46. Over $10M Saved, 2x Faster Releases 8+ Petabytes In Storage Saved 6,000+ Apps, DBs Virtualized for Self-Service In my 4 years as CIO here at Molina, the best ROI of any technology investment that I’ve made has been with Delphix. —Rick Hopfer Molina CIO CIO 100 Award Winner with Delphix Implementation • Regional expansion, Affordable Care Act, HIPAA 50% Reduction In Application Release Schedules
  • 47. » ERP Migration from HP to HCL/Cognizant » Refresh/Upgrade software and hardware » Planned 7 day outage Migration Risk Reduction Almost ZERO Downtime during migration Accelerated project timeline by 30% 80% Reduction in data migrated
  • 48. Problem: Rapid global expansion Each region sub ledger must be reconciled in GL Hard to root cause, reconcile sub ledger collisions Solution: » Finance now has 15 independent, trial-close tracks » Preserve end-of-quarter data for SOX audits » Data reset, refresh in 10 minutes vs. weeks » Data errors reduced from ~20 per month to 0 21 to 2 Day Financial Close
  • 49. Problem: Mobile devices drive 50% traffic, revenues Monthly releases were too slow Solution: » 30 day  daily releases (drives $400M sales) » Delphix secures, automates data delivery » Massive parallelization: from 5 to 120+ virtual DB copies 30 day releases down to daily
  • 50. • Compliance risk for Sarbanes-Oxley • Complex application, data migration • Environment, data delivery times • Costs for maintaining legacy environment EBS upgrade and compliance 2x Faster Migration reduce project risks Fast Audit Compliance Live Archive for full EBS R11 environment Insert picture © 2015 Delphix. All Rights Reserved. Private & Confidential. P50. “Delphix saved my bacon” – Bryan Wise, IT Director
  • 51. • Resources for only 2 app programs per year Development productivity 50% Lower Mitigated data loss compliance risk 5x Development output . 94% consolidation of Storage . Insert picture © 2015 Delphix. All Rights Reserved. Private & Confidential. P51. “Delphix saved my bacon” – Bryan Wise, IT Director
  • 52. WALMART » Rapid development to compete with Amazon » 25 databases e-commerce application » Refresh takes 10 DBAs 6 weeks Rapid Application Updates Moving to 100 copies of PROD in dev/test 98% Reduction In workdays required to refresh 15 TB DB & 20+ others DBs Provisioned in sync
  • 53. Thank you! • Kyle Hailey - Technical Evangelist (Oracle Ace Director, Oaktable) – Kyle@delphix.com – kylehailey.com – slideshare.net/khailey – @virtdata
  • 54. 67© Cloudera, Inc. All rights reserved. Why is Big Data Important? Stephen Fitzsimmons Account Executive ANZ Government
  • 55. 68© Cloudera, Inc. All rights reserved. Agenda • What is the Big Data Mission? • The role of Hadoop and an Enterprise Data Hub • Big Data at work
  • 56. 69© Cloudera, Inc. All rights reserved. Agenda • What is the Big Data mission • The role of Hadoop and an Enterprise Data Hub • Big Data at work
  • 57. 70© Cloudera, Inc. All rights reserved. The Mission: Big Data helps organizations get value from all their data
  • 58. 71© Cloudera, Inc. All rights reserved. Agenda • What is the Big Data Mission • The role of Hadoop and an Enterprise Data Hub • Big Data at work
  • 59. 72© Cloudera, Inc. All rights reserved. Cloudera Enterprise Making Hadoop Fast, Easy, and Secure A new kind of data platform: • One place for unlimited data • Unified, multi-framework data access Cloudera makes it: • Fast for business • Easy to manage • Secure without compromise STORE INTEGRATE OPERATIONS Cloudera Manager Cloudera Director DATA MANAGEMENT Cloudera Navigator Encrypt and KeyTrustee Optimizer STRUCTURED Sqoop UNSTRUCTURED Kafka, Flume PROCESS, ANALYZE, SERVE UNIFIED SERVICES RESOURCE MANAGEMENT YARN SECURITY Sentry, RecordService FILESYSTEM HDFS RELATIONAL Kudu NoSQL HBase STORE INTEGRATE BATCH Spark, Hive, Pig MapReduce STREA M Spark SQL Impala SEARCH Solr SDK Kite
  • 60. 73© Cloudera, Inc. All rights reserved. Our approach Cloudera Enterprise Enterprise Data Hub Security and Administration Unlimited Storage Process Discover Model Serve Manager Navigator Director CDH Cloudera Services Cluster Certification Cloudera Training Cloudera Partners Security Integration Production Readiness Ingest ETL Pilot Descriptive Analytics Pilot Center of Excellence Hadoop or Manager Admin Building Big Data Apps Spark, HBase, Search or MR Developer Hadoop Essentials Data Analyst Training Intro to Data Science
  • 61. 74© Cloudera, Inc. All rights reserved. Agenda • What is the Big Data Mission • The role of Hadoop and an Enterprise Data Hub • Big Data at work
  • 62. 75© Cloudera, Inc. All rights reserved. Big Data across industries Public Sector & Government The intelligence community securely manages, audits, & analyzes massive video data sets to fight terrorism Retail & E-Commerce Take a 360o view of online behaviors to customize interactions, including real-time recommendations Financial Services & Banking Ingest, transform, secure, and scrutinize data from multiple silos to detect/prevent fraud and mitigate risk Healthcare & Biotech Index and cross-query patient and pharma data in real time and manage next-gen sequencing workflows Media & Entertainment Scale user data capture to optimize marketing, reporting, and content positioning at manageable cost
  • 63. 76© Cloudera, Inc. All rights reserved.
  • 64. 77© Cloudera, Inc. All rights reserved. A large government revenue service brings customer convenience with pre-populated tax returns
  • 65. 78© Cloudera, Inc. All rights reserved. Customer Spotlight: Govt Revenue Service £506B annual collection data is spread across 12 data warehouses • Unacceptably slow data access and analysis Cloudera EDH • 960TB structured & unstructured data • Thousands of users now access the cluster, including 50,000 with Impala View the complete taxpayer journey • How long did it take us to respond to that letter? • Creates ability to pre- populate tax returns Challenge Solution Benefit Pre-populating tax returns for taxpayer convenience.
  • 66. 79© Cloudera, Inc. All rights reserved. Questions? stephen.fitzsimmons@cloudera.co m