The document presents a series of discussions on data management and its impact on development efficiency, featuring contributions from Delphix, Pure Storage, and Cloudera. It emphasizes the challenges of legacy data processes and offers solutions like virtual data provisioning to enhance development cycles, reduce costs, and improve compliance. Use cases from various industries underscore the significance of big data solutions for operational efficiency and customer service enhancement.

1. 1© 2015 Delphix. All Rights Reserved. Private & Confidential.
Thought Leadership Series -
It’s all about data!

2. Agenda
 Introductions
 Pure Storage - Stu
 Delphix - Kyle
 Cloudera - Stephen
 Wrap and Q & A session - Devin

3. © 2016 PURE STORAGE, INC.
INTRODUCING PURE STORAGE
ITS ALL ABOUT DATA

4. Double Developer Productivity with Virtual Data
Kyle Hailey, Technical Evangelist at Delphix
kyle@delphix.com

5. The Phoenix Project
What is the
constraint
in Application
Development?

6. Flow of Features
6
1
Development
Environments
2
QA & Testing Environments
Product
Management
Features
2 2
Code Architecture
3Code Speed
4
5
Data

7. Development Pipeline for QA
Build Deploy
Environment
Database

8. 8
PROD
DEV Test UAT
DBA
Sys Admin
Storage
Admin
Legacy Data Movement: Slow & expensive
?
Slow environment builds: delays

9. Data Management not Agile
9
• 20% SDLC time lost waiting for data
• 60% dev/QA time consumed by data tasks
Conclusion:
Data management does not scale to Agile
- Infosys
Data is the Constraint

10. • Data Constraint
• Solution
• Use Cases
In this presentation :

11. Development UATQA
99% of blocks are identical

12. Solution

13. Development QA UAT
Thin Clone

14. One time backup of source database
Production
3 TB
1 TB

15. Install Delphix on Intel hardware
• .
• .
• .
• .
• .
• Data
• .
• Binaries
• Application Stacks
• EBS
• SAP
• Flat files

16. Allocate Any Storage to Delphix
Any Storage

17. PROD
3 TB
1 TB
One time backup of source database
Data is
compressed
typically 1/3 size

18. 18
PROD DEV DEV Test Test UAT
Data as a Service : fast, elastic, secure
Self Service

19. 1. Development
2. Security
3. Cloud Migration
Use Cases

20. Development: Virtual Data
Development

21. Problem Not Enough Resources: shared bottleneck
Frustration Waiting

22. Solution Virtual Data: Parallelize
gif by Steve Karam

23. Problem Not enough resources: limited environments

24. Solution Virtual data: increase the limit

25. 2. Bad data leads to bugs: subsets

26. 26
Problem subsets lead to bugs: Production Wall

27. Solution Virtual Data: Full size

28. Developer Asks for DB Get Access
Manager approves
DBA Request
system
Setup DB
System Admin Request
storage
Setup
machine
Storage Admin Allocate
storage (take
snapshot)
Problem Slow environment builds: delays

29. Solution Virtual Data: Self Service

30. Problem Bad data leads to bugs: late stage bugs
Dev QA UAT Production
#
bugs
Found

31. Solution Virtual data : find bugs fast
Dev QA UAT Production
Dev Testing UAT Production
0
10
20
30
40
50
60
70
1 2 3 4 5 6 7
Cost
To
Correct
Software
Engineering
Economics
– Barry Boehm (1981)

32. New York City based global bank
32

33. RefreshTest Refresh
Test
Refresh
Test
Virtual Data : Fast Refresh
0 2 4 6 8 10 12 14 16 18 20 22 24
Hours
Virtual Data
Physical Data

34. 1. Development & QA
2. Security
3. Cloud Migration
Use Cases

35. Production Dev, QA, UAT Reporting Backup
Security problem

36. Production Dev, QA, UAT Reporting Sandbox
Security management improvement

37. Delphix Virtual Data Masking
• Automates discovery
• Suggests algorithms
• Mask once clone many
Mask Data
6 hours Clone 18 Hours
Clone
15 min
Mask Data
Mask
4 hours
Mask
Data

38. Production
Dev, QA, UAT Reporting Sandbox
Security Solution

39. 1. Development & QA
2. Security
3. Cloud Migration
Use Cases

40. Cloud Optimizations
40
ON PREMISE / PRIVATE
CLOUD
Replication
Encrypted
Compressed
Masked

41. Migration to Cloud with Delphix
41
Three Clones
=
Moving 1/3 of Source Size

42. Cloud Optimizations
42
ON PREMISE / PRIVATE
CLOUD
$$$

43. 1. Development & QA
– Dev throughput increase by 2x
2. Secure
– Mask once, clone many
3. Cloud Enablement
– Compressed, encrypted replication
– active/active replication
Summary

44. • Projects “12 months to 6 months.”
– New York Life
• Insurance product “about 50 days ... to about 23 days”
– Presbyterian Health
• “Can't imagine working without it”
– State of California
Virtual Data Quotes

45. » DBA dropped video titles table
» 24M users could not stream videos
» Recover takes at least one day
Automatic Recovery from Data Loss
Restored exact data in
15 MINUTES
Avoided delay of
1-2 DAYS
NEAR ZERO
Revenue loss
or reduced customer experience

46. Over $10M Saved, 2x Faster Releases
8+ Petabytes
In Storage Saved
6,000+ Apps, DBs
Virtualized for Self-Service
In my 4 years as CIO here at
Molina, the best ROI of any
technology investment that
I’ve made has been with
Delphix.
—Rick Hopfer
Molina CIO
CIO 100 Award Winner
with Delphix Implementation
• Regional expansion, Affordable Care Act, HIPAA
50% Reduction
In Application Release
Schedules

47. » ERP Migration from HP to HCL/Cognizant
» Refresh/Upgrade software and hardware
» Planned 7 day outage
Migration Risk Reduction
Almost ZERO
Downtime during migration
Accelerated project timeline by
30%
80%
Reduction in data migrated

48. Problem:
Rapid global expansion
Each region sub ledger must be reconciled in GL
Hard to root cause, reconcile sub ledger collisions
Solution:
» Finance now has 15 independent, trial-close tracks
» Preserve end-of-quarter data for SOX audits
» Data reset, refresh in 10 minutes vs. weeks
» Data errors reduced from ~20 per month to 0
21 to 2 Day Financial Close

49. Problem:
Mobile devices drive 50% traffic, revenues
Monthly releases were too slow
Solution:
» 30 day  daily releases (drives $400M sales)
» Delphix secures, automates data delivery
» Massive parallelization: from 5 to 120+ virtual DB copies
30 day releases down to daily

50. • Compliance risk for Sarbanes-Oxley
• Complex application, data migration
• Environment, data delivery times
• Costs for maintaining legacy environment
EBS upgrade and compliance
2x Faster Migration
reduce project risks
Fast Audit Compliance
Live Archive for full EBS R11
environment
Insert picture
© 2015 Delphix. All Rights Reserved. Private & Confidential. P50.
“Delphix saved my bacon” – Bryan Wise, IT Director

51. • Resources for only 2 app programs per year
Development productivity
50% Lower
Mitigated data loss compliance
risk
5x Development output
.
94% consolidation of Storage
.
Insert picture
© 2015 Delphix. All Rights Reserved. Private & Confidential. P51.
“Delphix saved my bacon” – Bryan Wise, IT Director

52. WALMART
» Rapid development to compete with Amazon
» 25 databases e-commerce application
» Refresh takes 10 DBAs 6 weeks
Rapid Application Updates
Moving to
100 copies
of PROD in dev/test
98% Reduction
In workdays required to refresh
15 TB DB
& 20+ others DBs
Provisioned in sync

53. Thank you!
• Kyle Hailey - Technical Evangelist (Oracle Ace Director, Oaktable)
– Kyle@delphix.com
– kylehailey.com
– slideshare.net/khailey
– @virtdata

54. 67© Cloudera, Inc. All rights reserved.
Why is Big Data Important?
Stephen Fitzsimmons
Account Executive ANZ Government

55. 68© Cloudera, Inc. All rights reserved.
Agenda
• What is the Big Data Mission?
• The role of Hadoop and an Enterprise Data Hub
• Big Data at work

56. 69© Cloudera, Inc. All rights reserved.
Agenda
• What is the Big Data mission
• The role of Hadoop and an Enterprise Data Hub
• Big Data at work

57. 70© Cloudera, Inc. All rights reserved.
The Mission:
Big Data helps organizations
get value from all their data

58. 71© Cloudera, Inc. All rights reserved.
Agenda
• What is the Big Data Mission
• The role of Hadoop and an Enterprise Data Hub
• Big Data at work

59. 72© Cloudera, Inc. All rights reserved.
Cloudera Enterprise
Making Hadoop Fast, Easy, and Secure
A new kind of data
platform:
• One place for unlimited data
• Unified, multi-framework data
access
Cloudera makes it:
• Fast for business
• Easy to manage
• Secure without compromise
STORE
INTEGRATE
OPERATIONS
Cloudera Manager
Cloudera Director
DATA
MANAGEMENT
Cloudera Navigator
Encrypt and KeyTrustee
Optimizer
STRUCTURED
Sqoop
UNSTRUCTURED
Kafka, Flume
PROCESS, ANALYZE, SERVE
UNIFIED SERVICES
RESOURCE MANAGEMENT
YARN
SECURITY
Sentry, RecordService
FILESYSTEM
HDFS
RELATIONAL
Kudu
NoSQL
HBase
STORE
INTEGRATE
BATCH
Spark, Hive, Pig
MapReduce
STREA
M
Spark
SQL
Impala
SEARCH
Solr
SDK
Kite

60. 73© Cloudera, Inc. All rights reserved.
Our approach
Cloudera Enterprise
Enterprise Data Hub
Security and Administration
Unlimited Storage
Process Discover Model Serve
Manager
Navigator
Director
CDH
Cloudera Services
Cluster Certification
Cloudera Training
Cloudera Partners
Security Integration
Production Readiness
Ingest ETL Pilot
Descriptive Analytics Pilot
Center of Excellence
Hadoop or Manager
Admin
Building Big Data Apps
Spark, HBase,
Search or MR Developer
Hadoop Essentials
Data Analyst Training
Intro to Data Science

61. 74© Cloudera, Inc. All rights reserved.
Agenda
• What is the Big Data Mission
• The role of Hadoop and an Enterprise Data Hub
• Big Data at work

62. 75© Cloudera, Inc. All rights reserved.
Big Data across industries
Public Sector & Government
The intelligence community securely manages, audits, & analyzes massive video data sets to fight terrorism
Retail & E-Commerce
Take a 360o view of online behaviors to customize interactions, including real-time recommendations
Financial Services & Banking
Ingest, transform, secure, and scrutinize data from multiple silos to detect/prevent fraud and mitigate risk
Healthcare & Biotech
Index and cross-query patient and pharma data in real time and manage next-gen sequencing workflows
Media & Entertainment
Scale user data capture to optimize marketing, reporting, and content positioning at manageable cost

63. 76© Cloudera, Inc. All rights reserved.

64. 77© Cloudera, Inc. All rights reserved.
A large government
revenue service brings
customer convenience
with pre-populated tax
returns

65. 78© Cloudera, Inc. All rights reserved.
Customer Spotlight: Govt Revenue Service
£506B annual collection
data is spread across 12
data warehouses
• Unacceptably slow data
access and analysis
Cloudera EDH
• 960TB structured &
unstructured data
• Thousands of users now
access the cluster, including
50,000 with Impala
View the complete
taxpayer journey
• How long did it take us
to respond to that
letter?
• Creates ability to pre-
populate tax returns
Challenge Solution Benefit
Pre-populating tax returns for taxpayer
convenience.

66. 79© Cloudera, Inc. All rights reserved.
Questions?
stephen.fitzsimmons@cloudera.co
m