Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
What is Delphix
kylehailey.com/delphix

Use Cases
What is
Delphix

Competition
What is Delphix
Three Physical Copies

Three Virtual Copies

Delphix
Install Delphix on Intel commodity hardware

Intel hardware
Allocate Any Storage to Delphix

Allocate Storage
Any type

Pure Storage + Delphix
Better Performance for
1/10 the cost
One time backup of source database
Production

Supports

Instance
Instance
Instance

Database

File system

Application St...
DxFS (Delphix) Compress Data
Production
Instance
Instance
Instance

Database

File system

Data is
compressed
typically 1/...
Incremental forever change collection
Production
Instance
Instance
Instance

Database

Changes
Time Window

File system

•...
Change collection works with snapshots

Snapshot 0:
Source Full Copy

Snapshot 1:
Changed blocks at
time T1
Snapshots immediately look like full copies as they are
mapped
onto the previous copy
Snapshot 0

Snapshot 1
Snapshot 0

Snapshot 1

Snapshot 2: Changed
blocks at time T2
Snapshot 0

Snapshot 2
Snapshot 1
Purging old snapshot releases any blocks that have
been since replaced, but keeps all unchanged blocks
Snapshot 2
Snapshot...
Cloning : almost no storage at creation since it is all
shared. Upon usage changed blocks will add to storage
used
Product...
Typical Architecture

Production

Dev, QA, UAT

Reporting

Instance
Instance
Instance
Instance
Instance
Instance

Instance...
With Delphix
Production
Instance
Instance

Database

File system

Dev & QA
Instance
Instance
Instance
Instance
Instance
In...
Delphix Use Cases

1.
2.
3.
4.
5.

Fast, Fresh, Full
Free
Branching
Federated
Self Serve
Fast, Fresh, Full
Source

Development VDB

Instance

Instance

Time Window
Free

Instance

Source
Instance

Instance

Instance

gif by Steve Karam
Branching
Source
Instance

branching

Dev
Instance

Source

QA
branched from Dev
Instance
Federated Cloning
Federated
Source1

Instance

Source1
Instance

Source2
Instance

Instance
“I looked like a hero”
Tony Young, CIO Informatica
Self Service
Use Cases
1.

Development Acceleration

2.

Quality

3.

BI
DevOps
DevOps With Delphix

1.
2.
3.
4.
5.

Efficient QA: Low cost, high utilization
Quick QA : Fast Bug Fix
Every Dev gets DB: P...
Without Delphix
1. Inefficient QA: Long Build times

Build

QA Test
Build Time

96% of QA time was building environment
$....
: With Delphix
1. Efficient QA: Lower cost

Build

QA Test
Build Time
B
u
i
l
d

T
i
m
e

QA Test

1% of QA time was build...
Rapid QA via Branching
Without Delphix
2. QA Delays: bugs found late require more code re-work
Build QA Env

Sprint 3

Sprint 2

Sprint 1

X

Bui...
: With Delphix
2. QA Immediate: bugs found fast and fixed
Build QA Env

Sprint 2

Sprint 1

X

Q
A

Build QA Env

Q
A

Spr...
Without Delphix
3. Full Copy Shared : Bottlenecks

Old Unrepresentative Data

Frustration Waiting
: With Delphix
3. Private Copies: Parallelize

gif by Steve Karam
Without Delphix

4. Subsets : cause bugs
Without Delphix
4. Subsets : cause
bugs
The Production ‘Wall’

Classic problem is that queries that
run fast on subsets hi...
: With Delphix
4. Full Size DB : Eliminate bugs
Without Delphix
5. Slow Environment Builds:

Slow Environment Builds: 3-6 Months to Deliver
Data
Developer
Asks for DB
Get...
Without Delphix
5. Slow Environment Builds: culture of no
DBA

Developer
Without Delphix
Never enough environments
: With Delphix
5. Self Service: Fast, Efficient. Culture of Yes!
Quality

1. Forensics
2. Testing
3. Recovery
1. Forensics: Investigate Production Bugs
Development
Instance

Instance

Time Window

Anomaly on Prod
Possible code bug
A...
2. Testing : Rewind for patch and QA testing
Prod

Development

Instance

Instance

Time Window

Time Window
2. Testing: A/B

Instance

Test A with Index 1

Instance

Instance

Time Window

• Keep tests for compare
• Production vs ...
3. Recovery: Surgical recover of Production
Source

Development

Instance

Instance

Spin VDB up
Before drop
Time Window
P...
3. Recovery Surgical or Full Recovery on VDB
Dev1 VDB
Source

Instance

Instance

Dev2 VDB Branched
Source
Time Window
Dev...
3. Recovery: Virtual to Physical
Source

VDB

Instance

Instance

Spin VDB up
Before drop
Time Window

Corruption
50 days of backup in size of
Original

3. Recovery
Business Intelligence
ETL and Refresh Windows

1pm
noon

10pm

8am
ETL and DW refreshes taking longer

1pm
noon

10pm

2011
2012
2013
2014
2015

8am
ETL and Refresh
Windows
Globalization limits ETL windows to
weekends

6am

8am

10pm

10pm

1pm
noon

8am

10pm

2011
2012...
ETL and DW Refreshes
Prod

DW & BI

Instance

Instance

Data Guard – requires full refresh if used
Active Data Guard – rea...
Fast Refreshes
• Collect only Changes
• Refresh in minutes

Prod
Instance

BI

DW

Instance

Instance

ETL
24x7
Temporal Data
Oracle 12c
80MB buffer cache ?
200GB
Cache
with

Latency

Tnxs / min

5000

300
ms

1

5

10 20 30 60 100 200

Users

1

5

10 20 30 60 100 200
Latency

Tnxs / min

8000

600
ms

1

5

10 20 30 60 100 200

Users

1

5

10 20 30 60 100 200
Five 200GB database copies are
cached with :

$1,000,000
1TB cache on SAN

$6,000
200GB shared cache on Delphix
Data Center Migration : clone migration

5x Source Data Copy

< 1x Source Data Copy
Data Center Migration : clone migration + source

S

S

5x Source Data Copy
< 2 x Source Data Copy
Data Center Migration : clone migration + source

S

C

C

C

5x Source Data Copy

C

S

V

V

V

< 1 x Source Data Copy

...
Consolidation
Without Delphix
Active

Active

With Delphix
Idle
Active

Idle
Active
DBMS License Utilization

•

Most DBMS time spent waiting on environment setup, data loads, backups,
etc.
•
Coupling of da...
Dev
v2.6

v2.6

QA
v2.6

v2.6

UAT
v2.6

v2.6

v2.6

v2.7

v2.6

v2.7

v2.7

v2.6

v2.6

v2.6

v2.8

v2.8

v2.6

v2.8
Production

Dev
v2.6

v2.6

QA
v2.6

v2.6

UAT
v2.6

v2.6

v2.6

v2.7

v2.6

v2.7

v2.7

v2.6

v2.6

v2.6

v2.8

v2.8

v2....
2.6

branching

Dev
Prod

checkout

bookmark
2.6
QA
Dev
Prod
2.6
UAT
QA
Dev
Prod
2.6
UAT
QA
Dev
Prod
Dev
QA
UAT

2.7
2.6

2.8

UAT
QA

UAT
QA

Dev

Dev

Prod
Dev
QA

UAT

2.7
2.6

2.8

UAT
QA

UAT
QA

Dev

Dev

Prod
Dev
QA

UAT

2.7
Data Control = Source Control for the Database
2.6

2.8

UAT
QA

UAT

QA

Dev

Dev

Production Time Flow
Dev
QA
UAT

2.7

Data Control = Source Control for the Database
What is Delphix
Upcoming SlideShare
Loading in …5
×

What is Delphix

3,914 views

Published on

  • Be the first to comment

What is Delphix

  1. 1. What is Delphix
  2. 2. kylehailey.com/delphix Use Cases What is Delphix Competition
  3. 3. What is Delphix
  4. 4. Three Physical Copies Three Virtual Copies Delphix
  5. 5. Install Delphix on Intel commodity hardware Intel hardware
  6. 6. Allocate Any Storage to Delphix Allocate Storage Any type Pure Storage + Delphix Better Performance for 1/10 the cost
  7. 7. One time backup of source database Production Supports Instance Instance Instance Database File system Application Stack Virtualization Upcoming
  8. 8. DxFS (Delphix) Compress Data Production Instance Instance Instance Database File system Data is compressed typically 1/3 size
  9. 9. Incremental forever change collection Production Instance Instance Instance Database Changes Time Window File system • Collected incrementally forever • Old data purged
  10. 10. Change collection works with snapshots Snapshot 0: Source Full Copy Snapshot 1: Changed blocks at time T1
  11. 11. Snapshots immediately look like full copies as they are mapped onto the previous copy Snapshot 0 Snapshot 1
  12. 12. Snapshot 0 Snapshot 1 Snapshot 2: Changed blocks at time T2
  13. 13. Snapshot 0 Snapshot 2 Snapshot 1
  14. 14. Purging old snapshot releases any blocks that have been since replaced, but keeps all unchanged blocks Snapshot 2 Snapshot 1 Drop Snapshot 0
  15. 15. Cloning : almost no storage at creation since it is all shared. Upon usage changed blocks will add to storage used Production Instance Instance Instance Instance Instance Database Database Time Window File system
  16. 16. Typical Architecture Production Dev, QA, UAT Reporting Instance Instance Instance Instance Instance Instance Instance Instance Database Database Database Database Database File system File system File system File system File system File system File system File system File system File system File system Backup Instance Instance Instance File system File system
  17. 17. With Delphix Production Instance Instance Database File system Dev & QA Instance Instance Instance Instance Instance Instance Database Database Database Reporting Backup Instance Instance Database Database
  18. 18. Delphix Use Cases 1. 2. 3. 4. 5. Fast, Fresh, Full Free Branching Federated Self Serve
  19. 19. Fast, Fresh, Full Source Development VDB Instance Instance Time Window
  20. 20. Free Instance Source Instance Instance Instance gif by Steve Karam
  21. 21. Branching Source Instance branching Dev Instance Source QA branched from Dev Instance
  22. 22. Federated Cloning
  23. 23. Federated Source1 Instance Source1 Instance Source2 Instance Instance
  24. 24. “I looked like a hero” Tony Young, CIO Informatica
  25. 25. Self Service
  26. 26. Use Cases 1. Development Acceleration 2. Quality 3. BI
  27. 27. DevOps
  28. 28. DevOps With Delphix 1. 2. 3. 4. 5. Efficient QA: Low cost, high utilization Quick QA : Fast Bug Fix Every Dev gets DB: Parallelized Dev Full DB : Less Bugs Fast Builds: Culture of Yes
  29. 29. Without Delphix 1. Inefficient QA: Long Build times Build QA Test Build Time 96% of QA time was building environment $.04/$1.00 actual testing vs. setup
  30. 30. : With Delphix 1. Efficient QA: Lower cost Build QA Test Build Time B u i l d T i m e QA Test 1% of QA time was building environment $.99/$1.00 actual testing vs. setup
  31. 31. Rapid QA via Branching
  32. 32. Without Delphix 2. QA Delays: bugs found late require more code re-work Build QA Env Sprint 3 Sprint 2 Sprint 1 X Build QA Env QA Bug Code 70 60 50 40 30 20 10 0 Cost To Correct 1 2 3 4 5 6 7 Delay in Fixing the bug Software Engineering Economics – Barry Boehm (1981) QA
  33. 33. : With Delphix 2. QA Immediate: bugs found fast and fixed Build QA Env Sprint 2 Sprint 1 X Q A Build QA Env Q A Sprint 3 Bug Code QA QA Sprint 2 Sprint 1 X Bug Code Sprint 3
  34. 34. Without Delphix 3. Full Copy Shared : Bottlenecks Old Unrepresentative Data Frustration Waiting
  35. 35. : With Delphix 3. Private Copies: Parallelize gif by Steve Karam
  36. 36. Without Delphix 4. Subsets : cause bugs
  37. 37. Without Delphix 4. Subsets : cause bugs The Production ‘Wall’ Classic problem is that queries that run fast on subsets hit the wall in production. Developers are unable to test against all data
  38. 38. : With Delphix 4. Full Size DB : Eliminate bugs
  39. 39. Without Delphix 5. Slow Environment Builds: Slow Environment Builds: 3-6 Months to Deliver Data Developer Asks for DB Get Access Manager DBA System Admin Storage Admin approves Request system Setup DB Request storage Setup machine Allocate storage (take snapshot)
  40. 40. Without Delphix 5. Slow Environment Builds: culture of no DBA Developer
  41. 41. Without Delphix Never enough environments
  42. 42. : With Delphix 5. Self Service: Fast, Efficient. Culture of Yes!
  43. 43. Quality 1. Forensics 2. Testing 3. Recovery
  44. 44. 1. Forensics: Investigate Production Bugs Development Instance Instance Time Window Anomaly on Prod Possible code bug At noon yesterday Spin up VDB of Prod as it was during anomaly
  45. 45. 2. Testing : Rewind for patch and QA testing Prod Development Instance Instance Time Window Time Window
  46. 46. 2. Testing: A/B Instance Test A with Index 1 Instance Instance Time Window • Keep tests for compare • Production vs Virtual – invisible index on Prod – Creating index on virtual • Flashback vs Virtual Test B with Index 2
  47. 47. 3. Recovery: Surgical recover of Production Source Development Instance Instance Spin VDB up Before drop Time Window Problem on Prod Dropped Table Accidently
  48. 48. 3. Recovery Surgical or Full Recovery on VDB Dev1 VDB Source Instance Instance Dev2 VDB Branched Source Time Window Dev1 VDB Time Window Instance
  49. 49. 3. Recovery: Virtual to Physical Source VDB Instance Instance Spin VDB up Before drop Time Window Corruption
  50. 50. 50 days of backup in size of Original 3. Recovery
  51. 51. Business Intelligence
  52. 52. ETL and Refresh Windows 1pm noon 10pm 8am
  53. 53. ETL and DW refreshes taking longer 1pm noon 10pm 2011 2012 2013 2014 2015 8am
  54. 54. ETL and Refresh Windows Globalization limits ETL windows to weekends 6am 8am 10pm 10pm 1pm noon 8am 10pm 2011 2012 2013 2014 2015 noon 9pm 8am
  55. 55. ETL and DW Refreshes Prod DW & BI Instance Instance Data Guard – requires full refresh if used Active Data Guard – read only, most reports don’t work
  56. 56. Fast Refreshes • Collect only Changes • Refresh in minutes Prod Instance BI DW Instance Instance ETL 24x7
  57. 57. Temporal Data
  58. 58. Oracle 12c
  59. 59. 80MB buffer cache ?
  60. 60. 200GB Cache
  61. 61. with Latency Tnxs / min 5000 300 ms 1 5 10 20 30 60 100 200 Users 1 5 10 20 30 60 100 200
  62. 62. Latency Tnxs / min 8000 600 ms 1 5 10 20 30 60 100 200 Users 1 5 10 20 30 60 100 200
  63. 63. Five 200GB database copies are cached with : $1,000,000 1TB cache on SAN $6,000 200GB shared cache on Delphix
  64. 64. Data Center Migration : clone migration 5x Source Data Copy < 1x Source Data Copy
  65. 65. Data Center Migration : clone migration + source S S 5x Source Data Copy < 2 x Source Data Copy
  66. 66. Data Center Migration : clone migration + source S C C C 5x Source Data Copy C S V V V < 1 x Source Data Copy V
  67. 67. Consolidation Without Delphix Active Active With Delphix Idle Active Idle Active
  68. 68. DBMS License Utilization • Most DBMS time spent waiting on environment setup, data loads, backups, etc. • Coupling of data and DB servers forces over-provisioning, limits utilization • Delphix can attach / detach data to server tier on-demand to drive consolidation • Potential 2X reduction in DB server footprint cuts HW and DBMS license © 2014 DELPHIX. ALL RIGHTS RESERVED. PRIVATE & CONFIDENTIAL. costs 69
  69. 69. Dev v2.6 v2.6 QA v2.6 v2.6 UAT v2.6 v2.6 v2.6 v2.7 v2.6 v2.7 v2.7 v2.6 v2.6 v2.6 v2.8 v2.8 v2.6 v2.8
  70. 70. Production Dev v2.6 v2.6 QA v2.6 v2.6 UAT v2.6 v2.6 v2.6 v2.7 v2.6 v2.7 v2.7 v2.6 v2.6 v2.6 v2.8 v2.8 v2.6 v2.8 Source Control for the database data
  71. 71. 2.6 branching Dev Prod checkout bookmark
  72. 72. 2.6 QA Dev Prod
  73. 73. 2.6 UAT QA Dev Prod
  74. 74. 2.6 UAT QA Dev Prod Dev QA UAT 2.7
  75. 75. 2.6 2.8 UAT QA UAT QA Dev Dev Prod Dev QA UAT 2.7
  76. 76. 2.6 2.8 UAT QA UAT QA Dev Dev Prod Dev QA UAT 2.7 Data Control = Source Control for the Database
  77. 77. 2.6 2.8 UAT QA UAT QA Dev Dev Production Time Flow Dev QA UAT 2.7 Data Control = Source Control for the Database

×