Slides from Vinod Jayaraman's talk "State of the Persistence Art: Present Best Practices and Future Goals for Container Storage in Production" at ContainerDays NYC 2016: http://dynamicinfradays.org/events/2016-nyc/programme.html#storage

1. 1© 2016 PORTWORX | CONTAINERDAYS2016
State of the Art: Data Services
for Persistent Containerized Apps
VINOD JAYARAMAN, CO-FOUNDER AND CHIEF ARCHITECT

2. 2© 2016 PORTWORX | CONTAINERDAYS2016
Agenda
§ Challenges
§ Best practices
§ Introducing Portworx
§ Demo
§ Use cases
§ Leading vendors
§ Q&A

3. 3© 2016 PORTWORX | CONTAINERDAYS2016
Container Infrastructure: IT at Container Speed
X86 Commodity Servers
Monitoring
Orchestration/Scheduling
Minimal OS
Container Data Services
Container Infrastructure
Fixed Infrastructure
Security
Orchestration/Scheduling
Containers
HP
EMC
NetApp
IBM
Cisco
VMware
Dell
Oracle
RedHat
Microsoft

4. 4© 2016 PORTWORX | CONTAINERDAYS2016
Problem for Enterprise IT with Container Deployments
Elastic Search Wordpress
Redis
Docker made apps portable and
enabled choice …
1. Compute spans servers, but data still silo’d
2. Data not effectively protected from failure
3. Ops + data are not portable
Developer IT Ops and DevOps
…but existing storage, connectors don’t work
for these containerized apps in production.

5. 5© 2016 PORTWORX | CONTAINERDAYS2016
Traditional Storage Provisioning to Containers
SSD
HDD
volumenginx
Storage
Connector
python mysql
SAN
html5 rest sql
Containerized DevOps hits a wall in production Out-of-band infrastructure provisioning
DEVOPS IT

6. 6© 2016 PORTWORX | CONTAINERDAYS2016
Challenges with SANs
LUN
Redis
No effective way to:
1. Snapshot + back up
2. Encrypt + ACL
3. Prioritize IO for users
4. Support high availability
... at the container level

7. 7© 2016 PORTWORX | CONTAINERDAYS2016
Challenges with Physical Drives
Redis
SSD
HDD
No effective way to:
1. Expand storage capacity
2. Prioritize SSD/HDD for users
3. Perform maintenance (e.g. patch OS)
... at the container level
+
§ Snapshot+ backup
§ Encrypt and ACL
§ Support high availability

8. 8© 2016 PORTWORX | CONTAINERDAYS2016
Challenges with VMs and Clouds
Redis
Public Cloud
Unnecessary VM overhead
+
No effective way to:
1. Snapshot + back up
2. Encrypt + ACL
3. Prioritize IO for users
4. Support high availability
... at the container level

9. 9© 2016 PORTWORX | CONTAINERDAYS2016
Persistence
IOPs
Connectors
SSD
HDD
SAN
EBS
S3
Apps Don’t Want Volumes
1. Makes a science out of data protection
2. Churns IT playbook for every cloud
3. Does not modernize… why containerize?

10. 10© 2016 PORTWORX | CONTAINERDAYS2016
SSD
HDD
nginx python mysql
SAN
html5 rest sql
Multi Cloud Data services
- Persistence
- Provisioning
- Security
- DR
Container Data
Services
StreamlinedDevOps Infrastructurethroughcontainer-granular self-provisioning
Apps Want Data Services
DEVOPS IT

11. 11© 2016 PORTWORX | CONTAINERDAYS2016
Data Services for Containers
WordPress WordPress
PX
MySQL
MySQL
persistence
encryption
CoS
namespace
Auth/ACLs
HA Operational Experience
Delivered as a lightweight
container with support for
volumes and graph. Runs on any
server, any cloud.
Converged Performance
Data collocated with container
compute
Container Granular Controls
Encryption, CoS, replication,
snapshots are done at container
granularity
Hybrid Cloud Ops
Cloud-agnostic deployment and
data accessibility across multiple
clouds

12. 12© 2016 PORTWORX | CONTAINERDAYS2016
Data Protection Data Access Performance Secure Volumes
App
Services
§ Replication, including regional
§ Snapshot read/writeable
§ File, block, object
§ Unified namespace
§ Auto expand capacity
§ Prioritize IOPs per container
§ Read parallelization
§ ACL volumes
§ Encryption inflight, at
rest
Data Protection Data Access Performance Secure Volumes
Infrastructure
Services
§ Protect from drive degradation
§ Async backup to S3
§ Global GUI control
§ Capacity plan
§ Edit existing capacity
§ IOPS tiering over SSD /
HDD
§ Monitoring integration
§ Audit access
§ BYOK encryption
Introducing Portworx Container Data Services
PORTWORX STORAGE CLUSTER
WordPress
Any
Containerized
App
Any
Cloud
Any
SAN
Any SSDAny HDDAny Server
Jenkins

13. 13© 2016 PORTWORX | CONFIDENTIAL: DO NOT DISTRIBUTE
Step 1: Install
SERVER SERVER EC2 NODESERVER/SAN SERVER/SAN EC2 NODE/SAN

14. 14© 2016 PORTWORX | CONFIDENTIAL: DO NOT DISTRIBUTE
Step 2: Fingerprint
SERVER/SAN SERVER/SAN EC2 NODE/SAN
8 SSD, 4 SATA 2 SSD, 10 SATA EBS
EXISTING
STORAGE

15. 15© 2016 PORTWORX | CONFIDENTIAL: DO NOT DISTRIBUTE
PORTWORX STORAGE CLUSTER
Step 3: Aggregate & Tier
FAST
MEDIUM
SLOW
PORTWORX STORAGE CLUSTER

16. 16© 2016 PORTWORX | CONFIDENTIAL: DO NOT DISTRIBUTE
+
+
+
Step 4: Elastic Storage
SERVER/SAN
5 SSD, 7 SATA
FAST
MEDIUM
SLOW
PORTWORX STORAGE CLUSTER

17. 17© 2016 PORTWORX | CONFIDENTIAL: DO NOT DISTRIBUTE
PORTWORX STORAGE CLUSTERVOL
MySQL
Step 5: Container Granular Storage

18. 18© 2016 PORTWORX | CONFIDENTIAL: DO NOT DISTRIBUTE
Step 6: High Availability
MySQL Data MySQL Data MySQL Data
VOL
MySQL
SERVER FAILURE
WordPress
VOL
WordPress
NFS

19. 19© 2016 PORTWORX | CONFIDENTIAL: DO NOT DISTRIBUTE
Step 7: Snapshot
MySQL Data MySQL Data MySQL Data
VOL
MySQL
SNAP
MySQL
VOL

20. 20© 2016 PORTWORX | CONTAINERDAYS2016
Portworx is infrastructure
automation at the data layer…
…so IT can offer the data
services that containers need.
SSD
HDD
SAN
EBS
S3
VOL VOLVOL VOL

21. 21© 2016 PORTWORX | CONTAINERDAYS2016
Demo

22. 22© 2016 PORTWORX | CONTAINERDAYS2016
On-Prem Case Study
HDD
HDD
HDD
HDD
HDD
HDD
HDD
HDD
HDD
HDD
HDD
HDD
HDD
HDD
HDD
HDD
STORAGE-HEAVY SERVER
SSDSSD
COMPUTE-HEAVY SERVERS
PORTWORX STORAGE CLUSTER
FAST
MEDIUM
SLOW
x 24 x 10 pools capacity,
automates infra,
same experience.

23. 23© 2016 PORTWORX | CONTAINERDAYS2016
Portworx enables genomics institute to enter the container age.
+ Redistribute
Archive
On-Prem Case Study
FIXED INFRASTRUCTURE
Batch process
IRF
SAN
Sequencing
Pipeline:
IRF à BAM,
VCF
(3,000 cores)
Disks
Filer
Redistribute
+ Archive
PORTWORX
Fast
Slow
Medium
Sequencing
Pipeline
Batch
Disks SAN
PORTWORX

24. 24© 2016 PORTWORX | CONTAINERDAYS2016
Container Infrastructure Landscape
ContainerLegacy/VM
Control Data
• Any hardware, OS, cloud
• All schedulers
• Data + services

25. 25© 2016 PORTWORX | CONTAINERDAYS2016
Portworx: Storage and Container Expertise
Murli Thirumale Co-founder and CEO
Storage Executive, Dell
Co-founder and CEO, Ocarina
Group VP and GM, Citrix
Co-founder and CEO, Net6
GM, HP
Gou Rao, Co-founder and CTO
CTO/Executive, Dell
Co-founder and CTO, Ocarina
CTO, Citrix
Co-Founder and CTO, Net6
Vinod Jayaraman, Co-founder and Architect
Senior Principal Engineer/Architect, Dell
Principal Engineer, Ocarina Networks
Principal Software Engineer, F5 Networks
Software Engineer, NTT MCL
Leadership Team:24 Employees:
Startup veterans from Google, Ocarina,
Microsoft, Nimble Storage,
Pure Storage, NetApp, StorSimple
Los Altos, CA
Lead Investor:

26. 26© 2016 PORTWORX | CONTAINERDAYS2016
Q&A

27. 27© 2016 PORTWORX | CONTAINERDAYS2016
Learn More About Portworx
§ portworx.com for white papers,
analyst reports, videos
§ Portworx/Rancher webinar on
Wednesday, November 15
§ PX-Developer on GitHub
Sign up for more
information and a
chance to win an
Apple Watch!