Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

IT Press Tour #19 Slides OpenIO June 2016


Published on

Slides from the OpenIO session at IT Press Tour #19
1- What is OpenIO
2- OpenIO WebUI
3- OpenIO Storage Tiering
4- Kinetic Drives
5- Hybrid Cloud with Backblaze B2

Published in: Technology
  • Be the first to comment

IT Press Tour #19 Slides OpenIO June 2016

  1. 1. Application-aware
  2. 2. @LaurentDenel Co founder & CEO
 at OpenIO @GuilDelaporte 
 Co founder & Product Manager
 at OpenIO
  3. 3. Agenda 2. OpenIO
 WebUI Storage 
 Tiering 3.1. What is OpenIO 4. Kinetic Drives 5. Hybrid Cloud 
 with Backblaze B2
  4. 4. 1. What is
  5. 5. 2006 Idea & 
 1st concept 2007 Design
 dev starts 2009 1st massive
 production above 1PB 2012 Open
 sourced 2014 10+ PB
 managed in a
 single cluster About OpenIO
 fork 2015 20 60employees millions end-users San Francisco | Lille (FR) | Tokyo | Montreal
  6. 6. Use cases > Email Platforms > Video Streaming > Object and file storage • Storage-as-a-Service • Compute + Storage Platform • On-prem Data
  7. 7. > High frequency modifications most 88 % and growing fast iops capacity > Low frequency modifications & immutable data Storage market evolution (80/20 rule) IOPS Realm Hyper-Scale Capacity Realm
  8. 8. x86 servers Software-Defined 
 Storage Hyper Scalable
 Storage and Compute Platform The OpenIO Solution + = OpenIO transforms a rack of x86 servers 
 into a large storage and compute pool
  9. 9. OpenIO Democratizes Large Data Platforms Internet giants 
 have initiated the wave 
 and proved the technology OpenIO offers 
 the same model 
 “on-premise “ > Simple > Elastic > Flexible > Cost effective > On-demand
  10. 10. OpenIO Approach Object Storage Scale and store 1000+ PBs of data, Billions of objects Open Source software
 Commodity hardware Reduce 
 cost and TCO Application-aware Grid for Apps Run applications on the storage infrastructure 1. 2. 3.
  11. 11. HOW
  12. 12. … … … Multi tenancy Flat structure Track containers, not objects Directory with indirections Containers Objects grid://namespace/account/container/object > Namespace Account Container Object
  13. 13. New nodes are automatically 
 discovered and immediately available Scaling No consistent hashing algorithm > no recalculation of the key space Grid of nodes with no consistent hashing Never rebalance>
  14. 14. 1. Collects metrics from the services of each node 2. Computes a score for each service 3. Distributes scores to every node and client 4. On the fly best match making for each request The score is computed with a configurable formula usually based on: 
 capacity, io performance, CPU Conscience Realtime load balancing 
 for optimal data placement >
  15. 15. Grid for Apps Data usage at the heart of the datacenter> A data processing framework integrated inside OpenIO’s Grid Scale-out application back-ends can be built on the storage platform itself Avoid wasted resources and simplify load balancing for 
 storage and processing
  16. 16. APIs and Specific App Connectors Data at the heart of the datacenter> Gateway layer Optimized 
 native APIs • C • Python • Java • Go Command line interface Specific 
 App Connectors • Enterprise Storage • Email • Video streaming RESTAPIs • Amazon S3 • Openstack Swift
  17. 17. What makes us unique? 3.2.1. Ease of use Easy to test, deploy in production, manage and use 0 TB > 1000+ PB Start small and grow with your needs (from one engine for small config to very large ones) Grid for Apps Unifying Compute and Storage on a single platform
  18. 18. 1. Grid for Apps Ingest Search Store Full Text Index Video workflow 
 for user generated contents Ingest Stream Store Transcode Store Spam sample 
 long-term archiving and search Scale-out real life use cases
  19. 19. 2. From 0TB to 1000+PB Start small! No compromise 
 on 3 object storage characteristics Fast > Simple and standard APIs > Data protection with replication or erasure coding on multiple nodes > Scale-out capabilities to hyper- scale > A 3 nodes cluster can be deployed in 5 minutes and be production ready
  20. 20. 3. Ease of use Full Operational Control CLI 
 available Ubiquitous Management 
 via Web GUI
  21. 21. 2. 
 Web UI
  22. 22. What you can do in 5’ Drink 
 an espresso Stretch 
 your body Deploy 
 an OpenIO cluster
  23. 23. 3.
 Storage Tiering
  24. 24. OpenIO tiering is obvious 1. Built-in feature Across storage devices managed by OIO or connected to an external pool 2. Multicriteria settings 
 Name, date, size, patterns, type, container name, etc. 3. Transparent At upload, or with background jobs
  25. 25. OIO chunk Layer OIO 
 directory Client side applications OpenIO standard architecture R R R R R R R R
  26. 26. Storage 
 Array x86 
 Servers Ethernet
 drives 1995 - 2005 2006 - 2016 2017 - … Large capacity storage evolution - drive presentation cost cutting
  27. 27. 4. Kinetic Drives
  28. 28. OpenIO & Kinetic Thanks Seagate for the Ember system! Kinetic
 Open Source
 Project Member Participation to the Plugfest in Raleigh
 April ‘16 Working proof of concept in our lab Ready to get certified during the next oio-kinetic
  29. 29. OpenIO standard architecture OIO chunk Layer OIO 
 directory Client side applications R R R R R R R R
  30. 30. OpenIO Kinetic architecture
 NO CHANGE! OIO Kinetic Layer K K K K K K K K OIO 
 directory Client side applications
  31. 31. 5. Hybrid Cloud OpenIO with Backblaze
  32. 32. June 2016 Gleb Budman, CEO WHEN WHO
  33. 33. $5/Month = 30GB
  34. 34. “Backblaze Undercuts All Cloud Storage Competitors”
  35. 35. Key Metrics 30.000 developers 
 & IT people signed up 200+ PB stored Profitable Hundreds 
 of PB in the 
 B2 pipeline
  36. 36. IT struggling with archiving data explosion 1. Explosion of Data Volume 2. Complexity 3. Infrastructure cost
  37. 37. Current solution: Silos Hot data 
 stored on disk Cold data 
 stored on LTO Archiving software Move cold data to cold storage
  38. 38. But the current solution has lots of problems Backblaze B2 & OpenIO take up the challenge Data is siloed LTO has very slow performance High cost of having multiple solutions 1. 2. 3.
  39. 39. A hybrid cloud storage solution to rule them all OpenIO single namespace & tiering Backblaze B2
 public cloud 
 No more "cold" storage Backblaze B2 
 offered through 
 OpenIO solution Data is siloed LTO has very slow performance High cost of having multiple solutions 1. 2. 3.
  40. 40. 1. OpenIO single namespace & tiering OIO chunk Layer OIO 
 directory Client side applications R R R R R Blackblaze B2 objects Hybrid
 Cloud GW
  41. 41. 2. Backblaze B2 public cloud / No more "cold" storage 2. High performance Unlimited storage 3.1. Data is instantly available 4. Pay only for what you use
  42. 42. 3. Backblaze B2 offered through OpenIO solution OpenIO (on premise) Backblaze B2 (cloud) hybrid Push your datacenter’s walls!
  43. 43. 2. Fast Performance 3. 99.999999% durability Backblaze B2 Fully integrated in OpenIO 1. Cost Effective Only $.005/GB/month No Capex Pay for what you use All data are stored on in- production. Always online disks. Parallelization achieves fast throughput. All data checked ever 30 days for degradation and rebuilt when necessary.
  44. 44. 3 years TCO for 1PB Legacy OpenIO +
 Backblaze B2 Storage array 3 years hosting Tape gear Backup software Human admin OIO subscription x86 servers 3 years hosting Human admin B2 (>40% archived in Backblaze B2)
  45. 45. do you still want 
 to live in the ’80s?
  46. 46. Ease of Use 3. 5 minutes deployment Kinetic Drives 4. Ready for the next storage hardware 2. Tiering Built-in, multi criteria and transparent Grid for Apps 1. scale-out backend for applications Wrapping up Backblaze B2 5. Unique hybrid cloud storage approach
  47. 47. Application-Aware