Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

IT Press Tour #17 - OpenIO & Technology

799 views

Published on

Talk we gave during IT Press Tour #17, describing the vision, company profile and technology of OpenIO.
See: http://www.theregister.co.uk/2015/12/02/openio_object_storage_upstart/

Published in: Technology
  • Be the first to comment

IT Press Tour #17 - OpenIO & Technology

  1. 1. 88% (2015) Unstructured data
 worldwide ratio Each year Facts: ESG Digital Archive Market Forecast IDGSource: +62%
  2. 2. Scalability + PerformanceChallenge:
  3. 3. Object storageSolution: ?
  4. 4. Object storage ?
  5. 5. Object storage ?
  6. 6. Object storage !
  7. 7. Object storage Advantages But not optimized for Scalability 100s PBs, low TCO Ease of access Simple API GET/PUT/DELETE Resiliency Replication, erasure coding,
 geodistribution Heavily updated data
 No POSIX-like API • VMs • SQL DBs
  8. 8. 10+ yearsMarket: 1.2 B$ today 
 4.6 B$ > 2020 Maturity Fast growing IDCSource:
  9. 9. Gartner, Critical Capabilities for Object Storage Scalability Efficiency Interoperability Ease of management Performance Resiliency Security
  10. 10. Very high capacity Optimized TCO* Unstructured data Price per GB low Rather low capacity 
 Very high performance
 VMs, SQL DBs Price per GB high Object store Flash Arrays Vision: 88% 12% No future 
 for traditional vendors? *Total Cost of Ownership
  11. 11. Performance Tightly integrated 
 application connectors Quality of Service <Vision: Very high capacity Optimized TCO Unstructured data Price per GB low 88% Object store
  12. 12. Object storage is not only storage. It is a new way to build backend services for applications. As Docker has disrupted sysadmin, we want to disrupt storage management.
  13. 13. WHO
  14. 14. AntiSpam - AntiPhishing - 
 eMail classification 235M MailBoxes in 76 countries IaaS - PaaS - DaaS
 Network & Security for legacy, SaaS and Web Apps Lille San Francisco Montréal Hong-Kong Tokyo Innovative technologies
 for IT infrastructure 100 people
  15. 15. 7 8 50 fellow co-founders years experience million end users 16 people 2015 launch 
 (June)
  16. 16. 2006 Idea & 
 1st concept 2007 Design
 dev starts 2009 1st massive
 production
 above 1PB
  17. 17. 2006 Idea & 
 1st concept 2007 Design
 dev starts 2009 1st massive
 production above 1PB 2015 OpenIO
 fork 2012 Open
 sourced 2014 10+ PB
 managed
  18. 18. Lille @OpenIO OpenIO github.com/open-io San Francisco FRANCE USA Tokyo JAPAN
  19. 19. Member of Partners Customers
  20. 20. WE LOVE 
 OPEN SOURCE
  21. 21. • AGPL V3 for core services • LGPL V3 for libraries and
 client APIs LICENSES github.com/open-io
  22. 22. WHAT
  23. 23. Grid 
 for apps ConscienceDirectory with indirections 1. 2. 4. Grid 
 of nodes 3. Unique 
 design
  24. 24. … … … Namespace Account Container Object Multi tenancy Flat structure Track containers, not objects Directory with indirections1. UNIQUE DESIGN containers objects
  25. 25. Distributed Hash Tables Consistent Hashing Single name node • Good for trillion of objects • Bad because of rebalancing data when scaling • Good for few large files • Bad for numerous small objects Directory with indirections1. • Good for trillion of objects • Good, no need to rebalance data when scaling Indirection table Existing technologies OpenIO UNIQUE DESIGN
  26. 26. Grid of nodes2. UNIQUE DESIGN • Share nothing architecture • Scale-out design with no contention • New nodes are auto discovered • No gateway in native object mode • No SPOF, resilient to node failures
  27. 27. 1. Collects metrics from the services of each node 2. Computes a score for each service 3. Distributes scores to every nodes and clients 4. On the fly best match making for each request Conscience3. UNIQUE DESIGN Realtime load balancing 
 for optimal data placement The score is computed with a configurable formula 
 usually based on: capacity, io performance, CPU
  28. 28. Storage CPU/RAM
 usage Over the years > Don’t waste servers Use their free CPU & RAM! Grid for Apps4. UNIQUE DESIGN
  29. 29. Scality Ceph OpenIO LICENSE Proprietary Open Source Open Source ARCHITECTURE RING Crush maps 3-level distributed directory CONTAINERS External DB RADOS GW only Native with strong consistency SCALING rebalance rebalance No rebalance,
 immediate availability LOAD BALANCING Static, consistent hashing based Static, consistent hashing based Real time, automatic Competitors
  30. 30. Hardware
 agnostic 0TB
 > 1000+PB 1. 2. Never 
 Rebalance 3. Different
  31. 31. • Simple to use • Low-latency and linear performance • Never rebalance when scaling • Immediate benefits in terms of capacity & performance • Flexible increments “True scalability” 0TB > 1000+PB1. DIFFERENT
  32. 32. Consistent hashing Each node owns a part 
 of the key space New nodes get parts of the key 
 space from the older ones Never rebalance2. DIFFERENT Recalculate key space Scaling
  33. 33. OpenIO New nodes automatically 
 discovered and immediately available Scaling Immediate benefits 
 in terms of performance 
 from the new nodes Never rebalance2. DIFFERENT
  34. 34. • Work with heterogeneous hardware • No vendor lockin Hardware agnostic3. DIFFERENT • Hardware is used according to
 its capacity and performance • Scores are also based on I/O figures and CPU, not only capacity Conscience
  35. 35. Interoperability 1. 2. 3. ConnectorsOpen Source Native APIs
  36. 36. >_ Amazon S3® OpenStack 
 Swift® Optimized 
 native APIs • Python • Go • C • Java Command line interface Native APIs2. INTEROPERABILITY
  37. 37. Storage Email Video Connectors3. INTEROPERABILITY • File System (NFS) • OpenStack SWIFT • Amazon S3 • Cyrus 3.0 • Zimbra • Mail Object • Dovecot • HTTP connector • Adaptive streaming connector • Event based transcoding
  38. 38. Hardware agnostic, True scalability 0 > 1000+PBs Storage-tier, Conscience auto-optimization, Grid for Apps Open Source, S3 and SWIFT APIs, Specific App connectors Human free management, Simple to deploy Low-latency design, Specific App connectors Grid of nodes, Replication, Erasure Coding, Geodistribution Multitenancy, silent corruption checks, WORM for compliance and encryption Scalability Efficiency Interoperability Ease of management Performance Resiliency Security Gartner, Critical Capabilities for Object Storage
  39. 39. HOW
  40. 40. Time > PB> Deployed Used ISP 40+ M mailboxes Real life use case REFERENCES
  41. 41. OIO Core Standard Support 24/7 Premium Support 24/7 Professional
 Services Mail
 Connectors Video
 Connectors File
 Connectors WebUI Open SourceSubscriptionService
  42. 42. New release scheme & new release 15.12 • One release for our projects • Fuse & NFS file connector • First LTS (long term support) release • Multiple OpenIO core optimizations • New python-based CLI #1
  43. 43. File connector (Fuse & NFS) • To ease adoption by the market • Ability to « mount » an account as a filesystem • Targets performance - close to our core solution • Files will also appear as read-only objects under the traditional object APIs #2
  44. 44. Philippe Nicolas #3 As advisor 
 Welcome aboard! :-)
  45. 45. OpenIO to quickly become a major player
  46. 46. info@openio.io

×