Scality, Cloud Storage pour Zimbra
Upcoming SlideShare
Loading in...5
×
 

Scality, Cloud Storage pour Zimbra

on

  • 2,862 views

Réduire le coût de stockage, administrer de grands volumes, repousser les limites des solutions actuelles

Réduire le coût de stockage, administrer de grands volumes, repousser les limites des solutions actuelles

Statistics

Views

Total Views
2,862
Views on SlideShare
1,854
Embed Views
1,008

Actions

Likes
1
Downloads
35
Comments
0

3 Embeds 1,008

http://www.zimbrablog.fr 971
http://www.zimbrafr.org 33
http://feeds.feedburner.com 4

Accessibility

Categories

Upload Details

Uploaded via as Microsoft PowerPoint

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

Scality, Cloud Storage pour Zimbra Scality, Cloud Storage pour Zimbra Presentation Transcript

  • Data and Storage Challenges 100s Millions of Users, 10s-100s PB of Data and Billions of files to store and serve What all these companies have in common ? Internet/Cloud business impossible to sustain and develop with traditional IT approaches Slide 2
  • Scality – Quick Facts Founded 2009 Experienced management team HQ in the San Francisco, Global reach ~ 50 Employees, 20 engineers in Paris “Aggressive use of a scale-out 24 x 7 support team architecture like that enabled by Scalitys RING architecture will become more prevalent, as US patents IT organizations develop best practices that boost storage $13M invested in Scality to-date asset use, reduce operational overhead, and meet 120% annual growth high data availability expectations.” Industry Associations Slide 3
  • Customers in US, Europe and Japan Email Service Providers Cloud Providers (s3 Compatible, FileSync, Cloud Backup…)Consumer Internet Big Data Hardware Alliances Slide 4
  • Scality RING 4 Email File Storage StaaS Digital Media Big Data Enterprise & Data Scale Out Cloud Email S3 & CDMI API Origin Server Processing File System System with Hadoop Scality RING Organic Storage 4 MD S3 P2P DATA ARC CDMI Ring End-to-End Object MESA Replication Erasure Geo Tiering Standard ManagementTopology Parallelism Storage NewSQL DB Coding Redundancy x86 Slide 5
  • Les Défis du Stockage Mail L’explosion des données et l’explosion des attentes La gestion des volumes, la croissance et la distribution La complexité Les performances La protection  Ne pas perdre les données  Garder les données disponibles Slide 6
  • La gestion des volumes  Chaque ZCS gère une liste fixe d’utilisateurs, on doit :  Distribuer la charge CPU, DBs, IOPS  Gérer les volumes  Les volumes sont limités en nombre de fichiers Slide 7
  • L’explosion du stockage Attentes clients Cout d’y répondre Slide 8
  • Les migrations  Changement de HW  Serveurs trop chargé  Changement de versions  Volumes pleins … Slide 9
  • La complexité
  • Scalitys Zimbra Architecture Zimbra 7/8 Servers SCALITYS RINGSpare Zimbra Server Legend Stateless Zimbra Node Data Standard GE Network MySQL backups
  • Les Performances La combinaison de:  volume important  Densité d’ IO  Quantité de fichiers ~ milliards La croissance ne peut pas réduire les performances Webmail et IMAP exige les réponses < 100msec en tout temps Slide 13
  • Distributed Architecture P2P Scality RING Servers (6) Storage nodes (ex: 6/node, total=36) Storage nodes projected on a ring From Servers to Storage Nodes RING Topology, P2P Architecture Limitless Scale-Out Storage based on Shared Nothing model Fully Distributed Storage (Data and Meta-data) Slide 14
  • End-to-End Parallelism APPLICATIONS / APPLICATIONS / APPLICATIONS / APPLICATIONS / APPLICATIONS / Parallel Connectors access CONNECTORS CONNECTORS CONNECTORS CONNECTORS CONNECTORS to Storage Nodes  Performance aggregation STORAGE STORAGE STORAGE STORAGE NODES NODES NODES NODES  Redundant Data Path Multiple Storage Nodes I/O DAEMONS I/O DAEMONS I/O DAEMONS I/O DAEMONS I/O DAEMONS I/O DAEMONS per server  Minimum 6 to increase parallelism SSD SATA TIERED STORAGE and data independence  Fast and easy rebuild Scality Parallelism Factor Multiple IO Daemons #Storage Nodes x #IO Daemons per Server vs  Control Physical and Boost IO Simple server node with only 1 IO Engine Independent Performance and Capacity Scalability Slide 15
  • « Exceptional performance »“ESG Lab verified exceptional performance for an object-based storagesolution, which rivals block-based solutions. Aggregate throughputscaled linearly as nodes were added to a RING. Response timesimproved as the RING grew in size, allowing for predictability whendeploying a RING.” Table 3. Content Delivery Simultaneously Sustained Object Type Objects Delivered 5 servers with Intel SSD Internet Audio (MP3) 211,424 Internet Image (JPG) 135,311 Internet Video 90,208 (MPEG) CD Audio (ISO) 18,877 Broadcast TV (HD) 2,298 Slide 16
  • La protection La perte des messages n’est pas acceptable La disponibilité de la messagerie est essentielle Souvent le cout oblige à des compromis Slide 17
  • Data Replication 11 00 No data transformation 220 20  Clear/Native data format 200 40  Very fast access  Simple projection 180 60 Class of Storage 171  Up to 5 replicas (6 copies) 160 80 91 Rack-aware 140 100 120  Guarantee of full independent object location Self-healing  Balance misplaced objects  Transparently proxy misplaced objects  Rebuild missing replicas  Permanent CRC of all contents (no silent data corruption) Slide 18
  • Scality ARC ARC Data fragments = Native Data (no transformation)  Direct and fast read access  Calculation only required when data is missing  Highly Configurable eg ARC(2,4) Scality 4 RING Check sums Data Scality inputs ARC(14,4) Data 14 Data source Output to be stored Slide 19
  • Geo Redundancy Business Continuity with “true 99.999%” availability Multi-site topology with Scality RING (up to 6 sites)  Replication or Geo Erasure Coding implementation – Synchronous Or Multi-RINGs on Multi-site (independent topology) – Asynchronous Asynchronous multiple Synchronous independent stretched RING RINGs across 2 sites Slide 20
  • 2 Million Users, 1 Billion Objects:Telenet – Email Service Provider Case StudyProblem: Outdated Infrastructure, Fast GrowingCustomer Base, Budgetary Constraints, ExponentialGrowth of Storage Projected.Solution: Scality RING Unlimited number of files: Millions of files per bucket. Up to 1B files per node. Pay as you grow model Fully integrated product includes Zimbra Connectors“Scality’s storage tiering capability allows us to uselower cost disk systems at geographically dispersedsites to provide Tier 2 storage with true redundancyand disaster recovery, without incurring the extrahardware expense and back-up overheadassociated with using NAS and SAN storagesystems.In addition, the cost risk associated with emailstorage has been significantly reduced with Scalityas we can add lower cost storage as and when weneed it, without large incremental spending chunks”Nick De Jonghe, Manager Network Strategy &Architecture, at Telenet Slide 21
  • En resuméChallenges Zimbra Solutions ScalityLexplosion du stockage coute cher Stockage distribué sur des serveursen NAS/SAN standards baisse le TCOLimitation du nombre dobjets par pas de limitation (no inode): un seulvolume nécessite de monter volume: aggregation de la capacitéplusieurs volumes indépendants qui de stockagene partagent pas leur capacitéPerformance Lajout de capacité de stockage augmente la performance (aggregation CPU & IO operations)Sauvegardes complexes sauvegardes intégrées distribuées géographiquement (géo-redondant)Ajout de capacité sans interruption système distribué – zéro interruption
  • Mercihttp://www.scality.com Slide 23