Riak CS Build Your Own Cloud Storage
Upcoming SlideShare
Loading in...5
×
 

Riak CS Build Your Own Cloud Storage

on

  • 1,890 views

Riak CS Build Your Own Cloud Storage by Pavan Venkatesh

Riak CS Build Your Own Cloud Storage by Pavan Venkatesh

Statistics

Views

Total Views
1,890
Views on SlideShare
1,890
Embed Views
0

Actions

Likes
3
Downloads
24
Comments
0

0 Embeds 0

No embeds

Accessibility

Categories

Upload Details

Uploaded via as Adobe PDF

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

    Riak CS Build Your Own Cloud Storage Riak CS Build Your Own Cloud Storage Presentation Transcript

    • Build Your Own Cloud Storage
    • About MeSolutions EngineerPavan@basho.com
    • About BashoOur Mission is to Be The Leader in Distributed Systems•  Founded January 2008•  115+ employees•  Headquartered in Cambridge, withregional offices in San Francisco,Washington DC, London and Tokyo•  Makers of Riak & Riak CS•  Thousands of Users Worldwide includingover 20% of the Fortune 50•  30,000+ downloads per month now upfrom 19,500 in Dec 2011•  Strategic Partners include Citrix, IDCFrontier, Yahoo! Japan, and Microsoft
    • Product SuiteBasho’s  distributed  systems  technologies  EnterpriseDSOpen  Source  Distributed  Database  Commercial  Distributed  Database  Distributed  Cloud  Storage  Pla7orm  • Always-­‐available,  scalable,  ops-­‐friendly  NoSQL  database  • Over  35,000  downloads  per  month  • Thousands  of  users  worldwide  • Version  1.0  unveiled  September  2011  • Adds  mulK-­‐data  center  replicaKon  &  Basho  24x7  support  • Enables  Secondary  Search  and  MapReduce  Clusters  • Requires  commercial  contract  and  secure  download  • Version  1.4  in  May  2013  • Expands  with  mulK-­‐tenancy,  large  object  support,  metering  and  Amazon  S3  API  • Enables  public  and  private  cloud  storage  • SoXware  released  to  open  source  on  March  20th  
    • Overview
    • Riak CSis...enterprise cloud storageRiakS3-compatibility multi-tenancy per user reporting builton topoflarge object storage
    • Enabling you to host your ownPUBLICPRIVATE&CLOUDSor….Reliable Storage Behind Apps
    • Riak CS Use CasesPublic CloudStorageS3 Without AWS Cloud Drive(General Content Storage)Backup-as-a-ServiceArchival andPreservationStorage forInternalClients / Depts.
    • Riak CSRiakStanchion
    • Riak CS nodefor every 
node of Riak1
    • How ItWorks
    • Riak
NodeRiak
NodeRiak
NodeRiak
NodeRiak
NodeLarge Object Riak CS
S3APIReportingAPIRiak CS
S3APIReportingAPIRiak CS
S3APIReportingAPIRiak CS
S3APIReportingAPIRiak CS
S3APIReportingAPI1. User uploads anobject1 MB2. Riak CS
breaks objectinto 1 MB chunks1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB3. Riak CS
streams chunksto Riak nodes4. Riak replicatesand stores chunks
    • Under TheHood
    • RiakRiak is a distributed NoSQL key-value store Store anything: text, images More Flexible
    • RiakRemains flexible in the long run, because of design
    • RiakHigh availability Low-latencyHorizontal scalability Fault-toleranceOps friendliness
    • RiakMasterless•  No master/slave or different roles•  All nodes are equal•  Write availability and scalability •  All nodes can accept/route requests
    • RiakNo Sharding•  Consistent hashing•  Prevents “hot spots”•  Lowers operational burden of scale•  Data rebalanced automatically
    • RiakAvailability and Fault-Tolerance •  Automatically replicates data•  Read and write data duringhardware failure and networkpartition•  Hinted handoff
    • USERSmulti-tenancy:Riak CS will trackindividual usage/statsaccess_key secret_keyusers identified by users authenticated by
    • BUCKETSusers create buckets.buckets are like folders.store objects in buckets.names are globally unique.
    • OBJECTSstored in buckets.store any file type.
    • Basic OperationsS3 API Commands s3cmd mb s3://pavan-test s3cmd ls s3://pavan-test s3cmd put README.txt s3://pavan-test s3cmd get s3://pavan-test/README.txt
    • Features
    • Riak CS Large Object Support•  Started with 5GB / object•  Now have multipart upload•  Content agnostic
    • Riak CS S3-Compatible API•  Use existing S3 libraries and tools•  RESTful operations•  Multipart upload •  S3-style ACLs for object/bucketpermissions•  S3 authentication scheme
    • Riak CS Administration and Users•  Interface for user creation,deletion, and credentials •  Configure so only admins cancreate users
    • Riak CS New Stuff in Riak 1.3•  Multipart upload: parts between5MB and 5GB •  Restrict access to buckets based onsource IP
    • Multi-Datacenter Replication•  For active backups, availabilityzones, disaster recovery, globaltraffic•  Real-time or full-sync•  24/7 support•  Per-node or storage-based pricing“[deploying Riak CS] reduces the risk of using AWS and allowscustomers to store their data in their own data centers, on theirown terms.” - Alex Williams, TechCrunch
    • Riak CS
    • Operations
    • OPERATIONAL STATSexposed via HTTP resource: /riak-cs/statsblock bucket objectGET, PUT, DELETELIST KEYS, CREATE,DELETE, GET/PUT ACLGET, PUT, DELETEHEAD, GET/PUT ACLHISTOGRAMS & COUNTERS
    • TRACK INDIVIDUAL USER’S
THE “USAGE”BUCKETACCESSSTORAGE
    • QUERY USAGE STATSStorage and access statistics trackedon per-user basis, as rollups for slicesof time•  Operations, Count, BytesIn,BytesOut, + system and user error•  Objects, Bytes
    • Partnerships
    • Citrix CloudStack•  Combined platform for computeand storage •  Summer ‘13: integratedauthentication support•  Videos on our blog
    • Roadmap
    • •  Open stack integration•  API•  Keystone authentication•  Expand S3 API support•  Object versioning support•  Cloudstack integration work
    • Q&Ahttp://docs.basho.com/riakcs/latest/ http://docs.basho.com/riakcs/latest/riakcs-tutorials/fast-track/ riak-users riak-users@lists.basho.com