0
Build Your Own Cloud Storage
About MeSolutions EngineerPavan@basho.com
About BashoOur Mission is to Be The Leader in Distributed Systems•  Founded January 2008•  115+ employees•  Headquartered ...
Product SuiteBasho’s	  distributed	  systems	  technologies	  EnterpriseDSOpen	  Source	  Distributed	  Database	  Commerc...
Overview
Riak CSis...enterprise cloud storageRiakS3-compatibility	multi-tenancy	per user reporting	builton topoflarge object storage
Enabling you to host your ownPUBLICPRIVATE&CLOUDSor….Reliable Storage Behind Apps
Riak CS Use CasesPublic CloudStorageS3 Without AWS Cloud Drive(General Content Storage)Backup-as-a-ServiceArchival andPres...
Riak CSRiakStanchion
Riak CS nodefor every 
node of Riak1
How ItWorks
Riak
NodeRiak
NodeRiak
NodeRiak
NodeRiak
NodeLarge Object	Riak CS
S3APIReportingAPIRiak CS
S3APIReportingAPIRiak CS
S3APIR...
Under TheHood
RiakRiak is a distributed NoSQL key-value store 	Store anything: text, images	More Flexible
RiakRemains flexible in the long run, because of design
RiakHigh availability Low-latencyHorizontal scalability Fault-toleranceOps friendliness
RiakMasterless•  No master/slave or different roles•  All nodes are equal•  Write availability and scalability •  All node...
RiakNo Sharding•  Consistent hashing•  Prevents “hot spots”•  Lowers operational burden of scale•  Data rebalanced automat...
RiakAvailability and Fault-Tolerance •  Automatically replicates data•  Read and write data duringhardware failure and net...
USERSmulti-tenancy:Riak CS will trackindividual usage/statsaccess_key secret_keyusers identified by users authenticated by
BUCKETSusers create buckets.buckets are like folders.store objects in buckets.names are globally unique.
OBJECTSstored in buckets.store any file type.
Basic OperationsS3 API Commands	s3cmd mb s3://pavan-test		s3cmd ls s3://pavan-test		s3cmd put README.txt		s3://pavan-test ...
Features
Riak CS Large Object Support•  Started with 5GB / object•  Now have multipart upload•  Content agnostic
Riak CS S3-Compatible API•  Use existing S3 libraries and tools•  RESTful operations•  Multipart upload •  S3-style ACLs f...
Riak CS Administration and Users•  Interface for user creation,deletion, and credentials •  Configure so only admins cancre...
Riak CS New Stuff in Riak 1.3•  Multipart upload: parts between5MB and 5GB •  Restrict access to buckets based onsource IP
Multi-Datacenter Replication•  For active backups, availabilityzones, disaster recovery, globaltraffic•  Real-time or full...
Riak CS
Operations
OPERATIONAL STATSexposed via HTTP resource: /riak-cs/statsblock bucket objectGET, PUT, DELETELIST KEYS, CREATE,DELETE, GET...
TRACK INDIVIDUAL USER’S
THE “USAGE”BUCKETACCESSSTORAGE
QUERY USAGE STATSStorage and access statistics trackedon per-user basis, as rollups for slicesof time•  Operations, Count,...
Partnerships
Citrix CloudStack•  Combined platform for computeand storage •  Summer ‘13: integratedauthentication support•  Videos on o...
Roadmap
•  Open stack integration•  API•  Keystone authentication•  Expand S3 API support•  Object versioning support•  Cloudstack...
QAhttp://docs.basho.com/riakcs/latest/		http://docs.basho.com/riakcs/latest/riakcs-tutorials/fast-track/		riak-users riak-...
Upcoming SlideShare
Loading in...5
×

Riak CS Build Your Own Cloud Storage

2,142

Published on

Riak CS Build Your Own Cloud Storage by Pavan Venkatesh

Published in: Technology, Business
0 Comments
5 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total Views
2,142
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
59
Comments
0
Likes
5
Embeds 0
No embeds

No notes for slide

Transcript of "Riak CS Build Your Own Cloud Storage"

  1. 1. Build Your Own Cloud Storage
  2. 2. About MeSolutions EngineerPavan@basho.com
  3. 3. About BashoOur Mission is to Be The Leader in Distributed Systems•  Founded January 2008•  115+ employees•  Headquartered in Cambridge, withregional offices in San Francisco,Washington DC, London and Tokyo•  Makers of Riak & Riak CS•  Thousands of Users Worldwide includingover 20% of the Fortune 50•  30,000+ downloads per month now upfrom 19,500 in Dec 2011•  Strategic Partners include Citrix, IDCFrontier, Yahoo! Japan, and Microsoft
  4. 4. Product SuiteBasho’s  distributed  systems  technologies  EnterpriseDSOpen  Source  Distributed  Database  Commercial  Distributed  Database  Distributed  Cloud  Storage  Pla7orm  • Always-­‐available,  scalable,  ops-­‐friendly  NoSQL  database  • Over  35,000  downloads  per  month  • Thousands  of  users  worldwide  • Version  1.0  unveiled  September  2011  • Adds  mulK-­‐data  center  replicaKon  &  Basho  24x7  support  • Enables  Secondary  Search  and  MapReduce  Clusters  • Requires  commercial  contract  and  secure  download  • Version  1.4  in  May  2013  • Expands  with  mulK-­‐tenancy,  large  object  support,  metering  and  Amazon  S3  API  • Enables  public  and  private  cloud  storage  • SoXware  released  to  open  source  on  March  20th  
  5. 5. Overview
  6. 6. Riak CSis...enterprise cloud storageRiakS3-compatibility multi-tenancy per user reporting builton topoflarge object storage
  7. 7. Enabling you to host your ownPUBLICPRIVATE&CLOUDSor….Reliable Storage Behind Apps
  8. 8. Riak CS Use CasesPublic CloudStorageS3 Without AWS Cloud Drive(General Content Storage)Backup-as-a-ServiceArchival andPreservationStorage forInternalClients / Depts.
  9. 9. Riak CSRiakStanchion
  10. 10. Riak CS nodefor every 
node of Riak1
  11. 11. How ItWorks
  12. 12. Riak
NodeRiak
NodeRiak
NodeRiak
NodeRiak
NodeLarge Object Riak CS
S3APIReportingAPIRiak CS
S3APIReportingAPIRiak CS
S3APIReportingAPIRiak CS
S3APIReportingAPIRiak CS
S3APIReportingAPI1. User uploads anobject1 MB2. Riak CS
breaks objectinto 1 MB chunks1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB 1 MB3. Riak CS
streams chunksto Riak nodes4. Riak replicatesand stores chunks
  13. 13. Under TheHood
  14. 14. RiakRiak is a distributed NoSQL key-value store Store anything: text, images More Flexible
  15. 15. RiakRemains flexible in the long run, because of design
  16. 16. RiakHigh availability Low-latencyHorizontal scalability Fault-toleranceOps friendliness
  17. 17. RiakMasterless•  No master/slave or different roles•  All nodes are equal•  Write availability and scalability •  All nodes can accept/route requests
  18. 18. RiakNo Sharding•  Consistent hashing•  Prevents “hot spots”•  Lowers operational burden of scale•  Data rebalanced automatically
  19. 19. RiakAvailability and Fault-Tolerance •  Automatically replicates data•  Read and write data duringhardware failure and networkpartition•  Hinted handoff
  20. 20. USERSmulti-tenancy:Riak CS will trackindividual usage/statsaccess_key secret_keyusers identified by users authenticated by
  21. 21. BUCKETSusers create buckets.buckets are like folders.store objects in buckets.names are globally unique.
  22. 22. OBJECTSstored in buckets.store any file type.
  23. 23. Basic OperationsS3 API Commands s3cmd mb s3://pavan-test s3cmd ls s3://pavan-test s3cmd put README.txt s3://pavan-test s3cmd get s3://pavan-test/README.txt
  24. 24. Features
  25. 25. Riak CS Large Object Support•  Started with 5GB / object•  Now have multipart upload•  Content agnostic
  26. 26. Riak CS S3-Compatible API•  Use existing S3 libraries and tools•  RESTful operations•  Multipart upload •  S3-style ACLs for object/bucketpermissions•  S3 authentication scheme
  27. 27. Riak CS Administration and Users•  Interface for user creation,deletion, and credentials •  Configure so only admins cancreate users
  28. 28. Riak CS New Stuff in Riak 1.3•  Multipart upload: parts between5MB and 5GB •  Restrict access to buckets based onsource IP
  29. 29. Multi-Datacenter Replication•  For active backups, availabilityzones, disaster recovery, globaltraffic•  Real-time or full-sync•  24/7 support•  Per-node or storage-based pricing“[deploying Riak CS] reduces the risk of using AWS and allowscustomers to store their data in their own data centers, on theirown terms.” - Alex Williams, TechCrunch
  30. 30. Riak CS
  31. 31. Operations
  32. 32. OPERATIONAL STATSexposed via HTTP resource: /riak-cs/statsblock bucket objectGET, PUT, DELETELIST KEYS, CREATE,DELETE, GET/PUT ACLGET, PUT, DELETEHEAD, GET/PUT ACLHISTOGRAMS COUNTERS
  33. 33. TRACK INDIVIDUAL USER’S
THE “USAGE”BUCKETACCESSSTORAGE
  34. 34. QUERY USAGE STATSStorage and access statistics trackedon per-user basis, as rollups for slicesof time•  Operations, Count, BytesIn,BytesOut, + system and user error•  Objects, Bytes
  35. 35. Partnerships
  36. 36. Citrix CloudStack•  Combined platform for computeand storage •  Summer ‘13: integratedauthentication support•  Videos on our blog
  37. 37. Roadmap
  38. 38. •  Open stack integration•  API•  Keystone authentication•  Expand S3 API support•  Object versioning support•  Cloudstack integration work
  39. 39. QAhttp://docs.basho.com/riakcs/latest/ http://docs.basho.com/riakcs/latest/riakcs-tutorials/fast-track/ riak-users riak-users@lists.basho.com
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×