Cybozu Labs, Inc.
  Kazuho Oku
 Oracle (RAC)                      

    force.com (Salesforce)
    GAE DataStore
    Kumofs, hBase, etc.

           ...
PHP RDBMS                  

        RDBMS
    OSS RDBMS                                           ?
         MySQL Clu...
MySQL (InnoDB)                  

    SELECT
                   max. 40k QPS
               memcached   1/5

    
    ...
 ACID
    
         
    
         
               
         
               

                  
Nov 30 2009    ...
(SNS           )

    
    
         
    
          :
              (JOIN          )
    
                       ...
Incline & Pacific                

    
         
         
         (eventual) consistency
    
         SPOF      ...
Incline –              

                 RDB Sharding
                  shard
                                    




...
Incline –     

                      DDL

         
         DDL
                            shard

    ACID
    

...
Incline –                    (1)

                           JOIN

               uid:1-2000
              uid:2001-4000
...
Incline –                     (2)

                                                                    

               u...
Pacific –              

    
                         RDBMS

    
         
         
                  < 10

    ...
Incline & Pacific       

    Incline
         
         MySQL PostgreSQL
         Windows
    Pacific
         
   ...
 
         Incline Pacific
         DBIx::ShardManager
                              




Nov 30 2009                 ...
Upcoming SlideShare
Loading in …5
×

高度に進化した分散データストアについて

5,073 views

Published on

高度に進化した分散データストアについて。Incline と Pacific の背景にある考え方を説明

Published in: Technology
0 Comments
1 Like
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
5,073
On SlideShare
0
From Embeds
0
Number of Embeds
1,644
Actions
Shares
0
Downloads
37
Comments
0
Likes
1
Embeds 0
No embeds

No notes for slide

高度に進化した分散データストアについて

  1. 1. Cybozu Labs, Inc. Kazuho Oku
  2. 2.  Oracle (RAC)  force.com (Salesforce)  GAE DataStore  Kumofs, hBase, etc. Q. Oracle ? Nov 30 2009 2
  3. 3. PHP RDBMS   RDBMS  OSS RDBMS ?  MySQL Cluster?  Spider Storage Engine?  Oracle OSS ?   KVS RDBMS  Salesforce GAE DataStore SQL-like Nov 30 2009 3
  4. 4. MySQL (InnoDB)  SELECT   max. 40k QPS  memcached 1/5     OS   KVS  SQL ACID     Nov 30 2009 4
  5. 5.  ACID                 Nov 30 2009 5
  6. 6. (SNS )           :   (JOIN )     Nov 30 2009 6
  7. 7. Incline & Pacific        (eventual) consistency    SPOF Proxy-less Daemon-less OSS RDBMS Nov 30 2009 7
  8. 8. Incline –   RDB Sharding   shard Incline Nov 30 2009 8
  9. 9. Incline –   DDL    DDL   shard  ACID   Nov 30 2009 9
  10. 10. Incline – (1)   JOIN uid:1-2000 uid:2001-4000 uid:4001-6000 tweet tweet tweet following following following followed_by followed_by followed_by ... timeline timeline timeline queue queue queue when uid:123 tweets, write only to his tweet table. Incline updates other tables automatically Nov 30 2009 10
  11. 11. Incline – (2)   uid:1-2000 uid:2001-4000 uid:4001-6000 tweet tweet tweet following following following followed_by followed_by followed_by ... timeline timeline timeline queue queue queue when uid:2431 starts following uid:940 only write to his following table Nov 30 2009 11
  12. 12. Pacific –     RDBMS         < 10  SPOF   Nov 30 2009 12
  13. 13. Incline & Pacific  Incline    MySQL PostgreSQL  Windows  Pacific    see developer.cybozu.co.jp/kazuho Nov 30 2009 13
  14. 14.    Incline Pacific  DBIx::ShardManager   Nov 30 2009 14

×