Your SlideShare is downloading. ×
0
Arcus:NHNMemcachedCloud                   박준현/NHN
ARCUS2 / SDEC 2011 발표자료
ARCUS개발배경                                                                                                                 ...
ARCUS개발배경                                                                                                                 ...
ARCUSCacheCloud•                                                                                                          ...
Memcached•                                                                                                                ...
MemcachedOperations•                                                                                                      ...
MemcachedOperationExamples•                           set	  key	  flags	  exptime	  bytes	  [noreply]rn	       valuern	   ...
MemcachedPerformance•                                                             Throughput (TPS)              Response T...
ConsistentHashing•                                                                                                        ...
ConsistentHashing•                                                                                                        ...
Arcus1.5Architecture                      Clients               Cache Nodes            Consistent hashing         Java  C ...
ZookeeperIntegration•                                                     •                                               ...
ZookeeperIntegrationClients                                                       Cache Nodes               Cache Node Lis...
Arcus1.5Memcached•                                                                                              •         ...
Collection개발배경•                                                                                                           ...
Collection개요•                                                                                                             ...
Collection저장구조                                                                   Hash Table For Uniqueness Checkingheader ...
NAVERMeCollection활용사례정보콘텐츠on네이버     카페    블로그     뉴스        웹툰       책       뮤직                   etc...   지식인            ...
NAVERMeCollection활용사례•                                                                     ­–                             ...
NAVERMeCollection활용사례•                                                  •                                                 ...
NAVERMeCollection활용사례                                                                                                     ...
BulkInsert•                                                                                                               ...
SequentialCommandExecution•                                                                                               ...
Server-sideCommandPipelining•                                            ­–                                               ...
OtherFeatures•                                                                                                            ...
ArcusandMembase                              기술 협조,                              공동 개발                                    ...
28 / SDEC 2011 발표자료
Upcoming SlideShare
Loading in...5
×

SDEC2011 Arcus NHN memcached cloud

4,673

Published on

Arcus is data caching cloud developed on Memcached which is a memory-based Key-Value repository. It was developed meeting requirements from various NHN services. Arcus is capable of having up-to-date cache server list of clients using ZooKeeper and also able to possess cloud architecture flexible to add or delete caching servers while eliminating extra network latency between client and server. Furthermore, to support save/ computation function of data collection which is becoming a requirement among many services, it provides list, set, b+tree structures.

http://sdec.kr/

Published in: Technology
0 Comments
11 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total Views
4,673
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
224
Comments
0
Likes
11
Embeds 0
No embeds

No notes for slide

Transcript of "SDEC2011 Arcus NHN memcached cloud"

  1. 1. Arcus:NHNMemcachedCloud 박준현/NHN
  2. 2. ARCUS2 / SDEC 2011 발표자료
  3. 3. ARCUS개발배경 •  •  •  •  •  •  3 / SDEC 2011 발표자료
  4. 4. ARCUS개발배경 •  •  4 / SDEC 2011 발표자료
  5. 5. ARCUSCacheCloud•  •  •  •  •  •  5 / SDEC 2011 발표자료
  6. 6. Memcached•  •  •  •  •  6 / SDEC 2011 발표자료
  7. 7. MemcachedOperations•  Commands •  •  •  , ) •  , ( ), 7 / SDEC 2011 발표자료
  8. 8. MemcachedOperationExamples•  set  key  flags  exptime  bytes  [noreply]rn   valuern     [jhpark@XXXX]$  telnet  localhost  11211   get  keyrn Trying  127.0.0.1...   Connected  to  localhost.localdomain  (127.0.0.1).   Escape  character  is  ^].     set  sample_key  0  0  12   sample_value   STORED     get  sample_key   VALUE  sample_key  0  12   sample_value   END   8 / SDEC 2011 발표자료
  9. 9. MemcachedPerformance•  Throughput (TPS) Response Time 250000 (microsec) 800 200000 700 600 150000 500 400 100000 300 200 50000 100 0 0 9 / SDEC 2011 발표자료
  10. 10. ConsistentHashing•  •  •  Key z Node 3 Node 2 Remapped to Join Node 3 Key y Node 1 Remapped to Node 1 Node 0 Key x Leave (Failure) 10 / SDEC 2011 발표자료
  11. 11. ConsistentHashing•  Node 0 Node 2 •  Node 2 Node 0 •  Node 0 •  Node 1 •  Node 1 Node 2 Node 1Node 1 Node 2 Node 2 Node 0 Node 0 Node 1 11 / SDEC 2011 발표자료
  12. 12. Arcus1.5Architecture Clients Cache Nodes Consistent hashing Java C Smart Client + Local caching (Java) Unified Cloud Admin (Zookeeper ensemble)12 / SDEC 2011 발표자료
  13. 13. ZookeeperIntegration•  •  •  •  •  •  •  •  13 / SDEC 2011 발표자료
  14. 14. ZookeeperIntegrationClients Cache Nodes Cache Node List M aintenance Zookeeper Ensemble Cache Node List ------------------ Node 1 IP:Port Node 2 IP:Port Node 3 IP:Port Node 4 IP:Port Cache Node 구동 Zookeeper 세션 연결 Ephemeral Node 수동 생성14 / SDEC 2011 발표자료
  15. 15. Arcus1.5Memcached•  •  Memcached Core ZK Community Engine Client Default Arcus Engine Engine 15 / SDEC 2011 발표자료
  16. 16. Collection개발배경•  •  ­– •  ­– •  ­– •  •  •  •  •  16 / SDEC 2011 발표자료
  17. 17. Collection개요•  •  ­– •  •  •  ­– •  64bitintegerkey(bkey),value •  •  •  •  •  17 / SDEC 2011 발표자료
  18. 18. Collection저장구조 Hash Table For Uniqueness Checkingheader key value value2 .. .header key setinfo item Forward/Backward Range Scanheader key b+treeinfo .. . bkey1 .. .. . . value 18 / SDEC 2011 발표자료
  19. 19. NAVERMeCollection활용사례정보콘텐츠on네이버 카페 블로그 뉴스 웹툰 책 뮤직 etc... 지식인 19 / SDEC 2011 발표자료
  20. 20. NAVERMeCollection활용사례•  ­– SELECT  *     FROM  messages   WHERE  feedid  in  (feedID1,  feedID2,  …,  feedIDn)                      AND  create_time    sysdate()   ORDER  BY  create_time  DESC   LIMIT  20;•  •  •  •  20 / SDEC 2011 발표자료
  21. 21. NAVERMeCollection활용사례•  •  •  ­– Push Delivery User Inbox 1 Feed 1 User Inbox 2 Feed M User Inbox N 21 / SDEC 2011 발표자료
  22. 22. NAVERMeCollection활용사례 구독관계Cache (SETtype) 사용자별 구독글목록Cache (B+Treetype) 구독글내용Cache (K/Vtype) 22 / SDEC 2011 발표자료
  23. 23. BulkInsert•  •  •  •  •  •  23 / SDEC 2011 발표자료
  24. 24. SequentialCommandExecution•  Client Server 0 ms •  •  40 usec 1 ms•  40 usec •  2 ms •  40 usec•  3 ms 24 / SDEC 2011 발표자료
  25. 25. Server-sideCommandPipelining•  ­– Client Server •  0 ms 120 usec •  1.x ms•  •  25 / SDEC 2011 발표자료
  26. 26. OtherFeatures•  •  •  •  •  •  New Technology Requirements New Idea Features New Products 26 / SDEC 2011 발표자료
  27. 27. ArcusandMembase 기술 협조, 공동 개발 Memcached 기반 Elastic data cloud27 / SDEC 2011 발표자료
  28. 28. 28 / SDEC 2011 발표자료
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×