SDEC2011 Arcus NHN memcached cloud
Upcoming SlideShare
Loading in...5
×
 

SDEC2011 Arcus NHN memcached cloud

on

  • 4,318 views

Arcus is data caching cloud developed on Memcached which is a memory-based Key-Value repository. It was developed meeting requirements from various NHN services. Arcus is capable of having up-to-date ...

Arcus is data caching cloud developed on Memcached which is a memory-based Key-Value repository. It was developed meeting requirements from various NHN services. Arcus is capable of having up-to-date cache server list of clients using ZooKeeper and also able to possess cloud architecture flexible to add or delete caching servers while eliminating extra network latency between client and server. Furthermore, to support save/ computation function of data collection which is becoming a requirement among many services, it provides list, set, b+tree structures.

http://sdec.kr/

Statistics

Views

Total Views
4,318
Views on SlideShare
4,318
Embed Views
0

Actions

Likes
8
Downloads
212
Comments
0

0 Embeds 0

No embeds

Accessibility

Categories

Upload Details

Uploaded via as Adobe PDF

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

SDEC2011 Arcus NHN memcached cloud SDEC2011 Arcus NHN memcached cloud Presentation Transcript

  • Arcus:NHNMemcachedCloud 박준현/NHN
  • ARCUS2 / SDEC 2011 발표자료
  • ARCUS개발배경   •    •       •         •   •       •      3 / SDEC 2011 발표자료
  • ARCUS개발배경   •              •                 4 / SDEC 2011 발표자료
  • ARCUSCacheCloud•     •   •   •     •   •     5 / SDEC 2011 발표자료
  • Memcached•  •     •       •        •          6 / SDEC 2011 발표자료
  • MemcachedOperations•    Commands •       •     •    , )   •       ,      (  ),  7 / SDEC 2011 발표자료
  • MemcachedOperationExamples•    set  <key>  <flags>  <exptime>  <bytes>  [noreply]rn   <value>rn     [jhpark@XXXX]$  telnet  localhost  11211   get  <key>rn Trying  127.0.0.1...   Connected  to  localhost.localdomain  (127.0.0.1).   Escape  character  is  ^].     set  sample_key  0  0  12   sample_value   STORED     get  sample_key   VALUE  sample_key  0  12   sample_value   END   8 / SDEC 2011 발표자료
  • MemcachedPerformance•      Throughput (TPS) Response Time 250000 (microsec) 800 200000 700 600 150000 500 400 100000 300 200 50000 100 0 0 9 / SDEC 2011 발표자료
  • ConsistentHashing•          •       •       Key z Node 3 Node 2 Remapped to Join Node 3 Key y Node 1 Remapped to Node 1 Node 0 Key x Leave (Failure) 10 / SDEC 2011 발표자료
  • ConsistentHashing•        Node 0 Node 2 •    Node 2 Node 0 •      Node 0 •      Node 1 •    Node 1 Node 2 Node 1Node 1 Node 2 Node 2 Node 0 Node 0 Node 1 11 / SDEC 2011 발표자료
  • Arcus1.5Architecture Clients Cache Nodes Consistent hashing Java & C Smart Client + Local caching (Java) Unified Cloud Admin (Zookeeper ensemble)12 / SDEC 2011 발표자료
  • ZookeeperIntegration•   •   •        •       •           •     •         •    13 / SDEC 2011 발표자료
  • ZookeeperIntegrationClients Cache Nodes Cache Node List M aintenance Zookeeper Ensemble Cache Node List ------------------ Node 1 IP:Port Node 2 IP:Port Node 3 IP:Port Node 4 IP:Port Cache Node 구동 Zookeeper 세션 연결 Ephemeral Node 수동 생성14 / SDEC 2011 발표자료
  • Arcus1.5Memcached•      •      Memcached Core ZK Community Engine Client Default Arcus Engine Engine 15 / SDEC 2011 발표자료
  • Collection개발배경•     •   ­–    •    ­–     •   ­–   •      •     •      •     •          16 / SDEC 2011 발표자료
  • Collection개요•     •  ­–   •         •      •  ­–        •  64bitintegerkey(bkey),value    •        •      •       •      •     17 / SDEC 2011 발표자료
  • Collection저장구조   Hash Table For Uniqueness Checkingheader key value  value2  ..    .header key setinfo item Forward/Backward Range Scanheader key b+treeinfo .. . bkey1  ..    ..    .    .       value 18 / SDEC 2011 발표자료
  • NAVERMeCollection활용사례정보콘텐츠on네이버 카페 블로그 뉴스 웹툰 책 뮤직 etc... 지식인       19 / SDEC 2011 발표자료
  • NAVERMeCollection활용사례•   ­–   SELECT  *     FROM  messages   WHERE  feedid  in  (feedID1,  feedID2,  …,  feedIDn)                      AND  create_time  <  sysdate()   ORDER  BY  create_time  DESC   LIMIT  20;•      •       •       •       20 / SDEC 2011 발표자료
  • NAVERMeCollection활용사례•     •     •    ­–    Push Delivery User Inbox 1 Feed 1 User Inbox 2 Feed M User Inbox N 21 / SDEC 2011 발표자료
  • NAVERMeCollection활용사례  구독관계Cache (SETtype)         사용자별        구독글목록Cache  (B+Treetype)       구독글내용Cache  (K/Vtype)        22 / SDEC 2011 발표자료
  • BulkInsert•     •     •       •      •    •     23 / SDEC 2011 발표자료
  • SequentialCommandExecution•    Client Server 0 ms •       •     40 usec       1 ms•   40 usec •    2 ms •     40 usec•        3 ms 24 / SDEC 2011 발표자료
  • Server-sideCommandPipelining•   ­–   Client Server •        0 ms 120 usec •         1.x ms•    •       25 / SDEC 2011 발표자료
  • OtherFeatures•        •    •     •    •  •   New Technology Requirements New Idea & Features New Products 26 / SDEC 2011 발표자료
  • ArcusandMembase 기술 협조, 공동 개발 Memcached 기반 Elastic data cloud27 / SDEC 2011 발표자료
  •   28 / SDEC 2011 발표자료