Scalable concurrency control  in a dynamic membership A. Ciuffoletti * – A. Asim ** *  INFN-CNAF, Bologna, Italy **  Unive...
Problem statement <ul><li>A centralized resource </li></ul><ul><li>A large, dynamic number of users </li></ul><ul><li>Each...
A multi-token approach <ul><li>Given  </li></ul><ul><li>The service time (here  token latency )  t  and </li></ul><ul><li>...
Our solution <ul><li>Overlay topology: mesh with degree near to N </li></ul><ul><li>Token routing: random neighbor </li></...
Closed loop control <ul><li>Measure the time from the last token receive event </li></ul><ul><li>Early tokens are delayed ...
Membership maintenance <ul><li>Recent updates to the local membership directory are piggybacked to the token </li></ul><ul...
Experimental results Decrease exponentially (good) Maximum at the minimum (bad) Average at 1.7 instead of 2.6 (bad) Waving...
Experimental results The process converges (good!) Its dynamics are extremely fast (unexpectedly good) Number of token exc...
Experimental results All join events eventually received (good) Takes a long time (expected)
Conclusions <ul><ul><li>One of the first experiments of this kind in the Internet scale (instead of theoretical investigat...
Upcoming SlideShare
Loading in …5
×

Scalable concurrency control in a dynamic membership

511 views

Published on

Published in: Technology
  • Be the first to comment

  • Be the first to like this

Scalable concurrency control in a dynamic membership

  1. 1. Scalable concurrency control in a dynamic membership A. Ciuffoletti * – A. Asim ** * INFN-CNAF, Bologna, Italy ** University of Paris Sud-XI, Paris, France 3 rd CoreGRID Workshop on Middleware – June 2008
  2. 2. Problem statement <ul><li>A centralized resource </li></ul><ul><li>A large, dynamic number of users </li></ul><ul><li>Each user must be periodically granted access to the resource </li></ul><ul><li>A use case </li></ul><ul><li>A centralized registry that must be periodically checked by each user to synchronize a local cache. </li></ul>
  3. 3. A multi-token approach <ul><li>Given </li></ul><ul><li>The service time (here token latency ) t and </li></ul><ul><li>The number of nodes in the system N </li></ul><ul><li>We can figure out the number of tokens needed to sustain a certain period p : </li></ul><ul><li>But we need: </li></ul><ul><li>An overlay ring (difficult) </li></ul><ul><li>The size of the network (difficult) </li></ul>
  4. 4. Our solution <ul><li>Overlay topology: mesh with degree near to N </li></ul><ul><li>Token routing: random neighbor </li></ul><ul><li>Token number: closed loop over p </li></ul><ul><li>Problems: </li></ul><ul><li>Security issues (tokens are received from “anybody”) </li></ul><ul><li>Maintain a cache with most of the neighbors </li></ul><ul><li>Closed loop control </li></ul>
  5. 5. Closed loop control <ul><li>Measure the time from the last token receive event </li></ul><ul><li>Early tokens are delayed in a short queue (discard on overflow) </li></ul><ul><li>Generate a new token upon timeout </li></ul><ul><li>Appear to be quite simplistic: loop control is still to refine </li></ul><ul><li>Problem (minor): sensitivity to network performance </li></ul>
  6. 6. Membership maintenance <ul><li>Recent updates to the local membership directory are piggybacked to the token </li></ul><ul><li>Limited capacity of the token </li></ul><ul><li>At each step the list of updates is recomputed </li></ul><ul><li>Join event </li></ul><ul><li>Create a new token and send it to a known peer </li></ul><ul><li>Leave event </li></ul><ul><li>File a leave event in the first availabletoken </li></ul>
  7. 7. Experimental results Decrease exponentially (good) Maximum at the minimum (bad) Average at 1.7 instead of 2.6 (bad) Waving? Due to buffering.
  8. 8. Experimental results The process converges (good!) Its dynamics are extremely fast (unexpectedly good) Number of token exceeds expectation (55 instead of 2!)
  9. 9. Experimental results All join events eventually received (good) Takes a long time (expected)
  10. 10. Conclusions <ul><ul><li>One of the first experiments of this kind in the Internet scale (instead of theoretical investigation and simulations) </li></ul></ul><ul><ul><li>Mixed results: </li></ul></ul><ul><ul><li>The process stabilizes, local directories eventually converge </li></ul></ul><ul><ul><li>Dynamics are not those expected: too many tokens, short lived, too frequent </li></ul></ul><ul><ul><li>Overall: we are on the right way, tuning needed </li></ul></ul>

×