Introducing EC-GIN: Europe-China Grid InterNetworking Europe-China Grid InterNetworking European Sixth Framework STREP FP6...
What is EC-GIN about? Traditional Internet applications (web browser, ftp, ..)‏ Driving a racing car on a public road Appl...
Project facts <ul><li>STREP in FP6 Call 6, total funding € 2.2 M </li></ul><ul><li>Start date: 1 November 2006; duration: ...
Research Objectives and Challenges <ul><li>Objectives </li></ul><ul><ul><li>The EC-GIN project, based on a number of prope...
Example Scenario: Large File Transfer Multipath file transfer (A  B + A  C  B)  beneficial Multipath file transfer not ...
Large File Transfer Scenarios: Questions <ul><li>When does use of multiple paths make sense? </li></ul><ul><ul><li>To incr...
Some answers (EC-GIN results)‏ <ul><li>Incentives: Private Shared History - PSH2 </li></ul><ul><ul><li>tested in file shar...
More results: models and simulation <ul><li>Various Grid traffic measurements and analyses </li></ul><ul><ul><li>ATLAS (EG...
QoS for Grids: Bulk Data Transfer Service (BDTS)  virtual topology calendars Real network Control Plane:  jBDTS Data Plane...
Weighted fairness for data transfers <ul><li>Based on model of multiple TCP flows (extension of Padhye eqn)‏ </li></ul><ul...
... and many other things, available as tools... <ul><li>GridMAP </li></ul><ul><ul><li>Passive measurement system </li></u...
... and integrated in GINTONIC <ul><li>Grid InterNetworking TOolbox Nestled in the Core </li></ul><ul><ul><li>Separate dae...
Thanks for your attention! More information, references, code: http://www.ec-gin.eu
Upcoming SlideShare
Loading in...5
×

EC-GIN_sep09.ppt

280

Published on

Published in: Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
280
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
2
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

EC-GIN_sep09.ppt

  1. 1. Introducing EC-GIN: Europe-China Grid InterNetworking Europe-China Grid InterNetworking European Sixth Framework STREP FP6-2006-IST-045256 Michael Welzl, Dan He OGF 27, 15 oct 2009
  2. 2. What is EC-GIN about? Traditional Internet applications (web browser, ftp, ..)‏ Driving a racing car on a public road Applications with special network properties and requirements Bringing the Grid to its full potential ! Enriched with customised network mechanisms Original Internet technology Real-time multimedia applications (VoIP, video conference, ..)‏ Today‘s Grid applications EC-GIN EC-GIN enabled Grid applications
  3. 3. Project facts <ul><li>STREP in FP6 Call 6, total funding € 2.2 M </li></ul><ul><li>Start date: 1 November 2006; duration: 3 years </li></ul><ul><li>Consortium: 11 partners </li></ul><ul><ul><li>7 European partners </li></ul></ul><ul><ul><ul><li>Universität Innsbruck, UIBK, Austria (coordinator)‏ </li></ul></ul></ul><ul><ul><ul><li>University of Zürich, UniZH, Switzerland </li></ul></ul></ul><ul><ul><ul><li>Institut National de Recherche en Informatique et Automatique, INRIA, France </li></ul></ul></ul><ul><ul><ul><li>Lancaster University, ULANC, U.K. </li></ul></ul></ul><ul><ul><ul><li>Justinmind, JIM, Spain </li></ul></ul></ul><ul><ul><ul><li>EXIS IT, Greece </li></ul></ul></ul><ul><ul><ul><li>University of Surrey, UniS, U.K. </li></ul></ul></ul><ul><ul><li>4 Chinese partners </li></ul></ul><ul><ul><ul><li>Beijing University of Posts and Telecommunications, BUPT </li></ul></ul></ul><ul><ul><ul><li>Institute of Software, Chinese Academy of Sciences, ISCAS </li></ul></ul></ul><ul><ul><ul><li>China Telecommunication Technology Labs, CTTL </li></ul></ul></ul><ul><ul><ul><li>China Mobile Group Design Institute Co., Ltd , CMDI </li></ul></ul></ul>
  4. 4. Research Objectives and Challenges <ul><li>Objectives </li></ul><ul><ul><li>The EC-GIN project, based on a number of properties that make Grids unique from the network perspective, aims at developing a tailored network technology in dedicated support of Grid applications. These technical solutions will be supplemented with a secure and incentive-based Grid Services network traffic management system, which will balance the conflicting performance demand and the economic use of resources in the network and within the Grid.” </li></ul></ul><ul><li>Research Challenges </li></ul><ul><ul><li>How to model Grid traffic and simulate a Grid-network? </li></ul></ul><ul><ul><ul><li>Much is known about web traffic (e.g. self-similarity) - but the Grid is different </li></ul></ul></ul><ul><ul><ul><li>Up to now, Grid-Sim / Net-Sim were two separate worlds (different goals, assumptions, tools, people </li></ul></ul></ul><ul><ul><li>How to specify and manage QoS? </li></ul></ul><ul><ul><ul><li>Grids need file transfer deadlines, not sustained bit rates </li></ul></ul></ul><ul><ul><li>How to align network and Grid economics? </li></ul></ul><ul><ul><ul><li>Grid service model, charging model for grid services </li></ul></ul></ul><ul><ul><ul><li>Network Mgmt mechanisms in support of those areas in an integrated fashion </li></ul></ul></ul>
  5. 5. Example Scenario: Large File Transfer Multipath file transfer (A  B + A  C  B) beneficial Multipath file transfer not beneficial due to shared bottleneck Also consider: B wants to send to A; obtains prediction; does not know that C sends to A at the same time  prediction is wrong in right diagram
  6. 6. Large File Transfer Scenarios: Questions <ul><li>When does use of multiple paths make sense? </li></ul><ul><ul><li>To increase overall throughput </li></ul></ul><ul><li>How could this functionality be exposed? </li></ul><ul><ul><li>As a transport service? </li></ul></ul><ul><li>What constraints can be considered? </li></ul><ul><ul><li>To allow the delivery of a certain level of QoS </li></ul></ul><ul><li>How could large file transfer be authenticated and authorized? </li></ul><ul><ul><li>By intermediate nodes? </li></ul></ul><ul><li>How to align incentives? </li></ul><ul><ul><li>Who should be charged how much? </li></ul></ul>
  7. 7. Some answers (EC-GIN results)‏ <ul><li>Incentives: Private Shared History - PSH2 </li></ul><ul><ul><li>tested in file sharing scenario; closely related to LFT </li></ul></ul><ul><ul><li>PSH2 simulation with data from ThePirateBay </li></ul></ul><ul><ul><li>Scaled down by 1000 for simulation (70 GB scaled to 70 MB); used 29 files with over 1000 nodes </li></ul></ul><ul><li>Pricing </li></ul><ul><ul><li>Resource allocation model based on combinatorial double auction </li></ul></ul><ul><ul><li>Four entities involved: User broker (UB), Grid service provider (GSP), Grid market auctioneer (GMA), Combinatorial Double Auctioneer, Grid information service (GIS)‏ </li></ul></ul>
  8. 8. More results: models and simulation <ul><li>Various Grid traffic measurements and analyses </li></ul><ul><ul><li>ATLAS (EGEE), GridFTP, IPTV CDN, PPLive </li></ul></ul><ul><li>ns-2 code for Grid traffic simulation </li></ul><ul><ul><li>Traffic generators for applications above available from Sourceforge </li></ul></ul><ul><ul><li>can be tuned for a wide variety of network conditions and streaming parameters </li></ul></ul>
  9. 9. QoS for Grids: Bulk Data Transfer Service (BDTS) virtual topology calendars Real network Control Plane: jBDTS Data Plane: FLOC Contribution to OGF- NSI: Network Service Interface
  10. 10. Weighted fairness for data transfers <ul><li>Based on model of multiple TCP flows (extension of Padhye eqn)‏ </li></ul><ul><ul><li>based on RTT, loss and parameter n </li></ul></ul><ul><ul><li>Easy to calculate; n  Q >0 </li></ul></ul><ul><li>MulTFRC: emulate n TCP flows </li></ul><ul><ul><li>Based on TFRC (Equation Based TCP-friendy Rate Control protocol)‏ </li></ul></ul><ul><ul><li>Equation exchanged with ours + some minor other changes </li></ul></ul><ul><li>Applications </li></ul><ul><ul><li>Assign priorities to flows belonging to one user </li></ul></ul><ul><ul><li>Assign priorities to users (e.g. M-IPTV)‏ </li></ul></ul>
  11. 11. ... and many other things, available as tools... <ul><li>GridMAP </li></ul><ul><ul><li>Passive measurement system </li></ul></ul><ul><li>High-Speed SOAP Engine </li></ul><ul><ul><li>Transparently deployable speed improvement </li></ul></ul><ul><li>Dynamic optimum server selection </li></ul><ul><ul><li>Mobile IPTV </li></ul></ul><ul><li>Peer Awareness (for fast file transfer with limited number of nodes)‏ </li></ul><ul><ul><li>Topology discovery and shared bottleneck detection </li></ul></ul><ul><li>Parallel Transfer Grid (for fast file transfer with large number of nodes)‏ </li></ul><ul><ul><li>Heuristic based scheme to find and use the best Forwarding Peers </li></ul></ul>
  12. 12. ... and integrated in GINTONIC <ul><li>Grid InterNetworking TOolbox Nestled in the Core </li></ul><ul><ul><li>Separate daemons which communicate via “Base” </li></ul></ul><ul><ul><li>Architecture somewhat similar to Globus Toolkit </li></ul></ul><ul><ul><li>You install the “Base” plus what you need, not everything! </li></ul></ul>MECHANISM X Daemonization code X daemon based on WP3/WP4 prototype MECHANISM Y Daemonization code Y daemon based on WP3/WP4 prototype BASE BASE 1 2 Host 1 Host 2 GINTONIC library GINTONIC library GINTONIC library GINTONIC library
  13. 13. Thanks for your attention! More information, references, code: http://www.ec-gin.eu
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×