Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

An Implementation of Virtual Cluster on a Cloud

1,349 views

Published on

"An Implementation of Virtual Cluster on a Cloud" was given at #PRAGMA24 on Mar 20, 2013 at Kasetsart University, Bangkok, THAILAND.

Published in: Technology
  • Be the first to comment

  • Be the first to like this

An Implementation of Virtual Cluster on a Cloud

  1. 1. An Implementation ofVirtual Cluster on a Cloud Pongsakorn U-chupala Kasetsart University #PRAGMA24
  2. 2. Agenda• Introduction• Design & Implementation• Benchmarking Results
  3. 3. Virtual ClusterUser Frontend GPU Accelerated Nodes High-speed Network Compute Nodes Storage Farm *Example setup
  4. 4. Managing virtual cluster Manually is a Headachehttp://openphoto.net/gallery/image.html?image_id=24436
  5. 5. Virtual Cluster Cloud User Virtual Cluster Template*Not limited to Rocks Cluster Virtual Cluster
  6. 6. Multi-site Infrastructure Japan Overlay NetworkUSA Thailand *Countries listed are just for examples
  7. 7. Design Goals• Automatic resources management• Designed with scalability in mind• Acceptable performance• Virtual Cluster management as a single entity – Create – Stop – Deploy – Delete – Suspend
  8. 8. Agenda• Introduction• Design & Implementation• Benchmarking Results
  9. 9. Architecture O ebula penN onevc extension Virtual Infras ture truc Multi-tier V N P O erlayN o v etw rk R ourceS 1(R ) es ite ocks R ource esV -C iner M onta V -C iner M onta S 2 ite P ic R o e hys al es urc
  10. 10. Multi-tier VPN P a VN S rim ry P erver P a V NS rim ry P erver V NC P lient S 1 ite B e ridg V NJ P unction S 2 ite V NS P erver V -C iner M onta V -C iner M ontaV -C iner V NC M onta P lients
  11. 11. Agenda• Introduction• Design & Implementation• Benchmarking Results
  12. 12. Cloud Testbed OpenNebula (CentOS 6.2) Public NetworkSite A (Rocks 6.0) Site B (Rocks 6.0) Frontend Frontend Private Network Private Network VM-Container-0-0 VM-Container-0-1 VM-Container-0-0 VM-Container-0-1 Overlay Network
  13. 13. Network Benchmarking• Average Bandwidth: measured with Iperf – Physical Network: 776.62 Mbits/s – Overlay Network: 314.26 Mbits/s• Round-Trip-Time: measured with ping – Physical Network: 0.135 ms – Overlay Network: 0.455 ms
  14. 14. Virtual Cluster Testset Site A Site B VM-Container-0-0 VM-Container-0-1 VM-Container-0-0 VM-Container-0-1Multi-site Virtual Cluster Frontend Compute-0-0 Compute-0-1 Compute-0-2Single-site Virtual Cluster Frontend Compute-0-1 Compute-0-0 Compute-0-2Single-site Virtual Cluster with Physical Network Frontend Compute-0-1 Compute-0-0 Compute-0-2Single-host VC Frontend Compute-0-0 Compute-0-1 Compute-0-2
  15. 15. HPCC Benchmarking Results
  16. 16. DGEMM (CPU Intensive) DGEMM (CPU Intensive) 10 9.045199 9.100802 9.303938 9 8Average Gflops 7 6 5 4.197254 4 3 2 1 0 Single-host Single-site Single-site with Multi-site Physical Network
  17. 17. Average GB/s 0 5 10 15 20 20.318253 25 20.153016 19.75952 Single-host 18.470081 18.605038Copy 19.260255 18.560227Scale Single-site 17.8158Add 18.669311 18.415776Triad 17.819891 17.472441 Single-site with Physical Network 21.183269 21.509165 21.116839 STREAM (Memory Bandwidth) Multi-site 19.738259
  18. 18. HPL (Peak Performance) 2 1.873 1.8 1.6 1.4 1.2Gflops 1 0.8 0.6 0.5229 0.4117 0.4 0.3126 0.2 0 Single-host Single-site Single-site with Multi-site Physical Network
  19. 19. Conclusion• The virtual cluster cloud works as expected• This cloud is suitable for non-network- intensive application – Bio-Chemical-Related Research – Video Rendering – Brute-force Searches – Bitcoin Mining :D
  20. 20. Future Works• Better Overlay Network implementation – Software-defined Networking (SDN)• Intelligence VM placement mechanism (scheduling) – Swarm algorithm – Firefly algorithm
  21. 21. Thank you for you attentionQ&A

×