Evaluation of     Virtual    Clusters  Performance   on a Cloud   Computing Infrastructure     Nuno Cardoso, Tito  Vieira ...
Evaluation of     Virtual    Clusters  Performance                                                                        ...
Evaluation of     Virtual    Clusters  Performance                                                                       U...
Evaluation of     Virtual    Clusters  Performance                                                               Provider’...
Evaluation of     Virtual    Clusters  Performance                                                                        ...
Evaluation of     Virtual    Clusters  Performance                                                                        ...
Evaluation of     Virtual    Clusters  Performance                                             Resources characterization ...
Evaluation of     Virtual    Clusters  Performance                                             Resources characterization ...
Evaluation of     Virtual    Clusters  Performance                                             Resources characterization ...
Evaluation of     Virtual    Clusters  Performance                                                                        ...
Evaluation of     Virtual    Clusters  Performance                                                                Benchmar...
Evaluation of     Virtual    Clusters  Performance                                                                        ...
Evaluation of     Virtual    Clusters  Performance                                                                        ...
Evaluation of     Virtual    Clusters  Performance                                                                Benchmar...
Evaluation of     Virtual    Clusters  Performance                                                                    Phor...
Evaluation of     Virtual    Clusters  Performance                                                                Benchmar...
Evaluation of     Virtual    Clusters  Performance                                                                  HPCC -...
Evaluation of     Virtual    Clusters  Performance                                                           HPCC - Multip...
Evaluation of     Virtual    Clusters  Performance                                                                Benchmar...
Evaluation of     Virtual    Clusters  Performance                                                                        ...
Evaluation of     Virtual    Clusters  Performance                                                                        ...
Evaluation of     Virtual    Clusters  Performance                                                                Benchmar...
Evaluation of     Virtual    Clusters  Performance                                                               Distribut...
Evaluation of     Virtual    Clusters  Performance                                                               Distribut...
Evaluation of     Virtual    Clusters  Performance                                                                        ...
Evaluation of     Virtual    Clusters  Performance                                                                        ...
Evaluation of     Virtual    Clusters  Performance                                                                        ...
Evaluation of     Virtual    Clusters  Performance                                                                        ...
Evaluation of     Virtual    Clusters  Performance                                     Backup - HPL Benchmark Results   on...
Evaluation of     Virtual    Clusters  Performance                                     Backup - HPL Benchmark Results   on...
Evaluation of     Virtual    Clusters  Performance                                     Backup - HPL Benchmark Results   on...
Evaluation of     Virtual    Clusters  Performance                                     Backup - HPL Benchmark Results   on...
Upcoming SlideShare
Loading in...5
×

Evaluation of Virtual Clusters Performance on a Cloud Computing Infrastructure

837

Published on

Published in: Technology, Business
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
837
On Slideshare
0
From Embeds
0
Number of Embeds
3
Actions
Shares
0
Downloads
18
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Evaluation of Virtual Clusters Performance on a Cloud Computing Infrastructure

  1. 1. Evaluation of Virtual Clusters Performance on a Cloud Computing Infrastructure Nuno Cardoso, Tito Vieira and Jorge G. Barbosa Introduction Hypothesis Goals Evaluation of Virtual Clusters Performance on Methods a Cloud Computing Infrastructure Results Conclusions Nuno Cardoso, Tito Vieira and Jorge G. Barbosa Universidade do Porto, Faculdade de Engenharia November 4, 2011Nuno Cardoso, Tito Vieira and Jorge G. Barbosa (Universidade do Clusters PerformanceEngenharia) Computing Infrastructure 1 / 26 Evaluation of Virtual Porto, Faculdade de on a Cloud November 4, 2011
  2. 2. Evaluation of Virtual Clusters Performance Outline on a Cloud Computing Infrastructure Nuno Cardoso, Tito 1 Introduction Vieira and Jorge G. Barbosa 2 Hypothesis Introduction Hypothesis 3 Goals Goals Methods Results 4 Methods Conclusions 5 Results 6 ConclusionsNuno Cardoso, Tito Vieira and Jorge G. Barbosa (Universidade do Clusters PerformanceEngenharia) Computing Infrastructure 1 / 26 Evaluation of Virtual Porto, Faculdade de on a Cloud November 4, 2011
  3. 3. Evaluation of Virtual Clusters Performance User’s perspective on a Cloud Computing Infrastructure Nuno Cardoso, Tito Vieira and Jorge G. Barbosa • Increase of computing needs Introduction Hypothesis • Lack of flexibility Goals • SW requirements different from the available Methods • Permissions to the available platforms are restricted Results • Clusters exist for specific applications ConclusionsNuno Cardoso, Tito Vieira and Jorge G. Barbosa (Universidade do Clusters PerformanceEngenharia) Computing Infrastructure 2 / 26 Evaluation of Virtual Porto, Faculdade de on a Cloud November 4, 2011
  4. 4. Evaluation of Virtual Clusters Performance Provider’s perspective on a Cloud Computing Infrastructure Nuno Cardoso, Tito Vieira and Jorge G. • High energy cost Barbosa Introduction • HW aging without proper use Hypothesis Goals • SW is tightly coupled with HW leading to: Methods • Difficult and lengthy migrations Results • Inflexibility Conclusions • Difficult substitution of failing components • Difficulty in meeting users’ requirementsNuno Cardoso, Tito Vieira and Jorge G. Barbosa (Universidade do Clusters PerformanceEngenharia) Computing Infrastructure 3 / 26 Evaluation of Virtual Porto, Faculdade de on a Cloud November 4, 2011
  5. 5. Evaluation of Virtual Clusters Performance Hypothesis on a Cloud Computing Infrastructure Nuno Cardoso, Tito Vieira and Jorge G. Barbosa Introduction Hypothesis Cloud Computing enables a better usage of the available Goals hardware without seriously compromising performance. Methods Results ConclusionsNuno Cardoso, Tito Vieira and Jorge G. Barbosa (Universidade do Clusters PerformanceEngenharia) Computing Infrastructure 4 / 26 Evaluation of Virtual Porto, Faculdade de on a Cloud November 4, 2011
  6. 6. Evaluation of Virtual Clusters Performance Goals on a Cloud Computing Infrastructure Nuno Cardoso, Tito Vieira and Jorge G. Barbosa • Explore the creation steps of an IaaS Cloud: Introduction • In an academic context Hypothesis • Using both specialized and non-specialized hardware Goals • Using open source technologies Methods • Evaluate the losses introduced by virtualization Results Conclusions • Analyze the benefits of the Cloud paradigmNuno Cardoso, Tito Vieira and Jorge G. Barbosa (Universidade do Clusters PerformanceEngenharia) Computing Infrastructure 5 / 26 Evaluation of Virtual Porto, Faculdade de on a Cloud November 4, 2011
  7. 7. Evaluation of Virtual Clusters Performance Resources characterization (1) on a Cloud Computing Infrastructure Nuno Cardoso, Tito Vieira and Jorge G. Barbosa • More non-specialized HW Introduction than specialized HW Hypothesis • Specialized HW older than Goals non-specialized HW Methods • Inferior performance Results • Higher energy Conclusions consumption Specialized: 256 Cores Non-Specialized: 3328 Cores • Closer to failure Figure: Computer resourcesNuno Cardoso, Tito Vieira and Jorge G. Barbosa (Universidade do Clusters PerformanceEngenharia) Computing Infrastructure 6 / 26 Evaluation of Virtual Porto, Faculdade de on a Cloud November 4, 2011
  8. 8. Evaluation of Virtual Clusters Performance Resources characterization (2) on a Cloud Computing Infrastructure Nuno Cardoso, Tito Vieira and Jorge G. Barbosa Introduction • High uptimes Hypothesis • 70% > 40m Goals • 42% > 1h30 Methods • Low loads Results • Possibility of running jobs 10 < t <= 40: 30% 40 < t <= 90: 28% Conclusions 90 < t <= 160: 23% 160 < t <= 250: 11% during those periods 250 < t <= 360: 5% 360 < t <= 490: 3% Figure: Non-specialized HW uptimesNuno Cardoso, Tito Vieira and Jorge G. Barbosa (Universidade do Clusters PerformanceEngenharia) Computing Infrastructure 7 / 26 Evaluation of Virtual Porto, Faculdade de on a Cloud November 4, 2011
  9. 9. Evaluation of Virtual Clusters Performance Resources characterization (3) on a Cloud Computing Infrastructure • Tier 1 nodes: Nuno Cardoso, Tito • Hardware: Vieira and Jorge G. • 2x Intel Xeon X3440 Barbosa (4 cores each) • 24GB RAM Introduction • GbE network Hypothesis • Operating System: Goals Debian GNU/Linux 6 Methods • Tiers 2 and 3 nodes: Results • Hardware: Conclusions • Intel Core 2 Quad Q9300 (4 cores) • 4GB RAM Figure: Multi-tier setup • GbE network • Operating System: Ubuntu FEUPNuno Cardoso, Tito Vieira and Jorge G. Barbosa (Universidade do Clusters PerformanceEngenharia) Computing Infrastructure 8 / 26 Evaluation of Virtual Porto, Faculdade de on a Cloud November 4, 2011
  10. 10. Evaluation of Virtual Clusters Performance Technologies on a Cloud Computing Infrastructure Nuno Cardoso, Tito Vieira and Infrastructure Benchmarks Jorge G. Barbosa • Debian GNU/Linux 6 • Phoronix Test Suite 3.2 Introduction • OpenNebula 2.0.1 • HPCC 1.4.1 Hypothesis Goals • KVM 0.12.5 • OpenMPI 1.4.2 Methods Results • OpenVPN 2.1 • Condor 7.4.4 Conclusions • OpenSSH 5.5 • Riak 0.14.1 • Cassandra 0.7.5Nuno Cardoso, Tito Vieira and Jorge G. Barbosa (Universidade do Clusters PerformanceEngenharia) Computing Infrastructure 9 / 26 Evaluation of Virtual Porto, Faculdade de on a Cloud November 4, 2011
  11. 11. Evaluation of Virtual Clusters Performance Benchmark Summary on a Cloud Computing Infrastructure Nuno Cardoso, Tito Vieira and Jorge G. Name Scope Barbosa Deployment Infrastructure Introduction Phoronix CPU/RAM, Disk IO Hypothesis HPCC CPU/RAM, Network, HPC Goals Methods Condor Infrastructure, HTC Results Distributed DBs Infrastructure, Databases Conclusions Table: Benchmark SummaryNuno Cardoso, Tito Vieira and Jorge G. Barbosa (Universidade do Clusters PerformanceEngenharia) Computing Infrastructure 10 / 26 Evaluation of Virtual Porto, Faculdade de on a Cloud November 4, 2011
  12. 12. Evaluation of Virtual Clusters Performance Deployment on a Cloud Computing Infrastructure Nuno Cardoso, Tito Vieira and Setup Jorge G. Barbosa S1: 1 node → 1 VM Introduction S2, S4 and S6: 1 node at 1x, 2x and 4x capacity (8,16 and 32 VMs) Hypothesis S3, S5 and S7: 2 nodes at 0.5x, 1x and 2x capacity (8,16 and 32 VMs) Goals VMs Methods Results • 1 Virtual CPU Conclusions • 1GB RAM • 2GB Disk (image: 500MB) • 4GB SwapNuno Cardoso, Tito Vieira and Jorge G. Barbosa (Universidade do Clusters PerformanceEngenharia) Computing Infrastructure 11 / 26 Evaluation of Virtual Porto, Faculdade de on a Cloud November 4, 2011
  13. 13. Evaluation of Virtual Clusters Performance Deployment on a Cloud Computing Infrastructure Nuno Cardoso, Tito Results Vieira and Jorge G. • 1 VM → ∼ 1.8 sec Barbosa • Elastic capabilities Introduction • Enables duplication of Hypothesis VMs/Clusters Request Transfer Boot Goals • Transfer bottleneck: Avg Avg Avg Methods S1 0.6 2.2 216.0 Distributed storage S2 0.1 1.9 245.4 Results S3 0.1 1.3 228.5 • Processing power S4 0.1 1.1 466.7 Conclusions S5 0.1 1.3 243.8 bottleneck: S6 0.1 1.5 717.4 More physical resources S7 0.1 1.0 418.2 Table: Benchmark results(sec)Nuno Cardoso, Tito Vieira and Jorge G. Barbosa (Universidade do Clusters PerformanceEngenharia) Computing Infrastructure 12 / 26 Evaluation of Virtual Porto, Faculdade de on a Cloud November 4, 2011
  14. 14. Evaluation of Virtual Clusters Performance Benchmark Summary on a Cloud Computing Infrastructure Nuno Cardoso, Tito Vieira and Jorge G. Name Scope Barbosa Deployment Infrastructure Introduction Phoronix CPU/RAM, Disk IO Hypothesis Goals HPCC CPU/RAM, Network, HPC Methods Condor Infrastructure, HTC Results Distributed DBs Infrastructure, Databases Conclusions Table: Benchmark SummaryNuno Cardoso, Tito Vieira and Jorge G. Barbosa (Universidade do Clusters PerformanceEngenharia) Computing Infrastructure 13 / 26 Evaluation of Virtual Porto, Faculdade de on a Cloud November 4, 2011
  15. 15. Evaluation of Virtual Clusters Performance Phoronix Test Suite on a Cloud Computing Infrastructure Setup Application Loss Bullet Physics Engine 2.75 1.29% Nuno Cardoso, Tito • Virtualized vs. C-Ray 1.1 0.67% Vieira and FFmpeg 0.6.1 5.39% Jorge G. Non-Virtualized FLAC Audio Encoding 1.2.1 1.43% Barbosa GraphicsMagick 1.3.12 2.33% • Two Categories: John The Ripper 1.7.3.1 0.64% LAME MP3 Encoding 3.98.2 4.46% Introduction • CPU intensive OpenSSL 1.0.0a 0.55% Smallpt 1.0 0.74% Hypothesis • IO intensive Goals Results Table: CPU intensive Methods Results • CPU virtualization → Low Application Loss Dbench 4.0 1 -55.34% Conclusions overhead (avg: 1.71%) Flexible IO Tester 1.21 73.12% PostMark 1.51 -363.33% • IO virtualization → High SQLite 3.7.3 -5.37% 7-Zip Compression 9.13 6.68% overhead (avg w/o gains: 22.51%) GnuPG 1.4.10 1.26% Unpacking linux-2.6.32 35.53% • Needing further analysis: x264 2010-11-22 10.95% Compile linux-2.6.32 4.90% Cache Table: IO intensiveNuno Cardoso, Tito Vieira and Jorge G. Barbosa (Universidade do Clusters PerformanceEngenharia) Computing Infrastructure 14 / 26 Evaluation of Virtual Porto, Faculdade de on a Cloud November 4, 2011
  16. 16. Evaluation of Virtual Clusters Performance Benchmark Summary on a Cloud Computing Infrastructure Nuno Cardoso, Tito Vieira and Jorge G. Name Scope Barbosa Deployment Infrastructure Introduction Phoronix CPU/RAM, Disk IO Hypothesis Goals HPCC CPU/RAM, Network, HPC Methods Condor Infrastructure, HTC Results Distributed DBs Infrastructure, Databases Conclusions Table: Benchmark SummaryNuno Cardoso, Tito Vieira and Jorge G. Barbosa (Universidade do Clusters PerformanceEngenharia) Computing Infrastructure 15 / 26 Evaluation of Virtual Porto, Faculdade de on a Cloud November 4, 2011
  17. 17. Evaluation of Virtual Clusters Performance HPCC - Single Node on a Cloud Computing Infrastructure Setup HPL 1 Nuno 0.8 Cardoso, Tito • 8 processes PTRANS 0.6 Latency Vieira and 0.4 Jorge G. Barbosa • 1 Computer (8 cores) 0.2 Random Bandwidth Access Introduction • Several “PxQ” and “N”’s Hypothesis Goals • Virt. vs. Non-virt. FFTE DGEMM Methods Results Results STREAM VM Host Conclusions Spatial/Temporal Locality Figure: Result comparison High: Low losses Temporal (HPL: 2.2%) Low High Low Random Access FFT Spatial PTRANS HPL Low: High losses High STREAM DGEMM (RandomAccess: 35%) Table: Data LocalityNuno Cardoso, Tito Vieira and Jorge G. Barbosa (Universidade do Clusters PerformanceEngenharia) Computing Infrastructure 16 / 26 Evaluation of Virtual Porto, Faculdade de on a Cloud November 4, 2011
  18. 18. Evaluation of Virtual Clusters Performance HPCC - Multiple Nodes on a Cloud Computing Infrastructure Setup HPL 1 Nuno 0.8 Cardoso, Tito • 16 processes (2x8) PTRANS 0.6 Latency Vieira and 0.4 Jorge G. Barbosa • 2 Computer (16 cores) 0.2 Random Bandwidth Access Introduction • Several “PxQ” and “N”’s Hypothesis Goals • Virt. vs. Non-virt. FFTE DGEMM Methods Results Results STREAM VM Host Conclusions Huge impact on networking: Figure: Result comparison Latency: 563% increase Temporal Low High Bandwidth: 70% decrease Spatial Low Random Access FFT High PTRANS HPL STREAM DGEMM Table: Data LocalityNuno Cardoso, Tito Vieira and Jorge G. Barbosa (Universidade do Clusters PerformanceEngenharia) Computing Infrastructure 17 / 26 Evaluation of Virtual Porto, Faculdade de on a Cloud November 4, 2011
  19. 19. Evaluation of Virtual Clusters Performance Benchmark Summary on a Cloud Computing Infrastructure Nuno Cardoso, Tito Vieira and Jorge G. Name Scope Barbosa Deployment Infrastructure Introduction Phoronix CPU/RAM, Disk IO Hypothesis Goals HPCC CPU/RAM, Network, HPC Methods Condor Infrastructure, HTC Results Distributed DBs Infrastructure, Databases Conclusions Table: Benchmark SummaryNuno Cardoso, Tito Vieira and Jorge G. Barbosa (Universidade do Clusters PerformanceEngenharia) Computing Infrastructure 18 / 26 Evaluation of Virtual Porto, Faculdade de on a Cloud November 4, 2011
  20. 20. Evaluation of Virtual Clusters Performance Condor on a Cloud Computing Infrastructure Setup Nuno Cardoso, Tito • S1: Baseline Vieira and Jorge G. 8 VMs → 4 (Tier 1) Computers Barbosa Introduction • S2: Scalability/Resource Hypothesis exploitation Goals 8 + 15 VMs → 4 (Tier 1) + 15 (Tier 2) Computers Methods Results • S3: Elasticity/Resource exploitation Conclusions 15 VMs → 15 (Tier 3, 10a.m. until 19p.m.) Computers Figure: Multi-tier setup • Job: Subdivided into 10 minute chunks, Embarrassingly Parallel • VMs: 4 CPUs, 3GB RAMNuno Cardoso, Tito Vieira and Jorge G. Barbosa (Universidade do Clusters PerformanceEngenharia) Computing Infrastructure 19 / 26 Evaluation of Virtual Porto, Faculdade de on a Cloud November 4, 2011
  21. 21. Evaluation of Virtual Clusters Performance Condor on a Cloud Computing Infrastructure Nuno Results Cardoso, Tito Vieira and • Execution times: Jorge G. Barbosa • 1 VM: 1 month (extrapolated) • S1: 29 hours Introduction • S2: 10 hours Hypothesis • S3: 74 hours (extrapolated) Goals Methods • Nearly linear gain Results Conclusions • Possibility of using HW in both dedicated (S1 and S2) and non-dedicated (S3) fashions • Enables using unexploited (Tiers 2 and 3) HW to perform tasks with no extra expenseNuno Cardoso, Tito Vieira and Jorge G. Barbosa (Universidade do Clusters PerformanceEngenharia) Computing Infrastructure 20 / 26 Evaluation of Virtual Porto, Faculdade de on a Cloud November 4, 2011
  22. 22. Evaluation of Virtual Clusters Performance Benchmark Summary on a Cloud Computing Infrastructure Nuno Cardoso, Tito Vieira and Jorge G. Name Scope Barbosa Deployment Infrastructure Introduction Phoronix CPU/RAM, Disk IO Hypothesis Goals HPCC CPU/RAM, Network, HPC Methods Condor Infrastructure, HTC Results Distributed DBs Infrastructure, Databases Conclusions Table: Benchmark SummaryNuno Cardoso, Tito Vieira and Jorge G. Barbosa (Universidade do Clusters PerformanceEngenharia) Computing Infrastructure 21 / 26 Evaluation of Virtual Porto, Faculdade de on a Cloud November 4, 2011
  23. 23. Evaluation of Virtual Clusters Performance Distributed Databases on a Cloud Computing Infrastructure Nuno Cardoso, Tito Setup Vieira and Jorge G. • Baseline Barbosa 6 nodes (2 CPUs, 4GB RAM), 1GB data per node Introduction Hypothesis • S1: Elasticity Goals Start from baseline; add 1 node; measure latencies Methods Results • S2: Scalability Conclusions Start from baseline; scale up to 12 nodes while measuring latencies • Databases: • Riak • CassandraNuno Cardoso, Tito Vieira and Jorge G. Barbosa (Universidade do Clusters PerformanceEngenharia) Computing Infrastructure 22 / 26 Evaluation of Virtual Porto, Faculdade de on a Cloud November 4, 2011
  24. 24. Evaluation of Virtual Clusters Performance Distributed Databases on a Cloud Computing Infrastructure Results 2000 ms 1500 ms Nuno Cardoso, Tito • IO was a bottleneck 1000 ms Vieira and Jorge G. 500 ms Barbosa • S1: The Cloud introduced 0 ms elasticity in the cluster 0m 5m 10m 15m 20m 25m 30m 35m 40m 45m 50m 55m 60m Introduction Hypothesis with a transient (15 min) Cassandra Riak Goals overhead Figure: S1 Result Methods Results • S2: The cluster scaled 20 ms 19 ms Conclusions while maintaining latency 18 ms 17 ms constant (4 ms variation) 16 ms 15 ms 14 ms 13 ms 6N 7N 8N 9N 10 11 12 ode ode ode ode Nod Nod Nod s s s s es es es Cassandra Riak Figure: S2 ResultNuno Cardoso, Tito Vieira and Jorge G. Barbosa (Universidade do Clusters PerformanceEngenharia) Computing Infrastructure 23 / 26 Evaluation of Virtual Porto, Faculdade de on a Cloud November 4, 2011
  25. 25. Evaluation of Virtual Clusters Performance Conclusions on a Cloud Computing Infrastructure Nuno Cardoso, Tito Dynamic architecture enabled: Vieira and Jorge G. • Performance scaling Barbosa • Cluster duplication Introduction • Redundancy creation Hypothesis • Increase infrastructure’s capabilities by using non-specialized HW Goals Performance losses Methods Results • IO → Depends on cache’s efficiency, normally high (around 20%) Conclusions • Networking → High (Latency: 563% increase, Bandwidth: 70% decrease) • CPU → Depends on the data locality: • High → Low (≤ 5%) • Low → High (≤ 35%)Nuno Cardoso, Tito Vieira and Jorge G. Barbosa (Universidade do Clusters PerformanceEngenharia) Computing Infrastructure 24 / 26 Evaluation of Virtual Porto, Faculdade de on a Cloud November 4, 2011
  26. 26. Evaluation of Virtual Clusters Performance Future Work on a Cloud Computing Infrastructure Nuno Cardoso, Tito Vieira and Jorge G. Barbosa Introduction Evaluate other setups Hypothesis • Xen, VirtualBox, VMWare, etc. Goals • Different IO modules/configurations Methods • OpenStack, Nimbus, Eucalyptus, etc. Results ConclusionsNuno Cardoso, Tito Vieira and Jorge G. Barbosa (Universidade do Clusters PerformanceEngenharia) Computing Infrastructure 25 / 26 Evaluation of Virtual Porto, Faculdade de on a Cloud November 4, 2011
  27. 27. Evaluation of Virtual Clusters Performance Q&A on a Cloud Computing Infrastructure Nuno Cardoso, Tito Vieira and Jorge G. Barbosa Introduction Hypothesis Goals Methods ? Results ConclusionsNuno Cardoso, Tito Vieira and Jorge G. Barbosa (Universidade do Clusters PerformanceEngenharia) Computing Infrastructure 26 / 26 Evaluation of Virtual Porto, Faculdade de on a Cloud November 4, 2011
  28. 28. Evaluation of Virtual Clusters Performance Backup on a Cloud Computing Infrastructure 140 % Nuno 100 % Cardoso, Tito Vieira and 60 % Jorge G. Gain Barbosa 20 % Introduction −20 % Hypothesis −60 % Goals −100 % Methods −140 % Results 1000 2000 4000 8000 16000 32000 46336 Conclusions Problem Size VM (resources x 2) HOST (resources x 2) VM (resources x 4) HOST (resources x 4) Figure: HPL performance gain by increasing processing powerNuno Cardoso, Tito Vieira and Jorge G. Barbosa (Universidade do Clusters PerformanceEngenharia) Computing Infrastructure 27 / 26 Evaluation of Virtual Porto, Faculdade de on a Cloud November 4, 2011
  29. 29. Evaluation of Virtual Clusters Performance Backup - HPL Benchmark Results on a Cloud Computing Infrastructure (8 processes) Nuno Problem Size Cardoso, Tito PxQ 2K 4K 8K 16K 32K 46K Avg Vieira and Jorge G. 1x8 12.4 23.0 28.4 30.2 29.3 28.9 25.4 Barbosa 2x4 12.9 20.3 25.5 27.7 28.5 28.6 23.9 4x2 9.4 16.7 24.0 28.3 32.3 31.9 23.8 Introduction 8x1 11.0 12.2 20.5 30.3 36.7 38.2 24.8 Hypothesis Avg 11.4 18.0 24.6 29.1 31.7 31.9 24.5 Goals Table: VM (GFlops) Methods Results Problem Size PxQ 2K 4K 8K 16K 32K 46K Avg Conclusions 1x8 13.3 23.9 30.3 33.1 33.1 33.3 27.9 2x4 9.9 20.5 28.3 32.2 32.7 33.0 26.1 4x2 9.1 17.4 26.2 32.4 35.7 35.3 26.0 8x1 8.2 8.6 16.8 27.8 36.5 38.8 22.8 Avg 10.2 17.6 25.4 31.4 34.5 35.1 25.7 Table: Host (GFlops)Nuno Cardoso, Tito Vieira and Jorge G. Barbosa (Universidade do Clusters PerformanceEngenharia) Computing Infrastructure 28 / 26 Evaluation of Virtual Porto, Faculdade de on a Cloud November 4, 2011
  30. 30. Evaluation of Virtual Clusters Performance Backup - HPL Benchmark Results on a Cloud Computing Infrastructure (8 processes) Nuno Cardoso, Tito Vieira and Jorge G. Barbosa Problem Size Introduction PxQ 2K 4K 8K 16K 32K 46K Avg Hypothesis 1x8 7.0 3.9 6.3 8.8 11.7 13.2 9.0 2x4 -29.8 1.1 9.7 14.0 13.0 13.6 3.6 Goals 4x2 -2.5 4.2 8.2 12.6 9.6 9.7 7.0 Methods 8x1 -33.9 -41.6 -22.0 -8.9 -0.6 1.6 -17.6 Results Avg -12.4 -2.4 3.0 7.2 8.2 9.2 2.2 Conclusions Table: Performance Loss(%)Nuno Cardoso, Tito Vieira and Jorge G. Barbosa (Universidade do Clusters PerformanceEngenharia) Computing Infrastructure 29 / 26 Evaluation of Virtual Porto, Faculdade de on a Cloud November 4, 2011
  31. 31. Evaluation of Virtual Clusters Performance Backup - HPL Benchmark Results on a Cloud Computing Infrastructure (16 processes) Problem Size Nuno PxQ 2K 4K 8K 16K 32K 46K Avg Cardoso, Tito Vieira and 1x16 1.6 3.0 6.1 12.7 25.3 34.0 13.8 Jorge G. 2x8 3.5 7.3 14.8 27.7 42.3 47.0 23.8 Barbosa 4x4 5.9 14.4 28.7 41.1 50.9 54.2 32.5 8x2 7.9 13.5 26.3 43.8 59.4 65.7 36.1 Introduction 16x1 1.3 3.0 6.5 12.4 22.4 29.7 12.8 Hypothesis Avg 4.0 8.3 16.5 27.6 40.0 46.1 23.8 Goals Table: VM Results(GFlops) Methods Results Problem Size Conclusions PxQ 2K 4K 8K 16K 32K 46K Avg 1x16 3.4 6.8 14.7 28.0 43.2 50.3 24.4 2x8 5.8 13.7 26.9 44.0 55.6 58.6 34.1 4x4 5.2 15.6 35.2 51.4 61.2 63.5 38.7 8x2 7.6 11.0 24.3 44.8 63.0 69.8 36.7 16x1 3.1 6.5 11.4 21.8 37.4 46.9 21.2 Avg 5.0 10.7 22.5 38.0 52.0 57.8 31.0 Table: Host Results(GFlops)Nuno Cardoso, Tito Vieira and Jorge G. Barbosa (Universidade do Clusters PerformanceEngenharia) Computing Infrastructure 30 / 26 Evaluation of Virtual Porto, Faculdade de on a Cloud November 4, 2011
  32. 32. Evaluation of Virtual Clusters Performance Backup - HPL Benchmark Results on a Cloud Computing Infrastructure (16 processes) Nuno Cardoso, Tito Vieira and Jorge G. Barbosa Problem Size Introduction PxQ 2K 4K 8K 16K 32K 46K Avg 1x16 54.1 56.3 58.2 54.5 41.4 32.2 49.5 Hypothesis 2x8 39.4 46.5 44.9 36.9 23.9 19.6 35.2 Goals 4x4 -12.7 7.9 18.5 20.0 16.8 14.6 10.9 Methods 8x2 -4.3 -23.0 -8.1 2.2 5.6 5.9 -3.6 16x1 56.6 52.6 42.9 42.9 40.2 36.8 45.3 Results Avg 20.6 28.1 31.3 31.3 25.6 21.8 27.4 Conclusions Table: Performance Loss(%)Nuno Cardoso, Tito Vieira and Jorge G. Barbosa (Universidade do Clusters PerformanceEngenharia) Computing Infrastructure 31 / 26 Evaluation of Virtual Porto, Faculdade de on a Cloud November 4, 2011
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×