Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

SURFsara Cloud - OpenNebula Tech Day 2014.03.26

SURFsara Cloud explained

  • Login to see the comments

  • Be the first to like this

SURFsara Cloud - OpenNebula Tech Day 2014.03.26

  1. 1. — experiences with OpenNebula 3.X HPC Cloud at SURFsara Ander Astudillo <ander.astudillo@surfsara.nl> Lykle Voort <lykle.voort@surfsara.nl> OpenNebula Tech Day Ede (The Netherlands) 26th March 2014 #
  2. 2. e-Infrastructure landscape 3 Cartesius (National Supercomputer) Bull bullx, 13984 cores, 41.75 TB memory, 2.4 PB disk, 271 TFlop/s LISA (National compute cluster) Dell cluster, 6528 cores, 16 TB of memory, 46 TFlop/s Grid 5000 cores, 4 PB disk, 6 PB tape 11 sites Visualization Collaboratorium Remote visualization Render cluster Network SURFnet7 GLIF NetherLight Innovative infrastructures Hadoop GPU cluster BeeHub HPC Cloud
  3. 3. Agenda 1.- SURFsara’s HPC Cloud service 2.- User experience 3.- SURFsara’s HPC Cloud implementation
  4. 4. What do we (SURFsara) want to offer? 5 Services for scientists …scientists ⇏ systems gurus … complex users’ problems • Data: big, dirty, non-structured… • Computation: complex (e.g.: modeling, simulation) • Libraries nightmare • 3rd party, incompatibility, maintenance… … flexibility … trial and error … test … cooperate … share … show … scratch … privacy 1.- Our service
  5. 5. Where does the HPC Cloud fit? 61.- Our service
  6. 6. What does our HPC Cloud offer? 7 Your own world In a jar 1.- Our service IaaS: Network filter
  7. 7. What does a user see? 81.- Our service
  8. 8. User experience
  9. 9. Our decisions 102.- User experience HPC • Big nodes • Fast interconnect • MPI-alike computation • Own flexibility Cloud light • Smaller nodes • CPU overcommit • (Interactive) services • Projects • Documentation • System load • Network filters • Dynamic DNS • VirDir • Image upload • Wizard tweaks
  10. 10. Accounting 112.- User experience Per project User accounts CPU time Images storage VirDir
  11. 11. Accounting (& figures) 122.- User experience Per project User accounts CPU time Images storage VirDir 180+ projects active: 110+ 370+ users active: 240+ Since 2009 until March 2014: 300+ requests 32.000+ VM 130+ TB in use 850+ years 3.700+ images
  12. 12. User applications 132.- User experience • Profit from cloud elasticity • Provide own service to own users • Software that requires licenses • Workflows • Training • Intensive compute Fields: • Biology • Genetics • Informatics • Chemistry • Ecology • Linguistics • Robotics • Business • Social sciences • Engineering • Humanities
  13. 13. User applications 142.- User experience • High-memory nodes • Database as a Service Experimental additions:
  14. 14. SURFsara’s HPC Cloud implementation
  15. 15. Hardware 163.- Implementation 30 HPC nodes 19× 32-core Intel Xeon-E7 11× 32-core Intel Xeon-E5 256 GB RAM 1 TByte local disk Ethernet 2×10GE Each new HPC node delivers 12K SPECints under ideal circumstances 10 light nodes 8 cores AMD Opteron 6212 64 GB RAM 6 TByte local disk Ethernet 1×10GE Network 144 ports 10GE, 1-hop Storage 800TB shared (Arista DCS-7504)
  16. 16. 800TB Shared Storage 2×10Gbps 4 Service Nodes Virtualised Services 30 large compute nodes .... .. 10 light compute nodes Network overview 3.- Implementation 4×10Gbps
  17. 17. Software 3.- Implementation
  18. 18. Groups’ network isolation 3.- Implementation
  19. 19. The good 3.- Implementation • Live migration • HUGE disks possible • Security • Ease of use
  20. 20. Ander Astudillo <ander.astudillo@surfsara.nl> Lykle Voort <lykle.voort@surfsara.nl> Credits Images: Wikipedia, Science Park Front slide photo: dvanzuijlekom in Flicker Slides: SURFsara colleagues

×