Your SlideShare is downloading. ×
SURFsara Cloud - OpenNebula Tech Day 2014.03.26
Upcoming SlideShare
Loading in...5
×

Thanks for flagging this SlideShare!

Oops! An error has occurred.

×

Saving this for later?

Get the SlideShare app to save on your phone or tablet. Read anywhere, anytime - even offline.

Text the download link to your phone

Standard text messaging rates apply

SURFsara Cloud - OpenNebula Tech Day 2014.03.26

356
views

Published on

SURFsara Cloud explained

SURFsara Cloud explained

Published in: Technology

0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
356
On Slideshare
0
From Embeds
0
Number of Embeds
3
Actions
Shares
0
Downloads
18
Comments
0
Likes
0
Embeds 0
No embeds

Report content
Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
No notes for slide

Transcript

  • 1. — experiences with OpenNebula 3.X HPC Cloud at SURFsara Ander Astudillo <ander.astudillo@surfsara.nl> Lykle Voort <lykle.voort@surfsara.nl> OpenNebula Tech Day Ede (The Netherlands) 26th March 2014 #
  • 2. e-Infrastructure landscape 3 Cartesius (National Supercomputer) Bull bullx, 13984 cores, 41.75 TB memory, 2.4 PB disk, 271 TFlop/s LISA (National compute cluster) Dell cluster, 6528 cores, 16 TB of memory, 46 TFlop/s Grid 5000 cores, 4 PB disk, 6 PB tape 11 sites Visualization Collaboratorium Remote visualization Render cluster Network SURFnet7 GLIF NetherLight Innovative infrastructures Hadoop GPU cluster BeeHub HPC Cloud
  • 3. Agenda 1.- SURFsara’s HPC Cloud service 2.- User experience 3.- SURFsara’s HPC Cloud implementation
  • 4. What do we (SURFsara) want to offer? 5 Services for scientists …scientists ⇏ systems gurus … complex users’ problems • Data: big, dirty, non-structured… • Computation: complex (e.g.: modeling, simulation) • Libraries nightmare • 3rd party, incompatibility, maintenance… … flexibility … trial and error … test … cooperate … share … show … scratch … privacy 1.- Our service
  • 5. Where does the HPC Cloud fit? 61.- Our service
  • 6. What does our HPC Cloud offer? 7 Your own world In a jar 1.- Our service IaaS: Network filter
  • 7. What does a user see? 81.- Our service
  • 8. User experience
  • 9. Our decisions 102.- User experience HPC • Big nodes • Fast interconnect • MPI-alike computation • Own flexibility Cloud light • Smaller nodes • CPU overcommit • (Interactive) services • Projects • Documentation • System load • Network filters • Dynamic DNS • VirDir • Image upload • Wizard tweaks
  • 10. Accounting 112.- User experience Per project User accounts CPU time Images storage VirDir
  • 11. Accounting (& figures) 122.- User experience Per project User accounts CPU time Images storage VirDir 180+ projects active: 110+ 370+ users active: 240+ Since 2009 until March 2014: 300+ requests 32.000+ VM 130+ TB in use 850+ years 3.700+ images
  • 12. User applications 132.- User experience • Profit from cloud elasticity • Provide own service to own users • Software that requires licenses • Workflows • Training • Intensive compute Fields: • Biology • Genetics • Informatics • Chemistry • Ecology • Linguistics • Robotics • Business • Social sciences • Engineering • Humanities
  • 13. User applications 142.- User experience • High-memory nodes • Database as a Service Experimental additions:
  • 14. SURFsara’s HPC Cloud implementation
  • 15. Hardware 163.- Implementation 30 HPC nodes 19× 32-core Intel Xeon-E7 11× 32-core Intel Xeon-E5 256 GB RAM 1 TByte local disk Ethernet 2×10GE Each new HPC node delivers 12K SPECints under ideal circumstances 10 light nodes 8 cores AMD Opteron 6212 64 GB RAM 6 TByte local disk Ethernet 1×10GE Network 144 ports 10GE, 1-hop Storage 800TB shared (Arista DCS-7504)
  • 16. 800TB Shared Storage 2×10Gbps 4 Service Nodes Virtualised Services 30 large compute nodes .... .. 10 light compute nodes Network overview 3.- Implementation 4×10Gbps
  • 17. Software 3.- Implementation
  • 18. Groups’ network isolation 3.- Implementation
  • 19. The good 3.- Implementation • Live migration • HUGE disks possible • Security • Ease of use
  • 20. Ander Astudillo <ander.astudillo@surfsara.nl> Lykle Voort <lykle.voort@surfsara.nl> Credits Images: Wikipedia, Science Park Front slide photo: dvanzuijlekom in Flicker Slides: SURFsara colleagues