Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
Migration of a computation cluster to Debian                    Julien Cristau              julien.cristau@logilab.fr     ...
Outline   Context   Hardware   Existing software   Solution                       0/5
Context   Institut de G´n´tique et Microbiologie (IGM):                e e       joint lab, CNRS & Universit´ Paris Sud   ...
Hardware  Existing:       10 compute nodes       1 frontend       1 separate assembly node       (lots of RAM and storage)...
Existing software       Based on RHEL5       Sun Grid Engine (SGE) batch scheduler       No shared storage       No centra...
Solution                      KVM host                       WEB                       Galaxy                            C...
Solution (2)       One storage node using ZFS on Linux       VM hosts for all services: provisioning, monitoring, frontend...
Upcoming SlideShare
Loading in …5
×

Migration of a computation cluster to Debian

979 views

Published on

Julien Cristau -
Migration of a computation cluster to Debian at minidebconf Paris 2012 http://fr2012.mini.debconf.org/

Published in: Technology
  • Be the first to comment

  • Be the first to like this

Migration of a computation cluster to Debian

  1. 1. Migration of a computation cluster to Debian Julien Cristau julien.cristau@logilab.fr November 25th, 2012 Mini-Debconf Paris 2012
  2. 2. Outline Context Hardware Existing software Solution 0/5
  3. 3. Context Institut de G´n´tique et Microbiologie (IGM): e e joint lab, CNRS & Universit´ Paris Sud e cluster part of the eBio platform, providing resources for scientists Logilab: software services python specialist, Debian-based scientific computing / simulation 1/5
  4. 4. Hardware Existing: 10 compute nodes 1 frontend 1 separate assembly node (lots of RAM and storage) 24-port 1Gb ethernet switch New: 2 hosts for virtualization and storage 2 more storage bays 2/5
  5. 5. Existing software Based on RHEL5 Sun Grid Engine (SGE) batch scheduler No shared storage No central management 3/5
  6. 6. Solution KVM host WEB Galaxy Compute Node Ganglia/Munin Compute Node Master Public network Condor/OAR/SGE Compute Node Provision. DHCP/tFTP/PXE/FAI Compute Node Salt Storage NFS ZFS Compute Node* ADMIN for BLAST assembly SAS SAN SAS SAS SAS SAS CLUSTER 4/5
  7. 7. Solution (2) One storage node using ZFS on Linux VM hosts for all services: provisioning, monitoring, frontend (submission host), databases, web server, . . . Nodes reinstalled with FAI (http://www.fai-project.org/) Configuration/deployment with Salt (http://www.saltstack.org/) 5/5

×