Provisioning the Cloud within XLCloud
Sylvain Bauza

2013/11/14
XLcloud project
http://xlcloud.org/
A three-year long collaborative project
Funded by the French FSN (Fonds national pour la Société
Numérique) programme, started early 2012
Apache 2.0 license
Members
●
●
●
●

Bull
Institut Telecom (Telecom Sud Paris)
Silkan
CEA List

Slide 2/14

●
●
●
●

EISTI
ATEME
OW2
Inria RESO
Mission statement of XLcloud

The XLcloud project strives to establish the demonstration
of a High Performance Cloud Computing (HPCC)
platform based on OpenStack that is designed to run a
representative set of compute intensive workloads
including more specifically interactive games, interactive
simulations and 3D graphic applications.

Slide 3/14
Common HPCC issues
Issues
●

●

●

●

●

Virtualization overhead (5% to 30%)
especially for I/O
Large data volume transfers

Solutions
●

HVM, LXC, bare-metal instances

●

GPU support for compute and graphics

●

Low latency / high bandwidth networks
Lack of mature management,
orchestration and monitoring features

●

Security concerns (data privacy,
authorization)

●

●

Slide 4/14

High performance full-bisection network with
traffic control
GUI & REST API (XMS) to manage and
monitor full software stacks
Strong and standard AuthN / AuthZ
protocols
Instances can be allocated on reserved,
dedicated and homogeneous HW with CPU
affinity
XLcloud interactions with OpenStack
Designed for DevOps minded users
to create and manage the life-cycle
of multi-tier middleware stacks
Vertically integrated with the
OpenStack CMS and physical infra
Advanced Identity & Access
Management integration

Slide 5/14
Walkthrough of stack creation

Slide 6/14
Deploying Openstack on baremetal
A three-step process:
Installing the OS
Installing the packages
Configuring Openstack

Various solutions :
MaaS/JuJu : Canonical
Crowbar : Suse
TripleO : Openstack On Openstack (official program, HP/RedHat)

Others...

Slide 7/14
Foreman and Puppet
Foreman
Lifecycle management tool with “Smart Proxies”
Support of pre-seed (Ubuntu), Kickstart (RHEL) config files
Puppet SmartProxy : Puppet External Node Classifier (ENC)

Puppet manifests for Openstack
Stackforge projects, one per Openstack project
Librarian-puppet for managing dependencies

Definition of HostGroups and SmartVariables for managing
configuration of our clusters

Slide 8/14
Foreman : hosts view

Slide 9/14
Foreman : Puppet integration

Slide 10/14
Provisioning the stack
Heat : should I present ?
Userdata usage with cfn-tools

Chef recipes
Chef-solo only
Synchronization/communication thanks to MCollective

Climate : A resource reservation service (0.1 by December)
Implements lease management
Plans to implement both virtual and physical resources (Vms, stacks,
compute hosts...)

TBD : Marconi for notifications, HOT software templates ?
Slide 11/14
XLcloud contributions to OpenStack
Puppet for Openstack
Climate project
Heat
Ceilometer (KWAPI)
Nova (CPU affinity, GPU)
Neutron (Infiniband)

Slide 12/14
How to contribute to OpenStack ?
https://wiki.openstack.org/wiki/How_To_Contribute
Very dynamic community with many skilled and creative people
Mailing lists and IRC channels are really important to learn, build
relationships and credibility
Don't wait for features to land, be proactive and show that you care
Test new features
Report bugs
Write documentation
Fix bugs

Slide 13/14
Thank you. Any questions ?

Provisioning the Cloud within XLCloud, Sylvain Bauza, Bull

  • 1.
    Provisioning the Cloudwithin XLCloud Sylvain Bauza 2013/11/14
  • 2.
    XLcloud project http://xlcloud.org/ A three-yearlong collaborative project Funded by the French FSN (Fonds national pour la Société Numérique) programme, started early 2012 Apache 2.0 license Members ● ● ● ● Bull Institut Telecom (Telecom Sud Paris) Silkan CEA List Slide 2/14 ● ● ● ● EISTI ATEME OW2 Inria RESO
  • 3.
    Mission statement ofXLcloud The XLcloud project strives to establish the demonstration of a High Performance Cloud Computing (HPCC) platform based on OpenStack that is designed to run a representative set of compute intensive workloads including more specifically interactive games, interactive simulations and 3D graphic applications. Slide 3/14
  • 4.
    Common HPCC issues Issues ● ● ● ● ● Virtualizationoverhead (5% to 30%) especially for I/O Large data volume transfers Solutions ● HVM, LXC, bare-metal instances ● GPU support for compute and graphics ● Low latency / high bandwidth networks Lack of mature management, orchestration and monitoring features ● Security concerns (data privacy, authorization) ● ● Slide 4/14 High performance full-bisection network with traffic control GUI & REST API (XMS) to manage and monitor full software stacks Strong and standard AuthN / AuthZ protocols Instances can be allocated on reserved, dedicated and homogeneous HW with CPU affinity
  • 5.
    XLcloud interactions withOpenStack Designed for DevOps minded users to create and manage the life-cycle of multi-tier middleware stacks Vertically integrated with the OpenStack CMS and physical infra Advanced Identity & Access Management integration Slide 5/14
  • 6.
    Walkthrough of stackcreation Slide 6/14
  • 7.
    Deploying Openstack onbaremetal A three-step process: Installing the OS Installing the packages Configuring Openstack Various solutions : MaaS/JuJu : Canonical Crowbar : Suse TripleO : Openstack On Openstack (official program, HP/RedHat) Others... Slide 7/14
  • 8.
    Foreman and Puppet Foreman Lifecyclemanagement tool with “Smart Proxies” Support of pre-seed (Ubuntu), Kickstart (RHEL) config files Puppet SmartProxy : Puppet External Node Classifier (ENC) Puppet manifests for Openstack Stackforge projects, one per Openstack project Librarian-puppet for managing dependencies Definition of HostGroups and SmartVariables for managing configuration of our clusters Slide 8/14
  • 9.
    Foreman : hostsview Slide 9/14
  • 10.
    Foreman : Puppetintegration Slide 10/14
  • 11.
    Provisioning the stack Heat: should I present ? Userdata usage with cfn-tools Chef recipes Chef-solo only Synchronization/communication thanks to MCollective Climate : A resource reservation service (0.1 by December) Implements lease management Plans to implement both virtual and physical resources (Vms, stacks, compute hosts...) TBD : Marconi for notifications, HOT software templates ? Slide 11/14
  • 12.
    XLcloud contributions toOpenStack Puppet for Openstack Climate project Heat Ceilometer (KWAPI) Nova (CPU affinity, GPU) Neutron (Infiniband) Slide 12/14
  • 13.
    How to contributeto OpenStack ? https://wiki.openstack.org/wiki/How_To_Contribute Very dynamic community with many skilled and creative people Mailing lists and IRC channels are really important to learn, build relationships and credibility Don't wait for features to land, be proactive and show that you care Test new features Report bugs Write documentation Fix bugs Slide 13/14
  • 14.
    Thank you. Anyquestions ?