HNSciCloud PILOT PLATFORM OVERVIEW
RHEA Consortium
14 June 2018
Helix Nebula Science Cloud D-PIL-3.4 Unclassified 1
Helix Nebula Science Cloud D-PIL-3.4 Unclassified 2
Solution delivers a cost effective solution
at scale (10k, 1PB; 400k, 100 PB), with
minimal intrusion into Buyers’ sites.
Built on pure IaaS to ensure no-lock-in and
best market pricing.
Laying the foundations of the
European Open Science Cloud (EOSC)
Building an open, European platform for science
data exploitation
OUR VISION
RHEA: Prime contractor with proven management skills for
large, institutional contracts and cyber-security expertise
Exoscale: Dynamic, innovative cloud provider that has worked
with European scientific institutions like CERN
SixSq: Cloud experts that provide its expertise through the
Nuvla service running the SlipStream platform software
CYFRONET: Provides Onedata for data management and IT
services to research teams and educational institutions
CONSORTIUM
Helix Nebula Science Cloud D-PIL-3.4 Unclassified 3
Established Partnership
CHALLENGES
Provide seamless user access and security through federated identities
Support a wide range of applications
High data throughput: home institute ⬌ cloud; data source ⬌ application
Transparent data access with POSIX support
Support different data layout and access patterns
Integrate containers and container orchestration engines
… with minimum complexity!
Helix Nebula Science Cloud D-PIL-3.4 Unclassified 4
Deliver end-to-end optimized data access and analysis
COMBINED SOLUTION
Helix Nebula Science Cloud D-PIL-3.4 Unclassified 5
Complementary partners,
coherent solution,
flexible implementation…
EXOSCALE: IAAS CLOUD SERVICES
Four regions: Geneva, Frankfurt, Zurich, and Vienna
Based on Apache CloudStack
Supports CloudStack API, Libcloud, and Terraform
Browser-based portal
Easy configuration and management of virtual machines
Dashboard of compute, storage, and other resource
utilization
Géant: ramping up to aggregate 40 Gb/s bandwidth
Helix Nebula Science Cloud D-PIL-3.4 Unclassified 6
Innovative cloud service provider optimized for cloud-native applications…
NOWend April end Julyend
June
ROADMAP
June 2018
Managed Privnet
ELB
IAM lite
end August
➔VPN Gateway
➔Audit Trail
➔Custom
templates
Coming next
IPv6
Object
storage
FRA1
zone
Object
storage
VIE1 zone
Object storage
GVA-2 zone
ONEDATA: DATA MANAGEMENT
Uniform view of all shared data sets, no matter
where they are stored
Transparent access to all data sets with dynamic
migration
Support for POSIX access
Integrated with the eduGAIN and Elixir AAI
identity federations
Helix Nebula Science Cloud D-PIL-3.4 Unclassified 8
Flexible, effective data management solution built around shared “spaces”…
AUTHENTICATION & ORCHESTRATION
Full support for eduGAIN and Elixir AAI identity federations
Keycloak based implementation allows management of users,
groups, and their attributes
Nuvla
Automated deployment and dynamic management of
applications to minimize costs and maximize performance
Predefined applications: SLURM, Docker Swarm, Kubernetes, etc.
Dashboard showing cloud resource utilization
Helix Nebula Science Cloud D-PIL-3.4 Unclassified 9
Simplifies and automates management of cloud applications…
HPCAAS
Automated SLURM deployment supporting
normal and MPI jobs
Range of “Super VMs” with up to 16 vCPUs
and 128 GB of RAM.
Two profiles with available GPUs
Helix Nebula Science Cloud D-PIL-3.4 Unclassified 10
Dynamically deployed batch clusters using high-performance hardware…
GPU Profiles
vCPU 12 48
RAM 56 GB 225 GB
SSD (max.) 2 TB 8 TB
GPU Cores 3584 14336
GPU NVIDIA Tesla P100 1 4
DEMONSTRATIONS
Provisioning cloud
resources via web portal
Use of Libcloud or
Terraform with Exoscale
Managing users and
viewing resource utilization
Use of vouchers
…
Helix Nebula Science Cloud D-PIL-3.4 Unclassified 11
Exoscale Onedata Nuvla
Upload and download of
data from Onedata browser
interface
Data access from cloud
applications with Oneclient
Strategies for importing
and exporting data hosted
in your data center
…
Automated deployment of
platforms for container-
based applications
Deployment of SLURM
through browser interface
and command line
User and user attribute
management with Keycloak
…
General documentation: https://hn-docs.rtfd.io
Previous Training: https://hn-docs.readthedocs.io/en/d-pil-3.2/training/index.html

HNSciCloud PILOT PLATFORM OVERVIEW

  • 1.
    HNSciCloud PILOT PLATFORMOVERVIEW RHEA Consortium 14 June 2018 Helix Nebula Science Cloud D-PIL-3.4 Unclassified 1
  • 2.
    Helix Nebula ScienceCloud D-PIL-3.4 Unclassified 2 Solution delivers a cost effective solution at scale (10k, 1PB; 400k, 100 PB), with minimal intrusion into Buyers’ sites. Built on pure IaaS to ensure no-lock-in and best market pricing. Laying the foundations of the European Open Science Cloud (EOSC) Building an open, European platform for science data exploitation OUR VISION
  • 3.
    RHEA: Prime contractorwith proven management skills for large, institutional contracts and cyber-security expertise Exoscale: Dynamic, innovative cloud provider that has worked with European scientific institutions like CERN SixSq: Cloud experts that provide its expertise through the Nuvla service running the SlipStream platform software CYFRONET: Provides Onedata for data management and IT services to research teams and educational institutions CONSORTIUM Helix Nebula Science Cloud D-PIL-3.4 Unclassified 3 Established Partnership
  • 4.
    CHALLENGES Provide seamless useraccess and security through federated identities Support a wide range of applications High data throughput: home institute ⬌ cloud; data source ⬌ application Transparent data access with POSIX support Support different data layout and access patterns Integrate containers and container orchestration engines … with minimum complexity! Helix Nebula Science Cloud D-PIL-3.4 Unclassified 4 Deliver end-to-end optimized data access and analysis
  • 5.
    COMBINED SOLUTION Helix NebulaScience Cloud D-PIL-3.4 Unclassified 5 Complementary partners, coherent solution, flexible implementation…
  • 6.
    EXOSCALE: IAAS CLOUDSERVICES Four regions: Geneva, Frankfurt, Zurich, and Vienna Based on Apache CloudStack Supports CloudStack API, Libcloud, and Terraform Browser-based portal Easy configuration and management of virtual machines Dashboard of compute, storage, and other resource utilization Géant: ramping up to aggregate 40 Gb/s bandwidth Helix Nebula Science Cloud D-PIL-3.4 Unclassified 6 Innovative cloud service provider optimized for cloud-native applications…
  • 7.
    NOWend April endJulyend June ROADMAP June 2018 Managed Privnet ELB IAM lite end August ➔VPN Gateway ➔Audit Trail ➔Custom templates Coming next IPv6 Object storage FRA1 zone Object storage VIE1 zone Object storage GVA-2 zone
  • 8.
    ONEDATA: DATA MANAGEMENT Uniformview of all shared data sets, no matter where they are stored Transparent access to all data sets with dynamic migration Support for POSIX access Integrated with the eduGAIN and Elixir AAI identity federations Helix Nebula Science Cloud D-PIL-3.4 Unclassified 8 Flexible, effective data management solution built around shared “spaces”…
  • 9.
    AUTHENTICATION & ORCHESTRATION Fullsupport for eduGAIN and Elixir AAI identity federations Keycloak based implementation allows management of users, groups, and their attributes Nuvla Automated deployment and dynamic management of applications to minimize costs and maximize performance Predefined applications: SLURM, Docker Swarm, Kubernetes, etc. Dashboard showing cloud resource utilization Helix Nebula Science Cloud D-PIL-3.4 Unclassified 9 Simplifies and automates management of cloud applications…
  • 10.
    HPCAAS Automated SLURM deploymentsupporting normal and MPI jobs Range of “Super VMs” with up to 16 vCPUs and 128 GB of RAM. Two profiles with available GPUs Helix Nebula Science Cloud D-PIL-3.4 Unclassified 10 Dynamically deployed batch clusters using high-performance hardware… GPU Profiles vCPU 12 48 RAM 56 GB 225 GB SSD (max.) 2 TB 8 TB GPU Cores 3584 14336 GPU NVIDIA Tesla P100 1 4
  • 11.
    DEMONSTRATIONS Provisioning cloud resources viaweb portal Use of Libcloud or Terraform with Exoscale Managing users and viewing resource utilization Use of vouchers … Helix Nebula Science Cloud D-PIL-3.4 Unclassified 11 Exoscale Onedata Nuvla Upload and download of data from Onedata browser interface Data access from cloud applications with Oneclient Strategies for importing and exporting data hosted in your data center … Automated deployment of platforms for container- based applications Deployment of SLURM through browser interface and command line User and user attribute management with Keycloak … General documentation: https://hn-docs.rtfd.io Previous Training: https://hn-docs.readthedocs.io/en/d-pil-3.2/training/index.html