OpenNebulaConf2017EU: Enabling Dev and Infra teams by Lodewijk De Schuyter,Department for environment and special planning Ministry Flemish Community

•

0 likes•241 views

The document discusses enabling development and infrastructure teams at the Flemish government's Department of Environment and Spatial Planning with an OpenNebula hosting platform. It describes challenges with the previous VMware-based hosting platform, including manual server provisioning and network complexity. The new OpenNebula platform aims to provide self-service for dev teams through automation and metadata templates that declaratively define machine configurations. Over 1,100 virtual machines have been migrated to OpenNebula so far, improving agility, transparency and scale. Future plans include datacenter migration and improved support for IO-intensive applications.

Technology

Enabling Dev and Infra
with OpenNebula
@ Departement Omgeving
OpenNebulaConf Madrid, 2017 1

Agenda
• Introduction
• Previous Hosting Platform
• Challenges/Problems
• New Hosting Platform
• The Road Ahead
OpenNebulaConf Madrid, 2017 2

Introduction
• Lodewijk De Schuyter
• Middleware Developer @ Departement Omgeving since
04/2015
• ✉ lodewijk.deschuyter@vlaanderen.be
• Started Development 04/2016
OpenNebulaConf Madrid, 2017 3

Departement Omgeving
• Department of Environment and Spatial Planning
• Flemish Government
• Merger of
• Department of Environment, Nature and Energy
• Department of Spatial Planning
• Aims to create integrated environmental/planning policy
OpenNebulaConf Madrid, 2017 4

IT @ Department Omgeving
• 4 Dev Teams (30+ Devs)
• 1 Infra Team (8 FTE)
• 2 Datacenters
• Open source / Java (250+)
• Databases (150+)
• 3 environments (dev/test/prod)
• HA-setup -> Clustering
• Hosting services for other entities/agencies
➡ 1200+ virtual machines
OpenNebulaConf Madrid, 2017 5

Previous Hosting
Platform
• VMware
• Semi-manual installation of server
• Each application own VLAN (1000+)
• App. Routing using ESB (MSB) + F5
loadbalancer
• Deployment using Ansible
OpenNebulaConf Madrid, 2017 6

Challenges/Problems
• Requested Server != Actual Server
• Dependency on Infra-team
• ansible vars
• network
• creation servers
• manual intervention
• Capacity
• ESB
• Monitoring
OpenNebulaConf Madrid, 2017 7

New Hosting Platform
• Starting points/requirements
• OpenNebula + Ceph Based
• Support for Linux (Ubuntu/CentOS) & Windows
• Less complicated network setup
• Easy conﬁguration
• No manual intervention
• Self service for dev teams
• Transparency/Monitoring
• Extensible / Future Proof
• Scale further
OpenNebulaConf Madrid, 2017 8

New Hosting Platform
• Less complicated network setup
• Functional VLANS (dev/test/prod/DMZ/MGMT/...)
• Hostbased ﬁrewalling
• Support for client side loadbalancing by using service registry
• Easy conﬁguration:
• Usage of conﬁgserver
• Conﬁg is stored in subversion
• Secrets are encrypted
OpenNebulaConf Madrid, 2017 9

New Hosting Platform
• No manual intervention
• Self service for dev teams
• Transparency/Monitoring
• Extensible / Future Proof
• Scale further
➡ Automation to the rescue enter the metadata template
OpenNebulaConf Madrid, 2017 10

Metadata Template
• Declarative description of machine and its ecosystem
• Simple Yaml ﬁles stored in subversion (versioning)
• Used as input for automation tool
OpenNebulaConf Madrid, 2017 11

Metadata Template
Contains 5 Sections:
1. Project Info
2. Machine Spec
3. Software Spec
4. External Context
5. Server Context
OpenNebulaConf Madrid, 2017 12

Metadata Template
Project Info section:
• Project Information
• Bug-tracking
• Wiki
• Build Plan
• Contact Information
OpenNebulaConf Madrid, 2017 13

Metadata Template
Machine Spec section:
• Amount of RAM
• Nb of CPUs
• Firewall open ports
• SSH Access
• Wich OS
• Disks (nfs/data)
OpenNebulaConf Madrid, 2017 14

Metadata Template
Software Spec section:
• Which software to install
• Support
• Zip-assemblies
• DEB
• RPM
• Bash
• Powershell
• Ansible
OpenNebulaConf Madrid, 2017 15

Metadata Template
External Context section:
• Conﬁguration for external systems
• Support
• Zabbix Monitoring
• Amanda Backup
• PowerDNS
• f5 BIG IP
• Forward Proxy
OpenNebulaConf Madrid, 2017 16

Metadata Template
Server Context section:
• Environment speciﬁc conﬁguration
(dev/test/prod)
• LDAP
• Repositories
• NTP
• Network
• ...
OpenNebulaConf Madrid, 2017 17

Releasemanager
• Metadata template input for release process
• Release process:
• Generator phase: generates context ﬁles for subsystems
• Instantiator phase: Uses context ﬁles to provision
subsystems
OpenNebulaConf Madrid, 2017 18

UI For Dev teams
OpenNebulaConf Madrid, 2017 20

CLI For Infra team
OpenNebulaConf Madrid, 2017 21

Some Numbers
It's going fast!
• 1125 Vm's and counting
• Migration VMware stared since
08/2016
• 900+ Deployments in the last 10
days
OpenNebulaConf Madrid, 2017 22

The Road Ahead
• Datacenter Migration To New Location
• Add support for IO-intensive applications
• Deployment Pipelines
• Automate Reverse Proxies
OpenNebulaConf Madrid, 2017 23

¿ Questions ?
OpenNebulaConf Madrid, 2017 24

What's hot

CEPH DAY BERLIN - WELCOME

Ceph Community

In this talk, Rubén and Tino will lay our the novelties (not all of them, there are many!) present in 5.4, ranging from core new functionality to the big changes in vCenter. Also, the roadmap for 5.6 and future versions would be laid out, as far as it is consolidated (it won't be closed yet, but nearly so). It would also be the perfect session for feature requests, so don't miss it! YouTube: https://youtu.be/Czzm2EimayY

OpenNebulaconf2017EU: OpenNebula 5.4 and Beyond by Tino Vázquez and Ruben S. ...

OpenNebula Project

This talk shows how to setup a virtual infrastructure using OpenNebula as cloud management platform, SaltStack for configuration management and Foreman for bare-metal/ virtual host provisioning. You will see how to combine OpenNebula with bare-metal deployment on standard server hardware using non-shared storage in an environment without physical access to the hardware and no existing base infrastructure like DNS, NTP, DHCP, VPN or other. The infrastructure installation has been done automatically using public code and free Open Source software.

OpenNebula Conf 2014 | Bootstrapping a virtual infrastructure using OpenNebul...

NETWAYS

OpenNebula Conf | Lightning talk: Managing a Scientific Computing Facility wi...

NETWAYS

The platform currently runs several solutions for Earth Sciences Researchers: Developer Cloud Sandboxes for scalable scientific processors integration, Virtual Archives federating distributed data repositories, Data Challenges for Earth Observation contests, and Digital Marketplaces for reproducible scientific experiments. OpenNebula is also powering our Cloud development environment, that has been enhanced during the past year. Terradue’s Cloud development environment is both our laboratory to test the latest developments from OpenNebula, especially for the integration of our own OpenNebula extensions, and our Engineering team facility to provision servers supporting project-based software developments. OpenNebula provides the virtualization and management of hardware clusters, that we rent from commercial ‘bare-metal’ providers. We have recently further developed several specific drivers for Multi-Cloud bursting, in order to provision virtual machines over public commercial clouds. When their processor integration and validation phase concludes, our researcher users can seamlessly burst their applications at scale, leveraging OpenNebula drivers for on-demand processing tasks.

OpenNebula Conf 2014: Expanding OpenNebula´s support for Cloud Bursting - Emm...

NETWAYS

SC4 Hangout - Luigi Selmi, Transport pilot architecture

BigData_Europe

Ceph Day Santa Clara Welcome

Ceph Community

BDE SC4 Hangout - Hajira Jabeen, general architecture

BigData_Europe

We’re moving into a world of open cloud — where each organization can find the right cloud for its unique needs. A single cloud management platform can not be all things to all people, there will be a cloud space with several offerings focused on different environments and/or industries. The OpenNebula commitment to the open cloud flows directly out of its mission — to become the simplest cloud enabling platform — and its purpose — to bring simplicity to the private and hybrid enterprise cloud. OpenNebula exists to help companies build simple, cost-effective, reliable, open enterprise clouds on existing IT infrastructure. The OpenNebula Conference will be a great opportunity to remind our vision, vision and commitment, to look back at how the project has grown in the last six years, and to give a peek at what to expect from the project in the near future.

OpenNebula Conf 2014 | State and future of OpenNebula - Ignacio Llorente

NETWAYS

OpenStack Journey in Tieto Elastic Cloud

Jakub Pavlik

OpenNebula Conf: 2014 | Lightning talk: Managing Docker Containers with OpenN...

NETWAYS

OpenNebula Conf 2014 | The rOCCI project - a year later - alias OpenNebula in...

NETWAYS

Cncf storage-final-filip

Juraj Hantak

Cloud database vendors tend to report performance numbers for the sweet spot or running in highly optimized hardware with specific workload parameters. Moreover, many of these systems are not tested under different failure scenarios that may appear in the public cloud. At Netflix, as a cloud-native enterprise, our focus is on high availability. We achieve high availability by deploying at multiple regions. Hence, our data store system performance is highly affected by our global deployment model, instance types and workload patterns. Hence, we were interested in a Cloud database benchmark tool that could be deployed in a loosely-coupled fashion, as a microservice, and with the ability to dynamically change the configurations parameters at run time. In this paper, we present Netflix Data Benchmark (NDBench). NDBench offers pluggable patterns and loads and support for different client APIs. It offers the ability to deploy, manage and monitor multiple instances from a single point. NDBench was designed to run for infinite time. This nature offered us with the ability to test long-running database maintenance jobs, test database systems under conditions that affect the performance, such as compactions, repairs etc., and also gives us a view on client side issues like memory leaks and heap pressure. We have been running NDBench for almost 3 years having validated multiple database versions, tested numerous NoSQL systems running on the Cloud, and tested new functionalities. NDBench is major component of our testing and validation pipelines.

Netflix Data Benchmark @ HPTS 2017

Ioannis Papapanagiotou

SC5 Hangout2 pilot 1 description

BigData_Europe

OCCI (Open Cloud Computing Interface ) [1] is an open protocol for management tasks in the cloud environment focused on integration, portability and interoperability with a high degree of extensibility. It is designed to bridge differences between various cloud platforms (or cloud middleware) and provide common ground for users and developers alike. The rOCCI framework [2], originally developed by GWDG [3], was written to simplify the implementation of the OCCI 1.1 protocol in Ruby and later provided the base for a working client and server implementation targeting OpenNebula as its primary back-end cloud platform. The initial server-side implementation provided basic functionality and served as a proof of concept when it was adopted by the EGI Federated Cloud Task Force [4] and chosen to act as the designated VM management interface. This led to further funding from EGI-InSPIRE [5] and involvement of CESNET [6]. This talk aims to provide basic information about the OCCI protocol, introduce its implementation in rOCCI, describe and/or demonstrate some of the functionality provided by rOCCI client and rOCCI-server in concert with OpenNebula. It also briefly examines its use in the EGI FedCloud environment and explores the possibility of further integration with OpenNebula as a part of the ON ecosystem or even as an integral part of OpenNebula itself in the future. All this with interoperability in mind.

rOCCI – Providing Interoperability through OCCI 1.1 Support for OpenNebula

NETWAYS

Ryan Betts [InfluxData] | InfluxDB Platform Performance | InfluxDays Virtual ...

InfluxData

CoreOS fest 2016 Summary - DevOps BP 2016 June

Zsolt Molnar

Webinar: Building a multi-cloud Kubernetes storage on GitLab

MayaData Inc

BDE_SC4_WS3_6_Luigi Selmi - Pilot SC4

BigData_Europe

What's hot (20)

CEPH DAY BERLIN - WELCOME

OpenNebulaconf2017EU: OpenNebula 5.4 and Beyond by Tino Vázquez and Ruben S. ...

OpenNebula Conf 2014 | Bootstrapping a virtual infrastructure using OpenNebul...

OpenNebula Conf | Lightning talk: Managing a Scientific Computing Facility wi...

OpenNebula Conf 2014: Expanding OpenNebula´s support for Cloud Bursting - Emm...

SC4 Hangout - Luigi Selmi, Transport pilot architecture

Ceph Day Santa Clara Welcome

BDE SC4 Hangout - Hajira Jabeen, general architecture

OpenNebula Conf 2014 | State and future of OpenNebula - Ignacio Llorente

OpenStack Journey in Tieto Elastic Cloud

OpenNebula Conf: 2014 | Lightning talk: Managing Docker Containers with OpenN...

OpenNebula Conf 2014 | The rOCCI project - a year later - alias OpenNebula in...

Cncf storage-final-filip

Netflix Data Benchmark @ HPTS 2017

SC5 Hangout2 pilot 1 description

rOCCI – Providing Interoperability through OCCI 1.1 Support for OpenNebula

Ryan Betts [InfluxData] | InfluxDB Platform Performance | InfluxDays Virtual ...

CoreOS fest 2016 Summary - DevOps BP 2016 June

Webinar: Building a multi-cloud Kubernetes storage on GitLab

BDE_SC4_WS3_6_Luigi Selmi - Pilot SC4

Similar to OpenNebulaConf2017EU: Enabling Dev and Infra teams by Lodewijk De Schuyter,Department for environment and special planning Ministry Flemish Community

DevOps Digital Transformation: A real life use case enabled by Alien4Cloud

Cloudify Community

Team Data Science Process Presentation (TDSP), Aug 29, 2017

Debraj GuhaThakurta

Persistent identifiers in DataverseEU project

vty

Session 8 - Creating Data Processing Services | Train the Trainers Program

FIWARE

Day 13 - Creating Data Processing Services | Train the Trainers Program

FIWARE

Neo4j GraphTalk Oslo - Building Intelligent Solutions with Graphs

Neo4j

We’re moving into a world of open cloud — where each organization can find the right cloud for its unique needs. A single cloud management platform can not be all things to all people, there will be a cloud space with several offerings focused on different environments and/or industries. The OpenNebula commitment to the open cloud flows directly out of its mission — to become the simplest cloud enabling platform — and its purpose — to bring simplicity to the private and hybrid enterprise cloud. OpenNebula exists to help companies build simple, cost-effective, reliable, open enterprise clouds on existing IT infrastructure. The OpenNebula Conference will be a great opportunity to remind our vision, vision and commitment, to look back at how the project has grown in the last 8 years, and to give a peek at what to expect from the project in the near future.

OpenNebulaConf2017US: Welcome and project update by Ignacio M. Llorente and R...

OpenNebula Project

How to scale your PaaS with OVH infrastructure?

OVHcloud

Red hat infrastructure for analytics

Kyle Bader

Ross King, Project Director of SCAPE, gave a short presentation of the EU funded project SCAPE, including descriptions of tools for planning and monitoring digital preservation, scalable computation and repositories, SCAPE Testbeds and where to learn more. The presentation was given at the workshop ‘Preservation at Scale’ http://bit.ly/17ppAln in connection with the iPres2013 conference in Lissabon, Portugal, in September 2013.

SCAPE - Scalable Preservation Environments

SCAPE Project

The presentation will describe the OpenNebula project for data center virtualization, with a focus on how to deploy OpenNebula-based private clouds and its unique features to tune and adapt it to any technology in the cloud and virtualization ecosystem. The target audience are developers and IT administrators interested in deploying a private cloud solution, or in the integration of OpenNebula with other projects. The talk will be useful for both people with experience or without prior knowledge of OpenNebula, as it will start by introducing the project and its main features, along with a quick demonstration. Although this is not a hands-on tutorial, by the end of the presentation attendees will have a comprehensive idea of the integration and customization capabilities of OpenNebula in different areas, like user authentication, virtualization, storage, networking, etc.

OSDC 2013 | The OpenNebula Cloud Platform for Datacenter Virtualization by Co...

NETWAYS

Everyone needs storage, but Open Source is changing how we think about storage infrastructure through new features, added durability, and reduced cost. New storage solutions like Ceph are providing distributed, flexible, powerful options that can support a myriad of use cases across object, block, and file system applications. This talk will explore the history and basics of Ceph, the current status of the community, and where the project is headed in the near future.

Ceph, Open Source, and the Path to Ubiquity in Storage - AACS Meetup 2014

Patrick McGarry

Advanced deeplearning4j features

Adam Gibson

OpenStack Marketing Meeting Oct 2

OpenStack Foundation

FlexPod Winter Leadership Update

Michael Harding

Converged and Containerized Distributed Deep Learning With TensorFlow and Kub...

Mathieu Dumoulin

Technology Roadmap by ericnel

Eric Nelson

This is the presentation deck, I did for LimerickDotNet-Azure User group. Event Url: https://www.meetup.com/Limerick-DotNet/events/240897689/ Session Details: This session represented .NET journey of almost 17 years. Through this slid-deck, I narrated .NET platform progression till .NET Standards 2.0. This session was accompanied by a small demo of running small dotnet program on alpine linux with docker container.

Dot net platform and dotnet core fundamentals

Lalit Kale

Putting Drupal in the Cloud with Red Hat's OpenShift PaaS #DrupalCon/Prague

OpenShift Origin

You’ve moved to agile. You’re “all in” on the cloud. And yet, you know there’s a ton of velocity in your DevOps projects left on the table. Jay Lyman, Principal Analyst with 451 Research, hosts a webinar with DevOps pioneers Patrick Lightbody, SVP of Product at Delphix and Nick Suwyn, Principal Systems Engineer at Choice Hotels, to explore how DevOps teams in the global enterprise have successfully check marked code management, configuration management and build management with various industry standard tools to combat the challenges brought upon by “data friction.” Jay will unveil his latest research on the state of DevOps and share thoughts on why there’s still tremendous inertia for companies in this space.

451 Research: Data Is the Key to Friction in DevOps

Delphix

Similar to OpenNebulaConf2017EU: Enabling Dev and Infra teams by Lodewijk De Schuyter,Department for environment and special planning Ministry Flemish Community (20)

DevOps Digital Transformation: A real life use case enabled by Alien4Cloud

Team Data Science Process Presentation (TDSP), Aug 29, 2017

Persistent identifiers in DataverseEU project

Session 8 - Creating Data Processing Services | Train the Trainers Program

Day 13 - Creating Data Processing Services | Train the Trainers Program

Neo4j GraphTalk Oslo - Building Intelligent Solutions with Graphs

OpenNebulaConf2017US: Welcome and project update by Ignacio M. Llorente and R...

How to scale your PaaS with OVH infrastructure?

Red hat infrastructure for analytics

SCAPE - Scalable Preservation Environments

OSDC 2013 | The OpenNebula Cloud Platform for Datacenter Virtualization by Co...

Ceph, Open Source, and the Path to Ubiquity in Storage - AACS Meetup 2014

Advanced deeplearning4j features

OpenStack Marketing Meeting Oct 2

FlexPod Winter Leadership Update

Converged and Containerized Distributed Deep Learning With TensorFlow and Kub...

Technology Roadmap by ericnel

Dot net platform and dotnet core fundamentals

Putting Drupal in the Cloud with Red Hat's OpenShift PaaS #DrupalCon/Prague

451 Research: Data Is the Key to Friction in DevOps

More from OpenNebula Project

We've made our way into the world of open cloud — where each organization can find the right cloud for its unique needs. A single cloud management platform cannot be all things to all people. There will be a cloud space with several offerings focused on different environments and/or industries. The OpenNebula commitment to the open cloud is at the very base of its mission — to become the simplest cloud enabling platform — and its purpose — to bring simplicity to the private and hybrid enterprise cloud. OpenNebula exists to help companies build simple, cost-effective, reliable, open enterprise clouds on existing IT infrastructure. The OpenNebula Conference will be a great opportunity to communicate and share our vision and commitment, to look back at how the project has grown in the last 9 years, and to shed some insight into what to expect from the project in the near future.

OpenNebulaConf2019 - Welcome and Project Update - Ignacio M. Llorente, Rubén ...

OpenNebula Project

Computer networks are undergoing a phenomenal growth, driven by the rapidly increasing number of nodes constituting the networks. At the same time, the number of security threats on Internet and intranet networks is constantly increasing, and the testing and experimentation of cyber defense solutions require the availability of separate, test environments that best reflect the complexity of a real system. Such environments support the deployment and monitoring of complex mission-driven network scenarios, and cyber security training activities, thus enabling enterprises to study cyber defense strategies and allowing security researchers to evaluate their algorithms at scale. The main objective is delivering to researchers and practitioners an overview of the technological means and the practical steps to setup a private cloud platform based on OpenNebula for the creation and management of virtual environments that support cyber-security activities of training and testing, as well as an overview of its possible applications in the cyber security domain. In particular: 1. We describe our infrastructure based on OpenNebula 2. We overview our application, sitting on top of OpenNebula, as well as the technological tools involved in the management of its lifecycle (e.g., Ansible) . 3. We show how the platform can support various examples of security research activities  [References] Building an emulation environment for cyber security analyses of complex networked systems, Tanasache, Florin Dragos and Sorella, Mara and Bonomi, Silvia and Rapone, Raniero and Meacci, Davide, ICDCN '19, ACM, 2019

OpenNebulaConf2019 - Building Virtual Environments for Security Analyses of C...

OpenNebula Project

OpenNebulaConf2019 - CORD and Edge computing with OpenNebula - Alfonso Aureli...

OpenNebula Project

OpenNebulaConf2019 - 6 years (+) OpenNebula - Lessons learned - Sebastian Man...

OpenNebula Project

OpenNebula users have a range of storage options available to them, including proprietary appliances, proprietary software and Open Source software projects. This session will present a fully Open Source approach, that tightly integrates with Linux, and makes full use of the mature building blocks within the Linux kernel (LVM, Software RAID, DM-crypt, NVMe-oF Target, DRBD, etc...), and delivers one of the highest performance open source storage stacks currently available. The core goal is to expose the improved performance of NVMe storage devices to VMs and containers. The solution covers both local NVMe drives and NVMe-oF. For interacting with NVMe-oF targets it supports the Swordfish-API and LVM & Linux’s software NVMe-oF target. The solution contains a storage addon for OpenNebula.

OpenNebulaConf2019 - Performant and Resilient Storage the Open Source & Linux...

OpenNebula Project

OpenNebulaConf2019 - Image Backups in OpenNebula - Momčilo Medić - ITAF

OpenNebula Project

At Iguane Solutions, a lot of our "DevOps" tools are developed in Golang, and we have a good amount of experience in contributing to the Goca. I'll review just what contributions we make, as well as how we use Goca with different tools, on a daily basis, to manage and monitor our OpenNebula cloud. I will delve into the concept of Infrastructure as Code - deployment of VM instances on cloud, as well as, also address the metrics collection of deployed VMs. Finally, I will present how we can abstract VM management with automation tools thanks to GOCA.

OpenNebulaConf2019 - How We Use GOCA to Manage our OpenNebula Cloud - Jean-Ph...

OpenNebula Project

OpenNebulaConf2019 - Crytek: A Video gaming Edge Implementation "on the shoul...

OpenNebula Project

Replacing vCloud with OpenNebula

OpenNebula Project

NTS: What We Do With OpenNebula - and Why We Do It

OpenNebula Project

OpenNebula from the Perspective of an ISP

OpenNebula Project

NTS CAPTAIN / OpenNebula at Julius Blum GmbH

OpenNebula Project

Performant and Resilient Storage: The Open Source & Linux Way

OpenNebula Project

NetApp Hybrid Cloud with OpenNebula

OpenNebula Project

NSX with OpenNebula - upcoming 5.10

OpenNebula Project

Security for Private Cloud Environments

OpenNebula Project

CheckPoint R80.30 Installation on OpenNebula

OpenNebula Project

DE-CIX: CloudConnectivity

OpenNebula Project

DDC Demo

OpenNebula Project

Cloud Disaggregation with OpenNebula

OpenNebula Project

More from OpenNebula Project (20)