Slides from our Q3 meetup held in Montreal on September 27th 2017 at the Cloud.ca Center.
Video recording can be seen at: https://www.youtube.com/watch?v=_1btwHW39ms&list=PLSsQodeQD6LPyqrvvczcC5mkOOnPt469o
CERN is the home of the Large Hadron Collider (LHC), a 27km circular proton accelerator generating tens of petabytes of new data every year. Data is stored and processed using a large amount of resources totaling over 250.000 cores and 1000s of storage servers, managed by OpenStack.
Networking is a critical part of our infrastructure and arguably the hardest to evolve. Given the size of CERN’s infrastructure, its flat network is partitioned in segments each representing a separate broadcast domain and potentially offering different levels of service. This fragmentation improves scalability and reduces the impact of misbehaving systems in the datacentre to individual segments. On the other hand, having multiple broadcast domains means features like floating and virtual IPs are much harder to offer.
We will tell the story of OpenStack Networking at CERN. First integration with Nova Network, the migration to Neutron and how we're adding SDN in our infrastructure.
CERN, the European Organization for Nuclear Research, is one of the world’s largest centres for scientific research. Its business is fundamental physics, finding out what the universe is made of and how it works. At CERN, accelerators such as the 27km Large Hadron Collider, are used to study the basic constituents of matter. This talk reviews the challenges to record and analyse the 25 Petabytes/year produced by the experiments and the investigations into how OpenStack could help to deliver a more agile computing infrastructure.
Slides from our Q3 meetup held in Montreal on September 27th 2017 at the Cloud.ca Center.
Video recording can be seen at: https://www.youtube.com/watch?v=_1btwHW39ms&list=PLSsQodeQD6LPyqrvvczcC5mkOOnPt469o
CERN is the home of the Large Hadron Collider (LHC), a 27km circular proton accelerator generating tens of petabytes of new data every year. Data is stored and processed using a large amount of resources totaling over 250.000 cores and 1000s of storage servers, managed by OpenStack.
Networking is a critical part of our infrastructure and arguably the hardest to evolve. Given the size of CERN’s infrastructure, its flat network is partitioned in segments each representing a separate broadcast domain and potentially offering different levels of service. This fragmentation improves scalability and reduces the impact of misbehaving systems in the datacentre to individual segments. On the other hand, having multiple broadcast domains means features like floating and virtual IPs are much harder to offer.
We will tell the story of OpenStack Networking at CERN. First integration with Nova Network, the migration to Neutron and how we're adding SDN in our infrastructure.
CERN, the European Organization for Nuclear Research, is one of the world’s largest centres for scientific research. Its business is fundamental physics, finding out what the universe is made of and how it works. At CERN, accelerators such as the 27km Large Hadron Collider, are used to study the basic constituents of matter. This talk reviews the challenges to record and analyse the 25 Petabytes/year produced by the experiments and the investigations into how OpenStack could help to deliver a more agile computing infrastructure.
CERN, the European Organization for Nuclear Research, is running for several years a large OpenStack Cloud that helps thousands of scientists to analyze the data from the LHC.
In 2012, early in the design phase of the CERN Cloud we decided to use Nova Cells to enable the infrastructure to scale to thousands of nodes. Now with more than 280K cores spread across 70 cells that are hosted in two data centres we were faced with the challenge to migrate to Nova Cells V2 required in the Pike release.
In this presentation, we will describe how Nova Cells allowed CERN to scale to thousands of nodes, its advantages and how we mitigate the implementation issues of Nova Cells V1. Next, we will cover how we upgraded Nova from Newton with Cells V1 to Pike with Cells V2. We will explain the steps that we followed and the issues that we faced during the upgrade. Finally, we will report our experience with Cells V2 at scale, its caveats and how we are mitigate them.
What can I expect to learn?
This presentation describes how CERN migrated from Cells V1 to Cells V2 when upgraded from Newton to Pike release.
You will learn the procedures followed by CERN in order to migrate Cells V1 to Cells V2 in a large production environment.
The issues found during the upgrade and how we mitigate them will be discussed.
Also, we will present how Cells V2 behaves in a large scale deployment with serveral thounsands nodes in 70 cells.
10 Years of OpenStack at CERN - From 0 to 300k coresBelmiro Moreira
CERN, the European Laboratory for Particle Physics, provides the infrastructure and resources to thousands of scientists all around the world to uncover the mysteries of the Universe. In the quest to build a private Cloud Infrastructure to support its users, CERN started early evaluating the OpenStack project, building several prototypes and engaging with the community. Finally, in 2013 CERN released its production Cloud Infrastructure using OpenStack. Since then we moved from a few hundred cores to a multi-cell deployment spread between different regions. After 7 years deploying and managing OpenStack in production at a large scale, we now look back and discuss the challenges of building a massive scale infrastructure from 0 to +300K cores. In this talk we will dive into the history, architecture, tools and technical decisions behind the CERN Cloud Infrastructure over the years.
OSDC 2013 | Tutorial and demonstration of failover from EC2 to OpenStack usin...NETWAYS
Sudden Cloud outages seem to happen every few months, with no major Cloud company successfully preventing them.
Each time, well known companies and websites who should know better are caught out. The cost is time, money, reputation, and trust.
This OSDC presentation will show how to stay up when Amazon's EC2 goes down. The setup and deployment of Linux applications to EC2 will be demonstrated using Aeolus, and then you will learn how to fail them over to a public OpenStack cloud when trouble strikes -- quickly and with minimal impact.
This presentation will be of _serious interest_ to everyone who needs their public cloud applications (running on Linux) to be resilient to cloud outages.
OpenShift Commons Briefing: Ask Me Anything about Cinder and GlanceBrian Rosmaita
Overview and update on the OpenStack Cinder and Glance projects, including a discussion of upstream OpenStack development, Cinder third-party backend drivers, and how these impact OpenShift.
Quick update of the OpenStack Cinder project, but mostly a discussion of open source software development opportunities working with the OpenStack Block Storage service. Presented at the OpenInfra Q3 Meetup in China on 26 September 2020.
CERN, the European Organization for Nuclear Research, is running for several years a large OpenStack Cloud that helps thousands of scientists to analyze the data from the LHC.
In 2012, early in the design phase of the CERN Cloud we decided to use Nova Cells to enable the infrastructure to scale to thousands of nodes. Now with more than 280K cores spread across 70 cells that are hosted in two data centres we were faced with the challenge to migrate to Nova Cells V2 required in the Pike release.
In this presentation, we will describe how Nova Cells allowed CERN to scale to thousands of nodes, its advantages and how we mitigate the implementation issues of Nova Cells V1. Next, we will cover how we upgraded Nova from Newton with Cells V1 to Pike with Cells V2. We will explain the steps that we followed and the issues that we faced during the upgrade. Finally, we will report our experience with Cells V2 at scale, its caveats and how we are mitigate them.
What can I expect to learn?
This presentation describes how CERN migrated from Cells V1 to Cells V2 when upgraded from Newton to Pike release.
You will learn the procedures followed by CERN in order to migrate Cells V1 to Cells V2 in a large production environment.
The issues found during the upgrade and how we mitigate them will be discussed.
Also, we will present how Cells V2 behaves in a large scale deployment with serveral thounsands nodes in 70 cells.
10 Years of OpenStack at CERN - From 0 to 300k coresBelmiro Moreira
CERN, the European Laboratory for Particle Physics, provides the infrastructure and resources to thousands of scientists all around the world to uncover the mysteries of the Universe. In the quest to build a private Cloud Infrastructure to support its users, CERN started early evaluating the OpenStack project, building several prototypes and engaging with the community. Finally, in 2013 CERN released its production Cloud Infrastructure using OpenStack. Since then we moved from a few hundred cores to a multi-cell deployment spread between different regions. After 7 years deploying and managing OpenStack in production at a large scale, we now look back and discuss the challenges of building a massive scale infrastructure from 0 to +300K cores. In this talk we will dive into the history, architecture, tools and technical decisions behind the CERN Cloud Infrastructure over the years.
OSDC 2013 | Tutorial and demonstration of failover from EC2 to OpenStack usin...NETWAYS
Sudden Cloud outages seem to happen every few months, with no major Cloud company successfully preventing them.
Each time, well known companies and websites who should know better are caught out. The cost is time, money, reputation, and trust.
This OSDC presentation will show how to stay up when Amazon's EC2 goes down. The setup and deployment of Linux applications to EC2 will be demonstrated using Aeolus, and then you will learn how to fail them over to a public OpenStack cloud when trouble strikes -- quickly and with minimal impact.
This presentation will be of _serious interest_ to everyone who needs their public cloud applications (running on Linux) to be resilient to cloud outages.
OpenShift Commons Briefing: Ask Me Anything about Cinder and GlanceBrian Rosmaita
Overview and update on the OpenStack Cinder and Glance projects, including a discussion of upstream OpenStack development, Cinder third-party backend drivers, and how these impact OpenShift.
Quick update of the OpenStack Cinder project, but mostly a discussion of open source software development opportunities working with the OpenStack Block Storage service. Presented at the OpenInfra Q3 Meetup in China on 26 September 2020.
This was an intro I gave to create awareness with the Telco and enterprise community in Pakistan. The idea was to bootstrap this with an effort to create workshop content that will be created with collaboration from within Plumgrid (time /resource wise) and PTA as well as Govt. of Pakistan.
PSOCLD-1006 Cisco Cloud Architectures on OpenStack - Cisco Live! US 2015 San ...Rohit Agarwalla
OpenStack solutions have revolutionized economics, flexibility and scalability for the cloud. Hear how Cisco innovations like Application Centric Infrastructure and Intercloud Fabric bring unparalleled efficiency to OpenStack private cloud deployments. Attendees will be introduced to Cisco Validated Designs for deploying Red Hat Enterprise Linux OpenStack Platform. This session will cover Cisco OpenStack strategy, architecture and solutions. It will discuss in detail about the Cisco integration, innovations and differentiation for OpenStack. In addition, it will cover the architecture for both private and public cloud offerings. It will also cover the key Cisco partnerships, offerings and UCS bundles to help accelerate this solution.
KubeCon EU 2016: What is OpenStack's role in a Kubernetes world?KubeAcademy
OpenStack is a global open collaboration to produce an open source infrastructure stack. Since its creation 5 years ago, it moved from an open source compute / object storage IaaS solution to about 30 projects providing programmable infrastructure building blocks. How does this project fit in a container-driven future ? How complementary is it with Kubernetes ? In this talk, Thierry Carrez will detail the long-term vision for OpenStack: infrastructure for a programmable infrastructure world and an integration engine for future infrastructure technologies.
Sched Link: http://sched.co/6BYC
stackconf 2021 | Why you should take care of infrastructure driftNETWAYS
As infrastructure as code (IaC) becomes widely adopted by users with heterogenous skillsets, and as IaC codebases become larger and larger, it becomes harder to track drift. Drift is a deviation between the actual infrastructure state and the IaC codebase. It causes issues for security posture management, collaborative work, and maintenance. There are a lot of juicy stories from the trenches to be told on infrastructure drift. Sure enough, we all do GitOps by the book! Or we all have the right processes in place. But we also have to interact with other teams. We also have to grant some level of access to our infrastructures to some services or tools that may eventually generate uncontrolled changes. You can’t efficiently improve what you don’t track. We track coverage for unit tests, why not infrastructure as code coverage? How can we make sure our infrastructure code matches our actual infrastructure state? In this talk, using Terraform with AWS resources, I will show how infrastructure drift can go undetected despite our best efforts or tooling and cause issues and end the talk by showing our own free and open source tool driftctl, (just released under Apache-2.0 licence) that tracks IaC coverage and warns of infrastructure drift.
Latinoware 2013 - OpenStack RDO - A walkthrough by the Open Source Cloud Comp...Luan Cestari
In this lecture will show an introduction to OpenStack, starting with the basic concepts of Cloud, keywords, what Openstack project is, the use cases, history, the project overview, features, tools and roadmap. The following topics will be covered:
* Introduction to Cloud Computing (Keyword such: Virtualization; Iaas, Paas, Saas; Public/Private/Hybrid/Community Cloud; Concepts: scalability, elasticity , provisioning,
self-service, multi tenant, billing, etc)
* What is OpenStack?
* Who are using it?
* History, Releases/Versions and Evolution
* Architecture
* Sub-projects (Keystone, Glance, Nova, Openstack Networking/Quantum/Neutron, Cinder,
Swift, Horizon, Ceilometer, Heat, Oslo, Marconi, etc)
* Tools
* Next Releases
* Who helps and distributions (RDO, StackOps, Devstack, Dell OpenStack, etc)
Quantum - Virtual networks for Openstacksalv_orlando
An overview of Quantum, the soon-to-be default Openstack network service.
These slides introduce Quantum, its design goals, and discusses the API. It also tries to address how quantum relates to Software Defined Networking (SDN)
Introduction and Overview of OpenStack for IaaSKeith Basil
These slides supported a presentation at the 2013 Red Hat Summit.
It covers:
✦ Introduction to OpenStack
✦ OpenStack Architecture
✦ Understanding the Elastic Cloud
✦ OpenStack in the Real World
This presentation is a basic overview of the OpenStack Cloud. It was presented on September 23, 2015 in Orlando Florida at the Downtown UCF Incubation Office. The session provides a hi level overview of the OpenStack and a list of training resources to get up to speed on OpenStack.
Similar to Getting Started with OpenStack from Hong Kong Summit Session November 5 (20)
LPI Webinar: Accelerating Your Career with OpenStackNiki Acosta
LPI Webinar: Accelerating Your Career with OpenStack geared for Linux professionals wanting to take the next step in their careers. Questions? @nikiacosta or @scottsanchez
Accelerate your Kubernetes clusters with Varnish CachingThijs Feryn
A presentation about the usage and availability of Varnish on Kubernetes. This talk explores the capabilities of Varnish caching and shows how to use the Varnish Helm chart to deploy it to Kubernetes.
This presentation was delivered at K8SUG Singapore. See https://feryn.eu/presentations/accelerate-your-kubernetes-clusters-with-varnish-caching-k8sug-singapore-28-2024 for more details.
Generating a custom Ruby SDK for your web service or Rails API using Smithyg2nightmarescribd
Have you ever wanted a Ruby client API to communicate with your web service? Smithy is a protocol-agnostic language for defining services and SDKs. Smithy Ruby is an implementation of Smithy that generates a Ruby SDK using a Smithy model. In this talk, we will explore Smithy and Smithy Ruby to learn how to generate custom feature-rich SDKs that can communicate with any web service, such as a Rails JSON API.
Transcript: Selling digital books in 2024: Insights from industry leaders - T...BookNet Canada
The publishing industry has been selling digital audiobooks and ebooks for over a decade and has found its groove. What’s changed? What has stayed the same? Where do we go from here? Join a group of leading sales peers from across the industry for a conversation about the lessons learned since the popularization of digital books, best practices, digital book supply chain management, and more.
Link to video recording: https://bnctechforum.ca/sessions/selling-digital-books-in-2024-insights-from-industry-leaders/
Presented by BookNet Canada on May 28, 2024, with support from the Department of Canadian Heritage.
Essentials of Automations: Optimizing FME Workflows with ParametersSafe Software
Are you looking to streamline your workflows and boost your projects’ efficiency? Do you find yourself searching for ways to add flexibility and control over your FME workflows? If so, you’re in the right place.
Join us for an insightful dive into the world of FME parameters, a critical element in optimizing workflow efficiency. This webinar marks the beginning of our three-part “Essentials of Automation” series. This first webinar is designed to equip you with the knowledge and skills to utilize parameters effectively: enhancing the flexibility, maintainability, and user control of your FME projects.
Here’s what you’ll gain:
- Essentials of FME Parameters: Understand the pivotal role of parameters, including Reader/Writer, Transformer, User, and FME Flow categories. Discover how they are the key to unlocking automation and optimization within your workflows.
- Practical Applications in FME Form: Delve into key user parameter types including choice, connections, and file URLs. Allow users to control how a workflow runs, making your workflows more reusable. Learn to import values and deliver the best user experience for your workflows while enhancing accuracy.
- Optimization Strategies in FME Flow: Explore the creation and strategic deployment of parameters in FME Flow, including the use of deployment and geometry parameters, to maximize workflow efficiency.
- Pro Tips for Success: Gain insights on parameterizing connections and leveraging new features like Conditional Visibility for clarity and simplicity.
We’ll wrap up with a glimpse into future webinars, followed by a Q&A session to address your specific questions surrounding this topic.
Don’t miss this opportunity to elevate your FME expertise and drive your projects to new heights of efficiency.
Connector Corner: Automate dynamic content and events by pushing a buttonDianaGray10
Here is something new! In our next Connector Corner webinar, we will demonstrate how you can use a single workflow to:
Create a campaign using Mailchimp with merge tags/fields
Send an interactive Slack channel message (using buttons)
Have the message received by managers and peers along with a test email for review
But there’s more:
In a second workflow supporting the same use case, you’ll see:
Your campaign sent to target colleagues for approval
If the “Approve” button is clicked, a Jira/Zendesk ticket is created for the marketing design team
But—if the “Reject” button is pushed, colleagues will be alerted via Slack message
Join us to learn more about this new, human-in-the-loop capability, brought to you by Integration Service connectors.
And...
Speakers:
Akshay Agnihotri, Product Manager
Charlie Greenberg, Host
Securing your Kubernetes cluster_ a step-by-step guide to success !KatiaHIMEUR1
Today, after several years of existence, an extremely active community and an ultra-dynamic ecosystem, Kubernetes has established itself as the de facto standard in container orchestration. Thanks to a wide range of managed services, it has never been so easy to set up a ready-to-use Kubernetes cluster.
However, this ease of use means that the subject of security in Kubernetes is often left for later, or even neglected. This exposes companies to significant risks.
In this talk, I'll show you step-by-step how to secure your Kubernetes cluster for greater peace of mind and reliability.
JMeter webinar - integration with InfluxDB and GrafanaRTTS
Watch this recorded webinar about real-time monitoring of application performance. See how to integrate Apache JMeter, the open-source leader in performance testing, with InfluxDB, the open-source time-series database, and Grafana, the open-source analytics and visualization application.
In this webinar, we will review the benefits of leveraging InfluxDB and Grafana when executing load tests and demonstrate how these tools are used to visualize performance metrics.
Length: 30 minutes
Session Overview
-------------------------------------------
During this webinar, we will cover the following topics while demonstrating the integrations of JMeter, InfluxDB and Grafana:
- What out-of-the-box solutions are available for real-time monitoring JMeter tests?
- What are the benefits of integrating InfluxDB and Grafana into the load testing stack?
- Which features are provided by Grafana?
- Demonstration of InfluxDB and Grafana using a practice web application
To view the webinar recording, go to:
https://www.rttsweb.com/jmeter-integration-webinar
DevOps and Testing slides at DASA ConnectKari Kakkonen
My and Rik Marselis slides at 30.5.2024 DASA Connect conference. We discuss about what is testing, then what is agile testing and finally what is Testing in DevOps. Finally we had lovely workshop with the participants trying to find out different ways to think about quality and testing in different parts of the DevOps infinity loop.
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...DanBrown980551
Do you want to learn how to model and simulate an electrical network from scratch in under an hour?
Then welcome to this PowSyBl workshop, hosted by Rte, the French Transmission System Operator (TSO)!
During the webinar, you will discover the PowSyBl ecosystem as well as handle and study an electrical network through an interactive Python notebook.
PowSyBl is an open source project hosted by LF Energy, which offers a comprehensive set of features for electrical grid modelling and simulation. Among other advanced features, PowSyBl provides:
- A fully editable and extendable library for grid component modelling;
- Visualization tools to display your network;
- Grid simulation tools, such as power flows, security analyses (with or without remedial actions) and sensitivity analyses;
The framework is mostly written in Java, with a Python binding so that Python developers can access PowSyBl functionalities as well.
What you will learn during the webinar:
- For beginners: discover PowSyBl's functionalities through a quick general presentation and the notebook, without needing any expert coding skills;
- For advanced developers: master the skills to efficiently apply PowSyBl functionalities to your real-world scenarios.
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...Jeffrey Haguewood
Sidekick Solutions uses Bonterra Impact Management (fka Social Solutions Apricot) and automation solutions to integrate data for business workflows.
We believe integration and automation are essential to user experience and the promise of efficient work through technology. Automation is the critical ingredient to realizing that full vision. We develop integration products and services for Bonterra Case Management software to support the deployment of automations for a variety of use cases.
This video focuses on the notifications, alerts, and approval requests using Slack for Bonterra Impact Management. The solutions covered in this webinar can also be deployed for Microsoft Teams.
Interested in deploying notification automations for Bonterra Impact Management? Contact us at sales@sidekicksolutionsllc.com to discuss next steps.
Key Trends Shaping the Future of Infrastructure.pdfCheryl Hung
Keynote at DIGIT West Expo, Glasgow on 29 May 2024.
Cheryl Hung, ochery.com
Sr Director, Infrastructure Ecosystem, Arm.
The key trends across hardware, cloud and open-source; exploring how these areas are likely to mature and develop over the short and long-term, and then considering how organisations can position themselves to adapt and thrive.
38. 38
Reading About OpenStack
The OpenStack Foundation
http://www.openstack.org/
Official OpenStack Documentation
http://docs.openstack.org/
The OpenStack Cloud Computing Cookbook (Second Edition)
http://www.amazon.com/OpenStack-Cloud-Computing-Cookbook-Jackson/dp/1782167
1
39. 39
Trying Out OpenStack
TryStack (OpenStack Sandbox)
http://trystack.org/
OpenStack-based Public Clouds
•DreamHost
http://dreamhost.com/cloud/
•HP Public Cloud
https://www.hpcloud.com/
•Rackspace Public Cloud
http://www.rackspace.com/cloud/
40. 40
Deploying OpenStack
OpenStack Distributions
Red Hat - http://openstack.redhat.com/
SUSE - https://www.suse.com/products/suse-cloud/
Ubuntu - http://www.ubuntu.com/cloud
Packaged Deploys For Different Linux Distros
Mirantis - https://fuel.mirantis.com/
Piston Cloud Computing - http://www.pistoncloud.com/openstack-cloud-software/
Rackspace - http://www.rackspace.com/cloud/private/openstack_software/
Configuration Management Tools
Opscode Chef - https://github.com/opscode/openstack-chef-repo/
Puppet Labs Puppet -http://puppetlabs.com/solutions/cloudautomation/compute/openstack
A Cloud Computing platform sits above the virtual data center and provides both a control plane over and resource access to the virtualized data center. OpenStack, as a Cloud Computing platform, manages virtualized resources, such as virtual machines exported by a hypervisor, network overlays created by Software-Defined Network devices, and volumes exported by virtual storage arrays. OpenStack takes these data center resources and automates and orchestrates them so they can be accessed on demand and be scaled up and down as needed, turning these resources into consumable services.
The OpenStack platform is actually composed of multiple components, called projects. Each project is managed by a technical committee and the OpenStack Foundation decides which projects are ready to be included in the OpenStack core. These projects work together to provide the services required to deliver the Cloud.
Nova – The compute project responsible for on-demand creation and termination of compute instances. Nova leverage a number of hypervisors, including KVM, Xen, Hyper-V, and vSphere.
Glance – The OS image management project responsible for storage and management of images used to create compute instances with OSes installed, such as Windows and Linux.
Quantum – The network project that provides network access and security services to compute instances. Quantum uses plugins to leverage virtual switches and SDN-enabled devices.
Swift – The object storage project that provides a scalable repository for storing large quantities of objects such as files and media content. It can also be used as an repository for Glance images.
Cinder – The block storage project that provides a virtual storage array that can export out iSCSI volumes. A Cinder/virtual storage array server can be a server with local storage or a server using an external storage array.
Horizon – The interactive dashboard project that provides users and admins provisioning and management access to the OpenStack Cloud via a web GUI.
Keystone – The identity management project that provides authorization and access security control for all the other OpenStack projects.
New projects are being added with each release and as the OpenStack community calls for them. New projects underway include metering, application orchestration, and database-as-a-service.
The OpenStack community is a growing body that spans the globe. Individuals and companies can join the community and learn from other members via IRC chat, mailing lists, and forums.