It's not widely known that the OpenStack Images API v2 contains an implementation of a "tasks" API that can be customized by operators to enable asynchronous processing of long-running operations. For example, a deployer might want to enable end users to upload their own custom images ... but only after such images have been approved by some thorough, computation-intensive validation process. The Glance tasks API provides a common interface across OpenStack installations, but allows the implementation of tasks to be customizable to a particular cloud environment. Join Brian Rosmaita, Compute Control Plane Product Manager at Rackspace to see how Glance tasks are being used at Rackspace and to learn how you can use Glance tasks in your OpenStack cloud.
Reactive Streams are a cross-company initiative first ignited by Lightbend in 2013, soon to be joined by RxJava and other implementations focused on solving a very similar problem: asynchronous non-blocking stream processing, with guaranteed over-flow protection. Fast forward to 2016 and now these interfaces are part of JSR-266 and proposed for JDK9.
In this talk we'll first disambiguate what the word Stream means in this context (as it's been overloaded recently by various different meanings), then look at how its protocol works and how one might use it in the real world showing examples using existing implementations.
We'll also have a peek into the future, to see what the next steps for such collaborative protocols and the JDK ecosystem are in general.
Rackspace Private Cloud presentation for ChefConf 2013Joe Breu
Rackspace uses Chef and other operational tools to automate the deployment of OpenStack. They developed their own cookbooks to model real-world deployments across multiple operating systems and to handle updates and new OpenStack services. Over time, they added capabilities like high availability and vendor integration. To simplify deployment and reduce operator overhead, they created OpenCenter, which automates tasks through a solver and provides an API. OpenCenter lowers the OpenStack knowledge needed by operators.
Apache Rave is a lightweight Java platform for personalized web pages built with widgets like OpenSocial gadgets and W3C widgets. It provides a customizable and multi-platform mashup engine for assembling personalized content without the complexity of traditional portals. The project was initiated in 2010 and became a top-level Apache project in 2012, reusing other Apache technologies. Future plans include expanding social and sharing capabilities between widgets.
Getting started with Apache Camel - jDays 2013Claus Ibsen
In this session will teach you how to get a good start with Apache Camel. We will introduce you to Apache Camel and how Camel its related to Enterprise Integration Patterns. And how you go about using these patterns in Camel routes, written in Java code or XML files.
We will then discuss how you can get started developing with Camel, and how to setup new projects from scratch using Maven and Eclipse tooling.
This session includes live demos that show how to build Camel applications in Java, Spring, OSGi Blueprint and alternative languages such as Scala and Groovy. You will also hear what other features Camel provides out of the box, which can make integration much easier for you.
We also take a moment to look at hawtio, then hot new web console tooling that allows you to get insight into your running Apache Camel applications, which has among others visual route diagrams with tracing/debugging and profiling capabilities.
Before opening up for QA, we will share useful links where you can dive into learning more about Camel.
Getting started with Apache Camel - May 2013Claus Ibsen
This session will teach you how to get a good start with Apache Camel.
We will introduce you to Apache Camel and how Camel its related to Enterprise Integration Patterns. And how you go about using these patterns in Camel routes, written in Java code or XML files.
We will then discuss how you can get started developing with Camel, and how to setup a new project from scratch using Maven and Eclipse tooling.
This session includes live demos that show how to build Camel applications in Java, Spring, OSGi Blueprint and alternative languages such as Scala and Groovy.
You will also hear what other features Camel provides out of the box, which can make integration much easier for you.
Before opening up for QA, we will share useful links where you can dive into learning more about Camel.
This presentation was video taped which you can find here: http://javagruppen.dk/index.php/moder/historiske-moder/285-javagruppemode-115-apache-camel-i-aarhus
The slide deck for Andrew White's Technical Breakfast Club, covering how past major releases have tripped people up in upgrades and what strategies you need to adopt to make sure your upgrade path is smooth.
Apache Camel is a very popular integration library that works very well with microservice architecture.
This talk introduces you to Apache Camel and how you can easily get started with Camel on your computer.
Then we cover how to create new Camel projects from scratch as micro services which you can boot using Camel or Spring Boot, or other micro containers such as Jetty or fat JARs. We then take a look at what options you have for monitoring and managing your Camel microservices
using tooling such as Jolokia, and hawtio web console.
The second part of this talk is about running Camel in the cloud. We start by showing you how you can use the Maven Docker Plugin to create a docker image of your Camel application and run it using docker on a single host. Then kubernetes enters the stage and we take a look at how you can deploy your docker images on a kubernetes cloud platform, and how thenfabric8 tooling can make this much easier for the Java developers.
At the end of this talk you will have learned about and seen in practice how to take a Java Camel project from scratch, turn that into a docker image, and how you can deploy those docker images in a scalable cloud platform based on Google's kubernetes.
Reactive Streams are a cross-company initiative first ignited by Lightbend in 2013, soon to be joined by RxJava and other implementations focused on solving a very similar problem: asynchronous non-blocking stream processing, with guaranteed over-flow protection. Fast forward to 2016 and now these interfaces are part of JSR-266 and proposed for JDK9.
In this talk we'll first disambiguate what the word Stream means in this context (as it's been overloaded recently by various different meanings), then look at how its protocol works and how one might use it in the real world showing examples using existing implementations.
We'll also have a peek into the future, to see what the next steps for such collaborative protocols and the JDK ecosystem are in general.
Rackspace Private Cloud presentation for ChefConf 2013Joe Breu
Rackspace uses Chef and other operational tools to automate the deployment of OpenStack. They developed their own cookbooks to model real-world deployments across multiple operating systems and to handle updates and new OpenStack services. Over time, they added capabilities like high availability and vendor integration. To simplify deployment and reduce operator overhead, they created OpenCenter, which automates tasks through a solver and provides an API. OpenCenter lowers the OpenStack knowledge needed by operators.
Apache Rave is a lightweight Java platform for personalized web pages built with widgets like OpenSocial gadgets and W3C widgets. It provides a customizable and multi-platform mashup engine for assembling personalized content without the complexity of traditional portals. The project was initiated in 2010 and became a top-level Apache project in 2012, reusing other Apache technologies. Future plans include expanding social and sharing capabilities between widgets.
Getting started with Apache Camel - jDays 2013Claus Ibsen
In this session will teach you how to get a good start with Apache Camel. We will introduce you to Apache Camel and how Camel its related to Enterprise Integration Patterns. And how you go about using these patterns in Camel routes, written in Java code or XML files.
We will then discuss how you can get started developing with Camel, and how to setup new projects from scratch using Maven and Eclipse tooling.
This session includes live demos that show how to build Camel applications in Java, Spring, OSGi Blueprint and alternative languages such as Scala and Groovy. You will also hear what other features Camel provides out of the box, which can make integration much easier for you.
We also take a moment to look at hawtio, then hot new web console tooling that allows you to get insight into your running Apache Camel applications, which has among others visual route diagrams with tracing/debugging and profiling capabilities.
Before opening up for QA, we will share useful links where you can dive into learning more about Camel.
Getting started with Apache Camel - May 2013Claus Ibsen
This session will teach you how to get a good start with Apache Camel.
We will introduce you to Apache Camel and how Camel its related to Enterprise Integration Patterns. And how you go about using these patterns in Camel routes, written in Java code or XML files.
We will then discuss how you can get started developing with Camel, and how to setup a new project from scratch using Maven and Eclipse tooling.
This session includes live demos that show how to build Camel applications in Java, Spring, OSGi Blueprint and alternative languages such as Scala and Groovy.
You will also hear what other features Camel provides out of the box, which can make integration much easier for you.
Before opening up for QA, we will share useful links where you can dive into learning more about Camel.
This presentation was video taped which you can find here: http://javagruppen.dk/index.php/moder/historiske-moder/285-javagruppemode-115-apache-camel-i-aarhus
The slide deck for Andrew White's Technical Breakfast Club, covering how past major releases have tripped people up in upgrades and what strategies you need to adopt to make sure your upgrade path is smooth.
Apache Camel is a very popular integration library that works very well with microservice architecture.
This talk introduces you to Apache Camel and how you can easily get started with Camel on your computer.
Then we cover how to create new Camel projects from scratch as micro services which you can boot using Camel or Spring Boot, or other micro containers such as Jetty or fat JARs. We then take a look at what options you have for monitoring and managing your Camel microservices
using tooling such as Jolokia, and hawtio web console.
The second part of this talk is about running Camel in the cloud. We start by showing you how you can use the Maven Docker Plugin to create a docker image of your Camel application and run it using docker on a single host. Then kubernetes enters the stage and we take a look at how you can deploy your docker images on a kubernetes cloud platform, and how thenfabric8 tooling can make this much easier for the Java developers.
At the end of this talk you will have learned about and seen in practice how to take a Java Camel project from scratch, turn that into a docker image, and how you can deploy those docker images in a scalable cloud platform based on Google's kubernetes.
Getting started with Apache Camel presentation at BarcelonaJUG, january 2014Claus Ibsen
This session will teach you how to get a good start with Apache Camel. We will introduce you to Apache Camel and how Camel its related to Enterprise Integration Patterns. And how you go about using these patterns in Camel routes, written in Java code or XML files.
We will then discuss how you can get started developing with Camel, and how to setup new projects from scratch using Maven and Eclipse tooling.
This session includes live demos that show how to build Camel applications in Java, Spring, OSGi Blueprint and alternative languages such as Scala and Groovy. You will also hear what other features Camel provides out of the box, which can make integration much easier for you.
We also take a moment to look at web console tooling that allows you to get insight into your running Apache Camel applications, which has among others visual route diagrams with tracing/debugging and profiling capabilities.
Crowdmix is a social network focused on music that runs on an event-driven architecture. It allows users to share music content from various streaming services across crowds. The system is designed for scalability to support millions of users. Key components include Kafka for event streaming, Spark/EMR for batch processing, Elasticsearch for search, and Cassandra/Redshift for materialized views and analytics. Music matching is required to identify tracks across different services. Performance testing showed the architecture could support the targeted user scale.
The document discusses the problem of managing multiple Scala/SBT projects (MBMH) and proposes a solution of using SBT archetype plugins. The key points are:
- MBMH refers to the difficulty of maintaining consistency across many SBT projects with different dependencies, plugins, and versions.
- The proposed solution is to define SBT archetype plugins that project share common build settings, dependencies, and provide a way to upgrade all projects by upgrading the archetype version.
- This centralizes configuration, promotes consistency, and simplifies upgrading whole suites of projects at once.
Microservices with apache_camel_barcelonaClaus Ibsen
Apache Camel is a very popular integration library that works very well with microservice architecture.
This talk introduces you to Apache Camel and how you can easily get started with Camel on your computer.
Then we cover how to create new Camel projects from scratch as micro services which you can boot using Camel or Spring Boot, or other micro containers such as Jetty or fat JARs.
We then take a look at what options you have for monitoring and managing your Camel microservices using tooling such as Jolokia, and hawtio web console.
The second part of this talk is about running Camel in the cloud.We start by showing you how you can use the Maven Docker Plugin to create a docker image of your Camel application and run it using docker on a single host. Then kubernetes enters the stage and we take a look at how you can deploy your docker images on a kubernetes cloud platform, and how the fabric8 tooling can make this much easier for the Java developers.
At the end of this talk you will have learned about and seen in practice how to take a Java Camel project from scratch, turn that into a docker image, and how you can deploy those docker images in a scalable cloud platform based on Google's kubernetes.
Alfresco 5.2 Introduces New Public REST APIs
For an update, please see: https://www.slideshare.net/jvonka/exciting-new-alfresco-apis
https://www.meetup.com/Alfresco-Meetups/events/236987848/
An overview of the new and enhanced APIs will be discussed and some of the key endpoints demonstrated via Postman so that by the time you leave you should have enough knowledge to create a simple client or integration.
These APIs will also be the foundation for new clients developed for the Alfresco Digital Business Platform.
We'll have a sneak peek at what's coming next and leave plenty of time for questions, feedback and open discussion.
This document provides an overview of the Ratpack web framework. It discusses key features like the Groovy DSL, handler chains for processing requests, and common handlers for routing requests. It also covers project structure and support for Gradle builds.
RIPE NCC conducted active measurements of the 2012 World IPv6 Launch from May 19 to June 18 using 53 vantage points to measure DNS records, ping, traceroute, and HTTP performance over IPv6 for 60 participating networks. The results showed that most sites kept IPv6 enabled as intended, though some did not enable it during the event. RIPE also demonstrated tools for visualizing IPv6 connectivity and performance using its RIPE Atlas probes to trace routes to networks, with options to view results by autonomous system or get raw data. Feedback was sought on the traceroute visualization tool to help improve debugging of network issues.
Moving Gigantic Files Into and Out of the Alfresco RepositoryJeff Potts
This talk is a technical case study showing show Metaversant solved a problem for one of their clients, Noble Research Institute. Researchers at Noble deal with very large files which are often difficult to move into and out of the Alfresco repository.
A chronicle of my attempt to create a real time web app using pure clojure at every layer of the stack, from the client to the styles to the web server
Event Driven Architecture with Apache Camelprajods
This presentation describes Event Driven Architecture(EDA) support in Camel, and scalability features like SEDA and Akka support in Camel.It starts with an overview of Camel and introduces its simple syntax
This document provides an overview of the jclouds Java SDK for interacting with cloud APIs. It discusses what jclouds is, the clouds and APIs it supports, its layered architecture, SDK deployment, and examples of using jclouds for tasks like authentication, logging, and interacting with cloud services like files, servers, and load balancers. It also covers getting help, bug reporting, and contributing to the jclouds open source project.
Alfresco DevCon 2018: SDK 3 Multi Module project using Nexus 3 for releases a...Martin Bergljung
In this talk you will learn how to set up an Alfresco SDK 3.0 multi module project that could be used in a larger consulting project context. Extension modules will be standalone and versioned and released independently in the Nexus 3 Repository Manager. The talk also includes a look at defining a Parent POM and an Aggregator POM for your SDK 3 project solution.
Developing Microservices with Apache CamelClaus Ibsen
Red Hat Microservices Architecture Day - New York, November 2015. Presented by Claus Ibsen.
Apache Camel is a very popular integration library that works very well with microservice architecture. This talk introduces you to Apache Camel and how you can easily get started with Camel on your computer. Then we cover how to create new Camel projects from scratch as microservices, which you can boot using Camel or Spring Boot, or other micro containers such as Jetty or fat JARs. We then take a look at what options you have for monitoring and managing your Camel microservices using tooling such as Jolokia, and hawtio web console.
Enterprise Integration Patterns with Apache CamelIoan Eugen Stan
This document discusses Enterprise Integration Patterns (EIPs) using Apache Camel, a Java framework for integration and mediation. It provides an overview of common EIPs like content-based routing, normalization, and the transactional client pattern. It also demonstrates how to implement EIPs like these using the Java and Spring DSLs in Camel. Key features of Camel like components, exchanges, processors and error handling are explained. Tools for working with Camel like Fuse IDE and Hawt.io are also introduced.
The BBC prepared extensively for hosting their online coverage of the 2012 London Olympics by conducting load testing, performance testing, and resilience testing on their systems and platforms. Through this testing, they found problems at various architecture layers that had not been discovered during testing on their staging environment. The testing exposed issues like poor application performance, timeouts not being properly configured, and a lack of caching. The extensive testing in the months leading up to the Olympics helped the BBC identify and fix issues before they impacted their online coverage during the live events.
Eberhard Wolff discusses several factors that contribute to creating changeable software beyond just architecture. He emphasizes that automated testing, following a test pyramid approach, continuous delivery practices like automated deployment, and understanding the customer's priorities are all important. While architecture is a factor, there are no universal rules and the architect's job is to understand each project's unique needs.
Using Apache Camel connectors for external connectivityClaus Ibsen
The document summarizes a public presentation by Claus Ibsen on using Apache Camel connectors for external connectivity. The presentation covers understanding Camel components, essential components like Direct, Bean, File, and JMS, and how to create new Camel components. It also provides information on where to find additional Camel resources.
Fault Tolerance in Distributed EnvironmentOrkhan Gasimov
The document discusses various techniques for achieving fault tolerance in distributed systems, including service coordination, handling high load, RPC mechanics, circuit breakers, N-modular redundancy, recovery blocks, actors and error kernels, and instance healers. It describes common issues that can occur like network failures and overloaded services, and explains solutions such as service discovery, load balancing, timeouts, and dynamically scaling services horizontally.
Docker and serverless Randstad Jan 2019: OpenFaaS Serverless: when functions ...Edward Wilde
This talk introduces OpenFaaS, an open source platform for serverless functions. We begin by installing, running the platform and invoking a machine learning function within 60 second (ish). Next we step up and look at the high level platform architecture and key pillars of OpenFaaS: developer first, operator friendly and community focused. We close by looking at a multiuser platform built on top OpenFaas.
The objective of this talk is to introduce you to OpenFaaS the serverless platform and OpenFaaS cloud the multi-user environment for practicing git ops with functions.
This document discusses Spring Boot, a framework for building Java applications. It makes building Java web applications easier by providing sensible defaults and automatic configuration. Spring Boot allows building applications that are easy to test, debug and deploy. It supports adding additional libraries and frameworks like Spring Data JPA with minimal configuration. The document demonstrates how to create a basic application with Spring Boot and Spring Data JPA with auto-configured infrastructure and shows how Spring Boot helps with development, operations and deployment of Java applications.
This document provides an overview and introduction to the Keystone identity service in OpenStack. It defines key concepts in Keystone including users, tenants, roles, tokens, services, and endpoints. It also provides examples of using the keystone CLI to list and get information about users, tenants, services, and endpoints. The document concludes by assigning homework of setting up additional roles, endpoints, and services in Keystone to enable the Glance image service, and installing Glance in preparation for the next session.
Getting started with Apache Camel presentation at BarcelonaJUG, january 2014Claus Ibsen
This session will teach you how to get a good start with Apache Camel. We will introduce you to Apache Camel and how Camel its related to Enterprise Integration Patterns. And how you go about using these patterns in Camel routes, written in Java code or XML files.
We will then discuss how you can get started developing with Camel, and how to setup new projects from scratch using Maven and Eclipse tooling.
This session includes live demos that show how to build Camel applications in Java, Spring, OSGi Blueprint and alternative languages such as Scala and Groovy. You will also hear what other features Camel provides out of the box, which can make integration much easier for you.
We also take a moment to look at web console tooling that allows you to get insight into your running Apache Camel applications, which has among others visual route diagrams with tracing/debugging and profiling capabilities.
Crowdmix is a social network focused on music that runs on an event-driven architecture. It allows users to share music content from various streaming services across crowds. The system is designed for scalability to support millions of users. Key components include Kafka for event streaming, Spark/EMR for batch processing, Elasticsearch for search, and Cassandra/Redshift for materialized views and analytics. Music matching is required to identify tracks across different services. Performance testing showed the architecture could support the targeted user scale.
The document discusses the problem of managing multiple Scala/SBT projects (MBMH) and proposes a solution of using SBT archetype plugins. The key points are:
- MBMH refers to the difficulty of maintaining consistency across many SBT projects with different dependencies, plugins, and versions.
- The proposed solution is to define SBT archetype plugins that project share common build settings, dependencies, and provide a way to upgrade all projects by upgrading the archetype version.
- This centralizes configuration, promotes consistency, and simplifies upgrading whole suites of projects at once.
Microservices with apache_camel_barcelonaClaus Ibsen
Apache Camel is a very popular integration library that works very well with microservice architecture.
This talk introduces you to Apache Camel and how you can easily get started with Camel on your computer.
Then we cover how to create new Camel projects from scratch as micro services which you can boot using Camel or Spring Boot, or other micro containers such as Jetty or fat JARs.
We then take a look at what options you have for monitoring and managing your Camel microservices using tooling such as Jolokia, and hawtio web console.
The second part of this talk is about running Camel in the cloud.We start by showing you how you can use the Maven Docker Plugin to create a docker image of your Camel application and run it using docker on a single host. Then kubernetes enters the stage and we take a look at how you can deploy your docker images on a kubernetes cloud platform, and how the fabric8 tooling can make this much easier for the Java developers.
At the end of this talk you will have learned about and seen in practice how to take a Java Camel project from scratch, turn that into a docker image, and how you can deploy those docker images in a scalable cloud platform based on Google's kubernetes.
Alfresco 5.2 Introduces New Public REST APIs
For an update, please see: https://www.slideshare.net/jvonka/exciting-new-alfresco-apis
https://www.meetup.com/Alfresco-Meetups/events/236987848/
An overview of the new and enhanced APIs will be discussed and some of the key endpoints demonstrated via Postman so that by the time you leave you should have enough knowledge to create a simple client or integration.
These APIs will also be the foundation for new clients developed for the Alfresco Digital Business Platform.
We'll have a sneak peek at what's coming next and leave plenty of time for questions, feedback and open discussion.
This document provides an overview of the Ratpack web framework. It discusses key features like the Groovy DSL, handler chains for processing requests, and common handlers for routing requests. It also covers project structure and support for Gradle builds.
RIPE NCC conducted active measurements of the 2012 World IPv6 Launch from May 19 to June 18 using 53 vantage points to measure DNS records, ping, traceroute, and HTTP performance over IPv6 for 60 participating networks. The results showed that most sites kept IPv6 enabled as intended, though some did not enable it during the event. RIPE also demonstrated tools for visualizing IPv6 connectivity and performance using its RIPE Atlas probes to trace routes to networks, with options to view results by autonomous system or get raw data. Feedback was sought on the traceroute visualization tool to help improve debugging of network issues.
Moving Gigantic Files Into and Out of the Alfresco RepositoryJeff Potts
This talk is a technical case study showing show Metaversant solved a problem for one of their clients, Noble Research Institute. Researchers at Noble deal with very large files which are often difficult to move into and out of the Alfresco repository.
A chronicle of my attempt to create a real time web app using pure clojure at every layer of the stack, from the client to the styles to the web server
Event Driven Architecture with Apache Camelprajods
This presentation describes Event Driven Architecture(EDA) support in Camel, and scalability features like SEDA and Akka support in Camel.It starts with an overview of Camel and introduces its simple syntax
This document provides an overview of the jclouds Java SDK for interacting with cloud APIs. It discusses what jclouds is, the clouds and APIs it supports, its layered architecture, SDK deployment, and examples of using jclouds for tasks like authentication, logging, and interacting with cloud services like files, servers, and load balancers. It also covers getting help, bug reporting, and contributing to the jclouds open source project.
Alfresco DevCon 2018: SDK 3 Multi Module project using Nexus 3 for releases a...Martin Bergljung
In this talk you will learn how to set up an Alfresco SDK 3.0 multi module project that could be used in a larger consulting project context. Extension modules will be standalone and versioned and released independently in the Nexus 3 Repository Manager. The talk also includes a look at defining a Parent POM and an Aggregator POM for your SDK 3 project solution.
Developing Microservices with Apache CamelClaus Ibsen
Red Hat Microservices Architecture Day - New York, November 2015. Presented by Claus Ibsen.
Apache Camel is a very popular integration library that works very well with microservice architecture. This talk introduces you to Apache Camel and how you can easily get started with Camel on your computer. Then we cover how to create new Camel projects from scratch as microservices, which you can boot using Camel or Spring Boot, or other micro containers such as Jetty or fat JARs. We then take a look at what options you have for monitoring and managing your Camel microservices using tooling such as Jolokia, and hawtio web console.
Enterprise Integration Patterns with Apache CamelIoan Eugen Stan
This document discusses Enterprise Integration Patterns (EIPs) using Apache Camel, a Java framework for integration and mediation. It provides an overview of common EIPs like content-based routing, normalization, and the transactional client pattern. It also demonstrates how to implement EIPs like these using the Java and Spring DSLs in Camel. Key features of Camel like components, exchanges, processors and error handling are explained. Tools for working with Camel like Fuse IDE and Hawt.io are also introduced.
The BBC prepared extensively for hosting their online coverage of the 2012 London Olympics by conducting load testing, performance testing, and resilience testing on their systems and platforms. Through this testing, they found problems at various architecture layers that had not been discovered during testing on their staging environment. The testing exposed issues like poor application performance, timeouts not being properly configured, and a lack of caching. The extensive testing in the months leading up to the Olympics helped the BBC identify and fix issues before they impacted their online coverage during the live events.
Eberhard Wolff discusses several factors that contribute to creating changeable software beyond just architecture. He emphasizes that automated testing, following a test pyramid approach, continuous delivery practices like automated deployment, and understanding the customer's priorities are all important. While architecture is a factor, there are no universal rules and the architect's job is to understand each project's unique needs.
Using Apache Camel connectors for external connectivityClaus Ibsen
The document summarizes a public presentation by Claus Ibsen on using Apache Camel connectors for external connectivity. The presentation covers understanding Camel components, essential components like Direct, Bean, File, and JMS, and how to create new Camel components. It also provides information on where to find additional Camel resources.
Fault Tolerance in Distributed EnvironmentOrkhan Gasimov
The document discusses various techniques for achieving fault tolerance in distributed systems, including service coordination, handling high load, RPC mechanics, circuit breakers, N-modular redundancy, recovery blocks, actors and error kernels, and instance healers. It describes common issues that can occur like network failures and overloaded services, and explains solutions such as service discovery, load balancing, timeouts, and dynamically scaling services horizontally.
Docker and serverless Randstad Jan 2019: OpenFaaS Serverless: when functions ...Edward Wilde
This talk introduces OpenFaaS, an open source platform for serverless functions. We begin by installing, running the platform and invoking a machine learning function within 60 second (ish). Next we step up and look at the high level platform architecture and key pillars of OpenFaaS: developer first, operator friendly and community focused. We close by looking at a multiuser platform built on top OpenFaas.
The objective of this talk is to introduce you to OpenFaaS the serverless platform and OpenFaaS cloud the multi-user environment for practicing git ops with functions.
This document discusses Spring Boot, a framework for building Java applications. It makes building Java web applications easier by providing sensible defaults and automatic configuration. Spring Boot allows building applications that are easy to test, debug and deploy. It supports adding additional libraries and frameworks like Spring Data JPA with minimal configuration. The document demonstrates how to create a basic application with Spring Boot and Spring Data JPA with auto-configured infrastructure and shows how Spring Boot helps with development, operations and deployment of Java applications.
This document provides an overview and introduction to the Keystone identity service in OpenStack. It defines key concepts in Keystone including users, tenants, roles, tokens, services, and endpoints. It also provides examples of using the keystone CLI to list and get information about users, tenants, services, and endpoints. The document concludes by assigning homework of setting up additional roles, endpoints, and services in Keystone to enable the Glance image service, and installing Glance in preparation for the next session.
Keystone is the OpenStack identity service that provides user, project and service catalog management. It implements the OpenStack Identity API. Keystone has four internal services - Identity, Token, Catalog and Policy. It uses a pluggable backend architecture that allows different storage backends. Keystone provides authentication for users and services in OpenStack and maps users to their authorized projects and roles.
Deep Dive into Keystone Tokens and Lessons LearnedPriti Desai
Keystone supports four different types of tokens, UUID, PKI, PKIZ, and Fernet. Let’s take a deep dive into:
Understanding token formats
Pros and Cons of each format in Production
Performance across multiple data centers
Token revocation workflow for each of the formats
Horizon usage of the different token types
We previously deployed UUID and PKI in Production and are now moving towards the latest format, Fernet. We would like to share our lessons learned with different formats and help you decide on which format is suitable for your cloud.
Big Data and OpenStack, a Love Story: Michael Still, RackspaceOpenStack
Big Data and OpenStack, a Love Story
Audience: Intermediate
Topic: Storage
Abstract: Increasingly we’re being asked to build out clusters of machines to solve big data problems. These clusters can become quite large, reaching up to thousands of machines. Of course, our operational budgets don’t scale linearly like our machine counts do, and we’re asked to do more and more with less. This talk will explore how organisations around the world are using OpenStack to automate the management of their big data implementations, harnessing interesting characteristics of big data workloads along the way.
Speaker Bio: Michael Still, Rackspace
OpenStack core developer and former Nova PTL, as well as experienced software and reliability engineer. Part of the team that grew Google Mobile to being a billion dollar business. Director of linux.conf.au 2013. Author of The Definitive Guide to ImageMagick (www.imagemagickbook.com) and Practical MythTV (www.mythtvbook.com) from Apress, as well as a bunch of articles.
OpenStack Australia Day Government - Canberra 2016
https://events.aptira.com/openstack-australia-day-canberra-2016/
This document provides an overview of Docker for PHP developers. It discusses what Docker is, how containers work, and how to use basic Docker commands like docker run, docker exec, and docker volume to build and run PHP applications in containers. It also covers more advanced topics like linking containers together, building custom Docker images, and using Docker Compose to define and run multi-container apps. The goal is to help PHP developers learn how to containerize their applications and workflows using Docker.
OpenStack Documentation Projects and ProcessesAnne Gentle
This document provides an overview of OpenStack, including what it is, its core projects, principles, release process, and documentation processes. OpenStack is an open source cloud computing platform that delivers infrastructure as a service. It aims to be simple to implement, massively scalable, and feature-rich. The technology consists of interrelated projects delivering components for a cloud infrastructure solution like compute, storage, networking, identity management, and more. Documentation is developed openly through summits, Launchpad, GitHub, Gerrit, and the Jenkins automation platform.
A talk given to JCConf 2015 on 2015/12/05.
在程式設計領域,“immutable objects” 是相當重要的設計模式。同樣的,在虛擬化及雲端時代,“immutable infrastructure” 也成為新一代的顯學。在資源及流程的充分配合下,這將會大大簡化系統的複雜度,穩定性也會大大提升。
本演講將會從觀念出發,並佐以部份實作建議,讓大家有足夠資訊來評估此架構的好處。
Video: https://youtu.be/9j008nd6-A4
Show Me Kafka Tools That Will Increase My Productivity! (Stephane Maarek, Dat...confluent
In the Apache Kafka world, there is such a great diversity of open source tools available (I counted over 50!) that it’s easy to get lost. Over the years I have dealt with Kafka, I have learned to particularly enjoy a few of them that save me a tremendous amount of time over performing manual tasks. I will be sharing my experience and doing live demos of my favorite Kafka tools, so that you too can hopefully increase your productivity and efficiency when managing and administering Kafka. Come learn about the latest and greatest tools for CLI, UI, Replication, Management, Security, Monitoring, and more!
This document summarizes feedback from operator sessions at the Mitaka/Tokyo Design Summit and OpenStack London Meetup on November 18, 2015. It discusses upgrades being difficult due to unknown compatibility and integration issues. It also provides an overview of the OpenStack-Ansible project including its history, deliverables for the Liberty release, and plans for the Mitaka release.
Glance is the OpenStack image service that provides services to store, browse, share, distribute, and manage disk images and metadata. It is deployed by 97% of OpenStack clouds. Contributor numbers grew for the Ocata release but declined after budget cuts impacted the core reviewer team. The presentation outlines features added in recent releases and themes for upcoming releases, and asks for help contributing in various ways.
This document discusses Project RedDwarf, an OpenStack project that provides managed MySQL database services. It originated in 2011 at Rackspace and HP to build value-added services on top of OpenStack. RedDwarf uses Nova for provisioning and other OpenStack components. It provides a public API for managing MySQL instances and is used in production at both Rackspace and HP Cloud. Future plans include additional integration with OpenStack and language bindings.
Different Ways of Integrating React into Rails - Pros and ConsAmoniac OÜ
Applications these days appear to become more specific and role-divided. However, we want to deploy frontend and backend as one unit so Mikhail Bortnyk is going to research and to tell how modern JS frameworks are integrating into Rails, with pros, cons, blackjack, and dancers. Prepared for Ruby Meditation #16.
Different ways of integrating React into Rails - Mikhail BortnykRuby Meditation
This document discusses different approaches for integrating React with Ruby on Rails applications. It outlines four cases:
1. A standalone frontend application, which provides full control but requires coordinating builds and deployments.
2. Using in-app JavaScript, which is hardly maintainable and only supports in-browser JSX.
3. The react-rails gem, which provides server-side rendering but has a fixed React version and deep assets pipeline integration.
4. The react_on_rails gem, which supports React and Redux with templates and Webpack but requires setting up hot module reloading.
The document suggests the webpacker gem may be the future approach as it easily
Behind the Curtain: Operating an OpenStack Powered Private CloudNiki Acosta
The document provides an overview of Rackspace's private cloud offering powered by OpenStack. It discusses how Rackspace developed its private cloud product based on customer demand for the security and performance of an on-premise solution combined with the APIs, self-service model, and expertise of Rackspace's public cloud. It also outlines key aspects of Rackspace's private cloud such as common use cases, support model, development process, lessons learned, and the OpenStack release process.
Latest version of the Netflix Cloud Architecture story was given at Gluecon May 23rd 2012. Gluecon rocks, and lots of Van Halen references were added for the occasion. There tradeoff between developer driven high functionality AWS based PaaS, and operations driven low cost portable PaaS is discussed. The three sections cover the developer view, the operator view and the builder view.
The document discusses features and changes in ASP.NET vNext, the future version of ASP.NET. It describes how vNext uses project.json for dependencies instead of references, allows editing code without recompiling, and merges MVC, Web API and Web Pages into a single framework. It also discusses tools for building, running and deploying vNext applications in Visual Studio 2015 and how the runtime will be more modular and cross-platform compared to previous versions of ASP.NET.
The document provides an overview of the XVA Platform, which uses a distributed architecture for enterprise web applications. Key points:
- The platform consists of multiple independent modules hosted on a CDN and loaded on demand. A small Node.js server app loads the initial page and configures module paths.
- Modules are built, tested, versioned, and released independently, allowing for improved scalability, collaboration, and code quality compared to a monolithic architecture.
- Continuous integration processes compile modules and deploy them to the CDN. The platform loads the correct module versions for each environment via a configuration module.
As the leading full-stack application framework for Java SE and EE, the Spring Framework continues to deliver significant benefits to Java developers, increasing development productivity and runtime performance while improving test coverage and application quality.
In this talk, core Spring Framework committer Sam Brannen will provide attendees an overview of the new features in Spring 3.2 as well as a sneak peak at the roadmap for 4.0.
Spring Framework 3.2 builds on several themes delivered in 3.1 with a continued focus on asynchronous MVC processing with Servlet 3.0, support for using @Autowired and @Value as meta-annotations, support for custom @Bean definition annotations, and early support for JCache 0.5. Regarding the internals, CGLIB 3.0 and ASM 4.0 have been inlined, and the framework is now built with Gradle and hosted on GitHub. For those interested in testing their Spring-based web applications, Spring 3.2 offers new support for loading WebApplicationContexts in the TestContext framework, and the formerly standalone Spring MVC Test project is now included in the spring-test module, allowing for first-class testing of Spring MVC applications.
Paul Angus – Backup & Recovery in CloudStackShapeBlue
The document previews ShapeBlue's CloudStack Backup and Recovery Framework, which aims to provide a vendor-agnostic API and UI in CloudStack for third-party backup and recovery solutions. The framework abstracts vendor specifics through plugins so solutions can deliver features like scheduled, ad-hoc, and policy-based backups as well as VM and volume restoration. An example plugin for Veeam Backup & Replication is provided. The framework and initial plugins are targeted for an open source release in Q4.
This document provides an overview of Locaweb's Infrastructure as a Service (IaaS) engineering team and capabilities. It discusses the team size and responsibilities, defines IaaS, describes Locaweb's IaaS architecture including virtual/physical servers, open source software used, provisioning processes, and resource monitoring. It also lists several open source projects developed by Locaweb to support their IaaS operations.
Scott Taylor was the release lead for WordPress 4.4. He outlined several goals for the release, including closing many tickets, front-loading development, and finding out what could realistically be accomplished with limited resources. Some of the major features included in 4.4 were the REST API, responsive images, comments overhaul, and Twenty Sixteen theme. Taylor discussed lessons learned, like the high burnout rate among volunteers and the significant technical debt in WordPress. He presented case studies on refactoring PHP code structure and improving performance of AJAX unit tests. Taylor argued for moving away from globals and treating WordPress as one part of a larger system, and drew inspiration from practices like PSR standards, Composer,
You'll Never Look at Developer Support the Same Way AgainAnne Gentle
The document discusses developer support for OpenStack. It provides an overview of the different SDKs and tools available for developers, the most frequently asked questions on forums like Stack Overflow, and top tags and answerers. It also discusses analyzing usage data and issues to identify ways to improve developer documentation, tools, and support.
OSDC 2013 | Introduction into Chef by Andy HawkinsNETWAYS
This presentation will give an overview about what Chef is and how to access it. It will describe the typical use cases and architecture as well as Cookbooks, data bags and other concepts and will explain how to implement your CM solution. Finally it will show how to drive a successful Chef project.
Similar to Making Glance tasks work for you - OpenStack Summit May 2015 Vancouver (20)
Ecosystem Projects for Data Management Challenges: CinderBrian Rosmaita
Key features and roadmap of Cinder for data management challenges. Cinder integration with SODA along with its use cases.
Presented 11 December 2020 at SODACON2020.
SODA Foundation is an open source project under Linux Foundation that aims to foster an ecosystem of open source data management and storage software for data autonomy. SODA Foundation offers a neutral forum for cross-projects collaboration and integration and provides end users quality end-to-end solutions.
OpenStack Cinder - Victoria Release Update - 2020Brian Rosmaita
Cinder Block Storage Service project overview and update. Highlights from the Victoria release, state of the project, and planning for the Wallaby development cycle.
Quick update of the OpenStack Cinder project, but mostly a discussion of open source software development opportunities working with the OpenStack Block Storage service. Presented at the OpenInfra Q3 Meetup in China on 26 September 2020.
OpenShift Commons Briefing: Ask Me Anything about Cinder and GlanceBrian Rosmaita
Overview and update on the OpenStack Cinder and Glance projects, including a discussion of upstream OpenStack development, Cinder third-party backend drivers, and how these impact OpenShift.
Cinder Block Storage Service project overview and update. Highlights from the Train release, state of the project, and planning for the Ussuri development cycle.
The Evolution of Glance API: On the Way From v1 to v3Brian Rosmaita
OpenStack Image Service (aka Glance) has been around from the earliest days of OpenStack and has been evolving ever since.
It's been three years since the last major update of its API - the v2 - went live with the Folsom release, and it is time now to move forward. With the recent introduction of new large features, such as Meta Definitions and Artifacts, the time has come to introduce a new version of Glance public API - V3.
In this session, Glance driver Brian Rosmaita and Artifacts driver Alexander Tivelkov will talk about the history of Glance API, the way it made since the initial release and the challenges it now has. The attendees will learn about the new experimental version of Glance API, the plans to deprecate the v1 and the new amazing features which are available for Glance users.
For the full video of this presentation, please visit: https://www.edge-ai-vision.com/2024/06/building-and-scaling-ai-applications-with-the-nx-ai-manager-a-presentation-from-network-optix/
Robin van Emden, Senior Director of Data Science at Network Optix, presents the “Building and Scaling AI Applications with the Nx AI Manager,” tutorial at the May 2024 Embedded Vision Summit.
In this presentation, van Emden covers the basics of scaling edge AI solutions using the Nx tool kit. He emphasizes the process of developing AI models and deploying them globally. He also showcases the conversion of AI models and the creation of effective edge AI pipelines, with a focus on pre-processing, model conversion, selecting the appropriate inference engine for the target hardware and post-processing.
van Emden shows how Nx can simplify the developer’s life and facilitate a rapid transition from concept to production-ready applications.He provides valuable insights into developing scalable and efficient edge AI solutions, with a strong focus on practical implementation.
GraphSummit Singapore | The Art of the Possible with Graph - Q2 2024Neo4j
Neha Bajwa, Vice President of Product Marketing, Neo4j
Join us as we explore breakthrough innovations enabled by interconnected data and AI. Discover firsthand how organizations use relationships in data to uncover contextual insights and solve our most pressing challenges – from optimizing supply chains, detecting fraud, and improving customer experiences to accelerating drug discoveries.
Threats to mobile devices are more prevalent and increasing in scope and complexity. Users of mobile devices desire to take full advantage of the features
available on those devices, but many of the features provide convenience and capability but sacrifice security. This best practices guide outlines steps the users can take to better protect personal devices and information.
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slackshyamraj55
Discover the seamless integration of RPA (Robotic Process Automation), COMPOSER, and APM with AWS IDP enhanced with Slack notifications. Explore how these technologies converge to streamline workflows, optimize performance, and ensure secure access, all while leveraging the power of AWS IDP and real-time communication via Slack notifications.
Essentials of Automations: The Art of Triggers and Actions in FMESafe Software
In this second installment of our Essentials of Automations webinar series, we’ll explore the landscape of triggers and actions, guiding you through the nuances of authoring and adapting workspaces for seamless automations. Gain an understanding of the full spectrum of triggers and actions available in FME, empowering you to enhance your workspaces for efficient automation.
We’ll kick things off by showcasing the most commonly used event-based triggers, introducing you to various automation workflows like manual triggers, schedules, directory watchers, and more. Plus, see how these elements play out in real scenarios.
Whether you’re tweaking your current setup or building from the ground up, this session will arm you with the tools and insights needed to transform your FME usage into a powerhouse of productivity. Join us to discover effective strategies that simplify complex processes, enhancing your productivity and transforming your data management practices with FME. Let’s turn complexity into clarity and make your workspaces work wonders!
How to Get CNIC Information System with Paksim Ga.pptxdanishmna97
Pakdata Cf is a groundbreaking system designed to streamline and facilitate access to CNIC information. This innovative platform leverages advanced technology to provide users with efficient and secure access to their CNIC details.
Securing your Kubernetes cluster_ a step-by-step guide to success !KatiaHIMEUR1
Today, after several years of existence, an extremely active community and an ultra-dynamic ecosystem, Kubernetes has established itself as the de facto standard in container orchestration. Thanks to a wide range of managed services, it has never been so easy to set up a ready-to-use Kubernetes cluster.
However, this ease of use means that the subject of security in Kubernetes is often left for later, or even neglected. This exposes companies to significant risks.
In this talk, I'll show you step-by-step how to secure your Kubernetes cluster for greater peace of mind and reliability.
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?Speck&Tech
ABSTRACT: A prima vista, un mattoncino Lego e la backdoor XZ potrebbero avere in comune il fatto di essere entrambi blocchi di costruzione, o dipendenze di progetti creativi e software. La realtà è che un mattoncino Lego e il caso della backdoor XZ hanno molto di più di tutto ciò in comune.
Partecipate alla presentazione per immergervi in una storia di interoperabilità, standard e formati aperti, per poi discutere del ruolo importante che i contributori hanno in una comunità open source sostenibile.
BIO: Sostenitrice del software libero e dei formati standard e aperti. È stata un membro attivo dei progetti Fedora e openSUSE e ha co-fondato l'Associazione LibreItalia dove è stata coinvolta in diversi eventi, migrazioni e formazione relativi a LibreOffice. In precedenza ha lavorato a migrazioni e corsi di formazione su LibreOffice per diverse amministrazioni pubbliche e privati. Da gennaio 2020 lavora in SUSE come Software Release Engineer per Uyuni e SUSE Manager e quando non segue la sua passione per i computer e per Geeko coltiva la sua curiosità per l'astronomia (da cui deriva il suo nickname deneb_alpha).
Climate Impact of Software Testing at Nordic Testing DaysKari Kakkonen
My slides at Nordic Testing Days 6.6.2024
Climate impact / sustainability of software testing discussed on the talk. ICT and testing must carry their part of global responsibility to help with the climat warming. We can minimize the carbon footprint but we can also have a carbon handprint, a positive impact on the climate. Quality characteristics can be added with sustainability, and then measured continuously. Test environments can be used less, and in smaller scale and on demand. Test techniques can be used in optimizing or minimizing number of tests. Test automation can be used to speed up testing.
Removing Uninteresting Bytes in Software FuzzingAftab Hussain
Imagine a world where software fuzzing, the process of mutating bytes in test seeds to uncover hidden and erroneous program behaviors, becomes faster and more effective. A lot depends on the initial seeds, which can significantly dictate the trajectory of a fuzzing campaign, particularly in terms of how long it takes to uncover interesting behaviour in your code. We introduce DIAR, a technique designed to speedup fuzzing campaigns by pinpointing and eliminating those uninteresting bytes in the seeds. Picture this: instead of wasting valuable resources on meaningless mutations in large, bloated seeds, DIAR removes the unnecessary bytes, streamlining the entire process.
In this work, we equipped AFL, a popular fuzzer, with DIAR and examined two critical Linux libraries -- Libxml's xmllint, a tool for parsing xml documents, and Binutil's readelf, an essential debugging and security analysis command-line tool used to display detailed information about ELF (Executable and Linkable Format). Our preliminary results show that AFL+DIAR does not only discover new paths more quickly but also achieves higher coverage overall. This work thus showcases how starting with lean and optimized seeds can lead to faster, more comprehensive fuzzing campaigns -- and DIAR helps you find such seeds.
- These are slides of the talk given at IEEE International Conference on Software Testing Verification and Validation Workshop, ICSTW 2022.
A tale of scale & speed: How the US Navy is enabling software delivery from l...sonjaschweigert1
Rapid and secure feature delivery is a goal across every application team and every branch of the DoD. The Navy’s DevSecOps platform, Party Barge, has achieved:
- Reduction in onboarding time from 5 weeks to 1 day
- Improved developer experience and productivity through actionable findings and reduction of false positives
- Maintenance of superior security standards and inherent policy enforcement with Authorization to Operate (ATO)
Development teams can ship efficiently and ensure applications are cyber ready for Navy Authorizing Officials (AOs). In this webinar, Sigma Defense and Anchore will give attendees a look behind the scenes and demo secure pipeline automation and security artifacts that speed up application ATO and time to production.
We will cover:
- How to remove silos in DevSecOps
- How to build efficient development pipeline roles and component templates
- How to deliver security artifacts that matter for ATO’s (SBOMs, vulnerability reports, and policy evidence)
- How to streamline operations with automated policy checks on container images
UiPath Test Automation using UiPath Test Suite series, part 6DianaGray10
Welcome to UiPath Test Automation using UiPath Test Suite series part 6. In this session, we will cover Test Automation with generative AI and Open AI.
UiPath Test Automation with generative AI and Open AI webinar offers an in-depth exploration of leveraging cutting-edge technologies for test automation within the UiPath platform. Attendees will delve into the integration of generative AI, a test automation solution, with Open AI advanced natural language processing capabilities.
Throughout the session, participants will discover how this synergy empowers testers to automate repetitive tasks, enhance testing accuracy, and expedite the software testing life cycle. Topics covered include the seamless integration process, practical use cases, and the benefits of harnessing AI-driven automation for UiPath testing initiatives. By attending this webinar, testers, and automation professionals can gain valuable insights into harnessing the power of AI to optimize their test automation workflows within the UiPath ecosystem, ultimately driving efficiency and quality in software development processes.
What will you get from this session?
1. Insights into integrating generative AI.
2. Understanding how this integration enhances test automation within the UiPath platform
3. Practical demonstrations
4. Exploration of real-world use cases illustrating the benefits of AI-driven test automation for UiPath
Topics covered:
What is generative AI
Test Automation with generative AI and Open AI.
UiPath integration with generative AI
Speaker:
Deepak Rai, Automation Practice Lead, Boundaryless Group and UiPath MVP
Building RAG with self-deployed Milvus vector database and Snowpark Container...Zilliz
This talk will give hands-on advice on building RAG applications with an open-source Milvus database deployed as a docker container. We will also introduce the integration of Milvus with Snowpark Container Services.
Unlocking Productivity: Leveraging the Potential of Copilot in Microsoft 365, a presentation by Christoforos Vlachos, Senior Solutions Manager – Modern Workplace, Uni Systems
Pushing the limits of ePRTC: 100ns holdover for 100 daysAdtran
At WSTS 2024, Alon Stern explored the topic of parametric holdover and explained how recent research findings can be implemented in real-world PNT networks to achieve 100 nanoseconds of accuracy for up to 100 days.
9. • This talk was originally planned to be given along with Nikhil Komawar, the
Glance Project Technical Lead
The old bait-and-switch
9www.rackspace.com
10. • This talk was originally planned to be given along with Nikhil Komawar, the
Glance Project Technical Lead
– Unfortunately, he can’t be here today
The old bait-and-switch
10www.rackspace.com
11. • This talk was originally planned to be given along with Nikhil Komawar, the
Glance Project Technical Lead
– Unfortunately, he can’t be here today
• “Making Glance tasks work for you”
The old bait-and-switch
11www.rackspace.com
12. • This talk was originally planned to be given along with Nikhil Komawar, the
Glance Project Technical Lead
– Unfortunately, he can’t be here today
• “Making Glance tasks work for you”
– Actually, the focus won’t be on how to implement your own tasks
The old bait-and-switch
12www.rackspace.com
13. • This talk was originally planned to be given along with Nikhil Komawar, the
Glance Project Technical Lead
– Unfortunately, he can’t be here today
• “Making Glance tasks work for you”
– Actually, the focus won’t be on how to implement your own tasks
– More about what tasks are, why you should consider using them
The old bait-and-switch
13www.rackspace.com
14. • This talk was originally planned to be given along with Nikhil Komawar, the
Glance Project Technical Lead
– Unfortunately, he can’t be here today
• “Making Glance tasks work for you”
– Actually, the focus won’t be on how to implement your own tasks
– More about what tasks are, why you should consider using them
– … and some requests for feedback
The old bait-and-switch
14www.rackspace.com
16. • Ops Feedback
– Thursday May 21, 2015 11:50am - 12:30pm
– Room 218
– Please attend if you can
– If you can’t, put suggestions on this etherpad:
http://etherpad.openstack.org/p/liberty-glance-ops-feedback
Glance design session tomorrow
16www.rackspace.com
18. • I was told that to have an effective
presentation, you need to start with
a compelling story
18
This presentation
www.rackspace.com
19. • I was told that to have an effective
presentation, you need to start with
a compelling story
• I will give you one!
19
This presentation
www.rackspace.com
20. • I was also told that it’s good if your
presentation includes some
controversy
20
This presentation
www.rackspace.com
21. • I was also told that it’s good if your
presentation includes some
controversy
• I’ll give you some of that, too!
21
This presentation
www.rackspace.com
23. • Wednesday May 20, 2015 2:40pm -
3:20pm
• Room 222
• https://etherpad.openstack.org/p/liberty-
what-is-glance
23
The direction of the Glance project
www.rackspace.com
24. • Glance’s role in OpenStack: Image
service
24
The Glance mission statement
www.rackspace.com
25. • Glance’s role in OpenStack: Image
service
• On July 10, 2014, the following mission
statement was merged:
To provide a service where users can
upload and discover data assets that
are meant to be used with other
services, like images for Nova and
templates for Heat
– https://review.openstack.org/#/c/98002/
25
The Glance mission statement
www.rackspace.com
26. • Images API
– v1 changed to SUPPORTED status
– v2 now considered CURRENT
26
Recent Developments in Glance
www.rackspace.com
27. • Images API
– v1 changed to SUPPORTED status
– v2 now considered CURRENT
• Metadefs catalog
– Added in Juno
– /v2/metadefs
27
Recent Developments in Glance
www.rackspace.com
28. • Images API
– v1 changed to SUPPORTED status
– v2 now considered CURRENT
• Metadefs catalog
– Added in Juno
– /v2/metadefs
• Catalog Index Service (Experimental API)
– Added in Kilo
– /v0.1/search
28
Recent Developments in Glance
www.rackspace.com
29. • Images API
– v1 changed to SUPPORTED status
– v2 now considered CURRENT
• Metadefs catalog
– Added in Juno
– /v2/metadefs
• Catalog Index Service (Experimental API)
– Added in Kilo
– /v0.1/search
• Artifacts (Experimental API)
– Scheduled for Liberty
– /v0.1/artifacts
29
Recent Developments in Glance
www.rackspace.com
30. • Wednesday May 20, 2015 2:40pm -
3:20pm
• Room 222
• https://etherpad.openstack.org/p/liberty-
what-is-glance
30
The direction of the Glance project
www.rackspace.com
31. • Wednesday May 20, 2015 3:30pm – 4:10pm
• Room 222
• https://etherpad.openstack.org/p/catalog-index-
service-liberty
31
Catalog Index Service – Future and Scope
www.rackspace.com
39. • End users would like to bring
their own images into your cloud
39
The compelling story
www.rackspace.com
40. • End users would like to bring
their own images into your cloud
• But there are a few
complications …
40
The compelling story
www.rackspace.com
41. • Some end users don’t quite
understand what the OpenStack
Image Service is
41
The compelling story
www.rackspace.com
42. • Some end users don’t quite
understand what the OpenStack
Image Service is
– You can upload as many JPEGs as you
want, but you’ll never be able to boot a
VM from them
42
The compelling story
www.rackspace.com
43. • Some end users do understand
what the OpenStack Image Service
is … but they are not nice people
43
The compelling story
www.rackspace.com
44. • Some end users do understand
what the OpenStack Image Service
is … but they are not nice people
– Someone may upload malicious images
to share malware with other users
44
The compelling story
www.rackspace.com
45. • Some end users do understand
what the OpenStack Image Service
is … but they are not nice people
– Someone may upload malicious images
to share malware with other users
– Someone may upload a malicious image
to try and attack the hypervisor itself
45
The compelling story
www.rackspace.com
46. • Some end users have really slow
connections
46
The compelling story
www.rackspace.com
47. • Some end users have really slow
connections
– Upload will take a long time
47
The compelling story
www.rackspace.com
48. • Some end users have really slow
connections
– Upload will take a long time
– Lots of really slow, long-running uploads
can tie up the image service
48
The compelling story
www.rackspace.com
49. • Some end users have really slow
connections
– Upload will take a long time
– Lots of really slow, long-running uploads
can tie up the image service
– The Image Service is kind of important
for Nova
49
The compelling story
www.rackspace.com
50. • How to get information back to
users?
50
The compelling story
www.rackspace.com
51. • How to get information back to
users?
– The Image status field is not very
descriptive
51
The compelling story
www.rackspace.com
52. • How to get information back to
users?
– The Image status field is not very
descriptive
– The uploaded thing might not be a VM
image, anyway … do we really want to
create an “image” that’s not an image?
52
The compelling story
www.rackspace.com
53. • We want to find a way for end users
to:
– Upload their custom VM images into an
OpenStack cloud
53
The compelling story
www.rackspace.com
54. • We want to find a way for end users
to:
– Upload their custom VM images into an
OpenStack cloud
– In such a way that the uploaded data can
be verified as a VM image
54
The compelling story
www.rackspace.com
55. • We want to find a way for end users
to:
– Upload their custom VM images into an
OpenStack cloud
– In such a way that the uploaded data can
be verified as a VM image
– And scanned for malware or exploits
55
The compelling story
www.rackspace.com
56. • We want to find a way for end users
to:
– Upload their custom VM images into an
OpenStack cloud
– In such a way that the uploaded data can
be verified as a VM image
– And scanned for malware or exploits
– Using an interface that’s common across
OpenStack installations
56
The compelling story
www.rackspace.com
57. • We want to find a way for end users
to:
– Upload their custom VM images into an
OpenStack cloud
– In such a way that the uploaded data can
be verified as a VM image
– And scanned for malware or exploits
– Using an interface that’s common across
OpenStack installations
– Yet is customizable as to the actual
workflow
57
The compelling story
www.rackspace.com
58. • We want to find a way for end users
to:
– Upload their custom VM images into an
OpenStack cloud
– In such a way that the uploaded data can
be verified as a VM image
– And scanned for malware or exploits
– Using an interface that’s common across
OpenStack installations
– Yet is customizable as to the actual
workflow
– And which provides useful feedback to
the end user
58
The compelling story
www.rackspace.com
59. • And …
– End users may want to download images
to move them to another cloud for
various reasons
59
The compelling story
www.rackspace.com
60. • And …
– End users may want to download images
to move them to another cloud for
various reasons
– The same problems present themselves
60
The compelling story
www.rackspace.com
61. • And …
– End users may want to download images
to move them to another cloud for
various reasons
– The same problems present themselves
– A provider may want to pre-process an
image before it’s handed over to an end
user
61
The compelling story
www.rackspace.com
62. • And …
– End users may want to download images
to move them to another cloud for
various reasons
– The same problems present themselves
– A provider may want to pre-process an
image before it’s handed over to an end
user
– The end user may have a slow
connection, etc.
62
The compelling story
www.rackspace.com
63. • And …
– End users may want to download images
to move them to another cloud for
various reasons
– The same problems present themselves
– A provider may want to pre-process an
image before it’s handed over to an end
user
– The end user may have a slow
connection, etc.
– We’re dealing with another long-running,
asynchronous image-related activity
63
The compelling story
www.rackspace.com
64. • And …
– End users may want to download images
to move them to another cloud for
various reasons
– The same problems present themselves
– A provider may want to pre-process an
image before it’s handed over to an end
user
– The end user may have a slow
connection, etc.
– We’re dealing with another long-running,
asynchronous image-related activity
– Would like a way to handle this direction,
too
64
The compelling story
www.rackspace.com
65. • And …
– End users may want to move images
from one isolated cloud region to another
65
The compelling story
www.rackspace.com
66. • And …
– End users may want to move images
from one isolated cloud region to another
– End users may want to move images
from one OpenStack cloud to another
OpenStack cloud
66
The compelling story
www.rackspace.com
67. • And …
– End users may want to move images
from one isolated cloud region to another
– End users may want to move images
from one OpenStack cloud to another
OpenStack cloud
– Yet another long-running, asynchronous
image-related activity
67
The compelling story
www.rackspace.com
69. • Provide a common API across
OpenStack installations
– /v2/tasks
Glance tasks
69www.rackspace.com
70. • Provide a common API across
OpenStack installations
– /v2/tasks
• Workflow is customizable per cloud
provider
Glance tasks
70www.rackspace.com
71. • Provide a common API across
OpenStack installations
– /v2/tasks
• Workflow is customizable per cloud
provider
• Don’t create an image until there’s a
high probability of success
Glance tasks
71www.rackspace.com
72. • Provide a common API across
OpenStack installations
– /v2/tasks
• Workflow is customizable per cloud
provider
• Don’t create an image until there’s a
high probability of success
• Provide a way to deliver meaningful,
helpful error messages
Glance tasks
72www.rackspace.com
73. • Provide a common API across
OpenStack installations
– /v2/tasks
• Workflow is customizable per cloud
provider
• Don’t create an image until there’s a
high probability of success
• Provide a way to deliver meaningful,
helpful error messages
• Concept of expiration built in
Glance tasks
73www.rackspace.com
74. • Provide a common API across
OpenStack installations
– /v2/tasks
• Workflow is customizable per cloud
provider
• Don’t create an image until there’s a
high probability of success
• Provide a way to deliver meaningful,
helpful error messages
• Concept of expiration built in
• Frees the normal upload/download
path for trusted users
Glance tasks
74www.rackspace.com
79. Glance task schema (abbreviated)
79www.rackspace.com
{ "name": "task",
"properties": {
"expires_at": {
"description": "Datetime when this resource would be subject to removal”},
"input": {
"description": "The parameters required by task, JSON blob”},
"message": {
"description": "Human-readable informative message only included when appropriate (usually on failure)”},
"result": {
"description": "The result of current task, JSON blob”},
"status": {
"description": "The current status of this task",
"enum": [ "pending”, "processing”, "success”, "failure” ]},
"type": {
"description": "The type of task represented by this content",
"enum": [ "import” ]}}
}
85. • Glance only stores “real”
images
• Keep Glance highly available
for Nova
Tasks address: MANAGEABILITY
85www.rackspace.com
86. • Glance only stores “real”
images
• Keep Glance highly available
for Nova
• Security
– Screen images for vulnerabilities
Tasks address: MANAGEABILITY
86www.rackspace.com
87. • Tasks enable you to process
images asynchronously
according to current resource
availability
Tasks address: SCALABILITY
87www.rackspace.com
88. • Tasks help manage end users’
expectations
Tasks address: USABILITY
88www.rackspace.com
89. • Tasks help manage end users’
expectations
• Tasks can reduce user frustration
Tasks address: USABILITY
89www.rackspace.com
90. • Tasks help manage end users’
expectations
• Tasks can reduce user frustration
• Tasks can provide better error
feedback
Tasks address: USABILITY
90www.rackspace.com
107. Tasks are customizable …
107www.rackspace.com
"input": {
"description": "The parameters required by task, JSON blob",
"type": "object"
},
"result": {
"description": "The result of current task, JSON blob",
"type": "object"
}
108. Tasks provide a common interface …
108www.rackspace.com
"input": {
"description": "The parameters required by task, JSON blob",
"type": "object"
},
"result": {
"description": "The result of current task, JSON blob",
"type": "object"
}
110. • Tasks provide a common interface, but
the interface hides differences among
cloud providers
Questions
110www.rackspace.com
111. • Tasks provide a common interface, but
the interface hides differences among
cloud providers
• What’s the best way to make these
differences available to end users?
– Documentation?
– Programmatically?
Questions
111www.rackspace.com
112. • Tasks provide a common interface, but
the interface hides differences among
cloud providers
• What’s the best way to make these
differences available to end users?
– Documentation?
– Programmatically?
• How do users discover what upload
facility is available to them?
Questions
112www.rackspace.com
114. WE’RE HIRING!
bit.ly/RackerTalent
Expo Hall Booth P-11
Python OpenStack Engineers
C, C++ Linux Systems Engineers
Ruby DevOps Engineers
Java Frontend & Backend Developers
C#, .NET Software Developer in Test
JavaScript, CSS, HTML iOS/Android Development
Twisted, Backhone Data Scientist
Angular.JS, Ember.js, Node.js Field Sales Specialist
Restful/JSON/XML Strategic Account Executive
Closure, Scala, Erlang
Hadoop, MongoDB, MySQL
Solution Architect
Data Visualization