This document summarizes a presentation about containers, developer defined data centers, and DevOps. It discusses how containers and Kubernetes can enable developers to define their own infrastructure and release code more frequently. It also notes challenges like finding full-stack engineers and complexity. Finally, it recommends trying the open source OpenEBS project for persistent storage in containers and Kubernetes.
Containerized Storage for Containers- Kubernetes LA Meetup , July 2017OpenEBS
The Containerized Storage for Containers(OpenEBS) slides were presented in the Kubernetes Meetup , LA on July 18th , 2017. OpenEBS delivers storage and storage services to containerized environments. OpenEBS allows stateful workloads to be managed more like stateless containers. OpenEBS storage services include: per container (or pod) QoS SLAs, tiering and replica policies across AZs and environments, and predictable and scalable performance. To know more about OpenEBS visit our website www.openebs.io
These are the slides presented at the Docker meetup which was held on 3rd of June in Chennai where our OpenEbs contributor Rahul Krishnan gave a promising demo of OpenEbs Jiva.
Quick overview on the journey of storage w.r.t containers and emerging trends in container storage. A look at the requirements and architectural patterns of the new storage startups. Presented at the Docker meetup#24 at #GoJekIndia
Containerized Storage for Containers- Kubernetes LA Meetup , July 2017OpenEBS
The Containerized Storage for Containers(OpenEBS) slides were presented in the Kubernetes Meetup , LA on July 18th , 2017. OpenEBS delivers storage and storage services to containerized environments. OpenEBS allows stateful workloads to be managed more like stateless containers. OpenEBS storage services include: per container (or pod) QoS SLAs, tiering and replica policies across AZs and environments, and predictable and scalable performance. To know more about OpenEBS visit our website www.openebs.io
These are the slides presented at the Docker meetup which was held on 3rd of June in Chennai where our OpenEbs contributor Rahul Krishnan gave a promising demo of OpenEbs Jiva.
Quick overview on the journey of storage w.r.t containers and emerging trends in container storage. A look at the requirements and architectural patterns of the new storage startups. Presented at the Docker meetup#24 at #GoJekIndia
These slides were presented in the containerization meet-up organized by digital ocean meet-up group in Bangalore. The slides talk about using containers for storage to make the storage truly non-disruptive during upgrades. This is a quick introduction to OpenEBS as well.
From Node Interactive North America 2016. In this talk, Ross Kukulinski, a NodeJS Evangelist, container enthusiast, and NodeSource technical product manager will share his cloud-native implementation of the Internet Archive’s Wayback Machine, including a live demonstration.
Ross will share his goals, architecture, and technology stack choices to implement a scalable, containerized, microservice implementation of the Wayback Machine using Node.JS, Docker, and Kubernetes.
Topics covered in the talk will include:- Architecture- Scaling- Monitoring- CI/CD
Storage 101: Rook and Ceph - Open Infrastructure Denver 2019Sean Cohen
Starting from the basics, we explore the advantages of using Rook as a Storage operator to serve Ceph storage, the leading Software-Defined Storage platform in the Open Source world. Ceph automates the internal storage management, while Rook automates the user-facing operations and effectively turns a storage technology into a service transparent to the user. The combination delivers an impressive improvement in UX and provides the ideal storage platform for Kubernetes.
A comprehensive examination of use cases and open problems will complement our review of the Rook architecture. We will deep-dive into what Rook does well, what it does not do (yet), and what trade-offs using a storage operator involves operationally. With live access to a running cluster, we will showcase Rook in action as we discuss its capabilities.
https://www.openstack.org/summit/denver-2019/summit-schedule/events/23515/storage-101-rook-and-ceph
Workshop: Deploying and Scaling Node.js with KubernetesRoss Kukulinski
From Ross Kukulinski's workshop at Node Interactive US 2016.
As companies look to build out their next-generation architectures, Node.js and containerization are emerging as two major components for powering rapid technical innovation. In this technical workshop, we will show you how to get started with Node.js, Docker and Kubernetes and cover the pitfalls that often occur when starting and how to avoid them. Most of this workshop will be a live demonstration as we dockerize a Node.js application, deploy to Kubernetes, and scale to handle a large amount of traffic.
Get an intro on Kubernetes and how to deploy through Rancher. Discover how to start your CI/CD flow and integrate your build tools within Kubernetes. We'll show you how to secure your environment and manage your logging and monitoring.
Using Rook to Manage Kubernetes Storage with CephCloudOps2005
Moh Ahmed and Raymond Maika presented 'Using Rook to Manage Kubernetes Storage with Ceph' at Montreal's first Cloud Native Day, which took place on June 11 in Montreal.
Introduction to Flocker which is a lightweight volume and container manager.
Meetup details of my presentation:
http://www.meetup.com/Docker-Bangalore/events/222476025/
You wish you could learn just one platform and never have to learn another one, but that's not how software works. Today’s epic swell is tomorrow's choppy ripples. Today's cloud nine is tomorrow's smog. What you really need to learn is how to surf… on clouds.
So catch the wave and we’ll ride the white fluffies together. We’ll start with Kubernetes, the cloud container orchestration engine Google seeded, and Mesos, the scheduling framework from which Twitter and Apple are hanging ten. Then we’ll throw on the afterburner with the Mesosphere Datacenter Operating System (DCOS) and deploy orchestrators, like Kubernetes and Marathon, alongside distributed services, like Spark and Cassandra, to open up a universe of possibilities.
Video: https://www.youtube.com/watch?v=qku6ilFG5RM
How to Survive an OpenStack Cloud Meltdown with CephSean Cohen
What if you lost your datacenter completely in a catastrophe, but your users hardly noticed? Sounds like a mirage, but it’s absolutely possible.
This talk will showcase OpenStack features enabling multisite and disaster recovery functionalities. We’ll present the latest capabilities of OpenStack and Ceph for Volume and Image Replication using Ceph Block and Object as the backend storage solution, as well as look at the future developments they are driving to improve and simplify the relevant architecture use cases, such as Distributed NFV, an emerging use case that rationalizes your IT by using less control planes and allows you to spread your VNF on multiple datacenters and edge deployments.
In this session you will learn about wew OpenStack features enabling Multisite and distributed deployments, as well as review key use cases, architecture design and best practices to help operations avoid the OpenStack cloud Meltdown nightmare.
https://youtu.be/n2S7uNC_KMw
https://goo.gl/cRNGBK
Persistent Storage with Containers with Kubernetes & OpenShiftRed Hat Events
Manually configuring mounts for containers to various network storage platforms and services is tedious and time consuming. OpenShift and Kubernetes provides a rich library of volume plugins that allow authors of containerized applications (Pods) to declaratively specify what the storage requirements for the containers are so that OpenShift can dynamically provision and allocate the storage assets for the specified containers. As the author of the Kubernetes Persistent Volume specification, I will provide an overview of how Persistent Volume plugins work in OpenShift, demo block storage and file storage volume plugins and close with the Red Hat storage roadmap.
Presented at LinuxCon/ContainerCon by Mark Turansky, Principal Software Engineer, Red Hat
Mark Turansky is a Principal Software Engineer at Red Hat and a full-time contributor to the Kubernetes Project. Mark is the author of the Kubernetes Persistent Volume specification and a member of the Red Hat OpenShift Engineering team.
Containers seem to have suddenly become the hot new thing everyone is talking about, but what are they?
Why are they important?
How should you use them and what does it mean for cloud infrastructure? This talk will examine the history, technical details and strategy around containerisation from the perspective of developers and operations, consider internal container OSs like Rocket and Ubuntu Core as well as management layers like Docker and Apache Mesos and take a look at why cloud providers are launching their own services around them.
Presented by David Mytton at Datacloud Monaco 2015-06-04
Platform as a Service with Kubernetes and Mesos Miguel Zuniga
Platform as a Service with Kubernetes and Mesos on top of openstack
Go through the design, architecture, HA, security and how to design and roll services.
Teaching Elephants to Dance (Federal Audience): A Developer's Journey to Digi...Burr Sutter
We can be brilliant developers, but we won’t succeed—and won’t lead our organizations to succeed—without a new perspective (if you will) and new assumptions about the components of the “technology ecosystem” that are fundamentally critical to our success. This includes the operators, QA team, DBAs, security folks, and even the pure business contingent—in most cases, each of these individuals and groups plays a critical role in the success of what we create and give birth to as developers. What we do in isolation might be genius, but if we insulate ourselves—especially with arrogance—from these colleagues, neither our code nor our organizations will realize their full potential, and most will fail. The bottom line is that our old ways are no longer viable, and as the elite within our industry, we will be the leaders and heroes who discard old assumptions and adopt a new perspective in this exciting journey to digital transformation—where the impossible can become reality.
Two years ago at Devoxx UK we talked about DevOps, what it was, why it was important and how to get started. Boy, was it scary. Now we’re wiser. More battle-scarred. The large scale of the challenge for application writers exploiting cloud and DevOps is clearer, but so is the path forward. Understanding the DevOps approach is important, but equally you must understand specific deployment technologies, security issues, operational reliability, and how to drive organisational transformation. Whether creating simple applications or sophisticated microservice architectures many of the challenges are the same. Join us to learn how you can apply this within your team and company.
These slides were presented in the containerization meet-up organized by digital ocean meet-up group in Bangalore. The slides talk about using containers for storage to make the storage truly non-disruptive during upgrades. This is a quick introduction to OpenEBS as well.
From Node Interactive North America 2016. In this talk, Ross Kukulinski, a NodeJS Evangelist, container enthusiast, and NodeSource technical product manager will share his cloud-native implementation of the Internet Archive’s Wayback Machine, including a live demonstration.
Ross will share his goals, architecture, and technology stack choices to implement a scalable, containerized, microservice implementation of the Wayback Machine using Node.JS, Docker, and Kubernetes.
Topics covered in the talk will include:- Architecture- Scaling- Monitoring- CI/CD
Storage 101: Rook and Ceph - Open Infrastructure Denver 2019Sean Cohen
Starting from the basics, we explore the advantages of using Rook as a Storage operator to serve Ceph storage, the leading Software-Defined Storage platform in the Open Source world. Ceph automates the internal storage management, while Rook automates the user-facing operations and effectively turns a storage technology into a service transparent to the user. The combination delivers an impressive improvement in UX and provides the ideal storage platform for Kubernetes.
A comprehensive examination of use cases and open problems will complement our review of the Rook architecture. We will deep-dive into what Rook does well, what it does not do (yet), and what trade-offs using a storage operator involves operationally. With live access to a running cluster, we will showcase Rook in action as we discuss its capabilities.
https://www.openstack.org/summit/denver-2019/summit-schedule/events/23515/storage-101-rook-and-ceph
Workshop: Deploying and Scaling Node.js with KubernetesRoss Kukulinski
From Ross Kukulinski's workshop at Node Interactive US 2016.
As companies look to build out their next-generation architectures, Node.js and containerization are emerging as two major components for powering rapid technical innovation. In this technical workshop, we will show you how to get started with Node.js, Docker and Kubernetes and cover the pitfalls that often occur when starting and how to avoid them. Most of this workshop will be a live demonstration as we dockerize a Node.js application, deploy to Kubernetes, and scale to handle a large amount of traffic.
Get an intro on Kubernetes and how to deploy through Rancher. Discover how to start your CI/CD flow and integrate your build tools within Kubernetes. We'll show you how to secure your environment and manage your logging and monitoring.
Using Rook to Manage Kubernetes Storage with CephCloudOps2005
Moh Ahmed and Raymond Maika presented 'Using Rook to Manage Kubernetes Storage with Ceph' at Montreal's first Cloud Native Day, which took place on June 11 in Montreal.
Introduction to Flocker which is a lightweight volume and container manager.
Meetup details of my presentation:
http://www.meetup.com/Docker-Bangalore/events/222476025/
You wish you could learn just one platform and never have to learn another one, but that's not how software works. Today’s epic swell is tomorrow's choppy ripples. Today's cloud nine is tomorrow's smog. What you really need to learn is how to surf… on clouds.
So catch the wave and we’ll ride the white fluffies together. We’ll start with Kubernetes, the cloud container orchestration engine Google seeded, and Mesos, the scheduling framework from which Twitter and Apple are hanging ten. Then we’ll throw on the afterburner with the Mesosphere Datacenter Operating System (DCOS) and deploy orchestrators, like Kubernetes and Marathon, alongside distributed services, like Spark and Cassandra, to open up a universe of possibilities.
Video: https://www.youtube.com/watch?v=qku6ilFG5RM
How to Survive an OpenStack Cloud Meltdown with CephSean Cohen
What if you lost your datacenter completely in a catastrophe, but your users hardly noticed? Sounds like a mirage, but it’s absolutely possible.
This talk will showcase OpenStack features enabling multisite and disaster recovery functionalities. We’ll present the latest capabilities of OpenStack and Ceph for Volume and Image Replication using Ceph Block and Object as the backend storage solution, as well as look at the future developments they are driving to improve and simplify the relevant architecture use cases, such as Distributed NFV, an emerging use case that rationalizes your IT by using less control planes and allows you to spread your VNF on multiple datacenters and edge deployments.
In this session you will learn about wew OpenStack features enabling Multisite and distributed deployments, as well as review key use cases, architecture design and best practices to help operations avoid the OpenStack cloud Meltdown nightmare.
https://youtu.be/n2S7uNC_KMw
https://goo.gl/cRNGBK
Persistent Storage with Containers with Kubernetes & OpenShiftRed Hat Events
Manually configuring mounts for containers to various network storage platforms and services is tedious and time consuming. OpenShift and Kubernetes provides a rich library of volume plugins that allow authors of containerized applications (Pods) to declaratively specify what the storage requirements for the containers are so that OpenShift can dynamically provision and allocate the storage assets for the specified containers. As the author of the Kubernetes Persistent Volume specification, I will provide an overview of how Persistent Volume plugins work in OpenShift, demo block storage and file storage volume plugins and close with the Red Hat storage roadmap.
Presented at LinuxCon/ContainerCon by Mark Turansky, Principal Software Engineer, Red Hat
Mark Turansky is a Principal Software Engineer at Red Hat and a full-time contributor to the Kubernetes Project. Mark is the author of the Kubernetes Persistent Volume specification and a member of the Red Hat OpenShift Engineering team.
Containers seem to have suddenly become the hot new thing everyone is talking about, but what are they?
Why are they important?
How should you use them and what does it mean for cloud infrastructure? This talk will examine the history, technical details and strategy around containerisation from the perspective of developers and operations, consider internal container OSs like Rocket and Ubuntu Core as well as management layers like Docker and Apache Mesos and take a look at why cloud providers are launching their own services around them.
Presented by David Mytton at Datacloud Monaco 2015-06-04
Platform as a Service with Kubernetes and Mesos Miguel Zuniga
Platform as a Service with Kubernetes and Mesos on top of openstack
Go through the design, architecture, HA, security and how to design and roll services.
Teaching Elephants to Dance (Federal Audience): A Developer's Journey to Digi...Burr Sutter
We can be brilliant developers, but we won’t succeed—and won’t lead our organizations to succeed—without a new perspective (if you will) and new assumptions about the components of the “technology ecosystem” that are fundamentally critical to our success. This includes the operators, QA team, DBAs, security folks, and even the pure business contingent—in most cases, each of these individuals and groups plays a critical role in the success of what we create and give birth to as developers. What we do in isolation might be genius, but if we insulate ourselves—especially with arrogance—from these colleagues, neither our code nor our organizations will realize their full potential, and most will fail. The bottom line is that our old ways are no longer viable, and as the elite within our industry, we will be the leaders and heroes who discard old assumptions and adopt a new perspective in this exciting journey to digital transformation—where the impossible can become reality.
Two years ago at Devoxx UK we talked about DevOps, what it was, why it was important and how to get started. Boy, was it scary. Now we’re wiser. More battle-scarred. The large scale of the challenge for application writers exploiting cloud and DevOps is clearer, but so is the path forward. Understanding the DevOps approach is important, but equally you must understand specific deployment technologies, security issues, operational reliability, and how to drive organisational transformation. Whether creating simple applications or sophisticated microservice architectures many of the challenges are the same. Join us to learn how you can apply this within your team and company.
StackEngine has talked to over 100 businesses about the direction and needs of companies ranging from start ups still in Stealth mode to the Fortune 100. Combine these learnings with the features currently included in the StackEngine Controller and a solution to production operation begins to come to light.
To think about a production operation we:
* Establish the characteristics of an ideal containerized application.
* Motivate those characteristics in terms of business benefit.
* Discuss the "final mile" problem of taking a containerized service and making it available to the operations team.
* Now that containers are running, how do we inventory what we have and the state that it is in?
* Demo Host, Container and Search pages as a means of inventory management.
* When our monitoring tells us something is wrong on a host, what do we do?
* How do services find each other?
* Discuss how StackEngine will provide service discovery.
* Provide a roadmap overview
Container Soup for Your Soul: The Microservice Edition, Building Deployment ...Amazon Web Services
The talk is the story of a Clever's journey to effectively use a container orchestration system (ECS) and a walk through decisions to create a simple and effective deployment pipeline. We will go through various aspects of building application deployment pipelines for microservices. Clever is an education technology company and we do hundreds of deployments of tens of thousands of containers every week to serve over 50% of K-12 public and private school districts in the US. Learn More: https://aws.amazon.com/government-education/
AWS and Open Cloud, All Things Open, 10/25/2013, Raleigh NCGreg DeKoenigsberg
How does open cloud compete with AWS? By recognizing that AWS has won, and by duplicating its functionality and semantics as rapidly as possible to provide users with desperately needed choice.
Your Goat Antifragiled My Snowflake!: Demystifying DevOps Jargon - ChefConf 2015Chef
From ChefConf 2015.
https://youtu.be/OU3F_UU-Jpc
Are you a cow, a pet, a canary, or a unicorn? Do you prefer blue/green, or red/green/refactor? Who the heck is Brent?
Welcome to DevOps, where we are all about breaking down walls. But, we've created a private dialect, full of familiar words with unfamiliar meanings, and in-jokes upon in-jokes. Many newcomers wish there was a glossary for the movement. Time to be inclusive!
In this fun session, we'll go over some of the more unintuitive terms (being a goat is a good thing!) and the backstories behind them. We'll have an extended audience participation segment in which you can ask about words you've heard.
AppSec Pipelines and Event based SecurityMatt Tesauro
Presented at AppSec California 2017, this is a continuation of earlier talks about AppSec Pipelines and demonstrates 1st and 2nd Gen Pipelines, how OWASP is creating a pipeline for its projects and how several companies have benefited from combining DevOps, Agile, CI/CD and Security into an AppSec Pipeline to move beyond traditional AppSec testing.
Why do containers suddenly matter so much when they have been around since 1998? Take a look at the potential of OpenStack's Magnum, Murano and Nova-Docker in the context leveraging the incredible interest in Linux Containers brought about by Docker.
Check out www.stackengine.com to learn more about our excellent container management solution.
Teaching Elephants to Dance (and Fly!) A Developer's Journey to Digital Trans...Burr Sutter
We can be brilliant developers, but we won’t succeed—and won’t lead our organizations to succeed—without a new perspective (if you will) and new assumptions about the components of the “technology ecosystem” that are fundamentally critical to our success. This includes the operators, QA team, DBAs, security folks, and even the pure business contingent—in most cases, each of these individuals and groups plays a critical role in the success of what we create and give birth to as developers. What we do in isolation might be genius, but if we insulate ourselves—especially with arrogance—from these colleagues, neither our code nor our organizations will realize their full potential, and most will fail. The bottom line is that our old ways are no longer viable, and as the elite within our industry, we will be the leaders and heroes who discard old assumptions and adopt a new perspective in this exciting journey to digital transformation—where the impossible can become reality.
Rapid Prototyping with Sass, Compass and Middleman by Bermon PainterCodemotion
This talk will cover some of the benefits of building a rapid prototyping framework with Sass & Compass along with the static site generator, Nanoc. you’ll discover how to rapid prototype pages, widgets and interactions that can be used for usability testing and to help concept ideas. Since it’s all built on Ruby it’s easy to migrate over to the real application later or toss away
Interoperable Clouds and How to Build (or Buy) ThemMark Voelker
What's up with interop in OpenStack, Kubernetes, and more!
In this talk we'll discuss interoperability of modern open source cloud platforms and describe how the OpenStack, Kubernetes, and OPNFV communities are working toward interoperability standards for their respective platforms. We'll discuss the need for interoperability standards, the types of problems one may encounter, and why interoperability programs are increasingly a trend in open source infrastructure projects. We'll particularly hone in on the OpenStack Powered program and the work of the OpenStack Interop Working Group. Presented at All Things Open 2017.
Lean Engineering: Engineering for Learning & Experimentation in the Enterpris...Rosenfeld Media
Bill Scott: "Lean Engineering: Engineering for Learning & Experimentation in the Enterprise"
Enterprise UX 2015 • May 13, 2015 • San Antonio, TX, USA
http://enterpriseux.net
Redis Conf 2019--Container Attached Storage for RedisOpenEBS
Kubernetes and containerized applications allow development teams to iterate fast, deploy efficiently and operate at scale. Kubernetes allows you to orchestrate containers that are highly available. However, in the case of container reschedule, Kubernetes does not provide a great set of primitives to manage your persistent data along with your application containers. In this talk, we will present some of the challenges associated with managing persistent data in Kubernetes and how we can make day 2 operations easier to manage. We will talk about a couple of approaches to solving data persistence problems in multi-cloud environments. During the demos, we will showcase how we address data replication and data encryption challenges.
cStor is a resilient storage engine built with proven building blocks of storage components. The storage block layer is derived from the user space ZFS inherited from the proven OpenSolaris stack. The volumes can be accessed via iSCSI Target which is derived from Linux to BSD port. Both of these core components of cStor have been field tested at thousands of installations for many years.
About the Talk:
Cloud native ecosystem is bringing a huge change in the way of DevOps in every cloud native organisation. Developers and operators in cloud native organisations are using tools and platforms like Kubernetes to achieve the agility promised by DevOps and microservices. The tools and best practices for stateless applications have been well established and the results can be seen in the agility of teams using these stateless applications. However, stateful applications pose new challenges to DevOps teams in achieving the agility as the best practices around persistent storage management are still emerging. In this talk, first we discuss the challenges faced by DevOps while dealing with persistent storage handling in stateful applications. Then we discuss the open source tools and best practices for DevOps teams to achieve data agility of cloud native applications.
Introduction to cStor replica - Contributors Meet 5th Oct 2018OpenEBS
cStor storage engine has separate container image files for storage controller and storage replica. Docker images for controller is at << https://hub.docker.com/r/openebs/cstor-controller/>> and for replica is at << https://hub.docker.com/r/openebs/cstor-pool/>>. cStor is a high performing storage engine built with proven building blocks of storage components. Access protocol iSCSI stack is a linux ported BSD based Multi-threaded iSCSI protocol stack originally developed at CloudByte. This iSCSI is field tested at thousands of installations for many years". The storage block layer is the DMU layer of user space ZFS inherited from the proven OpenSolaris stack. With these proven building blocks, cStor engine is highly reliable for storing and protecting enterprise data.To know more details click https://docs.openebs.io/docs/next/storageengine.html#cstor
Container Attached Storage (CAS) with OpenEBS - SDC 2018OpenEBS
Applying micro service patterns to storage giving each workload its own Container Attached Storage (CAS) system. This puts the DevOps persona within full control of the storage requirements and brings data agility to k8s persistent workloads. We will go over the concept and the implementation of CAS, as well as its orchestration.
The added features include in 0.7 includes
Management of local nodes
Many NoSQL and other users do not need the resilience features of OpenEBS however they do want management of these nodes. OpenEBS users can now designate local node via their storage classes and have the benefits of metrics and fault management.
Node Disk Management support (NDM). One capability that has been added by MayaData to Kubernetes itself is improvements in the management of storage media in local nodes. OpenEBS 0.7 now uses NDM to improve the resilience and flexibility of Kubernetes for storage.
Data operations automation
As OpenEBS was adopted users increasingly encountered a number of storage and data management tasks such as data clean up, data back-up, copy data operations, auto-scaling and cross availability zone deployment specification and much more. All of these use cases and others have been made simpler to deliver in OpenEBS, to test and validate via Litmus integration in MayaOnline, and to observe and operate in MayaOnline.
Resilience and supportability
The fundamental task of any storage is to keep the data safe. With that in mind, OpenEBS adds resilience and supportability capabilities in each release, such as improved retry logic, improved resilience to network outages, cross availability zone recovery, initial snapshot-based replication, and backup options, and ongoing integrations with emerging Kubernetes capabilities to further increase control and availability.
A new user interface for MayaOnline
MayaOnline has been redesigned to be more intuitive for use in understanding, controlling and troubleshooting stateful environments on Kubernetes.
Thoughts on heptio's ark - Contributors Meet 21st Sept 2018OpenEBS
Create a OpenEBS ARK Plugin that will implement the Block-Store API exposed by ARK
Backup Operation
ARK will invoke the Plugin-Snapshot (Backup) method.
Plugin: will call maya-apiserver backup api on a given volume
Maya-apiserver backup will call volumes (jiva/cstor) backup api
(jiva/cstor) volume controller will take a snapshot, and pass the request to one of the replica’s to push snapshot data to remote backup location (say S3 compatible -- as passed via the ark plugin or a custom backup location on mayaonline or may be a nfs server that openebs supports ). The code to actually push the data to backup location can make use of restic. We are putting it at the jiva/cstor for getting access to snapshot/incr snapshot data.
Restore Operation
ARK will invoke the Plugin-VolumeFromSnapshot (Restore) method
Plugin will invoke maya-apiserver to create a new PV/PVC and restore the data from backup.
ARK will launch the application with the PV/PVC.
Latest (storage IO) patterns for cloud-native applications OpenEBS
Applying micro service patterns to storage giving each workload its own Container Attached Storage (CAS) system. This puts the DevOps persona within full control of the storage requirements and brings data agility to k8s persistent workloads. We will go over the concept and the implementation of CAS, as well as its orchestration.
When one of the zones where application is running is gone, the application (a1) moves to one of the other zones and can access the data from the available replicas.
Kubernetes Monitoring and Troubleshooting using Weavescope- Kubernetes Meetup...OpenEBS
Why monitoring is important?
Application exceptions
Server CPU usage
Server memory usage
Storage Spikes
What is Kubernetes?
Container orchestration tool
Comprises of :
Pods
Services
Controllers
Persistent Volumes
OpenEBS Visualization and Monitoring using Weave-scope - Contributors Meet 1s...OpenEBS
This topic was presented by Satyam - an OpenEBS Contributor at Weekly Contributors Meet held on 1st June.
Weave Scope helps microservices architecture by
Networking of microservices
Visualization of infra
Ease of monitoring and logging
Better view of system configuration
Storage view
Container Attached Storage (CAS) with OpenEBS - Berlin Kubernetes Meetup - Ma...OpenEBS
The OpenEBS project has taken a different approach to storage when it comes to containers. Instead of using existing storage systems and making them work with containers; what if you were to redesign something from scratch using the same paradigms used in the container world? This resulted in the effort of containerizing the storage controller. Also, as applications that consume storage are changing over, do we need a scale-out distributed storage systems?
BDD Testing Using Godog - Bangalore Golang Meetup # 32OpenEBS
BDD uses natural language to describe the "desired behaviour" of the system, that can be understood by both the developer and the customer
Demo of an existing BDD application using Godog predominantly used with golang
Container Attached Storage - Chennai Kubernetes Meetup #2 - April 21st 2018OpenEBS
Container Attached Storage or CAS is a truly cloud native software architecture for applications running in containers. In CAS, the storage software itself is containerized and hence gets the advantages of being a micro service. In CAS architecture, each storage volume gets it's own storage controller running completely in user space and attains the maximum agility and policy granularity.
The slides were presented @ Kubernetes Meetup Bangalore held on 26th May - 2018 by Sathyam Zode - An OpenEBS Contributor and Software Engineer at MayaData .
There is a huge need to containerize the Stateful applications in today's world of Docker and Kubernetes. These stateful applications need a storage architecture that is truly cloud native. Container Attached Storage or CAS is a truly cloud native software architecture for applications running in containers. In CAS, the storage software itself is containerized and hence gets the advantages of being a micro service. In CAS architecture, each storage volume gets it's own storage controller running completely in user space and attains the maximum agility and policy granularity.
The OpenEBS Hangout #4 was held on 22nd December 2017 at 11:00 AM (IST and PST) where a live demo of cMotion was shown . Storage policies of OpenEBS 0.5 were also explained
Containerized storage for CI/CD Pipeline and DevOps - why, how, huh? What is wrong w/ stateful workloads on containers today? What is happening at the Linux kernel to improve the security of containers as a platform FOR storage? Could containers and Kubernetes become the foundations of a new approach to storage? How to deal with storage in multi-cloud environment. Quick view into the OpenEBS project.
Murat Karslioglu is a serial entrepreneur, technologist, and startup geek with over 15 years of experience in storage, distributed systems, and enterprise software development. He is currently the VP of Solutions and Technology at CloudByte / OpenEBS, a startup developing open-source containerized storage for containers.
Prior to joining CloudByte, Murat has worked at Hewlett Packard Enterprise / 3PAR Storage in various advanced development projects including storage file stack performance optimization and the storage management stack for HPE’s Hyper-converged solution. Murat holds a Bachelor’s Degree in Industrial Engineering from the Sakarya University.
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...James Anderson
Effective Application Security in Software Delivery lifecycle using Deployment Firewall and DBOM
The modern software delivery process (or the CI/CD process) includes many tools, distributed teams, open-source code, and cloud platforms. Constant focus on speed to release software to market, along with the traditional slow and manual security checks has caused gaps in continuous security as an important piece in the software supply chain. Today organizations feel more susceptible to external and internal cyber threats due to the vast attack surface in their applications supply chain and the lack of end-to-end governance and risk management.
The software team must secure its software delivery process to avoid vulnerability and security breaches. This needs to be achieved with existing tool chains and without extensive rework of the delivery processes. This talk will present strategies and techniques for providing visibility into the true risk of the existing vulnerabilities, preventing the introduction of security issues in the software, resolving vulnerabilities in production environments quickly, and capturing the deployment bill of materials (DBOM).
Speakers:
Bob Boule
Robert Boule is a technology enthusiast with PASSION for technology and making things work along with a knack for helping others understand how things work. He comes with around 20 years of solution engineering experience in application security, software continuous delivery, and SaaS platforms. He is known for his dynamic presentations in CI/CD and application security integrated in software delivery lifecycle.
Gopinath Rebala
Gopinath Rebala is the CTO of OpsMx, where he has overall responsibility for the machine learning and data processing architectures for Secure Software Delivery. Gopi also has a strong connection with our customers, leading design and architecture for strategic implementations. Gopi is a frequent speaker and well-known leader in continuous delivery and integrating security into software delivery.
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf91mobiles
91mobiles recently conducted a Smart TV Buyer Insights Survey in which we asked over 3,000 respondents about the TV they own, aspects they look at on a new TV, and their TV buying preferences.
State of ICS and IoT Cyber Threat Landscape Report 2024 previewPrayukth K V
The IoT and OT threat landscape report has been prepared by the Threat Research Team at Sectrio using data from Sectrio, cyber threat intelligence farming facilities spread across over 85 cities around the world. In addition, Sectrio also runs AI-based advanced threat and payload engagement facilities that serve as sinks to attract and engage sophisticated threat actors, and newer malware including new variants and latent threats that are at an earlier stage of development.
The latest edition of the OT/ICS and IoT security Threat Landscape Report 2024 also covers:
State of global ICS asset and network exposure
Sectoral targets and attacks as well as the cost of ransom
Global APT activity, AI usage, actor and tactic profiles, and implications
Rise in volumes of AI-powered cyberattacks
Major cyber events in 2024
Malware and malicious payload trends
Cyberattack types and targets
Vulnerability exploit attempts on CVEs
Attacks on counties – USA
Expansion of bot farms – how, where, and why
In-depth analysis of the cyber threat landscape across North America, South America, Europe, APAC, and the Middle East
Why are attacks on smart factories rising?
Cyber risk predictions
Axis of attacks – Europe
Systemic attacks in the Middle East
Download the full report from here:
https://sectrio.com/resources/ot-threat-landscape-reports/sectrio-releases-ot-ics-and-iot-security-threat-landscape-report-2024/
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024Albert Hoitingh
In this session I delve into the encryption technology used in Microsoft 365 and Microsoft Purview. Including the concepts of Customer Key and Double Key Encryption.
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...Ramesh Iyer
In today's fast-changing business world, Companies that adapt and embrace new ideas often need help to keep up with the competition. However, fostering a culture of innovation takes much work. It takes vision, leadership and willingness to take risks in the right proportion. Sachin Dev Duggal, co-founder of Builder.ai, has perfected the art of this balance, creating a company culture where creativity and growth are nurtured at each stage.
The Art of the Pitch: WordPress Relationships and SalesLaura Byrne
Clients don’t know what they don’t know. What web solutions are right for them? How does WordPress come into the picture? How do you make sure you understand scope and timeline? What do you do if sometime changes?
All these questions and more will be explored as we talk about matching clients’ needs with what your agency offers without pulling teeth or pulling your hair out. Practical tips, and strategies for successful relationship building that leads to closing the deal.
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...UiPathCommunity
💥 Speed, accuracy, and scaling – discover the superpowers of GenAI in action with UiPath Document Understanding and Communications Mining™:
See how to accelerate model training and optimize model performance with active learning
Learn about the latest enhancements to out-of-the-box document processing – with little to no training required
Get an exclusive demo of the new family of UiPath LLMs – GenAI models specialized for processing different types of documents and messages
This is a hands-on session specifically designed for automation developers and AI enthusiasts seeking to enhance their knowledge in leveraging the latest intelligent document processing capabilities offered by UiPath.
Speakers:
👨🏫 Andras Palfi, Senior Product Manager, UiPath
👩🏫 Lenka Dulovicova, Product Program Manager, UiPath
Epistemic Interaction - tuning interfaces to provide information for AI supportAlan Dix
Paper presented at SYNERGY workshop at AVI 2024, Genoa, Italy. 3rd June 2024
https://alandix.com/academic/papers/synergy2024-epistemic/
As machine learning integrates deeper into human-computer interactions, the concept of epistemic interaction emerges, aiming to refine these interactions to enhance system adaptability. This approach encourages minor, intentional adjustments in user behaviour to enrich the data available for system learning. This paper introduces epistemic interaction within the context of human-system communication, illustrating how deliberate interaction design can improve system understanding and adaptation. Through concrete examples, we demonstrate the potential of epistemic interaction to significantly advance human-computer interaction by leveraging intuitive human communication strategies to inform system design and functionality, offering a novel pathway for enriching user-system engagements.
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...DanBrown980551
Do you want to learn how to model and simulate an electrical network from scratch in under an hour?
Then welcome to this PowSyBl workshop, hosted by Rte, the French Transmission System Operator (TSO)!
During the webinar, you will discover the PowSyBl ecosystem as well as handle and study an electrical network through an interactive Python notebook.
PowSyBl is an open source project hosted by LF Energy, which offers a comprehensive set of features for electrical grid modelling and simulation. Among other advanced features, PowSyBl provides:
- A fully editable and extendable library for grid component modelling;
- Visualization tools to display your network;
- Grid simulation tools, such as power flows, security analyses (with or without remedial actions) and sensitivity analyses;
The framework is mostly written in Java, with a Python binding so that Python developers can access PowSyBl functionalities as well.
What you will learn during the webinar:
- For beginners: discover PowSyBl's functionalities through a quick general presentation and the notebook, without needing any expert coding skills;
- For advanced developers: master the skills to efficiently apply PowSyBl functionalities to your real-world scenarios.
Securing your Kubernetes cluster_ a step-by-step guide to success !KatiaHIMEUR1
Today, after several years of existence, an extremely active community and an ultra-dynamic ecosystem, Kubernetes has established itself as the de facto standard in container orchestration. Thanks to a wide range of managed services, it has never been so easy to set up a ready-to-use Kubernetes cluster.
However, this ease of use means that the subject of security in Kubernetes is often left for later, or even neglected. This exposes companies to significant risks.
In this talk, I'll show you step-by-step how to secure your Kubernetes cluster for greater peace of mind and reliability.
Securing your Kubernetes cluster_ a step-by-step guide to success !
Ep keyote slides
1. Containers: And 3D-C
Containers & Developer Defined Data Centers (D^3, C)
Evan Powell - @epowell101
Containers in Production
Bangalore
April 7, 2017
11. Who dat?
2001 2008 2016
The 2017 case for acceleration in innovation & the persistence of unicorns:
https://venturebeat.com/2017/02/11/were-not-in-a-bubble-were-in-a-revolution/
12. 4:45PM Kubernetes - Google - standards and OCI
Today!
App security Kubernetes
design
Docker in
production
Containers in
prod w Rancher
Containers in
prod w K8S
Containers in
prod w Cl
Foundry
NOW DevOps & Containers: Developer Defined Data Centers &
you
Cloud
alternatives
13. Why DevOps? So what?
https://puppet.com/resources/white-paper/2016-state-of-devops-report
14. Why DevOps? So what?
https://puppet.com/resources/white-paper/2016-state-of-devops-report
SAY DEVOPS
ONE MORE TIME
15. Why DevOps? So what?
https://puppet.com/resources/white-paper/2016-state-of-devops-report
‘80-’90 ‘90-’00 ‘00-’10 ‘10-’15
Revenue per employee, India tech (‘80-
’15)
SAY DEVOPS
ONE MORE TIME
16. Adoption: Bimodal IT: Retailer
Marks and Spencer: Enterprise DevOps presentation ‘15
17. Before After
4 releases per year
45-90 days of testing
Big releases
Monolithic
Large operations teams that limit risk and
developer choice
Hopelessly outclassed vs. Amazon
18. Before After
4 releases per year 5-7 releases per week
45-90 days of testing 1-3 hours of testing
Big releases Tiny releases
Monolithic 12 factor, containerized
Large operations teams that limit risk and
developer choice
NoOps - or DevOps - with a handful of
engineers doing the work of dozens
Hopelessly outclassed vs. Amazon Competitive
20. Challenges
People Full stack engineers that are willing to wear a
pager are rare.
Complexity Many simple bricks, tied together, work well; until
they don’t.
OpenSource Communities that grow quickly are great; until
they don’t.
Transparency Everyone knows everything.
Infrastructure as code Ops teams using GitHub.
Failure Daily. Ones you notice & understand are good.
Persistence You need it. To keep going. And to enable the
next wave in analytics - machine learning.
21. People Full stack engineers that are willing to wear a
pager are rare.
Complexity Many simple bricks, tied together, work well; until
they don’t.
OpenSource Communities that grow quickly are great; until
they aren't.
Transparency Everyone knows everything.
Infrastructure as code Ops teams using GitHub.
Failure Daily. Ones you notice & understand are good.
Persistence You need it. To keep going. And to enable the
next wave in analytics - machine learning.
Challenges
22. What projects?
Hard to overstate the promise of
Kubernetes
● Makes real the hype that crazy people were
throwing around about software defined
years ago*
● Part of a move to DevOps & NoOps
○ Which is disrupting all tech vendors
○ Also disrupting most industries
* https://blog.openebs.io/software-defined-storage-finally-37fdffc0e37c
23. The magic of K8S
Manifests
express
intent
stateless
24. Before OpenEBS DevOps workflow broken
Manifests
express
intent
K8S used rarely for apps requiring persistence
because they require brittle tight coupling.
Container 1 Container 2 Container 2
Hard wired connections via plug-in
stateless
stateful
NAS SAN S3 NAS SAN S3
Legacy storage
Flocker, Docker,
EMC plug-ins
25. Manifests
express
intent
stateless stateful
No changes to DevOps workflow even for containers requiring
persistence. Users manifest their intent and the storage and
storage controllers adjust automatically as needed.
Maya
Policy engine
Remote Storage
Local Storage
OpenEBS Storage
Hosts
OpenEBS VSMs
OpenEBS Storage Cluster
APIs
Containers and underlying storage,
local on host or dedicated storage
pods OR remote S3 or EBS storage
all grouped into a storage cloud that
just works. Billing by AWS.
Manifests
express
intent
With OpenEBS the workflow works
26. What if I were you, what would I try to do?
1
2
3
Try OpenEBS - find OSS that you can use & influence
● 0.2 being released in the next few days
27. What if I were you, what would I try to do?
1
2
3
Rage quit
Try OpenEBS - find OSS that you can use & influence
● 0.2 being released in the next few days
28. What if I were you, what would I try to do?
1
2
3
Rage quit
Save the world
Try OpenEBS - find OSS that you can use & influence
● 0.2 being released in the next few days
29. 4:45PM Kubernetes - Google - standards and OCI
Today!
App security Kubernetes
design
Docker in
production
Containers in
prod w Rancher
Containers in
prod w K8S
Containers in
prod w Cl
Foundry
NOW DevOps & Containers: Developer Defined Data Centers &
you
Cloud
alternatives
@epowell101
Editor's Notes
Good morning. Let’s start with a test. Who knows what this curve represents? I’m going to show you another one in a second. But let’s make this interesting. Whoever guesses right - free use of some office space at our offices for 6 months for your start-up. Or a free batch of stickers, whichever you’d like more.
Ok, how about now? The one on the right now goes from $1 billion to $143 billion. What if I tell you the X axis is time….
First off, many thanks!
First off, many thanks!
By comparison, Facebook is approximately at $1.5 million.