Cloud Surfing: Kubernetes on Mesos

•

1 like•504 views

Kubernetes: it’s new; it’s cool; and you want it! But you have questions… Is deployment easy? Does it scale? Can it be upgraded in place? Will it work with your existing services? Can it handle big data workloads? You wish you could learn just one platform and never have to learn another one, but that's not how software works. Today’s epic swell is tomorrow's choppy ripples. Today's cloud nine is tomorrow's smog. What you really need to learn is how to surf… on clouds. So catch the wave and we’ll ride the white fluffies together. We’ll start with Kubernetes, the cloud container orchestration engine Google seeded, and Mesos, the scheduling framework from which Twitter and Apple are hanging ten. Then we’ll throw on the afterburner with the Mesosphere Datacenter Operating System (DCOS) and deploy orchestrators, like Kubernetes and Marathon, alongside distributed services, like Spark and Cassandra, to open up a universe of possibilities. KubeCon schedule link: http://sched.co/4V0d

Technology

© 2015 Mesosphere, Inc. All Rights Reserved. 1
Cloud Surfing:
Kubernetes on Mesos
Karl Isenberg

© 2015 Mesosphere, Inc. All Rights Reserved. 3
Is your PaaS backed by Hadoop?
Why is OpenStack on top of AWS?
Do you even lift bro?
The Cloud

© 2015 Mesosphere, Inc. All Rights Reserved. 4
Renton Thurston - Eureka Seven
Cloud Surfing 101 - Lifting
1. Survey landscape
2. Stay as high level as possible
3. Dive down when you need
4. Choose your board wisely

© 2015 Mesosphere, Inc. All Rights Reserved. 5
Light Finding Operation (LFO) - Eureka Seven
Cloud Surfing 102 - Tool Selection
1. No one tool solves all problems
2. Pick the right tool for the job
3. Pick tools that do one thing well
4. Prefer small APIs
5. Chain your tricks together

© 2015 Mesosphere, Inc. All Rights Reserved. 6
Cloud Surfing
103:
Atmospheric
Layers
Application Orchestration
Container Orchestration
Job Scheduling
Containerization
Resource Management
Provisioning
CloudFoundry, Heroku,
OpenShift
Kubernetes, Marathon,
Swarm, Fleet, Lattice, ECS
Chronos, Kubernetes
Docker, Rkt, Garden, Mesos
Mesos
Puppet, Chef, Ansible, Salt,
Vagrant, Otto
non-exhaustive
Machine Management
AWS, Azure, GCE, OpenStack,
vSphere, VirtualBox, Fusion

© 2015 Mesosphere, Inc. All Rights Reserved.
DCOS
7
Datacenter
Operating
System
Application Orchestration
Container Orchestration
Job Scheduling
Containerization
Resource Management
Provisioning
CloudFoundry, Heroku,
OpenShift
Kubernetes, Marathon,
Swarm, Fleet, Lattice, ECS
Chronos, Kubernetes
Docker, Rkt, Garden, Mesos
Mesos
Vagrant, Otto, Puppet, Chef,
Ansible, Salt
Machine Management
AWS, Azure, GCE, OpenStack,
vSphere, VirtualBox, Fusion

© 2015 Mesosphere, Inc. All Rights Reserved. 8
Demo: DCOS
- dcos package install cassandra
- dcos package install etcd
- dcos package install kubernetes

© 2015 Mesosphere, Inc. All Rights Reserved. 9
Demo: Oinker
- Mini twitter clone
- Deployed on Kubernetes
- Replicated 3x
- Backed by Cassandra-Mesos
- Discovery with Mesos DNS
- github.com/karlkfi/oinker-go

© 2015 Mesosphere, Inc. All Rights Reserved. 10
Q: What does Kubernetes manage?
A: Applications & Services
Q: What does Mesos manage?
A: Tasks & Resources
Q: What does DCOS manage?
A: Frameworks
Pop Quiz!
Don’t worry!
This ain’t rocket surgery.

© 2015 Mesosphere, Inc. All Rights Reserved. 11
As Seen On Stage
- kubernetes.io
- mesos.apache.org
- mesosphere.com/product (DCOS)
- github.com/mesosphere/kubernetes-mesos
- github.com/mesosphere/cassandra-mesos
- github.com/mesosphere/universe
- github.com/mesosphere/multiverse
- github.com/mesosphere/dcos-cli
- github.com/karlkfi/oinker-go
Bonus
- mesosphere.github.io/marathon
- github.com/karlkfi/mesos-compose-dind
But You Don’t
Have To Take
My Word For It

© 2015 Mesosphere, Inc. All Rights Reserved. 12
FIN

What's hot

Sjug aug 2010_cloud

Michael Neale

Mesos and the Architecture of the New Datacenter

QAware GmbH

HTCondor flocking between two clouds

Guy Tel-Zur

Deltacloud - Abstracting for Freedom

Stephen Gordon

Aaron Williams (Head of Advocacy at Mesosphere) and Ryan Lee (Cloud Infrastructure Engineer at 10th Magnitude) demonstrate how to use Mesosphere DCOS on Microsoft Azure to easily deploy Docker containers at scale. This presentation and linked video (https://youtu.be/xNEZFRsANMk) will walk you through: - What microservices are, and why a microservice-based architecture might be the right choice for your company - How to easily deploy DCOS on Microsoft Azure - Several different scenarios for deploying Docker containers using DCOS on Azure http://www.mesosphere.com http://www.10thmagnitude.com

Easy Docker Deployments with Mesosphere DCOS on Azure

Mesosphere Inc.

Introduction to Apache jclouds at ApacheCon 2014

Everett Toews

Open source documentation is generally awful, often frightening, and sometimes it’s just outright weird. In this discussion, I will show you examples from the entire spectrum of open source documentation, in an effort to try and help you avoid some of the worst mistakes made by others before you. We will discuss why documentation is important for open source projects, and how to go about getting it written, and written well, without making too much of a fool out of yourself.

Open Source Docs: The Good, The Bad, and the WTF?!

Lana Brindley

JBoss Developer Webinar: Cloud: BoxGrinder & SteamCannon

bobmcwhirter

Session Presented @IndicThreads Cloud Computing Conference, Pune, India ( http://u10.indicthreads.com ) ------------ One of the big hurdles for an enterprise to move to the cloud is the fear of getting locked into a specific cloud implementation. This is one of the big reasons apart from security of data that keeps most of the enterprises out of the cloud space. Currently each vendor provides their unique set of API to interact with their Cloud services. This mandates a need to recode and refactor when moving from one cloud provider to the other. jClouds is a multi cloud framework which allows connection to multiple clouds such as Amazon, VMWare, Azure, and Rackspace. jClouds provides portable abstractions for cloud specific features, thus allowing the application to move from one cloud vendor to the other with relative ease. jClouds also had a simulators to operate in restricted environments like Google App Engine and Android. Unit testing and mocking is made easy through stub connections which simulate the cloud. Takeaways from the session * Understand the need for a multi cloud framework * showcase of abstractions for different cloud environments. * Introduction to capabilities of jClouds * Hands on application development using jClouds on GAE

Getting Started with jClouds: Multi Cloud Framework

IndicThreads

JUDCon 2010 Boston : CoolingTower and CirrAS

marekgoldmann

Cloudworks Update: リージョンをまたいだAMIコピー機能

Ryo Ooishi

As clouds become commonplace, there is a need to manage virtual instances across a great variety of clouds and cloud-like environments. Aeolus, an open source project recently launched by Red Hat, lives in the space just below where traditional config management tools like Puppet live. It provides tools for managing virtual instances and images across public, private and hybrid clouds, from image creation to the launch of complex deployments. It enhances existing clouds by providing user management, monitoring and quality-of-service metrics to make intelligent decisions about resource placement, or automate them based on policy, across multiple clouds. All fronted by a friendly self-service web application, with an API in the works.

Aeolus - Clouds Flying in Assembly

lutter

Flexible, simple deployments with OpenStack-Ansible

Major Hayden

The term "cloud portability" is often considered a synonym for "Cloud API portability," which implies a series of misconceptions. If we break away from dogma, we can find that what we really looking for in cloud portability is Application portability between clouds which can be a vastly simpler requirement, as we can achieve application portability without settling on a common Cloud API. .. The following presentation shows how I could use the ideas from this post and provide a practical cloud portability solution today using Cloudify and JClouds. See details in this post: http://natishalom.typepad.com/nati_shaloms_blog/2011/12/making-cloud-portability-a-practical-reality.html

Making cloud portability a practical reality (i pad)

Nati Shalom

Extension de Service Cloud Foundry

VMware Tanzu

Cooling Tower

guest69f868

Managing Your Infrastructure on Azure using SaltStack

Rita Zhang

There’s no doubt, everyone’s talking about container technologies these days. Especially Docker has established itself as a de facto standard here. These technologies are especially suited to develop, run, and deploy microservices. So there are a few things coming together. This talk will give an overview why things like immutable infrastructure, continuous delivery and small autonomous teams make a lot of sense in today’s web scale architectures. Further, we discuss how these technologies can be used to manage an infrastructure with a high amount of containers.

OSDC 2015: Timo Derstappen | Microservice orchestration

NETWAYS

OpenStack!

철민 홍

Firebaseの運用に役立つTips5

ME iBotch

What's hot (20)

Sjug aug 2010_cloud

Mesos and the Architecture of the New Datacenter

HTCondor flocking between two clouds

Deltacloud - Abstracting for Freedom

Easy Docker Deployments with Mesosphere DCOS on Azure

Introduction to Apache jclouds at ApacheCon 2014

Open Source Docs: The Good, The Bad, and the WTF?!

JBoss Developer Webinar: Cloud: BoxGrinder & SteamCannon

Getting Started with jClouds: Multi Cloud Framework

JUDCon 2010 Boston : CoolingTower and CirrAS

Cloudworks Update: リージョンをまたいだAMIコピー機能

Aeolus - Clouds Flying in Assembly

Flexible, simple deployments with OpenStack-Ansible

Making cloud portability a practical reality (i pad)

Extension de Service Cloud Foundry

Cooling Tower

Managing Your Infrastructure on Azure using SaltStack

OSDC 2015: Timo Derstappen | Microservice orchestration

OpenStack!

Firebaseの運用に役立つTips5

Similar to Cloud Surfing: Kubernetes on Mesos

Kubernetes Architecture and Introduction – Paris Kubernetes Meetup

Stefan Schimanski

Kubernetes Kops - Automation Night

Kasper Nissen

Getting Started Running Apache Spark on Apache Mesos

Paco Nathan

There is a transformation brewing for DevOps in age of Kubernetes. The tools of the trade, configuration management solutions, have been superseded in agility and preference by development teams who want the declarative choreography of containerized applications. The new preference for mixing developer and operations is the site reliability engineering (SRE) model championed by Google. In this new structure, the need to automate doesn’t stop at the containerized application and DevOps professionals should seek to automate the Kubernetes service itself. In this webinar, Chris Gaun, Product Marketing Manager at Mesosphere, will cover: The transformation of DevOps to SRE How Kubernetes and DC/OS were catalyst for this change How DevOps professionals can get started with Kubernetes WHO SHOULD ATTEND Tech Professionals Developer Managers IT Managers Note the material is technical and is not intended as sales and marketing training

DevOps vs. Site Reliability Engineering (SRE) in Age of Kubernetes

DevOps.com

Kubernetes Architecture and Introduction

Stefan Schimanski

DevOps in Age of Kubernetes

Mesosphere Inc.

Spring Boot on Kubernetes/OpenShift

Kamesh Sampath

Open Source Cloud, Virtualization and Deployment Technologies

mestery

2013 05-multicloud-paas-interop-scenarios-fia-dublin

Alex Heneveld

Kubernetes Day 2017 - Build, Ship and Run Your APP, Production !!

smalltown

Learn about the challenges the come with deploying and operating Kubernetes at scale and how the Mesosphere DC/OS Kubernetes integration helps solve them. During this presentation, Joerg Schad discusses: 1. Common challenges associated with getting a Kubernetes cluster up and running 2. The basics of running Kubernetes on Mesosphere DC/OS 3. How failure recovery works with the DC/OS-Kubernetes solution

Episode 2: Deploying Kubernetes at Scale

Mesosphere Inc.

Rudraksh Kulshreshtha, from Indiqus presenting how to architect lean CloudStack deployments for Edge use cases. ------------------------------------------ CloudStack European User Group Virtual happened on May 27th. The first CSEUG Virtual proved to be a huge success. It collected people from 23 countries – Germany, the United Kingdom, Switzerland, India, Bulgaria, Greece, Poland, Serbia, Brazil, Chile, Russia, USA, Canada, Japan, France, Uruguay, Korea … We also had a record number of registrations and attendees for a CloudStack User Group Event. The physical distance was not a stopper for our speakers, who joined the event from 6 different countries. ------------------------------------------ About CloudStack: https://cloudstack.apache.org/

Designing Lean CloudStack Environments for the Edge - IndiQus - CloudStack E...

ShapeBlue

Aws container webinar day 1

HoseokSeo7

Video: https://youtu.be/C_u4_l84ED8 Karl Isenberg reviews the history of distributed computing, clarifies terminology for layers in the container stack, and does a head to head comparison of several tools in the space, including Kubernetes, Marathon, and Docker Swarm. Learn which features and qualities are critical for container orchestration and how you can apply this knowledge when evaluating platforms.

Container Orchestration Wars

Karl Isenberg

Serverless Computing 2019, November 2019, London: Talk by Mario-Leander Reimer (@LeanderReimer, Principal Software Architect at QAware) === Please download slides if blurred! === Abstract: Not long ago, the advent of microservice architectures was a big disruption in software engineering: systems were now build, composed and run as autonomous services. But this came at the price of added complexity. Serverless and FaaS seem to be the next disruption, they are a logical evolution addressing the inherent technology complexity we are faced when building cloud native applications. FaaS frameworks and platforms are currently popping up like mushrooms: Knative, OpenFaaS, Fission or Nuclio are just a few to name. But which one of these is safe to pick and use in your next project? And is it an all or nothing decision or is it suitable to build hybrid architectures? Let’s find out.

The Big Cloud Native FaaS Lebowski

QAware GmbH

9 ways to consume kubernetes on open stack in 15 mins (k8s meetup)

Stacy Véronneau

An Introduction to the Kubernetes API

Stefan Schimanski

Eskimo - Big Data 2.0 Management Platform

EskimoAdmin

Running Cloudbreak on Kubernetes

Krisztián Horváth

Cloudbreak (https://hortonworks.com/open-source/cloudbreak/), as part of the Hortonworks Data Platform (https://hortonworks.com/products/data-center/hdp/) (HDP), makes it easy to provision, configure and elastically grow clusters across cloud infrastructure providers including Amazon Web Services, Microsoft Azure, Google Cloud Platform and OpenStack. It has been designed and developed in a micro-service architecture since the beginning and shipped in Docker. This talk is about the challenges of how we scaled the application using Kubernetes on ACS (https://azure.microsoft.com/en-us/services/container-service/) (Azure Container Services) and how handle the hosted service challenges like: - Exposing metrics regarding the application - Collecting application, k8s, and system logs - Handling scenarios when one of the application node dies - Preparing for high workloads Learn more about the meetup, here: https://www.meetup.com/futureofdata-budapest/events/244277121/

Running Cloudbreak on Kubernetes

Future of Data Meetup

Similar to Cloud Surfing: Kubernetes on Mesos (20)

Kubernetes Architecture and Introduction – Paris Kubernetes Meetup

Kubernetes Kops - Automation Night

Getting Started Running Apache Spark on Apache Mesos

DevOps vs. Site Reliability Engineering (SRE) in Age of Kubernetes

Kubernetes Architecture and Introduction

DevOps in Age of Kubernetes

Spring Boot on Kubernetes/OpenShift

Open Source Cloud, Virtualization and Deployment Technologies

2013 05-multicloud-paas-interop-scenarios-fia-dublin

Kubernetes Day 2017 - Build, Ship and Run Your APP, Production !!

Episode 2: Deploying Kubernetes at Scale

Designing Lean CloudStack Environments for the Edge - IndiQus - CloudStack E...

Aws container webinar day 1

Container Orchestration Wars

The Big Cloud Native FaaS Lebowski

9 ways to consume kubernetes on open stack in 15 mins (k8s meetup)

An Introduction to the Kubernetes API

Eskimo - Big Data 2.0 Management Platform

Running Cloudbreak on Kubernetes

More from KubeAcademy

The building industry in the world today is at large, far behind the rest of the world, technically. Alongside this, it is at threat of being dominated by a small selection of software vendors. These vendors push specific software solutions to the technically unskilled consumers in the AEC industry. The software they provide however is monolithic, native and heavy. Containers, distributed computing, and open source microservices and applications offer a solution to turn the construction industries future on its head. When computing is ubiquitous in our buildings with the internet of things, the whole way we think about building design has to change. We need to think in advance about how our applications which will run our buildings are developed. Each building is bespoke and the offers currently on the software market simply wont fit the bill in the near future. We are trying to develop a kubernetes based platform to lay the foundations for the future of lightweight bespoke apps developed for our built environment. Sched Link:

KubeCon EU 2016: Distributed containers in the physical world

KubeAcademy

KubeCon EU 2016:

KubeAcademy

ChatOps is a term often credited to GitHub, and it is all about putting the tools in the middle of the conversations. At Unacast, most of our conversations go through Slack. When we integrated ChatOps into our workflow, we got the tools closer to the conversation. We are using a version of GitHub Flow for our development process. That means all new features goes in a branch, someone opens a pull request and we merge continuously from master into the feature branch. When we have something that is ready to deploy to a server we trigger a deploy of the branch to a test environment. When the new feature gets verified it gets deployed to production, gets verified again, and then merged back into master. This workflow enables us to maintain a clean master branch so we can roll back in case something fails. Sched Link: http://sched.co/67c1

KubeCon EU 2016: ChatOps and Automatic Deployment on Kubernetes

KubeAcademy

Containers are at the forefront of a new wave of technology innovation but the methods for scheduling and managing them are still new to most developers. In this talk we'll look at the kind of problems that container scheduling solves and at how maximising efficiency and maiximising QoS don't have to be exclusive goals. We'll take a behind the scenes look at the Kubernetes scheduler: How does it prioritize? What about node selection and external dependencies? How do you schedule based on your own specific needs? How does it scale and what’s in it both for developers already using containers and for those that aren't? We’ll use a combination of slides, code, demos to answer all these questions and hopefully all of yours. Sched Link: http://sched.co/6BZa

KubeCon EU 2016: A Practical Guide to Container Scheduling

KubeAcademy

KubeCon EU 2016: Trading in the Kube

KubeAcademy

Being able to trust your containers requires that you be able to trust the systems your containers are running on. Trusted computing makes it possible for computers to prove what they’ve booted, making it practical for clusters to verify that systems haven’t been compromised, but up until now it’s been a heroic task to deploy a trusted computing environment. This presentation will describe the integration of trusted computing technologies into Kubernetes, making it possible to define policies that provide fine-grained access control to cluster resources and distribute secrets in a secure manner. It will then introduce functionality added to the rkt runtime, making it possible to extend trusted computing from initial system state to validation of individual containers. Sched Link: http://sched.co/67eX

KubeCon EU 2016: Integrated trusted computing in Kubernetes

KubeAcademy

One of the most underrated features of Kubernetes is namespaces. In the market, instead of using this feature, people are still stuck with having different clusters for their environments. This talk will try to break this approach, and will introduce how we end up using ephemeral namespaces within our CI/CD pipeline. It will cover the architecture of our system for running the user acceptance tests on isolated ephemeral namespaces with every bits and pieces running within pods. While doing this, we will set up our CI/CD pipeline on top of TravisCI, GoCD, and Selenium that is controlled by Nightwatch.js. Sched Link: http://sched.co/6Bcb

KubeCon EU 2016: Leveraging ephemeral namespaces in a CI/CD pipeline

KubeAcademy

KubeCon EU 2016: Secure, Cloud-Native Networking with Project Calico

KubeAcademy

Arkena's video-on-demand platform is used as backend by major european channels (TF1 / beIN SPORTS / Elisa) to propose a non-linear experience to their customers. Previously hosted on Heroku, the number of our users is increasing constantly. In order to optimize resources we decided to move on a bare metal infrastructure powered by Kubernetes. We'll share thoughts, feedbacks and technical details about this successful transition. Sched Link:

KubeCon EU 2016: Heroku to Kubernetes

KubeAcademy

This talk is documents the UK Home Office's cloud-native journey, changing how we did devops forever! At the UK Home Office, we run Kubernetes in production. This talk is about how we got there, where we came from, where we are right now and where do we want to go from here. We will also cover what things worked out and which things didn't. From on-boarding projects into Kubernetes to continous delivery, this talk will give you a good understanding of what lies ahead if you decided to take the road to schedule containers in production. Sched Link: http://sched.co/68xS

KubeCon EU 2016: Transforming the Government

KubeAcademy

When you hear words such as Kubernetes or OpenShift you immediately start thinking about long running processes you can easily scale at will. However, Kubernetes includes a lesser known feature which allows you to run pretty much anything from simple tasks up to highly-complicated ones. During this presentation, the author of the Job resource in Kubernetes will guide you through several techniques for performing anything ranging from simple Pi calculations to rendering a movie. No matter if you're a data scientist running large scale calculations across several data centers or a hobby programmer running simple day-to-day tasks, this presentation is to teach you how to efficiently use Kubernetes Jobs on their own or as the building blocks of something bigger. This presentation will feature a number of live demos to help illustrate the various ways that you can put Jobs to work. Don’t miss out on learning about one of the coolest features of Kubernetes! Sched Link: http://sched.co/6BUw

KubeCon EU 2016: Getting the Jobs Done With Kubernetes

KubeAcademy

You have deployed your application on Kube and now you want to actually do something permanent with it?? You will need STORAGE. This talk will be a good introduction to using storage in Kubernetes. It will cover the use of EmptyDir, HostPath and Persistent Storage options. How to configure and use each type. This talk will also discuss the security features for storage in the open source OpenShift project. Sched Link: http://sched.co/6BcS

KubeCon EU 2016: Kubernetes Storage 101

KubeAcademy

Testing applications is important, as shown by the rise of continuous integration and automated testing. In this talk, I will focus on one area of testing that is difficult to automate: poor network connectivity. Developers usually work within reliable networking conditions so they might not notice issues that arise in other networking conditions. I will give examples of software that would benefit from test scenarios with varying connectivity. I will explain how traffic control on Linux can help to simulate various network connectivity. Finally, I will run a demo showing how an application running in Kubernetes behaves when changing network parameters. Sched Link: http://sched.co/6Bb3

KubeCon EU 2016: Using Traffic Control to Test Apps in Kubernetes

KubeAcademy

The New York Times’ is a US media company serves digital journalism to millions of visitors every day. The format of our stories is constantly experimented with; for example we publish graphics based on election data ingested from APIs, question and answer led discussions, breaking news live coverage, and quizzes. This leads to a lot of applications. Our previous experience with infrastructure may be a familiar one: an unruly number of virtual machines, which led us to containers. Containers give our web developers who are not infrastructure engineers the opportunity to configure and launch their applications with little oversight. Kubernetes offers us an infrastructure for our numerous applications at scale. Leveraging the Kubernetes API, we’ve built a self-service admin interface for developers (not sysadmins) to configure and launch their applications at scale, similar to the Kubernetes Dashboard project, tailored to our development workflow. Sched Link: http://sched.co/67f2

KubeCon EU 2016: Kubernetes in Production in The New York Times newsroom

KubeAcademy

With growing demand for containers in the enterprise, build pipelines are a bottleneck to success. Traditional workflows can't release application candidates quickly enough to fulfill demand. With over 400 development teams across many different business units, Pearson had to move away from massive installs of traditional build pipeline tools and rethink the entire concept. In this talk we'll demonstrate how we have built in security compliance, performance testing, quality assurance, abstracted away complexity, reduced overhead, aim to recover 10% of developers time and turned build tools into cattle. This represents the story to date of an in-flight engineering project to modernise the digital estate of a global enterprise organisation and how scale of the operation is leading us to challenge many established beliefs. Attendees will walk away with everything from workflows to code which they can use to get started in their own endeavors. Sched Link:

KubeCon EU 2016: ITNW (If This Now What): Orchestrating an Enterprise

KubeAcademy

Modern cities are rapidly adopting smart technologies to deliver realtime data about a number of city services. These technologies heavily rely on a high quality network interconnecting all sensors and reactors as lamps with controlling services. Many low level PLC systems solve the automation, but their purpose is limited to narrow areas of usage as these device have limited computational power. On the other hand, the rise of single-board computers as Raspberry Pi with multi-core processors and plenty of memory can serve as a platform for virtualized services based on Kubernetes. The distributed cluster across whole city on public streetlights gives operators the possibility to adapt to rapidly changing conditions. We propose distribution of HA clusters of single-board devices in key topological points of smart city mesh networks connected together by reliable SDN network. These virtualized services fulfill various tasks as data collection, data processing or and all of these services can rely on cloud backends, that provide much more computational and storage capacity. Services can be operated at both locations to serve local as well as foreign users. We will share whole concept and architecture of SmartCity project, which covers deployment of more than 3000 endpoints[, both sensoric and reactive devices,] and about 30 smart gateways running in HA mode on Kubernetes Nodes. Sched Link: http://sched.co/6BUM

KubeCon EU 2016: SmartCity IoT on Kubernetes

KubeAcademy

Kubernetes gives developers a platform on which to run images and many configuration objects to control those images, but constructing a cohesive application made up of images and configuration objects is currently a challenge. Reconstructing or sharing that configuration can also be a challenge. This talk will cover the Template feature implemented in OpenShift to simplify the process of defining and repeatably deploying coordinated objects, discuss what is coming to Kubernetes with respect to this capability, and touch on several other existing projects that enable templatizing application definitions. Sched Link: http://sched.co/6BVH

KubeCon EU 2016: Templatized Application Configuration on OpenShift and Kuber...

KubeAcademy

The Kubernetes community has aspirations of becoming the Linux kernel of distributed systems. Together we want to build a scalable, stable, and secure platform for distributed system that is the ubiquitous choice for people building server infrastructure. This talk will discuss the major community efforts made in recent months to deliver this goal and the work we need to do to continue our momentum. Sched Link: http://sched.co/68lU

KubeCon EU 2016 Keynote: Pushing Kubernetes Forward

KubeAcademy

Load balancing is an important part of any resilient web application. Kubernetes supports a few options for external load balancing, but they are limited in features. After a brief discussion of those options and the features they lack, we’ll show how to build an advanced load balancing solution for Kubernetes on top of NGINX, utilizing Kubernetes features including Ingress, Annotations, and ConfigMap. We’ll conclude with a demo of how to use NGINX and NGINX Plus to expose services to the Internet. Sched Link: http://sched.co/6Bc9

KubeCon EU 2016: Creating an Advanced Load Balancing Solution for Kubernetes ...

KubeAcademy

The Met Office Informatics Lab includes scientists, developers and designers. We build prototypes exploring new technologies to make environmental data useful. Here we describe a recent project to process multi-dimensional weather data to create a fully interactive 4D browser application. We used long-running containers to serve data and web pages and short-running processes to ingest and compress the data. Forecast data is issued every three hours so our data ingestion goes through regular and predictable bursts (i.e. perfect for autoscaling). We built a Kubernetes cluster in an AWS group which auto-scales based on load. We used replication controllers to process the data. Every three hours ingestion jobs are added to a queue and the number of ingestion containers are set in proportion to the queue length. Each worker completes exactly one ingestion job from the queue and then exits, at which point Kubernetes creates a new one to process the next message. This has allowed us to remove the lifespan logic from the containers and keep them light, fast and massively scalable. We are now in the process of using this in our production systems. Sched Link: http://sched.co/6BWQ

KubeCon EU 2016: Killing containers to make weather beautiful

KubeAcademy

More from KubeAcademy (20)

KubeCon EU 2016: Distributed containers in the physical world

KubeCon EU 2016:

KubeCon EU 2016: ChatOps and Automatic Deployment on Kubernetes

KubeCon EU 2016: A Practical Guide to Container Scheduling

KubeCon EU 2016: Trading in the Kube

KubeCon EU 2016: Integrated trusted computing in Kubernetes

KubeCon EU 2016: Leveraging ephemeral namespaces in a CI/CD pipeline

KubeCon EU 2016: Secure, Cloud-Native Networking with Project Calico

KubeCon EU 2016: Heroku to Kubernetes

KubeCon EU 2016: Transforming the Government

KubeCon EU 2016: Getting the Jobs Done With Kubernetes

KubeCon EU 2016: Kubernetes Storage 101

KubeCon EU 2016: Using Traffic Control to Test Apps in Kubernetes

KubeCon EU 2016: Kubernetes in Production in The New York Times newsroom

KubeCon EU 2016: ITNW (If This Now What): Orchestrating an Enterprise

KubeCon EU 2016: SmartCity IoT on Kubernetes

KubeCon EU 2016: Templatized Application Configuration on OpenShift and Kuber...

KubeCon EU 2016 Keynote: Pushing Kubernetes Forward

KubeCon EU 2016: Creating an Advanced Load Balancing Solution for Kubernetes ...

KubeCon EU 2016: Killing containers to make weather beautiful

Recently uploaded

Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving

Edi Saputra

Angeliki Cooney has spent over twenty years at the forefront of the life sciences industry, working out of Wynantskill, NY. She is highly regarded for her dedication to advancing the development and accessibility of innovative treatments for chronic diseases, rare disorders, and cancer. Her professional journey has centered on strategic consulting for biopharmaceutical companies, facilitating digital transformation, enhancing omnichannel engagement, and refining strategic commercial practices. Angeliki's innovative contributions include pioneering several software-as-a-service (SaaS) products for the life sciences sector, earning her three patents. As the Senior Vice President of Life Sciences at Avenga, Angeliki orchestrated the firm's strategic entry into the U.S. market. Avenga, a renowned digital engineering and consulting firm, partners with significant entities in the pharmaceutical and biotechnology fields. Her leadership was instrumental in expanding Avenga's client base and establishing its presence in the competitive U.S. market.

Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...

Angeliki Cooney

Scaling API-first – The story of a global engineering organization Ian Reasor, Senior Computer Scientist - Adobe Radu Cotescu, Senior Computer Scientist - Adobe Apidays New York 2024: The API Economy in the AI Era (April 30 & May 1, 2024) ------ Check out our conferences at https://www.apidays.global/ Do you want to sponsor or talk at one of our conferences? https://apidays.typeform.com/to/ILJeAaV8 Learn more on APIscene, the global media made by the community for the community: https://www.apiscene.io Explore the API ecosystem with the API Landscape: https://apilandscape.apiscene.io/

Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe

apidays

Six Myths about Ontologies: The Basics of Formal Ontology

johnbeverley2021

AWS Community Day CPH - Three problems of Terraform

Andrey Devyatkin

MS Copilot expands with MS Graph connectors

Nanddeep Nachan

Webinar Recording: https://www.panagenda.com/webinars/why-teams-call-analytics-is-critical-to-your-entire-business Nothing is as frustrating and noticeable as being in an important call and being unable to see or hear the other person. Not surprising then, that issues with Teams calls are among the most common problems users call their helpdesk for. Having in depth insight into everything relevant going on at the user’s device, local network, ISP and Microsoft itself during the call is crucial for good Microsoft Teams Call quality support. To ensure a quick and adequate solution and to ensure your users get the most out of their Microsoft 365. But did you know that ‘bad calls’ are also an excellent indicator of other problems arising? Precisely because it is so noticeable!? Like the canary in the mine, bad calls can be early indicators of problems. Problems that might otherwise not have been noticed for a while but can have a big impact on productivity and satisfaction. Join this session by Christoph Adler to learn how true Microsoft Teams call quality analytics helped other organizations troubleshoot bad calls and identify and fix problems that impacted Teams calls or the use of Microsoft365 in general. See what it can do to keep your users happy and productive! In this session we will cover - Why CQD data alone is not enough to troubleshoot call problems - The importance of attributing call problems to the right call participant - What call quality analytics can do to help you quickly find, fix-, and prevent problems - Why having retrospective detailed insights matters - Real life examples of how others have used Microsoft Teams call quality monitoring to problem shoot problems with their ISP, network, device health and more.

Why Teams call analytics are critical to your entire business

panagenda

Following the popularity of “Cloud Revolution: Exploring the New Wave of Serverless Spatial Data,” we’re thrilled to announce this much-anticipated encore webinar. In this sequel, we’ll dive deeper into the Cloud-Native realm by uncovering practical applications and FME support for these new formats, including COGs, COPC, FlatGeoBuf, GeoParquet, STAC, and ZARR. Building on the foundation laid by industry leaders Michelle Roby of Radiant Earth and Chris Holmes of Planet in the first webinar, this second part offers an in-depth look at the real-world application and behind-the-scenes dynamics of these cutting-edge formats. We will spotlight specific use-cases and workflows, showcasing their efficiency and relevance in practical scenarios. Discover the vast possibilities each format holds, highlighted through detailed discussions and demonstrations. Our expert speakers will dissect the key aspects and provide critical takeaways for effective use, ensuring attendees leave with a thorough understanding of how to apply these formats in their own projects. Elevate your understanding of how FME supports these cutting-edge technologies, enhancing your ability to manage, share, and analyze spatial data. Whether you’re building on knowledge from our initial session or are new to the serverless spatial data landscape, this webinar is your gateway to mastering cloud-native formats in your workflows.

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME

Safe Software

Boost Fertility New Invention Ups Success Rates.pdf

sudhanshuwaghmare1

Elevate Developer Efficiency & build GenAI Application with Amazon Q

Bhuvaneswari Subramani

The value of a flexible API Management solution for Open Banking Steve Melan, Manager for IT Innovation and Architecture - State's and Saving's Bank of Luxembourg Apidays New York 2024: The API Economy in the AI Era (April 30 & May 1, 2024) ------ Check out our conferences at https://www.apidays.global/ Do you want to sponsor or talk at one of our conferences? https://apidays.typeform.com/to/ILJeAaV8 Learn more on APIscene, the global media made by the community for the community: https://www.apiscene.io Explore the API ecosystem with the API Landscape: https://apilandscape.apiscene.io/

Apidays New York 2024 - The value of a flexible API Management solution for O...

apidays

Three things you will take away from the session: • How to run an effective tenant-to-tenant migration • Best practices for before, during, and after migration • Tips for using migration as a springboard to prepare for Copilot in Microsoft 365 Main ideas: Migration Overview: The presentation covers the current reality of cross-tenant migrations, the triggers, phases, best practices, and benefits of a successful tenant migration Considerations: When considering a migration, it is important to consider the migration scope, performance, customization, flexibility, user-friendly interface, automation, monitoring, support, training, scalability, data integrity, data security, cost, and licensing structure Next Wave: The next wave of change includes the launch of Copilot, which requires businesses to be prepared for upcoming changes related to Copilot and the cloud, and to consolidate data and tighten governance ShareGate: ShareGate can help with pre-migration analysis, configurable migration tool, and automated, end-user driven collaborative governance

Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff

sammart93

Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood

Juan lago vázquez

Retrieval augmented generation (RAG) is the most popular style of large language model application to emerge from 2023. The most basic style of RAG works by vectorizing your data and injecting it into a vector database like Milvus for retrieval to augment the text output generated by an LLM. This is just the beginning. One of the ways that we can extend RAG, and extend AI, is through multilingual use cases. Typical RAG is done in English using embedding models that are trained in English. In this talk, we’ll explore how RAG could work in languages other than English. We’ll explore French, Chinese, and Polish.

Introduction to Multilingual Retrieval Augmented Generation (RAG)

Zilliz

Artificial Intelligence Chap.5 : Uncertainty

Khushali Kathiriya

Dubai, often portrayed as a shimmering oasis in the desert, faces its own set of challenges, including the occasional threat of flooding. Despite its reputation for opulence and modernity, the emirate is not immune to the forces of nature. In recent years, Dubai has experienced sporadic but significant floods, testing the resilience of its infrastructure and communities. Among the critical lifelines in this bustling metropolis is the Dubai International Airport, a bustling hub that connects the city to the world. This article explores the intersection of Dubai flood events and the resilience demonstrated by the Dubai International Airport in the face of such challenges.

Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...

Orbitshub

How to Troubleshoot Apps for the Modern Connected Worker

ThousandEyes

ICT role in 21st century education and its challenges

rafiqahmad00786416

ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke

Product Anonymous

Corporate and higher education. Two industries that, in the past, have had a clear divide with very little crossover. The difference in goals, learning styles and objectives paved the way for differing learning technologies platforms to evolve. Now, those stark lines are blurring as both sides are discovering they have content that’s relevant to the other. Join Tammy Rutherford as she walks through the pros and cons of corporate and higher ed collaborating. And the challenges of these different technology platforms working together for a brighter future.

Corporate and higher education May webinar.pptx

Rustici Software

Recently uploaded (20)

Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving

Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...

Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe

Six Myths about Ontologies: The Basics of Formal Ontology

AWS Community Day CPH - Three problems of Terraform

MS Copilot expands with MS Graph connectors

Why Teams call analytics are critical to your entire business

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME

Boost Fertility New Invention Ups Success Rates.pdf

Elevate Developer Efficiency & build GenAI Application with Amazon Q

Apidays New York 2024 - The value of a flexible API Management solution for O...

Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff

Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood

Introduction to Multilingual Retrieval Augmented Generation (RAG)

Artificial Intelligence Chap.5 : Uncertainty

Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...

How to Troubleshoot Apps for the Modern Connected Worker

ICT role in 21st century education and its challenges

ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke

Corporate and higher education May webinar.pptx

Cloud Surfing: Kubernetes on Mesos

2. © 2015 Mesosphere, Inc. All Rights Reserved. 2 - Mesosphere - kubernetes-mesos - Pivotal - cloudfoundry - bosh - bosh-init - bosh-mysql - Williams-Sonoma - multi-brand spring-based ecommerce platform - github.com/karlkfi - mesos-compose-dind - inject (golang) - probe - twitter.com/karlkfi - linkedin.com/in/karlkfi - karl.isenberg.us - karl@mesosphere.com Who is Karl Isenberg?

4. © 2015 Mesosphere, Inc. All Rights Reserved. 4 Renton Thurston - Eureka Seven Cloud Surfing 101 - Lifting 1. Survey landscape 2. Stay as high level as possible 3. Dive down when you need 4. Choose your board wisely

5. © 2015 Mesosphere, Inc. All Rights Reserved. 5 Light Finding Operation (LFO) - Eureka Seven Cloud Surfing 102 - Tool Selection 1. No one tool solves all problems 2. Pick the right tool for the job 3. Pick tools that do one thing well 4. Prefer small APIs 5. Chain your tricks together

6. © 2015 Mesosphere, Inc. All Rights Reserved. 6 Cloud Surfing 103: Atmospheric Layers Application Orchestration Container Orchestration Job Scheduling Containerization Resource Management Provisioning CloudFoundry, Heroku, OpenShift Kubernetes, Marathon, Swarm, Fleet, Lattice, ECS Chronos, Kubernetes Docker, Rkt, Garden, Mesos Mesos Puppet, Chef, Ansible, Salt, Vagrant, Otto non-exhaustive Machine Management AWS, Azure, GCE, OpenStack, vSphere, VirtualBox, Fusion

7. © 2015 Mesosphere, Inc. All Rights Reserved. DCOS 7 Datacenter Operating System Application Orchestration Container Orchestration Job Scheduling Containerization Resource Management Provisioning CloudFoundry, Heroku, OpenShift Kubernetes, Marathon, Swarm, Fleet, Lattice, ECS Chronos, Kubernetes Docker, Rkt, Garden, Mesos Mesos Vagrant, Otto, Puppet, Chef, Ansible, Salt Machine Management AWS, Azure, GCE, OpenStack, vSphere, VirtualBox, Fusion

9. © 2015 Mesosphere, Inc. All Rights Reserved. 9 Demo: Oinker - Mini twitter clone - Deployed on Kubernetes - Replicated 3x - Backed by Cassandra-Mesos - Discovery with Mesos DNS - github.com/karlkfi/oinker-go

10. © 2015 Mesosphere, Inc. All Rights Reserved. 10 Q: What does Kubernetes manage? A: Applications & Services Q: What does Mesos manage? A: Tasks & Resources Q: What does DCOS manage? A: Frameworks Pop Quiz! Don’t worry! This ain’t rocket surgery.

11. © 2015 Mesosphere, Inc. All Rights Reserved. 11 As Seen On Stage - kubernetes.io - mesos.apache.org - mesosphere.com/product (DCOS) - github.com/mesosphere/kubernetes-mesos - github.com/mesosphere/cassandra-mesos - github.com/mesosphere/universe - github.com/mesosphere/multiverse - github.com/mesosphere/dcos-cli - github.com/karlkfi/oinker-go Bonus - mesosphere.github.io/marathon - github.com/karlkfi/mesos-compose-dind But You Don’t Have To Take My Word For It

Cloud Surfing: Kubernetes on Mesos

Recommended

Recommended

More Related Content

What's hot

What's hot (20)

Similar to Cloud Surfing: Kubernetes on Mesos

Similar to Cloud Surfing: Kubernetes on Mesos (20)

More from KubeAcademy

More from KubeAcademy (20)

Recently uploaded

Recently uploaded (20)

Cloud Surfing: Kubernetes on Mesos