muCon2015 - Conduct your microservices with Mesos and Marathon

•Download as PPTX, PDF•

0 likes•449 views

Sylvain Hellegouarch

High-level overview about orchestration of microservices through Mesos and Marathon.

Technology

CONDUCT YOUR
MICROSERVICES
On the path to cloud-native applications
Sylvain Hellegouarch
@lawouach

Before you had one big app
Sylvain Hellegouarch
@lawouach

Now, you have a zillion of smaller
services
Sylvain Hellegouarch
@lawouach

Why so many of them?
The big app had hidden links and
dependencies.
These Functions still exist but their
relationships are now public.
➢Who becomes reponsible for those?
Sylvain Hellegouarch
@lawouach

Be careful about projecting complexity
Sylvain Hellegouarch
@lawouach

Going forward…
Standardize
Automate
Isolate
Orchestrate
Monitor
Adapt
Sylvain Hellegouarch
@lawouach

Helping the ops!
Sysadmins cannot be expected to
support thousands of dynamic services
the old fashion way
We need a tool to orchestrate all of
those pieces together.
Sylvain Hellegouarch
@lawouach

Orchestration
Microservices lifecycle and relationships
conductor
Orchestration brings (some) order to the
microservices chaos
➢ Docker Swarm
➢ Apache Mesos/Marathon
➢ Google Kubernetes
➢ CoreOS Fleet
➢ Cloud Foundry Diego
Sylvain Hellegouarch
@lawouach

Mesos
Cluster resources sharing
Advertizes resources to high-
level schedulers and executors
Isolates executed tasks into
mesos or docker containers
Sylvain Hellegouarch
@lawouach

Mesos (misc)
Master/slave architecture
Infrastructure neutral
Docker Swarm and Kubernetes can benefit from Mesos
MesosDNS for discovery (though you can use Consul,
WeaveDNS too)
Proven: used in production at airbnb, Apple, netflix,
Mesosphere…
Open Source (Apache 2.0 license)
Sylvain Hellegouarch
@lawouach

Marathon: a Mesos framework
Schedules your microservices
based on needed vs available
resources (offered by Mesos)
Executes microservices and
manages their lifecycle
Sylvain Hellegouarch
@lawouach

High level HTTP REST API
Sylvain Hellegouarch
@lawouach

Marathon: Specification
Sylvain Hellegouarch
@lawouach

Marathon: Resources
How much do you need?
➢ Match Marathon’s agent role set at
startup
Sylvain Hellegouarch
@lawouach

How should it be deployed?
➢ Match Mesos slave attributes
➢ UNIQUE, GROUP BY, CLUSTER,
LIKE, UNLIKE…
Marathon: Constraints
Sylvain Hellegouarch
@lawouach

What is the upgrade/rollback
strategy?
➢ Ensures service continuity
Marathon: Upgrade
Sylvain Hellegouarch
@lawouach

Input for redundancy/failure
scenarios
➢Ensures service availability
Marathon: Health-check
Sylvain Hellegouarch
@lawouach

Relationships to other
services
➢ Manages relationships
Marathon: Dependencies
Sylvain Hellegouarch
@lawouach

Marathon: Application definition
Sylvain Hellegouarch
@lawouach

Marathon: More…
Application groups supported
Deployment events feedack
Straight documentation
Sylvain Hellegouarch
@lawouach

Marathon: Challenges
No command line, less natural for scripting
Can Marathon cope with the speed of changes
brought on Docker itself?
Not a simple debugging experience
AFAIK, docker containers are never removed
automatically
Might be too generic for your use case
Sylvain Hellegouarch
@lawouach

Marathon: Getting started?
Design your system so that it copes with interruptions
Define your deployment workflows carefully: install,
upgrade, rollback, failover...
Use a service discovery (weave, consul, etcd,
MesosDNS)
Consider using an overlay network to decouple your
network from the infrastructure (weave, VXLAN)
Sylvain Hellegouarch
@lawouach

What’s next?
Explore but be patient!
Build familiarity to gain trust and
confidence
Sylvain Hellegouarch
@lawouach

Thank you!
Questions?
sylvain.hellegouarch@simplicityitself.com
Sylvain Hellegouarch
@lawouach

What's hot

To see this presentation given live, go to http://bit.ly/DesignPatternsReplay There is a special (discount) offer in there! :-) Cloud-native applications are characterized by highly distributed topologies consisting of many relatively small components (yup, usually called microservices). But the thing that sets them apart even more from the previous generation of apps is that they are expected to function flawlessly even while the environment they are running in is constantly changing, or even failing. All of this requires applying a new set of design patterns and practices and this webinar will introduce the most important ones. The Twelve Factor App (12factor.net) is a high-level articulation of some of these techniques that you may well have heard of, but its descriptions are relatively dense and the industry knowledge has evolved a fair bit since its publication. Cornelia Davis, Senior Director of Technology at Pivotal, will share best practices for cloud-native applications and clear some of the mystery that shrouds 12-factor today. At the conclusion, attendees will understand what is needed for cloud-native applications, as well as why and how to deliver on those requirements.

Cloud Native: Designing Change-tolerant Software

cornelia davis

Damon Edwards, co-founder of Rundeck, presents at DevOps Con Munch on December 3, 2019. The DevOps movement is undeniably pulling Developers closer to Operations. "Shift left" and "You build it, you run it" have become common slogans. However, for years, we were told that developer involvement in production was verboten — a bad idea that would surely lead to chaos, poor productivity, and higher costs. Our legacy processes, policies, and technologies were all built to live within and reinforce the Dev and Ops divide. This talk will examine: 1) what changed 2) how to make it work at scale. See a Demo of Rundeck Enterprise : https://www.rundeck.com/see-demo --or-- Download Rundeck Open Source here: https://rundeck.com/open-source Connect: Stack Overflow community: https://stackoverflow.com/questions/tagged/rundeck Github: https://github.com/rundeck/rundeck/issues Twitter: https://twitter.com/Rundeck Facebook: https://www.facebook.com/RundeckInc/ LinkedIn: www.linkedin.com › company › rundeck-inc

You Build It, But How Are You Going to Run It?

Rundeck

There are typically four primary variables that influence the performance of an Atlassian application: users, application admins, add-on developers, and system administrators. Each plays a different role and its impact on performance can be profound at scale. Dan Hardiker, Chief Technical Officer at Adaptavist who's advised Fortune 500 companies on their Atlassian implementations, will share best practices and demonstrate how to use the process of "monitor, measure, mitigate" to identify key performance bottlenecks and provide data that your organization can use to optimize performance. Dan Hardiker, CTO, Adaptavist

The Four Principles of Atlassian Performance Tuning

Atlassian

CI/CD As first and last line of defence

Jimmy Dahlqvist

Many organisations are interested in adopting DevOps culture and practices but quite often they face some serious challenges after starting a DevOps transformation programme. These problems can be mitigated if organisations are well prepared for what’s likely to happen when their existing processes and culture are being altered during the DevOps transformation effort. This talk aims to explore the common problem areas that can impact the success of the DevOps transformation, and will provide practical advice for dealing with these based on experiences from our past engagements. It will offer some insight into how organisations can prepare and manage the transformation programme, track and report the progress, and finally, ensure that the desired business outcomes are achieved.

Succeeding with DevOps Transformation - Rafal Gancarz

OpenCredo

3 Tips to Deliver Fast Performance Across Mobile Web On-Demand Webinar Seems like everyone’s doing Responsive Web Design these days! Are you using React, Angular or others to create a mobile-friendly web experience? Newsflash: Mobile-friendly doesn’t always equal customer-friendly, when it comes to performance. We’re talking about 60% of your traffic—how do you avoid disaster? Learn the basics of high-performance mobile development through the examination of real-world, performance-killing code examples. You’ll also hear about: Why 4.5 seconds on Chrome can be 15 seconds on a Galaxy S5 Chromium How to identify major issues within mobile page construction Best practices for managing CSS and JavaScript Things to consider going global with your Web application Join web performance experts Klaus Enzenhofer and Stefan Baumgartner from Dynatrace to ensure your mobile properties are delighting your customers!

3 Tips to Deliver Fast Performance Across Mobile Web

Dynatrace

Presented at the Pivotal Toronto Users Group, March 2017 Cloud-native applications form the foundation for modern, cloud-scale digital solutions, and the patterns and practices for cloud-native at the app tier are becoming widely understood – statelessness, service discovery, circuit breakers and more. But little has changed in the data tier. Our modern apps are often connected to monolithic shared databases that have monolithic practices wrapped around them. As a result, the autonomy promised by moving to a microservices application architecture is compromised. With lessons from the application tier to guide us, the industry is now figuring out what the cloud-native architectural patterns are at the data tier. Join us to explore some of these with Cornelia Davis, a five year Cloud Foundry veteran who is now focused on cloud-native data. As it happens, every microservice needs a cache and this evening will drill deep on that topic. She’ll cover a variety of caching patterns and use cases, and demonstrate how their use helps preserve the autonomy that is driving agile software delivery practices today.

Cloud-native Data: Every Microservice Needs a Cache

cornelia davis

Software as a Service workshop / Unlocked: the Hybrid Cloud 12th May 2014

Rackspace Academy

SOASTA mPulse update webinar

CloudBees

The DevOps First Amendment

Fawzy Manaa

AWS and Dynatrace: Moving your Cloud Strategy to the Next Level On-Demand Webcast AWS re:Invent was an exciting time for Dynatrace and we received a lot of “Wows” on our capabilities. We got to demonstrate the only AI-based, full-stack monitoring solution to thousands of AWS prospects and users. We announced our AWS Certified DevOps Competency partnership, and we introduced DAVIS, our natural-language voice interface, to thousands of attendees. We know that many of you couldn’t attend the event in Las Vegas, so we wanted to share some of the key highlights from the show. And for those of you who were there, you may not have seen all of the benefits Dynatrace provides in the AWS ecosystem due to time constraints of sessions and the large tradeshow floor. Listen to this 30 Minute webcast where Alois Reitbauer and Franz Karlsberger recap some of the highlights of the event, including: How Dynatrace, as an AWS certified Migration Competency partner, uniquely supports enterprise migrations to AWS How to achieve faster feedback and improved lead times with AWS CodePipeline and Dynatrace An overview of the first ever VoiceOps and ChatOps interface via DAVIS, based on our AI approach to full-stack monitoring

AWS and Dynatrace: Moving your Cloud Strategy to the Next Level

Dynatrace

What's hot (11)

Cloud Native: Designing Change-tolerant Software

You Build It, But How Are You Going to Run It?

The Four Principles of Atlassian Performance Tuning

CI/CD As first and last line of defence

Succeeding with DevOps Transformation - Rafal Gancarz

3 Tips to Deliver Fast Performance Across Mobile Web

Cloud-native Data: Every Microservice Needs a Cache

Software as a Service workshop / Unlocked: the Hybrid Cloud 12th May 2014

SOASTA mPulse update webinar

The DevOps First Amendment

AWS and Dynatrace: Moving your Cloud Strategy to the Next Level

Similar to muCon2015 - Conduct your microservices with Mesos and Marathon

Why Release Automation Matters

Clarive

Jelastic - DevOps for Java with Docker Containers - Madrid 2015

Jelastic Multi-Cloud PaaS

Agility and Control from AWS [FutureStack16]

New Relic

Dev ops concept

Professional Guru

on 10 Dec 2019 as part of Global SKILup Day organised by DevOps Institute, I presented on topic "How to Avoid Cloud Confusion, DevOps dilemma, Microservice Madness" along with DevOps leaders, practitioners, authors and speakers. The presentation covers three major areas of today's trend: Cloud, DevOps, Microservices and I presented on some practical "How to" #DevOps session as an invited speaker.

How to Avoid Cloud Confusion, DevOps dilemma, Microservice Madness

BMK Lakshminarayanan

Developing reliable applications with .net core and AKS

Alessandro Melchiori

If your team practices DevOps, it's only a matter of time before they say "We want to move to microservices". How do we, the tech leaders, arm ourselves with enough knowledge to make good decisions on the move to microservices. Many times engineers will emphatically push for this move because microservices represent the bleeding edge. They do not always assess the value of this change in the same way we do. Using our real life experiences at Comcast, we will answer the following questions to help tech leaders make good decisions: * What are microservices, exactly? * What are the main reasons to move to microservices? * What are reasons to NOT move to microservices? * What maintenance considerations should my team prepare for? * Where are the hidden costs that come with microservices? At the end of this talk, you will have an appropriate level of understanding of microservices and will be prepared to make informed decisions with your team.

Winslow, Chapman - What Tech Leaders Must Know About Microservices

Michael Scott Winslow

DevOps introduction

Sridhara T V

Cloud computing started a technology revolution; now DevOps is driving that revolution forward. By enabling new approaches to service delivery, cloud and DevOps together are delivering even greater speed, agility and efficiency. No wonder leading innovators are adopting DevOps and cloud together! This presentation explores the synergies in these two approaches, with practical tips, techniques, research data, war stories, case studies and recommendations.

DevOps and Cloud Tips and Techniques to Revolutionize Your SDLC

CA Technologies

The End of Security as We Know It - Shannon Lietz

SeniorStoryteller

Developing reliable applications with .net core and AKS

Alessandro Melchiori

Early Draft: Service Mesh allows developers to focus on business logic while the crosscutting network data layer code is handled by the Service Mesh. This is a boon because this code can be tricky to implement and hard to test all of the edge cases. Service Mesh takes this a few steps further than AOP or Servlet Filters or custom language-specific frameworks because it works regardless of the underlying programming language being used which is great for polyglot development shops. Thus standardizing how these layers work, while allowing teams to pick the best tools or languages for the job at hand. Kubernetes and Istio Service Mesh automate best practices for DevSecOps needs like: failover, scale-out, scalability, health checks, circuit breakers, rate limiters, metrics, observability, avoiding cascading failure, disaster recovery, and traffic routing; supporting CI/CD and microservices architecture. Istio’s ability to automate and maintaining zero trust networks is its most important feature. In the age of high-profile data breaches, security is paramount. Companies want to avoid major brand issues that impact the bottom line and shrink market capitalization in an instant. Istio allows a standard way to do mTLS and auto certificate rotation which helps prevent a breach and limits the blast radius if a breach occurs. Istio also takes the concern of mTLS from microservices deployments and makes it easy to use taking the burden off of application developers.

Service Mesh CTO Forum (Draft 3)

Rick Hightower

How to Broker Access to vSphere and Cloud

RightScale

Microservices have transformed the way developers are building and deploying applications in the era of modern cloud infrastructure. Microservices architectures are designed to separate components into discrete functional elements or individual services. Developers benefit from this new model with reduced complexity and increased scalability. Smaller, more granular compute services which can be developed and deployed independently are easier to maintain, repair, and update. Microservices delivers more agile capabilities so software developers can quickly respond to today's changing environments.

Microservices: Breaking Apart the Monolith

Iron.io

The Future of Cloud Innovation, featuring Adrian Cockcroft

Dun & Bradstreet Cloud Innovation Center

Interest in Atlassian Cloud by Server (and Data Center) customers has been steadily increasing, propelled by new cloud capabilities like SAML authentication, SCIM provisioning, local data centers for performance, encryption at rest, guaranteed uptime, unlimited storage, and the ever-increasing availability of essential Marketplace apps. To anticipate increasing demand, the time has come to develop a standard app migration framework that makes migrating app data from Server to Cloud feasible, intuitive, reliable, secure, and above all, self-serve. In this talk, Chris Clarke will provide an overview of our emerging app data migration architecture, how it will integrate into our evolving Cloud Migration Assistants, and what we’d need from Marketplace vendors to make it work. App migration will be a key part of every customer’s migration journey and we will only be successful by working on it together.

Leaning into Server to Cloud App Migration

Atlassian

As DevOps practices have been put into wide use, it's become evident that developers and operations aren't merging to become one discipline. Nor is operations simply going away. Rather, DevOps is leading software development and operations - together with other practices such as security - to collaborate and coexist with less overhead and conflict than in the past. In his session at @DevOpsSummit at 19th Cloud Expo, Gordon Haff, Red Hat Technology Evangelist, will discuss what modern operational practices look like in a world in which applications are more loosely coupled, are developed using DevOps approaches, and are deployed on software-defined, and often containerized, infrastructures - and where operations itself is increasingly another "as a service" capability from the perspective of developers. How does the operations tool chest change? How does the required skill set differ? How are the interactions between operations and other IT and business organizations different from in the past? How can operations provide the confidence to the entire organization that this new pipeline is still delivering non-functional requirements such as regulatory compliance and a secure and certified operating environment? How does operations safely consume vendor and upstream dependencies while meeting developer desires for the latest and greatest? Operations is more important than ever for a business to derive value from its IT organization. But the roles and the goals of operations are significantly different than they were historically.

Optimizing the Ops in DevOps

Gordon Haff

For many, the transition to DevOps starts small, in a single team or a new project and often involves pieced-together open source solutions with little to no security. To scale effectively, deploying daily, hourly or even more frequently, organizations must infuse security in all aspects of software development and deployment. Join XebiaLabs VP Product Strategy and thought leader in DevOps, Andreas Prins, as he shares market trends, disconnects, tips and techniques to incorporate security and all other disciplines into the complete DevOps lifecycle – a cura di Andreas Prins Vice President of Product Strategy for XebiaLabs

OpenDevOps 2019 - Disconnected pipelines the missing link

Emerasoft, solutions to collaborate

We will provide a high level introduction to DevOps at the enterprise level and how an enterprise can implement a useful and effective DevOps capability to support its software development efforts. We will cover the definition of DevOps, the DevOps Space, how an enterprise should get started with DevOps, Zivra’s “tried and true” DevOps framework, some of the strategic initiatives that will advance your DevOps capabilities, and more.

Scaling DevOps from Ground Zero to Enterprise

matthewabq

RisingWave.pptx

ssuser1790a9

Similar to muCon2015 - Conduct your microservices with Mesos and Marathon (20)

Why Release Automation Matters

Jelastic - DevOps for Java with Docker Containers - Madrid 2015

Agility and Control from AWS [FutureStack16]

Dev ops concept

How to Avoid Cloud Confusion, DevOps dilemma, Microservice Madness

Developing reliable applications with .net core and AKS

Winslow, Chapman - What Tech Leaders Must Know About Microservices

DevOps introduction

DevOps and Cloud Tips and Techniques to Revolutionize Your SDLC

The End of Security as We Know It - Shannon Lietz

Developing reliable applications with .net core and AKS

Service Mesh CTO Forum (Draft 3)

How to Broker Access to vSphere and Cloud

Microservices: Breaking Apart the Monolith

The Future of Cloud Innovation, featuring Adrian Cockcroft

Leaning into Server to Cloud App Migration

Optimizing the Ops in DevOps

OpenDevOps 2019 - Disconnected pipelines the missing link

Scaling DevOps from Ground Zero to Enterprise

RisingWave.pptx

Recently uploaded

Webinar Recording: https://www.panagenda.com/webinars/why-teams-call-analytics-is-critical-to-your-entire-business Nothing is as frustrating and noticeable as being in an important call and being unable to see or hear the other person. Not surprising then, that issues with Teams calls are among the most common problems users call their helpdesk for. Having in depth insight into everything relevant going on at the user’s device, local network, ISP and Microsoft itself during the call is crucial for good Microsoft Teams Call quality support. To ensure a quick and adequate solution and to ensure your users get the most out of their Microsoft 365. But did you know that ‘bad calls’ are also an excellent indicator of other problems arising? Precisely because it is so noticeable!? Like the canary in the mine, bad calls can be early indicators of problems. Problems that might otherwise not have been noticed for a while but can have a big impact on productivity and satisfaction. Join this session by Christoph Adler to learn how true Microsoft Teams call quality analytics helped other organizations troubleshoot bad calls and identify and fix problems that impacted Teams calls or the use of Microsoft365 in general. See what it can do to keep your users happy and productive! In this session we will cover - Why CQD data alone is not enough to troubleshoot call problems - The importance of attributing call problems to the right call participant - What call quality analytics can do to help you quickly find, fix-, and prevent problems - Why having retrospective detailed insights matters - Real life examples of how others have used Microsoft Teams call quality monitoring to problem shoot problems with their ISP, network, device health and more.

Why Teams call analytics are critical to your entire business

panagenda

This presentation explores the impact of HTML injection attacks on web applications, detailing how attackers exploit vulnerabilities to inject malicious code into web pages. Learn about the potential consequences of such attacks and discover effective mitigation strategies to protect your web applications from HTML injection vulnerabilities. for more information visit https://bostoninstituteofanalytics.org/category/cyber-security-ethical-hacking/

HTML Injection Attacks: Impact and Mitigation Strategies

Boston Institute of Analytics

Partners Life - Insurer Innovation Award 2024

The Digital Insurer

Boost Fertility New Invention Ups Success Rates.pdf

sudhanshuwaghmare1

Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024

The Digital Insurer

Real Time Object Detection Using Open CV

Khem

MINDCTI Revenue Release Quarter One 2024

MIND CTI

presentation ICT roal in 21st century education

jfdjdjcjdnsjd

AWS Community Day CPH - Three problems of Terraform

Andrey Devyatkin

With more memory available, system performance of three Dell devices increased, which can translate to a better user experience Conclusion When your system has plenty of RAM to meet your needs, you can efficiently access the applications and data you need to finish projects and to-do lists without sacrificing time and focus. Our test results show that with more memory available, three Dell PCs delivered better performance and took less time to complete the Procyon Office Productivity benchmark. These advantages translate to users being able to complete workflows more quickly and multitask more easily. Whether you need the mobility of the Latitude 5440, the creative capabilities of the Precision 3470, or the high performance of the OptiPlex Tower Plus 7010, configuring your system with more RAM can help keep processes running smoothly, enabling you to do more without compromising performance.

Boost PC performance: How more available memory can improve productivity

Principled Technologies

Automating Google Workspace (GWS) & more with Apps Script

wesley chun

Scaling API-first – The story of a global engineering organization Ian Reasor, Senior Computer Scientist - Adobe Radu Cotescu, Senior Computer Scientist - Adobe Apidays New York 2024: The API Economy in the AI Era (April 30 & May 1, 2024) ------ Check out our conferences at https://www.apidays.global/ Do you want to sponsor or talk at one of our conferences? https://apidays.typeform.com/to/ILJeAaV8 Learn more on APIscene, the global media made by the community for the community: https://www.apiscene.io Explore the API ecosystem with the API Landscape: https://apilandscape.apiscene.io/

Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe

apidays

A Domino Admins Adventures (Engage 2024)

Gabriella Davis

Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...

Neo4j

GenAI Risks & Security Meetup 01052024.pdf

lior mazor

🐬 The future of MySQL is Postgres 🐘

RTylerCroy

Manulife - Insurer Innovation Award 2024

The Digital Insurer

Imagine a world where information flows as swiftly as thought itself, making decision-making as fluid as the data driving it. Every moment is critical, and the right tools can significantly boost your organization’s performance. The power of real-time data automation through FME can turn this vision into reality. Aimed at professionals eager to leverage real-time data for enhanced decision-making and efficiency, this webinar will cover the essentials of real-time data and its significance. We’ll explore: FME’s role in real-time event processing, from data intake and analysis to transformation and reporting An overview of leveraging streams vs. automations FME’s impact across various industries highlighted by real-life case studies Live demonstrations on setting up FME workflows for real-time data Practical advice on getting started, best practices, and tips for effective implementation Join us to enhance your skills in real-time data automation with FME, and take your operational capabilities to the next level.

From Event to Action: Accelerate Your Decision Making with Real-Time Automation

Safe Software

This presentations targets students or working professionals. You may know Google for search, YouTube, Android, Chrome, and Gmail, but did you know Google has many developer tools, platforms & APIs? This comprehensive yet still high-level overview outlines the most impactful tools for where to run your code, store & analyze your data. It will also inspire you as to what's possible. This talk is 50 minutes in length.

Powerful Google developer tools for immediate impact! (2023-24 C)

wesley chun

Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood

Juan lago vázquez

Recently uploaded (20)

Why Teams call analytics are critical to your entire business

HTML Injection Attacks: Impact and Mitigation Strategies

Partners Life - Insurer Innovation Award 2024

Boost Fertility New Invention Ups Success Rates.pdf

Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024

Real Time Object Detection Using Open CV

MINDCTI Revenue Release Quarter One 2024

presentation ICT roal in 21st century education

AWS Community Day CPH - Three problems of Terraform

Boost PC performance: How more available memory can improve productivity

Automating Google Workspace (GWS) & more with Apps Script

Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe

A Domino Admins Adventures (Engage 2024)

Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...

GenAI Risks & Security Meetup 01052024.pdf

🐬 The future of MySQL is Postgres 🐘

Manulife - Insurer Innovation Award 2024

From Event to Action: Accelerate Your Decision Making with Real-Time Automation

Powerful Google developer tools for immediate impact! (2023-24 C)

Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood

muCon2015 - Conduct your microservices with Mesos and Marathon

1. CONDUCT YOUR MICROSERVICES On the path to cloud-native applications Sylvain Hellegouarch @lawouach

2. Before you had one big app Sylvain Hellegouarch @lawouach

3. Now, you have a zillion of smaller services Sylvain Hellegouarch @lawouach

4. Why so many of them? The big app had hidden links and dependencies. These Functions still exist but their relationships are now public. ➢Who becomes reponsible for those? Sylvain Hellegouarch @lawouach

5. Be careful about projecting complexity Sylvain Hellegouarch @lawouach

6. Going forward… Standardize Automate Isolate Orchestrate Monitor Adapt Sylvain Hellegouarch @lawouach

7. Helping the ops! Sysadmins cannot be expected to support thousands of dynamic services the old fashion way We need a tool to orchestrate all of those pieces together. Sylvain Hellegouarch @lawouach

8. Orchestration Microservices lifecycle and relationships conductor Orchestration brings (some) order to the microservices chaos ➢ Docker Swarm ➢ Apache Mesos/Marathon ➢ Google Kubernetes ➢ CoreOS Fleet ➢ Cloud Foundry Diego Sylvain Hellegouarch @lawouach

9. Mesos Cluster resources sharing Advertizes resources to high- level schedulers and executors Isolates executed tasks into mesos or docker containers Sylvain Hellegouarch @lawouach

10. Mesos (misc) Master/slave architecture Infrastructure neutral Docker Swarm and Kubernetes can benefit from Mesos MesosDNS for discovery (though you can use Consul, WeaveDNS too) Proven: used in production at airbnb, Apple, netflix, Mesosphere… Open Source (Apache 2.0 license) Sylvain Hellegouarch @lawouach

11. Marathon: a Mesos framework Schedules your microservices based on needed vs available resources (offered by Mesos) Executes microservices and manages their lifecycle Sylvain Hellegouarch @lawouach

12. High level HTTP REST API Sylvain Hellegouarch @lawouach

13. Marathon: Specification Sylvain Hellegouarch @lawouach

14. Marathon: Resources How much do you need? ➢ Match Marathon’s agent role set at startup Sylvain Hellegouarch @lawouach

15. How should it be deployed? ➢ Match Mesos slave attributes ➢ UNIQUE, GROUP BY, CLUSTER, LIKE, UNLIKE… Marathon: Constraints Sylvain Hellegouarch @lawouach

16. What is the upgrade/rollback strategy? ➢ Ensures service continuity Marathon: Upgrade Sylvain Hellegouarch @lawouach

17. Input for redundancy/failure scenarios ➢Ensures service availability Marathon: Health-check Sylvain Hellegouarch @lawouach

18. Relationships to other services ➢ Manages relationships Marathon: Dependencies Sylvain Hellegouarch @lawouach

19. Marathon: Application definition Sylvain Hellegouarch @lawouach

20. Marathon: More… Application groups supported Deployment events feedack Straight documentation Sylvain Hellegouarch @lawouach

21. Marathon: Challenges No command line, less natural for scripting Can Marathon cope with the speed of changes brought on Docker itself? Not a simple debugging experience AFAIK, docker containers are never removed automatically Might be too generic for your use case Sylvain Hellegouarch @lawouach

22. Marathon: Getting started? Design your system so that it copes with interruptions Define your deployment workflows carefully: install, upgrade, rollback, failover... Use a service discovery (weave, consul, etcd, MesosDNS) Consider using an overlay network to decouple your network from the infrastructure (weave, VXLAN) Sylvain Hellegouarch @lawouach

23. What’s next? Explore but be patient! Build familiarity to gain trust and confidence Sylvain Hellegouarch @lawouach

24. Thank you! Questions? sylvain.hellegouarch@simplicityitself.com Sylvain Hellegouarch @lawouach

muCon2015 - Conduct your microservices with Mesos and Marathon

Recommended

Recommended

More Related Content

What's hot

What's hot (11)

Similar to muCon2015 - Conduct your microservices with Mesos and Marathon

Similar to muCon2015 - Conduct your microservices with Mesos and Marathon (20)

Recently uploaded

Recently uploaded (20)

muCon2015 - Conduct your microservices with Mesos and Marathon