Apache mesos

•

1 like•716 views

Apache Mesos abstracts compute resources like CPU, memory, and storage from physical or virtual machines, enabling distributed systems to easily build and run applications in a fault-tolerant and elastic way. It provides scalability to 10,000s of nodes, fault tolerance through replicated masters and slaves using ZooKeeper, support for Docker containers, isolation between tasks using Linux containers, and scheduling of multiple resources like memory, CPU, disk and ports. It also includes Java, Python and C++ APIs and a web UI to view cluster state.

Apache Mesos
Diego Pacheco
SoftwareArchitect| Agile Coach
diego-pacheco.blogspot.com@diego_pacheco diegopacheco diego.pacheco

Apache Mesos abstracts CPU, memory, storage, and other
compute resources away from machines (physical or virtual),
enabling fault-tolerant and elastic distributed systems to easily be
built and run effectively.
Apache Mesos

Apache Mesos
Scalability to 10,000s of nodes
Fault-tolerant replicated master and slaves using ZooKeeper
Support for Docker containers
Native isolation between tasks with Linux Containers
Multi-resource scheduling (memory, CPU, disk, and ports)
Java, Python and C++ APIs for developing new parallel applications
Web UI for viewing cluster state

Apache Mesos
Diego Pacheco
SoftwareArchitect| Agile Coach
diego-pacheco.blogspot.com@diego_pacheco diegopacheco diego.pacheco
Thank You!
Obrigado!

Presentation made at DevOpsDays Berlin 2015 Container technology are being evaluated by software developers and administrators with a great deal of interest. Developers want to focus on what they do best: Creating and coding new applications. That shouldn't have to change just because they need to deploy an application to a different environment. Administrators want the environment to stay reliable and stable, keeping changes at a minimum. By following a strategy that embraces good Architecture, use of Containers, DevOps philosophy, Apache Mesos and a Cloud based environment, developers and operators can create, consume and collaborate on the infrastructure configuration over the time, deploy Java EE applications and test your application infrastructure consistently regardless of the stage of the development life cycle.

OSDC 2015: Bernd Mathiske | Why the Datacenter Needs an Operating System

NETWAYS

Developers are moving away from their host-based patterns and adopting a new mindset around the idea that the datacenter is the computer. It?s quickly becoming a mainstream model that you can view a warehouse full of servers as a single computer (with terabytes of memory and tens of thousands of cores). There is a key missing piece, which is an operating system for the datacenter (DCOS), which would provide the same OS functionality and core OS abstractions across thousands of machines that an OS provides on a single machine today. In this session, we will discuss: How the abstraction of an OS has evolved over time and can cleanly scale to spand thousands of machines in a datacenter. How key open source technologies like the Apache Mesos distributed systems kernel provide the key underpinnings for a DCOS. How developers can layer core system services on top of a distributed systems kernel, including an init system (Marathon), cron (Chronos), service discovery (DNS), and storage (HDFS) What would the interface to the DCOS look like? How would you use it? How you would install and operate datacenter services, including Apache Spark, Apache Cassandra, Apache Kafka, Apache Hadoop, Apache YARN, Apache HDFS, and Google's Kubernetes. How will developers build datacenter-scale apps, programmed against the datacenter OS like it?s a single machine?

Presentation made at ApacheCon: Core Europe 2015 Container technology are being evaluated by software developers and administrators with a great deal of interest. Developers want to focus on what they do best: Creating and coding new applications. That shouldn't have to change just because they need to deploy an application to a different environment. Administrators want the environment to stay reliable and stable, keeping changes at a minimum. By following a strategy that embraces good Architecture, use of Containers, DevOps philosophy, Apache Mesos and a Cloud based environment, developers and operators can create, consume and collaborate on the infrastructure configuration over the time, deploy Java EE applications and test your application infrastructure consistently regardless of the stage of the development life cycle.

Making Distributed Data Persistent Services Elastic (Without Losing All Your ...

C4Media

Video and slides synchronized, mp3 and slide download available at URL http://bit.ly/1L2FXLC. Joe Stein introduces Mesos and managing data services on it, presenting use cases for replacing classic solutions (like cold storage) with new functionality based on these technology. Filmed at qconnewyork.com. Joe Stein is the CEO of Elodina, a startup focusing on the support & maintenance of third party open source software (like Mesos frameworks) as well as its own open source products & SaaS solutions. He is also the Founder and Principal Consultant of Big Data Open Source Security.

Fully fault tolerant real time data pipeline with docker and mesos

Rahul Kumar

Deploying a 3 tier application using docker

parth2094

TXLF: Automated Deployment of OpenStack with Chef

Matt Ray

Analyzing data with docker v4

Andreas Dewes

Containerized Data Persistence on Mesos

Joe Stein

Introduction to mesos bay

hongbin034

SQL Server on Linux

Fabrício Catae

Catalogic ECX: Copy Data Management for InterSystems Caché and Epic EHR

Catalogic Software

Copy Data Management is fast becoming a must-have solution for any Epic EHR environment. Catalogic ECX provides native application aware integration with InterSystems Caché and Clarity databases (SQL), VMs and file systems to automate the creation and use of Caché database copies — snapshots, clones and replicas – on your existing enterprise storage infrastructure. This allows you to meet Epic protection and recovery requirements as well as provide quick, easy and secure access to clones or full copies for development, testing, release, MDR, SUP, Build and training environments. ECX supports Caché on Red Hat Linux (virtual and physical) and AIX.

Mesos on coreOS

충섭 김

Drupal In The Cloud

Bret Piatt

The secret is out – Drupal has become the ‘go-to’ open source software for the publication and management of website content. By pairing Drupal with cloud technologies there is a whole new world of user benefits well beyond scale and performance. In this session, Bret Piatt, director, technical alliances at Rackspace Hosting will discuss how to best take advantage of cloud technologies with Drupal sites. The panel presentation will address: • Leveraging the cloud ecosystem for managing configuration, code, and backups • How to scale Drupal clusters by integrating with cloud APIs • Enhancing site scale and performance by taking advantage of cloud file storage/CDN • Cloud/Drupal success stories such as Chapter Three’s ( http://www.chapterthree.com ) on Mercury, a Drupal PaaS built on The Rackspace Cloud’s Cloud Servers

Apache Mesos

Puneet soni

Setting up repositories

Iryna Kuchma

Kubernetes on DC/OS

Cloud Technology Experts

Join us on Wednesday, January 9 as Mesosphere will demo how to install and run Kubernetes in under 10 minutes on DC/OS. We will walk you step-by-step through installing and running Kubernetes on Mesosphere DC/OS 1.10, discuss the benefits of container orchestrators, and answer frequently asked questions. Topics include: Live demo showing how to deploy and manage 100% pure Kubernetes distribution on DC/OS How to run multiple Kubernetes clusters (of different versions) alongside each other How to run both stateless and stateful workloads on the same infrastructure Live Q&A

Introduction to OpenStack (2012)

Julio Villarreal Pelegrino

Doing Dropbox the Native Cloud Native Way

Minio

Extending DevOps to Big Data Applications with Kubernetes

Nicola Ferraro

SCALE 2011 Deploying OpenStack with Chef

Matt Ray

Naming Things Book : Simple Book Review!

Diego Pacheco

Continuous Discovery Habits Book Review.pdf

Diego Pacheco

Similar to Apache mesos

Mesos: Cluster Management System

Erhan Bagdemir

Containers, DevOps, Apache Mesos and Cloud - Reshaping how we develop and del...

Marcelo Sousa Ancelmo

Making Distributed Data Persistent Services Elastic (Without Losing All Your ...

C4Media

Fully fault tolerant real time data pipeline with docker and mesos

Rahul Kumar

Deploying a 3 tier application using docker

parth2094

TXLF: Automated Deployment of OpenStack with Chef

Matt Ray

Analyzing data with docker v4

Andreas Dewes

Containerized Data Persistence on Mesos

Joe Stein

Introduction to mesos bay

hongbin034

SQL Server on Linux

Fabrício Catae

Catalogic ECX: Copy Data Management for InterSystems Caché and Epic EHR

Mesos on coreOS

Drupal In The Cloud

Apache Mesos

Setting up repositories

Iryna Kuchma

Kubernetes on DC/OS

Cloud Technology Experts

Introduction to OpenStack (2012)

Julio Villarreal Pelegrino

Doing Dropbox the Native Cloud Native Way

Minio

Extending DevOps to Big Data Applications with Kubernetes

Nicola Ferraro

SCALE 2011 Deploying OpenStack with Chef

Matt Ray

Similar to Apache mesos (20)

Mesos: Cluster Management System

Containers, DevOps, Apache Mesos and Cloud - Reshaping how we develop and del...

Making Distributed Data Persistent Services Elastic (Without Losing All Your ...

Fully fault tolerant real time data pipeline with docker and mesos

Deploying a 3 tier application using docker

TXLF: Automated Deployment of OpenStack with Chef

Analyzing data with docker v4

Containerized Data Persistence on Mesos

Introduction to mesos bay

SQL Server on Linux

Catalogic ECX: Copy Data Management for InterSystems Caché and Epic EHR

Mesos on coreOS

Drupal In The Cloud

Apache Mesos

Setting up repositories

Kubernetes on DC/OS

Introduction to OpenStack (2012)

Doing Dropbox the Native Cloud Native Way

Extending DevOps to Big Data Applications with Kubernetes

SCALE 2011 Deploying OpenStack with Chef

Recently uploaded

UiPath Test Automation using UiPath Test Suite series, part 5

DianaGray10

Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf

Malak Abu Hammad

Discover how MongoDB Atlas and vector search technology can revolutionize your application's search capabilities. This comprehensive presentation covers: * What is Vector Search? * Importance and benefits of vector search * Practical use cases across various industries * Step-by-step implementation guide * Live demos with code snippets * Enhancing LLM capabilities with vector search * Best practices and optimization strategies Perfect for developers, AI enthusiasts, and tech leaders. Learn how to leverage MongoDB Atlas to deliver highly relevant, context-aware search results, transforming your data retrieval process. Stay ahead in tech innovation and maximize the potential of your applications. #MongoDB #VectorSearch #AI #SemanticSearch #TechInnovation #DataScience #LLM #MachineLearning #SearchTechnology

Building RAG with self-deployed Milvus vector database and Snowpark Container...

Zilliz

Large Language Model (LLM) and it’s Geospatial Applications

Rohit Gautam

Securing your Kubernetes cluster_ a step-by-step guide to success !

KatiaHIMEUR1

Today, after several years of existence, an extremely active community and an ultra-dynamic ecosystem, Kubernetes has established itself as the de facto standard in container orchestration. Thanks to a wide range of managed services, it has never been so easy to set up a ready-to-use Kubernetes cluster. However, this ease of use means that the subject of security in Kubernetes is often left for later, or even neglected. This exposes companies to significant risks. In this talk, I'll show you step-by-step how to secure your Kubernetes cluster for greater peace of mind and reliability.

20240609 QFM020 Irresponsible AI Reading List May 2024

Matthew Sinclair

Uni Systems Copilot event_05062024_C.Vlachos.pdf

Uni Systems S.M.S.A.

みなさんこんにちはこれ何文字まで入るの？40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの？えこ...

名前です男

GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...

Neo4j

Dr. Sean Tan, Head of Data Science, Changi Airport Group Discover how Changi Airport Group (CAG) leverages graph technologies and generative AI to revolutionize their search capabilities. This session delves into the unique search needs of CAG’s diverse passengers and customers, showcasing how graph data structures enhance the accuracy and relevance of AI-generated search results, mitigating the risk of “hallucinations” and improving the overall customer journey.

Full-RAG: A modern architecture for hyper-personalization

Zilliz

Mike Del Balso, CEO & Co-Founder at Tecton, presents "Full RAG," a novel approach to AI recommendation systems, aiming to push beyond the limitations of traditional models through a deep integration of contextual insights and real-time data, leveraging the Retrieval-Augmented Generation architecture. This talk will outline Full RAG's potential to significantly enhance personalization, address engineering challenges such as data management and model training, and introduce data enrichment with reranking as a key solution. Attendees will gain crucial insights into the importance of hyperpersonalization in AI, the capabilities of Full RAG for advanced personalization, and strategies for managing complex data integrations for deploying cutting-edge AI solutions.

GridMate - End to end testing is a critical piece to ensure quality and avoid...

ThomasParaiso2

GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...

Neo4j

Leonard Jayamohan, Partner & Generative AI Lead, Deloitte This keynote will reveal how Deloitte leverages Neo4j’s graph power for groundbreaking digital twin solutions, achieving a staggering 100x performance boost. Discover the essential role knowledge graphs play in successful generative AI implementations. Plus, get an exclusive look at an innovative Neo4j + Generative AI solution Deloitte is developing in-house.

GraphSummit Singapore | Graphing Success: Revolutionising Organisational Stru...

Neo4j

Sudheer Mechineni, Head of Application Frameworks, Standard Chartered Bank Discover how Standard Chartered Bank harnessed the power of Neo4j to transform complex data access challenges into a dynamic, scalable graph database solution. This keynote will cover their journey from initial adoption to deploying a fully automated, enterprise-grade causal cluster, highlighting key strategies for modelling organisational changes and ensuring robust disaster recovery. Learn how these innovations have not only enhanced Standard Chartered Bank’s data infrastructure but also positioned them as pioneers in the banking sector’s adoption of graph technology.

A tale of scale & speed: How the US Navy is enabling software delivery from l...

sonjaschweigert1

Rapid and secure feature delivery is a goal across every application team and every branch of the DoD. The Navy’s DevSecOps platform, Party Barge, has achieved: - Reduction in onboarding time from 5 weeks to 1 day - Improved developer experience and productivity through actionable findings and reduction of false positives - Maintenance of superior security standards and inherent policy enforcement with Authorization to Operate (ATO) Development teams can ship efficiently and ensure applications are cyber ready for Navy Authorizing Officials (AOs). In this webinar, Sigma Defense and Anchore will give attendees a look behind the scenes and demo secure pipeline automation and security artifacts that speed up application ATO and time to production. We will cover: - How to remove silos in DevSecOps - How to build efficient development pipeline roles and component templates - How to deliver security artifacts that matter for ATO’s (SBOMs, vulnerability reports, and policy evidence) - How to streamline operations with automated policy checks on container images

Microsoft - Power Platform_G.Aspiotis.pdf

Uni Systems S.M.S.A.

How to Get CNIC Information System with Paksim Ga.pptx

danishmna97

Video Streaming: Then, Now, and in the Future

Alpen-Adria-Universität

In his public lecture, Christian Timmerer provides insights into the fascinating history of video streaming, starting from its humble beginnings before YouTube to the groundbreaking technologies that now dominate platforms like Netflix and ORF ON. Timmerer also presents provocative contributions of his own that have significantly influenced the industry. He concludes by looking at future challenges and invites the audience to join in a discussion.

GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...

James Anderson

Effective Application Security in Software Delivery lifecycle using Deployment Firewall and DBOM The modern software delivery process (or the CI/CD process) includes many tools, distributed teams, open-source code, and cloud platforms. Constant focus on speed to release software to market, along with the traditional slow and manual security checks has caused gaps in continuous security as an important piece in the software supply chain. Today organizations feel more susceptible to external and internal cyber threats due to the vast attack surface in their applications supply chain and the lack of end-to-end governance and risk management. The software team must secure its software delivery process to avoid vulnerability and security breaches. This needs to be achieved with existing tool chains and without extensive rework of the delivery processes. This talk will present strategies and techniques for providing visibility into the true risk of the existing vulnerabilities, preventing the introduction of security issues in the software, resolving vulnerabilities in production environments quickly, and capturing the deployment bill of materials (DBOM). Speakers: Bob Boule Robert Boule is a technology enthusiast with PASSION for technology and making things work along with a knack for helping others understand how things work. He comes with around 20 years of solution engineering experience in application security, software continuous delivery, and SaaS platforms. He is known for his dynamic presentations in CI/CD and application security integrated in software delivery lifecycle. Gopinath Rebala Gopinath Rebala is the CTO of OpsMx, where he has overall responsibility for the machine learning and data processing architectures for Secure Software Delivery. Gopi also has a strong connection with our customers, leading design and architecture for strategic implementations. Gopi is a frequent speaker and well-known leader in continuous delivery and integrating security into software delivery.

By Design, not by Accident - Agile Venture Bolzano 2024

Pierluigi Pugliese

Epistemic Interaction - tuning interfaces to provide information for AI support

Alan Dix

Paper presented at SYNERGY workshop at AVI 2024, Genoa, Italy. 3rd June 2024 https://alandix.com/academic/papers/synergy2024-epistemic/ As machine learning integrates deeper into human-computer interactions, the concept of epistemic interaction emerges, aiming to refine these interactions to enhance system adaptability. This approach encourages minor, intentional adjustments in user behaviour to enrich the data available for system learning. This paper introduces epistemic interaction within the context of human-system communication, illustrating how deliberate interaction design can improve system understanding and adaptation. Through concrete examples, we demonstrate the potential of epistemic interaction to significantly advance human-computer interaction by leveraging intuitive human communication strategies to inform system design and functionality, offering a novel pathway for enriching user-system engagements.

Recently uploaded (20)

UiPath Test Automation using UiPath Test Suite series, part 5

Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf

Building RAG with self-deployed Milvus vector database and Snowpark Container...

Large Language Model (LLM) and it’s Geospatial Applications

Securing your Kubernetes cluster_ a step-by-step guide to success !

20240609 QFM020 Irresponsible AI Reading List May 2024

Uni Systems Copilot event_05062024_C.Vlachos.pdf

GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...

Full-RAG: A modern architecture for hyper-personalization

GridMate - End to end testing is a critical piece to ensure quality and avoid...

GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...

GraphSummit Singapore | Graphing Success: Revolutionising Organisational Stru...

A tale of scale & speed: How the US Navy is enabling software delivery from l...

Microsoft - Power Platform_G.Aspiotis.pdf

How to Get CNIC Information System with Paksim Ga.pptx

Video Streaming: Then, Now, and in the Future

GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...

By Design, not by Accident - Agile Venture Bolzano 2024

Epistemic Interaction - tuning interfaces to provide information for AI support

Apache mesos

1. Apache Mesos Diego Pacheco SoftwareArchitect| Agile Coach diego-pacheco.blogspot.com@diego_pacheco diegopacheco diego.pacheco

2. http://about.me/diegopacheco

3. Apache Mesos abstracts CPU, memory, storage, and other compute resources away from machines (physical or virtual), enabling fault-tolerant and elastic distributed systems to easily be built and run effectively. Apache Mesos

4. Apache Mesos Scalability to 10,000s of nodes Fault-tolerant replicated master and slaves using ZooKeeper Support for Docker containers Native isolation between tasks with Linux Containers Multi-resource scheduling (memory, CPU, disk, and ports) Java, Python and C++ APIs for developing new parallel applications Web UI for viewing cluster state

5. Zookeper

6. Runs on Mesos

7. Cases

8. Reality

9. Architecture

10.

11. Apache Mesos

12. Marathon

13. Marathon

14. DCOS

15. DCOS

16. Apache Mesos Diego Pacheco SoftwareArchitect| Agile Coach diego-pacheco.blogspot.com@diego_pacheco diegopacheco diego.pacheco Thank You! Obrigado!

Apache mesos

Recommended

Recommended

More Related Content

Similar to Apache mesos

Similar to Apache mesos (20)

More from Diego Pacheco

More from Diego Pacheco (20)

Recently uploaded

Recently uploaded (20)

Apache mesos