SlideShare a Scribd company logo
1 of 37
Download to read offline
© 2016 Mesosphere, Inc. All Rights Reserved.
Edward Hsu, VP of Enterprise DC/OS
@edwardihsu
JOURNEY TO THE MODERN APP WITH
CONTAINERS, MICROSERVICES AND BIG DATA
Datacenter Operating System (DC/OS)
The simplest way to build, run, scale and manage modern enterprise apps
© 2016 Mesosphere, Inc. All Rights Reserved.
© 2016 Mesosphere, Inc. All Rights Reserved.
INDUSTRY TRANSITIONS
Customer analytics
2000s
Electronic customer
records
1980s
Online customer
engagement
1990s
Real-time & predictive
customer engagement
2013+
© 2016 Mesosphere, Inc. All Rights Reserved.
© 2016 Mesosphere, Inc. All Rights Reserved.
© 2016 Mesosphere, Inc. All Rights Reserved.
MAYO CLINIC REVOLUTIONIZING HEALTHCARE
Individualized care
recommendations based on
5 million patient records
Key technologies:
● Real-time data ingestion
● Distributed search engine
● Large-scale processing
● Distributed database
© 2016 Mesosphere, Inc. All Rights Reserved.
UBER DISRUPTING MULTIPLE INDUSTRIES
Operations in over 300 cities around
the world
Key technologies:
● Distributed logging
● Large-scale data processing
● Distributed datastore
© 2016 Mesosphere, Inc. All Rights Reserved.
ARCHITECTURAL SHIFT
TRADITIONAL
ENTERPRISE
APPLICATIONS
MODERN
ENTERPRISE
APPLICATIONS
Data
Code
Latency
Users
2+ Billion smartphone users
3+ Billion internet users
Enterprise data growth (CAGR): 40%+
Source: KPCB Internet Trends 2016, EMC Digital Universe 2014
© 2016 Mesosphere, Inc. All Rights Reserved.
ARCHITECTING FOR SCALE AT TWITTER
BEFORE AFTER
© 2016 Mesosphere, Inc. All Rights Reserved.
Streaming
10
THE MODERN ENTERPRISE APP
BIG DATA SERVICESMICROSERVICES
STATELESS CONTAINERS ANALYTICS
Batch
Machine
Learning
Search
DATABASES
Time
Series
SQL /
NoSQL
© 2016 Mesosphere, Inc. All Rights Reserved.
MODERN ENTERPRISE APPS
Containers Data Services
MicroservicesOpen source & Social coding1
2
3
4
© 2016 Mesosphere, Inc. All Rights Reserved.
OPEN SOURCE SOFTWARE PROVIDES LEVERAGE1
© 2016 Mesosphere, Inc. All Rights Reserved.
CONTAINERS SIMPLIFY PACKAGING AND DEPLOYMENT
Private Copy
Shared
App 3
Libraries
Guest
Operating
System
Infrastructure
App 1
Libs
Host Operating System
Start / stop time One minute to few seconds Milliseconds
Workload density 10 - 100x1x
App 2
Libraries
Guest
Operating
System
App 1
Libraries
Guest
Operating
System
App 2
Libs
App 3
Libs
Virtual Machines Containers
Host Operating System
Hypervisor
Infrastructure
App 4
Libs
App 5
Libs
2
© 2016 Mesosphere, Inc. All Rights Reserved.
JUST HOW FAST ARE CONTAINERS?
Larry Rau from @Verizon
with @flo Launching 50,000
containers in seconds with
@mesosphere #DC/OS
© 2016 Mesosphere, Inc. All Rights Reserved.
MICROSERVICES ENABLE FAST AND FREQUENT RELEASES
Traditional Architecture
Many functions
in a single process
Siloed
teams
RESTAPIs
Microservices Architecture
Cross-functional
teams organized
around capabilities
Scales
individually
Each element of
functionality defined as
“microservices”
Scales
monolithically
3
© 2016 Mesosphere, Inc. All Rights Reserved.
DATA SERVICES PROVIDE CONNECTION AND PERSISTENCE
Data Ingestion
Response
Devices
ClientSensors
Event Bus
Reactive
App
Database
Analytics
Use Case Examples
● Anomaly detection
● Personalization
● IoT Applications
● Predictive Analytics
● Machine Learning
4
© 2016 Mesosphere, Inc. All Rights Reserved. 17
BUT WHAT ABOUT THE INFRASTRUCTURE?
CaaSPaaS
Container
AppContainer App
Stateful
Service #1
V1
Big Data
Analytics #1
V1
Stateful
Service #2
V1
Stateful
Service #2
V2
PaaS
Container
App
Team A
Big Data
Analytics #1
V2
Big Data
Analytics
#2
V1
Team B
© 2016 Mesosphere, Inc. All Rights Reserved. 18
BUT WHAT ABOUT THE INFRASTRUCTURE?
CaaSPaaS
Container
AppContainer App
Stateful
Service #1
V1
Big Data
Analytics #1
V1
Stateful
Service #2
V1
Stateful
Service #2
V2
PaaS
Container
App
Team A
Big Data
Analytics #1
V2
Big Data
Analytics
#2
V1
Team B
● Extremely low utilization - less than 10%, due to static
partitioning
● Manual operations - Weeks to provision, wasted time
managing individual machines
● Difficult to experiment with new tech - months to
provision environments to evaluate new technologies
● High risk - Failure from manual operations and
difficulties maintaining high availability
© 2015 Mesosphere, Inc. All Rights Reserved.
WHERE HAVE WE SEEN THIS PROBLEM BEFORE?
You are launching Google Chrome.
Which core would you like to use?
Core 1 Core 2
Core 3 Core 4
You are launching a distributed app requiring 500 cores.
Which of your 50,000 cores would you like to use?
Core 1 Core 2 Core 3 Core 4 Core 5
Core 6 Core 8 Core 9 Core 10Core 7
Core 11 Core 13 Core 14 Core 15Core 12
Core 16 Core 18 Core 19 Core 20Core 17
Core 21 Core 23 Core 24 Core 25Core 22
Core 26 Core 28 Core 29 Core 30Core 27
Core 31 Core 33 Core 34 Core 35Core 32
Core 36 Core 38 Core 39 Core 40Core 37
Core 41 Core 43 Core 44 Core 45Core 42
© 2015 Mesosphere, Inc. All Rights Reserved.
MODERN ENTERPRISE APPS REQUIRE WE OPERATE
AT THE LOGICAL DATACENTER LEVEL
Traditional App Modern Enterprise App
© 2015 Mesosphere, Inc. All Rights Reserved.
YES, THIS TOO CAN BE SOLVED WITH ABSTRACTION
Scheduler
Executor
Task
Launch
Task
Launch
Task
Status
Task
Status
Resource
Offer
Executor
Executor
Executor
Scheduler
Executor
Task
Launch
Executor
Executor
Task
Status
Scheduler
Executor
Task
Launch
Executor
Executor
Task
Status
Distributed System A Distributed System B Datacenter Operating System
Approach
Distributed
Systems
A+B+C+...
Apache Mesos Two-level Scheduling
© 2015 Mesosphere, Inc. All Rights Reserved.
Datacenter Operating System (DC/OS)
DC/OS
...
Agent 1 Agent 2 Agent 3 Agent n
Server VM Cloud VM
...
Modern App
Components
FROM SERVER TO DATACENTER-SCALE
Server Operating System
OS (e.g., Windows, Linux)
...
Core 0 Core 1 Core 2 Core n
Server
Process
© 2016 Mesosphere, Inc. All Rights Reserved. 23
MODERN APPS WITH THE DC/OS MODEL
Traditional Approach
Big Data
Analytics
Stateful
Service
DC/OS Model
Container
App
Container
App
CaaS PaaS
● Turnkey install of datacenter-wide services
● Simplified operations & efficiency
● Lowers barriers to experiment with new tech (e.g., Spark)
Container
App
Datacenter-scale operating system
© 2016 Mesosphere, Inc. All Rights Reserved.
BRINGING
MODERN
APPS TO
EVERYONE
● 100% Open source
● No limits
25
THE DC/OS COMMUNITY
© 2016 Mesosphere, Inc. All Rights Reserved.
DC/OS
Operations
© 2016 Mesosphere, Inc. All Rights Reserved.
DC/OS
SERVICE
INSTALL:
SPARK
© 2016 Mesosphere, Inc. All Rights Reserved.
DC/OS
SERVICE
INSTALL:
KAFKA
© 2016 Mesosphere, Inc. All Rights Reserved. 29
DC/OS
SERVICE
UPDATE &
CONFIG:
KAFKA
© 2016 Mesosphere, Inc. All Rights Reserved.
DC/OS UNIVERSE: STORE FOR APP SERVICES
DC/OS
Anyone can publish on DC/OS Universe
app store - partners & OSS contributors
Popular services include Spark,
Cassandra, Jenkins, and Kafka
Services include distributed systems that
run elastically across the datacenter
Install these services with a single
command
Spark
Jenkins
Riak
DataStax Enterprise
Confluent Kafka
ArangoDB
GitLab
Cassandra
JFrog Artifactory
Elasticsearch
MariaDB
Storm
HDFS
Zeppelin
MemSQL
Over 40 Services Made For DC/OS
© 2016 Mesosphere, Inc. All Rights Reserved.
TRY DC/OS IN
UNDER 20
MINUTES
dcos.io
© 2016 Mesosphere, Inc. All Rights Reserved.
MESOSPHERE ENTERPRISE DC/OS
© 2016 Mesosphere, Inc. All Rights Reserved.
“We’re running real time analytics and
visualization of data from connected sensors
Before DC/OS we had no where near the scale
we had today, from thousands of to millions of
events per second.
Next, we’re doing predictive GIS”
Adam Mollenkopf, Real Time Geospatial
Information Systems Capability Lead
© 2016 Mesosphere, Inc. All Rights Reserved.
“We are building a PaaS and services on an
existing OpenStack cloud to enable developers to
build microservices on Docker containers and use
big data technologies...
DC/OS was a force multiplier for us to get these
new services out the door fast...
We transitioned the full enterprise infrastructure
at 2X the speed of previous efforts.”
Tim Pletcher
Engineering Director, Application Services
© 2016 Mesosphere, Inc. All Rights Reserved.
“We came across Mesosphere while planning for the
coming IoT market..
If I build everything in a silo, I have no chance...
With DC/OS, I have one single contiguous cluster
and I can bring my data and store it and I can run all
my applications as well..
and I think that's a huge advantage”
Larry Rau, Director Architecture & Infrastructure,
Verizon Labs
© 2016 Mesosphere, Inc. All Rights Reserved.
SPEED MATTERS
McKinsey Quarterly 2015: “The perils of ignoring software development”
Based on assessment of software development projects at 1,300 companies
Top quartile companies
bring new software
features to market
3x faster
than bottom quartile
© 2016 Mesosphere, Inc. All Rights Reserved.
Thank You
Questions?
@edwardihsu
Learn more at mesosphere.com, including our whitepaper:
Modern Enterprise App Operations with DC/OS
Lessons from Running Containers, Microservices, and
Stateful Big Data Services in Production

More Related Content

What's hot

Designing a reactive data platform: Challenges, patterns, and anti-patterns
Designing a reactive data platform: Challenges, patterns, and anti-patterns Designing a reactive data platform: Challenges, patterns, and anti-patterns
Designing a reactive data platform: Challenges, patterns, and anti-patterns Alex Silva
 
Digital Transformation with Kubernetes, Containers, and Microservices
Digital Transformation with Kubernetes, Containers, and MicroservicesDigital Transformation with Kubernetes, Containers, and Microservices
Digital Transformation with Kubernetes, Containers, and MicroservicesLightbend
 
Going Reactive in the Land of No
Going Reactive in the Land of NoGoing Reactive in the Land of No
Going Reactive in the Land of NoLightbend
 
Developing reliable applications with .net core and AKS
Developing reliable applications with .net core and AKSDeveloping reliable applications with .net core and AKS
Developing reliable applications with .net core and AKSAlessandro Melchiori
 
OpenWhisk: Where Did My Servers Go?
OpenWhisk: Where Did My Servers Go?OpenWhisk: Where Did My Servers Go?
OpenWhisk: Where Did My Servers Go?Carlos Santana
 
Building Reactive Fast Data & the Data Lake with Akka, Kafka, Spark
Building Reactive Fast Data & the Data Lake with Akka, Kafka, SparkBuilding Reactive Fast Data & the Data Lake with Akka, Kafka, Spark
Building Reactive Fast Data & the Data Lake with Akka, Kafka, SparkTodd Fritz
 
Spring Cloud Netflix OSS
Spring Cloud Netflix OSSSpring Cloud Netflix OSS
Spring Cloud Netflix OSSSteve Hall
 
Devoxx university - Kafka de haut en bas
Devoxx university - Kafka de haut en basDevoxx university - Kafka de haut en bas
Devoxx university - Kafka de haut en basFlorent Ramiere
 
Designing a reactive real-time data platform: Architecture and Infrastructure...
Designing a reactive real-time data platform: Architecture and Infrastructure...Designing a reactive real-time data platform: Architecture and Infrastructure...
Designing a reactive real-time data platform: Architecture and Infrastructure...Alex Silva
 
The full picture of Openstack in real-time
The full picture of Openstack in real-timeThe full picture of Openstack in real-time
The full picture of Openstack in real-timeDynatrace
 
What is reactive
What is reactiveWhat is reactive
What is reactiveLightbend
 
Revitalizing Walmart's Aging Architecture for Web Scale
Revitalizing Walmart's Aging Architecture for Web ScaleRevitalizing Walmart's Aging Architecture for Web Scale
Revitalizing Walmart's Aging Architecture for Web ScaleKevin Webber
 
Monitoring OpenStack? Piece of cake!
Monitoring OpenStack? Piece of cake!Monitoring OpenStack? Piece of cake!
Monitoring OpenStack? Piece of cake!Dirk Wallerstorfer
 
Smarter Monitoring for Highly Distributed Cloud Foundry Application Environme...
Smarter Monitoring for Highly Distributed Cloud Foundry Application Environme...Smarter Monitoring for Highly Distributed Cloud Foundry Application Environme...
Smarter Monitoring for Highly Distributed Cloud Foundry Application Environme...Dynatrace
 

What's hot (16)

Designing a reactive data platform: Challenges, patterns, and anti-patterns
Designing a reactive data platform: Challenges, patterns, and anti-patterns Designing a reactive data platform: Challenges, patterns, and anti-patterns
Designing a reactive data platform: Challenges, patterns, and anti-patterns
 
Digital Transformation with Kubernetes, Containers, and Microservices
Digital Transformation with Kubernetes, Containers, and MicroservicesDigital Transformation with Kubernetes, Containers, and Microservices
Digital Transformation with Kubernetes, Containers, and Microservices
 
Going Reactive in the Land of No
Going Reactive in the Land of NoGoing Reactive in the Land of No
Going Reactive in the Land of No
 
Developing reliable applications with .net core and AKS
Developing reliable applications with .net core and AKSDeveloping reliable applications with .net core and AKS
Developing reliable applications with .net core and AKS
 
Reactive Design Patterns
Reactive Design PatternsReactive Design Patterns
Reactive Design Patterns
 
OpenWhisk: Where Did My Servers Go?
OpenWhisk: Where Did My Servers Go?OpenWhisk: Where Did My Servers Go?
OpenWhisk: Where Did My Servers Go?
 
Building Reactive Fast Data & the Data Lake with Akka, Kafka, Spark
Building Reactive Fast Data & the Data Lake with Akka, Kafka, SparkBuilding Reactive Fast Data & the Data Lake with Akka, Kafka, Spark
Building Reactive Fast Data & the Data Lake with Akka, Kafka, Spark
 
Spring Cloud Netflix OSS
Spring Cloud Netflix OSSSpring Cloud Netflix OSS
Spring Cloud Netflix OSS
 
SQL vs. NoSQL
SQL vs. NoSQLSQL vs. NoSQL
SQL vs. NoSQL
 
Devoxx university - Kafka de haut en bas
Devoxx university - Kafka de haut en basDevoxx university - Kafka de haut en bas
Devoxx university - Kafka de haut en bas
 
Designing a reactive real-time data platform: Architecture and Infrastructure...
Designing a reactive real-time data platform: Architecture and Infrastructure...Designing a reactive real-time data platform: Architecture and Infrastructure...
Designing a reactive real-time data platform: Architecture and Infrastructure...
 
The full picture of Openstack in real-time
The full picture of Openstack in real-timeThe full picture of Openstack in real-time
The full picture of Openstack in real-time
 
What is reactive
What is reactiveWhat is reactive
What is reactive
 
Revitalizing Walmart's Aging Architecture for Web Scale
Revitalizing Walmart's Aging Architecture for Web ScaleRevitalizing Walmart's Aging Architecture for Web Scale
Revitalizing Walmart's Aging Architecture for Web Scale
 
Monitoring OpenStack? Piece of cake!
Monitoring OpenStack? Piece of cake!Monitoring OpenStack? Piece of cake!
Monitoring OpenStack? Piece of cake!
 
Smarter Monitoring for Highly Distributed Cloud Foundry Application Environme...
Smarter Monitoring for Highly Distributed Cloud Foundry Application Environme...Smarter Monitoring for Highly Distributed Cloud Foundry Application Environme...
Smarter Monitoring for Highly Distributed Cloud Foundry Application Environme...
 

Viewers also liked

Lambda at Weather Scale - Cassandra Summit 2015
Lambda at Weather Scale - Cassandra Summit 2015Lambda at Weather Scale - Cassandra Summit 2015
Lambda at Weather Scale - Cassandra Summit 2015Robbie Strickland
 
Data Scientist 101 BI Dutch
Data Scientist 101 BI DutchData Scientist 101 BI Dutch
Data Scientist 101 BI DutchJos van Dongen
 
Transforming Data Management and Time to Insight with Anzo Smart Data Lake®
Transforming Data Management and Time to Insight with Anzo Smart Data Lake®Transforming Data Management and Time to Insight with Anzo Smart Data Lake®
Transforming Data Management and Time to Insight with Anzo Smart Data Lake®Cambridge Semantics
 
Hi Speed Datawarehousing
Hi Speed DatawarehousingHi Speed Datawarehousing
Hi Speed DatawarehousingJos van Dongen
 
Introduction to Anzo Unstructured
Introduction to Anzo UnstructuredIntroduction to Anzo Unstructured
Introduction to Anzo UnstructuredCambridge Semantics
 
SnappyData overview NikeTechTalk 11/19/15
SnappyData overview NikeTechTalk 11/19/15SnappyData overview NikeTechTalk 11/19/15
SnappyData overview NikeTechTalk 11/19/15SnappyData
 
Database Shootout: What's best for BI?
Database Shootout: What's best for BI?Database Shootout: What's best for BI?
Database Shootout: What's best for BI?Jos van Dongen
 
Graph-based Discovery and Analytics at Enterprise Scale
Graph-based Discovery and Analytics at Enterprise ScaleGraph-based Discovery and Analytics at Enterprise Scale
Graph-based Discovery and Analytics at Enterprise ScaleCambridge Semantics
 
Always On: Building Highly Available Applications on Cassandra
Always On: Building Highly Available Applications on CassandraAlways On: Building Highly Available Applications on Cassandra
Always On: Building Highly Available Applications on CassandraRobbie Strickland
 
NoLambda: Combining Streaming, Ad-Hoc, Machine Learning and Batch Analysis
NoLambda: Combining Streaming, Ad-Hoc, Machine Learning and Batch AnalysisNoLambda: Combining Streaming, Ad-Hoc, Machine Learning and Batch Analysis
NoLambda: Combining Streaming, Ad-Hoc, Machine Learning and Batch AnalysisHelena Edelson
 
Scalable On-Demand Hadoop Clusters with Docker and Mesos
Scalable On-Demand Hadoop Clusters with Docker and MesosScalable On-Demand Hadoop Clusters with Docker and Mesos
Scalable On-Demand Hadoop Clusters with Docker and MesosDataWorks Summit
 
Online Analytics with Hadoop and Cassandra
Online Analytics with Hadoop and CassandraOnline Analytics with Hadoop and Cassandra
Online Analytics with Hadoop and CassandraRobbie Strickland
 
How to Build a Smart Data Lake Using Semantics
How to Build a Smart Data Lake Using SemanticsHow to Build a Smart Data Lake Using Semantics
How to Build a Smart Data Lake Using SemanticsCambridge Semantics
 
Semantic Graph Databases: The Evolution of Relational Databases
Semantic Graph Databases: The Evolution of Relational DatabasesSemantic Graph Databases: The Evolution of Relational Databases
Semantic Graph Databases: The Evolution of Relational DatabasesCambridge Semantics
 
Applying Data Engineering and Semantic Standards to Tame the "Perfect Storm" ...
Applying Data Engineering and Semantic Standards to Tame the "Perfect Storm" ...Applying Data Engineering and Semantic Standards to Tame the "Perfect Storm" ...
Applying Data Engineering and Semantic Standards to Tame the "Perfect Storm" ...Cambridge Semantics
 
Streaming Big Data & Analytics For Scale
Streaming Big Data & Analytics For ScaleStreaming Big Data & Analytics For Scale
Streaming Big Data & Analytics For ScaleHelena Edelson
 
Fast and Simplified Streaming, Ad-Hoc and Batch Analytics with FiloDB and Spa...
Fast and Simplified Streaming, Ad-Hoc and Batch Analytics with FiloDB and Spa...Fast and Simplified Streaming, Ad-Hoc and Batch Analytics with FiloDB and Spa...
Fast and Simplified Streaming, Ad-Hoc and Batch Analytics with FiloDB and Spa...Helena Edelson
 
SnappyData, the Spark Database. A unified cluster for streaming, transactions...
SnappyData, the Spark Database. A unified cluster for streaming, transactions...SnappyData, the Spark Database. A unified cluster for streaming, transactions...
SnappyData, the Spark Database. A unified cluster for streaming, transactions...SnappyData
 
Leveraging Kafka for Big Data in Real Time Bidding, Analytics, ML & Campaign ...
Leveraging Kafka for Big Data in Real Time Bidding, Analytics, ML & Campaign ...Leveraging Kafka for Big Data in Real Time Bidding, Analytics, ML & Campaign ...
Leveraging Kafka for Big Data in Real Time Bidding, Analytics, ML & Campaign ...Helena Edelson
 
Rethinking Streaming Analytics For Scale
Rethinking Streaming Analytics For ScaleRethinking Streaming Analytics For Scale
Rethinking Streaming Analytics For ScaleHelena Edelson
 

Viewers also liked (20)

Lambda at Weather Scale - Cassandra Summit 2015
Lambda at Weather Scale - Cassandra Summit 2015Lambda at Weather Scale - Cassandra Summit 2015
Lambda at Weather Scale - Cassandra Summit 2015
 
Data Scientist 101 BI Dutch
Data Scientist 101 BI DutchData Scientist 101 BI Dutch
Data Scientist 101 BI Dutch
 
Transforming Data Management and Time to Insight with Anzo Smart Data Lake®
Transforming Data Management and Time to Insight with Anzo Smart Data Lake®Transforming Data Management and Time to Insight with Anzo Smart Data Lake®
Transforming Data Management and Time to Insight with Anzo Smart Data Lake®
 
Hi Speed Datawarehousing
Hi Speed DatawarehousingHi Speed Datawarehousing
Hi Speed Datawarehousing
 
Introduction to Anzo Unstructured
Introduction to Anzo UnstructuredIntroduction to Anzo Unstructured
Introduction to Anzo Unstructured
 
SnappyData overview NikeTechTalk 11/19/15
SnappyData overview NikeTechTalk 11/19/15SnappyData overview NikeTechTalk 11/19/15
SnappyData overview NikeTechTalk 11/19/15
 
Database Shootout: What's best for BI?
Database Shootout: What's best for BI?Database Shootout: What's best for BI?
Database Shootout: What's best for BI?
 
Graph-based Discovery and Analytics at Enterprise Scale
Graph-based Discovery and Analytics at Enterprise ScaleGraph-based Discovery and Analytics at Enterprise Scale
Graph-based Discovery and Analytics at Enterprise Scale
 
Always On: Building Highly Available Applications on Cassandra
Always On: Building Highly Available Applications on CassandraAlways On: Building Highly Available Applications on Cassandra
Always On: Building Highly Available Applications on Cassandra
 
NoLambda: Combining Streaming, Ad-Hoc, Machine Learning and Batch Analysis
NoLambda: Combining Streaming, Ad-Hoc, Machine Learning and Batch AnalysisNoLambda: Combining Streaming, Ad-Hoc, Machine Learning and Batch Analysis
NoLambda: Combining Streaming, Ad-Hoc, Machine Learning and Batch Analysis
 
Scalable On-Demand Hadoop Clusters with Docker and Mesos
Scalable On-Demand Hadoop Clusters with Docker and MesosScalable On-Demand Hadoop Clusters with Docker and Mesos
Scalable On-Demand Hadoop Clusters with Docker and Mesos
 
Online Analytics with Hadoop and Cassandra
Online Analytics with Hadoop and CassandraOnline Analytics with Hadoop and Cassandra
Online Analytics with Hadoop and Cassandra
 
How to Build a Smart Data Lake Using Semantics
How to Build a Smart Data Lake Using SemanticsHow to Build a Smart Data Lake Using Semantics
How to Build a Smart Data Lake Using Semantics
 
Semantic Graph Databases: The Evolution of Relational Databases
Semantic Graph Databases: The Evolution of Relational DatabasesSemantic Graph Databases: The Evolution of Relational Databases
Semantic Graph Databases: The Evolution of Relational Databases
 
Applying Data Engineering and Semantic Standards to Tame the "Perfect Storm" ...
Applying Data Engineering and Semantic Standards to Tame the "Perfect Storm" ...Applying Data Engineering and Semantic Standards to Tame the "Perfect Storm" ...
Applying Data Engineering and Semantic Standards to Tame the "Perfect Storm" ...
 
Streaming Big Data & Analytics For Scale
Streaming Big Data & Analytics For ScaleStreaming Big Data & Analytics For Scale
Streaming Big Data & Analytics For Scale
 
Fast and Simplified Streaming, Ad-Hoc and Batch Analytics with FiloDB and Spa...
Fast and Simplified Streaming, Ad-Hoc and Batch Analytics with FiloDB and Spa...Fast and Simplified Streaming, Ad-Hoc and Batch Analytics with FiloDB and Spa...
Fast and Simplified Streaming, Ad-Hoc and Batch Analytics with FiloDB and Spa...
 
SnappyData, the Spark Database. A unified cluster for streaming, transactions...
SnappyData, the Spark Database. A unified cluster for streaming, transactions...SnappyData, the Spark Database. A unified cluster for streaming, transactions...
SnappyData, the Spark Database. A unified cluster for streaming, transactions...
 
Leveraging Kafka for Big Data in Real Time Bidding, Analytics, ML & Campaign ...
Leveraging Kafka for Big Data in Real Time Bidding, Analytics, ML & Campaign ...Leveraging Kafka for Big Data in Real Time Bidding, Analytics, ML & Campaign ...
Leveraging Kafka for Big Data in Real Time Bidding, Analytics, ML & Campaign ...
 
Rethinking Streaming Analytics For Scale
Rethinking Streaming Analytics For ScaleRethinking Streaming Analytics For Scale
Rethinking Streaming Analytics For Scale
 

Similar to Modern App Journey with Containers, Microservices and Big Data

Journey to the Modern App with Containers, Microservices and Big Data
Journey to the Modern App with Containers, Microservices and Big DataJourney to the Modern App with Containers, Microservices and Big Data
Journey to the Modern App with Containers, Microservices and Big DataLightbend
 
Hyperscale Computing, Enterprise Agility with Mesosphere
Hyperscale Computing, Enterprise Agility with MesosphereHyperscale Computing, Enterprise Agility with Mesosphere
Hyperscale Computing, Enterprise Agility with MesosphereMarkus Eisele
 
Partner Webinar: Mesosphere and DSE: Production-Proven Infrastructure for Fas...
Partner Webinar: Mesosphere and DSE: Production-Proven Infrastructure for Fas...Partner Webinar: Mesosphere and DSE: Production-Proven Infrastructure for Fas...
Partner Webinar: Mesosphere and DSE: Production-Proven Infrastructure for Fas...DataStax
 
Powering Predictive Mapping at Scale with Spark, Kafka, and Elastic Search: S...
Powering Predictive Mapping at Scale with Spark, Kafka, and Elastic Search: S...Powering Predictive Mapping at Scale with Spark, Kafka, and Elastic Search: S...
Powering Predictive Mapping at Scale with Spark, Kafka, and Elastic Search: S...Spark Summit
 
Downtime is not an option - day 2 operations - Jörg Schad
Downtime is not an option - day 2 operations -  Jörg SchadDowntime is not an option - day 2 operations -  Jörg Schad
Downtime is not an option - day 2 operations - Jörg SchadCodemotion
 
DOD 2016 - Jörg Schad - How Fast Data and Microservices Change the Datacenter.
DOD 2016 - Jörg Schad - How Fast Data and Microservices Change the Datacenter.DOD 2016 - Jörg Schad - How Fast Data and Microservices Change the Datacenter.
DOD 2016 - Jörg Schad - How Fast Data and Microservices Change the Datacenter.PROIDEA
 
Mesos, DC/OS and the Architecture of the New Datacenter
Mesos, DC/OS and the Architecture of the New DatacenterMesos, DC/OS and the Architecture of the New Datacenter
Mesos, DC/OS and the Architecture of the New DatacenterQAware GmbH
 
Elastic data services on Apache Mesos via Mesosphere’s DCOS
Elastic data services on Apache Mesos via Mesosphere’s DCOSElastic data services on Apache Mesos via Mesosphere’s DCOS
Elastic data services on Apache Mesos via Mesosphere’s DCOSharrythewiz
 
Alluxio Mesos Meetup - SMACK to SMAACK
Alluxio Mesos Meetup - SMACK to SMAACKAlluxio Mesos Meetup - SMACK to SMAACK
Alluxio Mesos Meetup - SMACK to SMAACKAlluxio, Inc.
 
[DO16] Mesosphere : Microservices meet Fast Data on Azure
[DO16] Mesosphere : Microservices meet Fast Data on Azure [DO16] Mesosphere : Microservices meet Fast Data on Azure
[DO16] Mesosphere : Microservices meet Fast Data on Azure de:code 2017
 
Mesosphere & Magnetic: Take the pain out of running complex and critical serv...
Mesosphere & Magnetic: Take the pain out of running complex and critical serv...Mesosphere & Magnetic: Take the pain out of running complex and critical serv...
Mesosphere & Magnetic: Take the pain out of running complex and critical serv...Mesosphere Inc.
 
Smack Stack and Beyond—Building Fast Data Pipelines with Jorg Schad
Smack Stack and Beyond—Building Fast Data Pipelines with Jorg SchadSmack Stack and Beyond—Building Fast Data Pipelines with Jorg Schad
Smack Stack and Beyond—Building Fast Data Pipelines with Jorg SchadSpark Summit
 
SMACK stack and beyond
SMACK stack and beyondSMACK stack and beyond
SMACK stack and beyondMatt Jarvis
 
OSDC 2018 | From batch to pipelines – why Apache Mesos and DC/OS are a soluti...
OSDC 2018 | From batch to pipelines – why Apache Mesos and DC/OS are a soluti...OSDC 2018 | From batch to pipelines – why Apache Mesos and DC/OS are a soluti...
OSDC 2018 | From batch to pipelines – why Apache Mesos and DC/OS are a soluti...NETWAYS
 
DevOps vs. Site Reliability Engineering (SRE) in Age of Kubernetes
DevOps vs. Site Reliability Engineering (SRE) in Age of KubernetesDevOps vs. Site Reliability Engineering (SRE) in Age of Kubernetes
DevOps vs. Site Reliability Engineering (SRE) in Age of KubernetesDevOps.com
 
Containerizing couchbase with microservice architecture on mesosphere.pptx
Containerizing couchbase with microservice architecture on mesosphere.pptxContainerizing couchbase with microservice architecture on mesosphere.pptx
Containerizing couchbase with microservice architecture on mesosphere.pptxRavi Yadav
 
Scaling Like Twitter with Apache Mesos
Scaling Like Twitter with Apache MesosScaling Like Twitter with Apache Mesos
Scaling Like Twitter with Apache MesosMesosphere Inc.
 
Developing a successful big data business strategy
Developing a successful big data business strategyDeveloping a successful big data business strategy
Developing a successful big data business strategySebastian Darrington
 
Operating Kubernetes at Scale (Australia Presentation)
Operating Kubernetes at Scale (Australia Presentation)Operating Kubernetes at Scale (Australia Presentation)
Operating Kubernetes at Scale (Australia Presentation)Mesosphere Inc.
 

Similar to Modern App Journey with Containers, Microservices and Big Data (20)

Journey to the Modern App with Containers, Microservices and Big Data
Journey to the Modern App with Containers, Microservices and Big DataJourney to the Modern App with Containers, Microservices and Big Data
Journey to the Modern App with Containers, Microservices and Big Data
 
Hyperscale Computing, Enterprise Agility with Mesosphere
Hyperscale Computing, Enterprise Agility with MesosphereHyperscale Computing, Enterprise Agility with Mesosphere
Hyperscale Computing, Enterprise Agility with Mesosphere
 
Partner Webinar: Mesosphere and DSE: Production-Proven Infrastructure for Fas...
Partner Webinar: Mesosphere and DSE: Production-Proven Infrastructure for Fas...Partner Webinar: Mesosphere and DSE: Production-Proven Infrastructure for Fas...
Partner Webinar: Mesosphere and DSE: Production-Proven Infrastructure for Fas...
 
Powering Predictive Mapping at Scale with Spark, Kafka, and Elastic Search: S...
Powering Predictive Mapping at Scale with Spark, Kafka, and Elastic Search: S...Powering Predictive Mapping at Scale with Spark, Kafka, and Elastic Search: S...
Powering Predictive Mapping at Scale with Spark, Kafka, and Elastic Search: S...
 
Downtime is not an option - day 2 operations - Jörg Schad
Downtime is not an option - day 2 operations -  Jörg SchadDowntime is not an option - day 2 operations -  Jörg Schad
Downtime is not an option - day 2 operations - Jörg Schad
 
DOD 2016 - Jörg Schad - How Fast Data and Microservices Change the Datacenter.
DOD 2016 - Jörg Schad - How Fast Data and Microservices Change the Datacenter.DOD 2016 - Jörg Schad - How Fast Data and Microservices Change the Datacenter.
DOD 2016 - Jörg Schad - How Fast Data and Microservices Change the Datacenter.
 
Mesos, DC/OS and the Architecture of the New Datacenter
Mesos, DC/OS and the Architecture of the New DatacenterMesos, DC/OS and the Architecture of the New Datacenter
Mesos, DC/OS and the Architecture of the New Datacenter
 
Kubernetes on DC/OS
Kubernetes on DC/OSKubernetes on DC/OS
Kubernetes on DC/OS
 
Elastic data services on Apache Mesos via Mesosphere’s DCOS
Elastic data services on Apache Mesos via Mesosphere’s DCOSElastic data services on Apache Mesos via Mesosphere’s DCOS
Elastic data services on Apache Mesos via Mesosphere’s DCOS
 
Alluxio Mesos Meetup - SMACK to SMAACK
Alluxio Mesos Meetup - SMACK to SMAACKAlluxio Mesos Meetup - SMACK to SMAACK
Alluxio Mesos Meetup - SMACK to SMAACK
 
[DO16] Mesosphere : Microservices meet Fast Data on Azure
[DO16] Mesosphere : Microservices meet Fast Data on Azure [DO16] Mesosphere : Microservices meet Fast Data on Azure
[DO16] Mesosphere : Microservices meet Fast Data on Azure
 
Mesosphere & Magnetic: Take the pain out of running complex and critical serv...
Mesosphere & Magnetic: Take the pain out of running complex and critical serv...Mesosphere & Magnetic: Take the pain out of running complex and critical serv...
Mesosphere & Magnetic: Take the pain out of running complex and critical serv...
 
Smack Stack and Beyond—Building Fast Data Pipelines with Jorg Schad
Smack Stack and Beyond—Building Fast Data Pipelines with Jorg SchadSmack Stack and Beyond—Building Fast Data Pipelines with Jorg Schad
Smack Stack and Beyond—Building Fast Data Pipelines with Jorg Schad
 
SMACK stack and beyond
SMACK stack and beyondSMACK stack and beyond
SMACK stack and beyond
 
OSDC 2018 | From batch to pipelines – why Apache Mesos and DC/OS are a soluti...
OSDC 2018 | From batch to pipelines – why Apache Mesos and DC/OS are a soluti...OSDC 2018 | From batch to pipelines – why Apache Mesos and DC/OS are a soluti...
OSDC 2018 | From batch to pipelines – why Apache Mesos and DC/OS are a soluti...
 
DevOps vs. Site Reliability Engineering (SRE) in Age of Kubernetes
DevOps vs. Site Reliability Engineering (SRE) in Age of KubernetesDevOps vs. Site Reliability Engineering (SRE) in Age of Kubernetes
DevOps vs. Site Reliability Engineering (SRE) in Age of Kubernetes
 
Containerizing couchbase with microservice architecture on mesosphere.pptx
Containerizing couchbase with microservice architecture on mesosphere.pptxContainerizing couchbase with microservice architecture on mesosphere.pptx
Containerizing couchbase with microservice architecture on mesosphere.pptx
 
Scaling Like Twitter with Apache Mesos
Scaling Like Twitter with Apache MesosScaling Like Twitter with Apache Mesos
Scaling Like Twitter with Apache Mesos
 
Developing a successful big data business strategy
Developing a successful big data business strategyDeveloping a successful big data business strategy
Developing a successful big data business strategy
 
Operating Kubernetes at Scale (Australia Presentation)
Operating Kubernetes at Scale (Australia Presentation)Operating Kubernetes at Scale (Australia Presentation)
Operating Kubernetes at Scale (Australia Presentation)
 

Recently uploaded

Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Scott Keck-Warren
 
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...HostedbyConfluent
 
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking MenDelhi Call girls
 
Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreternaman860154
 
Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountPuma Security, LLC
 
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationBeyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationSafe Software
 
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure serviceWhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure servicePooja Nehwal
 
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmaticsKotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmaticscarlostorres15106
 
08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking MenDelhi Call girls
 
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...Neo4j
 
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | DelhiFULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhisoniya singh
 
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 3652toLead Limited
 
Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Allon Mureinik
 
How to Remove Document Management Hurdles with X-Docs?
How to Remove Document Management Hurdles with X-Docs?How to Remove Document Management Hurdles with X-Docs?
How to Remove Document Management Hurdles with X-Docs?XfilesPro
 
How to convert PDF to text with Nanonets
How to convert PDF to text with NanonetsHow to convert PDF to text with Nanonets
How to convert PDF to text with Nanonetsnaman860154
 
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024BookNet Canada
 
Azure Monitor & Application Insight to monitor Infrastructure & Application
Azure Monitor & Application Insight to monitor Infrastructure & ApplicationAzure Monitor & Application Insight to monitor Infrastructure & Application
Azure Monitor & Application Insight to monitor Infrastructure & ApplicationAndikSusilo4
 
Key Features Of Token Development (1).pptx
Key  Features Of Token  Development (1).pptxKey  Features Of Token  Development (1).pptx
Key Features Of Token Development (1).pptxLBM Solutions
 

Recently uploaded (20)

Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024
 
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
 
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
 
The transition to renewables in India.pdf
The transition to renewables in India.pdfThe transition to renewables in India.pdf
The transition to renewables in India.pdf
 
Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreter
 
Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path Mount
 
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationBeyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
 
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure serviceWhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
 
E-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptx
E-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptxE-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptx
E-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptx
 
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmaticsKotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
 
08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men
 
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
 
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | DelhiFULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
 
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
 
Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)
 
How to Remove Document Management Hurdles with X-Docs?
How to Remove Document Management Hurdles with X-Docs?How to Remove Document Management Hurdles with X-Docs?
How to Remove Document Management Hurdles with X-Docs?
 
How to convert PDF to text with Nanonets
How to convert PDF to text with NanonetsHow to convert PDF to text with Nanonets
How to convert PDF to text with Nanonets
 
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
 
Azure Monitor & Application Insight to monitor Infrastructure & Application
Azure Monitor & Application Insight to monitor Infrastructure & ApplicationAzure Monitor & Application Insight to monitor Infrastructure & Application
Azure Monitor & Application Insight to monitor Infrastructure & Application
 
Key Features Of Token Development (1).pptx
Key  Features Of Token  Development (1).pptxKey  Features Of Token  Development (1).pptx
Key Features Of Token Development (1).pptx
 

Modern App Journey with Containers, Microservices and Big Data

  • 1. © 2016 Mesosphere, Inc. All Rights Reserved. Edward Hsu, VP of Enterprise DC/OS @edwardihsu JOURNEY TO THE MODERN APP WITH CONTAINERS, MICROSERVICES AND BIG DATA Datacenter Operating System (DC/OS) The simplest way to build, run, scale and manage modern enterprise apps
  • 2. © 2016 Mesosphere, Inc. All Rights Reserved.
  • 3. © 2016 Mesosphere, Inc. All Rights Reserved. INDUSTRY TRANSITIONS Customer analytics 2000s Electronic customer records 1980s Online customer engagement 1990s Real-time & predictive customer engagement 2013+
  • 4. © 2016 Mesosphere, Inc. All Rights Reserved.
  • 5. © 2016 Mesosphere, Inc. All Rights Reserved.
  • 6. © 2016 Mesosphere, Inc. All Rights Reserved. MAYO CLINIC REVOLUTIONIZING HEALTHCARE Individualized care recommendations based on 5 million patient records Key technologies: ● Real-time data ingestion ● Distributed search engine ● Large-scale processing ● Distributed database
  • 7. © 2016 Mesosphere, Inc. All Rights Reserved. UBER DISRUPTING MULTIPLE INDUSTRIES Operations in over 300 cities around the world Key technologies: ● Distributed logging ● Large-scale data processing ● Distributed datastore
  • 8. © 2016 Mesosphere, Inc. All Rights Reserved. ARCHITECTURAL SHIFT TRADITIONAL ENTERPRISE APPLICATIONS MODERN ENTERPRISE APPLICATIONS Data Code Latency Users 2+ Billion smartphone users 3+ Billion internet users Enterprise data growth (CAGR): 40%+ Source: KPCB Internet Trends 2016, EMC Digital Universe 2014
  • 9. © 2016 Mesosphere, Inc. All Rights Reserved. ARCHITECTING FOR SCALE AT TWITTER BEFORE AFTER
  • 10. © 2016 Mesosphere, Inc. All Rights Reserved. Streaming 10 THE MODERN ENTERPRISE APP BIG DATA SERVICESMICROSERVICES STATELESS CONTAINERS ANALYTICS Batch Machine Learning Search DATABASES Time Series SQL / NoSQL
  • 11. © 2016 Mesosphere, Inc. All Rights Reserved. MODERN ENTERPRISE APPS Containers Data Services MicroservicesOpen source & Social coding1 2 3 4
  • 12. © 2016 Mesosphere, Inc. All Rights Reserved. OPEN SOURCE SOFTWARE PROVIDES LEVERAGE1
  • 13. © 2016 Mesosphere, Inc. All Rights Reserved. CONTAINERS SIMPLIFY PACKAGING AND DEPLOYMENT Private Copy Shared App 3 Libraries Guest Operating System Infrastructure App 1 Libs Host Operating System Start / stop time One minute to few seconds Milliseconds Workload density 10 - 100x1x App 2 Libraries Guest Operating System App 1 Libraries Guest Operating System App 2 Libs App 3 Libs Virtual Machines Containers Host Operating System Hypervisor Infrastructure App 4 Libs App 5 Libs 2
  • 14. © 2016 Mesosphere, Inc. All Rights Reserved. JUST HOW FAST ARE CONTAINERS? Larry Rau from @Verizon with @flo Launching 50,000 containers in seconds with @mesosphere #DC/OS
  • 15. © 2016 Mesosphere, Inc. All Rights Reserved. MICROSERVICES ENABLE FAST AND FREQUENT RELEASES Traditional Architecture Many functions in a single process Siloed teams RESTAPIs Microservices Architecture Cross-functional teams organized around capabilities Scales individually Each element of functionality defined as “microservices” Scales monolithically 3
  • 16. © 2016 Mesosphere, Inc. All Rights Reserved. DATA SERVICES PROVIDE CONNECTION AND PERSISTENCE Data Ingestion Response Devices ClientSensors Event Bus Reactive App Database Analytics Use Case Examples ● Anomaly detection ● Personalization ● IoT Applications ● Predictive Analytics ● Machine Learning 4
  • 17. © 2016 Mesosphere, Inc. All Rights Reserved. 17 BUT WHAT ABOUT THE INFRASTRUCTURE? CaaSPaaS Container AppContainer App Stateful Service #1 V1 Big Data Analytics #1 V1 Stateful Service #2 V1 Stateful Service #2 V2 PaaS Container App Team A Big Data Analytics #1 V2 Big Data Analytics #2 V1 Team B
  • 18. © 2016 Mesosphere, Inc. All Rights Reserved. 18 BUT WHAT ABOUT THE INFRASTRUCTURE? CaaSPaaS Container AppContainer App Stateful Service #1 V1 Big Data Analytics #1 V1 Stateful Service #2 V1 Stateful Service #2 V2 PaaS Container App Team A Big Data Analytics #1 V2 Big Data Analytics #2 V1 Team B ● Extremely low utilization - less than 10%, due to static partitioning ● Manual operations - Weeks to provision, wasted time managing individual machines ● Difficult to experiment with new tech - months to provision environments to evaluate new technologies ● High risk - Failure from manual operations and difficulties maintaining high availability
  • 19. © 2015 Mesosphere, Inc. All Rights Reserved. WHERE HAVE WE SEEN THIS PROBLEM BEFORE? You are launching Google Chrome. Which core would you like to use? Core 1 Core 2 Core 3 Core 4 You are launching a distributed app requiring 500 cores. Which of your 50,000 cores would you like to use? Core 1 Core 2 Core 3 Core 4 Core 5 Core 6 Core 8 Core 9 Core 10Core 7 Core 11 Core 13 Core 14 Core 15Core 12 Core 16 Core 18 Core 19 Core 20Core 17 Core 21 Core 23 Core 24 Core 25Core 22 Core 26 Core 28 Core 29 Core 30Core 27 Core 31 Core 33 Core 34 Core 35Core 32 Core 36 Core 38 Core 39 Core 40Core 37 Core 41 Core 43 Core 44 Core 45Core 42
  • 20. © 2015 Mesosphere, Inc. All Rights Reserved. MODERN ENTERPRISE APPS REQUIRE WE OPERATE AT THE LOGICAL DATACENTER LEVEL Traditional App Modern Enterprise App
  • 21. © 2015 Mesosphere, Inc. All Rights Reserved. YES, THIS TOO CAN BE SOLVED WITH ABSTRACTION Scheduler Executor Task Launch Task Launch Task Status Task Status Resource Offer Executor Executor Executor Scheduler Executor Task Launch Executor Executor Task Status Scheduler Executor Task Launch Executor Executor Task Status Distributed System A Distributed System B Datacenter Operating System Approach Distributed Systems A+B+C+... Apache Mesos Two-level Scheduling
  • 22. © 2015 Mesosphere, Inc. All Rights Reserved. Datacenter Operating System (DC/OS) DC/OS ... Agent 1 Agent 2 Agent 3 Agent n Server VM Cloud VM ... Modern App Components FROM SERVER TO DATACENTER-SCALE Server Operating System OS (e.g., Windows, Linux) ... Core 0 Core 1 Core 2 Core n Server Process
  • 23. © 2016 Mesosphere, Inc. All Rights Reserved. 23 MODERN APPS WITH THE DC/OS MODEL Traditional Approach Big Data Analytics Stateful Service DC/OS Model Container App Container App CaaS PaaS ● Turnkey install of datacenter-wide services ● Simplified operations & efficiency ● Lowers barriers to experiment with new tech (e.g., Spark) Container App Datacenter-scale operating system
  • 24. © 2016 Mesosphere, Inc. All Rights Reserved. BRINGING MODERN APPS TO EVERYONE ● 100% Open source ● No limits
  • 26. © 2016 Mesosphere, Inc. All Rights Reserved. DC/OS Operations
  • 27. © 2016 Mesosphere, Inc. All Rights Reserved. DC/OS SERVICE INSTALL: SPARK
  • 28. © 2016 Mesosphere, Inc. All Rights Reserved. DC/OS SERVICE INSTALL: KAFKA
  • 29. © 2016 Mesosphere, Inc. All Rights Reserved. 29 DC/OS SERVICE UPDATE & CONFIG: KAFKA
  • 30. © 2016 Mesosphere, Inc. All Rights Reserved. DC/OS UNIVERSE: STORE FOR APP SERVICES DC/OS Anyone can publish on DC/OS Universe app store - partners & OSS contributors Popular services include Spark, Cassandra, Jenkins, and Kafka Services include distributed systems that run elastically across the datacenter Install these services with a single command Spark Jenkins Riak DataStax Enterprise Confluent Kafka ArangoDB GitLab Cassandra JFrog Artifactory Elasticsearch MariaDB Storm HDFS Zeppelin MemSQL Over 40 Services Made For DC/OS
  • 31. © 2016 Mesosphere, Inc. All Rights Reserved. TRY DC/OS IN UNDER 20 MINUTES dcos.io
  • 32. © 2016 Mesosphere, Inc. All Rights Reserved. MESOSPHERE ENTERPRISE DC/OS
  • 33. © 2016 Mesosphere, Inc. All Rights Reserved. “We’re running real time analytics and visualization of data from connected sensors Before DC/OS we had no where near the scale we had today, from thousands of to millions of events per second. Next, we’re doing predictive GIS” Adam Mollenkopf, Real Time Geospatial Information Systems Capability Lead
  • 34. © 2016 Mesosphere, Inc. All Rights Reserved. “We are building a PaaS and services on an existing OpenStack cloud to enable developers to build microservices on Docker containers and use big data technologies... DC/OS was a force multiplier for us to get these new services out the door fast... We transitioned the full enterprise infrastructure at 2X the speed of previous efforts.” Tim Pletcher Engineering Director, Application Services
  • 35. © 2016 Mesosphere, Inc. All Rights Reserved. “We came across Mesosphere while planning for the coming IoT market.. If I build everything in a silo, I have no chance... With DC/OS, I have one single contiguous cluster and I can bring my data and store it and I can run all my applications as well.. and I think that's a huge advantage” Larry Rau, Director Architecture & Infrastructure, Verizon Labs
  • 36. © 2016 Mesosphere, Inc. All Rights Reserved. SPEED MATTERS McKinsey Quarterly 2015: “The perils of ignoring software development” Based on assessment of software development projects at 1,300 companies Top quartile companies bring new software features to market 3x faster than bottom quartile
  • 37. © 2016 Mesosphere, Inc. All Rights Reserved. Thank You Questions? @edwardihsu Learn more at mesosphere.com, including our whitepaper: Modern Enterprise App Operations with DC/OS Lessons from Running Containers, Microservices, and Stateful Big Data Services in Production