This document discusses various technology topics including DevOps, Docker, microservices, and cloud computing. It provides an overview of the exponential growth of data and importance of handling increasing volumes over time. DevOps is defined as a culture that breaks down silos between development and operations teams to prioritize continuous integration, delivery, scalability, reliability and security. Docker is introduced as a tool for building and shipping applications but is not just lightweight virtual machines or a configuration tool. Microservices architecture is also discussed as an approach involving small, independent services that use language-agnostic APIs.
5. README.MD
ALISTAIR ISRAEL
▸In 1999, developed and deployed a 20M page view/month
Web site
▸On two (2) HP servers (active-passive, manual failover)
▸Dual Pentium 3 CPUs at 500+ MHz
▸256MB RAM
▸200GB HD
▸ASP and C++ on Microsoft IIS
13. “EXPONENTIAL GROWTH
WILL CONTINUE
INDEFINITELY: YOU WILL
NEED TO HANDLE TWICE
AS MUCH CRAP TODAY
AS YOU DID 18 MONTHS
AGO.”
“EXPONENTIAL GROWTH
WILL CONTINUE
INDEFINITELY: YOU WILL
NEED TO HANDLE TWICE
AS MUCH CRAP TODAY
AS YOU DID 18 MONTHS
AGO.”
42. DEVCON 2015 TECH RADAR
WHAT DEVOPS IS NOT
▸It’s not a tool
▸It’s not a methodology
▸“Giving developers the root password”
▸A separate role or team
43. DEVELOPMENT
▸“Move fast and break
things.”
▸Iterations: from 2 weeks
down to continuous
▸“It works on my machine!”
▸Security?
OPERATIONS
▸“Don’t fix it if it ain’t broke.
▸Procurement: from 2 weeks
up to 4 months
▸Dev ≠ Test ≠ Staging ≠
Production
▸Security!
55. DEVCON 2015 TECH RADAR
DEMYSTIFYING DOCKER
▸What Docker is NOT
▸Not just lightweight VMs
▸Not another configuration management tool
▸Not a silver bullet
72. “The biggest single benefit of Docker is the
extent that it’s empowered the team to
build services from scratch. We no longer
have a complex set of provisioning scripts
or AMIs—we just hand the production
cluster an image, and it runs. There’s no
more stateful instances, and we’re
guaranteed to run the same exact code on
both staging and prod.”
http://highscalability.com/blog/2015/10/19/se
gment-rebuilding-our-infrastructure-with-
docker-ecs-and-te.html
DEVCON 2015 TECH RADAR
77. Automated Infrastructure
(IaaS, Baremetal)
Cloud Native Container Service
(Kubernetes, Mesos, Swarm)
Cloud Native Apps (Domain Specific Use Cases)
Big Data
& Batch
Data Services
Cache, DB
Infra Services
Logging,
Monitoring
PaaS
Microservices,
Lambda,
Tasks
CI/CD
THE NEW STACK
Mutable state isn't evil. It's necessary in the real world. It's just that stateful actions don't compose well, especially when you involve concurrency or Big Code problems. Good programmers learn that they need to manage (not eliminate) mutable state. That's what FP is about.
Clojure, for example, powers Akamai, the massive content delivery network utilized by companies such as Facebook, while Twitter famously adopted Scala for its most performance-intensive components, and Haskell is used by AT&T for its network security systems.
Clojure, for example, powers Akamai, the massive content delivery network utilized by companies such as Facebook, while Twitter famously adopted Scala for its most performance-intensive components, and Haskell is used by AT&T for its network security systems.
http://www.smashingmagazine.com/2014/07/dont-be-scared-of-functional-programming/
In 2010, Google’s CEO Eric Schmidt estimated that *every two days* we create as much data as we did from the dawn of civilization up until 2003—about 5 *exabytes* (or five thousand petabytes).
“Many people seem to think we are promoting a world where developers and system administrators all just run wild on the production systems and that it will somehow work out for the best.”
"How to automate to make this more efficient, how do we push code to different environments 400 to 500 times per week…”
“Many people seem to think we are promoting a world where developers and system administrators all just run wild on the production systems and that it will somehow work out for the best.”
Registry: Fully 25% of companies running Docker are using Registry, presumably instead of Docker Hub.
NGINX: Docker is being used to contain a lot of HTTP servers, it seems. It is interesting that Apache (httpd) didn’t make the top 10.
Redis: This popular in-memory key/value data store is often used as an in-memory database, message queue, or cache.
Ubuntu: Still the default to build images.
Logspout: For collecting logs from all containers on a host, and routing them to wherever they need to go.
MongoDB: The widely-used NoSQL datastore.
Elasticsearch: Full text search.
CAdvisor: Used by Kubernetes to collect metrics from containers.
MySQL: The most widely used open source database in the world.
Postgres: The second-most widely used open source database in the world. Adding the Postgres and MySQL numbers, it appears that using Docker to run relational databases is surprisingly common.