OpenStack Tokyo Presentation about best practices for scale deployment using Digital Rebar & Open Contrail. Rob Hirschfeld and Parantap Lahiri

1. Apply, Rinse, Repeat to
get Location Agnostic
(re)Build OpenStack Ready
Infrastructure Like a Pro

2. Rob Hirschfeld
OpenStack Foundation board.
RackN
CEO & co-Founder - We specialize in
portable infrastructure automation
Background: Dell and start-ups
● Twitter: @zehicle
● Blog http://robhirschfeld.com
Juniper Networks
Sr. Director of Contrail Solutions Engineering
NFV related solutions with service chaining and
interaction with MPLS based Telco network
infrastructure
Background: Microsoft Online, UUNet
Parantap Lahiri

3. Complete Provisioning System (in containers!)
“API for Metal” automates physical
infrastructure
“Start to Scale” works on any platform from
desktop to datacenter
“Open Ops” makes DevOps portable between
sites
Deploys container platforms using containers.
Seamless Virtual Network Across multiple
Orchestration System
Each container POD or VM gets IP address from
separate Virtual Network Space
Policy Based Virtual Network Interconnect plus
Filtering with micro-segmentation
On-Demand Virtual and Physical (VNF and PNF)
Service Insertion
Detailed Analytics on flow data and resource
utilization

4. Making Cloud Infrastructure Agnostic
We want hybrid clouds but they are technically challenging
What major challenges do we face?
● Open Platforms - OpenStack
● Distributed Overlay Networking - Open Contrail
● Consistent Scale Operations - Digital Rebar
And…. Faster Iterations

5. Traditional Stacking
This approach is creates a lot of complexity
Metal Network Cloud Network Containers

6. Infrastructure needs are heterogeneous
App
AppApp

7. Overlay networks can span all environments
?
o
v
e
r
l
a
y
App
AppApp

8. True Hybrid: Private & Multiple Public
o
v
e
r
l
a
yPublic
On Prem
Public

9. True Hybrid: Private & Multiple Public

10. Why is this so hard?!

11. Scale faults from the “Fidelity Gap”
Testing for production on a desktop
or cloud is not sufficient.
Automation is required at all levels.
We want to use the SAME
deployment at every level to
eliminate translation errors.
Production
Dev
Test
PoC
Scale
Effort
Easy
Hard
5 10 20 100+
How Do Deployments Fail?
One step at a time
Fidelity
Gap

12. Major Differences in:
● Networking
● Timing / Sequential Ops
● Need for fault tolerance
● Process Requirements
● Ops / Environmentals
● User motivation / priorities
● Ownership
Why a Fidelity Gap? Different needs
Scale
Effort
Easy
Hard
5 10 20 100+
Desktop
Cloud
Lab
Datacenter

13. Operationally Challenging
Different Requirements
Fragmented networking
Hybrid straddles multiple phases
Scale
Effort
Easy
Hard
5 10 20 100+
Desktop
Cloud
Lab
Datacenter

14. Addressing the “Fidelity Gap”
Faithful ops between environments
Portable DevOps automation
Fast cycle times for developers
Transparent execution
True multi-node even when small
Mix-and-match environments
Production
Dev
Test
PoC
Scale
Effort
Easy
Hard
5 10 20 100+

15. Apply, Rinse & Repeat - cycle time matters!
Looking for at least, 10x faster
If you have fidelity, work translates
However, that’s not useful if we’ve
added too much time or effort
overhead
Redeploy Virtual in 5 to 10 minutes
Redeploy Metal in 1 to 2 hours
Production
Dev
Test
PoC
Scale
Effort
Easy
Hard
5 10 20 100+
10,000x
1,000x
100x
10x
1x
10x
100x
1,000x

16. HybridInfrastructure

17. Networks require logical & physical actions

18. Composable
Approach
Building multi-site
networks requires
coordinating
activities at
multiple layers and
sites.
ORCHESTRATION
IS NOT OPTIONAL

19. Sequence Matters
in System
Construction
Digital Rebar orchestrates
cross platform operational
steps to bring up the physical
and logical systems.
The Digital Rebar “annealer”
coordinates activities over
multiple control planes.

20. TargetEndState

21. Let’s keep it simple AND connected
Rob
Project http://rebar.digital & @digitalrebar
Rob: http://robhirschfeld.com & @zehicle
Parantap
OpenContrail http://OpenContrail.org &
@OpenContrail
Parantap: plahiri@juniper.net

22. Additional Material

23. Digital Rebar with Docker Compose
Complete Datacenter Ops in containers.
Fast to setup and reset
Low overhead and scales up to 100s
DockerCompose(15containers)
Consul
Rebar API
Rebar Engine
Postgresql
NTP
DNS
DHCP
Provisioner
...
Port Map
Port Map
Port Map
Port Map
Port Map
Port Map
Docker
Hub

24. Digital Rebar with Consul
Consul (registry & shared keystore)
● registers all services
● shared secrets
● & more stuff we don’t use
Rebar API & Orchestration (yellow)
Services Managed by Rebar (blue)
Services Used by Rebar (green)
Docker Containers
ConsulForwarder
Rebar API
Postgresql
Rebar Engine
DNS
Provision
NTP
DHCP
Chef Loggers

25. Kubernetes Metadata
Determines:
● which containers
● dependencies between
● port mapping
● variables injection
● start/stop/scale
● tenant networking
AND multi-system infrastructure
Kubernetes
Keystore
Database
Web Front
Service 1
Service 2
Batch Item
Foo
Bar
...
Port Map
Port Map
Port Map
Port Map
Port Map
Port Map
Docker
Hub

26. Running Kubernetes
Master + Minion: cluster via etcd
Builds networking tunnel for pods
Additional pluggable services (L3)
Manages container
● life-cycle
● placement
● dependencies
Docker
Containers
Docker
Containers
Docker
Containers
SDN Agent
App
Kubernetes
Minion
Kubernetes
Minion
Kubernetes
Minion
SDN Agent SDN Agent
App
AppApp
AppApp
App
AppApp
AppApp
App App
AppApp
AppApp
App
Kubernetes
Master
etcd (shared store)

27. Flannel is weak SDN (basically UDP)
Requires kernel modification (fast!)
When L2 and L3 support is needed
Multi-datacenter connections
Mix infrastructure (docker, VMs, metal)
Expect to have multiple SDN options
+ OpenContrail
Docker
Containers
Docker
Containers
Docker
Containers
Contrail
Agent
App
Kubernetes
Minion
Kubernetes
Minion
Kubernetes
Minion
Contrail
Agent
Contrail
Agent
App
AppApp
AppApp
App
AppApp
AppApp
App App
AppApp
AppApp
App
Kubernetes
Master
etcd (shared store)
Contrail
Controller

28. Key Contrail Features