Microservices present challenges of coordination, SSL termination and socket connection among others. Looking to different cloud providers to assist with their load-balancers leaves you wanting as features socket connection support, SSL termination and geo-distributed load-balancing are often absent. Presented at Nginx Conf 2016.

1. 16
Powering
Microservices &
Sockets using
Nginx and
Kubernetes
Lee Calcote
Yogi Porla
http://calcotestudios.com/nginx16

2. Lee Calcote
linkedin.com/in/leecalcote
@lcalcote
blog.gingergeek.com
lee@calcotestudios.com
clouds, containers, infrastructure,
applications and their management
Free ebook
Preorder
Available

3. Our App
A 1GB jar

4. Case Study
is an IDE for game developers
- created by game
development studio based in
Austin (MaxPlay)
- creates a real-time,
collaborative game
development engine
@lcalcote
“google docs
for game
development”

5. Vert.x
Our Bloat-a-lith
@lcalcote
EventBus Handler
Persistence Verticle
SockJS
Analytics
Analytics UI
Hazelcast
GridConnection
Telemetry
Telemetry Analysis
Projects, Streams,
Users, Sessions,
Tenants
Kafka Producer
Platform Client
Producer
Spark, R
GCE Network
Load Balancer Kafka
Rendering Engines
Platform Publishing
Tool
Game Analysis
Single instance

6. App is Reactive
Deals with sockets
Limited resources
Culture / DevOps / Cloud Maturity
Support containers and VMs
Propagation of huge data sets
@lcalcote
The Challenge
On-the-fly intelligent rendering
Distribution of content
Extremely low latency for Reactive services
Blocking vs non-blocking
On-premises telemetry collection and
analytics

7. Shaping Up

8. Characteristics of
Microservices
small, autonomous services that work together.
how small is small?
independent, autonomous service
self-contained functional unit
@lcalcote
Who has a system that is
too big and that you’d
like to break down?
Can a small team manage it?
More moving parts
increases complexity.
Can you make a change to a
service and deploy it by itself
without changing anything else?

9. Faster delivery, rolling updates
Horizontal scale out on-demand;
on an individual service basis
Modular architecture
Easy integration and deployments
Service isolation, resilience and fail-safe recovery
@lcalcote
Benefits of Microservices
- a quick review
Democratization of language and technology choice

10. Kubernetes & Nginx
to the Rescue
@lcalcote

11. Our Microbloat v1
@lcalcote
Analytics UI
Authentication
Telemetry
Telemetry Analysis
Spark, R
Kafka
Rendering Engines
Platform Publishing
Tool
Game Analysis
Master
etcd
Authorization
Locking
Authorization
Projects
AuthorizationAuthorization
kube-proxy kube-proxy
SockJS
Authorization
kube-proxy
Node Node
Node
kube-api, etc.

12. Comparing
Services
(not shoes)

13. SSL Termination
@lcalcote
Kubernetes 1.3 No
Swarm 1.12 No
Mesos+Marathon Yes
ELB Classic Yes
ELB L7 Yes
Beanstalk Yes (EC2)
IOT Yes
ECS Yes (EC2)
Lambda ?
Container
Orchestrators
Clouds
AWS
Azure
GCP
Load-Balancer No
App Gateway Yes
Container Service ?
Cloud LB (HTTP) Yes (beta)
Cloud LB (Network) Yes (beta)
GKE No
Link
Link
Link
Link
Link
Link
Link
Link
Link
SSL Proxy
SSL Proxy

14. Websocket Support
@lcalcote
Kubernetes 1.3 No
Swarm 1.12 No
Mesos+Marathon Yes
ELB Classic Yes
ELB L7 Yes
Beanstalk Yes
IOT Yes
ECS Yes
Lambda Yes
Container
Orchestrators
Clouds
AWS
Azure
GCP
Load-Balancer No
App Gateway Yes
Container Service ?
Cloud LB (HTTP) No
Cloud LB (Network) Yes
GKE No
Link
Link
Link
Link
Link
Link
Link
Link
Link
Link
Link

15. Why Nginx
Hybrid needs
On-premises and Google Cloud Platform
Consistent administration and capabilities
central load balancing and proxy platform
Support for VM and container-based technologies with
minimal configuration change
Deeper feature set available as services/team matures
use as an Application Delivery Controller
@lcalcote
Platform independence

16. Microbloat v2
Going deeper with Nginx & Kubernetes
Service Discovery with Nginx Plus
Need for locating service instances instantly without reconfiguring
On-the-fly Reconfiguration API
Work with etcd
As an ingress controller in Kubernetes
SSL termination
Path-based rules
Multiple host names
@lcalcote

17. @lcalcote
Common Administration
w/Nginx Plus
App
App App

18. GSLB & Content Caching
w/Nginx Plus
@lcalcote
App
App
App
GeoDNS
US
Regions
Session Persistence and Sticky Routing help in
performance of request routing and localized content
Content Caching provides faster retrieval of data
Performance, reliability and availability
Global
Regions

19. A/B Testing Using Nginx
@lcalcote
Requests
App v0.1
App v0.2
90% of requests go to v0.1
10% of requests go to v0.2

20. Lee Calcote
linkedin.com/in/leecalcote
@lcalcote
blog.gingergeek.com
lee@calcotestudios.com
clouds, containers, infrastructure,
applications and their management
Questions?