On-demand recording: https://nginx.webex.com/nginx/lsr.php?RCID=82f9c75402528464d3625813e313f8a4 The new NGINX Microservices Reference Architecture (MRA) goes into depth on the entire architecture. Join this webinar to explore all three models in the MRA: the Proxy Model, the Router Mesh Model, and the Fabric Model. The Proxy Model gives you a leg up into microservices, including support for API gateways. The Router Mesh Model adds power, with a second server exclusively for microservices support. And the Fabric Model pairs an NGINX Plus instance with every microservice instance for secure SSL/TLS communications between service instances. Check out this webinar to learn about building a secure and scalable microservices app: * When to take the leap into deploying microservices * Why you should consider adopting the MRA for your app * How to choose a model that works for your app * How to start the process of converting a monolith to microservices

1. Three Models in the
NGINX Microservices
Reference Architecture
February 8, 2017

2. MORE INFORMATION AT NGINX.COM
Who Are We?
Chris Stetson
Chief Architect
Formerly:
- Vice President, Technology, Razorfish
- Vice President, West Coast, Huge
Floyd Smith
Technical Marketing Writer
Formerly:
- Apple, Alta Vista, Google, and more
- Author of multiple books on technology

3. MORE INFORMATION AT
NGINX.COM
Agenda
• NGINX Plus
• The Big Shift
• The Networking Problem
• Service Discovery
• Load Balancing
• Secure & Fast Intercommunication
• Architectures
• Issues

4. MORE INFORMATION AT NGINX.COM
Who Are You?
Job Titles
Analyst
Architect
CEO, CIO, CTO
Consultant
cool guy
Cloud Architect, Engineer
Developer
DevOps
Engineer
IT Lead, Manager
Security Architect
Systems Analyst
Tech Lead
Organization Types
Airlines
Computer technology
Consultancy
Ecommerce
Finance
Freelance
Government
Higher education
Mobile phones
Networking technology
Press
SaaS
Telecoms
Reasons for Attending
“Build ms platforms”
“Client proposals”
“Compare the three models
to our solution”
“Create API Gateway”
“Developing microservices”
“DevOps”
“Microservices strategies”
“Migrate from F5”
“Move from .NET”
“Move from Apache”
“Moving from monolith”
“Playing with microservices”

5. MORE INFORMATION AT
NGINX.COM
NGINX Plus

6. MORE INFORMATION AT NGINX.COM
About NGINX, Inc.
• Founded in 2011, and NGINX Plus first released in 2013
• VC-backed by enterprise software industry leaders
• Offices in San Francisco, Sunnyvale, Cork, Cambridge,
and Moscow
• 1,000+ commercial customers
• 100+ employees

7. >300 milliontotal sites
running on NGINX
7Source: Netcraft June 2016 Web Server Survey

8. >50%of the top 100,000
busiest websites
8Source: W3Techs Web Technology Survey

9. >40%of sites on AWS
9Source: SumoLogic

10. 10

11. MORE INFORMATION AT NGINX.COM
OPEN SOURCE
PLUS
FEATURES
REQUEST ROUTING COMPRESSION LOAD BALANCING APP HEALTH MONITORING GUI VISUALIZATION
SSL EMBEDDED SCRIPT LANGUAGE EDGE CACHE MEDIA STREAMING MONITORING ANALYTICS CONFIGURATION RESTFUL API
What’s Inside NGINX Plus?
11

12. Internet
Web Server
Serve content from disk
Application Gateway
FastCGI, uWSGI, Passenger…
Reverse Proxy
Caching, load balancing…
HTTP traffic
Where NGINX Plus Fits

13. MORE INFORMATION AT NGINX.COM
Public/Private/Hybrid CloudBare Metal Containers
13
NGINX Plus Works in All Environments

14. MORE INFORMATION AT NGINX.COM
NGINX and Microservices
• Two-thirds of surveyed developers using or investigating
microservices
• Microservices is #1 topic on our website
• Chris Richardson series, Introduction to Microservices
• Chris Stetson series, NGINX MRA
• MRA Training
• …and much more; contact Sales for free evaluation

15. MORE INFORMATION AT
NGINX.COM
The Big Shift

16. MORE INFORMATION AT
NGINX.COM
Architectural
Changes:
Monolith to
Microservices 1

17. MORE INFORMATION AT
NGINX.COM
Architectural
Changes:
Monolith to
Microservices 2

18. MORE INFORMATION AT
NGINX.COM
An Anecdote

19. MORE INFORMATION AT
NGINX.COM
The Tight Loop
Problem
• REST calls
• 1000s of requests
• Looped data

20. MORE INFORMATION AT
NGINX.COM
Mitigation
• Group requests
• Cache data
• Optimize the network

21. MORE INFORMATION AT
NGINX.COM
NGINX Microservices

22. MORE INFORMATION AT
NGINX.COM
Microservices
Reference
Architecture
• Docker containers
• Polyglot services
• Design incorporates
Twelve-Factor App
principles

23. MORE INFORMATION AT
NGINX.COM
The Networking
Problem

24. MORE INFORMATION AT
NGINX.COM
Service
Discovery
• Services needs to know
where other services are
• Service registries work in
many different ways
• Register and read service
information

25. MORE INFORMATION AT
NGINX.COM
Load Balancing
• High-quality load
balancing
• Developer configurable

26. MORE INFORMATION AT
NGINX.COM
Secure & Fast
Communication
• Encryption at the
transmission layer is
becoming standard
• SSL/TLS communication
is slow
• Encryption is
CPU-intensive

27. MORE INFORMATION AT
NGINX.COM
Solution
• Service discovery
• Robust load balancing
• Fast encryption

28. MORE INFORMATION AT
NGINX.COM
Network
Architectures

29. MORE INFORMATION AT
NGINX.COM
Proxy Model
• Inbound traffic is
managed through a
reverse proxy/load
balancer
• Services are left to
themselves to connect to
each other…
• …often through round-
robin DNS

30. MORE INFORMATION AT
NGINX.COM
Proxy Model
• Focus on Internet traffic
• A shock absorber for your app
• Dynamic connectivity

31. MORE INFORMATION AT
NGINX.COM
Router Mesh
Model
• Inbound routing through
reverse proxy
• Centralized load
balancing through a
separate load-balancing
service
• Deis Router works like
this

32. MORE INFORMATION AT
NGINX.COM
Circuit
Breakers
• Active health checks
• Retry
• Caching

33. MORE INFORMATION AT
NGINX.COM
Router Mesh
• Robust service discovery
• Advanced load balancing
• Circuit breaker pattern

34. MORE INFORMATION AT
NGINX.COM
Interprocess
Communication
• Routing is done at the
container level
• Services connect to each
other as needed
• NGINX Plus acts as the
forward and reverse
proxy for all requests

35. MORE INFORMATION AT
NGINX.COM
Normal Process
• DNS service discovery
• Relies on round-robin
DNS
• Each request creates a
new SSL/TLS connection,
which fully implemented
requires 9 requests

36. MORE INFORMATION AT
NGINX.COM
Detail
• NGINX Plus runs in each
container
• Application code talks to
NGINX Plus locally
• NGINX Plus talks to
NGINX Plus
• NGINX Plus queries the
service registry

37. MORE INFORMATION AT
NGINX.COM
Circuit Breaker
Plus
• Active health checks
• Retry
• Caching

38. MORE INFORMATION AT
NGINX.COM
Fabric Model
• Robust service discovery
• Advanced load balancing
• Circuit breaker pattern
• Persistent SSL Network

39. MORE INFORMATION AT NGINX.COM
NGINX and Microservices
• Two-thirds of surveyed developers using or investigating
microservices
• Microservices is #1 topic on our website
• Chris Richardson series, Introduction to Microservices
• Chris Stetson series, NGINX MRA
• MRA Training
• …and much more; contact Sales for free evaluation

40. MORE INFORMATION AT
NGINX.COM
Questions