This hands on workshop explores implementing various microservices patterns using 1) Pure Netflix OSS 2) Docker with Netflix and Prometheus 3) Docker & Kubernetes with Prometheus

1. © 2018 NIIT Tech | www.niit-tech.com | Confidential
1
© 2018 NIIT Tech | www.niit-tech.com | Confidential
APIs and Microservices
121 Test Automation Day
21st April 2018
Puneet Sachdev
Chief Architect, NIIT Technologies
puneet.sachdev@niit-tech.com
https://www.linkedin.com/in/puneetsachdev/

2. © 2018 NIIT Tech | www.niit-tech.com | Confidential
2

3. © 2018 NIIT Tech | www.niit-tech.com | Confidential
3

4. © 2018 NIIT Tech | www.niit-tech.com | Confidential
4
Microservices is about
splitting a single application
into smaller pieces which are
independent and have their
own lifecycle
Microservices vs. SOA vs. APIs

5. © 2018 NIIT Tech | www.niit-tech.com | Confidential
5
Microservices vs. SOA vs. APIs
CRM DW Finance Loyalty
SOA is about integrating
different applications which
can be internal or 3rd party

6. © 2018 NIIT Tech | www.niit-tech.com | Confidential
6
Microservices vs. SOA vs. APIs
SOA Microservices
• Integration between different applications • Splitting an application into smaller pieces
• Dominated by proprietary stacks • Dominated by Open Source components from
organizations like Netflix
• Smart Pipes, Dumb Endpoints • Dumb pipes, Smart Endpoints
• Typically Hub-n-Spoke. Technology
Monoliths
• Completely Distributed
APIS
• APIs are interfaces which are exposed either internally and/or externally and have governance
and management around it

7. © 2018 NIIT Tech | www.niit-tech.com | Confidential
7
Microservices Reference Architecture
Microservices Technology
Stack
• Open Source
• Lightweight
• Based on
• Spring
• Netflix
• Docker, k8s

8. © 2018 NIIT Tech | www.niit-tech.com | Confidential
8
Concepts to be explored
1. Service Discovery (using Eureka/Kubernetes)
• Microservices applications run in containerized/virtualized and cloud environments where their actual locations change
dynamically
• How does a client of a service discover the location?
2. Circuit Breakers (using Hystrix)
• Microservices applications have many moving parts and span across multiple boundaries
• How to prevent a network or service failure from cascading to other services?
3. Client Side Load Balancing (using Ribbon/Kubernetes)
• Dumb pipes and smart endpoints. Where does this leave load balancing?
4. Proxy (using Zuul/Kubernetes)
• With diverse traffic hitting microservices, how to get an ability to provide intelligent filters on requests
5. Monitoring (using Hystrix Monitor/Prometheus+Grafana)
• When things fail, it is extremely important to note what is failing
• How to monitor in near real time many microservices?

9. © 2018 NIIT Tech | www.niit-tech.com | Confidential
9
Codebases
1. Pure Netflix & Spring (Eureka, Hystrix, Ribbon, Zuul, Spring Config, Spring Boot)
https://github.com/psachdev6375/microservices-bootcamp.git
2. Docker-Netflix-Spring (Docker, Eureka, Hystrix, Ribbon, Zuul, Prometheus, Grafana, Spring)
https://github.com/psachdev6375/docker-microservices-bootcamp.git
3. Docker-k8s-Netflix-Spring (Docker, k8s, Hystrix, Prometheus, Grafana, Spring)
https://github.com/psachdev6375/k8s-microservices-bootcamp.git

10. © 2018 NIIT Tech | www.niit-tech.com | Confidential
10
© 2018 NIIT Tech | www.niit-tech.com | Confidential
Subject
Service
Verb
Service
Article
Service
Adjective
Service
Noun
Service
You saw the leaky seat
Sentence
Service
Code: https://github.com/psachdev6375/microservices-bootcamp.git
Scenario

11. © 2018 NIIT Tech | www.niit-tech.com | Confidential
11
© 2018 NIIT Tech | www.niit-tech.com | Confidential
Pure Netflix, Spring Boot implementation
Code: https://github.com/psachdev6375/microservices-bootcamp.git

12. © 2018 NIIT Tech | www.niit-tech.com | Confidential
12
© 2018 NIIT Tech | www.niit-tech.com | Confidential
Verb
Service
Eureka
Sentence
Service
Subject
Service
Article
Service
Adjective
Service
Noun
Service
1. Start Eureka Server
2. Check Eureka console
3. Start Sentence Service
4. See Circuit Breaker in action
5. See Hystrix Dashboard
Code: https://github.com/psachdev6375/microservices-bootcamp.git

13. © 2018 NIIT Tech | www.niit-tech.com | Confidential
13
© 2018 NIIT Tech | www.niit-tech.com | Confidential
Verb
Service
Eureka
Sentence
Service
Subject
Service
Article
Service
Adjective
Service
Noun
Service
1. Start Eureka Server
2. Check Eureka console
3. Start Sentence Service
4. See Circuit Breaker in action
5. See Hystrix Dashboard
6. All services running
Zuul
Code: https://github.com/psachdev6375/microservices-bootcamp.git

14. © 2018 NIIT Tech | www.niit-tech.com | Confidential
14
© 2018 NIIT Tech | www.niit-tech.com | Confidential
Verb
Service
Eureka
Sentence
Service
Subject
Service
Article
Service
Adjective
Service
Noun
Service
1. Start Eureka Server
2. Check Eureka console
3. Start Sentence Service
4. See Circuit Breaker in action
5. See Hystrix Dashboard
6. All services running
7. Zuul Proxy
Zuul
Code: https://github.com/psachdev6375/microservices-bootcamp.git

15. © 2018 NIIT Tech | www.niit-tech.com | Confidential
15
© 2018 NIIT Tech | www.niit-tech.com | Confidential
Verb
Service
Eureka
Sentence
Service
Subject
Service
Article
Service
Adjective
Service
Noun
Service
1. Start Eureka Server
2. Check Eureka console
3. Start Sentence Service
4. See Circuit Breaker in action
5. See Hystrix Dashboard
6. All services running
7. Zuul Proxy
8. Scaling Noun Service
Zuul
Noun
Service
Code: https://github.com/psachdev6375/microservices-bootcamp.git

16. © 2018 NIIT Tech | www.niit-tech.com | Confidential
16
© 2018 NIIT Tech | www.niit-tech.com | Confidential
Docker, Docker-Compose, Netflix, Spring Boot,
Prometheus, Grafana implementation
https://github.com/psachdev6375/docker-microservices-bootcamp.git

17. © 2018 NIIT Tech | www.niit-tech.com | Confidential
17
© 2018 NIIT Tech | www.niit-tech.com | Confidential
https://github.com/psachdev6375/docker-microservices-bootcamp.git
Adjective Article Noun Subject Verb
Eureka
Sentence Grafana
Prometheus
Monitoring endpoint /prometheus
Zuul
Concepts
• Discovery (eureka)
• Circuit Breakers (hystrix)
• Client Side LB (ribbon)
• Proxy (zuul)
• Containers (docker)
• Monitoring & Alerts
(Prometheus)
• Dashboard (Grafana)

18. © 2018 NIIT Tech | www.niit-tech.com | Confidential
18
© 2018 NIIT Tech | www.niit-tech.com | Confidential
Docker, Kubernetes, Hystrix, Spring Boot,
Prometheus, Grafana implementation
https://github.com/psachdev6375/k8s-microservices-bootcamp.git

19. © 2018 NIIT Tech | www.niit-tech.com | Confidential
19
© 2018 NIIT Tech | www.niit-tech.com | Confidential
https://github.com/psachdev6375/k8s-microservices-bootcamp.git
Kubernetes Cluster
Concepts
• Discovery (k8s)
• Circuit Breakers (Hystrix)
• Load Balancing (k8s
services)
• Proxy (k8s services)
• Containers
• Container Orchestration
(k8s)
• Monitoring & Alerts
(Prometheus)
• Dashboard (Grafana)
Adjective
Pods
Adjective
Service
Article
Pods
Article
Service
Noun
Pods
Noun Service
Subject
Pods
Subject
Service
Verb
Pods
Verb Service
Sentence
Pods
Sentence
Service
Prometheus
Pods
Prometheus
Service
Grifana
Pods
Grifana
Service

20. © 2018 NIIT Tech | www.niit-tech.com | Confidential
20
Thank You
Puneet Sachdev
Chief Architect, NIIT Technologies
puneet.sachdev@niit-tech.com
https://www.linkedin.com/in/puneetsachdev/