Yuval Birenboum discusses challenges in cloud native applications and microservices including service discovery, resiliency, secret and config management, and more. A service mesh like Istio addresses these issues by pushing cross-cutting concerns to infrastructure using the Envoy proxy for a universal data plane and Istio for a control plane. This provides capabilities like traffic management, security, observability, and chaos engineering testing throughout the service mesh.

1. CHAOS ENGINEERING,
CLOUD NATIVE
& SERVICE MESH
Yuval Birenboum
Nov 18

2. I AM A BUILDER!

3. Chairman @ Pivotal

4. AT THE BEGINNING THERE WAS AN
and the app was code
That needed to scale

6. DEPLOYMENT
Containers: lightweight VMs
Easy to deploy
Fast start up
Small size
BUT..

7. Scaling up and down
Redundancy
Scheduling/automation
Service discovery
Resiliency
Rolling out and back
Health check
Secret and config

8. BUT..

10. WE PUSH THE COMPLEXITY TO THE SPACE BTWEEN OUT SERVICES

11. NEW CHALLENGES IN A CLOUDY, SERVICES WORD
Logging, Tracing, Metrics
Dependency Visualization
Service Identity and Auth
Circuit Breaking
Traffic flow and Policies
Failover
Fault Injection
And..

12. AND, CONTINUED..
Retries
Timeouts
Rate limiting
Back pressure
Request shadowing
Edge/DMZ routing
A/B Tesing
And..

13. OH YAH.. AND ..
SECURITY

14. #Code#Infastructure

16. Service discovery
Health check

17. Timeout
Retries

18. Service Gateway
Edge/DMZ routing

19. Service Identity and Auth
Service Identity and Auth

20. Distributed Configuration
Secret and config

21. Open Tracing
Logging, Tracing, Metrics
Dependency Visualization

22. 0 ms delay 500 ms delay 800 ms delay 1100 ms delay
Circuit Breaker, SLA, Metrics & Preformance
Circuit Breaking
Logging, Tracing, Metrics

23. Auto scaling
Kubernetes ?

27. SOME DRAWBACKS TO THE #Code
APPROACH?
Specific to programming language
A single language does not fit all cases
Deployment and rolling updates
Traffic flow and Policies
Fault Injection
A/B Tesing
Request shadowing
Maybe #Infastructure ?

28. #Code#Infastructure

29. #SERVICE MESH a network of #SERVICES
not bytes
Pushing microservices cross cutting concerns in to the
infrastructure layer

30. MEET #envoy AND THE #data Plane
ENVOY IS AN OPEN SOURCE EDGE AND SERVICE
PROXY, DESIGNED FOR CLOUD-NATIVE
APPLICATIONS
high performance C++ distributed proxy
communication bus and “universal data plane”
runs alongside every application and abstracts the network by
providing common features in a platform-agnostic manner

31. MEET #SERVICE MESH #istio AND THE
#control Plane

34. Canary
Deployment
A/B
Splitting traffic
between versions

35. Timeouts and
Retries

36. Fault injection

37. Circuit Breaking

38. Gateway and Edge
Routing

39. SECURITY
istio Security tries to provide a comprehensive security solution to solve
microservices particular security needs
Namespace-level and service-level policies
Mutual TLS Authentication
Role-based access control (RBAC)
More..

40. Observability, Policies and Telemetry
enforce authorization policies and collect telemetry for the services in a mesh
Metrics (Prometheus)
Logs (fluentd)
Tracing (jaeger/zipkin)
Cluster traffic (kiali)

44. #CHAOS ENGINEERING

57. Is that all?

66. founder of Github

67. CI/CD Pipeline
Every Commit
Continues Deployment (Release Life-Cycle)
Continues Integration (Feature Life-Cycle)

68. Responsible Engineering and Testing
Automation

69. Security Automation in CI
Stage

77. Q&A