The document discusses Istio, an open source service mesh that provides traffic management, resilience, and monitoring for microservices. It connects, secures, and manages communication between microservices. Istio allows intelligent routing, A/B testing, canary releases, and more without requiring code changes. It also provides in-depth telemetry and policies to understand service dependencies and ensure access policies are enforced across services.

1. ISTIO
NILESH PATEL (SENIOR OFFERING MANAGER)

2. MICROSERVICES
▸Decomposing an application into single function modules
which are independently deployed and operated
▸Accelerate delivery by minimizing communication and
coordination between people

3. ARCHITECTURE

4. THE TRADE OFF
Improved delivery
velocity in exchange for
increased operational
complexity
Hailo microservices

5. MICROSERVICES ARE HARD
▸Applications aren’t running in green-field environments
▸Network layer is hard to manage
▸Tooling is nascent

6. THINGS TO CONSIDER
• Security

7. THINGS TO CONSIDER
• Security
• Canary deployments

8. THINGS TO CONSIDER
• Security
• Canary deployments
• A/B testing

9. THINGS TO CONSIDER
• Security
• Canary deployments
• A/B testing
• Circuit breaking

10. THINGS TO CONSIDER
• Security
• Canary deployments
• A/B testing
• Circuit breaking
• Rate limiting

11. THINGS TO CONSIDER
• Security
• Canary deployments
• A/B testing
• Circuit breaking
• Rate limiting
• Fault injection

12. THINGS TO CONSIDER
• Security
• Canary deployments
• A/B testing
• Circuit breaking
• Rate limiting
• Fault injection
• Policy management

13. THINGS TO CONSIDER
• Security
• Canary deployments
• A/B testing
• Circuit breaking
• Rate limiting
• Fault injection
• Policy management
• Many more….

14. It’s doable, but…

15. It’s doable, but…
Requires a lot of coding

16. Service Mesh
A dedicated infrastructure layer to make service-to-
service communication fast, safe and reliable

17. ISTIO
A service mesh designed to connect, manage and secure
micro services

18. ISTIO
A service mesh designed to connect, manage and secure
micro services
Open Source

19. ISTIO
A service mesh designed to connect, manage and secure
micro services
Open Source
Zero Code Changes

20. FEATURES

21. INTELLIGENT ROUTING AND LOAD BALANCING
‣ Conduct traffic between services
with dynamic route configuration
‣ A/B tests
‣ Canary releases
‣ Red/Black deployments

22. RESILIENCE ACROSS LANGUAGES AND PLATFORMS
‣ Increase reliability by shielding
applications from flaky networks
and cascading failures in adverse
conditions

23. FLEET-WIDE POLICY ENFORCEMENT
‣ Apply organizational policy to the
interaction between services
‣ Ensure access policies are
enforced
‣ Make sure resources are fairly
distributed among consumers.

24. IN-DEPTH TELEMETRY AND REPORTING
‣ Understand the dependencies
between services, the nature and
flow of traffic between them, and
quickly identify issues with
distributed tracing.

25. ENVOY
‣ C++ based L4/L7 proxy
‣ Low memory footprint
‣ Battle tested at Lyft
▸Runs with 100+ services
▸10K VMs
▸2M requests/sec

26. ARCHITECTURE

27. COMMUNITY PARTNERS
‣ Tigera
‣ RedHat
‣ Pivotal
‣ Cisco
‣ Weave works
‣ Datawire
‣ Scytale (SPIFEE)
‣ Microsoft
‣ And more…

28. CONTACT ME
Nilesh Patel: pateln@us.ibm.com
CONTACT ME
Nilesh Patel: pateln@us.ibm.com

29. USEFUL LINKS
‣ Web istio.io
‣ Twitter: @Istiomesh
‣ Traffic management using Istio: https://ibm.co/2F7xSnf
‣ Resiliency and fault-tolerance using Istio: https://bit.ly/2qStF2B
‣ Reliable application roll out and operations using Istio:
https://bit.ly/2K9IRQX

30. THANK YOU!

31. BACK UP

32. ISTIO ANALYTICS