It’s a common question: how are microservices different from the Service Oriented Architecture (SOA) we saw a decade ago? While they might be similar to what SOA advocates support, microservices have proven to deliver impressive developer productivity gains at the largest enterprises, including as Google, Amazon, and Netflix. Pivotal’s Matt Stine and Apigee’s Alan Ho discuss: - real-world examples of microservices best practices - anti-patterns and traps for microservices - recommendations on tools & technology to help with microservices implementations

1. ©2015 Apigee Corp. All Rights Reserved.
1

2. ©2015 Apigee Corp. All Rights Reserved.
Slideshare
slideshare.com/apigee
Apigee Community
https://community.apigee.com
YouTube"
youtube.com/apigee
https://community.apigee.com/questions/20895/is-microservices-soa-done-right.html

3. ©2015 Apigee Corp. All Rights Reserved.
Matt Stine!Senior Product Manager - Pivotal Software, Inc.
Author of:!
http://bit.ly/cloud-native-book

4. ©2015 Apigee Corp. All Rights Reserved.
Alan Ho!Head of Developer Programs – Apigee
Author of:!
MICRO
Just Joking

5. ©2015 Apigee Corp. All Rights Reserved.
Some Companies Has Helped with Microservices!
5

6. ©2015 Apigee Corp. All Rights Reserved.
Some Companies Has Helped with Microservices!
6

7. ©2015 Apigee Corp. All Rights Reserved.
How do you fix your last SOA
deployment (joke) !
7

8. ©2015 Apigee Corp. All Rights Reserved.
More (micro)Services !!
8

9. ©2015 Apigee Corp. All Rights Reserved.
Think Graphs, Not Layers!!
9

10. ©2015 Apigee Corp. All Rights Reserved.
Not Monoliths!
Relational Database
Data Access
Service
HTML JavaScript MVC
Service
Monolithic ApplicationBrowser

11. ©2015 Apigee Corp. All Rights Reserved.
Enterprise Service Bus
Service Service Service Service
Service Service Service Service
UI UI
Not Traditional (ESB-centric) SOA!

12. ©2015 Apigee Corp. All Rights Reserved.
But Microservices!!

13. ©2015 Apigee Corp. All Rights Reserved.
No Microservice is an Island!!
13

14. ©2015 Apigee Corp. All Rights Reserved.
Example Distributed System: Minified!

15. Some emergent challenges of microservices
systems…!
Ÿ Configuration Management!
Ÿ Service Registration & Discovery!
Ÿ Routing & Load Balancing!
Ÿ Fault Tolerance (Circuit Breakers!)!
Ÿ Monitoring!

16. ©2015 Apigee Corp. All Rights Reserved.
Example: Coordination Boiler Plate!

17. ©2015 Apigee Corp. All Rights Reserved.
Think Frameworks,!
Not Enterprise Architecture!
17

18. • Eureka!
• Hystrix + Turbine!
• Ribbon!
• Feign!
• Zuul!
http://netflix.github.io

19. ©2015 Apigee Corp. All Rights Reserved.
• Opinionated convention over
configuration!
• Simplified dependency management
with STARTERS!
• Standalone executable JARs with choice
of embedded runtime!
• Production-readiness with metrics,
health checks, introspection!
Spring Boot: Foundation for Twelve-Factor Apps!
19
Spring Boot!
http://projects.spring.io/spring-boot

20. ©2015 Apigee Corp. All Rights Reserved.
Spring Boot Adoption!
20
Source: oss.sonatype.org
3.05M
0
500,000
1,000,000
1,500,000
2,000,000
2,500,000
3,000,000
3,500,000
Feb-15 Mar-15 Apr-15 May-15 Jun-15 Jul-15 Aug-15 Sep-15 Oct-15 Nov-15 Dec-15 Jan-16 Feb-16
Monthly Maven downloads

21. http://projects.spring.io/spring-cloud!

22. ©2015 Apigee Corp. All Rights Reserved.
Example: Spring Cloud + Netflix OSS!

23. ©2015 Apigee Corp. All Rights Reserved.
So many more frameworks!
23

24. ©2015 Apigee Corp. All Rights Reserved.
What is a Microservice Anyway?!
24

25. ©2015 Apigee Corp. All Rights Reserved.
Loosely coupled service oriented
architecture with bounded contexts
If every service has to be updated in
concert, it’s not loosely coupled!
If you have to know about surrounding
services you don’t have a bounded context.
DEFINE: Microservice!

26. ©2015 Apigee Corp. All Rights Reserved.
Smaller services than my last SOA
deployment
Alternate Definition: Microservice!

27. ©2015 Apigee Corp. All Rights Reserved.
One Data Model to Bind Them…
MovieActor
Genre
Media
Type
Kiosk
Location
Media
ReviewCustomer
Reservation

28. ©2015 Apigee Corp. All Rights Reserved.
28
Movie Movie
Actor
Genre
Media
Type
Media
Type
Kiosk
Location
Media
Product
Catalog
Inventory
Bounded Contexts!

29. ©2015 Apigee Corp. All Rights Reserved.
Shared Database!
Service X Service Y Service Z

30. ©2015 Apigee Corp. All Rights Reserved.
Database per Service!
Service X Service Y Service Z

31. ©2015 Apigee Corp. All Rights Reserved.
Polyglot Persistence!
Service X Service Y Service Z

32. ©2015 Apigee Corp. All Rights Reserved.
Understanding Performance = !
Understanding Probability!
32

33. ©2015 Apigee Corp. All Rights Reserved.
Joint probability governs microservice behavior!
33
Availability Challenge
Latency Challenge
Serial
Parallel

34. ©2015 Apigee Corp. All Rights Reserved.
Understanding Availability!
34
Actual availability:
100 – (1% x 7) =
93%
Assume each service has a
99% availability

35. ©2015 Apigee Corp. All Rights Reserved.
Understanding Latency!
35
Average Latency
500ms
Assume each service has
a mean of 100ms processing time
and a TP99 of 1s
TP99
~ 5 sec
(Assuming statistical correlation)

36. ©2015 Apigee Corp. All Rights Reserved.
Techniques to improve latency + availability!
• Caching (2 types)!
• Retry & Cancellation & Timeout!
!
• Distributed Tracing!
36

37. ©2015 Apigee Corp. All Rights Reserved.
No Caching!
37
Latency :
200 ms
TP99:
2 s
Availability:
97%

38. ©2015 Apigee Corp. All Rights Reserved.
Caching with 50% hit rate!
38
Request
Cache
Latency :
150 ms
TP99:
~1.5 s
Availability:
98%

39. ©2015 Apigee Corp. All Rights Reserved.
Caching with 100% hit rate!
39
Latency :
100 ms
TP99:
1 s
Availability:
99%
NoSQL

40. ©2015 Apigee Corp. All Rights Reserved.
Caching !
40
Request
Caching
with
50% Hit
Forward
Cache
(NoSQL)
Average Latency:
100 + (100+200)/2 + 100 =
350ms
TP 99
~ 3.5 seconds
Availability:
96%

41. ©2015 Apigee Corp. All Rights Reserved.
Caching Tools from Apigee!
41
API
Gateway
Cache

42. ©2015 Apigee Corp. All Rights Reserved.
Cache Analytics!
42

43. ©2015 Apigee Corp. All Rights Reserved.
API BaaS (Apache Usergrid)!
43
C*
Elastic
Search
• Webscale
• APIs out of box
• Best of NoSQL
Technologies

44. ©2015 Apigee Corp. All Rights Reserved.
Retries & Cancelation & Timeout!
44
Availability:
97.9% or more
Assume 3 retries
Beware self-inflicted DOS attacks

45. ©2015 Apigee Corp. All Rights Reserved.
More Tools!
45
SDK

46. ©2015 Apigee Corp. All Rights Reserved.
Distributed Tracing!
46

47. ©2015 Apigee Corp. All Rights Reserved.
Think Consumption APIs, Not one-size-fits-all!
47

48. ©2015 Apigee Corp. All Rights Reserved.
Consumption APIs !
48
• Each Client has its own
microservice (with an API)!
• Downstream services are granular
and focused on reuse !
Credits : Sam Newman
(Backend for Frontends / Experience APIs)

49. ©2015 Apigee Corp. All Rights Reserved.
Ownership that Scales!
49
Doesn’t Scale
Scales

50. ©2015 Apigee Corp. All Rights Reserved.
Real World Example - Belly!
50

51. ©2015 Apigee Corp. All Rights Reserved.
51

52. ©2015 Apigee Corp. All Rights Reserved.
Belly’s Experience Focused APIs!
52

53. ©2015 Apigee Corp. All Rights Reserved.
Building “Microservices” in Apigee Edge!
53

54. ©2015 Apigee Corp. All Rights Reserved.
Other Platforms for Experience APIs!
54

55. ©2015 Apigee Corp. All Rights Reserved.
1 + 1 = 3 ?!
55

56. ©2015 Apigee Corp. All Rights Reserved.
Apigee + Pivotal Integration Preview!
56

57. ©2015 Apigee Corp. All Rights Reserved.
Apigee Edge
Pivotal Cloud Foundry
Runtime Traffic – Apigee Route Service!
57
API Client
LoadBalancer
Go Router
App
(Spring Boot)
Route Service
(Proxy)
Management
API
Unless otherwise noted, all traffic in HTTP/S

58. ©2015 Apigee Corp. All Rights Reserved.
58

59. ©2015 Apigee Corp. All Rights Reserved.
Conclusion!
• Think Graphs, Not Layers!!
• No Microservice is an Island!!
• Think Frameworks, not Processes!!
• Understand Performance = Understand Probability!
• Think Consumption APIs, Not one-size-fits-all!!
• Check us out at CloudFoundary Summit!
59

60. community.apigee.com
https://community.apigee.com/questions/20895/is-microservices-soa-
done-right.html

61. Thank you!