![{
"id": "/retail-online-bank/middle/transactions-api",
"cpus": 1,
"mem": 1024,
"instances": 5,
"container": {
"docker": {
"image": "docker/retail-online-bank-transactions-api:1.17.0",
"portMappings": [
{
"containerPort": 8080,
"servicePort": 0
}
]
}
}
}
Dynamic Configuration (PAAS)
18](https://image.slidesharecdn.com/springcloud-161014155532/75/service-discovery-spring-cloud-internals-18-2048.jpg?cb=1669659238)
![61
{
"host": "server1",
"ports": [
20688
],
"ipAddresses": [
{
"ipAddress": "172.17.0.21",
"protocol": "IPv4"
}
],
"appId": "/retail-online-bank/middle/a2a-transactions-api",
"healthCheckResults": [
{
"alive": true
}
]
}](https://image.slidesharecdn.com/springcloud-161014155532/75/service-discovery-spring-cloud-internals-61-2048.jpg?cb=1669659238)
![IPingStrategy SerialPingStrategy
int numCandidates = servers.length;
boolean[] results = new boolean[numCandidates];
for (int i = 0; i < numCandidates; i++) {
results[i] = false; /* Default answer is DEAD. */
if (ping != null) {
results[i] = ping.isAlive(servers[i]);
}
}
return results;
And what if ping will take a long time?
111](https://image.slidesharecdn.com/springcloud-161014155532/75/service-discovery-spring-cloud-internals-111-2048.jpg?cb=1669659238)
![test-service: #service name
ribbon: #namespace
ServerWeightTaskTimerInterval: 30000 #ms
Weigths [0.0, 0.0]
Let’s explain
151](https://image.slidesharecdn.com/springcloud-161014155532/75/service-discovery-spring-cloud-internals-151-2048.jpg?cb=1669659238)
![test-service: #service name
ribbon: #namespace
ServerWeightTaskTimerInterval: 1000 #ms
Weigths [12.285123016785462, 120.30885719400065]
Let’s explain
153](https://image.slidesharecdn.com/springcloud-161014155532/75/service-discovery-spring-cloud-internals-153-2048.jpg?cb=1669659238)
Service Discovery. Spring Cloud Internals
•3 likes•1,686 views
Report
Share
Download to read offline
There is a problem of finding the correct operating services In a distributed systems with dynamic configuration. Currently, there are designed one and more solutions for the ever-changing storage configuration. It should be mentioned at least Netflix Eureka, Consul, etcd or good old Zookeeper. Spring Cloud project allows to integrate some of these solutions to your project and provides powerful solutions for typical problems. However, on the way to unicorns not the most obvious subtleties of implementation and associated problems of use in real projects wait for a developer. This talk will review the internal structure SpringCloud, implementation of Client-Side Service Discovery pattern, and specific details of concrete implementations on the example of the official libraries and the author's own library.
![[Image Results] Java Build Tools: Part 2 - A Decision Maker's Guide Compariso...](https://cdn.slidesharecdn.com/ss_thumbnails/java-build-tools-part-2-maven-gradle-ant-ivy-140121040954-phpapp01-thumbnail.jpg?width=384&fit=bounds)
More Related Content
What's hot
What's hot(20)
Viewers also liked
Viewers also liked(20)
Similar to Service Discovery. Spring Cloud Internals
![[Rakuten TechConf2014] [C-5] Ichiba Architecture on ExaLogic](https://cdn.slidesharecdn.com/ss_thumbnails/c52014finalichibaarchitectureonexalogic-141105041147-conversion-gate02-thumbnail.jpg?width=384&fit=bounds)
![IVS CTO Night And Day 2018 Winter - [re:Cap] Serverless & Mobile](https://cdn.slidesharecdn.com/ss_thumbnails/ivsctonightandday2018morningsession-serverlessmobilerecap-190115185144-thumbnail.jpg?width=384&fit=bounds)
Similar to Service Discovery. Spring Cloud Internals(20)
![[Rakuten TechConf2014] [C-5] Ichiba Architecture on ExaLogic](https://cdn.slidesharecdn.com/ss_thumbnails/c52014finalichibaarchitectureonexalogic-141105041147-conversion-gate02-thumbnail.jpg?width=768&fit=bounds)
![IVS CTO Night And Day 2018 Winter - [re:Cap] Serverless & Mobile](https://cdn.slidesharecdn.com/ss_thumbnails/ivsctonightandday2018morningsession-serverlessmobilerecap-190115185144-thumbnail.jpg?width=768&fit=bounds)
Recently uploaded
Recently uploaded(20)
Service Discovery. Spring Cloud Internals
- 1. Spring Cloud Internals Service Discovery
- 3. Agenda Today 1. New reality - new problems 2. What service discovery means? 3. Dive into Spring Cloud service discovery pattern implementation 4. Tips and tricks during the session 5. Own experience as a conclusion 3
- 4. What is the problem? 4
- 5. Database ESB (service layer) Service Service Service Service Hardware Load Balancer Alfa-Click 2.0 (JSF/Weblogic) 5
- 7. Simple Binding Small number of resources Static host and port binding Rare reconfiguration 7
- 8. insert into resources_table values (key, endpoint) 8
- 9. final Properties props = new Properties(); final Context context = new InitialContext(props); // lookup Foo bean = context.lookup("ejb:myejb//Foo!org.myapp.Foo"); bean.call(); 9
- 10. final Properties props = new Properties(); final Context context = new InitialContext(props); // lookup Foo bean = context.lookup("ejb:myejb//Foo!org.myapp.Foo"); //do something bean.call(); 10
- 12. Big Frontend App Small App Small App Small App 12
- 13. Small App UI API 1 API 2 13
- 14. ESB Services API 1 API 2 API 4 UIMobile Mongo DB 14
- 15. API API instance API instance API instance 15
- 16. Some API Another API Instance 1 Another API Instance 2 Another API Instance 3 ? 16
- 17. - hosts: dc1-rest-api roles: - { role: api, name: transactions-api, service_port: 9081 } - { role: api, name: cards-api, port: 8081 } - { role: api, name: customers-api, port: 9091 } dc1-rest-api <ip_address_1> <ip_address_2> ... Static Configuration 17
- 18. { "id": "/retail-online-bank/middle/transactions-api", "cpus": 1, "mem": 1024, "instances": 5, "container": { "docker": { "image": "docker/retail-online-bank-transactions-api:1.17.0", "portMappings": [ { "containerPort": 8080, "servicePort": 0 } ] } } } Dynamic Configuration (PAAS) 18
- 19. Service Discovery What instance we can call? 19
- 20. 20
- 22. Five parallel service calls 22
- 23. S1 S2 S3 S4 S5 23
- 24. Client call S1 S2 S3 S4 S5 24
- 25. Client call S1 S2 S3 S4 S5 25
- 26. Five parallel service calls 26
- 27. p = 0.99 p – the probability of success for one service 27
- 28. P = p5 = (0.99)5 ≈ 0.95 p – the probability of success for one service 28
- 29. Service Discovery What instance we can call? What instance is better for call? 29
- 30. Service Discovery What instance we can call? What instance is better for call? How we can increase probability of success for one call? 30
- 31. S1 S2 S3 S4 S5 31
- 32. STATE S1 S2 S3 S4 S5 S1 S2 S3 S4 S5 32
- 33. STATE FILTER S1 S2 S3 S1 S2 S3 S4 S5 S1 S2 S3 S4 S5 33
- 34. STATE FILTER S2 S4 Other DC S1 S2 S3 S4 S5 S1 S2 S3 S4 S5 34
- 35. STATE FILTER S2 S4 Other DC S1 S2 S3 S4 S5 S1 S2 S3 S4 S5 ? 35
- 36. Service Service Service Service Service STATE FILTER S2 S4 RULE S2 S1 S2 S3 S4 S5 S1 S2 S3 S4 S5 36
- 37. Service Service Service Service Service STATE FILTER S2 S4 RULE S2 Client S1 S2 S3 S4 S5 call S1 S2 S3 S4 S5 37
- 40. Server-Side Client-Side VS Dummy client Language/Library tolerance Single Responsibility Principle More complex and smart decision implementation Avoid point of failure Flexibility Hard to implement something complex and smart One more point of failure Very good implementation is required Lock on libraries Hard to make changes 40
- 41. Spring Cloud Tools for building common patterns in distributed systems Part of Spring Boot Implements Client-Side Service Discovery Pattern 41
- 42. Rollback 42
- 43. S1 S2 S3 S4 S5 ? How we get them all? 43
- 47. Leader Master Master Leader-Election Quorum (n + 1)/2 Distributed Locks 47
- 48. Peer Peer Peer Eureka is not the same 48
- 50. Service A Leader Master Master Service B Service C register 50
- 51. Service A Leader Master Master Service B Service C health check 51
- 52. Service A Leader Master Master Service B Service C heartbeat 52
- 53. Service A Leader Master Master Service B Service C health check 53
- 54. Service A Leader Master Master Service B Service C health check 54
- 55. Service A Leader Master Master Service B Service C deregister 55
- 56. Service A Leader Master Master Service B Service C deregister graceful shutdown 56
- 57. Spring Cloud Core Eureka Consul Marathon 57
- 58. Spring Cloud Core Eureka Consul Marathon Reference/Native implementation Most complex load balancing 58
- 59. Spring Cloud Core Eureka Consul Marathon Out of the box PaaS 59
- 60. 60
- 61. 61 { "host": "server1", "ports": [ 20688 ], "ipAddresses": [ { "ipAddress": "172.17.0.21", "protocol": "IPv4" } ], "appId": "/retail-online-bank/middle/a2a-transactions-api", "healthCheckResults": [ { "alive": true } ] }
- 62. Spring Cloud Core Eureka Consul Marathon Out of the box PaaS One tool for deployment and configuration storage Own library 62
- 64. ... @EnableDiscoveryClient ... public class Application { @Autowired private DiscoveryClient discoveryClient; public List<String> services() { return discoveryClient.getServices(); } } 64
- 65. ... @EnableDiscoveryClient ... public class Application { @Autowired private DiscoveryClient discoveryClient; public List<String> services() { return discoveryClient.getServices(); } } 65
- 66. public interface DiscoveryClient { public ServiceInstance getLocalServiceInstance(); public List<ServiceInstance> getInstances(String serviceId); public List<String> getServices(); } 66
- 67. public interface DiscoveryClient { public ServiceInstance getLocalServiceInstance(); public List<ServiceInstance> getInstances(String serviceId); public List<String> getServices(); } 67
- 68. public interface DiscoveryClient { public ServiceInstance getLocalServiceInstance(); public List<ServiceInstance> getInstances(String serviceId); public List<String> getServices(); } 68
- 70. Eureka Cluster (Zone 1) appname: app1 virtualHostName: app eureka: client: serviceUrl: defaultZone: ${ZONE1_EUREKA_URL} Eureka Cluster (Zone 2) appname: app2 virtualHostName: app serviceId -> virtualHostName 70
- 71. Eureka Cluster (Zone 1) appname: app1 virtualHostName: app eureka: client: serviceUrl: defaultZone: ${ZONE1_EUREKA_URL} zone2: ${ZONE2_EUREKA_URL} availabilityZones: zone1,zone2 Eureka Cluster (Zone 2) appname: app2 virtualHostName: app 71
- 74. Eureka Cluster (Zone 1) appname: app1 virtualHostName: app virtualHostName Applications EurekaClient fetch EurekaDiscoveryClient serviceId eureka: client: registryFetchIntervalSeconds: 5 (30) 74
- 75. Eureka Cluster (Zone 1) appname: app1 virtualHostName: app virtualHostName Applications EurekaClient fetch and filter EurekaDiscoveryClient serviceId eureka: client: registryFetchIntervalSeconds: 5 (30) filterOnlyUpInstances: true (true) 75
- 77. Mesos Cluster (DC 1) taskId: {random} appId: app1 spring: cloud: marathon: host: ${MARATHON_HOST} port: ${MARATHON_PORT} Mesos Cluster (DC 2) taskId: {random} appId: app1 serviceId -> appId 77
- 78. Mesos Cluster (DC 1) taskId: {random} appId: app1 spring: cloud: marathon: host: ${MARATHON_HOST} port: ${MARATHON_PORT} Mesos Cluster (DC 2) taskId: {random} appId: app1 serviceId -> appId <- - - - there is no failover to another dc 78
- 79. Mesos Cluster (DC 1) taskId: {random} appId: app1 task = instance MarathonClient fetch tasks for apps MarathonDiscoveryClient serviceId spring: cloud: marathon: <no app cache> <no property> only healthy tasks 79
- 81. @Autowired private LoadBalancerClient loadBalancer; @RequestMapping("/instance") public ServiceInstance instance() { return loadBalancer.choose(serviceId); } 81
- 82. @Autowired private LoadBalancerClient loadBalancer; @RequestMapping("/instance") public ServiceInstance instance() { return loadBalancer.choose(serviceId); } ? 82
- 83. @Autowired private LoadBalancerClient loadBalancer; @RequestMapping("/instance") public ServiceInstance instance() { return loadBalancer.choose(serviceId); } 83 1. ServiceInstance 2. null 3. Error
- 84. @Autowired private LoadBalancerClient loadBalancer; @RequestMapping("/instance") public ServiceInstance instance() { return loadBalancer.choose(serviceId); } 84 1. ServiceInstance 2. null 3. Error
- 85. Where it is used? Hypermedia Links Dynamic Routes for Edge Server DiscoveryClient health check in actuator is based on it Less than you expect, right? 85
- 86. Deep Dive 1. Discovery 2. Balance it 86
- 87. Load Balancer Client Based on Netflix Ribbon Ribbon may be used with or without service registry 87
- 88. Service Service Service Service Service STATE FILTER S2 S4 RULE S2 Client S1 S2 S3 S4 S5 call S1 S2 S3 S4 S5 88
- 89. Service Service Service Service Service FILTER S2 S4 RULE S2 Client S1 S2 S3 S4 S5 call S1 S2 S3 S4 S5 Server List 89
- 90. Service Service Service Service Service S2 S4 RULE S2 Client S1 S2 S3 S4 S5 call S1 S2 S3 S4 S5 Server List Filter Chain 90
- 91. Service Service Service Service Service S2 S4 S2 LoadBalancerClient S1 S2 S3 S4 S5 call S1 S2 S3 S4 S5 Server List Filter Chain Rule 91
- 93. Spring Cloud Ribbon Configure Bean Lifecycle Spring native configuration 93
- 94. test-service: #service name ribbon: #namespace listOfServers: host:8080,anotherHost:8081 ConfigurationBasedServerList 94
- 95. test-service: #service name ribbon: #namespace listOfServers: host:8080,anotherHost:8081 public List<Server> getListOfServers() { return derive( clientConfig.get(CommonClientConfigKey.ListOfServers) ); } ConfigurationBasedServerList 95
- 96. @Autowired private LoadBalancerClient loadBalancer; @RequestMapping("/url") public String realUrl() throws IOException { return loadBalancer.reconstructURI( instance, new URI("http://"+ serviceId +"/me") ).toString(); } it will be replaced with real host and port 96
- 97. @Autowired private LoadBalancerClient loadBalancer; @RequestMapping("/url") public String realUrl() throws IOException { return loadBalancer.reconstructURI( instance, new URI("http://"+ serviceId +"/me") ).toString(); } > curl service:8080/url http://host:8080/me 97
- 98. @Autowired private LoadBalancerClient loadBalancer; @RequestMapping("/url") public String realUrl() throws IOException { return loadBalancer.reconstructURI( instance, new URI("http://"+ serviceId +"/me") ).toString(); } > curl service:8080/url http://anotherHost:8080/me 98
- 101. S1 S2 S3 S4 S5 S2 S4 S2 LoadBalancerClient call S1 S2 S3 S4 S5? 101 Server List Filter Chain Rule
- 102. t t + 1 S1 S2 S3 102
- 103. t t + 1 S1 S2 S3 ServerList S1 S2 S3 103
- 104. t t + 1 S1 S2 S3 ServerList S1S1 S2 S3 104
- 105. t t + 1 S1 S2 S3 ServerList S1 S1S1 S2 S3 105
- 106. t t + 1 S1 S2 S3 ServerList S1 S1 t + 2 S1 S2 S3 106
- 107. S1 S2 S3 S4 S5 S2 S4 S2 LoadBalancerClient call S1 S2 S3 S4 S5Ping -> 107 Server List Filter Chain Rule
- 108. Pinger (background thread) LoadBalancer background task force if setServerList() is called 108
- 109. Pinger (background thread) LoadBalancer background task force if setServerList() is called IPingStrategy pingServers 109
- 110. Pinger (background thread) LoadBalancer background task force if setServerList() is called IPingStrategy pingServers isAlive(server) IPing 110
- 111. IPingStrategy SerialPingStrategy int numCandidates = servers.length; boolean[] results = new boolean[numCandidates]; for (int i = 0; i < numCandidates; i++) { results[i] = false; /* Default answer is DEAD. */ if (ping != null) { results[i] = ping.isAlive(servers[i]); } } return results; And what if ping will take a long time? 111
- 113. public class MarathonPing implements IPing { @Override public boolean isAlive(Server server) { return server.isHealthChecksPassing(); } } 113
- 114. public class MarathonPing implements IPing { @Override public boolean isAlive(Server server) { return server.isHealthChecksPassing(); } } public class MarathonServer extends Server { public boolean isHealthChecksPassing() { return healthChecks.parallelStream() .allMatch(HealthCheckResult::isAlive); } } 114
- 115. IPingStrategy ? You may implement your own strategy at your own risk IPing PingUrl public boolean isAlive(Server server) { URL url = constructUrl(server); HttpResponse response = httpClient.execute(createReq(url)); return response.getStatusLine().getStatusCode() == 200; } 115
- 117. S1 S2 S3 S4 S5 S2 S4 S2 LoadBalancerClient call S1 S2 S3 S4 S5 Server List Filter Chain -> Rule 117
- 118. Eureka Cluster (Zone 1) S1 S2 S3 Eureka Cluster (Zone 2) S4 S5 S6 Client (Zone 1) 118
- 119. Eureka Cluster (Zone 1) S1 S2 S3 Eureka Cluster (Zone 2) S4 S5 S6 Client (Zone 1) cheap call 119
- 120. Eureka Cluster (Zone 1) S1 S2 S3 Eureka Cluster (Zone 2) S4 S5 S6 Client (Zone 1) expensive call 120
- 121. Eureka Cluster (Zone 1) S2 S3 Eureka Cluster (Zone 2) S4 S5 S6 Client (Zone 1) unpredictable S1 121
- 122. Eureka Cluster (Zone 1) S1 S2 S3 Eureka Cluster (Zone 2) S4 S5 S6 Client (Zone 1) more guaranteed result 122
- 123. FilterZonePreferenceFilter List servers = super.getFilteredServers(); List local = servers.filter(server -> server.zone == zoneFromConfig ); if (!local.isEmpty()) { return local; } return servers; super.getFilteredServers() DynamicServerListLoadBalancer default (local) zone 123
- 125. S1 S2 S3 S4 S5 S2 S4 S2 LoadBalancerClient call S1 S2 S3 S4 S5LB Stats -> Server List Filter Chain Rule 125
- 126. S1 S2 S3 S4 S5 S2 S4 S2 LoadBalancerClient call S1 S2 S3 S4 S5LB Stats -> Server Stats Server List Filter Chain Rule 126
- 130. ZoneAffinityFilterZonePreferenceFilter super.getFilteredServers(servers) ZoneAffinityPredicate filter out instances from other zones 130 zoneAffinity: maxLoadPerServer: 0.6 maxBlackOutServersPercentage: 0.8 minAvailableServers: 2
- 131. Eureka Cluster (Zone 1) S1 S2 S3 Eureka Cluster (Zone 2) S4 S5 S6 Client (Zone 1) cheap call 131
- 132. ZoneAffinityFilterZonePreferenceFilter super.getFilteredServers(servers) ZoneAffinityPredicate no filter 132 zoneAffinity: maxLoadPerServer: 0.6 maxBlackOutServersPercentage: 0.8 minAvailableServers: 2
- 133. Eureka Cluster (Zone 1) S1 Eureka Cluster (Zone 2) S4 S5 S6 Client (Zone 1) 133 S2 S3
- 134. Use Eureka. Use zones 134
- 136. S1 S2 S3 S4 S5 S2 S4 S2 LoadBalancerClient call S1 S2 S3 S4 S5 ? 136 Server List Filter Chain Rule
- 139. upstream test-marathon-app { server host1 weight=3; server host2 weight=1; server host3 weight=1; } Weighted typically is predefined 139
- 140. Weight Task (background thread) Weighted Rule background task LoadBalancerStats calculate serverWeight = summ(avgServerResponseTime)- avgServerResponseTime 140
- 141. Weight Task (background thread) Weighted Rule background task LoadBalancerStats calculate serverWeight = summ(avgServerResponseTime)- avgServerResponseTime 141 More response time -> less weight
- 142. 142 Slow Instance Fast Instance 100 ms 10 ms
- 143. 143 Slow Instance Fast Instance 100 ms 10 ms5 000 requests
- 144. 144 Slow Instance Fast Instance 100 ms 10 ms5 000 requests Round Robin Rule Slow: 2500 and Fast: 2500 Average time: 70
- 145. 145 Slow Instance Fast Instance 100 ms 10 ms5 000 requests Round Robin Rule Slow: 2500 and Fast: 2500 Average time: 70
- 146. 146 Slow Instance Fast Instance 100 ms 10 ms5 000 requests Round Robin Rule Slow: 2500 and Fast: 2500 Average time: 70 Weighted Rule Slow: 634 and Fast: 4366 Average time: 27
- 147. 147 Slow Instance Fast Instance 100 ms 10 ms1 000 requests Round Robin Rule Slow: 500 and Fast: 500 Average time: 70 Weighted Rule ? ?
- 148. 148 Slow Instance Fast Instance 100 ms 10 ms1 000 requests Round Robin Rule Slow: 500 and Fast: 500 Average time: 70 Weighted Rule Slow: 500 and Fast: 500 Average time: 72
- 149. 149 Slow Instance Fast Instance 100 ms 10 ms1 000 requests Round Robin Rule Slow: 500 and Fast: 500 Average time: 70 Weighted Rule Slow: 500 and Fast: 500 Average time: 72
- 150. test-service: #service name ribbon: #namespace ServerWeightTaskTimerInterval: 30000 #ms Let’s explain 150
- 151. test-service: #service name ribbon: #namespace ServerWeightTaskTimerInterval: 30000 #ms Weigths [0.0, 0.0] Let’s explain 151
- 152. test-service: #service name ribbon: #namespace ServerWeightTaskTimerInterval: 1000 #ms Let’s explain 152
- 153. test-service: #service name ribbon: #namespace ServerWeightTaskTimerInterval: 1000 #ms Weigths [12.285123016785462, 120.30885719400065] Let’s explain 153
- 155. Best Available Rule LoadBalancerStats calculate chosen -> activeConnections == min(activeConnections) 155
- 156. Best Available Rule LoadBalancerStats calculate chosen -> activeConnections == min(activeConnections) 156 Less active connections -> more chance to success
- 157. 157 Slow Instance Fast Instance 100 ms 10 ms1 000 requests Round Robin Rule Slow: 500 and Fast: 500 Average time: 70 Weighted Rule Slow: 500 and Fast: 500 Average time: 72 Best Available Rule Slow: 152 and Fast: 847 Average time: 38
- 158. Don’t use round robin rule 158
- 160. Availability Filtering Rule LoadBalancerStats calculate filtered -> activeConnections < maxActiveConnections filtered -> !isCircuitBreakerTripped Availability Predicate filter 160 Like a round robin
- 162. Zone Avoidance Rule Composite Predicate filter Zone Predicate Availability Predicate 162
- 163. Zone Avoidance Rule Composite Predicate filter Zone Predicate Availability Predicate CompositePredicateBuilder int minimalFilteredServers = 1 float minimalFilteredPercentage = 0 predicate.filter(servers) 163
- 164. Zone Avoidance Rule Composite Predicate filter Zone Predicate Availability Predicate CompositePredicateBuilder int minimalFilteredServers = 1 float minimalFilteredPercentage = 0 int count = predicate.filter(servers).size() //2 164
- 165. Zone Avoidance Rule Composite Predicate filter Zone Predicate Availability Predicate CompositePredicateBuilder int minimalFilteredServers = 1 float minimalFilteredPercentage = 0 int count = predicate.filter(servers).size() //2 count >= minimalFilteredServers count >= minimalFilteredPercentage * count 165
- 166. Zone Avoidance Rule Composite Predicate filter Zone Predicate Availability Predicate CompositePredicateBuilder int minimalFilteredServers = 1 float minimalFilteredPercentage = 0 int count = predicate.filter(servers).size() //0 count >= minimalFilteredServers count >= minimalFilteredPercentage * count 166
- 167. Zone Avoidance Rule Composite Predicate filter Zone Predicate Availability Predicate next 167
- 168. triggeringLoadPerServerThreshold: 0.2 avoidZoneWithBlackoutPercetage: 0.99999d worstZone -> loadPerServer > max(loadPerServer) && loadPerServer > triggeringLoadPerServerThreshold zones.remove(worstZone) Zone Avoidance Rule Composite Predicate filter Zone Predicate Availability Predicate 168
- 169. triggeringLoadPerServerThreshold: 0.2 avoidZoneWithBlackoutPercetage: 0.99999d zoneToAvoid -> circuitBreakerTrippedCount / instanceCount >= avoidZoneWithBlackoutPercetage zones.remove(zoneToAvoid) Zone Avoidance Rule Composite Predicate filter Zone Predicate Availability Predicate 169
- 171. If you don’t use zones then don’t use default rule 171
- 172. Deep Dive 1. Discovery 2. Balance it 3. Lifecycle 172
- 173. Service Service Service Service Service S2 S4 S2 LoadBalancerClient S1 S2 S3 S4 S5 S1 S2 S3 S4 S5 New Service register/deregister 173
- 174. How to do it? 3rd party registration pattern - dynamic - static Self-registration pattern (Lifecycle) 174
- 175. Docker Engine 175
- 178. Docker Engine Service register/deregister 178 Registrator emit event Service Registry native event
- 179. What is lifecycle? Allow automatically register and deregister service in service registry Implements Spring Lifecycle interface 179
- 181. DiscoveryLifecycle LifecycleProcessor autoStartup on refresh startBeans on start Service Registry register emit InstanceRegistered Event DiscoveryClientHealthIndicator 181
- 182. DiscoveryLifecycle LifecycleProcessor on RefreshScope event stopBeans on stop Service Registry deregister close or shutdown Real service discovery client 182
- 184. Docker container Internal IP External IP 184
- 185. > ifconfig lo0: flags=8049<UP,LOOPBACK,RUNNING,MULTICAST> mtu 16384 gif0: flags=8010<POINTOPOINT,MULTICAST> mtu 1280stf0: flags=0<> mtu 1280 en0: flags=8863<UP,BROADCAST,SMART,RUNNING,SIMPLEX,MULTICAST> mtu 1500 en1: flags=963<UP,BROADCAST,SMART,RUNNING,PROMISC,SIMPLEX> mtu 1500 en2: flags=963<UP,BROADCAST,SMART,RUNNING,PROMISC,SIMPLEX> mtu 1500 p2p0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 2304 awdl0: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> mtu 1484 bridge0: flags=8863<UP,BROADCAST,SMART,RUNNING,SIMPLEX,MULTICAST> mtu 1500 utun0: flags=8051<UP,POINTOPOINT,RUNNING,MULTICAST> mtu 1500 185
- 186. > ifconfig lo0: flags=8049<UP,LOOPBACK,RUNNING,MULTICAST> mtu 16384 gif0: flags=8010<POINTOPOINT,MULTICAST> mtu 1280stf0: flags=0<> mtu 1280 en0: flags=8863<UP,BROADCAST,SMART,RUNNING,SIMPLEX,MULTICAST> mtu 1500 en1: flags=963<UP,BROADCAST,SMART,RUNNING,PROMISC,SIMPLEX> mtu 1500 en2: flags=963<UP,BROADCAST,SMART,RUNNING,PROMISC,SIMPLEX> mtu 1500 p2p0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 2304 awdl0: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> mtu 1484 bridge0: flags=8863<UP,BROADCAST,SMART,RUNNING,SIMPLEX,MULTICAST> mtu 1500 utun0: flags=8051<UP,POINTOPOINT,RUNNING,MULTICAST> mtu 1500 ? 186
- 187. > ifconfig lo0: flags=8049<UP,LOOPBACK,RUNNING,MULTICAST> mtu 16384 gif0: flags=8010<POINTOPOINT,MULTICAST> mtu 1280stf0: flags=0<> mtu 1280 en0: flags=8863<UP,BROADCAST,SMART,RUNNING,SIMPLEX,MULTICAST> mtu 1500 en1: flags=963<UP,BROADCAST,SMART,RUNNING,PROMISC,SIMPLEX> mtu 1500 en2: flags=963<UP,BROADCAST,SMART,RUNNING,PROMISC,SIMPLEX> mtu 1500 p2p0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 2304 awdl0: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> mtu 1484 bridge0: flags=8863<UP,BROADCAST,SMART,RUNNING,SIMPLEX,MULTICAST> mtu 1500 utun0: flags=8051<UP,POINTOPOINT,RUNNING,MULTICAST> mtu 1500 Low index 187
- 188. Docker container Internal IP External IP 188
- 192. spring: cloud: inetutils: ignored-interfaces: - vbox* - bridge* - lo* consul: discovery: preferIpAddress: true (false) 192
- 193. Instead of a conclusion 193
- 194. Own experience 194
- 195. Own experience 195 We use both patterns: server and client side • Consul + Registrator + Nginx • Marathon + MarathonLB • Eureka
- 196. Own experience Use client side pattern for API and Edge server Use server side for NodeJS front apps and non-standard API (Python) 196
- 197. Own experience Spring Cloud is production-ready and very customizable Minimum number of settings are needed to be changed, but for better results there are some of them that should be changed There are some issues that make you sad 197
- 198. 198 Spring Cloud Marathon (Proof of Concept) https://github.com/aatarasoff/spring-cloud-marathon Spring Cloud http://projects.spring.io/spring-cloud Service Discovery Patterns http://microservices.io/patterns/server-side-discovery.html http://microservices.io/patterns/client-side-discovery.html