The document describes Netflix's microservices architecture using various open source technologies like Eureka, Ribbon, Hystrix, and Zuul. Key aspects include service discovery and load balancing via Eureka and Ribbon, circuit breaking with Hystrix, and API routing/filtering with Zuul. The architecture supports large scale and rapid development of microservices.

3. Growth

4. Data Center
MySQL
Middle Tier
Web UI / Front End API

5. Regional Load Balancers
Regional Load Balancers

6. API or Web Calls
memcached
Cassandra
Web service
S3 bucket

7. We’re here to help you get to global scale…
Apache Licensed Cloud Native OSS
http://netflix.github.com

12. Micro service Implementation
Web App
Front End
(REST services)
Hystrix
Call “AuthService”
Ribbon REST client
with Eureka
Fallback
Implementation
Karyon
App Service
(auth-service)
Eureka
Server(s)

13. KaryonEureka
Ribbon
Hystrix

18. Speed
Hardware Will Fail
Slowly Changing
Large Scale
Everything Is Broken
Rapid Change
Large Scale
Everything Works
Slowly Changing
Small Scale
Hardware Will Fail
Rapid Change
Small Scale
Scale

22. Regional Load Balancers
Regional Load Balancers

26. Micro service Implementation
Web App
Front End
(REST services)
Hystrix
Call “AuthService”
Ribbon REST client
with Eureka
Fallback
Implementation
Karyon
App Service
(auth-service)
Eureka
Server(s)

32. Client
A
p
a
c
h
e
Eureka (Service Registry)
Server (Karyon)
Apache
Tomcat
Ribbon
Load Balancing
Eureka Integration
Metrics
(Servo)
Bootstrapping (Governator)
Metrics (Servo)
Admin Console
HTTP
Eureka Integration
Registration
Fetch Registry
H
T
T
P
C
L
I
E
N
T
Hy
s
t
r
i
x
EVCache

33. Eureka (Service Registry)
Client (Ribbon 2.0)
Server (Karyon)
Ribbon Transport
Load Balancing
Eureka Integration
Metrics
(Servo)
Bootstrapping (Governator)
Metrics (Servo)
Admin Console
HTTP
Eureka Integration
Registration
Fetch Registry
Ribbon
Hystrix
EVCache
RxNet
ty
RxNetty
UDP
TCP
WebSockets
SSE

34. @ArchaiusBootstrap
@KaryonBootstrap(name ="hello-netflix-oss")
@Modules(include = {HelloNossApp.KaryonJerseyModuleImpl.class, KaryonWebAdminModule.class, KaryonEurekaModule.class})
public final class HelloNossApp {
public static class KaryonJerseyModuleImpl extends KaryonJerseyModule{
protected void configure() {
super.configure();
bind(AuthenticationService.class).to(AuthenticationServiceImpl.class);
}
public int serverPort() { return 8888; }
public int shutdownPort() { return 8899; }
public void configureInterceptors(GovernatorHttpInterceptorSupport<ByteBuf, ByteBuf> interceptorSupport) {
interceptorSupport.forUri("/hello").interceptIn(AuthInterceptor.class);
}
}
}

35. interface recommendationsByUserId@Var"userId"
@Http(method = HttpMethod.GET, uriTemplate="/users/{userId}/recommendations")
@Hystrix(fallbackHandler = RecommendationFallbackHandler.class)
@EvCache(name = "movie-rec", appName = "movieService", cacheKeyTemplate = "{userId}")
MovieService movieService = Ribbon.from(MovieService.class);
Observable<Recommendations> result =
movieService.recommendationsByUserId(“user1”)
.toObservable();

36. createHttpResourceGroup"movieService" newRequestTemplate"recommendationsByUserId" "GET" "/users/{userId}/recommendations" requestBuilder"userId"“user1”

40. AZ1
AZ2
AZ3
Regional Load Balancers
Zuul –Traffic Shaping/Routing
Data
Data
Data
Geo-located
Chaos Kong
Chaos Kong
AZ1
AZ2
AZ3
Regional Load Balancers
Zuul –Traffic Shaping/Routing
Data
Data
Data
Customer Device

43. A/B Test Engine
Personalization Engine
User Info
Movie Metadata
Movie Ratings
Similar Movies
API
Reviews

44. A/B Test Engine
Personalization Engine
User Info
Movie Metadata
Movie Ratings
Similar Movies
Reviews
User Info
API

45. A/B Test Engine
Personalization Engine
Movie Metadata
Movie Ratings
Similar Movies
Reviews
User Info
API

46. User Info
API
A/B Test Engine
Personalization Engine
Movie Metadata
Movie Ratings
Similar Movies
Reviews

47. A/B Test Engine
Personalization Engine
Movie Metadata
Movie Ratings
Similar Movies
Reviews
User Info
API

49. User Info
API
A/B Test Engine
Personalization Engine
Movie Metadata
Movie Ratings
Similar Movies
Reviews

50. A/B Test Engine
Personalization Engine
Movie Metadata
Movie Ratings
Similar Movies
Reviews
User Info
API

51. Personalization Engine
User Info
Movie Metadata
Movie Ratings
Similar Movies
API
Reviews
A/B Test Engine

52. Personalization Engine
User Info
Movie Metadata
Movie Ratings
Similar Movies
API
Reviews
A/B Test Engine
Fallback

53. Personalization Engine
User Info
Movie Metadata
Movie Ratings
Similar Movies
API
Reviews
A/B Test Engine
Fallback

58. Sketchy
Scumblr
+

60. ‒
‒
‒
‒
‒
‒
‒

62. http://netflix.github.com

63. https://github.com/Answers4AWS/netflixoss-ansible/wiki/AMIs-for-NetflixOSS
http://answersforaws.com/resources/netflixoss/cloudformation/

64. https://github.com/Netflix-Skunkworks/zerotodocker
https://hub.docker.com/u/netflixoss/

66. Mac OS X
Virtual Box
Ubuntu 14.04
single kernel
Container #1
Filesystem + process
Eureka Container
Zuul Container
Another Container
...

70. Talk
Time
Title

71. http://netflix.github.com

72. @NetflixOSS
http://netflix.github.com

73. Please give us your feedback on this session.
Complete session evaluations and earn re:Invent swag.
http://bit.ly/awsevals