The document discusses Diego, a modular and extensible substructure for microservices within Cloud Foundry, highlighting its platform features such as environment provisioning, scaling, and monitoring. It also outlines the architecture components including the receptor and long-running processes (LRPs), along with various actions for task management. The conclusion points to the challenges of deploying microservices and the integration of tools like Lattice and Spring Cloud to facilitate distributed system management.

1. CLOUD FOUNDRY DIEGO
MODULAR AND EXTENSIBLE SUBSTRUCTURE FOR MICROSERVICES
1

2. ME
Matt Stine @mstine
Principal Software Engineer
Pivotal
mstine@pivotal.io
2

3. I WROTE A LITTLE
CLOUD BOOK...
FREE - Compliments of Pivotal
http://bit.ly/cloud-native-book
3

4. MICROSERVICES?
4

5. Loosely coupled service oriented
architecture with bounded
contexts...
— Adrian Cockcroft
5

6. YOU MUST BE THIS
TALL TO USE
MICROSERVICES
▸ RAPID PROVISIONING
▸ BASIC MONITORING
▸ RAPID APPLICATION DEPLOYMENT
▸ DEVOPS CULTURE
http://martinfowler.com/bliki/
MicroservicePrerequisites.html
6

7. A SYMBIOTIC RELATIONSHIP
7

8. PLATFORM FEATURES
▸ Environment Provisioning
▸ On-Demand Scaling
▸ Failover/Resilience
▸ Routing/Load Balancing
▸ Data Service Operations (BOSH)
▸ Monitoring
8

9. But we need MOAR features...
9

10. HARD
TO ADD NEW FEATURES
HARDTO MAINTAIN EXISTING FEATURES10

11. WHY IS IT HARD?
From https://www.youtube.com/watch?v=1OkmVTFhfLY
11

12. ENTER THE
REWRITE12

13. WHAT?
From https://www.youtube.com/watch?v=1OkmVTFhfLY
13

14. THE RESULT:
14

15. THIS IS DIEGO
15

16. MEET THE RECEPTOR
16

17. TASKS
ONE-OFF WORK
LRPS
LONG-RUNNING PROCESSES17

18. DESIRED TASK
{
...
"rootfs": "docker:///docker-org/docker-image",
"env": [
{"name": "ENV_NAME_A", "value": "ENV_VALUE_A"},
{"name": "ENV_NAME_B", "value": "ENV_VALUE_B"}
],
"cpu_weight": 57,
"disk_mb": 1024,
"memory_mb": 128,
"privileged": true,
"action": ACTION(s) TO RUN,
...
}
18

19. ACTIONS
▸ RunAction: run proc in container
▸ DownloadAction: fetches and extract archive
▸ UploadAction: POST file from container to URL
▸ ParallelAction: run multiple actions in parallel
▸ SerialAction: runs multiple actions in order
19

20. MOAR ACTIONS
▸ EmitProgressAction: wraps action and logs progress
▸ TimeoutAction: wrap action and fail if timed out
▸ TryAction: wrap action and ignore errors
20

21. DESIRED LRP
{
...
"instances": 17,
"rootfs": "VALID-ROOTFS",
"env": [
{"name": "ENV_NAME_A", "value": "ENV_VALUE_A"},
{"name": "ENV_NAME_B", "value": "ENV_VALUE_B"}
],
"cpu_weight": 57,
"disk_mb": 1024,
"memory_mb": 128,
"privileged": true,
"setup": ACTION,
"action": ACTION,
"monitor": ACTION,
"start_timeout": N seconds,
"ports": [8080, 5050],
...
}
21

22. MEET THE BBS
22

23. LET'S HAVE AN AUCTION
23

24. LET'S HAVE AN AUCTION
24

25. LET'S HAVE AN AUCTION
25

26. INSIDE THE CELL
26

27. INSIDE THE CELL
27

28. INSIDE THE CELL
28

29. INSIDE THE CELL
29

30. SPECIFICITY GRADIENT
30

31. REP RESENTING THE ACTUAL WORK
31

32. WHAT IS THE TRUTH?
32

33. WHAT IS THE TRUTH?
33

34. WHAT IS THE TRUTH?
34

35. CONVERGENCE
35

36. PLAY WITH DIEGO?
36

37. DEPLOYING CLOUD FOUNDRY IS HARD
37

38. https://lattice.cf
38

39. THIS IS LATTICE
39

40. LATTICE + DIEGO
▸ Adds CF GoRouter (dynamic HTTP routing)
▸ Adds Doppler (log/metrics aggregation)
▸ LOCAL: vagrant up
▸ CLOUD: terraform apply (AWS, Google, DigitalOcean)
40

41. DEMO41

42. WHAT
ELSE?42

43. MICROSERVICES
43

44. NO MICROSERVICE
IS AN ISLAND
44

45. CHALLENGES OF DISTRIBUTED SYSTEMS
▸ Configuration Management
▸ Service Registration & Discovery
▸ Routing & Load Balancing
▸ Fault Tolerance (Circuit Breakers!)
▸ Monitoring
▸ Concurrent API Aggregation & Transformation
45

46. 46

47. SPRING CLOUDDISTRIBUTED SYSTEM PATTERNS FTW!
47

48. SPRING CLOUD LATTICE
▸ https://github.com/spring-cloud/spring-cloud-
lattice
▸ https://spring.io/guides/gs/spring-cloud-and-
lattice
48

49. EUREKA + RIBBON
49

50. LATTICE + RIBBON
50

51. DEMO51

52. DATAMICROSERVICES?52

53. SPRING XD
http://projects.spring.io/spring-xd
53

54. SPRING XD DISTRIBUTED RUNTIME
54

55. SPRING XD
SPI MODEL
55

56. SPRING XD
+ LATTICE
56

57. DEMO57

58. LEARN MORE!
▸ Lattice: http://lattice.cf
▸ Diego Design Notes: https://github.com/
cloudfoundry-incubator/diego-design-notes
58

59. THANK
YOU!59