The 5 Pillars of Cloudiness

944 views

Published on

Published in: Technology, Business
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
944
On SlideShare
0
From Embeds
0
Number of Embeds
426
Actions
Shares
0
Downloads
11
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

The 5 Pillars of Cloudiness

  1. 1. 5 PILLARS OF CLOUDINESS wayne walls cloud evangelist alex brandt sr developer Wednesday, August 21, 13
  2. 2. FIVE PILLARS OF CLOUDINESS 1 2 3 4 5 Parallel Modular Horizontal Agile Secure 2 Wednesday, August 21, 13
  3. 3. Pillar #1: Parallel Wednesday, August 21, 13
  4. 4. 1M Records Answer Node 4 Wednesday, August 21, 13
  5. 5. 1M Records Answer Node 1-250K Node 251K-500K Node 501K-750K Node 751K-1M 5 Wednesday, August 21, 13
  6. 6. 6 1M Records Answer Node 1-250K Node 251K-500K Node 501K-750K Node 751K-1M Wednesday, August 21, 13
  7. 7. 6 1M Records Answer Node 1-250K Node 251K-500K Node 501K-750K Node 751K-1M Wednesday, August 21, 13
  8. 8. 7 Wednesday, August 21, 13
  9. 9. DATA CALCULATION MAP CALCULATION REDUCE DATA CALC D C R D D C R D D C R D SHUFFLE DATA 7 Wednesday, August 21, 13
  10. 10. 8 Wednesday, August 21, 13
  11. 11. Thread 1 Deadlock 9 Thread 2 Wednesday, August 21, 13
  12. 12. Thread 1 Deadlock 9 Thread 2 Wednesday, August 21, 13
  13. 13. File A Thread 1 Deadlock 9 Thread 2 Wednesday, August 21, 13
  14. 14. File A Thread 1 Deadlock 9 Thread 2 Wednesday, August 21, 13
  15. 15. File A File B Thread 1 Deadlock 9 Thread 2 Wednesday, August 21, 13
  16. 16. File A File B Thread 1 Deadlock 9 Thread 2 Wednesday, August 21, 13
  17. 17. File A File B Thread 1 Deadlock 9 File B Thread 2 Wednesday, August 21, 13
  18. 18. File A File B Thread 1 Deadlock 9 File B Thread 2 Wednesday, August 21, 13
  19. 19. File A File B File A Thread 1 Deadlock 9 File B Thread 2 Wednesday, August 21, 13
  20. 20. File A File B File A Thread 1 Deadlock 9 File B Thread 2 Wednesday, August 21, 13
  21. 21. File A File B File A Thread 1 Deadlock 9 X File B Thread 2 Wednesday, August 21, 13
  22. 22. File A File B File A Thread 1 Deadlock 9 X File B Thread 2 Wednesday, August 21, 13
  23. 23. File A File B File A Thread 1 Deadlock 9 X X File B Thread 2 Wednesday, August 21, 13
  24. 24. Solution? Scheduling Y XA B A B Y X 1 2 3 4 10 Wednesday, August 21, 13
  25. 25. 1M records Answer Node 1M records Answer Node 1-250K Node 251K-500K Node 501K-750K Node 750K-1M 11 Wednesday, August 21, 13
  26. 26. 1M records Answer Node 1M records Answer Node 1-250K Node 251K-500K Node 501K-750K Node 750K-1M 11 Wednesday, August 21, 13
  27. 27. 12 Wednesday, August 21, 13
  28. 28. 13 Wednesday, August 21, 13
  29. 29. pillar #2: modular Wednesday, August 21, 13
  30. 30. ONE PERSON BUILDS A CAR 15 Wednesday, August 21, 13
  31. 31. CHASSIS ENGINE BODY INTERIOR 16 Wednesday, August 21, 13
  32. 32. CHASSIS ENGINE BODY INTERIOR 17 Wednesday, August 21, 13
  33. 33. CHASSIS ENGINE BODY INTERIOR 18 Wednesday, August 21, 13
  34. 34. CHASSIS ENGINE BODY INTERIOR SEATS FLOOR DASHBOARD GAS AND BRAKE PEDALS 18 Wednesday, August 21, 13
  35. 35. CHASSIS ENGINE BODY INTERIOR 19 Wednesday, August 21, 13
  36. 36. CHASSIS ENGINE BODY INTERIOR 20 Wednesday, August 21, 13
  37. 37. defect CHASSIS ENGINE BODY INTERIOR 20 Wednesday, August 21, 13
  38. 38. defect defect CHASSIS ENGINE BODY INTERIOR 20 Wednesday, August 21, 13
  39. 39. defect defect defect CHASSIS ENGINE BODY INTERIOR 20 Wednesday, August 21, 13
  40. 40. defect defect defect defect CHASSIS ENGINE BODY INTERIOR 20 Wednesday, August 21, 13
  41. 41. defect defect defect defect LEMON CHASSIS ENGINE BODY INTERIOR 20 Wednesday, August 21, 13
  42. 42. Pillar #3: horizontal Wednesday, August 21, 13
  43. 43. 2 GB 2 CORES 22 8 GB 4 CORES Wednesday, August 21, 13
  44. 44. 2 GB 2 CORES VERTICAL 22 8 GB 4 CORES Wednesday, August 21, 13
  45. 45. 2 GB 2 CORES VERTICAL 22 8 GB 4 CORES Wednesday, August 21, 13
  46. 46. 2 GB 2 CORES VERTICAL HORIZONTAL 22 8 GB 4 CORES Wednesday, August 21, 13
  47. 47. 2 GB 2 CORES VERTICAL HORIZONTAL 22 8 GB 4 CORES Wednesday, August 21, 13
  48. 48. 2 GB 2 CORES 2 GB 2 CORES VERTICAL HORIZONTAL 22 8 GB 4 CORES Wednesday, August 21, 13
  49. 49. 2 GB 2 CORES 2 GB 2 CORES 2 GB 2 CORES VERTICAL HORIZONTAL 22 8 GB 4 CORES Wednesday, August 21, 13
  50. 50. 2 GB 2 CORES 2 GB 2 CORES 2 GB 2 CORES 2 GB 2 CORES VERTICAL HORIZONTAL 22 8 GB 4 CORES Wednesday, August 21, 13
  51. 51. 2 GB 2 CORES 2 GB 2 CORES 2 GB 2 CORES 2 GB 2 CORES 2 GB 2 CORES VERTICAL HORIZONTAL 22 8 GB 4 CORES Wednesday, August 21, 13
  52. 52. 2 GB 2 CORES 2 GB 2 CORES 2 GB 2 CORES 2 GB 2 CORES 2 GB 2 CORES 2 GB 2 CORES VERTICAL HORIZONTAL 22 8 GB 4 CORES Wednesday, August 21, 13
  53. 53. 2 GB 2 CORES 2 GB 2 CORES 2 GB 2 CORES 2 GB 2 CORES 2 GB 2 CORES 2 GB 2 CORES 2 GB 2 CORES VERTICAL HORIZONTAL 22 8 GB 4 CORES Wednesday, August 21, 13
  54. 54. 2 GB 2 CORES 2 GB 2 CORES 2 GB 2 CORES 2 GB 2 CORES 2 GB 2 CORES 2 GB 2 CORES 2 GB 2 CORES VERTICAL HORIZONTAL SHARED NOTHING THROUGH STATELESSNESS 22 8 GB 4 CORES Wednesday, August 21, 13
  55. 55. 2 GB 2 CORES 2 GB 2 CORES 2 GB 2 CORES 2 GB 2 CORES 2 GB 2 CORES 2 GB 2 CORES VERTICAL HORIZONTAL SHARED NOTHING THROUGH STATELESSNESS 22 8 GB 4 CORES Wednesday, August 21, 13
  56. 56. 2 GB 2 CORES 2 GB 2 CORES 2 GB 2 CORES 2 GB 2 CORES 2 GB 2 CORES 2 GB 2 CORES VERTICAL HORIZONTAL SHARED NOTHING THROUGH STATELESSNESS 2 GB 2 CORES 22 8 GB 4 CORES Wednesday, August 21, 13
  57. 57. 23 Wednesday, August 21, 13
  58. 58. 24 Wednesday, August 21, 13
  59. 59. ONE SERVER NEAR CAPACITY 24 Wednesday, August 21, 13
  60. 60. ONE SERVER NEAR CAPACITY ADD ANOTHER SERVER 24 Wednesday, August 21, 13
  61. 61. ONE SERVER NEAR CAPACITY ADD ANOTHER SERVER 25 Wednesday, August 21, 13
  62. 62. 1234 MESSAGE QUEUE 26 Wednesday, August 21, 13
  63. 63. 1234MESSAGE QUEUE 27 Wednesday, August 21, 13
  64. 64. 1 2 3 4 28 MESSAGE QUEUE Wednesday, August 21, 13
  65. 65. 1 2 3 4 28 56789101112 MESSAGE QUEUE Wednesday, August 21, 13
  66. 66. 29 5678 9101112MESSAGE QUEUE 1 2 3 4 Wednesday, August 21, 13
  67. 67. 29 5678 9101112 ADD MORE SERVERS BASED ON MESSAGE QUEUE MESSAGE QUEUE 1 2 3 4 Wednesday, August 21, 13
  68. 68. MESSAGE QUEUE 30 5 6 7 8 9 10 11 12 13141516 ADD MORE SERVERS BASED ON MESSAGE QUEUE 1 2 3 4 Wednesday, August 21, 13
  69. 69. 31 5678 9101112 13141516 ADD MORE SERVERS BASED ON MESSAGE QUEUE 1234 MESSAGE QUEUE Wednesday, August 21, 13
  70. 70. 32 5678 9101112 13141516 ADD MORE SERVERS BASED ON MESSAGE QUEUE 1234 MESSAGE QUEUE Wednesday, August 21, 13
  71. 71. 33 5678 9101112 13141516 ADD MORE SERVERS BASED ON MESSAGE QUEUE 1234 MESSAGE QUEUE Wednesday, August 21, 13
  72. 72. 33 5678 9101112 13141516 ADD MORE SERVERS BASED ON MESSAGE QUEUE 1234 MESSAGE QUEUE DECREASE SERVERS BASED ON MESSAGE QUEUE Wednesday, August 21, 13
  73. 73. MESSAGE QUEUE 34 5678 9101112 13 14 15 16 ADD MORE SERVERS BASED ON MESSAGE QUEUE 1234 DECREASE SERVERS BASED ON MESSAGE QUEUE Wednesday, August 21, 13
  74. 74. Pillar #4: agile Wednesday, August 21, 13
  75. 75. 36 Wednesday, August 21, 13
  76. 76. Features In Progress Blocked Tabled Testing Complete Feature A Feature B Feature C 37 Monday Wednesday, August 21, 13
  77. 77. Features In Progress Blocked Tabled Testing Complete Feature A Feature B Feature C 38 Tuesday Wednesday, August 21, 13
  78. 78. Features In Progress Blocked Tabled Testing Complete Feature A Feature B Feature C Feature E Feature D 38 Tuesday Wednesday, August 21, 13
  79. 79. Features In Progress Blocked Tabled Testing Complete Feature AFeature BFeature C Feature E Feature G 39 Wednesday Wednesday, August 21, 13
  80. 80. Features In Progress Blocked Tabled Testing Complete Feature AFeature BFeature C Feature E Feature D Feature F Feature G 39 Wednesday Wednesday, August 21, 13
  81. 81. Features In Progress Blocked Tabled Testing Complete Feature A Feature B Feature C Feature E Feature D Feature F Feature G 40 Friday Wednesday, August 21, 13
  82. 82. Features In Progress Blocked Tabled Testing Complete Feature A Feature B Feature C Feature E Feature D Feature F Feature G Feature H Feature I 40 Friday Wednesday, August 21, 13
  83. 83. Features In Progress Blocked Tabled Testing Complete Feature A Feature B Feature C Feature EFeature D Feature F Feature G Feature H Feature I 41 Friday - WK 2 Wednesday, August 21, 13
  84. 84. 57% 14% 29% Failed Successful Challenged 49% 42% 9% Waterfall Agile Source: The CHAOS Manifesto, The Standish Group, 2012 42 Wednesday, August 21, 13
  85. 85. 43 Continuous Integration/Continuous Delivery Wednesday, August 21, 13
  86. 86. 44 Quality Wednesday, August 21, 13
  87. 87. 45 Release Cycle Wednesday, August 21, 13
  88. 88. IMAGE: blogs.bu.edu 46 Wednesday, August 21, 13
  89. 89. 47 Lint Testing Test Driven Development Functional Testing Black Box Integration Testing Unit Testing Behavior Driven Development White Box Smoke Testing Acceptance Testing Wednesday, August 21, 13
  90. 90. ENSURES QUALITY 47 Lint Testing Test Driven Development Functional Testing Black Box Integration Testing Unit Testing Behavior Driven Development White Box Smoke Testing Acceptance Testing Wednesday, August 21, 13
  91. 91. 48 Lint Testing Test Driven Development Functional Testing Black Box Integration Testing Unit Testing Behavior Driven Development White Box Smoke Testing Acceptance Testing Wednesday, August 21, 13
  92. 92. ENSURES CONFIDENCE 48 Lint Testing Test Driven Development Functional Testing Black Box Integration Testing Unit Testing Behavior Driven Development White Box Smoke Testing Acceptance Testing Wednesday, August 21, 13
  93. 93. Pillar #5: secure Wednesday, August 21, 13
  94. 94. 50 Wednesday, August 21, 13
  95. 95. 51 PRESENTATION APPLICATION STORAGE Wednesday, August 21, 13
  96. 96. 51 PRESENTATION APPLICATION STORAGE INTERFACE SECURITY ACROSS ALL LAYERS Wednesday, August 21, 13
  97. 97. 52 Wednesday, August 21, 13
  98. 98. 53 Host-based Authentication Wednesday, August 21, 13
  99. 99. 54 User Authentication Wednesday, August 21, 13
  100. 100. 55 Hybrid Cloud Wednesday, August 21, 13
  101. 101. 56 Trustworthiness as an Organization Wednesday, August 21, 13

×