This document summarizes a presentation by Surendra Reddy of Yahoo on Yahoo's cloud serving platform. The presentation discusses the challenges of traditional infrastructure management including outages, inflexibility, and complexity. It then introduces Yahoo's principles for cloud serving including declarative application structure, continuous integration/deployment, virtualized hardware, and extreme automation. Key aspects of Yahoo's platform are described like abstracting services, standardized software stacks, and an open cloud access protocol submitted to IETF for resource management. The cloud is portrayed as enabling innovation by cleaning up infrastructure messes.

1. Yahoo Cloud Serving Surendra Reddy Cloud Computing Conference & ExpoNovember 3, 2009

2. Imagining the Future of Cloud!

3. Cloud is a Promise, But …

4. Reference: Tussle in Cyberspace: Defining Tomorrow’s Internet http://conferences.sigcomm.org/sigcomm/2002/papers/tussle.pdf

8. Crippled Infrastructure

10. Staggering Complexities of Dependencies

12. Auditability and Assurance

13. Governance

17. L – Lean

18. O – Optimized

19. U – Utility

22. Yahoo! is Perfect for Cloud Computing 600M UNIQUE USERS / MONTH 300M+ YAHOO! MAIL USERS / MONTH HUNDREDS OF PROPERTIES / PRODUCTS BILLIONS OF OBJECTS STORED HUNDREDS OF PETABYTES OF STORAGE PETABYTES OF TRAFFIC DAILY

24. Includes multiple environments: Dev, QA, Staging, and production

26. Declarative application structure

27. Continuous Integration, Continuous Deployment, & Continuous Compliance*

28. End-to-End Security* Rich Miller @RHM2K first coined “Continuous Compliance”

30. Standardized software stacks and packaging

31. Integrated service management

33. Controlled/Intelligent traffic direction

34. Controlled execution environment

35. Managed Communication

37. Yahoo! Cloud: Tiers without Tears Entrypoint Naming Load Balancer Presentation Tier Application Logic Tier node node node Bindings Connections Database Tier

38. Yahoo! Cloud: Extreme Automation Abstracting Services Component AnswersCore { Entry root; Tier pres { app = “answers_web_tier”; Exit applogic; nsize = small; nnodes = 3; }; Tier applogic { app = “answers_al_tier”; Exit data; nsize = medium; nnodes = 3; }; Tier data; Connections { root -> pres; pres.applogic -> applogic; applogic.data -> data; } } Presentation Tier Application Logic Tier Database Tier

39. Yahoo! Cloud: Extreme Automation QA Environment Environment qa(ne1) { TrafficDirector root { name = “qa.answers.yahoo.com”; access = testing; }; AnswersCore core; Connections { root -> core; } } Presentation Tier Presentation Tier Application Logic Tier Application Logic Tier Testing Testing Environment production(ac4,sk1) { TeeTrafficDirector root { name = “answers.yahoo.com”; access = public; split_percent = 10; split_destination = qa.root; }; AnswersCore core; Connections { root -> core; } } Database Tier Database Tier

41. Platforms: data, user info, ad systems, configuration bundles

44. Machines to Containers

45. Friction to Innovation

46. Tears to Tiers

47. Complexity to Simplexity

49. OPEN CLOUD ACCESS PROTOCOL

51. Allocation, Provisioning, and Metering of Cloud Resources

52. Metadata/Registry for Cloud Resources

54. Specification behind Yahoo Implementation

58. DELETE - Delete an instance of a managed resource

59. GET - Request managed resource properties (for one resource or a set of resource)

60. CANCEL - Cancel an outstanding request

61. SET - Set managed resource properties

64. TERMINATE – Stop the resource

65. SUSPEND – Suspend the resource

66. RESUME – Resume the resource

70. TUESDAY, 11/3 4:50pm – 5:35 pm Hadoop @ Yahoo! – Internet Scale Data Processing Eric Baldeschwieler VP, Hadoop Software Development WEDNESDAY, 11/4 9:10 am - 9:55 am Yahoo! Scalable Storage and Delivery Services Chuck Neerdaels VP, Storage and Edge Services VISIT BOOTH #103 TO TALK WITH YAHOO! ENGINEERS AND LEARN MORE ABOUT YAHOO!’S VISION FOR CLOUD COMPUTING.