This document summarizes Cloud@eBay, which aims to simplify processes, automate everything, support any application anywhere, plan for failure, and implement proportional security. A new application can be deployed on 100 servers in less than 45 minutes. eBay serves 22 billion page views per day from 9 petabytes of storage and 23 million lines of code. There are 108 million active users and 6,000 application servers handling 75 billion database calls per day.
Invited talk at Usenix 25th June 2008 Boston MA. Discusses the future of pocket and enterprise computing over the next few years, based on publicly available information.
Services are the New Cloud Platform (Services-as-a-Platform)Randy Bias
How Amazon Web Services and other public clouds are really building Services-as-a-Platform (SaaP) not IaaS or PaaS. SaaP combined with DevOps is the ultimate path to faster, more nimble enterprise services and application delivery and lowering business time to value (TTV).
This is an update/review of the predictions I made over the last few years, in the form of a 5-minute Ignite! talk with 15 seconds per slide.
It will be given on Monday June 22, 2009 as part of the Velocity Conference evening Ignite session.
Networking is NOT Free: Lessons in Network DesignRandy Bias
An in-depth critique of the existing OpenStack networking approach, with a focus on how the Nova network controller is more of a hindrance than a help. Discusses the gap in Quantum's functionality required to close the gap, and alternative solutions. How can we make networking in OpenStack robust, high performance, and fault tolerant? What do typical large scale networks look like and what lessons can we learn from them? Is there an approach to networking we can take that is the same with a handful of servers as it is with hundreds of racks?
Invited talk at Usenix 25th June 2008 Boston MA. Discusses the future of pocket and enterprise computing over the next few years, based on publicly available information.
Services are the New Cloud Platform (Services-as-a-Platform)Randy Bias
How Amazon Web Services and other public clouds are really building Services-as-a-Platform (SaaP) not IaaS or PaaS. SaaP combined with DevOps is the ultimate path to faster, more nimble enterprise services and application delivery and lowering business time to value (TTV).
This is an update/review of the predictions I made over the last few years, in the form of a 5-minute Ignite! talk with 15 seconds per slide.
It will be given on Monday June 22, 2009 as part of the Velocity Conference evening Ignite session.
Networking is NOT Free: Lessons in Network DesignRandy Bias
An in-depth critique of the existing OpenStack networking approach, with a focus on how the Nova network controller is more of a hindrance than a help. Discusses the gap in Quantum's functionality required to close the gap, and alternative solutions. How can we make networking in OpenStack robust, high performance, and fault tolerant? What do typical large scale networks look like and what lessons can we learn from them? Is there an approach to networking we can take that is the same with a handful of servers as it is with hundreds of racks?
Keeping Movies Running Amid Thunderstorms!Sid Anand
How does Netflix strive to deliver an uninterrupted service? This talk, delivered for the first time in November, 2011, covers some engineering design concepts that help us deliver features at a rapid pace while assuring high availability.
Cloud Architecture Tutorial - Why and What (1of 3) Adrian Cockcroft
Introduction to the Netflix Cloud Architecture Tutorial - discusses the why and what of cloud including the thinking behind Netflix choice of AWS, and the product features that Netflix runs in the cloud.
[Full slides now also available at http://www.slideshare.net/adrianco/netflix-on-cloud-combined-slides-for-dev-and-ops]
Short summary of why Netflix is running on the Amazon cloud, what is running there, what we have learned and where this is taking us.
This is the introduction section to a series of public presentations that will go into much more detail. The Silicon Valley Cloud Computing Meetup was on Oct 14th, QCon San Francisco November 3rd.
This is a slide dump of a talk I gave at the 2017 Chicago Coder Conference (CCC) on June 26th, 2017.
http://www.chicagocoderconference.com/sessions/serverless-scheduled-job-processing/
Deep-Dive on Container Networking Architectures - Frans van Rooyen - Dell EMC...{code} by Dell EMC
Running containers is easy, but making them talk to each other takes a new kind of networking. Additionally, how do you deal with service discovery, load balancing and overall address management? Learn about networking with containers and how they are building advanced technologies like VXLAN directly into the engine to simplify networking between them.
In this general session, AWS IoT experts will present an in-depth look at the current state of the Internet of Things. Learn about trends and industry use cases. Hear how other organizations are using AWS IoT to connect devices to the cloud. Explore some of the most recent IoT announcements as we kick off the IoT re:Source Mini Con.
Carrier Cloud Opportunity - TM Forum Management World Dublin 2011Randy Bias
Cloudscaling Co-Founder and CTO Randy Bias shows the world's largest telcos that carriers must embrace web-scale cloud to be successful in the apps that will drive mobile, web and emerging markets. Legacy "clouds" are essentially virtualized and automated IT, and they do not offer the cost performance or business agility these hyper-growth segments demand.
Fast Kafka Apps! (Edoardo Comar and Mickael Maison, IBM) Kafka Summit London ...confluent
We all know Kafka is designed to allow applications to produce and consume data with high throughput and low latency, right? In practice, achieving this goal requires some tuning. Starting with a consideration of design principles and best practices for distributed applications, we’ll explore various practical tips to improve your client application’s performance. We’ll look first at the most important producer and consumer configuration options because these apply even when you have limited control of the brokers’ cluster setup. Secondly, we’ll look at how the brokers’ cluster deployment, topology and configuration could help further. Finally a word on some gotchas of performance analysis, that apply to Kafka too!
Docker and Cloud - Enables for DevOps - by ACA-ITStijn Wijndaele
DevOps is gericht op het tot stand brengen van een cultuur binnen organisaties waardoor het ontwikkelen, valideren en releasen van software sneller, meer betrouwbaar en frequenter kan verlopen. Om dit te realiseren staan het automatiseren van het 'software delivery process' en de bijhorende infrastructurele veranderingen centraal. Door de opkomst van 'Microservice Architecture' neemt het belang hiervan nog verder toe.
Building Serverless Apps with Kafka (Dale Lane, IBM) Kafka Summit London 2019confluent
Serverless (also known as function-as-a-service) is fast emerging as an effective architecture for event-driven applications. Apache OpenWhisk is one of the more popular open-source cloud serverless platforms, and has first-class support for Kafka as a source of events. Come to this session for an introduction to building microservices without servers using OpenWhisk. Ill describe the challenges to building applications using serverless stacks, and the serverless design patterns to help you get started. Ill give a demonstration of how you can use Kafka Connect to invoke serverless actions, and how serverless can be an effective way to host event-processing logic.
This presentation will dive into all the storage options available with the most popular container orchestrators such as Kubernetes, Docker, and Mesos.
Overview of Cloud Computing and how it can be used by startups. Case study on how the cloud helped the development of PriceChirp.com. Talk given to Barcamp NOLA 2009
Keeping Movies Running Amid Thunderstorms!Sid Anand
How does Netflix strive to deliver an uninterrupted service? This talk, delivered for the first time in November, 2011, covers some engineering design concepts that help us deliver features at a rapid pace while assuring high availability.
Cloud Architecture Tutorial - Why and What (1of 3) Adrian Cockcroft
Introduction to the Netflix Cloud Architecture Tutorial - discusses the why and what of cloud including the thinking behind Netflix choice of AWS, and the product features that Netflix runs in the cloud.
[Full slides now also available at http://www.slideshare.net/adrianco/netflix-on-cloud-combined-slides-for-dev-and-ops]
Short summary of why Netflix is running on the Amazon cloud, what is running there, what we have learned and where this is taking us.
This is the introduction section to a series of public presentations that will go into much more detail. The Silicon Valley Cloud Computing Meetup was on Oct 14th, QCon San Francisco November 3rd.
This is a slide dump of a talk I gave at the 2017 Chicago Coder Conference (CCC) on June 26th, 2017.
http://www.chicagocoderconference.com/sessions/serverless-scheduled-job-processing/
Deep-Dive on Container Networking Architectures - Frans van Rooyen - Dell EMC...{code} by Dell EMC
Running containers is easy, but making them talk to each other takes a new kind of networking. Additionally, how do you deal with service discovery, load balancing and overall address management? Learn about networking with containers and how they are building advanced technologies like VXLAN directly into the engine to simplify networking between them.
In this general session, AWS IoT experts will present an in-depth look at the current state of the Internet of Things. Learn about trends and industry use cases. Hear how other organizations are using AWS IoT to connect devices to the cloud. Explore some of the most recent IoT announcements as we kick off the IoT re:Source Mini Con.
Carrier Cloud Opportunity - TM Forum Management World Dublin 2011Randy Bias
Cloudscaling Co-Founder and CTO Randy Bias shows the world's largest telcos that carriers must embrace web-scale cloud to be successful in the apps that will drive mobile, web and emerging markets. Legacy "clouds" are essentially virtualized and automated IT, and they do not offer the cost performance or business agility these hyper-growth segments demand.
Fast Kafka Apps! (Edoardo Comar and Mickael Maison, IBM) Kafka Summit London ...confluent
We all know Kafka is designed to allow applications to produce and consume data with high throughput and low latency, right? In practice, achieving this goal requires some tuning. Starting with a consideration of design principles and best practices for distributed applications, we’ll explore various practical tips to improve your client application’s performance. We’ll look first at the most important producer and consumer configuration options because these apply even when you have limited control of the brokers’ cluster setup. Secondly, we’ll look at how the brokers’ cluster deployment, topology and configuration could help further. Finally a word on some gotchas of performance analysis, that apply to Kafka too!
Docker and Cloud - Enables for DevOps - by ACA-ITStijn Wijndaele
DevOps is gericht op het tot stand brengen van een cultuur binnen organisaties waardoor het ontwikkelen, valideren en releasen van software sneller, meer betrouwbaar en frequenter kan verlopen. Om dit te realiseren staan het automatiseren van het 'software delivery process' en de bijhorende infrastructurele veranderingen centraal. Door de opkomst van 'Microservice Architecture' neemt het belang hiervan nog verder toe.
Building Serverless Apps with Kafka (Dale Lane, IBM) Kafka Summit London 2019confluent
Serverless (also known as function-as-a-service) is fast emerging as an effective architecture for event-driven applications. Apache OpenWhisk is one of the more popular open-source cloud serverless platforms, and has first-class support for Kafka as a source of events. Come to this session for an introduction to building microservices without servers using OpenWhisk. Ill describe the challenges to building applications using serverless stacks, and the serverless design patterns to help you get started. Ill give a demonstration of how you can use Kafka Connect to invoke serverless actions, and how serverless can be an effective way to host event-processing logic.
This presentation will dive into all the storage options available with the most popular container orchestrators such as Kubernetes, Docker, and Mesos.
Overview of Cloud Computing and how it can be used by startups. Case study on how the cloud helped the development of PriceChirp.com. Talk given to Barcamp NOLA 2009
Hybrid clouds are quickly forming on the horizon, and they are transforming the way that organizations do business. Join David Butler, SVP of Marketing at Eucalyptus, Judith Hurwitz, President and CEO, and Marcia Kaufman, COO and partner, of Hurwitz & Associates and co-authors of “Hybrid Cloud For Dummies” to learn what this new cloud deployment model is all about.
Hybrid clouds are quickly forming on the horizon, and they are transforming the way that organizations do business. Join David Butler, SVP of Marketing at Eucalyptus, Judith Hurwitz, President and CEO, and Marcia Kaufman, COO and partner, of Hurwitz & Associates and co-authors of “Hybrid Cloud For Dummiesto learn what this new cloud deployment model is all about.
One of the big hurdles for an enterprise to move to the cloud is the fear of getting locked into a specific cloud implementation. This is one of the big reasons apart from security of data that keeps most of the enterprises out of the cloud space. Currently each vendor provides their unique set of API to interact with their Cloud services. This mandates a need to recode and refactor when moving from one cloud provider to the other.
jClouds is a multi cloud framework which allows connection to multiple clouds such as Amazon, VMWare, Azure, and Rackspace. jClouds provides portable abstractions for cloud specific features, thus allowing the application to move from one cloud vendor to the other with relative ease. jClouds also had a simulators to operate in restricted environments like Google App Engine and Android. Unit testing and mocking is made easy through stub connections which simulate the cloud.
Getting Started with jClouds: Multi Cloud FrameworkIndicThreads
Session Presented @IndicThreads Cloud Computing Conference, Pune, India ( http://u10.indicthreads.com )
------------
One of the big hurdles for an enterprise to move to the cloud is the fear of getting locked into a specific cloud implementation. This is one of the big reasons apart from security of data that keeps most of the enterprises out of the cloud space. Currently each vendor provides their unique set of API to interact with their Cloud services. This mandates a need to recode and refactor when moving from one cloud provider to the other.
jClouds is a multi cloud framework which allows connection to multiple clouds such as Amazon, VMWare, Azure, and Rackspace. jClouds provides portable abstractions for cloud specific features, thus allowing the application to move from one cloud vendor to the other with relative ease. jClouds also had a simulators to operate in restricted environments like Google App Engine and Android. Unit testing and mocking is made easy through stub connections which simulate the cloud.
Takeaways from the session
* Understand the need for a multi cloud framework
* showcase of abstractions for different cloud environments.
* Introduction to capabilities of jClouds
* Hands on application development using jClouds on GAE
Leveraging the Cloud - Getting the Most Bang for your Buck ( presentation by ...Cloudyn
This presentation was given by Nate Lindstrom, Director of Network Operations at Salesforce at the Silicon Valley Cloud Computing Meetup on April 4th 2013 in Mountain View - special thanks to host Quixey, along with organizers Scalr and Cloudyn.
SalesForce,
Open Cloud Frameworks - Open Standards for the Cloud Communitybefreax
A presentation about the RESERVOIR project and the need for open standards in the Cloud Community. This is demonstrated by the example of the Open Cloud Computing Interface. More information and a transcript here: http://85.114.139.198/nohuddleoffense/?p=369
Cloud Computing: Making the right choiceIndicThreads
Session Presented @IndicThreads Cloud Computing Conference, Pune, India ( http://u10.indicthreads.com )
------------
The concept of cloud computing is quickly scaling the chasm between hype and reality. Cloud Computing is rapidly becoming popular amongst enterprises that realize the benefits of shared infrastructure, lowered costs and minimal management overheads. But not all organizations and applications may benefit from a cloud computing platform. A legacy application ported in a native fashion to a cloud computing platform may not utilize any of the platform’s USPs at all. More importantly, wrong choice of platform can be disastrous. Deciding the optimal cloud vendor or platform for your requirements is a complex task.
Consider the plethora of choices available in the world of cloud computing:
* Public Cloud or Private Cloud or Hybrid Cloud
* Infrastructure-as-a-Service (IaaS): Amazon AWS, Rackspace Cloud, GoGrid, Terremark,
* Platform-as-a-Service (PaaS): Google AppEngine, Microsoft Azure, Heroku
* Software-as-a-Service (SaaS): Salesforce, Netsuite, Google Apps, saas.com
* Should you use IaaS, PaaS or SaaS for your application?
* Which cloud database fits your application? SimpleDB, SQL, RDS, Hadoop?
We will discuss the various business and technology factors to consider, while choosing a cloud vendor. We will explore the pros and cons of various cloud vendors and their offerings. Lastly, we will also discuss some real-life use-cases of applications and servers being migrated to cloud computing and what factors led to selection of a particular cloud vendor.
Takeaways from the session
This talk would serve as an introduction to a wide variety of cloud computing platforms. The audience would be able to answer questions like: “What options are available for cloud computing?”, “What are their pros and cons?”, “Should I consider migrating my application or server to the cloud?”, “Should I use IaaS, PaaS or SaaS?”, “Which is the best cloud vendor for my use-case?”
8 Securities & AWS Journey to the Cloud8 Securities
Our presentation at Amazon's Lean Cloud conference in Sydney on April 3rd, 2012. Includes background on our startup, how we use the cloud and our technology architecture.
9. Technology
• Fewer models
Single SKU • Fewer versions
• “Common denominator”
• Multi vendor options
Commodity • Lowest cost
H/W • Failure will happen
• Less platforms (e.g. OS)
Consolidate • Less tools
• Open source options
Cloud @ eBay 9
10. Organization
"organizations which design systems ... are
constrained to produce designs which are
copies of the communication structures of
these organizations”
Conway’s law
Cloud @ eBay 10
11. Tickets are for …
Recording
Approval
Assignment
Cloud @ eBay 11
13. Cannot be
The task requires human involvement (e.g. racking and wiring)
automated
No support for
Component lacks API or requires UI based actions
automation
Limited rate of
Configuration requires restart, reload, file sync
change
No permission Configuration requires special credential/role
Cloud @ eBay 13
14. Service Catalog REST APIs
Ticket driven run book State driven close loop
automation automation
Monitoring Big Data / Machine Learning
Configuration Management
Distributed state Management
Database (CMDB)
Financial Management Pay as you go
Cloud @ eBay 14
15. Based on Openstack
Community
Vendor ecosystem
Technology
Adoption
Cloud @ eBay 15