Most enterprise cloud adoption has relied on virtual machines and infrastructure as a service. However, there is a lot to love about the other approach to clouds—platform as a service. In a PaaS model, you worry about your code, and the systems take care of the rest. True Platform-as-a-Service not only reduces the cost of hardware infrastructure, but also reduces the complexity of the software stack that runs on it. PaaS promises to trim development and deployment time from months and years to days and weeks, but what are the signs of a true PaaS powerhouse? Is it simply free of servers or software to manage? Does it provide automatic upgrades and elasticity? Can you develop in multiple languages and across multiple device platforms? Many informed analysts think PaaS is the inevitable consequence of true utility computing. In this session, Patrick Chanezon of VMWare explains why PaaS may be the future of the enterprise.
Tackling complexity in giant systems: approaches from several cloud providersPatrick Chanezon
Systems architecture evolve in cycles every 15-20 years, oscillating between centralization and decentralization, but growing in size and complexity. The last cycle shifted from vertical to horizontal scalability for hardware, applications and data platforms. This talk will describe approaches used by some of the companies who pioneered cloud platforms, Google, Microsoft, Amazon, Netflix & VMware, to tackle complexity when building these giant distributed systems.
This talk was presented at JFokus 2014.
https://www.jfokus.se/jfokus/talks.jsp#Tacklingcomplexityin
Do you need Ops in your new startup? If not now, then when? And...what is Ops?
Learn how to scale ruby-based distributed software infrastructure in the cloud to serve 4,000 requests per second, handle 400 updates per second, and achieve 99.97% uptime – all while building the product at the speed of light.
Unimpressed? Now try doing the above altogether without the Ops team, while growing your traffic 100x in 6 months and deploying 5-6 times a day!
It could be a dream, but luckily it's a reality that could be yours.
Cloud-powered Continuous Integration and Deployment architectures - Jinesh VariaAmazon Web Services
The presentation will discuss some architectural patterns in continuous integration, deployment and optimization and I will share some of the lessons learned from Amazon.com.
The goal of the presentation is to convince you that if you invest your time where you get the maximum learning from your customers, automate everything else in the cloud (CI + CD + CO), you get fast feedback and will be able to release early, release often and recover quickly from your mistakes. Dynamism of the cloud allows you to increase the speed of your iteration and reduce the cost of mistakes so you can continuously innovate while keeping your cost down.
Distributed Design and Architecture of Cloud FoundryDerek Collison
In this session we will dig deep into Cloud Foundry's core architecture and design principles. We will discuss the challenges around scaling and operating a large scale service as we combined the PaaS and traditional IaaS layers, and how we achieve multiple updates per week to the system with no perceived downtime. Allowing user to download a single virtual machine that is a complete replica of the service presented some challenges as well, and we will discuss our approach to offering up the downloadable private cloud.
Architecting for the Cloud: demo and best practices, by Simone Brunozzi (2011...Amazon Web Services
Architecting for the Cloud: Demo and best practices.
Follow Simone Brunozzi on Twitter: @simon
Presentation recorded on July 14th, 2011, in Sydney during the 2011 AWS Tour Australia.
For the video (including audio), go here: http://www.slideshare.net/AmazonWebServices/video-architecting-for-the-cloud-demo-and-best-practices
Tackling complexity in giant systems: approaches from several cloud providersPatrick Chanezon
Systems architecture evolve in cycles every 15-20 years, oscillating between centralization and decentralization, but growing in size and complexity. The last cycle shifted from vertical to horizontal scalability for hardware, applications and data platforms. This talk will describe approaches used by some of the companies who pioneered cloud platforms, Google, Microsoft, Amazon, Netflix & VMware, to tackle complexity when building these giant distributed systems.
This talk was presented at JFokus 2014.
https://www.jfokus.se/jfokus/talks.jsp#Tacklingcomplexityin
Do you need Ops in your new startup? If not now, then when? And...what is Ops?
Learn how to scale ruby-based distributed software infrastructure in the cloud to serve 4,000 requests per second, handle 400 updates per second, and achieve 99.97% uptime – all while building the product at the speed of light.
Unimpressed? Now try doing the above altogether without the Ops team, while growing your traffic 100x in 6 months and deploying 5-6 times a day!
It could be a dream, but luckily it's a reality that could be yours.
Cloud-powered Continuous Integration and Deployment architectures - Jinesh VariaAmazon Web Services
The presentation will discuss some architectural patterns in continuous integration, deployment and optimization and I will share some of the lessons learned from Amazon.com.
The goal of the presentation is to convince you that if you invest your time where you get the maximum learning from your customers, automate everything else in the cloud (CI + CD + CO), you get fast feedback and will be able to release early, release often and recover quickly from your mistakes. Dynamism of the cloud allows you to increase the speed of your iteration and reduce the cost of mistakes so you can continuously innovate while keeping your cost down.
Distributed Design and Architecture of Cloud FoundryDerek Collison
In this session we will dig deep into Cloud Foundry's core architecture and design principles. We will discuss the challenges around scaling and operating a large scale service as we combined the PaaS and traditional IaaS layers, and how we achieve multiple updates per week to the system with no perceived downtime. Allowing user to download a single virtual machine that is a complete replica of the service presented some challenges as well, and we will discuss our approach to offering up the downloadable private cloud.
Architecting for the Cloud: demo and best practices, by Simone Brunozzi (2011...Amazon Web Services
Architecting for the Cloud: Demo and best practices.
Follow Simone Brunozzi on Twitter: @simon
Presentation recorded on July 14th, 2011, in Sydney during the 2011 AWS Tour Australia.
For the video (including audio), go here: http://www.slideshare.net/AmazonWebServices/video-architecting-for-the-cloud-demo-and-best-practices
Solving k8s persistent workloads using k8s DevOps styleMayaData
Solving k8s persistent workloads
using k8s DevOps style. Presented at Container_stack-Zurich-2019
-How Hardware trends enforce a change in the way we do things
-Storage limitations bubble up
-Infrastructure as code
This talk describes the Fermilab Virtual Facility project, which incorporates bare-metal machines, our OpenNebula-based private cloud, and commercial clouds. After a number of years of research and development we are now doing stable production of data-intensive analysis and simulation for High Energy Experiments on the cloud.
I will pay special attention to the auxiliary services such as code caching, data caching, job submission, autoscaling, and load balancing that we are launching in the cloud. I will also review other significant developments by others in the field with which Fermilab is not directly involved.
Author Biography
Steven Timm has worked on cloud and virtualization issues for the Scientific Computing Division at Fermilab. The new Virtual Facility Project is a way to transparently extend Fermilab’s facility onto commercial and community clouds.
Keeping Movies Running Amid Thunderstorms!Sid Anand
How does Netflix strive to deliver an uninterrupted service? This talk, delivered for the first time in November, 2011, covers some engineering design concepts that help us deliver features at a rapid pace while assuring high availability.
Pets vs. Cattle: The Elastic Cloud StoryRandy Bias
My recent presentation to the Chicago DevOps Meetup that explains how we're moving from a servers as Pets world to a servers as Cattle world. Understanding this change is critical to success in cloud, DevOps, and delivering new value to the enterprise.
This is a talk given by Jason Hoffman at a workshop given by Joyent called "Scale With Rails" in 2006. There's quite a bit of prescience in this presentation, including the first documented use of ZFS in production ("Fsck you if you think ZFS isn't production") and of OS-based virtualization (zones) in the cloud (which, it must be said, was not called "cloud" in 2006).
Presentation for the July 2018 @medianetlab meetup at NCSR "Demokritos"
Relative blog post can be found here: https://medianetlab.gr/mnlab-meetup-kubernetes/
and the video: https://www.youtube.com/watch?v=l2ce5U9bh6M
Finding and Organizing a Great Cloud Foundry User GroupDaniel Krook
Slides from the 2015 Cloud Foundry Summit on May 12.
http://sched.co/2tGc
Virtualization and global distribution are great when it comes to cloud computing and open source. In both cases, physical location is irrelevant. But one of the best ways to join the Cloud Foundry community is to participate in a local meetup. The presenters will share their experience running user groups over the past decade and lessons learned from recent Cloud Foundry events.
This session will teach you how to:
1. Find an active Cloud Foundry (or related cloud computing) user group
2. Contribute your own knowledge at an upcoming event
3. Organize - and sustain - a strong Cloud Foundry community
After this presentation, you will:
1. Appreciate the professional (and social) benefits of attending a meetup
2. Know how to share your expertise and establish your eminence as a Cloud Foundry expert
3. Be prepared to effectively organize a sustainable Cloud Foundry user group
A la rencontre de Kafka, le log distribué par Florian GARCIALa Cuisine du Web
Kafka c’est un peu la nouvelle star sur la scène des files de messages. Pourtant Kafka ne se présente pas en tant que tel, c’est un log distribué !
Alors qu’est ce que c’est ? Comment ça marche ? Et surtout comment et pourquoi je l’utilise ?
Dans cette session, on décortique la bête pour tout vous expliquer ! Au programme : des concepts, des cas d’usage, du streaming et un retour d’expérience !
UDS 2011 - Cloud Foundry and Ubuntu, a marriage made in heavenPatrick Chanezon
Cloud Foundry is an open source Cloud Platform as a Service "OpenPaaS" project created by VMware, developed in Ruby on Ubuntu. It is multi-language/framework (Java, Ruby, Node), multi-service (MongoDB, Reddis, MySQL, Postgres, RabbitMQ) and multi-cloud: it runs on your laptop, as Micro Cloud Foundry, an Ubuntu VMware image containing the whole platform,
but it can also run on many Cloud infrastructure providers (Cloudfoundry.com, Appfog, ActiveState), and can be used to create your own private cloud.
In this talk Patrick will talk about Cloud Foundry and its potential for developers, IT managers and Sysadmins.
The talk will be follwed by a demo some of Juju charms that allow you to deploy your own Ubuntu based multi-node cloud foundry platform on Amazon EC2 in 10 minutes.
This talk will provide an overview of the PaaS (Platform as a Service) landscape, and will describe the Cloud Foundry open source PaaS, with its multi-framework, multi-service, multi-cloud model.
Cloud Foundry allows developers to provision apps in Java/Spring, Ruby/Rails, Ruby/Sinatra, Javascript/Node, and leverage services like MySQL, MongoDB, Reddis, Postgres and RabbitMQ. It can be used as a public PaaS on CloudFoundry.com and other service providers (ActiveState, AppFog), to create your own private cloud, or on your laptop using the Micro Cloud Foundry VM.
The talk will end with a demo of Cloud Foundry in action, showing the end to end development workflow, from developing locally with Micro Cloud Foundry to deploying on Cloud Foundry.com.
If you want to get started with Cloud development, bring your laptops, check the requirements and download pre-requisites at https://cloudfoundry.com/micro, and we'll help you setup your environment and get started with Cloud Foundry on your local machine.
Solving k8s persistent workloads using k8s DevOps styleMayaData
Solving k8s persistent workloads
using k8s DevOps style. Presented at Container_stack-Zurich-2019
-How Hardware trends enforce a change in the way we do things
-Storage limitations bubble up
-Infrastructure as code
This talk describes the Fermilab Virtual Facility project, which incorporates bare-metal machines, our OpenNebula-based private cloud, and commercial clouds. After a number of years of research and development we are now doing stable production of data-intensive analysis and simulation for High Energy Experiments on the cloud.
I will pay special attention to the auxiliary services such as code caching, data caching, job submission, autoscaling, and load balancing that we are launching in the cloud. I will also review other significant developments by others in the field with which Fermilab is not directly involved.
Author Biography
Steven Timm has worked on cloud and virtualization issues for the Scientific Computing Division at Fermilab. The new Virtual Facility Project is a way to transparently extend Fermilab’s facility onto commercial and community clouds.
Keeping Movies Running Amid Thunderstorms!Sid Anand
How does Netflix strive to deliver an uninterrupted service? This talk, delivered for the first time in November, 2011, covers some engineering design concepts that help us deliver features at a rapid pace while assuring high availability.
Pets vs. Cattle: The Elastic Cloud StoryRandy Bias
My recent presentation to the Chicago DevOps Meetup that explains how we're moving from a servers as Pets world to a servers as Cattle world. Understanding this change is critical to success in cloud, DevOps, and delivering new value to the enterprise.
This is a talk given by Jason Hoffman at a workshop given by Joyent called "Scale With Rails" in 2006. There's quite a bit of prescience in this presentation, including the first documented use of ZFS in production ("Fsck you if you think ZFS isn't production") and of OS-based virtualization (zones) in the cloud (which, it must be said, was not called "cloud" in 2006).
Presentation for the July 2018 @medianetlab meetup at NCSR "Demokritos"
Relative blog post can be found here: https://medianetlab.gr/mnlab-meetup-kubernetes/
and the video: https://www.youtube.com/watch?v=l2ce5U9bh6M
Finding and Organizing a Great Cloud Foundry User GroupDaniel Krook
Slides from the 2015 Cloud Foundry Summit on May 12.
http://sched.co/2tGc
Virtualization and global distribution are great when it comes to cloud computing and open source. In both cases, physical location is irrelevant. But one of the best ways to join the Cloud Foundry community is to participate in a local meetup. The presenters will share their experience running user groups over the past decade and lessons learned from recent Cloud Foundry events.
This session will teach you how to:
1. Find an active Cloud Foundry (or related cloud computing) user group
2. Contribute your own knowledge at an upcoming event
3. Organize - and sustain - a strong Cloud Foundry community
After this presentation, you will:
1. Appreciate the professional (and social) benefits of attending a meetup
2. Know how to share your expertise and establish your eminence as a Cloud Foundry expert
3. Be prepared to effectively organize a sustainable Cloud Foundry user group
A la rencontre de Kafka, le log distribué par Florian GARCIALa Cuisine du Web
Kafka c’est un peu la nouvelle star sur la scène des files de messages. Pourtant Kafka ne se présente pas en tant que tel, c’est un log distribué !
Alors qu’est ce que c’est ? Comment ça marche ? Et surtout comment et pourquoi je l’utilise ?
Dans cette session, on décortique la bête pour tout vous expliquer ! Au programme : des concepts, des cas d’usage, du streaming et un retour d’expérience !
UDS 2011 - Cloud Foundry and Ubuntu, a marriage made in heavenPatrick Chanezon
Cloud Foundry is an open source Cloud Platform as a Service "OpenPaaS" project created by VMware, developed in Ruby on Ubuntu. It is multi-language/framework (Java, Ruby, Node), multi-service (MongoDB, Reddis, MySQL, Postgres, RabbitMQ) and multi-cloud: it runs on your laptop, as Micro Cloud Foundry, an Ubuntu VMware image containing the whole platform,
but it can also run on many Cloud infrastructure providers (Cloudfoundry.com, Appfog, ActiveState), and can be used to create your own private cloud.
In this talk Patrick will talk about Cloud Foundry and its potential for developers, IT managers and Sysadmins.
The talk will be follwed by a demo some of Juju charms that allow you to deploy your own Ubuntu based multi-node cloud foundry platform on Amazon EC2 in 10 minutes.
This talk will provide an overview of the PaaS (Platform as a Service) landscape, and will describe the Cloud Foundry open source PaaS, with its multi-framework, multi-service, multi-cloud model.
Cloud Foundry allows developers to provision apps in Java/Spring, Ruby/Rails, Ruby/Sinatra, Javascript/Node, and leverage services like MySQL, MongoDB, Reddis, Postgres and RabbitMQ. It can be used as a public PaaS on CloudFoundry.com and other service providers (ActiveState, AppFog), to create your own private cloud, or on your laptop using the Micro Cloud Foundry VM.
The talk will end with a demo of Cloud Foundry in action, showing the end to end development workflow, from developing locally with Micro Cloud Foundry to deploying on Cloud Foundry.com.
If you want to get started with Cloud development, bring your laptops, check the requirements and download pre-requisites at https://cloudfoundry.com/micro, and we'll help you setup your environment and get started with Cloud Foundry on your local machine.
NCA GTUG 2012 - Cloud is such stuff as dreams are made onPatrick Chanezon
There is a profound architecture transition happening in software in 2011, like we see every 15 years: html5 and mobile on the client, cloud on the server.
This talk will explain the opportunities and challenges that the Cloud represents for developers, in 4 areas: Infrastructure, Platform, Software and Development.
This talk will describe the capabilities, philosophies and issues associated with current Cloud Platform offerings (Google Appengine, Azure, Beanstalk, CloudFoundry, Heroku), for different use cases (public, private, hybrid clouds) and the nascent Cloud Development services (Cloudbees, Exo, Cloud9, Github).
We will dive into the code of a sample Cloud Foundry app using Node.js, MongoDb, the Twitter API and Lanyrd Calendar feeds, to show how Cloud Platforms enable a more agile development process.
We will also discuss opportunities and risks for developers to move their apps to the Cloud, new skills to learn, and old habits to forget.
Better, Faster, Cheaper Infrastructure: Apache CloudStack and Riak CSJohn Burwell
Software is eating infrastructure. By pulling reliability and scalability responsibilities up the stack from hardware into software, object stores such as Basho's Riak CS and cloud orchestration platforms such as Apache CloudStack increase the utilization of compute and storage resources by dynamically shifting workloads based on demand. Together, those platforms can saturate compute and storage of 1000s of hosts with strong operational visibility and end-user self-service.
This talk will cover the following topics to explore private cloud design principles and best practices:
* Why Private Cloud?
* Anatomy of a Private Cloud
* Building a Apache CloudStack Compute Offering
* Large Object Storage using Riak CS
(SPOT302) Availability: The New Kind of Innovator’s DilemmaAmazon Web Services
Successful companies, while focusing on their current customers' needs, often fail to embrace disruptive technologies and business models. This phenomenon, known as the "Innovator's Dilemma," eventually leads to many companies' downfall and is especially relevant in the fast-paced world of online services. In order to protect its leading position and grow its share of the highly competitive global digital streaming market, Netflix has to continuously increase the pace of innovation by constantly refining recommendation algorithms and adding new product features, while maintaining a high level of service uptime. The Netflix streaming platform consists of hundreds of microservices that are constantly evolving, and even the smallest production change may cause a cascading failure that can bring the entire service down. We face a new kind of Innovator's Dilemma, where product changes may not only disrupt the business model but also cause production outages that deny customers service access. This talk will describe various architectural, operational and organizational changes adopted by Netflix in order to reconcile rapid innovation with service availability.
Same basic flow as the keynote, but with a lot more detail, and we had a lot more interactive discussion rather than a presentation format. See part 2 for some more specific detail and links to other presentations.
Scaling Confluence Architecture: A Sneak Peek Under the HoodBhakti Mehta
Atlassian’s Confluence is content collaboration software that changes how modern teams work. It is trusted by more than 35,000 teams and millions of users. This session presents a deep dive to provide insights into how the Confluence architecture has evolved into its current form. It discusses how Atlassian deploys, runs, and operates at scale and challenges encountered along the way. Using examples of real-life incidents, the session covers best practices and lessons learned for building resilient, stable, and predictable services. Learn how Atlassian isolated the impact of failures and blast radius by microservice sharding and proper tuning, and hear about strategies for dependency scaling, failure injection, deployment pipelines, and end-to-end testing.
Presented at AI NEXTCon Seattle 1/17-20, 2018
http://aisea18.xnextcon.com
join our free online AI group with 50,000+ tech engineers to learn and practice AI technology, including: latest AI news, tech articles/blogs, tech talks, tutorial videos, and hands-on workshop/codelabs, on machine learning, deep learning, data science, etc..
AFCEA C4I Symposium: The 4th C in C4I Stands for Cloud:Factors Driving Adopti...Patrick Chanezon
Computer systems architecture evolve in cycles every 15-20 years, oscillating between centralization and decentralization: centralized mainframes of the 60s, decentralized PCs of the 80s, centralized web apps of the 90s. Since 2010, we see a new architecture shift back to the 80's client-server model, with 3 trends: powerful mobile device (android, iphone), the browser becoming a rich client platform with html5, and cloud platforms commoditizing distributed computing on the server. This talk is about the server side of the current architecture shift.
As most technology architecture changes, cloud computing adoption is driven by factors from multiple dimensions, not only technical ones:
- technology: Big Data & fast networks, shift from vertical to horizontal scalability, commoditization of distributed computing (Virtualization, Sharding, Storage, NoSQL databases, Paxos, Map/Reduce, Go language), centralization of security
- economy: broadband and wireless ubiquity, shift from product to services, economies of scale, Moore's law, cost of electricity becoming main driver for computing cost , pay as you go models
- culture: consumerization of enterprise technology, technology achieves ubiquity by disappearing
20 years ago when I was involved with Command and Control Systems for the french DoD, they were called C3I. Since then it seems they added a C for Computers, C4I. Maybe for the next 20 years the 4th C of C4I should stand for Cloud.
Building A Scalable Open Source Storage SolutionPhil Cryer
The Biodiversity Heritage Library (BHL), like many other projects within biodiversity informatics, maintains terabytes of data that must be safeguarded against loss. Further, a scalable and resilient infrastructure is required to enable continuous data interoperability, as BHL provides unique services to its community of users. This volume of data and associated availability requirements present significant challenges to a distributed organization like BHL, not only in funding capital equipment purchases, but also in ongoing system administration and maintenance. A new standardized system is required to bring new opportunities to collaborate on distributed services and processing across what will be geographically dispersed nodes. Such services and processing include taxon name finding, indexes or GUID/LSID services, distributed text mining, names reconciliation and other computationally intensive tasks, or tasks with high availability requirements.
DCSF19 CMD and Conquer: Containerizing the Monolith Docker, Inc.
Tony Lee & Nelson Wang, Splunk
Modern microservice-oriented software architectures evangelize the principles of infrastructure-as-code and declarative directives to manage and run applications. At Splunk, we wanted to marry these ideals with the majestic monolith, Splunk Enterprise, to simplify the use of our product through containerization. Without rearchitecting the entire product from the ground-up, which can be a costly investment, we focused on incorporating a flexible configuration management layer on top of the core application. This has enabled us to make running Splunk in Docker act and behave as a true microservice, greatly reducing the friction of migrating towards more container-native software.
We not only concentrated on making our open-source Docker image initiative user-friendly and production-ready, but we also wanted to seamlessly integrate it back into our internal engineering process. Join us for this session as we discuss migrating a traditional application into a microservice ecosystem, developing a containerization strategy for both external customer usage and internal development, as well as learning about our internal container platform at scale.
Webinar: Emerging Trends in Data Architecture – What’s the Next Big Thing?DATAVERSITY
The migration to cloud-based data architectures continues at a rapid pace, including databases and data management. Oracle databases are part of this trend, and during this webinar you will learn how to automate the provisioning and management of Oracle databases so that you can deliver an “as-a-service” experience with 1-click simplicity. Experts will walk you through the process of:
· Using Kubernetes to deliver a production-ready
solution for your Oracle-based applications
· Turbocharging your data infrastructure using
cloud-native architecture
· Improving the agility and efficiency of your BI
and Data Operation teams, Developers, and Data Scientists
· Defining the business impact and benefits of
cloud-based Oracle solutions
LinuxFest NW 2013: Hitchhiker's Guide to Open Source Cloud ComputingMark Hinkle
Presented on April 27th, 2013 at LinuxFest NW
Imagine it’s eight o’clock on a Thursday morning and you awake to see a bulldozer out your window ready to plow over your data center. Normally you may wish to consult the Encyclopedia Galáctica to discern the best course of action but your copy is likely out of date. And while the Hitchhiker’s Guide to the Galaxy (HHGTTG) is a wholly remarkable book it doesn’t cover the nuances of cloud computing. That’s why you need the Hitchhiker’s Guide to Cloud Computing (HHGTCC) or at least to attend this talk understand the state of open source cloud computing. Specifically this talk will cover infrastructure-as-a-service, platform-as-a-service and developments in big data and how to more effectively take advantage of these technologies using open source software. Technologies that will be covered in this talk include Apache CloudStack, Chef, CloudFoundry, NoSQL, OpenStack, Puppet and many more.
Specific topics for discussion will include:
Infrastructure-as-a-Service - The Systems Cloud - Get a comparision of the open source cloud platforms including OpenStack, Apache CloudStack, Eucalyptus, OpenNebula
Platform-as-a-Service - The Developers Cloud - Find out what tools are availble to build portable auto-scaling applications including CloudFoundry, OpenShift, Stackato and more.
Data-as-a-Service - The Analytics Cloud - Want to figure out the who, what , where , when and why of big data ? You get an overview of open source NoSQL databases and technologies like MapReduce to help crunch massive data sets in the cloud.
Finally you'll get a overview of the tools that can help you really take advantage of the cloud? Want to auto-scale virtual machiens to serve millions of web pages or want to automate the configuration of cloud computing environments. You'll learn how to combine these tools to provide continous deployment systems that will help you earn DevOps cred in any data center.
[Finally, for those of you that are Douglas Adams fans please accept the deepest apologies for bad analogies to the HHGTTG.]
Interop - Crash Course In Open Source Cloud ComputingMark Hinkle
This will be an overview of the open source software that can be used to deploy and manage a cloud computing environment. The session will include information on storage, networking(e.g. OpenDaylight) and compute virtualization (Xen, KVM, LXC) and the orchestration(Apache CloudStack, OpenStack) of the three to build their own cloud services.
Similar to Interop 2011 - Scaling Platform As A Service (20)
Kubernetes has many ways to scale your workloads, most of what we hear about is scaling our cluster up with either with vm sets or autoscaling groups. There is another way, in this talk we will look at virtual kubelet. Virual Kubelet will allow us to talk to a cloud providers container as a service platform like ACI, fargate or ECI. We will deep dive into how you can scale your applications across virtual kubelet. One issue is the kubernetes service type has is scaling to zero due to the way routing to the pod happens if there is no pod for the service to route too. Scaling our applications to zero is just as important and scaling up. We will look at projects that integrate with the horizontal pod autoscaler that fix this issue. Allowing us to not only scale our applications up but as easily down to make our cluster truly elastic.
KubeCon China 2019 - Building Apps with Containers, Functions and Managed Ser...Patrick Chanezon
Cloud native applications are composed of many technologies and components, but three canonical abstraction emerged in the past few years that help developers structure their architecture: container, functions responding to events, and managed services.
This talk will explain how to develop (Docker, local Kubernetes, virtual Kubelet, OpenFaaS), deploy (managed Kubernetes, functions and services) and package (CNAB specification and tooling) applications using these three components and look at not only deployment workflows but also at day 2 concerns that a developer would need to consider in the cloud native landscape.
We will demo every topic and a Github repository will be available for developers to reproduce the demos and learn at their own pace.
Patrick Chanezon and Scott Coulton
Dockercon 2019 Developing Apps with Containers, Functions and Cloud ServicesPatrick Chanezon
Cloud native applications are composed of containers, serverless functions and managed cloud services.
What is the best set of tools on your desktop to provide a rapid, iterative development experience and package applications using these three components?
This hand-on talk will explain how you can complement Docker Desktop, with it’s local Docker engine and Kubernetes cluster, with open source tools such as the Virtual Kubelet, Open Service Broker, the Gloo hybrid app gateway, Draft, and others, to build the most productive development inner-loop for these type of applications.
It will also cover how you can use the Cloud Native Application Bundle (CNAB) format and it’s implementation in the Docker app experimental tool to package your application and manage it with container supply chain tooling such as Docker Hub.
GIDS 2019: Developing Apps with Containers, Functions and Cloud ServicesPatrick Chanezon
Cloud native applications are increasingly composed of containers, serverless functions responding to events and managed cloud services. What is the best workflow and set of tools to provide a rapid, iterative development experience and to package applications using these three components?
This hand-on talk will compare and contrast several sets of tools and their associated workflows:
Using Docker Desktop, with its local Docker engine and Kubernetes cluster, with open source tools such as the Virtual Kubelet, or the Gloo hybrid app gateway, to build the most productive development inner-loop for these type of applications
OpenFaaS, Fn, or Nuclio open source serverless framework to run functions in containers locally
Telepresence to run a container locally, connected to a remote cluster
Helm and Draft
Knative
The talk will also cover how you can use the Cloud Native Application Bundle (CNAB) format and tools to package your applications and share them using a container registry.
Patrick Chanezon, un des pionniers du Cloud chez Google, VMware, Microsoft et Docker, vous raconte la révolution des conteneurs logiciels et comment certains concepts du taoïsme, wei-wu-wei, "agir sans agir", et ziran, naturel, ou spontanéïté, permettent d'en mieux cerner les enjeux.
Les conteneurs accélèrent l'adoption du Cloud en entreprise, avec des architectures hybride et multi cloud, la mise en place de démarches agiles et DevOps pour moderniser les applications existantes et réduire les coûts d'infrastructure, et permettent de nouveaux cas d'utilisation dans l'internet des objets et l'intelligence artificielle.
Moby is an open source project providing a "LEGO set" of dozens of components, the framework to assemble them into specialized container-based systems, and a place for all container enthusiasts to experiment and exchange ideas.
One of these assemblies is Docker CE, an open source product that lets you build, ship, and run containers.
This talk will explain how you can leverage the Moby project to assemble your own specialized container-based system, whether for IoT, cloud or bare metal scenarios.
We will cover Moby itself, the framework, and tooling around the project, as well as many of it’s components: LinuxKit, InfraKit, containerd, SwarmKit, Notary.
Then we will present a few use cases and demos of how different companies have leveraged Moby and some of the Moby components to create their own container-based systems.
Video at https://www.youtube.com/watch?v=kDp22YkD6WY
Microsoft Techsummit Zurich Docker and MicrosoftPatrick Chanezon
Docker and Microsoft have been collaborating both in open source and through their commercial partnership to bring the benefits of Docker Windows and Linux containers to Azure Enterprise customers. Docker’s container platform, Docker Enterprise Edition, is used to modernize traditioal applications, and move them to Azure, as well as to develop new cloud native applications using microservices architecture, bringing agility to developers and control to IT Pros. This talk will cover the latest developments in Docker’s container platform with planned support for Kubernetes in Docker for Windows, and Docker Enterprise Edition for Azure, Docker for Azure Stack to enable hybrid cloud deployments, Windows containers, Linux containers on Windows.
Develop and deploy Kubernetes applications with Docker - IBM Index 2018Patrick Chanezon
Docker Desktop and Enterprise Edition now both include Kubernetes as an optional orchestration component. This talk will explain how to use Docker Desktop (Mac or Windows) to develop and debug a cloud native application, then how Docker Enterprise Edition helps you deploy it to Kubernetes in production.
The Docker Way: modernize traditional applications without action (wu-wei) and create new cloud native microservices applications with naturalness (ziran).
This talk also provides a summary of all the DockerCon EU 2017 announcements: Kubernetes now supported in Docker, MTA, IBM partnership.
Building specialized container-based systems with Moby: a few use cases
This talk will explain how you can leverage the Moby project to assemble your own specialized container-based system, whether for IoT, cloud or bare metal scenarios. We will cover Moby itself, the framework, and tooling around the project, as well as many of it’s components: LinuxKit, InfraKit, containerd, SwarmKit, Notary. Then we will present a few use cases and demos of how different companies have leveraged Moby and some of the Moby components to create their own container-based systems.
Docker Cap Gemini CloudXperience 2017 - la revolution des conteneurs logicielsPatrick Chanezon
Si vous avez raté le début : Patrick Chanezon, un des pionniers du Cloud chez Google, VMware, Microsoft et Docker, vous raconte la révolution des conteneurs logiciels en quelques films ; comment ils accélèrent l'adoption du Cloud en entreprise, avec des architectures hybride et multi, la mise en place de démarches agiles et DevOps pour moderniser les applications existantes et réduire les coûts d'infrastructure, et permettent de nouveaux cas d'utilisation dans l'internet des objets et l'intelligence artificielle.
En bref, comment expliquer la stratégie des opérateurs du Cloud avec des films de science- fiction ? C’est le défi que va relever Patrick Chanezon, évangéliste chez Docker.
Docker moves very fast, with an edge channel released every month and a stable release every 3 months. Patrick will talk about how Docker introduced Docker EE and a certification program for containers and plugins with Docker CE and EE 17.03 (from March), the announcements from DockerCon (April), and the many new features planned for Docker CE 17.05 in May.
This talk will be about what's new in Docker and what's next on the roadmap
Oscon 2017: Build your own container-based system with the Moby projectPatrick Chanezon
Build your own container-based system
with the Moby project
Docker Community Edition—an open source product that lets you build, ship, and run containers—is an assembly of modular components built from an upstream open source project called Moby. Moby provides a “Lego set” of dozens of components, the framework for assembling them into specialized container-based systems, and a place for all container enthusiasts to experiment and exchange ideas.
Patrick Chanezon and Mindy Preston explain how you can leverage the Moby project to assemble your own specialized container-based system, whether for IoT, cloud, or bare-metal scenarios. Patrick and Mindy explore Moby’s framework, components, and tooling, focusing on two components: LinuxKit, a toolkit to build container-based Linux subsystems that are secure, lean, and portable, and InfraKit, a toolkit for creating and managing declarative, self-healing infrastructure. Along the way, they demo how to use Moby, LinuxKit, InfraKit, and other components to quickly assemble full-blown container-based systems for several use cases and deploy them on various infrastructures.
Transcript: Selling digital books in 2024: Insights from industry leaders - T...BookNet Canada
The publishing industry has been selling digital audiobooks and ebooks for over a decade and has found its groove. What’s changed? What has stayed the same? Where do we go from here? Join a group of leading sales peers from across the industry for a conversation about the lessons learned since the popularization of digital books, best practices, digital book supply chain management, and more.
Link to video recording: https://bnctechforum.ca/sessions/selling-digital-books-in-2024-insights-from-industry-leaders/
Presented by BookNet Canada on May 28, 2024, with support from the Department of Canadian Heritage.
State of ICS and IoT Cyber Threat Landscape Report 2024 previewPrayukth K V
The IoT and OT threat landscape report has been prepared by the Threat Research Team at Sectrio using data from Sectrio, cyber threat intelligence farming facilities spread across over 85 cities around the world. In addition, Sectrio also runs AI-based advanced threat and payload engagement facilities that serve as sinks to attract and engage sophisticated threat actors, and newer malware including new variants and latent threats that are at an earlier stage of development.
The latest edition of the OT/ICS and IoT security Threat Landscape Report 2024 also covers:
State of global ICS asset and network exposure
Sectoral targets and attacks as well as the cost of ransom
Global APT activity, AI usage, actor and tactic profiles, and implications
Rise in volumes of AI-powered cyberattacks
Major cyber events in 2024
Malware and malicious payload trends
Cyberattack types and targets
Vulnerability exploit attempts on CVEs
Attacks on counties – USA
Expansion of bot farms – how, where, and why
In-depth analysis of the cyber threat landscape across North America, South America, Europe, APAC, and the Middle East
Why are attacks on smart factories rising?
Cyber risk predictions
Axis of attacks – Europe
Systemic attacks in the Middle East
Download the full report from here:
https://sectrio.com/resources/ot-threat-landscape-reports/sectrio-releases-ot-ics-and-iot-security-threat-landscape-report-2024/
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...Ramesh Iyer
In today's fast-changing business world, Companies that adapt and embrace new ideas often need help to keep up with the competition. However, fostering a culture of innovation takes much work. It takes vision, leadership and willingness to take risks in the right proportion. Sachin Dev Duggal, co-founder of Builder.ai, has perfected the art of this balance, creating a company culture where creativity and growth are nurtured at each stage.
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered QualityInflectra
In this insightful webinar, Inflectra explores how artificial intelligence (AI) is transforming software development and testing. Discover how AI-powered tools are revolutionizing every stage of the software development lifecycle (SDLC), from design and prototyping to testing, deployment, and monitoring.
Learn about:
• The Future of Testing: How AI is shifting testing towards verification, analysis, and higher-level skills, while reducing repetitive tasks.
• Test Automation: How AI-powered test case generation, optimization, and self-healing tests are making testing more efficient and effective.
• Visual Testing: Explore the emerging capabilities of AI in visual testing and how it's set to revolutionize UI verification.
• Inflectra's AI Solutions: See demonstrations of Inflectra's cutting-edge AI tools like the ChatGPT plugin and Azure Open AI platform, designed to streamline your testing process.
Whether you're a developer, tester, or QA professional, this webinar will give you valuable insights into how AI is shaping the future of software delivery.
Key Trends Shaping the Future of Infrastructure.pdfCheryl Hung
Keynote at DIGIT West Expo, Glasgow on 29 May 2024.
Cheryl Hung, ochery.com
Sr Director, Infrastructure Ecosystem, Arm.
The key trends across hardware, cloud and open-source; exploring how these areas are likely to mature and develop over the short and long-term, and then considering how organisations can position themselves to adapt and thrive.
Accelerate your Kubernetes clusters with Varnish CachingThijs Feryn
A presentation about the usage and availability of Varnish on Kubernetes. This talk explores the capabilities of Varnish caching and shows how to use the Varnish Helm chart to deploy it to Kubernetes.
This presentation was delivered at K8SUG Singapore. See https://feryn.eu/presentations/accelerate-your-kubernetes-clusters-with-varnish-caching-k8sug-singapore-28-2024 for more details.
Connector Corner: Automate dynamic content and events by pushing a buttonDianaGray10
Here is something new! In our next Connector Corner webinar, we will demonstrate how you can use a single workflow to:
Create a campaign using Mailchimp with merge tags/fields
Send an interactive Slack channel message (using buttons)
Have the message received by managers and peers along with a test email for review
But there’s more:
In a second workflow supporting the same use case, you’ll see:
Your campaign sent to target colleagues for approval
If the “Approve” button is clicked, a Jira/Zendesk ticket is created for the marketing design team
But—if the “Reject” button is pushed, colleagues will be alerted via Slack message
Join us to learn more about this new, human-in-the-loop capability, brought to you by Integration Service connectors.
And...
Speakers:
Akshay Agnihotri, Product Manager
Charlie Greenberg, Host
GraphRAG is All You need? LLM & Knowledge GraphGuy Korland
Guy Korland, CEO and Co-founder of FalkorDB, will review two articles on the integration of language models with knowledge graphs.
1. Unifying Large Language Models and Knowledge Graphs: A Roadmap.
https://arxiv.org/abs/2306.08302
2. Microsoft Research's GraphRAG paper and a review paper on various uses of knowledge graphs:
https://www.microsoft.com/en-us/research/blog/graphrag-unlocking-llm-discovery-on-narrative-private-data/
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...UiPathCommunity
💥 Speed, accuracy, and scaling – discover the superpowers of GenAI in action with UiPath Document Understanding and Communications Mining™:
See how to accelerate model training and optimize model performance with active learning
Learn about the latest enhancements to out-of-the-box document processing – with little to no training required
Get an exclusive demo of the new family of UiPath LLMs – GenAI models specialized for processing different types of documents and messages
This is a hands-on session specifically designed for automation developers and AI enthusiasts seeking to enhance their knowledge in leveraging the latest intelligent document processing capabilities offered by UiPath.
Speakers:
👨🏫 Andras Palfi, Senior Product Manager, UiPath
👩🏫 Lenka Dulovicova, Product Program Manager, UiPath
When stars align: studies in data quality, knowledge graphs, and machine lear...
Interop 2011 - Scaling Platform As A Service
1. Beyond Virtual Machines
Scaling PaaS
Patrick Chanezon
Senior Director
Developer Relations
chanezonp@vmware.com
http://twitter.com/chanezon
2
Monday, October 3, 11
2. P@ in a nutshell
• French, based in San Francisco
• Senior Director, Developer Relations,VMware
• Software Plumber, API guy, mix of Enterprise and
Consumer
• 18 years writing software, backend guy with a
taste for javascript
• 2 y Accenture (Notes guru), 3 y Netscape/AOL
(Servers, Portals), 5 y Sun (ecommerce, blogs,
Portals, feeds, open source)
• 6 years at Google, API guy (first hired, helped start the
team)
• Adwords, Checkout, Social, HTML5, Cloud
Monday, October 3, 11
3. Predictions
“The future is already here
— it's just not very evenly
distributed”
William Gibson
3
Monday, October 3, 11
4. Predictions
My daugter Charlotte
4
Monday, October 3, 11
9. Back to Client Server: Groovy Baby!
9
Monday, October 3, 11
10. Hype warning: Cloudy, with a chance of real innovation
Source: Gartner (August 2009)
10
Monday, October 3, 11
11. What is Cloud Computing?
Cloud According to my daughter Eliette
11
Monday, October 3, 11
12. Cloud Stack - Classic Pyramid
Software
As A Service
Platform As A Service
Infrastructure As A Service
12
Monday, October 3, 11
13. Cloud Stack - By Number
Software
As A Service
Platform As A Service
Infrastructure
As A Service
13
Monday, October 3, 11
14. Cloud Stack - By Value
Software
As A Service
Platform As A Service
Infrastructure
As A Service
14
Monday, October 3, 11
15. Cloud Stack - Neutral
Software
As A Service
Platform As A Service
Infrastructure As A Service
15
Monday, October 3, 11
16. Cloud Stack - History
§ What does cloud mean, 4 main angles
• Software 1994 Netscape
• Infrastructure 2002 Amazon AWS
• Platform 2008 Google
• Development now!
§ Industrialization of hardware and software infrastructure
• like electricity beginning of 20th century, cf The Big Switch, Nick Carr
§ But software development itself is moving towards craftmanship
16
Monday, October 3, 11
17. Crossing the Chasm
§ Build the whole product
§ Cloud getting mainstream: Apple iCloud
§ Opportunities and risks
§ Ecosystems, various platforms
Picture from Wikimedia Foundation http://en.wikipedia.org/wiki/File:Technology-Adoption-Lifecycle.png
17
Monday, October 3, 11
18. Cloud started at Consumer websites solving their needs
• Google, Amazon, Yahoo, Facebook, Twitter
• Large Data Sets
• Storage Capacity growing faster than Moore’s Law
• Fast Networks
• Horizontal -> Vertical scalability
• Open Source Software
• Virtualization
• Cloud is a productization of these infrastructures
• Public Clouds Services: Google, Amazon
• Open Source Software: Hadoop, Eucalyptus, Cloud Foundry
Monday, October 3, 11
19. IaaS/Virtualization getting mainstream
§ AWS, Joyent, Rackspace,...
§ Open Source projects: OpenStack, DeltaCloud, Eucalyptus
§ Standardization? DTMF
§ Inside the Firewall, Virtualization: VMware, Microsoft, Xen, KVM
§ Easy to provision, manage instance...BUT
§ Still need to manage backups, software stacks, monitor, upgrades
19
Monday, October 3, 11
20. With Infrastructure, you still need to build your own platform
§ Need to build a distributed platform on top of you infrastructure
§ Story of the AWS meltdown from last summer
• http://blog.reddit.com/2011/03/why-reddit-was-down-for-6-of-last-24.html
• http://www.readwriteweb.com/cloud/2010/12/chaos-monkey-how-netflix-
uses.php
• http://news.ycombinator.com/item?id=2477296
• http://stu.mp/2011/04/the-cloud-is-not-a-silver-bullet.html
§ Twilio, Smugmug, SimpleGeo survived it because they built their
own distributed platform on top of IaaS
§ Enterprise customers want to consider Infrastructure like CDNs
• Multi Cloud usage
• Based on Open Source de facto standards, or full standards whenever that
happens
20
Monday, October 3, 11
21. Platform Example: Google Ap Engine Datastore Layers
Complex Entity Group Queries on Key range Get and set
queries Transactions properties scan by key
Datastore ✓ ✓ ✓ ✓ ✓
Megastore ✓ ✓ ✓ ✓
Bigtable ✓ ✓
21
Monday, October 3, 11
22. Megastore API
§ “Give me all rows where the column ‘name’ equals ‘ikai’”
§ “Transactionally write an update to this group of entities”
§ “Do a cross datacenter write of this data such that reads will be strongly
consistent” (High Replication Datastore)
§ Megastore paper: http://www.cidrdb.org/cidr2011/Papers/
CIDR11_Paper32.pdf
22
Monday, October 3, 11
23. Platforms
§ Web stack, nosql, sql
§ Google App Engine, Joyent, Heroku, Stax (Cloudbees), Amazon
elastic beanstalk, Microsoft Azure, AppFog
§ Single or a few languages, services
§ Start of Multi language Polyglot platforms
§ Enabler for Agile Developers -> Create Business value faster
§ Lack of standards: risk, vendor lock-in
§ Enterprise needs:
• Control, customizability
• Private/Hybrid Cloud
• Avoid lock-in
23
Monday, October 3, 11
24. Main Risk: Lock-In
Welcome to the hotel california
Such a lovely place
Such a lovely face
Plenty of room at the hotel california
Any time of year, you can find it here
Last thing I remember, I was
Running for the door
I had to find the passage back
To the place I was before
’relax,’ said the night man,
We are programmed to receive.
You can checkout any time you like,
But you can never leave!
24
Monday, October 3, 11
25. Cloud Foundry
§ Cloud Foundry Open PaaS
• Open Source: Apache 2 Licensed
• multi language/frameworks
• multi services
• multi cloud
25
Monday, October 3, 11
26. Open Source Advantage
§ http://code.google.com/p/googleappengine/issues/detail?id=13
• https://github.com/cloudfoundry/vcap/pull/25
26
Monday, October 3, 11
28. Fail often, fail quickly, and learn
• At Google Risk taking/Experimentation is encouraged
• http://blog.red-bean.com/sussman/?p=96
“Do not be afraid of day-to-day failures — learn from them. (As they say
at Google, “don’t run from failure — fail often, fail quickly, and learn.”)
Cherish your history, both the successes and mistakes. All of these
behaviors are the way to get better at programming. If you don’t follow
them, you’re cheating your own personal development.”
Ben Collins-Sussman (Subversion, code.google.com)
Monday, October 3, 11
30. Cultural Drivers: Agility
• Waterfall -> Agile methodologies
• Cloud enables an Agile culture, driver for innovation
1
2
http://www.yourdomain.com/
Monday, October 3, 11
31. Agile Development Processes
• Influences from XP, Agile, Scrum
• Code reviews
• Test Driven Development: Testing on the Toilets program and blog
• Many internal development tools: Mondrian recently open sourced
• Changed the meaning of beta
• Teams co-located: 3-15 people, 4/cubicle, all close to each other
• International offices: manage whole projects, avoid coordination costs
Monday, October 3, 11
32. Agility as a survival skill
§ Software is becoming like fashion
§ Phone apps, social apps, short lifetime, fast lifecycles
§ Ab testing
§ Clay shirky situational apps
§ Kent Beck, Usenix 2011 Talk
change in software process when frequency grows
§ Cloud is a powerful driver for agility
§ Scalability is built in the platforms
§ Can iterate faster
§ Focus on design
32
Monday, October 3, 11
33. Chaos of creativity in developer Frameworks and Tools
§ Proliferation of languages and frameworks
§ Spring, Rails, Grails, Django
§ “Pythons has more webframeworks than language keywords”
§ Javascript, Python, PHP, Java, Groovy, Scala, Clojure, Go
§ Gosling, vm is important, not the language
§ Ability to create DSL important, cf Book
§ Fragmentation of communities
§ Chaotic Darwinian period, fun for the curious, deadly for the ossified
§ Online services replacing a lot of software
§ Mashups, Weaving services together
§ Pick your battles, choose what you need to build yourself to add value
33
Monday, October 3, 11
35. Books / Articles
§ Nick Carr, The Big Switch
§ Eric Raymond, The Art of Unix Programming
§ Weinberg, Psychology of Computer Programming
§ Wes python book
§ Mark html5 book
§ Kent Beck XP
§ Hunt, Thomas, The Pragmatic Programmer
§ Ade Oshineye, Apprenticeship Patterns
§ Matt Cutt's Ignite Talk IO 2011, Trying different things
§ Josh Bloch talk about api design
§ Larry and Sergey, Anatomy of a Search Engine
§ Rob Pike, The Practice of Programming
35
Monday, October 3, 11
36. Papers / Talks
§ Simon Wardley, Oscon 09 “Cloud - Why IT Matters”
§ Tim O’Reilly article on internet os
§ Peter Deutsch’s 8 Fallacies of Distributed Computing
§ Brewer’s CAP Theorem
§ Gregor Hohpe’s Starbucks Does Not Use Two-Phase Commit
§ Stuff I tag http://www.delicious.com/chanezon/
§ My previous Talks http://www.slideshare.net/chanezon
§ My list of favorite books
http://www.chanezon.com/pat/soft_books.html
36
Monday, October 3, 11