This document summarizes Cloud Foundry, an open Platform as a Service (PaaS) that allows developers to build, deploy, and run applications. It describes the key components of Cloud Foundry including the kernel, orchestrator, routers, cloud controllers, DEAs, health manager, and services. It explains how applications are pushed, run, scaled, and accessed on Cloud Foundry through an event-driven and asynchronous architecture designed for high availability.
Networking in CloudStack is full-featured, full of bells and whistles and by necessity complicated. This session will take cloud operators through the ins-and-outs of CloudStack Networking. Attendees will learn the motivations behind how CloudStack networking is architected, solutions to common networking requirements, gotchas, troubleshooting CloudStack networking and finally some future directions for theses features.
It is assumed that the audience will have some experience administering CloudStack clouds.
UDS 2011 - Cloud Foundry and Ubuntu, a marriage made in heavenPatrick Chanezon
Cloud Foundry is an open source Cloud Platform as a Service "OpenPaaS" project created by VMware, developed in Ruby on Ubuntu. It is multi-language/framework (Java, Ruby, Node), multi-service (MongoDB, Reddis, MySQL, Postgres, RabbitMQ) and multi-cloud: it runs on your laptop, as Micro Cloud Foundry, an Ubuntu VMware image containing the whole platform,
but it can also run on many Cloud infrastructure providers (Cloudfoundry.com, Appfog, ActiveState), and can be used to create your own private cloud.
In this talk Patrick will talk about Cloud Foundry and its potential for developers, IT managers and Sysadmins.
The talk will be follwed by a demo some of Juju charms that allow you to deploy your own Ubuntu based multi-node cloud foundry platform on Amazon EC2 in 10 minutes.
Networking in CloudStack is full-featured, full of bells and whistles and by necessity complicated. This session will take cloud operators through the ins-and-outs of CloudStack Networking. Attendees will learn the motivations behind how CloudStack networking is architected, solutions to common networking requirements, gotchas, troubleshooting CloudStack networking and finally some future directions for theses features.
It is assumed that the audience will have some experience administering CloudStack clouds.
UDS 2011 - Cloud Foundry and Ubuntu, a marriage made in heavenPatrick Chanezon
Cloud Foundry is an open source Cloud Platform as a Service "OpenPaaS" project created by VMware, developed in Ruby on Ubuntu. It is multi-language/framework (Java, Ruby, Node), multi-service (MongoDB, Reddis, MySQL, Postgres, RabbitMQ) and multi-cloud: it runs on your laptop, as Micro Cloud Foundry, an Ubuntu VMware image containing the whole platform,
but it can also run on many Cloud infrastructure providers (Cloudfoundry.com, Appfog, ActiveState), and can be used to create your own private cloud.
In this talk Patrick will talk about Cloud Foundry and its potential for developers, IT managers and Sysadmins.
The talk will be follwed by a demo some of Juju charms that allow you to deploy your own Ubuntu based multi-node cloud foundry platform on Amazon EC2 in 10 minutes.
RESTing in the ALPS Mike Amundsen's Presentation from QCon London 2013CA API Management
Generic Hypermedia and Domain-Specific APIs: RESTing in the ALPS
Track: Building Web APIs: Opening & Linking your Data / Time: Thursday 15:40 - 16:30 / Location: Fleming Room
Hypermedia API is the new catch-phrase, but what is a Hypermedia API? Does this trend lead us toward a debilitating explosion of media types? Can we really create successful hypermedia APIs or is this just the latest hype?
Recently a number of new media types that offer hypermedia support have come into use on the Web including HAL, Collection+JSON, Siren, and more. However, these new designs are not designed to communicate application-specific information (e.g. accounting, microblogging, etc.) in a standard way. Is there a way to resolve this problem?
Drawing on the experience of Dublin Core, Microformats, Activity Streams, and other similar approaches, this talk describes the ALPS (Application-Level Profile Semantics) standard; a way to define the data and workflow details for a Web application and apply these details consistently regardless of the media type in use. Working examples in the talk also show how this standardized definition can make designing, implementing, documenting, and maintaining Web APIs easier and more consistent across multiple media types.
Introduction to the Netflix Open Source Software project, explains why Netflix is doing this, how all the parts fit together and what is planned to come next. Presented at the inaugural NetflixOSS Meetup February 6th 2013 at Netflix headquarters in Los Gatos.
Quantum is an OpenStack project to provide network connectivity as a service between interface devices. It will enable cloud tenants to create rich networking topologies, build advanced network services and innovative network capabilities.
Latest version of the Netflix Cloud Architecture story was given at Gluecon May 23rd 2012. Gluecon rocks, and lots of Van Halen references were added for the occasion. There tradeoff between developer driven high functionality AWS based PaaS, and operations driven low cost portable PaaS is discussed. The three sections cover the developer view, the operator view and the builder view.
Netflix Cloud Platform Building BlocksSudhir Tonse
Architectural Building Blocks of the Netflix Cloud Platform and lessons learned while implementing the same.
Commandments of Web Scale Cloud Deployments
SV Forum Platform Architecture SIG - Netflix Open Source PlatformAdrian Cockcroft
Architecture overview of Netflix Cloud Architecture with a focus on the Open Source components that Netflix has put and is planning to release on http://netflix.github.com
This is the final presentation of the MOINC Server component of the MOINC (Mora Open Infrastructure for Network Computing) project done as the Final Year Project under the BSc degree programme, MOINC is made up of the three components- MOINC Server, MOINc Server Manager and MOINC Agent.
Slides presented to OpenStack developer summit during the "Quantum Overview" session (note: these are not the slides presented during the conference, these slides are more technical, and less polished)
RESTing in the ALPS Mike Amundsen's Presentation from QCon London 2013CA API Management
Generic Hypermedia and Domain-Specific APIs: RESTing in the ALPS
Track: Building Web APIs: Opening & Linking your Data / Time: Thursday 15:40 - 16:30 / Location: Fleming Room
Hypermedia API is the new catch-phrase, but what is a Hypermedia API? Does this trend lead us toward a debilitating explosion of media types? Can we really create successful hypermedia APIs or is this just the latest hype?
Recently a number of new media types that offer hypermedia support have come into use on the Web including HAL, Collection+JSON, Siren, and more. However, these new designs are not designed to communicate application-specific information (e.g. accounting, microblogging, etc.) in a standard way. Is there a way to resolve this problem?
Drawing on the experience of Dublin Core, Microformats, Activity Streams, and other similar approaches, this talk describes the ALPS (Application-Level Profile Semantics) standard; a way to define the data and workflow details for a Web application and apply these details consistently regardless of the media type in use. Working examples in the talk also show how this standardized definition can make designing, implementing, documenting, and maintaining Web APIs easier and more consistent across multiple media types.
Introduction to the Netflix Open Source Software project, explains why Netflix is doing this, how all the parts fit together and what is planned to come next. Presented at the inaugural NetflixOSS Meetup February 6th 2013 at Netflix headquarters in Los Gatos.
Quantum is an OpenStack project to provide network connectivity as a service between interface devices. It will enable cloud tenants to create rich networking topologies, build advanced network services and innovative network capabilities.
Latest version of the Netflix Cloud Architecture story was given at Gluecon May 23rd 2012. Gluecon rocks, and lots of Van Halen references were added for the occasion. There tradeoff between developer driven high functionality AWS based PaaS, and operations driven low cost portable PaaS is discussed. The three sections cover the developer view, the operator view and the builder view.
Netflix Cloud Platform Building BlocksSudhir Tonse
Architectural Building Blocks of the Netflix Cloud Platform and lessons learned while implementing the same.
Commandments of Web Scale Cloud Deployments
SV Forum Platform Architecture SIG - Netflix Open Source PlatformAdrian Cockcroft
Architecture overview of Netflix Cloud Architecture with a focus on the Open Source components that Netflix has put and is planning to release on http://netflix.github.com
This is the final presentation of the MOINC Server component of the MOINC (Mora Open Infrastructure for Network Computing) project done as the Final Year Project under the BSc degree programme, MOINC is made up of the three components- MOINC Server, MOINc Server Manager and MOINC Agent.
Slides presented to OpenStack developer summit during the "Quantum Overview" session (note: these are not the slides presented during the conference, these slides are more technical, and less polished)
Distributed Design and Architecture of Cloud FoundryDerek Collison
In this session we will dig deep into Cloud Foundry's core architecture and design principles. We will discuss the challenges around scaling and operating a large scale service as we combined the PaaS and traditional IaaS layers, and how we achieve multiple updates per week to the system with no perceived downtime. Allowing user to download a single virtual machine that is a complete replica of the service presented some challenges as well, and we will discuss our approach to offering up the downloadable private cloud.
This presentation from our Hong Kong User Group held on March 7, 2019 went over how the event driven transformation is driving the Solace Event Mesh vision.
To really take advantage of cloud, software must be optimized to run in the cloud. This presentation explores what it means to be "Cloud Native" and looks at a real open source project that has built a complete Cloud Native platform. Cloud is not just a better way to run existing software, there are core enhancements that need to be made to software to enable it to run really effectively in a cloud environment. Often the first thought is about massive scalability, but actually there are other key enablers: multi-tenancy, metering, dynamic distribution, self-service and incremental deployment and testability. This presentation explores these enablers and looks at how an Open Source project (Carbon) built on Apache technology was re-built to be cloud native. The presentation will cover not just the concepts but dive into the practical issues in making a cloud native system and also explore which Apache technologies can help along the way.
Microservices with Spring Cloud and Netflix OSSDenis Danov
The presentation will introduce the audience to microservice architecture and how it is different from a monolithic one. It will focus on the different components that are necessary for a microservice architecture such as discovery service, configuration service, api gateway and others. For each one of the components will be highlighted why they are important for this type of architecture and how to implement them with Spring Boot and Netflix stack.
IT Geek Week 2016 - Introduction To Cloud ComputingHaim Ateya
An introduction to cloud computing which provides users information about different cloud models, types, how it all fit in in today's world and lay out the ecosystem. in addition, I provide some additional information on cloud technologies like storage, network and compute.
Amazon EKS 그리고 Service Mesh
Kubernetes는 컨테이너 서비스를 도입하는 기업들에게 가장 있기있는 Orchestration 플랫폼입니다. 이 세션에서는 아마존에서 6월 정식 출시한 managed Kubenetes서비스인 EKS를 소개해드리며, 오픈소스 버전과의 차이점 및 장점 등에 대해 설명하고, 진보한 마이크로 서비스인 Service Mesh를 구현하는 Linkerd 소개 및 데모를 진행하고자 합니다.
Operating Kafka on AutoPilot mode @ DBS Bank (Arpit Dubey, DBS Bank) Kafka Su...confluent
Kafka is among the few cool technologies that play a pivotal role in the digital journey of DBS to become one of the best bank in the world.
Kafka is the foundation for our vision of application modernisation by:
- making our systems event-driven
- moving batch workloads to real-time
- serving various financial industry use-cases that warrants proactive actions i.e Fraud detection, Anomaly and unusual behaviour detections.
To realize our Digital vision and to keep up with the pace of this transformation, we decided to run Kafka ""as-a-self-managed-service"" at large scale. This requires minimising reliance on human operators/ engineers and have intelligent apps make all important operation related decisions.
In this session, I would like to deep-dive into these intelligent apps that not only helped us maintain 100% availability but also provides self-service experience and a truly democratised Kafka ecosystem for our community.
Some of these apps include :
1. Self-service on-boarding and stream discovery built by esp. leveraging Kafka admin API
2. AI Ops - using machine learning for predicting resource utilisation and early anomaly detection
3. Automated Cluster scaling, deployment and maintenance
4. Self-healing services
5. Intelligent Chaos engineering - to make apps ready for production
6. Black box Kafka monitoring
7. Load simulator for performance testing - to bring production like experience in development environments
8. Automatic tiering and streams archival - to meet several regulatory compliance and to make brokers lightweight
DevOps and Testing slides at DASA ConnectKari Kakkonen
My and Rik Marselis slides at 30.5.2024 DASA Connect conference. We discuss about what is testing, then what is agile testing and finally what is Testing in DevOps. Finally we had lovely workshop with the participants trying to find out different ways to think about quality and testing in different parts of the DevOps infinity loop.
Accelerate your Kubernetes clusters with Varnish CachingThijs Feryn
A presentation about the usage and availability of Varnish on Kubernetes. This talk explores the capabilities of Varnish caching and shows how to use the Varnish Helm chart to deploy it to Kubernetes.
This presentation was delivered at K8SUG Singapore. See https://feryn.eu/presentations/accelerate-your-kubernetes-clusters-with-varnish-caching-k8sug-singapore-28-2024 for more details.
Essentials of Automations: Optimizing FME Workflows with ParametersSafe Software
Are you looking to streamline your workflows and boost your projects’ efficiency? Do you find yourself searching for ways to add flexibility and control over your FME workflows? If so, you’re in the right place.
Join us for an insightful dive into the world of FME parameters, a critical element in optimizing workflow efficiency. This webinar marks the beginning of our three-part “Essentials of Automation” series. This first webinar is designed to equip you with the knowledge and skills to utilize parameters effectively: enhancing the flexibility, maintainability, and user control of your FME projects.
Here’s what you’ll gain:
- Essentials of FME Parameters: Understand the pivotal role of parameters, including Reader/Writer, Transformer, User, and FME Flow categories. Discover how they are the key to unlocking automation and optimization within your workflows.
- Practical Applications in FME Form: Delve into key user parameter types including choice, connections, and file URLs. Allow users to control how a workflow runs, making your workflows more reusable. Learn to import values and deliver the best user experience for your workflows while enhancing accuracy.
- Optimization Strategies in FME Flow: Explore the creation and strategic deployment of parameters in FME Flow, including the use of deployment and geometry parameters, to maximize workflow efficiency.
- Pro Tips for Success: Gain insights on parameterizing connections and leveraging new features like Conditional Visibility for clarity and simplicity.
We’ll wrap up with a glimpse into future webinars, followed by a Q&A session to address your specific questions surrounding this topic.
Don’t miss this opportunity to elevate your FME expertise and drive your projects to new heights of efficiency.
Key Trends Shaping the Future of Infrastructure.pdfCheryl Hung
Keynote at DIGIT West Expo, Glasgow on 29 May 2024.
Cheryl Hung, ochery.com
Sr Director, Infrastructure Ecosystem, Arm.
The key trends across hardware, cloud and open-source; exploring how these areas are likely to mature and develop over the short and long-term, and then considering how organisations can position themselves to adapt and thrive.
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...UiPathCommunity
💥 Speed, accuracy, and scaling – discover the superpowers of GenAI in action with UiPath Document Understanding and Communications Mining™:
See how to accelerate model training and optimize model performance with active learning
Learn about the latest enhancements to out-of-the-box document processing – with little to no training required
Get an exclusive demo of the new family of UiPath LLMs – GenAI models specialized for processing different types of documents and messages
This is a hands-on session specifically designed for automation developers and AI enthusiasts seeking to enhance their knowledge in leveraging the latest intelligent document processing capabilities offered by UiPath.
Speakers:
👨🏫 Andras Palfi, Senior Product Manager, UiPath
👩🏫 Lenka Dulovicova, Product Program Manager, UiPath
Securing your Kubernetes cluster_ a step-by-step guide to success !KatiaHIMEUR1
Today, after several years of existence, an extremely active community and an ultra-dynamic ecosystem, Kubernetes has established itself as the de facto standard in container orchestration. Thanks to a wide range of managed services, it has never been so easy to set up a ready-to-use Kubernetes cluster.
However, this ease of use means that the subject of security in Kubernetes is often left for later, or even neglected. This exposes companies to significant risks.
In this talk, I'll show you step-by-step how to secure your Kubernetes cluster for greater peace of mind and reliability.
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf91mobiles
91mobiles recently conducted a Smart TV Buyer Insights Survey in which we asked over 3,000 respondents about the TV they own, aspects they look at on a new TV, and their TV buying preferences.
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024Tobias Schneck
As AI technology is pushing into IT I was wondering myself, as an “infrastructure container kubernetes guy”, how get this fancy AI technology get managed from an infrastructure operational view? Is it possible to apply our lovely cloud native principals as well? What benefit’s both technologies could bring to each other?
Let me take this questions and provide you a short journey through existing deployment models and use cases for AI software. On practical examples, we discuss what cloud/on-premise strategy we may need for applying it to our own infrastructure to get it to work from an enterprise perspective. I want to give an overview about infrastructure requirements and technologies, what could be beneficial or limiting your AI use cases in an enterprise environment. An interactive Demo will give you some insides, what approaches I got already working for real.
Elevating Tactical DDD Patterns Through Object CalisthenicsDorra BARTAGUIZ
After immersing yourself in the blue book and its red counterpart, attending DDD-focused conferences, and applying tactical patterns, you're left with a crucial question: How do I ensure my design is effective? Tactical patterns within Domain-Driven Design (DDD) serve as guiding principles for creating clear and manageable domain models. However, achieving success with these patterns requires additional guidance. Interestingly, we've observed that a set of constraints initially designed for training purposes remarkably aligns with effective pattern implementation, offering a more ‘mechanical’ approach. Let's explore together how Object Calisthenics can elevate the design of your tactical DDD patterns, offering concrete help for those venturing into DDD for the first time!
Neuro-symbolic is not enough, we need neuro-*semantic*Frank van Harmelen
Neuro-symbolic (NeSy) AI is on the rise. However, simply machine learning on just any symbolic structure is not sufficient to really harvest the gains of NeSy. These will only be gained when the symbolic structures have an actual semantics. I give an operational definition of semantics as “predictable inference”.
All of this illustrated with link prediction over knowledge graphs, but the argument is general.
UiPath Test Automation using UiPath Test Suite series, part 3DianaGray10
Welcome to UiPath Test Automation using UiPath Test Suite series part 3. In this session, we will cover desktop automation along with UI automation.
Topics covered:
UI automation Introduction,
UI automation Sample
Desktop automation flow
Pradeep Chinnala, Senior Consultant Automation Developer @WonderBotz and UiPath MVP
Deepak Rai, Automation Practice Lead, Boundaryless Group and UiPath MVP
Connector Corner: Automate dynamic content and events by pushing a buttonDianaGray10
Here is something new! In our next Connector Corner webinar, we will demonstrate how you can use a single workflow to:
Create a campaign using Mailchimp with merge tags/fields
Send an interactive Slack channel message (using buttons)
Have the message received by managers and peers along with a test email for review
But there’s more:
In a second workflow supporting the same use case, you’ll see:
Your campaign sent to target colleagues for approval
If the “Approve” button is clicked, a Jira/Zendesk ticket is created for the marketing design team
But—if the “Reject” button is pushed, colleagues will be alerted via Slack message
Join us to learn more about this new, human-in-the-loop capability, brought to you by Integration Service connectors.
And...
Speakers:
Akshay Agnihotri, Product Manager
Charlie Greenberg, Host
10. The Open PaaS
.js
Ap
ce
p
Private
lic
rfa
Clouds
at
Data Services
te
io
In
n
Se
er
r
vid
…
vic
Public
o
e
Clouds
Pr
Msg Services
In
te
ud
rfa
o
Cl
.COM
ce
Micro
Other Services
Clouds
11. What was our Goal?
• Raise the unit of currency to the be
the application and its associated
services, not the infrastructure
• Best of breed delivery platform for all
modern applications and frameworks
• Favor Choice and Openness
• Simplicity and Speed
12. How was it Built?
• Kernel and Orchestrator Shells
• Layered on top of IaaS
• Kernel
• Core PaaS System
• Orchestrator
• Creation, management and
orchestration of the infrastructure
14. Basic Premises
• Assume failure
• Optimize for MTTR, not MTBF
• MTTR = Mean Time To Recovery
• MTBF = Mean Time Between Failures
• Fail Fast
• Self Healing
• Horizontally Scalable Components
• Distributed state, No single POF
• Should be as simple as possible
16. Basic Design
• All components loosely coupled
• Few “Classes”, many “Instances”
• Messaging as foundation
• Addressing and Component Discovery
• Command and Control
• JSON payloads
• HTTP or File/Blob for data transport
17. Kernel Components
• All dynamically discoverable
• Launch and scale in any order
• Can come and go as needed
• Monitor via HTTP and JSON
• Location independent
19. Logical View
Browser
VMC client STS plugin
(user app access)
Routers
CloudControllers App App
HealthManager
Services DEA Pool
Messaging
20. Messaging
• Addressing and Discovery
• No static IPs or DNS lookups req’d
• Just Layer 4
• Command and Control
• Central communication system
• Dial tone, fire and forget
• Protects *itself* at all costs
• Idempotent semantics
21. Router
• Handles all HTTP traffic
• Maintains distributed routing state
• Routes URLs to applications
• Distributes load among instances
• Realtime distributed updates to
routing tables from DEAs
22. CloudController
• Handles all state transitions
• Deals with users, apps, and services
• Packages and Stages applications
• Binds Services to Applications
• Presents external REST API
23. HealthManager
• Monitors the state
• Initial value with realtime delta
updates to intended vs real
• Determines drift
• Complains to the CloudControllers
when something is not correct
• No power to change state itself
24. DEA
(Droplet Execution Agent)
• Responsible for running all applications
• Monitors all applications
• CPU, Mem, IO, Threads, Disk, FDs, etc
• All apps look same to DEA, start and stop
• “concept” of ability and desire to run an application
• runtimes, options, cluster avoidance, memory/cpu
• Alerts on any change in state of applications
• Provides secure/constrained OS runtime
• Hypervisor, Unix File and User, Linux Containers
• Single or Multi-Tenant
25. Services
• One of the extensibility planes
• First class citizen
• Bound to applications
• Can be shared
• Services API to discover, list, and provision
• Direct access to service after provisioned
• Easy way to bind any service to an app
28. Pushing an App
• Client (VMC/STS) pushes meta-data to CC
• Client optionally pushes resource
signatures (diff analysis, sys wide)
• Client pushes app resources to CC
• CC puts app together
• CC stages app asynchronously
• CC binds and stages services
• Droplet ready
30. Running an App
• CC asks DEAs for “help”
• First DEA back wins! Simple
• CC sends start request to selected DEA
• DEA pushes the “green” button
• DEA waits and monitors pid and ephemeral port
for app to bind
• When app is healthy, sends “register” message
• Register message is seen by HM and Routers
• Routers bind URL to host:port
32. DEAs answer?
• DEAs first determine YES or NO
• correct runtime, options, memory, etc
• Then calculate a Delay Taint
• SHA hash of app instance
• memory
• cpu
• This taint allows balancing and selection
33. Scale up & down?
• Exact steps as running the app the
first time
• SHA1 taint helps avoid clustering
• memory/cpu taint helps distribute as
evenly as possible
• Nothing pre-computed or strict
34. Crashes?
• If your app stops and we did not tell it
to, that is a crash
• Crashed apps are immediately detected
by DEA and message sent
• Routers disconnect route
• HM will signal a CC that something is
wrong
• CC will issue run sequence again
36. Access to my App?
• All routers understand where all
instances of your application are running
• Will randomly pick backend, not
semantically aware.
• Will remove routes that are stale or
unhealthy
• Session stickiness and replication
available, but best to avoid if possible