Introduction to Cloudify for OpenStack users

•Download as PPTX, PDF•

4 likes•3,185 views

Introduction for Cloudify as a deployment and management framework for OpenStack covering also Tosca, Integration with Heat, Docker, Chef

Technology

Introduction to Cloudify 3.0
Adding New Intelligence to Cloud
Copyright © GigaSpaces 2014. All rights reserved.
Orchestration

GigaSpaces OpenStack Activities
Cloudify bridges between OpenStack and other clouds
Leading the OpenStack
community in Israel
Leading OpenSource
project to simplify the
deployment and
management of
applications on
OpenStack
Contributing the
TOSCA specification
within the OpenStack
Heat project

Mapping the Cloud Space
Higher-level Services Do it Yourself
AWS Elastic
Beanstalk
AWS
OpsWorks
AWS
CloudFormation
Amazon EC2 +
CloudWatch
OpenShift/
CloudFoundry
**Solum**
Nova, Cinder,
Neutron, etc.
Convenience Control
Cloudify is the OpsWorks
equivalent for any environment.

Motivation Behind 3.0
• OpenStack Native
• Support for VMware and other
clouds
• Standard / TOSCA
• Suited for NFV
• Single Manager Scalability
• Network Orchestration
• Bring together BI, Monitoring
and Orchestration

“Intelligent Orchestration”
Send
Metrics
Real Time Analytics Cloud Infrastructure
Execute
Policy
Feedback
Real Time
Analytics
Correlate
with
Historical
Events
Deploy
Fail-over
Scale
Intelligent Orchestration
11111111111
000000000
11111111111
000000000
11111111111
000000000
Historical Data

Network & Application Orchestration
Apache Server DB Server
NodeJS
NodeCeller
• App Network
• App Subnet
• App Port
• Security Group
• Apache Floating IP
• Router Gateway
• Data Network
• Data Subnet
• Data Port
• Security Group
Router
Monitoring, Logging CI
MongoDB

What Do We See Here?
Host
Middleware
App module
connection

TOSCA –
The Glue for
Putting all This
Together
Application
Topologies
Workflows
Policies

TOSCA (Like) Blueprint
Host
Middleware
module: DB
Use Bash for
configuration and
life cycle
management

TOSCA (Like) Blueprint
Middleware module:
node JS Server
App module: node JS
connection

Plugin Architecture
14
Cloudify
Manager
Cloudify
Agent
Chef,Docker
,.. Endpoint
NodeJS
Container
MongoD
Container
Blueprint
Agent PlugIn

Chef Integration
Where to find the
plugin type definition
Using the Chef types
for app_module
Passing the specific
properties for the Chef
type

Docker Integration
Using the Docker type
for db_server
Passing the Docker file
inline

Deploy a Heat stack
Template Heat
VM VM
VM

Discovery of Heat stack
Cloudify
Discoverer
Cloudify
Blueprint
VM VM
VM

Augmenting The Blueprint
Cloudify
Discoverer
Infra
Blueprint
App
Blueprint
complete
Blueprint

Learn More
getcloudify.org
Documentation
Architecture
Community Forum
Blog

DevOps processes (such as continuous deployment and delivery) often involve writing many custom scripts that are triggered by the build system. With that approach, it is relatively hard to trace the deployment process and troubleshoot when something goes wrong. Additionally, custom scripts are often not written in an easily understood manner. In this session we will walk through specific DevOps workflows (such as install, update, etc) using Riemann as the framework in subject and see the steps required to automate those processes. We will also discuss how Cloudify uses Riemann to provide simple execution and monitoring of those workflow processes. We will share how one customer, PaddyPower, was able to leverage Cloudify to transition their traditional IT into a DevOps environment, bridging the gap betwe

Real World Application Orchestration Made Easy on VMware vCloud Air, vSphere ...

Nati Shalom

Looking for application orchestration in a hybrid or multi-cloud environment? You’ve got to hear about TOSCA orchestration. TOSCA (Topology and Orchestration Specification for Cloud Applications), brought to you by the same people who brought us XML, enables you to seamlessly migrate your workloads across environments or build a hybrid deployment that runs simultaneously across the VMware cloud offering. Join our Cloud Online Meetup to learn how Cloudify’s TOSCA-compliant orchestration can be your common management interface across the VMware cloud offering, OpenStack and heterogeneous cloud environments. Speakers: Nati Shalom, Founder and CTO at GigaSpaces, is a thought leader in Cloud Computing and Big Data Technologies. Shalom was recently recognized as a Top Cloud Computing Blogger for CIOs by The CIO Magazine and his blog is listed as an excellent blog by YCombinator. Shalom is the founder and also one of leaders of OpenStack Israel group, and is a frequent presenter at industry conferences. Paco Gomez, Senior Solution Architect at VMware vCloud Air. Paco evaluates and integrates strategic solutions that help vCloud Air clients benefit from VMware's hybrid cloud and application services. Paco is a seasoned technologist, having extensive experience in diverse fields including mainframes, distributed systems, enterprise development, cloud computing, mobile, assistive technology, electrical engineering and embedded systems. Across his career, Paco has held positions in consulting, sales engineering

Deployment Automation on OpenStack with TOSCA and Cloudify

Cloudify Community

TOSCA (Topology and Orchestration Specification for Cloud Applications) is an emerging standard for modeling complete application stacks and automating their deployment and management. It’s been discussed in the context of OpenStack for quite some time, mostly around Heat. In this session we’ll discuss what TOSCA is all about, why it makes sense in the context of OpenStack, and how we can take it farther up the stack to handle complete applications, both during and after deployment, on top of OpenStack.

OpenStack DevOps Workflows with TOSCA

Cloud Native Day Tel Aviv

The Cloud offers real opportunities for full DevOps culture with everything automated and silo free. To make these opportunities come true, one needs to go beyond a simple siloed approach that assumes the IaaS setup is separate from the middleware setup, and altogether different than application deployment. There is a need for automation of all processes, across layers using a customized workflow approach. In this talk we will suggest modeling of such workflows and architecture to execute them.

Intro to Cloudify

Ron Zavner

Real World Example of Orchestrating Docker, Node JS, NFV on OpenStack

Nati Shalom

The buzzwords Neutron, Heat, and TOSCA are spoken about quite often when it comes to the OpenStack - and many of us are still trying to make sense of the terminology and its place in the OpenStack world. Where OpenStack Neutron provides APIs for creating network elements, OpenStack Heat provides an orchestration engine for automating the setup and configuration of OpenStack infrastructure, while TOSCA is a standard for templating and defining application topology and policies (that form the basis for Heat). In this context, it really makes sense to put these all together to achieve application and network automation for OpenStack on steroids. In this session we will learn how we can use the robust combination of Heat and TOSCA to configure and control resources on Nova and Neutron in order to automate the network configuration as part of the application deployment. The session will include a demo and code examples that show how you can configure virtual networks, attach public IPs, set up security groups, set up load balancing and automatically scale up/down and more. You will leave this session understanding where Neutron meets Heat and TOSCA. This talk was delivered as part of OpenStack Paris summit - 2014 - http://openstacksummitnovember2014paris.sched.org/event/2b85b682ccaf3a5961e463b61e2403f8#.VFeuG_TF8mc

Application Centric DevOps

Nati Shalom

Running OpenStack in Production

Nati Shalom

It has long been debated whether OpenStack is production ready. In this session you will learn how a major bank has gone to production with more than 5000 VMs that delivered the results of a 40% decrease in cost, reduced deployment time to hours not weeks, 56 new technologies introduced, 7 new platforms launched - all in under a year. Learn how their platform built on Rackspace and RHEL, coupled with best of breed open source tooling - SaltStack, Jenkins, Cloudify, and Nexus are the enablers for production-grade OpenStack. http://sched.co/7fH1

Kirin User Story: Migrating Mission Critical Applications to OpenStack Privat...

Motoki Kakinuma

NTT Data is an IT service company. Kirin is one of the largest beverages companies in Japan. In this presentation, we will present the user story of migrating all applications from creaky infrastructure to OpenStack private cloud including actual challenges, know-hows and future prospects. The key concept of this project is: * Mission Critical: Migrate all Kirin enterprise applications to OpenStack private cloud. * Think Big, Start Small: Start from small number of apps, and expand rapidly. * Agility and elasticity: Adopt a PaaS-like automation approach, targeting 50% less development cost and 40% less operational cost. In order to achieve all items above, we have decided to use OpenStack IaaS, ICO, which is an automation product by IBM, serverspec for testing, and Hinemos for monitoring management. Starting from Aug 2014, the project expects 100 VM / 100 TB storage as the first-stage migration by end of 2015. We're planning to migrate 500 VM / 300 TB by end of 2016 and 2000 VM / 1 PB finally.

Protecting Yourself from the Container Shakeout

Mirantis

Keynote by Boris Renski, Co-Founder and CMO of Mirantis, and Lachlan Evenson, Team Lead of Cloud Platform Engineering at Lithium Technologies, at OpenStack Silicon Valley 2015. The Docker-fueled container craze is much less of a threat to VMs or OpenStack than it is to PaaS vendors. The story of “do it the way Google does it” is proving just as tough to monetize with enterprises as commodity cloud was. Boris will talk about OpenStack as a “safe harbor” from the coming container shakeout, leveraging the project’s maturity as a place to try various container strategies until the winner emerges. Lachlan Evenson of Lithium will join Boris to share how Lithium deployed Kubernetes on OpenStack.

Introduction to OpenStack

Edureka!

Template Languages for OpenStack - Heat and TOSCACloud Native Day Tel Aviv

Ibm cloud nativenetflixossfinalaspyker

1 cloud, 2 clouds, 3 clouds, tons...

Nati Shalom

Monitor Traefik with Prometheus

Brian Christner

OpenStack and CloudForms Do's and Dont's

Frederik Bijlsma

Considerations for Your Next Cloud Project – CloudForms & OpenStack Do’s and Don’ts In this Session we will discuss Organizational and Operational Considerations on how to move into Infrastructure as a Service Environments and showcase how Enterprises today address different aspects of Cloud Management. Focus of this session is on Design and Operational Aspects of running an Open Hybrid Cloud. The session will also touch on Process and Organizational Aspects.

OpenStack Introduction

Roozbeh Shafiee

CloudStack Meetup - Introduction

Madan Ganesh Velayudham

Infrastructure as Code

Robert Greiner

Today, the development and operations landscape has shifted to a more collaborative model merging the two (DevOps). Developers need to know much more about the operational components of their software - especially around network programming, services development, and continuous deployment. Likewise, the developer's IT counterpart needs to know much more about development - especially around infrastructure automation (Chef/Puppet), automated testing, and continuous deployment.

Pivotal CF on AWS

Lawrence Crowther

Avoiding cloud lock-inSebastien Goasguen

Open Source Docs: The Good, The Bad, and the WTF?!

Lana Brindley

Open source documentation is generally awful, often frightening, and sometimes it’s just outright weird. In this discussion, I will show you examples from the entire spectrum of open source documentation, in an effort to try and help you avoid some of the worst mistakes made by others before you. We will discuss why documentation is important for open source projects, and how to go about getting it written, and written well, without making too much of a fool out of yourself.

Giga spaces cloudify road map-3 (citi)Nati Shalom

HPE & Cloud Foundry @ CF Summit Berlin 2015

Omri Gazitt

AWS Webcast - Build Agile Applications in AWS Cloud for Government

Amazon Web Services

AWS Webcast - Build Agile Applications in AWS Cloud for Government

Amazon Web Services

What's hot

Introduction to cloudify - workshop 2013

Barak Merimovich

Application and Network Orchestration using Heat & Tosca

Nati Shalom

Application Centric DevOps

Nati Shalom

Running OpenStack in Production

Nati Shalom

Kirin User Story: Migrating Mission Critical Applications to OpenStack Privat...

Motoki Kakinuma

Protecting Yourself from the Container Shakeout

Mirantis

Introduction to OpenStack

Edureka!

Template Languages for OpenStack - Heat and TOSCACloud Native Day Tel Aviv

Ibm cloud nativenetflixossfinalaspyker

1 cloud, 2 clouds, 3 clouds, tons...

Nati Shalom

Monitor Traefik with Prometheus

Brian Christner

OpenStack and CloudForms Do's and Dont's

Frederik Bijlsma

OpenStack Introduction

Roozbeh Shafiee

CloudStack Meetup - Introduction

Madan Ganesh Velayudham

Infrastructure as Code

Robert Greiner

Pivotal CF on AWS

Lawrence Crowther

Avoiding cloud lock-inSebastien Goasguen

Open Source Docs: The Good, The Bad, and the WTF?!

Lana Brindley

Giga spaces cloudify road map-3 (citi)Nati Shalom

HPE & Cloud Foundry @ CF Summit Berlin 2015

Omri Gazitt

What's hot (20)

Introduction to cloudify - workshop 2013

Application and Network Orchestration using Heat & Tosca

Application Centric DevOps

Running OpenStack in Production

Kirin User Story: Migrating Mission Critical Applications to OpenStack Privat...

Protecting Yourself from the Container Shakeout

Introduction to OpenStack

Template Languages for OpenStack - Heat and TOSCA

Ibm cloud nativenetflixossfinal

1 cloud, 2 clouds, 3 clouds, tons...

Monitor Traefik with Prometheus

OpenStack and CloudForms Do's and Dont's

OpenStack Introduction

CloudStack Meetup - Introduction

Infrastructure as Code

Pivotal CF on AWS

Avoiding cloud lock-in

Open Source Docs: The Good, The Bad, and the WTF?!

Giga spaces cloudify road map-3 (citi)

HPE & Cloud Foundry @ CF Summit Berlin 2015

Similar to Introduction to Cloudify for OpenStack users

AWS Webcast - Build Agile Applications in AWS Cloud for Government

Amazon Web Services

AWS Webcast - Build Agile Applications in AWS Cloud for Government

Amazon Web Services

56k.cloud training

Brian Christner

Making Openstack Really Easy - Why Build Open Source When You Can Buy? Danny ...

OpenStack

Making Openstack Really Easy - Why Build Open Source When You Can Buy? Audience: Beginner Topic: Enterprise IT Strategies Abstract: Delivering a a OpenStack platform is no small feat. Dell|EMC is now among a very small minority of vendors that have ventured into this space with a simplified IaaS model based on Open Source technologies to enable the building of next generation application. Speaker Bio: Danny Elmarji, DellEMC Danny Elmarji is a passionate technology advocate across Dell|EMC Australia and New Zealand. Danny joined EMC in 2005 and is responsible for running the Dell|EMC engineering community, focused on the both our Core Technology and Emerging Technology Divisions. From his original background in application development in Java and C++, Danny has further built extensive technical knowledge around cloud computing, third platform applications, DevOps and data science. Over the past 15 years he has received numerous industry certifications across virtualisation and Infrastructure solutions. Danny is originally from Canada where he completed his bachelor degree in Computer Science and Computing. OpenStack Australia Day Government - Canberra 2016 https://events.aptira.com/openstack-australia-day-canberra-2016/

2020-02-10 Java on Azure Solution Briefing

Ed Burns

DCSF 19 Developing Apps with Containers, Functions and Cloud Services

Docker, Inc.

Cloud native applications are composed of containers, serverless functions and managed cloud services. What is the best set of tools on your desktop to provide a rapid, iterative development experience and package applications using these three components? This hand-on talk will explain how you can complement Docker Desktop, with it’s local Docker engine and Kubernetes cluster, with open source tools such as the Virtual Kubelet, Open Service Broker, the Gloo hybrid app gateway, Draft, and others, to build the most productive development inner-loop for these type of applications. It will also cover how you can use the Cloud Native Application Bundle (CNAB) format and it’s implementation in the Docker app experimental tool to package your application and manage it with container supply chain tooling such as Docker Hub.

Dockercon 2019 Developing Apps with Containers, Functions and Cloud Services

Patrick Chanezon

Cloud Computing Open Stack Compute Node

Palak Sood

Cloud Computing OpenStack Compute Node

Namita Arora

Application Centric Microservices Architecture

Ken Owens

Cloud level scalability - Nuxeo Tour 2014

Nuxeo

OpenStack and Cloud Foundry - Pair the leading open source IaaS and PaaS

Daniel Krook

OpenStack is the leading open source Infrastructure-as-a-Service, and Cloud Foundry has become the leading open source Platform-as-a-Service. Deploying them together is a natural fit for your next generation systems of engagement. This special joint meetup of the OpenStack NY and NYC Cloud Foundry communities will give both audiences an introduction to these popular open source IaaS and PaaS projects. The presentation will describe the compelling advantages of each technology, and then explain how they can be integrated, optimized, and scaled to provide a complete cloud application hosting solution.

Introduction to Kubernetes

Vishal Biyani

Transitioning to the Next Generation Hybrid Cloud Operating Model- AWS Summit...

Amazon Web Services

AWS provides many services to assist customers with their journey to the cloud. Hybrid solutions offer customers a way to continue leveraging existing investments on-premises, while expanding their footprint into the public cloud. This session covers the different technologies available to support hybrid architectures on AWS. We discuss common patterns and anti-patterns for solving enterprise workloads across a hybrid environment.

DEVNET-1008 Private or Public or Hybrid ? Which Cloud Should I choose?

Cisco DevNet

With the advent of cloud computing, the choices for delivery and consumption of applications have drastically increased. With choices comes complexity. Enterprises often find themselves struggling to decide if public, private or hybrid cloud is the best choice for their needs. This session will talk about the pros and cons of public, private and hybrid cloud. It will also describe how Cisco Intercloud Fabric (ICF) can provide the best of both worlds.

WIN401_Migrating Microsoft Applications to AWS

Amazon Web Services

In this session, we explore different approaches to migrating Microsoft applications to AWS. We walk through important considerations when planning a migration, and we show how to develop and implement a migration plan to move applications from on-premises (or traditional hosting) to AWS. We use a case study format to dive deep into successfully planning an application migration. Participants work in teams to plan a SharePoint migration that integrates with an existing Active Directory.

Continuous Integration and Deployment Best Practices on AWS (ARC307) | AWS re...

Amazon Web Services

With AWS, companies now have the ability to develop and run their applications with speed and flexibility like never before. Working with an infrastructure that can be 100 percent API driven enables businesses to use lean methodologies and realize these benefits. This in turn leads to greater success for those who make use of these practices. In this session, we talk about some key concepts and design patterns for continuous deployment and continuous integration, two elements of lean development of applications and infrastructures.

Continuous Deployment @ AWS Re:Invent

John Schneider

DevOps and BigData Analytics

sbbabu

IBM Open Cloud Update XCITE Fall 2014

Christopher Ferris

Similar to Introduction to Cloudify for OpenStack users (20)

AWS Webcast - Build Agile Applications in AWS Cloud for Government

56k.cloud training

Making Openstack Really Easy - Why Build Open Source When You Can Buy? Danny ...

2020-02-10 Java on Azure Solution Briefing

DCSF 19 Developing Apps with Containers, Functions and Cloud Services

Dockercon 2019 Developing Apps with Containers, Functions and Cloud Services

Cloud Computing Open Stack Compute Node

Cloud Computing OpenStack Compute Node

Application Centric Microservices Architecture

Cloud level scalability - Nuxeo Tour 2014

OpenStack and Cloud Foundry - Pair the leading open source IaaS and PaaS

Introduction to Kubernetes

Transitioning to the Next Generation Hybrid Cloud Operating Model- AWS Summit...

DEVNET-1008 Private or Public or Hybrid ? Which Cloud Should I choose?

WIN401_Migrating Microsoft Applications to AWS

Continuous Integration and Deployment Best Practices on AWS (ARC307) | AWS re...

Continuous Deployment @ AWS Re:Invent

DevOps and BigData Analytics

IBM Open Cloud Update XCITE Fall 2014

More from Nati Shalom

Cloudify and terraform integration

Nati Shalom

Why NFV and Digital Transformation Projects Fail!

Nati Shalom

Cloudify and terraform integration

Nati Shalom

Open Stack Days israel Keynote 2017

Nati Shalom

What A No Compromises Hybrid Cloud Looks Like

Nati Shalom

Orchestration tool roundup kubernetes vs. docker vs. heat vs. terra form vs...

Nati Shalom

Video recording: https://www.youtube.com/watch?v=tGlIgUeoGz8 It’s no news that containers represent a portable unit of deployment, and OpenStack has proven an ideal environment for running container workloads. However, where it usually becomes more complex is that many times an application is often built out of multiple containers. What’s more, setting up a cluster of container images can be fairly cumbersome because you need to make one container aware of another and expose intimate details that are required for them to communicate which is not trivial especially if they’re not on the same host. These scenarios have instigated the demand for some kind of orchestrator. The list of container orchestrators is growing fairly fast. This session will compare the different orchestation projects out there - from Heat to Kubernetes to TOSCA - and help you choose the right tool for the job. Session link from teh summit: https://openstacksummitmay2015vancouver.sched.org/event/abd484e0dedcb9774edda1548ad47518#.VV5eh5NViko

Software Defined Operator

Nati Shalom

During the past few years we’ve seen how our entire data-center becomes software defined. This include the Compute, Storage, Network and also Configuration. This new data centre is the cloud. The missing piece in the puzzle: While this is pretty much old news there is one big thing that is missing in this puzzle and that is the operator itself. The operator is responsible for running processes such: * Installation of new apps * Upgrades and update of new features or patches * Performance tuning * Handling failure * Managing the capacity to meet the scaling demand. Most of those tasks today involves lots of human intervention. Users who realised that gap try to mitigate that by putting their own custom automation - usually that comes in a form of scripts on-top of the configuration management. Those custom scripts tend to grow fairly quickly to the point where they become unmanageable. This presentation will introduce how we can use an orchestrator to automate those tasks and by that create a software defined Operator.

Complex Analytics with NoSQL Data Store in Real Time

Nati Shalom

NOSQL are often limited in the type of queries that they can support due to the distributed nature of the data. In this session we would learn patterns on how we can overcome this limitation and combine multiple query semantics with NoSQL based engines. We will demonstrate specifically a combination of key/value, SQL like, Document model and Graph based queries as well as more advanced topic such as handling partial update and query through projection. We will also demonstrate how we can create a meshaup between those API's i.e. write fast through Key/Value API and execute complex queries on that same data through SQL query. - See more at: http://nosql2014.dataversity.net/sessionPop.cfm?confid=81&proposalid=6335#sthash.PNSZi5TJ.dpuf

When networks meets apps (open stack atlanta)

Nati Shalom

Recent advancements in OpenStack capabilities have made the cloud better tuned to enterprise needs by introducing much more flexible network designs and networking services, with the tradeoff of making the cloud more complex. In this session we will describe how we can leverage the power of the new networking advancement without exposing the complexity to the end user. We will present alternative approaches and their tradeoffs for automating the deployment of a typical n-tier enterprise application that include multi-tenant environment, separate network for admin and applications, cross region network, attach a floating IP, setup security groups etc. all through a combination of Heat, TOSCA, Chef, Puppet, and more.

Application Centric Approach to Devops

Nati Shalom

The experience of automating continuous delivery processes with Chef and Cloudify through an application-centric approach to DevOps, and how this model transformed PaddyPower's traditional IT into DevOps, keeping their Devs and their Ops happy. References: --------------- - Cloudify & Chef : http://www.cloudifysource.org/guide/2.7/integrations/chef_documentation - Blog Post: http://www.cloudifysource.org/2013/10/27/application_centric_approach_to_devops.html - Earlier Video Presentation : http://www.youtube.com/watch?v=YhDNKyP_s7U

Case Studies for moving apps to the cloud - DLD 2013Nati Shalom

Real-Time Big Data at In-Memory Speed, Using Storm

Nati Shalom

Storm, a popular framework from Twitter, is used for real-time event processing. The challenge presented is how to manage the state of your real-time data processing at all times. In addition, you need Storm to integrate with your batch processing system (such as Hadoop) in a consistent manner. This session will demonstrate how to integrate Storm with an in-memory database/grid, and explore various strategies for integrating the data grid with Hadoop and Cassandra, seamlessly. By achieving smooth integration with consistent management, you will be able to easily manage all the tiers of you Big Data stack in a consistent and effective way. - See more at: http://nosql2013.dataversity.net/sessionPop.cfm?confid=74&proposalid=5526#sthash.FWIdqRHh.dpuf

Disaster Recovery on Demand on the Cloud

Nati Shalom

Disaster recovery on demand on the cloudNati Shalom

Big Data on OpenStack

Nati Shalom

The massive computing and storage resources that are needed to support big data applications make cloud environments an ideal fit. In this session, you'll learn how to build your big data "database on-demand" using MongoDB, Cassandra, Solr, MySQL, or any other big data solution, as well as manage your big data application using a new open source framework called “Cloudify.” All this, on top of the OpenStack cloud.

Avoiding Cloud Outage

Nati Shalom

Building cross-region and cross could high availability into your app, a real life use case by Gigaspaces, Nati Shalom, Funder & CTO, Gigaspaces Achieving high levels of availability and disaster recovery in a cloud environment requires the implementation of patterns and practices that introduce redundancy through multi-zone, multi-region, and multi-cloud deployments. As we move towards implementing higher availability, we cannot escape the direct increase in the accidental complexity of the deployment architecture resulting from lack of cloud portability and deployment lifecycle automation. We present how high availability and disaster recovery were achieved in reality by using the Cloudify open source framework on top of AWS. This approach applies to not just AWS but also other public clouds and private cloud environments such as Eucalyptus. The resulting reference architecture provides portable PostgreSQL replication and disaster recovery as well as application tier scalability across zones, regions, and public/private clouds through a unified deployment workflow.

Dont call me cache april 17Nati Shalom

Big data (reversim)

Nati Shalom

Adopting Hadoop to manage your Big Data is an important step, but not the end-solution to your Big Data challenges. Here are some of the additional considerations you must face: Choosing the right cloud for the job: The massive computing and storage resources that are needed to support Big Data applications make cloud environments an ideal fit, and more than ever, there is a growing number of choices of cloud infrastructure types and providers. Given the diverse options, and the dynamic environments involved, it becomes ever more important to maintain the flexibility for all your IT needs. Big Data is a complex beast: It involves many and different moving parts, in large clusters, and is continually growing and evolving. Managing such an environment manually is not a viable option. The question is, how can you achieve automation of all this complexity? The world beyond Hadoop: Big Data is not just Hadoop – there is a whole rapidly growing ecosystem to contend with, including NoSQL, data processing, analytics tools… As well as your own application services. How can you manage deployment, configuration, scaling and failover of all the different pieces, in a consistent way? In this session, you'll learn how to deploy and manage your Hadoop cluster on any Cloud, as well as manage the rest of your big data application stack using a new open source framework called Cloudify.

Scaling and Managing Big Data Apps in the Cloud

Nati Shalom

Title: Scaling and Managing Big Data Apps on Public Clouds Abstract: The massive computing and storage resources that are needed to support big data applications make on-demand, elastic cloud environments an ideal fit. However, managing your big data app on the cloud is no walk in the park - configuration, orchestration, H/A, auto-scaling are all quite complex when it comes to choosing the right cloud for you, whether it’s public, private or a hybrid cloud - which is where Cloudify and Eucalyptus come together. In this session, you'll learn how to deploy, manage, monitor and scale your big data apps on the open source Eucalyptus cloud platform using Cloudify, as well as easily test drive your apps locally and then migrate the workload to Amazon Web Services EC2.

Big Data in the Cloud

Nati Shalom

Adopting Hadoop to manage your Big Data is an important step, but not the end-solution to your Big Data challenges. Here are some of the additional considerations you must face: Choosing the right cloud for the job: The massive computing and storage resources that are needed to support Big Data applications make cloud environments an ideal fit, and more than ever, there is a growing number of choices of cloud infrastructure types and providers. Given the diverse options, and the dynamic environments involved, it becomes ever more important to maintain the flexibility for all your IT needs. Big Data is a complex beast: It involves many and different moving parts, in large clusters, and is continually growing and evolving. Managing such an environment manually is not a viable option. The question is, how can you achieve automation of all this complexity? The world beyond Hadoop: Big Data is not just Hadoop – there is a whole rapidly growing ecosystem to contend with, including NoSQL, data processing, analytics tools… As well as your own application services. How can you manage deployment, configuration, scaling and failover of all the different pieces, in a consistent way? In this session, you’ll learn how to deploy and manage your Hadoop cluster on any Cloud, as well as manage the rest of your big data application stack using a new open source framework called Cloudify.

More from Nati Shalom (20)

Cloudify and terraform integration

Why NFV and Digital Transformation Projects Fail!

Cloudify and terraform integration

Open Stack Days israel Keynote 2017

What A No Compromises Hybrid Cloud Looks Like

Orchestration tool roundup kubernetes vs. docker vs. heat vs. terra form vs...

Software Defined Operator

Complex Analytics with NoSQL Data Store in Real Time

When networks meets apps (open stack atlanta)

Application Centric Approach to Devops

Case Studies for moving apps to the cloud - DLD 2013

Real-Time Big Data at In-Memory Speed, Using Storm

Disaster Recovery on Demand on the Cloud

Disaster recovery on demand on the cloud

Big Data on OpenStack

Avoiding Cloud Outage

Dont call me cache april 17

Big data (reversim)

Scaling and Managing Big Data Apps in the Cloud

Big Data in the Cloud

Recently uploaded

Knowledge engineering: from people to machines and back

Elena Simperl

Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...

Jeffrey Haguewood

Sidekick Solutions uses Bonterra Impact Management (fka Social Solutions Apricot) and automation solutions to integrate data for business workflows. We believe integration and automation are essential to user experience and the promise of efficient work through technology. Automation is the critical ingredient to realizing that full vision. We develop integration products and services for Bonterra Case Management software to support the deployment of automations for a variety of use cases. This video focuses on the notifications, alerts, and approval requests using Slack for Bonterra Impact Management. The solutions covered in this webinar can also be deployed for Microsoft Teams. Interested in deploying notification automations for Bonterra Impact Management? Contact us at sales@sidekicksolutionsllc.com to discuss next steps.

Leading Change strategies and insights for effective change management pdf 1.pdf

OnBoard

DevOps and Testing slides at DASA Connect

Kari Kakkonen

GraphRAG is All You need? LLM & Knowledge Graph

Guy Korland

Guy Korland, CEO and Co-founder of FalkorDB, will review two articles on the integration of language models with knowledge graphs. 1. Unifying Large Language Models and Knowledge Graphs: A Roadmap. https://arxiv.org/abs/2306.08302 2. Microsoft Research's GraphRAG paper and a review paper on various uses of knowledge graphs: https://www.microsoft.com/en-us/research/blog/graphrag-unlocking-llm-discovery-on-narrative-private-data/

De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...

Product School

FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf

FIDO Alliance

FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf

FIDO Alliance

Elevating Tactical DDD Patterns Through Object Calisthenics

Dorra BARTAGUIZ

After immersing yourself in the blue book and its red counterpart, attending DDD-focused conferences, and applying tactical patterns, you're left with a crucial question: How do I ensure my design is effective? Tactical patterns within Domain-Driven Design (DDD) serve as guiding principles for creating clear and manageable domain models. However, achieving success with these patterns requires additional guidance. Interestingly, we've observed that a set of constraints initially designed for training purposes remarkably aligns with effective pattern implementation, offering a more ‘mechanical’ approach. Let's explore together how Object Calisthenics can elevate the design of your tactical DDD patterns, offering concrete help for those venturing into DDD for the first time!

JMeter webinar - integration with InfluxDB and Grafana

RTTS

Watch this recorded webinar about real-time monitoring of application performance. See how to integrate Apache JMeter, the open-source leader in performance testing, with InfluxDB, the open-source time-series database, and Grafana, the open-source analytics and visualization application. In this webinar, we will review the benefits of leveraging InfluxDB and Grafana when executing load tests and demonstrate how these tools are used to visualize performance metrics. Length: 30 minutes Session Overview ------------------------------------------- During this webinar, we will cover the following topics while demonstrating the integrations of JMeter, InfluxDB and Grafana: - What out-of-the-box solutions are available for real-time monitoring JMeter tests? - What are the benefits of integrating InfluxDB and Grafana into the load testing stack? - Which features are provided by Grafana? - Demonstration of InfluxDB and Grafana using a practice web application To view the webinar recording, go to: https://www.rttsweb.com/jmeter-integration-webinar

FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf

FIDO Alliance

Bits & Pixels using AI for Good.........

Alison B. Lowndes

Securing your Kubernetes cluster_ a step-by-step guide to success !

KatiaHIMEUR1

Today, after several years of existence, an extremely active community and an ultra-dynamic ecosystem, Kubernetes has established itself as the de facto standard in container orchestration. Thanks to a wide range of managed services, it has never been so easy to set up a ready-to-use Kubernetes cluster. However, this ease of use means that the subject of security in Kubernetes is often left for later, or even neglected. This exposes companies to significant risks. In this talk, I'll show you step-by-step how to secure your Kubernetes cluster for greater peace of mind and reliability.

Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024

Tobias Schneck

As AI technology is pushing into IT I was wondering myself, as an “infrastructure container kubernetes guy”, how get this fancy AI technology get managed from an infrastructure operational view? Is it possible to apply our lovely cloud native principals as well? What benefit’s both technologies could bring to each other? Let me take this questions and provide you a short journey through existing deployment models and use cases for AI software. On practical examples, we discuss what cloud/on-premise strategy we may need for applying it to our own infrastructure to get it to work from an enterprise perspective. I want to give an overview about infrastructure requirements and technologies, what could be beneficial or limiting your AI use cases in an enterprise environment. An interactive Demo will give you some insides, what approaches I got already working for real.

Monitoring Java Application Security with JDK Tools and JFR Events

Ana-Maria Mihalceanu

Epistemic Interaction - tuning interfaces to provide information for AI support

Alan Dix

Paper presented at SYNERGY workshop at AVI 2024, Genoa, Italy. 3rd June 2024 https://alandix.com/academic/papers/synergy2024-epistemic/ As machine learning integrates deeper into human-computer interactions, the concept of epistemic interaction emerges, aiming to refine these interactions to enhance system adaptability. This approach encourages minor, intentional adjustments in user behaviour to enrich the data available for system learning. This paper introduces epistemic interaction within the context of human-system communication, illustrating how deliberate interaction design can improve system understanding and adaptation. Through concrete examples, we demonstrate the potential of epistemic interaction to significantly advance human-computer interaction by leveraging intuitive human communication strategies to inform system design and functionality, offering a novel pathway for enriching user-system engagements.

Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...

UiPathCommunity

💥 Speed, accuracy, and scaling – discover the superpowers of GenAI in action with UiPath Document Understanding and Communications Mining™: See how to accelerate model training and optimize model performance with active learning Learn about the latest enhancements to out-of-the-box document processing – with little to no training required Get an exclusive demo of the new family of UiPath LLMs – GenAI models specialized for processing different types of documents and messages This is a hands-on session specifically designed for automation developers and AI enthusiasts seeking to enhance their knowledge in leveraging the latest intelligent document processing capabilities offered by UiPath. Speakers: 👨‍🏫 Andras Palfi, Senior Product Manager, UiPath 👩‍🏫 Lenka Dulovicova, Product Program Manager, UiPath

Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality

Inflectra

In this insightful webinar, Inflectra explores how artificial intelligence (AI) is transforming software development and testing. Discover how AI-powered tools are revolutionizing every stage of the software development lifecycle (SDLC), from design and prototyping to testing, deployment, and monitoring. Learn about: • The Future of Testing: How AI is shifting testing towards verification, analysis, and higher-level skills, while reducing repetitive tasks. • Test Automation: How AI-powered test case generation, optimization, and self-healing tests are making testing more efficient and effective. • Visual Testing: Explore the emerging capabilities of AI in visual testing and how it's set to revolutionize UI verification. • Inflectra's AI Solutions: See demonstrations of Inflectra's cutting-edge AI tools like the ChatGPT plugin and Azure Open AI platform, designed to streamline your testing process. Whether you're a developer, tester, or QA professional, this webinar will give you valuable insights into how AI is shaping the future of software delivery.

Neuro-symbolic is not enough, we need neuro-*semantic*

Frank van Harmelen

Neuro-symbolic (NeSy) AI is on the rise. However, simply machine learning on just any symbolic structure is not sufficient to really harvest the gains of NeSy. These will only be gained when the symbolic structures have an actual semantics. I give an operational definition of semantics as “predictable inference”. All of this illustrated with link prediction over knowledge graphs, but the argument is general.

Transcript: Selling digital books in 2024: Insights from industry leaders - T...

BookNet Canada

The publishing industry has been selling digital audiobooks and ebooks for over a decade and has found its groove. What’s changed? What has stayed the same? Where do we go from here? Join a group of leading sales peers from across the industry for a conversation about the lessons learned since the popularization of digital books, best practices, digital book supply chain management, and more. Link to video recording: https://bnctechforum.ca/sessions/selling-digital-books-in-2024-insights-from-industry-leaders/ Presented by BookNet Canada on May 28, 2024, with support from the Department of Canadian Heritage.

Recently uploaded (20)

Knowledge engineering: from people to machines and back

Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...

Leading Change strategies and insights for effective change management pdf 1.pdf

DevOps and Testing slides at DASA Connect

GraphRAG is All You need? LLM & Knowledge Graph

De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...

FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf

FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf

Elevating Tactical DDD Patterns Through Object Calisthenics

JMeter webinar - integration with InfluxDB and Grafana

FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf

Bits & Pixels using AI for Good.........

Securing your Kubernetes cluster_ a step-by-step guide to success !

Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024

Monitoring Java Application Security with JDK Tools and JFR Events

Epistemic Interaction - tuning interfaces to provide information for AI support

Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...

Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality

Neuro-symbolic is not enough, we need neuro-*semantic*

Transcript: Selling digital books in 2024: Insights from industry leaders - T...

Introduction to Cloudify for OpenStack users

2. GigaSpaces OpenStack Activities Cloudify bridges between OpenStack and other clouds Leading the OpenStack community in Israel Leading OpenSource project to simplify the deployment and management of applications on OpenStack Contributing the TOSCA specification within the OpenStack Heat project

3. Mapping the Cloud Space Higher-level Services Do it Yourself AWS Elastic Beanstalk AWS OpsWorks AWS CloudFormation Amazon EC2 + CloudWatch OpenShift/ CloudFoundry **Solum** Nova, Cinder, Neutron, etc. Convenience Control Cloudify is the OpsWorks equivalent for any environment.

4. Motivation Behind 3.0 • OpenStack Native • Support for VMware and other clouds • Standard / TOSCA • Suited for NFV • Single Manager Scalability • Network Orchestration • Bring together BI, Monitoring and Orchestration

5. “Intelligent Orchestration” Send Metrics Real Time Analytics Cloud Infrastructure Execute Policy Feedback Real Time Analytics Correlate with Historical Events Deploy Fail-over Scale Intelligent Orchestration 11111111111 000000000 11111111111 000000000 11111111111 000000000 Historical Data

6. Network & Application Orchestration Apache Server DB Server NodeJS NodeCeller • App Network • App Subnet • App Port • Security Group • Apache Floating IP • Router Gateway • Data Network • Data Subnet • Data Port • Security Group Router Monitoring, Logging CI MongoDB

7. Topology Driven Monitoring

8. What Do We See Here? Host Middleware App module connection

9. Custom Metrics

10. TOSCA – The Glue for Putting all This Together Application Topologies Workflows Policies

11. TOSCA (Like) Blueprint Host Middleware module: DB Use Bash for configuration and life cycle management

12. TOSCA (Like) Blueprint Middleware module: node JS Server App module: node JS connection

13. PlugIns

14. Plugin Architecture 14 Cloudify Manager Cloudify Agent Chef,Docker ,.. Endpoint NodeJS Container MongoD Container Blueprint Agent PlugIn

15. Chef Integration Where to find the plugin type definition Using the Chef types for app_module Passing the specific properties for the Chef type

16. Docker Integration Using the Docker type for db_server Passing the Docker file inline

17. Cloudify + Heat

18. Bootstrapping Cloudify Through Heat

19. Deploy a Heat stack Template Heat VM VM VM

20. Discovery of Heat stack Cloudify Discoverer Cloudify Blueprint VM VM VM

21. Augmenting The Blueprint Cloudify Discoverer Infra Blueprint App Blueprint complete Blueprint

22. Basic Cloudify Demo Video Streaming

23. Basic Cloudify Demo - Topology

24. Learn More getcloudify.org Documentation Architecture Community Forum Blog

Editor's Notes

http://getcloudify.org/2014/07/07/openstack-orchestration-heat-devstack.html

Introduction to Cloudify for OpenStack users

Recommended

Recommended

More Related Content

What's hot

What's hot (20)

Similar to Introduction to Cloudify for OpenStack users

Similar to Introduction to Cloudify for OpenStack users (20)

More from Nati Shalom

More from Nati Shalom (20)

Recently uploaded

Recently uploaded (20)

Introduction to Cloudify for OpenStack users

Editor's Notes