Running OpenStack on Amazon AWS, Alex Fishman

•Download as PPTX, PDF•

7 likes•10,406 views

Running OpenStack on Amazon AWS: In this talk we will demonstrate how to create an exact replica of an on-premises OpenStack configuration in the public cloud (AWS/EC-2, GCE or HP Cloud) and spin multiple copies of this environment in a matter of minutes. We will technically elaborate how we use our own high performance nested hypervisor HVX, and software defined networking - to run OpenStack guests with KVM acceleration on top of any public cloud.

Technology

Running OpenStack on
Amazon AWS
Alex Fishman,
Ravello Systems
Twitter: @ravellosystems

Agenda
• OpenStack for developers
• Trying out different OpenStack
vendors/flavors/configurations
• Bringing the gap between OpenStack and public
clouds
• Demo of OpenStack on Amazon AWS
• Use cases
6/5/2014 Ravello Systems, Inc. 2

OpenStack is a cool platform but…
• Time consuming to install and try
• Requires dedicated hardware that is not always available
• Many different versions and flavors, can be hard to choose
from
• Network configuration is complicated
6/5/2014 Ravello Systems, Inc. 3

Deploying OpenStack dev/test environments
• Local dev environments
– Flexible for development
– Easy to setup and tweak
– Not nearly powerful enough to run
multi node setups
• In a lab
– Powerful hardware
– Limited resources
– Time consuming
– Costly
6/5/2014 Ravello Systems, Inc. 4

So why not using public cloud?
6/5/2014 Ravello Systems, Inc. 5
• Unlimited compute resources
• Spinning new VMs is quick and easy
• Pay as you go: much more
economical for short term usage
than dedicated hardware
Amazon AWS,
Google GCE,
Rackspace Cloud,
…

But…
6/5/2014 Ravello Systems, Inc. 6
• Compute nodes require dedicated
hypervisor support
• Only trivial network configuration is
available
• Replicating multi node OpenStack
applications is hard

Nevertheless…
There are attempts to utilize a public cloud
• Devstack
– Can be deployed on a single VM
– Slow because of Qemu
• NanoStack, Osones
– Multi node but inflexible configuration/feature wise
– Slow because of Qemu
6/5/2014 Ravello Systems, Inc. 7

So? We cannot deploy custom
OpenStack environments on a
public cloud?
Yes you can!

Bridging the gap
• Nested virtualization
• Overlay network
• Saving & replicating of complex environments
6/5/2014 Ravello Systems, Inc. 9

The evolution of virtualization
6/5/2014 Ravello Systems, Inc. 10
x86
OS
x86
Hypervisor
x86
Hypervisor
OS
1:1 physical server virtualization nested virtualization
app app
OS
app
OS
app
OS
app
HVX

HVX: Nested virtualization
6/5/2014 Ravello Systems, Inc. 11
x86
Hypervisor
OS
app
OS
app
HVX
• Built from the ground up to be nested
• Binary Translation with direct execution
• Supports 32 and 64-bit guest OSs
– Windows, Linux, Solaris x86, Android x86 …
• Can run VMware and KVM guests
unmodified on any public cloud - AWS,
Google, …

Introducing N^2
(nested-nested)
virtualization

VT/SVM implementation in HVX
6/5/2014 Ravello Systems, Inc. 13
x86
Hypervisor
OS
nested virtualization
app
OS
app
HVX
x86
Hypervisor
OS
app
OS
app
HVX VT
Hypervisor
nested^2 virtualization
• HVX can expose VT
enabled virtual
hardware
• Can now run
hypervisors like
KVM, VMware ESXi,
Hyper-V etc. in the
cloud

Overlay network
6/5/2014 Ravello Systems, Inc. 14
• Software defined
network (SDN)
• Runs on top of cloud
provider L3 network
• Define any L2/L3
configuration
• Supports multicast,
broadcast, VLANs, PXE
boot, etc.HVX
web
OS
HVX
app
OS
HVX
db
OS
app
OS

Sample OpenStack architecture in the cloud
6/5/2014 Ravello Systems, Inc. 15
x86
Hypervisor
Linux
Nova
Horizon
Glance
HVX
Cloud VM
x86
Hypervisor
Linux
Neutron
HVX
Cloud VM
x86
Hypervisor
Linux
HVX VT
VM
KVM
Compute
VM
Linux
VM
KVM
Compute
VM
Controller node Neutron node
x86
Hypervisor
HVX
Compute node 1
Cloud VM Cloud VM
Compute node 2
VT

Demo
Multi-node OpenStack/KVM
running on AWS

Use-cases for developer community
• Multi-node system testing environments
• Test environments for complex features (e.g. HA, networking,
…)
6/5/2014 Ravello Systems, Inc. 18

Use-cases for OpenStack ISVs
• Development and test environments for downstream
hardening and QA testing
• SE (System Engineer) led customer demos
• Professional Services led customer PoCs
• Partner and end-user training environments
• On-line free trial demos
6/5/2014 Ravello Systems, Inc. 19

Use-cases for Enterprises
• PoC/Evaluate multiple OpenStack vendors without allocating
any incremental hardware
– Include proper scale and system testing
• Staging environments for OpenStack upgrades
• Test environments for OpenStack eco-system products
6/5/2014 Ravello Systems, Inc. 20

What's hot

This session will introduce the basics of primary storage in CloudStack. Additionally, I discuss the challenges of guaranteeing storage performance in a cloud and how by leveraging the latest enhancements to CloudStack, storage administrators can deliver consistent, repeatable performance to 10s, 100s or 1,000s of application workloads in parallel. I'll review the CloudStack enhancements in detail, outline the management benefits they provide and discuss common go-to-market approaches. About Mike Tutkowski Mike Tutkowski, a member of the CloudStack PMC, develops software for the Apache Software Foundation's CloudStack project to help drive improvements in its storage component and to integrate SolidFire more deeply into the product.

Guaranteeing Storage Performance by Mike Tutkowski

buildacloud

Designing OpenStack Architectures

Mirantis

Cloud orchestration major tools comparision

Ravi Kiran

Cloud stack for_beginners

Radhika Puthiyetath

VNG/IRD - Cloud computing & Openstack discussion 3/5/2014

Tran Nhan

The core of CloudStack networking has always been software-defined. As the networking industry evolves to a software-defined future, CloudStack will have to evolve with it. The presentation will examine the present state of SDN in CloudStack, look at some industry directions and attempt to predict the evolution of CloudStack with those trends. Bio Chiradeep Vittal is a Distinguished Engineer in the Converged Infrastructure Group at Citrix where he has technology leadership responsibilities around Citrix Cloud Platform, Citrix Lifecycle Manager and Citrix Workspace Pod. He is also a Project Management Committee member of the Apache CloudStack Project. At cloud.com (acquired by Citrix), he was a founding engineer, often tasked with the thorny details of virtualized networking and storage. Prior to cloud.com, he worked at several Silicon Valley startups in various architectural roles. Chiradeep has a B.Tech in Computer Science from IIT, Bombay and a M.Sc from the University of Alberta. He has spoken / presented at several conferences, including CloudStack Collab, LISA, OSCON, ONS, SDN Summit and LinuxCon. His twitter handle is @chiradeep and occasionally blogs at http://cloudierthanthou.wordpress.com

The Future of SDN in CloudStack by Chiradeep Vittal

buildacloud

OpenStack Introduction

Jimi Chen

Build public private cloud using openstack

Framgia Vietnam

Introduction Openstack

Ranjith Kumar

Are you overwhelmed by storage capacity requirements? Are you wondering how web giants are able to store large amounts of data at a fraction of your storage costs? OpenStack is the fastest growing open-source project to date, and its community builds cloud software. Join us to learn about the two OpenStack storage projects and how your company can take advantage of them. OpenStack storage allows the use of commodity hardware at massive scales that you can consume as a public, private, or hybrid cloud. View the on-demand webinar. Special guest speaker Randy Bias, founder and CEO of Cloudscaling and member of the Board of Directors for OpenStack Foundation, and EVault big data expert Joey Yep will inform you about this fast-growing, open-source project: OpenStack. • OpenStack Swift and Cinder storage projects • High-level functionality and architecture • Public, private, and hybrid use-cases

OpenStack 101 Presentation

EVault

Docker based Hadoop provisioning - anywhere

Janos Matyas

CloudStack Hyderabad Meetup: How the Apache community works

CloudStack - Open Source Cloud Computing Project

Software is eating infrastructure. By pulling reliability and scalability responsibilities up the stack from hardware into software, object stores such as Basho's Riak CS and cloud orchestration platforms such as Apache CloudStack increase the utilization of compute and storage resources by dynamically shifting workloads based on demand. Together, those platforms can saturate compute and storage of 1000s of hosts with strong operational visibility and end-user self-service. This talk will cover the following topics to explore private cloud design principles and best practices: * Why Private Cloud? * Anatomy of a Private Cloud * Building a Apache CloudStack Compute Offering * Large Object Storage using Riak CS

Better, Faster, Cheaper Infrastructure: Apache CloudStack and Riak CS

John Burwell

Avishay Traeger & Shimshon Zimmerman, Stratoscale - Deploying OpenStack Cinde...

Cloud Native Day Tel Aviv

An Introduction to OpenStack

Scott Lowe

Do you think that Nova, Cinder, Heat, Ceilometer, and Neutron are all references to global warming and looming apocalypse? For all those who come to the OpenStack community and wonder what all the fuss is about, this quick introduction will answer your many questions. It includes a short history of the largest Open Source project in history and will touch on the basic OpenStack components, so you will be prepared the next time someone mentions Keystone, Nova and Swift in the same sentence. This session was presented by Beth Cohen at the OpenStack meetup on Feb 19th, 2014 in Boston. Beth works for Verizon developing cool Cloud based products that she can't talk about without a strict NDA. She is a technical leader with over 25 years of experience architecting leading-edge system infrastructures and managing complex projects in the telecom, manufacturing, financial services, government, and technology industries. She has been involved in building some of the world's largest OpenStack architectures and has way too much fun at OpenStack Summits!

OpenStack 101 update

Kamesh Pemmaraju

Whats New in Apache CloudStack Version 4.5

ShapeBlue

Apache CloudStack is a mature, easy to deploy IaaS platform. That doesn't mean that it can be done without thought or preparation. Learn how CloudStack can be most efficiently deployed, and the problems to avoid in the process. About David Nalley David is a recovering sysadmin with a decade of experience. He’s a committer on the Apache CloudStack (incubating) project, a contributor to the Fedora Project and the Vice President of Infrastructure at the Apache Software Foundation.

Introduction to Apache CloudStack by David Nalley

buildacloud

Introduction to OpenStack Storage

NetApp

On Docker and its use for LHC at CERN

Sebastien Goasguen

What's hot (20)

Guaranteeing Storage Performance by Mike Tutkowski

Designing OpenStack Architectures

Cloud orchestration major tools comparision

Cloud stack for_beginners

VNG/IRD - Cloud computing & Openstack discussion 3/5/2014

The Future of SDN in CloudStack by Chiradeep Vittal

OpenStack Introduction

Build public private cloud using openstack

Introduction Openstack

OpenStack 101 Presentation

Docker based Hadoop provisioning - anywhere

CloudStack Hyderabad Meetup: How the Apache community works

Better, Faster, Cheaper Infrastructure: Apache CloudStack and Riak CS

Avishay Traeger & Shimshon Zimmerman, Stratoscale - Deploying OpenStack Cinde...

An Introduction to OpenStack

OpenStack 101 update

Whats New in Apache CloudStack Version 4.5

Introduction to Apache CloudStack by David Nalley

Introduction to OpenStack Storage

On Docker and its use for LHC at CERN

Viewers also liked

Cloud Computing & CloudStack Open Source

AhmadShah Sultani

Capgemini is delivering a best of bread user experience and e-business platform in the cloud using open source technologies and cloud service providers. This offering, named Capgemini Immediate, has already attracted several customers in Europe including Royal Mail Group in UK. The presentation will describe the customers' issues and business contexts, the solution built to address these issues, the Capgemini project approach and engagement model and the reasons to use open source technologies. It will also present the resulting benefits and the key success factors of this new approach.

Cloud / Build to cloud using Open Source - Jean-Francois Caenen, CapGemini

Paris Open Source Summit

Cloud Computing Architecture

Vasu Jain

DevOps for Managers

All Things Open

Cloud Computing Architecture

Animesh Chaturvedi

Sukumar Nayak-Detailed-Cloud Risk Management and Audit

Sukumar Nayak

This crash course is designed to give an overview of cloud computing architecture and the open source software that can be used to deploy and manage a cloud computing environment. Topics to be discussed in this session will include virtualization (KVM, LXC, and Xen Project), orchestration (Apache CloudStack, Eucalyptus, Open Nebula, and OpenStack), and storage (GlusterFS, Ceph, and others). The talk will also provide insight into how to deliver Platform-as-a-Service (PaaS) and what technologies can be used to compliment this evolving cloud computing paradigm. Systems administrators and IT generalists will leave the discussion with a general overview of the options at their disposal to effectively build and manage their own cloud computing environments using free and open source software and understand the capabilities and benefits of a host of technologies.

RICON 2014 - Build a Cloud Day - Crash Course Open Source Cloud Computing

Mark Hinkle

Crash Course in Cloud Computing

All Things Open

Computational Advertising

AhmadShah Sultani

Automating CloudStack and hypervisor installation and configuration

Dag Sonstebo

Cloud computing architecture and vulnerabilies

Vinay Dwivedi

Introduction of Cloud computing

Rkrishna Mishra

Viewers also liked (12)

Cloud Computing & CloudStack Open Source

Cloud / Build to cloud using Open Source - Jean-Francois Caenen, CapGemini

Cloud Computing Architecture

DevOps for Managers

Cloud Computing Architecture

Sukumar Nayak-Detailed-Cloud Risk Management and Audit

RICON 2014 - Build a Cloud Day - Crash Course Open Source Cloud Computing

Crash Course in Cloud Computing

Computational Advertising

Automating CloudStack and hypervisor installation and configuration

Cloud computing architecture and vulnerabilies

Introduction of Cloud computing

Similar to Running OpenStack on Amazon AWS, Alex Fishman

Webinar: OpenStack Benefits for VMware

Platform9

OpenStack - JobShop @Iași, 2016

Alexandru Coman

What is the OpenStack Platform? By Peter Dens - Kangaroot

Kangaroot

OpenStack in Action 4! Vincent Untz - Running multiple hypervisors in your Op...

eNovance

This webinar will cover the concept of Smart Labs that let you spin up your application in as many cloud-based lab environments as you need, without any migration overhead. Once upon a time - not too long ago - setting up repeatable application environments with complex networking, multiple VMs took days or even weeks and capacity planning was a nightmare. Today, you can automatically spin up complex environments in leading public clouds and run any VMs - including existing VMware/KVM virtual machines, and virtual appliances such as Cisco, Brocade, Juniper, F5, Check Point, Infoblox and any networking - including static IPs, multiple subnets, broadcast and multicast. We will discuss and demonstrate live how Ravello’s Smart Labs on AWS or Google Cloud, powered by nested virtualization and software defined networking, let you: 1. Provision hundreds of student environments with one click or API call for virtual training or classrooms - and pay only for usage 2. Enable sales teams with live cloud-based demo environments for your application software that they can deploy & destroy as needed from anywhere in the world 3. Ensure that QA teams never have to wait for test environments for automated testing

Ravello webinar - Creating smart labs on AWS/Google for sales demos, training...

shrutib

Open stack + Containers + Hyper-V

Sriram Subramanian

OpenStack + VMware at the Hong Kong OpenStack Summit

Dan Wendlandt

Develop with linux containers and docker

Fabio Fumarola

Openstack - An introduction/Installation - Presented at Dr Dobb's conference...

Rahul Krishna Upadhyaya

Container and Cloud Native Application: What is VMware doing in this space? -...

gguglie

The Information Technology have led us into an era where the production, sharing and use of information are now part of everyday life and of which we are often unaware actors almost: it is now almost inevitable not leave a digital trail of many of the actions we do every day; for example, by digital content such as photos, videos, blog posts and everything that revolves around the social networks (Facebook and Twitter in particular). Added to this is that with the "internet of things", we see an increase in devices such as watches, bracelets, thermostats and many other items that are able to connect to the network and therefore generate large data streams. This explosion of data justifies the birth, in the world of the term Big Data: it indicates the data produced in large quantities, with remarkable speed and in different formats, which requires processing technologies and resources that go far beyond the conventional systems management and storage of data. It is immediately clear that, 1) models of data storage based on the relational model, and 2) processing systems based on stored procedures and computations on grids are not applicable in these contexts. As regards the point 1, the RDBMS, widely used for a great variety of applications, have some problems when the amount of data grows beyond certain limits. The scalability and cost of implementation are only a part of the disadvantages: very often, in fact, when there is opposite to the management of big data, also the variability, or the lack of a fixed structure, represents a significant problem. This has given a boost to the development of the NoSQL database. The website NoSQL Databases defines NoSQL databases such as "Next Generation Databases mostly addressing some of the points: being non-relational, distributed, open source and horizontally scalable." These databases are: distributed, open source, scalable horizontally, without a predetermined pattern (key-value, column-oriented, document-based and graph-based), easily replicable, devoid of the ACID and can handle large amounts of data. These databases are integrated or integrated with processing tools based on the MapReduce paradigm proposed by Google in 2009. MapReduce with the open source Hadoop framework represent the new model for distributed processing of large amounts of data that goes to supplant techniques based on stored procedures and computational grids (step 2). The relational model taught courses in basic database design, has many limitations compared to the demands posed by new applications based on Big Data and NoSQL databases that use to store data and MapReduce to process large amounts of data. Course Website http://pbdmng.datatoknowledge.it/ Contact me to download the slides

2 Linux Container and Docker

Fabio Fumarola

Bitnami Bootcamp. OpenStack

Alberto Molina Coballes

Openstackoverview-DEC2013

Michael Lessard

Webinar - Introduction to Ceph and OpenStack

Ceph Community

Cloudexpowest opensourcecloudcomputing-1by arun kumar

Arun Kumar

Cloudexpowest opensourcecloudcomputing-1by arun kumar

Arun Kumar

A talk by Shaun Murakami and Phil Estes at the OpenStack Summit Paris, Fall 2014. We look at real-world scenarios deploying and managing workloads in a multi-platform environment of compute architectures including IBM System z (traditional mainframe), POWER, and Intel architectures. Moving beyond a homogeneous data center to a mix of enterprise architectures adds potential complexities around hypervisor support, deployment capabilities, and management of disparate workloads--of which some might be CPU-centric while others are not.

Beyond x86: Managing Multi-platform Environments with OpenStack

Phil Estes

Successfully Deliver and Operate OpenStack in Production with VMware VIO

Arraya Solutions

Linux containers and docker

Fabio Fumarola

Continuous Integration Fundamentals: Build Automation - OFM Canberra October ...

Joelith

Similar to Running OpenStack on Amazon AWS, Alex Fishman (20)

Webinar: OpenStack Benefits for VMware

OpenStack - JobShop @Iași, 2016

What is the OpenStack Platform? By Peter Dens - Kangaroot

OpenStack in Action 4! Vincent Untz - Running multiple hypervisors in your Op...

Ravello webinar - Creating smart labs on AWS/Google for sales demos, training...

Open stack + Containers + Hyper-V

OpenStack + VMware at the Hong Kong OpenStack Summit

Develop with linux containers and docker

Openstack - An introduction/Installation - Presented at Dr Dobb's conference...

Container and Cloud Native Application: What is VMware doing in this space? -...

2 Linux Container and Docker

Bitnami Bootcamp. OpenStack

Openstackoverview-DEC2013

Webinar - Introduction to Ceph and OpenStack

Cloudexpowest opensourcecloudcomputing-1by arun kumar

Beyond x86: Managing Multi-platform Environments with OpenStack

Successfully Deliver and Operate OpenStack in Production with VMware VIO

Linux containers and docker

Continuous Integration Fundamentals: Build Automation - OFM Canberra October ...

More from Cloud Native Day Tel Aviv

Cloud Native is a Cultural Decision. By Reshef Mann

Cloud Native Day Tel Aviv

In any Cloud Native architecture there’s a seemingly endless stream of events that happen at each layer. These events can be used to detect abnormal activity and possible security incidents, as well as providing an audit trail of activity. In this talk we’ll cover how we extended Falco to ingest events beyond just host system calls, such as Kubernetes audit events or even application level events. We will also show how to create Falco rules to detect behaviors in these new event streams. We show how we implemented Kubernetes audit events in Falco, and how to configure the event stream.

Container Runtime Security with Falco, by Néstor Salceda

Cloud Native Day Tel Aviv

Kafka Mirror Tester: Go and Kubernetes Powered Test Suite for Kafka Replicati...

Cloud Native Day Tel Aviv

Running I/O intensive workloads on Kubernetes, by Nati Shalom

Cloud Native Day Tel Aviv

Service meshes are all the buzz in cloud-native world. How come only yesterday we didn't know such a thing existed and now everybody seems to want one? If you're already running a microservice-based system or only starting out with one, you may be asking yourself : "Do I also need a mesh?" In this session we'll try to answer what the mesh is good for, what problem it solves, what new questions it poses.

WTF Do We Need a Service Mesh? By Anton Weiss.

Cloud Native Day Tel Aviv

Update Strategies for the Edge, by Kat Cosgrove

Cloud Native Day Tel Aviv

Building a Cloud-Native SaaS Product The Hard Way. By Arthur Berezin

Cloud Native Day Tel Aviv

If you are interested in monitoring, and successfully set up a system (whether home-grown or custom-off-the-shelf) for your own use, there comes a moment when you go from monitoring only the systems you care about, to monitoring systems that other people care about. Monitoring for yourself is all about having the best data for the least effort. Monitoring for others? That's when your job becomes a game of "what just happened" whack-a-mole.

The Four Questions (Every Monitoring Engineer gets asked), by Leon Adato

Cloud Native Day Tel Aviv

K8s Pod Scheduling - Deep Dive. By Tsahi Duek.

Cloud Native Day Tel Aviv

Cloud Native: The Cattle, the Pets, and the Germs, by Avishai Ish-Shalom

Cloud Native Day Tel Aviv

MySQL shell is the MySQL client of the future. It will help you in your daily operations, whatever they are. It doesn't matter if you are a developer or an administrator, if you want to work with relational or non relational data, if you want to setup or monitor your cluster, if you want to work with SQL language or javascript or python. Discover how MySQL shell will help you, no matter what you want to do with MySQL!

MySQL Shell: the daily tool for devs and admins. By Vittorio Cioe.

Cloud Native Day Tel Aviv

Cloud native transformation patterns, by Pini Reznik

Cloud Native Day Tel Aviv

Cloud and Edge: price, performance and privacy considerations in IOT, by Tsvi...

Cloud Native Day Tel Aviv

Running Highly Available Large Scale Systems is a lot of work. For the past 2.5 years, we've been running 100% serverless on a full production environment, serving customers worldwide. No VMs, no containers, no Kubernetes. Just code. In this session I will present why we decided to go fully serverless at Torii, how it helped us move faster than our competitors, where did serverless computing worked best and where there's more work to be done.

Two Years, Zero servers: Lessons learned from running a startup 100% on Serve...

Cloud Native Day Tel Aviv

The “Twelve-Factor” application model has come to represent twelve best practices for building modern, cloud-native applications. With guidance on things like configuration, deployment, runtime, and multiple service communication, the Twelve-Factor model prescribes best practices that apply to everything from web applications to APIs to data processing applications. Although Serverless computing and AWS Lambda have changed how application development is done, the “Twelve-Factor” best practices remain relevant and applicable in a Serverless world. In this talk, we’ll apply the “Twelve-Factor” model to Serverless application development with AWS Lambda and Amazon API Gateway and show you how these services enable you to build scalable, low cost, and low administration applications.

12 Factor Serverless Applications - Mike Morain, AWS - Cloud Native Day Tel A...

Cloud Native Day Tel Aviv

When creating a new Microservice you typically need to add a lot of boilerplate to the code, such as logging, metrics, authentication, SSL, secrets/credentials, etc... All this ends up overshadowing the actual logic of the service itself and results in a lot of dependencies and code. Because of this, we at Soluto created a template for the boilerplate, which worked great... Until we had to upgrade one of the dependencies which resulted in huge effort of code upgrades and deployment across each and every service that uses the template. And that’s besides the fact we needed to make a separate template for each language we used (and over the years, the number of programming languages we use at production increased dramatically). We needed a way to simplify all this. We wanted to get rid of the boilerplate while maintaining the functions listed above. So we decided to delegate the entire responsibility to the Kubernetes infrastructure. In this lecture, I will do a live coding session and show you how to remove the boilerplate from your code and move it to the infrastructure, and discuss the benefits and limitations of this approach.

Not my problem! Delegating responsibilities to the infrastructure - Yshay Yaa...

Cloud Native Day Tel Aviv

Machine Learning is no doubt the hottest trend in IT nowadays. Deep Neural Network (DNN), a subfield of Machine Learning with mode of operation loosely inspired by the brain, allows us to solve complex problems such as image recognition that has been very difficult to solve using standard programming paradigms. DNN concepts are not new. However, and until recently, applying them in practice could not be realized due to their high computational demands. With the recent development in parallel computing, especially around GPU acceleration and high speed and efficient networking, DNN has become a reality in modern data centers. In this talk we will describe the system requirements to effectively run a machine learning cluster with popular frameworks such as TensorFlow. We will discuss how such a system can be deployed in an OpenStack-based cloud without compromises, enjoying high-performance DNN programming paradigm as well as the benefits of cloud and software-defined data centers.

Brain in the Cloud: Machine Learning on OpenStack & Kubernetes Done Right - E...

Cloud Native Day Tel Aviv

Cloud native applications are commonly thought as stateless, horizontally scalable workloads that you can scale-up and down on-demand. Kubernetes, as the commodity cloud native orchestrator, was originally designed for such workloads. A lot has evolved since Kubernetes’ inception, and nowadays many of the stateful applications are migrating to Kubernetes. While not everything is perfect, more and more features are added to support complex stateful use-cases. In this session Arthur will cover the following topics: - Breakdown of a stateful application - Planning a stateful application on Kubernetes - The state of Kubernetes StatefulSets, Persistent Volumes, DNS, Networking, operators and High Availability - A practical use-case and DEMO of a stateful application with Kubernetes

A stateful application walks into a Kubernetes bar - Arthur Berezin, JovianX ...

Cloud Native Day Tel Aviv

The story of how KubeMQ was born - Oz Golan, KubeMQ - Cloud Native Day Tel Av...

Cloud Native Day Tel Aviv

I want it all: go hybrid - Orit Yaron, Outbrain - Cloud Native Day Tel Aviv 2018

Cloud Native Day Tel Aviv

More from Cloud Native Day Tel Aviv (20)