Ceph Performance on OpenStack - Barcelona SummitTakehiro Kudou
This document summarizes benchmark results for Ceph performance on OpenStack. Over 50,000 benchmarks were run comparing Ceph 1.3 and the new Ceph 2.0 BlueStore backend. Ceph 1.3 showed extremely high read performance but poor write performance due to limitations of the HDD backend. Initial tests of Ceph 2.0 BlueStore encountered bugs that caused segmentation faults and corrupted OSDs, indicating it is not yet stable enough for production workloads. Further development is needed before BlueStore can realize the full performance benefits of bypassing the journal.
Ceph Performance on OpenStack - Barcelona SummitTakehiro Kudou
This document summarizes benchmark results for Ceph performance on OpenStack. Over 50,000 benchmarks were run comparing Ceph 1.3 and the new Ceph 2.0 BlueStore backend. Ceph 1.3 showed extremely high read performance but poor write performance due to limitations of the HDD backend. Initial tests of Ceph 2.0 BlueStore encountered bugs that caused segmentation faults and corrupted OSDs, indicating it is not yet stable enough for production workloads. Further development is needed before BlueStore can realize the full performance benefits of bypassing the journal.
Kirin User Story: Migrating Mission Critical Applications to OpenStack Privat...Motoki Kakinuma
NTT Data is an IT service company.
Kirin is one of the largest beverages companies in Japan.
In this presentation, we will present the user story of migrating all applications from creaky infrastructure to OpenStack private cloud including actual challenges, know-hows and future prospects.
The key concept of this project is:
* Mission Critical: Migrate all Kirin enterprise applications to OpenStack private cloud.
* Think Big, Start Small: Start from small number of apps, and expand rapidly.
* Agility and elasticity: Adopt a PaaS-like automation approach, targeting 50% less development cost and 40% less operational cost.
In order to achieve all items above, we have decided to use OpenStack IaaS, ICO, which is an automation product by IBM, serverspec for testing, and Hinemos for monitoring management.
Starting from Aug 2014, the project expects 100 VM / 100 TB storage as the first-stage migration by end of 2015. We're planning to migrate 500 VM / 300 TB by end of 2016 and 2000 VM / 1 PB finally.
Is spark streaming based on reactive streams?chibochibo
What is Reactive Streams? What if a subscriber was very slow in asynchronous stream processing? In this talk we will briefly introduce you to the basics of Reactive Streams and the importance of back-pressure and then explain the architecture (implementations) of Spark Streaming back-pressure.
Introduction to Hortonworks Data Cloud for AWSYifeng Jiang
Hortonworks Data Cloud is a new cloud product from Hortonworks that offers pay-as-you-go pricing for launching and managing Hadoop clusters on AWS. It handles common big data use cases and focuses on ease of use by providing prescriptive cluster types. The product aims to improve enterprise readiness in the cloud by providing scalable storage, security and governance features, and reliability through auto-recovery of unhealthy nodes. It also matches Hadoop with cloud capabilities like scalable storage, customizability, and cost-effective compute.
Short Lived Tasks in Cloud Foundry #cfdtokyoToshiaki Maki
The document discusses different types of tasks in Cloud Foundry including long-running process (LRP) tasks, app process staging tasks, and app tasks. It provides examples of using the cf v3-run-task command to run tasks such as database migrations, flyway migrations, and a custom task to output a greeting.
Open the Stack: How to easily plan and install your OpenStack deploymentEric D. Schabell
Is planning and installing your next OpenStack deployment giving you a big headache? Are you losing sleep worrying about the compatibility of the components? We can help.
With the Cloud Deployment Planner by Red Hat, you can plan your deployments and ensure the compatibility of the open source components you’re using. And after ensuring that your OpenStack deployment components are valid, you can leverage the Quickstart Cloud Installer to experience an easy-to-use and fully repeatable OpenStack installation. Join this session to learn what the Cloud Deployment Planner and Quickstart Cloud Installer can do for your peace of mind.
Bare Metal Provisioning for Big Data - OpenStack最新情報セミナー(2016年12月)VirtualTech Japan Inc.
Bare Metal Provisioning for Big Data - OpenStack最新情報セミナー(2016年12月)
講師:崔 祐碩(Rakuten)
アジェンダ:
- Virtualization VS Bare Metal
- About Bare Metal management system at Rakuten
- Ready to Provisioning
- What is Next?
Kirin User Story: Migrating Mission Critical Applications to OpenStack Privat...Motoki Kakinuma
NTT Data is an IT service company.
Kirin is one of the largest beverages companies in Japan.
In this presentation, we will present the user story of migrating all applications from creaky infrastructure to OpenStack private cloud including actual challenges, know-hows and future prospects.
The key concept of this project is:
* Mission Critical: Migrate all Kirin enterprise applications to OpenStack private cloud.
* Think Big, Start Small: Start from small number of apps, and expand rapidly.
* Agility and elasticity: Adopt a PaaS-like automation approach, targeting 50% less development cost and 40% less operational cost.
In order to achieve all items above, we have decided to use OpenStack IaaS, ICO, which is an automation product by IBM, serverspec for testing, and Hinemos for monitoring management.
Starting from Aug 2014, the project expects 100 VM / 100 TB storage as the first-stage migration by end of 2015. We're planning to migrate 500 VM / 300 TB by end of 2016 and 2000 VM / 1 PB finally.
Is spark streaming based on reactive streams?chibochibo
What is Reactive Streams? What if a subscriber was very slow in asynchronous stream processing? In this talk we will briefly introduce you to the basics of Reactive Streams and the importance of back-pressure and then explain the architecture (implementations) of Spark Streaming back-pressure.
Introduction to Hortonworks Data Cloud for AWSYifeng Jiang
Hortonworks Data Cloud is a new cloud product from Hortonworks that offers pay-as-you-go pricing for launching and managing Hadoop clusters on AWS. It handles common big data use cases and focuses on ease of use by providing prescriptive cluster types. The product aims to improve enterprise readiness in the cloud by providing scalable storage, security and governance features, and reliability through auto-recovery of unhealthy nodes. It also matches Hadoop with cloud capabilities like scalable storage, customizability, and cost-effective compute.
Short Lived Tasks in Cloud Foundry #cfdtokyoToshiaki Maki
The document discusses different types of tasks in Cloud Foundry including long-running process (LRP) tasks, app process staging tasks, and app tasks. It provides examples of using the cf v3-run-task command to run tasks such as database migrations, flyway migrations, and a custom task to output a greeting.
Open the Stack: How to easily plan and install your OpenStack deploymentEric D. Schabell
Is planning and installing your next OpenStack deployment giving you a big headache? Are you losing sleep worrying about the compatibility of the components? We can help.
With the Cloud Deployment Planner by Red Hat, you can plan your deployments and ensure the compatibility of the open source components you’re using. And after ensuring that your OpenStack deployment components are valid, you can leverage the Quickstart Cloud Installer to experience an easy-to-use and fully repeatable OpenStack installation. Join this session to learn what the Cloud Deployment Planner and Quickstart Cloud Installer can do for your peace of mind.
Bare Metal Provisioning for Big Data - OpenStack最新情報セミナー(2016年12月)VirtualTech Japan Inc.
Bare Metal Provisioning for Big Data - OpenStack最新情報セミナー(2016年12月)
講師:崔 祐碩(Rakuten)
アジェンダ:
- Virtualization VS Bare Metal
- About Bare Metal management system at Rakuten
- Ready to Provisioning
- What is Next?