State of Resource Management in Big DataKhalid Ahmed
This talk gives an overview of open-source resource management and scheduling technologies in the big data space. We look in detail at the architectures of YARN, Mesos and Kubernetes and compare how similarities and differences.
Experiences in Delivering Spark as a ServiceKhalid Ahmed
The back-end architecture for the public Spark service in IBM Bluemix is powered by IBM Spectrum Conductor with Spark technology. In this presentation, we will demonstrate the advantages of the architecture, which uses dynamic resource allocations based on multiple Spark tenants workload demands (vs. common cloud service architecture provisioning of pre-deployed cluster per tenant), as well as cluster's auto-scaling based on computation capacity and billing policies. We will also review some of the architectural challenges of scaling to thousand of Spark tenants in terms of performance, security requirements, data isolation and manageability.
9. Apache CloudStack 概要
• Web インターフェースから Zone / Cluster / ネットワー
ク /
ホストの追加など設定
Copyright (C) Cloud Utilization Promotion
Agency. All Rights Reserved. 9
10. Apache CloudStack 概要
• システム VM / デフォルトテンプレートのダウンロー
ドが完了できれば、 CloudStack が使える準備完了
デフォルトテンプレート
SSVM / Console VM
Copyright (C) Cloud Utilization Promotion
Agency. All Rights Reserved. 10
11. Apache CloudStack 概要
• インスタンス作成も Web インターフェンスから
ISO / テンプレートを選
択してダウンロード
Disk を選択
Zone / ISO or テンプレート選択
コンピュータオファーリング選択 インスタンス名の決
ディスク選択 定
ネットワーク選択 Copyright (C) Cloud Utilization Promotion
Agency. All Rights Reserved. 11