Build Your Private Cloud with Ezilla and Haduzilla
Build Your Own Private Cloud with Ezilla and Haduzilla @ 2012-12-16 OSC.JP CLOUD 2012National Center for High-performance Computing Software Technology Division / Ezilla Team Jazz Yao-Tsung Wang email@example.com
Agenda➢Breif Introduction to NCHC➢Five little Zillas from Free Software Lab➢Brief Introduction to Ezilla Project➢Brief Introduction to Haduzilla Project
Breif Introduction to NCHC @ 2012-12-16 OSC.JP CLOUD 2012National Center for High-performance Computing Software Technology Division / Ezilla Team Jazz Yao-Tsung Wang firstname.lastname@example.org
About NCHC NCHC To Become a World-class Supercomputing Center To Become a World-class Supercomputing Center To Promote Global Scientific Discoveries & Technical Innovation To Promote Global Scientific Discoveries & Technical Innovation Fundamental Role Fundamental Role Enabling Role Enabling Role• Provide HPC, storage, and • Provide customized “total networking Facilities solution” to users• Infuse innovative technology; • Perform collaborative research Foster growth of HPC professionals with other institutes; Create technology breakthroughs
HPC Services• Open for academic, research, and Industrial users.• Windrider (a.k.a. ALPS system)- newly deployed supercomputer in 2011; peakperformance: 177 TFLOPS, 442.00 MFLOPS/W ● 25,600 Cores ● 73,728 GB Memory ● 1,074 TB Disk Jun. 2011: Top500 Ranking: No. 42 Green500 Ranking: No. 60 Nov. 2011: Top500 Ranking: No. 60 Green500 Ranking: No. 64Advanced Large-scale Parallel Supercluster IBM Cluster 1350 / 19.91TF HP Superdome2
Research and Education Network• Provides research network, education network (TANet), and optical Lightpath services• Peering with 35 IPv4 and 24 IPv6 networks worldwide• Network availability rate up to 99.991%• Enables dynamic circuit provisioning
Five little Zillas from Free Software Lab @ 2012-12-16 OSC.JP CLOUD 2012National Center for High-performance Computing Software Technology Division / Ezilla Team Jazz Yao-Tsung Wang email@example.com
5 little Zillas in the Cloud Cluster Deployment P2P, P2V, V2V DRBL Clonezilla Diskless Remote Boot in Linux Open Source Cloning SystemProvides a “diskless” and/or A partitioning and disk cloning“systemless” environment for utilities similar to Ghost® and client machines True image® Haduzilla Hadoop DeploymentProvides unattended installation and Provides unattended installation and web management interface for web management interface for virtualization infrastructure Hadoop infrastructure Virtual Machine Big Data Platform Manager (VMM) Provides cluster-based intranet search engine with chinese word segamentation support Application Example
Cloud Architecture Tomcat Nutch Nucth PaaS PaaS Hadoop Hadoop Hadoop VM OS VM OS VM OSWeb Frontend IaaS IaaS VMM VMM Hadoop Hadoop Hypervisor Hypervisor JVM JVM OS OS OS OS Disk Diskless Disk Disk
Brief Introduction to Ezilla Project @ 2012-12-16OSC.JP CLOUD 2012
Pervasive Computing Lab What is Ezilla ？ Ezilla is designed to ◦ A Toolkit to build your Private Cloud ◦ A Toolkit to build Infrastructure as a Service Ezilla provide user a simple web interface to create and access personal virtual desktop Ezilla is based on: ◦ (1) DRBL (Diskless Remote Boot in Linux) ◦ (2) Web Interface ◦ (3) Cloud Middleware ◦ (4) Moosefs ◦ (5) Clonezilla
Pervasive Computing Lab Architecture of Ezilla VM Ezilla Web Interface
Pervasive Computing Lab System Blocks of Ezilla Ezilla Master TM MAD IM MAD VM MAD Libvirt SSH KVM Ezilla Slave
Pervasive Computing Lab Feature #3: Enhanced Web interface Drag and Drop to define your VMs.
Pervasive Computing Lab Feature #4: Port Redirect Middleware
Pervasive Computing Lab EasyCloud : Virtual Classroom Service http://easycloud.nchc.org.tw
Pervasive Computing Lab Work in Progress To support OCCI (Cloud Interop) : Were now based on OpenNebula But will add support to OpenStack via OCCI VM#U1-1 VM#U2-1 rOCCI VM#U1-2 VM#U2-2 OpenNebula OpenStack (Powered by KVM) (Powered by Xen) 21
Pervasive Computing Lab Work in Progress 3. Query Resource Catalog 1. Register 2. Upload 4. Download OpenNebula OpenStack Micro Data Center Mini Data Center VM#U1-1 VM#U1-1 VM#U1-2 VM#U2-2 (Powered by KVM) (Powered by Xen) 22
Pervasive Computing Lab Marketplace Status Report : Once an image is added into the “Marketplace”, users should be able to choose in the D&D, in the near future. 23
Brief Introduction to Haduzilla Project @ 2012-12-16OSC.JP CLOUD 2012 Jazz Yao-Tsung Wang firstname.lastname@example.org
What is Haduzilla ? Haduzilla is consisted with two parts: (1) DRBL-Hadoop and (2) Hadoop4Win. DRBL-Hadoop aim to provide an easy way to deploy Hadoop cluster with DRBL (Diskless Remote Boot in Linux) developed by NCHC. Hadoop4Win is for students to build Hadoop developing environment on Windows.
Haduzilla in production Haduzilla had been deployed at http://hadoop.nchc.org.tw to serve the only public hadoop experimental cluster in Taiwan since June 2009. There are about 2,000+ registed users, executed 150,026 jobs till Nov. 2012.
We use Ganglia for monitoringhttp://hadoop.nchc.org.tw/ganglia