Build Your Own Private Cloud  with Ezilla and Haduzilla                                    @ 2012-12-16        OSC.JP CLOU...
Agenda➢Breif Introduction to NCHC➢Five little Zillas from Free Software Lab➢Brief Introduction to Ezilla Project➢Brief Int...
Breif Introduction to NCHC                                    @ 2012-12-16        OSC.JP CLOUD 2012National Center for Hig...
About NCHC                                   NCHC          To Become a World-class Supercomputing Center           To Beco...
HPC Services• Open for academic, research, and Industrial users.• Windrider (a.k.a. ALPS system)- newly deployed supercomp...
Research and Education Network•   Provides  research  network,        education    network (TANet), and optical        Lig...
Five little Zillas        from Free Software Lab                                    @ 2012-12-16        OSC.JP CLOUD 2012N...
5 little Zillas in the Cloud             Cluster Deployment                            P2P, P2V, V2V               DRBL   ...
Cloud Architecture                Tomcat      Nutch    Nucth                                              PaaS            ...
Brief Introduction to    Ezilla Project                  @ 2012-12-16OSC.JP CLOUD 2012
Pervasive Computing Lab                          What is Ezilla ?                          Ezilla   is designed to       ...
Pervasive Computing Lab                          Architecture of Ezilla                                                   ...
Pervasive Computing Lab   System Blocks of Ezilla                                                      Ezilla Master      ...
Pervasive Computing Lab   Feature #1: Unattaned Installation                                                  Virtual Mach...
Pervasive Computing Lab   Feature #2: Parallel File System                                                         Virtual...
Pervasive Computing Lab                      Based on Sun Stone
Pervasive Computing Lab                      Normal User Dashboard
Pervasive Computing Lab   Feature #3: Enhanced Web interface                               Drag and Drop to define your VMs.
Pervasive Computing Lab   Feature #4: Port Redirect Middleware
Pervasive Computing Lab   EasyCloud : Virtual Classroom Service                              http://easycloud.nchc.org.tw
Pervasive Computing Lab   Work in Progress                           To support OCCI (Cloud Interop) :                    ...
Pervasive Computing Lab                          Work in Progress                                                         ...
Pervasive Computing Lab   Marketplace                                                        Status Report :             ...
Pervasive Computing Lab                          More information                          Official  Website             ...
Brief Introduction to Haduzilla Project                       @ 2012-12-16OSC.JP CLOUD 2012        Jazz Yao-Tsung Wang    ...
What is Haduzilla ? Haduzilla is consisted with two parts:  (1) DRBL-Hadoop and (2) Hadoop4Win. DRBL-Hadoop aim to provi...
DRBL-Hadoop System Architecture
Haduzilla in production       Haduzilla had been deployed       at http://hadoop.nchc.org.tw to       serve the only publi...
We use Ganglia for monitoringhttp://hadoop.nchc.org.tw/ganglia
We designed a web interface for user-login
Hadoop4Win      Hadoop4Win is a     windows installer for      beginner to learn     Hadoop Ecosystem.         Download fr...
Questions ? Demo ?Welcome to our booth for more detailsOr drop me a line – jazz@nchc.org.tw
Upcoming SlideShare
Loading in …5
×

Build Your Private Cloud with Ezilla and Haduzilla

1,368 views

Published on

Introduction to NCHC Ezilla and Haduzilla project in OSC.JP CLOUD 2012 Tokyo
https://www.ospn.jp/osc2012.cloud/modules/eventrsv/?id=1&noform=1

Published in: Education
  • Be the first to comment

  • Be the first to like this

Build Your Private Cloud with Ezilla and Haduzilla

  1. 1. Build Your Own Private Cloud with Ezilla and Haduzilla @ 2012-12-16 OSC.JP CLOUD 2012National Center for High-performance Computing Software Technology Division / Ezilla Team Jazz Yao-Tsung Wang jazz@nchc.narl.org.tw
  2. 2. Agenda➢Breif Introduction to NCHC➢Five little Zillas from Free Software Lab➢Brief Introduction to Ezilla Project➢Brief Introduction to Haduzilla Project
  3. 3. Breif Introduction to NCHC @ 2012-12-16 OSC.JP CLOUD 2012National Center for High-performance Computing Software Technology Division / Ezilla Team Jazz Yao-Tsung Wang jazz@nchc.narl.org.tw
  4. 4. About NCHC NCHC To Become a World-class Supercomputing Center To Become a World-class Supercomputing Center To Promote Global Scientific Discoveries & Technical Innovation To Promote Global Scientific Discoveries & Technical Innovation Fundamental Role Fundamental Role Enabling Role Enabling Role• Provide HPC, storage, and • Provide customized “total networking Facilities solution” to users• Infuse innovative technology; • Perform collaborative research Foster growth of HPC professionals with other institutes; Create technology breakthroughs
  5. 5. HPC Services• Open for academic, research, and Industrial users.• Windrider (a.k.a. ALPS system)- newly deployed supercomputer in 2011; peakperformance: 177 TFLOPS, 442.00 MFLOPS/W ● 25,600 Cores ● 73,728 GB Memory ● 1,074 TB Disk Jun. 2011: Top500 Ranking: No. 42 Green500 Ranking: No. 60 Nov. 2011: Top500 Ranking: No. 60 Green500 Ranking: No. 64Advanced Large-scale Parallel Supercluster IBM Cluster 1350 / 19.91TF HP Superdome2
  6. 6. Research and Education Network• Provides research network, education network (TANet), and optical Lightpath services• Peering with 35 IPv4 and 24 IPv6 networks worldwide• Network availability rate up to 99.991%• Enables dynamic circuit provisioning
  7. 7. Five little Zillas from Free Software Lab @ 2012-12-16 OSC.JP CLOUD 2012National Center for High-performance Computing Software Technology Division / Ezilla Team Jazz Yao-Tsung Wang jazz@nchc.narl.org.tw
  8. 8. 5 little Zillas in the Cloud Cluster Deployment P2P, P2V, V2V DRBL Clonezilla Diskless Remote Boot in Linux Open Source Cloning SystemProvides a “diskless” and/or A partitioning and disk cloning“systemless” environment for utilities similar to Ghost® and client machines True image® Haduzilla Hadoop DeploymentProvides unattended installation and Provides unattended installation and web management interface for web management interface for virtualization infrastructure Hadoop infrastructure Virtual Machine Big Data Platform Manager (VMM) Provides cluster-based intranet search engine with chinese word segamentation support Application Example
  9. 9. Cloud Architecture Tomcat Nutch Nucth PaaS PaaS Hadoop Hadoop Hadoop VM OS VM OS VM OSWeb Frontend IaaS IaaS VMM VMM Hadoop Hadoop Hypervisor Hypervisor JVM JVM OS OS OS OS Disk Diskless Disk Disk
  10. 10. Brief Introduction to Ezilla Project @ 2012-12-16OSC.JP CLOUD 2012
  11. 11. Pervasive Computing Lab What is Ezilla ? Ezilla is designed to ◦ A Toolkit to build your Private Cloud ◦ A Toolkit to build Infrastructure as a Service Ezilla provide user a simple web interface to create and access personal virtual desktop Ezilla is based on: ◦ (1) DRBL (Diskless Remote Boot in Linux) ◦ (2) Web Interface ◦ (3) Cloud Middleware ◦ (4) Moosefs ◦ (5) Clonezilla
  12. 12. Pervasive Computing Lab Architecture of Ezilla VM Ezilla Web Interface
  13. 13. Pervasive Computing Lab System Blocks of Ezilla Ezilla Master TM MAD IM MAD VM MAD Libvirt SSH KVM Ezilla Slave
  14. 14. Pervasive Computing Lab Feature #1: Unattaned Installation Virtual Machines Ezilla WebOS
  15. 15. Pervasive Computing Lab Feature #2: Parallel File System Virtual Machines Ezilla Web Interface
  16. 16. Pervasive Computing Lab Based on Sun Stone
  17. 17. Pervasive Computing Lab Normal User Dashboard
  18. 18. Pervasive Computing Lab Feature #3: Enhanced Web interface Drag and Drop to define your VMs.
  19. 19. Pervasive Computing Lab Feature #4: Port Redirect Middleware
  20. 20. Pervasive Computing Lab EasyCloud : Virtual Classroom Service http://easycloud.nchc.org.tw
  21. 21. Pervasive Computing Lab Work in Progress To support OCCI (Cloud Interop) :  Were now based on OpenNebula  But will add support to OpenStack via OCCI VM#U1-1 VM#U2-1 rOCCI VM#U1-2 VM#U2-2 OpenNebula OpenStack (Powered by KVM) (Powered by Xen) 21
  22. 22. Pervasive Computing Lab Work in Progress 3. Query Resource Catalog 1. Register 2. Upload 4. Download OpenNebula OpenStack Micro Data Center Mini Data Center VM#U1-1 VM#U1-1 VM#U1-2 VM#U2-2 (Powered by KVM) (Powered by Xen) 22
  23. 23. Pervasive Computing Lab Marketplace  Status Report :  Once an image is added into the “Marketplace”, users should be able to choose in the D&D, in the near future. 23
  24. 24. Pervasive Computing Lab More information Official Website ◦ http://ezilla.nchc.org.tw ◦ http://ezilla.info Public IaaS portal ◦ http://easycloud.nchc.org.tw Sourceforge ◦ http://ezilla-nchc.sf.net Developers ◦ http://percomp.nchc.org.tw
  25. 25. Brief Introduction to Haduzilla Project @ 2012-12-16OSC.JP CLOUD 2012 Jazz Yao-Tsung Wang jazz@nchc.narl.org.tw
  26. 26. What is Haduzilla ? Haduzilla is consisted with two parts: (1) DRBL-Hadoop and (2) Hadoop4Win. DRBL-Hadoop aim to provide an easy way to deploy Hadoop cluster with DRBL (Diskless Remote Boot in Linux) developed by NCHC. Hadoop4Win is for students to build Hadoop developing environment on Windows.
  27. 27. DRBL-Hadoop System Architecture
  28. 28. Haduzilla in production Haduzilla had been deployed at http://hadoop.nchc.org.tw to serve the only public hadoop experimental cluster in Taiwan since June 2009. There are about 2,000+ registed users, executed 150,026 jobs till Nov. 2012.
  29. 29. We use Ganglia for monitoringhttp://hadoop.nchc.org.tw/ganglia
  30. 30. We designed a web interface for user-login
  31. 31. Hadoop4Win Hadoop4Win is a windows installer for beginner to learn Hadoop Ecosystem. Download from http://hadoop4win.sf.net
  32. 32. Questions ? Demo ?Welcome to our booth for more detailsOr drop me a line – jazz@nchc.org.tw

×