NCHC Hyper Kylin Cloud Platform , SC23

1. NCHC
Hyper Kylin Cloud
Platform
SC 23

2. ● Overview
● Introduction
○ Architecture
○ Services
● Demo Videos
Outline

3. NCHC Hyper Platform : Hyper Kylin
Feature :
• IaaS、PaaS
• Hybrid cloud integration:
○ Private cloud
○ Public ：AWS、Google Cloud、Azure
• Computing
○ Virtual Machine : Openstack
○ Container：Kubernetes
• Service on daemon
○ Computing/Storage/Deployment
• Friendly to manage
○ Monitoring/Alarm/Inspection
Overview

4. Goals:
4
● To build a hyper-converged cloud platform for resource
sharing
○ Easy to use : private/public cloud service
○ Hybrid to use: Cross-cloud, breaking old frameworks
○ Secure to use : integrate CCX private connections to interconnect
three major public clouds
● To enhance the resilience and quality of government critical
service via national-level cloud capacity
○ Utilize public cloud computing and storage resources for expansion
Introduction

5. Cloud Technology / Functionality
5

6. Components / Service Architecture
6
Introduction

7. User Portal Self-Service
7
● Hyper Kylin integrates NCHC authentication service
(iService)
● To provide lots of on-demand services:
○ Virtual machine
○ Kubernetes cluster
○ Storage
○ Network
○ Integrated public clouds

8. Interconnected Public Clouds
● Integrates with AWS
8

9. VM Service
9

10. K8S Service (KaaS)
10
● Support to DEPLOY and MANAGE K8S clusters and container workloads
on VMs, public clouds and baremetal nodes (in the future).

11. User Portal : Self-Service
● https://portal.hci-hybrid.nchc.org.tw/portal
11

12. Demo Videos
● iService Integration and SSH key binding
○ https://youtu.be/M-0IAJM2uO4
Video Source : https://drive.google.com/drive/u/1/folders/1zio2EkO72fuUiltoJh67N8YLBAca3pUb
● Firewall & VM Creation
○ https://youtu.be/VwbriGho9gM
● KaaS in Hyper Kylin
○ https://youtu.be/C2r2l4opy1I

13. Summary
NCHC hybrid cluoud solution
● Hybrid cloud integration:
○ Private : NCHC
○ Public：AWS、Google Cloud、Azure
● Virtualization
○ VMs : Openstacks
○ Container：Kubernetes
● Service on daemon:
○ Computing/Storage/Deployment
○ IaaS (partial as PaaS)
● Monitoring/Alarm/Inspection
Current Usage :
● Users : National Taiwan University, Taiwan government , NCHC Bio Team
and etc..
● Projects - NTU Cool, Bio research, AIoT research and etc..

14. Thank You for listing !
14

15. Appendix

16. Private Connections via CCX
(Chief Cloud eXchange)
16
To create secure / seamless connectivity:
● AWS Direct connect
● GCP Interconnect
● Azure ExpressRoute
seamless connectivity
Introduction

17. Hyper Kylin Hardware Spec.
1. Controller - 3 nodes
2. CPU Computed nodes -16 nodes
a. per node: 768 GB memory
b. per node: 2x86 64 bits CPUs, and per CPU with 24 cores, time clock is
2.4 GHz.
3. Capacity - 2 PB
a. SSD - 0.23 PB
b. HDD - 1.77 PB
4. GPU
a. 2* V100 nodes *1
b. 4*A100 nodes *2

18. FAQ:
1. 目前是否有其他類似 hyper cloud project / service ?
HCI 是有的，但是像是hyper kylin應該是沒有，因為同時混合公私的
雲。
2. Follow q1, 相較之下有何優點 (ex: 1st privoder in Taiwan )？
在高強度的網路保護下，同時兼具私有雲的資料保障，也提供了跨域
之公有雲的選擇。
3. Is it IaaS or PaaS or both ?
both

19. 19
Services
PaaS
COMPUTER VISION - GPU
OBJECT
DETECTION
IMAGE
CLASSIFICATION
SPEECH & AUDIO - GPU
VOICE
RECOGNITION
LANGUAGE
TRANSLATION
NATURAL LANGUAGE
PROCESSING - GPU
RECOMMENDATION
ENGINES
SENTIMENT
ANALYSIS
Kubernetes-as-a-Service
End User
Multi-cloud deployment
Public Cloud
CCX
Single Sign On (SSO)
Hyper Kylin User Portal
Monitoring & Reporting
Self-service – VM & Container
Caffe, Tensorflow, Torch,
Theano, MXNET, Keras, …
Machine Learning Platform
Bins/Libs
Bins/Libs
Bins/Libs
APP
APP
APP
APP
APP
APP
APP
APP
APP
k8s-c1 k8s-c2 k8s-c3
IaaS
Cloud Service Interoperability
Compute Storage Network
NCHC
Data center - Hsinchu Data center - Taichung Data center - Tainan
NCHC Hyper Platform : Hyper Kylin
Feature :
• Hybrid cloud integration:
○ Private : NCHC
○ Public：AWS、Google Cloud、
Azure
• Support Virtualization
○ VMs : Openstacks
○ Container：Kubernetes
• Service/Computing/Deploymen
t on daemon as IaaS (partial as
PaaS)
• Monitoring/Alarm/Inspection
Current Usage :
● Users : National Taiwan
University, NCHC Bio Team
and etc..
● Projects - NTU Cool, Bio
research, AIoT research and
etc..

20. (old)Demo Videos
● iService Integration and SSH key binding
○ https://drive.google.com/file/d/1ls5dMCUcHdXWaMgQqEx8
-IxCi6Ci_E1B/view?usp=drive_link
● Firewall & VM Creation
○ https://drive.google.com/file/d/1fRGSaVgdk_zay_ZIJ_MThIil
8f-8oYKf/view?usp=drive_link
● KaaS in Hyper Kylin
○ https://drive.google.com/file/d/1ls5dMCUcHdXWaMgQqEx8
-IxCi6Ci_E1B/view?usp=drive_link
https://drive.google.com/drive/u/1/folders/1zio2EkO72fuUiltoJh67N8YLBAca3pUb

21. NCHC
Introduction

22. NSTC is a statutory agency of Executive Yuan of the Republic of China (Taiwan) for the
promotion and funding of academic research, development of science and technology and science
parks.
• NARLabs is funded by NSTC
• is a research institution in Taiwan
resulted from the combination of
national laboratories into an
independent nonprofit institute.
Position
1
To establish R&D platforms
To support academic research
To promote frontier science and technology
To foster high-tech manpower
• Founded In 1991
• one of 8 national-level research
laboratories under NARLabs
• NCHC is Taiwan's only national-level
supercomputing center.

23. About NCHC
National Center for High-performance Computing (NCHC)
The NCHC is Taiwan's primary facility for high performance computing (HPC) resources
including large-scale computational science and engineering, cluster and grid computing,
middleware development, visualization and virtual reality, data storage, networking, and
HPC-related training.
The NCHC is also responsible for the operation of
the 100 Gbit/s Taiwan Advanced Research and
Education Network (TWAREN), the national
education and research network of Taiwan.
The NCHC supports local academia and industry
with hardware and software, advanced research and
application development, and professional training.

24. Vision and Mission
Be the Taiwan AI-HPC Enhancer
Enable Scientific Discoveries & Technical
Innovation through prospective computing
technology and platform
2
• Building World Class HPC, AI
& Big Data Platform
• Together, Stronger with
Customers
Industries
Government
NCHC
Academic

25. NCHC Milestone
1991
Taiwan’s first
National level
supercomputer
Center
1993
Hsinchu
Headquarters
2003
NPO under
NARLabs
2004
TWAREN
Services 10G
2005
Tainan Office
2008
Taichung
Office
2016
100G Network
Backbone
2017
1.7+ PF
2011
177 TF ALPS
Supercomputer
Hsin Chu
Headquarters Taichung Office Tainan Office
✔ ISO 9001 (Plus Award)
✔ ISO 27001
✔ ISO27017
✔ ISO27018
2018
9PF AI-HPC
2019 AI Platform
3
2021 2.3+ PF
✔ ISO20000
✔ CSA STAR Level 2 Gold Award
✔ BS 10012
✔ DCOS(2021)
Certifications
IBM SP2/80
TOP500 #76
(1996/6)
14 GFLOPS
IBM P690
TOP500 #60
(2002/6)
590 GFLOPS
Formosa 1
TOP500
#135
(2003/6)
973 GFLOPS
IBM Cluster 1350
TOP500 #35
(2007/6)
19.9 TFLOPS

26. AI and cloud resources
single service portal
NCHC AI Platform : TWCC
On demand
Computing and
storage environment
Customized
AI Solution
High convenience and
high performance
Containerized
computing environment
AI*Big Data*HPC
Integrated cloud service
platform
Top performance
Beyond the self-built cloud
platform 1.72 times
Multi-level security
Network security protection
17
IaaS